JP4652099B2 - Image display device, image display method, image display program, and recording medium - Google Patents

Description

  The present invention relates to an image display device, an image display method, an image display program, and a recording medium that display road signs, advertisement signs, and the like on a display screen. However, the present invention is not limited to the above-described image display device, image display method, image display program, and recording medium.

  In recent years, for example, road signs on roads and advertising signs set along the roads are photographed with an electronic camera and displayed on the in-car monitor to immediately check the road signs and advertising signs that the driver overlooked. A travel information recording / reproducing apparatus, a road sign reading apparatus, and a navigation apparatus are provided.

  Such a conventional traveling information recording / reproducing apparatus captures a road sign around the traveling road by using, for example, a video camera, extracts a road sign image from the captured image signal by a video signal processing unit, and stores it in a storage unit. Then, when there is a request to retrieve the stored road sign image from the remote controller, the CPU retrieves the road sign image from the storage unit and displays it on the liquid crystal display. Therefore, even when a road sign is overlooked, it is possible to immediately display a road sign that has passed, and to obtain appropriate traveling information (see, for example, Patent Document 1).

  Further, such a conventional road sign reading device includes, for example, a two-dimensional image sensor for inputting a road sign image, an image processing CPU for generating text data of characters and symbols from the input image data, and text data as a character string. A CPU for language processing that converts data into speech, a DSP for speech synthesis that synthesizes character string data into speech data, a D / A conversion circuit that converts speech data into speech signals, and a speaker that emits speech signals as speech. . Therefore, within a short period of time passing through the location of the road sign, the information indicated by the road sign can be reliably captured without being overlooked, and can be converted to voice and transmitted to the driver (for example, , See Patent Document 2).

  In addition, such a conventional navigation apparatus presents a two-dimensional code on a facility signboard or the like. In the two-dimensional code, information on facilities such as facility ID, company name, chain name, business type, store name, telephone number, location, coordinate data, regular holiday, business hours, and handling items are recorded. Then, the facility search condition is set in the navigation body, and the facility search is started. When the two-dimensional code reader reads the two-dimensional code, it is determined whether or not the information regarding the facility included in the read two-dimensional code satisfies the set search condition. When the search condition is satisfied, the search facility discovery is notified from the display device and the speaker. Therefore, the target facility and its signboard can be read electronically, and the time taken to discover the target facility can be shortened by reducing aside driving and oversight (for example, Patent Document 3). See).

JP 2003-329464 A JP-A-5-174294 JP 2001-82971 A

  However, the travel information recording / reproducing apparatus described in Patent Document 1 can immediately display the captured road sign image on the display and complement the oversight of the road sign, but captures the rear of the vehicle. One example is the problem that the road sign image obtained in this way cannot be used more effectively and displayed on the display to compensate for oversight of the road sign.

  In the road sign reading device and the navigation apparatus described in Patent Document 2 and Patent Document 3 described above, a road sign image obtained by photographing the rear of the vehicle is further effectively displayed and displayed on the display. An example is the problem that signs and oversight of target facilities cannot be supplemented.

  An image display apparatus according to a first aspect of the present invention includes an input unit that receives an input of a route guidance image that is taken from the rear to the rear of the vehicle and that is in a direction opposite to the traveling direction of the vehicle, and the input unit. By reversing the left and right of the input route guidance image, the first inversion means for generating the first inversion image and the first inversion image obtained by the first inversion means A specifying means for specifying an image; a second inversion means for generating a second inverted image by inverting the image relating to the character specified by the specifying means; and the second inversion means obtained by the second inversion means. And a display means for displaying two inverted images.

  The image display method according to the invention of claim 5 is the image display method of the image display device, wherein the route guidance image taken in the direction opposite to the traveling direction of the vehicle is taken from the rear to the rear of the vehicle. An input process for inputting, a first inversion process for generating a first inverted image by inverting the left and right of the route guidance image input in the input process, and a first obtained by the first inversion process A specifying step of specifying an image relating to a character from among the one inverted image, a second inversion step of generating a second inverted image by inverting the image relating to the character specified by the specifying step, And a display step for displaying the second reverse image obtained by the second reverse step.

  An image display program according to a sixth aspect of the invention causes a computer to execute the image display processing method according to the fifth aspect.

  A recording medium according to a seventh aspect of the invention is characterized in that the image display program according to the sixth aspect is recorded in a computer-readable manner.

  Exemplary embodiments of an image display device, an image display method, an image display program, and a recording medium according to the present invention will be described below in detail with reference to the accompanying drawings.

(Embodiment)
(Functional configuration of image display device)
First, the contents of the image display device according to the embodiment of the present invention will be described. FIG. 1 is a block diagram showing an example of a functional configuration of an image display apparatus according to an embodiment of the present invention. In FIG. 1, the image display device is mounted on a moving body such as a vehicle (including a four-wheeled vehicle and a two-wheeled vehicle), for example, and includes an input unit 101, a first reversing unit 102, a specifying unit 103, and a second reversing unit. It includes a section 104, a display section 105, and an erasing section 106, and further includes a photographing section 107.

  For example, the input unit 101 receives an input of a route guidance image captured from the rear of the vehicle by the imaging unit 107. The route guidance image specifically refers to an image for guiding the route of the vehicle such as a road sign image, a road structure image, and an advertisement signboard image, and is at least one of these.

  Among the route guidance images input by the input unit 101, a road sign image refers to an image representing a display board showing traffic regulations, etc., which is installed by, for example, a public safety committee or a road manager. Specifically, this sign image and the auxiliary sign image are included. A road structure image refers to a structure such as a member straddling a road, a member covering a travel lane, a bridge, a road surface (road pavement), a tunnel, and specifically includes a traffic light, a white road line, a power pole, etc. It is. The advertisement signboard image refers to an image related to an advertisement signboard provided on or around the road, and specifically includes a facility information signboard provided on a utility pole or the like.

  The first inversion unit 102 generates a first inversion image by inverting the left and right of the route guidance image input by the input unit 101. Specifically, for example, when a display unit 105 to be described later is provided on the front side of the vehicle and the route guidance image input by the input unit 101 is displayed as it is on the display unit 105, it is left and right for the vehicle user. Since different route guidance images are displayed, a first reverse image in a state where the left and right sides of the route guidance image are reversed is generated.

  The specifying unit 103 specifies an image related to characters from the first inverted image obtained by the first inversion unit 102. Specifically, for example, when the first reverse image is a guide sign among the main signs included in the road sign, the image relating to the character, such as a destination name or a place name drawn on the guide sign, An image of a predetermined range including the characters.

  The second inversion unit 104 generates a second inverted image by inverting the image related to the character specified by the specifying unit 103. Specifically, for example, when the display unit 105 is provided on the front side of the vehicle and the first inverted image obtained by the first inversion unit 102 is displayed on the display unit 105 as it is, it is useful for the vehicle user. Since the first reverse image is displayed in the state where the image related to the character is inverted, the second reverse image is generated in the state where the image related to the character specified by the specifying unit 103 is inverted in the first reverse image. . An example of the inversion processing by the second inversion unit 104 is left-right inversion.

  The display unit 105 displays the second inverted image obtained by the second inversion unit 104. Specifically, for example, when the display unit 105 is provided on the front side of the vehicle, a second inverted image is displayed in which the left-right direction of the route guidance image is inverted and the left-right direction of the image relating to characters is inverted. In addition, the display unit 105 displays an image related to the traveling direction of the vehicle in the second reverse image obtained by the second reverse unit 104 at a symmetrical position in the second reverse image. The erasing unit 106 erases an image related to the traveling direction of the vehicle from the second inverted image obtained by the second inverting unit 104. The second reverse image obtained by erasing the image related to the traveling direction of the vehicle by the erasing unit 106 is displayed on the display unit 105.

  Here, specifically, the image relating to the traveling direction of the vehicle includes, for example, an image relating to characters representing the front and rear of the vehicle and an image representing the direction of the arrow. Thereby, in the 2nd reverse image obtained by the 2nd reverse part 104, it can prevent displaying the image about the advancing direction different from the actual advancing direction of vehicles. The photographing unit 107 photographs the rear of the vehicle. Specifically, the imaging unit 107 captures a route guidance image behind the vehicle, for example. The route guidance image photographed by the photographing unit 107 is input to the input unit 101.

  In the image display device configured as described above, the route guidance image input by the input unit 101 is horizontally reversed by the first reversing unit 102, and characters are selected from the first reversed image that is horizontally reversed by the specifying unit 103. By identifying the image related to the vehicle and generating the second inverted image by inverting the image related to the character by the second reversing unit 104, the route guidance image behind the vehicle can be displayed on the display unit 105 without a sense of incongruity. . For this reason, according to this image display device, it is possible to display information using a route guidance image such as a road sign image or an advertisement signboard image behind the vehicle, and to improve convenience for the user of the vehicle. it can.

(Image display processing procedure of image display device)
Next, an image display processing procedure of the image display apparatus according to the embodiment of the present invention will be described. FIG. 2 is a flowchart showing an example of an image display processing procedure of the image display apparatus according to the embodiment of the present invention.

  In the flowchart of FIG. 2, first, the route guidance image obtained by photographing the rear of the vehicle by the photographing unit 107, for example, is input by the input unit 101 (step S201). Next, the first inversion unit 102 inverts the left and right of the input route guidance image to generate a first inversion image (step S202).

  Then, the image relating to the character is identified from the first inverted image obtained by the first reversing unit 102 by the identifying unit 103 (step S203), and identified by the identifying unit 103 by the second reversing unit 104. The second inverted image is generated by inverting the image relating to the character (step S204).

  Finally, the display unit 105 displays the second inverted image obtained by the second inversion unit 104 (step S205), and the route guidance image is displayed. Thus, a series of image display processing according to this flowchart is completed. Although illustration and description are omitted, in step S204, the second inverted image obtained by the second inversion unit 104 is used, and the erasing unit 106 uses the second inverted image to relate to the traveling direction of the vehicle. The image may be erased. In step S205, the display unit 105 may display an image related to the traveling direction of the vehicle in the second reverse image at a symmetrical position in the second reverse image.

  By performing the image display processing in this way, the route guidance image behind the vehicle is reversed left and right to generate a first inverted image, the image related to the character is specified from the image, and the image related to the specified character is inverted. By doing so, it is possible to generate the second reverse image and display the route guidance image behind the vehicle without a sense of incongruity. For this reason, according to this image display process, information display is performed using a route guidance image such as a road sign image or an advertisement signboard image behind the vehicle, and the convenience of the user of the vehicle can be improved.

  As described above, according to the image display device according to the embodiment of the present invention, the route guidance image behind the vehicle can be displayed without a sense of incongruity. For this reason, it is possible to display information using a route guidance image such as a road sign image or an advertisement signboard image behind the vehicle, and it is possible to improve convenience for the user of the vehicle.

  Next, Example 1 and Example 2 according to the embodiment of the present invention will be described in detail. Here, a case where the image display device according to this embodiment is applied to an in-vehicle navigation device will be described as an example.

(Explanation inside the vehicle equipped with the image display device)
First, the inside of a vehicle equipped with an image display apparatus according to Embodiment 1 of the present invention will be described. FIG. 3 is an explanatory diagram showing an example of the interior of the vehicle in which the image display apparatus according to the first embodiment of the present invention is mounted. In FIG. 3, for example, around the driver's seat 311 and the passenger seat 312 are provided a monitor 302a as the display unit 105 in FIG. Further, the passenger seat 312 is provided with a monitor 302b as the display unit 105 for a passenger on the rear seat 313.

  In addition, the in-car mirror 315 of the ceiling 314 of the vehicle is provided with a photographing device (camera) 317 as the photographing unit 107 in FIG. 1 for photographing the front of the vehicle, for example. Further, the left and right side mirrors 316 are, for example, a photographing device (camera) 317 as the photographing unit 107 in FIG. 1 for photographing the rear of the vehicle and a photographing device as the photographing unit 107 in FIG. 1 for photographing the side of the vehicle. (Camera) 318 is provided. The image display processing device 300 (300a, 300b) includes these monitors 302 (302a, 302b), a speaker 304, and photographing devices 317, 318. Note that the photographing device 317 may be provided at any position on the vehicle as long as it can capture the front and rear of the vehicle. The image display device 300 (300a, 300b) may have a structure that can be attached to and detached from the vehicle.

(Hardware configuration of image display device)
Next, a hardware configuration of the image display apparatus according to Embodiment 1 of the present invention will be described. FIG. 4 is a block diagram illustrating an example of a hardware configuration of the image display apparatus according to Embodiment 1 of the present invention. In the following, the same parts as those already described are denoted by the same reference numerals and the description thereof is omitted.

  4, as described above, the image display device 300 is mounted on a vehicle in a detachable manner, for example, and includes a navigation control unit 400, a user operation unit (remote control, touch panel) 406, an image circuit 407, Display screen (display) 408, recording medium (HD, DVD, etc.) 409, recording medium decoding unit (drive) 410, guidance sound output unit 411, speaker 412, guidance sound generation unit 413, and communication unit 414 A route search unit 415, a route guidance unit 416, an audio processing unit 417, an image processing unit 418, an image input / output interface (I / F) 419, a photographing unit (camera) 420, and an acquisition unit 430. , And includes a database 442 (hereinafter referred to as “DB”) such as map information.

  The navigation control unit 400 controls the entire image display device 300, for example, and performs various arithmetic processes according to a control program and the like, thereby comprehensively controlling each unit included in the image display device 300. The navigation control unit 400 includes a CPU (Central Processing Unit) 401, a RAM (Random Access Memory) 402, a ROM (Read Only Memory) 403, a memory 404, and a clock 405. The navigation control unit 400 can be realized by a microcomputer, for example.

  The CPU 401 of the navigation control unit 400 executes, for example, predetermined calculation processing. The RAM 402 stores so-called variable information in a rewritable manner and functions as a work area for the CPU 401. The RAM 402 may be a volatile memory that erases information stored when the power is turned off, for example, or may be a non-volatile memory that is backed up by a battery or the like.

  The ROM 403 stores so-called fixed information such as a boot program. Here, specifically, a basic processing program of the image display apparatus 300 is stored. The data stored in the ROM 403 can be rewritten by a user operation, but is not erased by turning off the power.

  The memory 404 stores various information such as route guidance images such as road sign images and advertisement signboard images, and calculation processing results. Specifically, the memory 404 is a flash memory that is fixed or detachable with respect to the navigation control unit 400, and instead of or in addition to the flash memory, an HD (Hard Disk), an optical disk (CD-ROM (CD-ROM)). R, CD-RW), MO (Magneto-Optical disk), DVD (Digital Versatile Disk), etc. may be a detachable recording medium, and the clock 405 provides information on the current time of the image display device 300. Time and memorize.

  The navigation control unit 400, for example, at the time of vehicle route guidance regarding the navigation function, information on the current location of the vehicle (current location information) acquired by the GPS 437 of the acquisition unit 430, which will be described later, and the recording medium decoding unit 410 from the recording medium 409. Based on the map information obtained through the network, the map information obtained from the server 441 via the network 440 or from the DB 442, it is calculated which position on the map the vehicle is traveling, etc. The data is output to the display screen 408 through the circuit 407.

  The navigation control unit 400 inputs / outputs information related to vehicle route guidance between a route search unit 415, a route guidance unit 416, and a guidance sound generation unit 413, which will be described later, and obtains the result. Information is output to the display screen 408 and the guidance sound output unit 411.

  The user operation unit 406 outputs input information input by the user such as characters, numerical values, and various instructions to the navigation control unit 400. The configuration of the user operation unit 406 includes, for example, a push button switch that detects physical depression / non-depression, a touch panel, a keyboard, a joystick, a trackball, a remote controller, and other various input operations provided in the image display device 300. The function is realized by being configured in various known forms such as detection switches or a combination thereof.

  In addition, the user operation unit 406 may be configured to accept input of information by an input operation using sound, for example, using a sound input device such as a microphone for inputting sound from the outside of the image display device 300. As described above, a user such as a vehicle driver can input information to the image display device 300 by appropriately performing an input operation according to the form of the user operation unit 406.

  The input information input by the input operation to the user operation unit 406 includes, for example, information related to the designation of the destination point regarding the navigation function. Specifically, for example, when the image display device 300 is provided in an in-vehicle navigation device or the like as described above, a destination point to be reached by a user such as a driver or a passenger of the vehicle is designated. This destination point is set in the navigation device.

  Further, as input information input by the user operation unit 406, for example, regarding image display processing on the display screen 408, information on selection and display of a route guidance image such as a displayed road sign image or an advertisement signboard image, and the like. Can be mentioned. Specifically, for example, the route guidance image desired by the user of the vehicle is selected, and the route guidance image is displayed in the desired display form (display position of the route guidance image) and display timing. 300 is set.

  Here, for example, when a touch panel is adopted as the form of the user operation unit 406, the touch panel is used by being stacked on the display screen 408, for example. In this case, the display timing of the route guidance image or the map image on the display screen 408, the operation timing of the user with respect to the touch panel (user operation unit 406), and the position coordinates thereof are managed, and input by the user input operation. Recognize input information.

  As described above, by adopting a touch panel stacked on the display screen 408 as a form of the user operation unit 406, a large amount of information input can be input to the image processing apparatus 300 without increasing the form of the user operation unit 406. You will be able to do it. In addition, as this touch panel, various well-known touch panels, such as a resistive film type and a pressure sensitive type, can be employed, for example.

  The image circuit 407 displays a route guidance image, a map image for navigation, or the like based on map information read from a recording medium 409, which will be described later, or image information output from the image processing unit 418, for example. Drawing processing is performed so as to optimally display on the screen 408, and the processed image information is output to the display screen 408.

  Specifically, the image circuit 407 temporarily holds (stores), for example, a graphic controller that controls the entire display screen 408 and image information such as images and characters that can be displayed immediately on the display screen 408. ) A buffer memory such as a VRAM (Video RAM) and a control IC (Integrated Circuit) that controls image display processing on the display screen 408 based on information output from the graphic controller, a GPU (Graphics Processing Unit), etc. Consists of.

  The display screen 408 includes, for example, a CRT (Cathode Ray Tube), a TFT (Thin Film Transistor) liquid crystal display, an organic EL (Electroluminescence) display, a plasma display, and the like. Specifically, the display screen 408 can be configured by, for example, an image I / F (not shown) or a dedicated display device for image display connected to the image I / F. The display screen 408 displays various information such as icons, cursors, menus, windows, or characters and images. Further, on the display screen 408, a route guidance image such as a road sign image and an advertisement signboard image based on image information from the image circuit 407, a map image, and the like are displayed as described above.

  The recording medium 409 records various control programs and various information in a state that can be read by a computer, for example. The recording medium 409 accepts writing of various information by the recording medium decoding unit 410 and records the written various information in a nonvolatile manner. This recording medium 409 can be realized by the above-described HD, for example.

  The recording medium 409 is not limited to the HD, and can be attached to and detached from the recording medium decoding unit 410 such as various optical disks (DVD and CD (Compact Disk)) instead of or in addition to HD. A medium having a structure and having portability may be used as the recording medium 409. The recording medium 409 is not limited to the above-described DVD or CD, but has a structure that can be attached to and detached from the recording medium decoding unit 410 such as a CD-ROM (CD-R, CD-RW), MO, or memory card. A portable medium can also be used.

  Here, the recording medium 409 stores, for example, an image display program, a navigation program, various image information, audio information, map information, and the like that realize the present invention. The image information is a two-dimensional array value representing an image representing a road sign or an advertising signboard or an image representing map information, for example. Audio information is information for reproducing sound (music) such as music. Say. The map information includes, as information included in the map information, background information representing features (features) such as buildings, rivers, and the ground surface, and road shape information representing the shape of the road. In the display screen 408, the information is drawn two-dimensionally or three-dimensionally.

  The background information includes background shape information representing the shape of the background and background type information representing the type of the background. The background shape information includes information indicating, for example, representative points of features, polylines, polygons, coordinates of features, and the like. The background type information includes, for example, text information indicating the name, address, and telephone number of the feature, type information indicating the type of the feature such as a building or a river.

  The road shape information is information relating to a road network having a plurality of nodes and links. The node is information related to an intersection where a plurality of roads such as a three-way, a crossroad, and a five-way cross. A link is information indicating a road connecting nodes. Some of these links have shape interpolation points that allow the expression of curved roads. Further, the road shape information includes traffic condition information. This traffic condition information is information indicating the characteristics of the intersection, the length (distance) of each link, the vehicle width, the traveling direction, the traffic prohibition, the road type, and the like.

  The traffic condition information includes road sign information, for example. A road sign refers to a display board that is installed by, for example, a public security committee or a road manager and indicates traffic regulations, and specifically includes a main sign and an auxiliary sign. This main sign includes, for example, a regulation sign, an instruction sign, a warning sign, and a guidance sign.

  Here, the restriction sign is a sign that prohibits a specific traffic method or instructs to travel according to a specific traffic method. In addition, the instruction sign is a sign indicating that a specific transportation method is possible, a place determined in terms of road traffic, and the like. Further, the warning sign is a sign for notifying road users in advance of road hazards and situations to be alerted, etc., to call attention. Further, the guide sign is a sign that indicates the name, direction, distance, etc. of the point to facilitate transportation.

  In addition, auxiliary signs are installed below the signs to supplement the meaning of the signs such as regulatory signs, indicating the reason for the regulations, the time when the regulations are applied, the day of the week, the type of car, etc. It is a sign to identify. The guide signs include guide signs for landmarks, museums, art galleries, amusement parks, golf courses, etc., in addition to those stipulated by traffic rules.

  The background information includes, for example, road structure information. The road structure refers to a structure such as a member straddling a road, a member covering a traveling lane, a bridge, a road surface (road pavement), a tunnel, and the like, and includes a traffic light, a white road, a utility pole, and the like. Furthermore, the background information may include, for example, advertisement signboard information. The advertisement signboard refers to, for example, an advertisement signboard provided on or around the road, and specifically includes signboards such as facility information signs provided on power poles and place name information signs installed along the road. As described above, in the first embodiment, the road sign information, the road structure information, and the advertisement signboard information may be included in association with the map information.

  Here, the characteristics of the intersection include, for example, intersections with complicated shapes such as three-way and five-way intersections, intersections where the road branches at a shallow angle, intersections around the destination point, highway entrances and junctions, route deviation rate High intersections and so on. The route departure rate can be calculated from a past travel history, for example. Examples of the road type include an expressway, a toll road, and a general road.

  In the first embodiment, for example, image information and map information are recorded on the recording medium 409. However, the present invention is not limited to this. Image information, map information, and the like may be stored in a storage device such as the memory 404 provided in the navigation control unit 400, for example, or limited to those provided integrally with the hardware of the image display device 300. May be provided outside the image display apparatus 300. When provided externally, for example, information communication is performed with an external storage device via a communication unit 414, which will be described later, or with an external server 441 via a network 440 to acquire image information, map information, and the like. May be. Moreover, you may make it utilize the image information and map information accumulate | stored in DB442 mentioned later.

  The recording medium decoding unit 410 controls reading / writing (reading / writing) of various information with respect to the recording medium 409. When, for example, an HD is used as the recording medium 409, the recording medium decoding unit 410 is an HDD (Hard Disk Drive). At the same time, when a DVD or CD (including CD-R and CD-RW) is used as the recording medium 409, the recording medium decoding unit 410 is a drive device such as a DVD drive or a CD drive.

  When a CD-ROM (CD-R, CD-RW), MO, memory card, or the like is used as the writable and detachable recording medium 409, writing to various recording media 409 or various recording media is possible. A dedicated drive device that can read the information recorded in 409 may be appropriately used as the recording medium decoding unit 410.

  The guidance sound output unit 411 reproduces navigation guidance sounds by controlling output to the connected speaker 412, for example. The speaker 412 is composed of one or a plurality of speakers. Specifically, the guidance sound output unit 411 can be realized by a voice I / F (not shown) connected to a speaker 412 for voice output, for example. More specifically, the audio I / F includes, for example, a D / A converter that performs D / A conversion of a digital audio signal, an amplifier that amplifies an analog audio signal output from the D / A converter, and an analog audio signal An A / D converter that performs A / D conversion can be used.

  The speaker 412 reproduces (outputs) navigation guidance sound output from the guidance sound output unit 411 and sound output from the sound processing unit 417 described later. For example, headphones or the like may be provided instead of the speaker 412 or together with the speaker 412, so that the output form of the guidance sound or voice is appropriately changed so as not to be the sound field of the guidance sound output from the entire vehicle interior. It may be.

  The guide sound generator 413 generates tone and voice information corresponding to various patterns. That is, based on route guidance information generated by a route guidance unit 416, which will be described later, a virtual sound source corresponding to the guidance point is set and voice guidance information is generated, and the guidance sound output unit is provided via the navigation control unit 400. To 411. In addition, the guidance sound generation unit 413 may generate voice guidance information that guides the vehicle in accordance with, for example, an image displayed on the display screen 408 during navigation.

  The communication unit 414 is connected to the network 440 through a communication line (not shown), for example, and is connected to an external server 441 or the like via the network 440. The communication unit 414 serves as an interface between the network 440 and the image display device 300 and controls input / output of various information to and from the image display device 300. The communication unit 414 may be configured with a modem or a LAN adapter, for example. Here, when the communication unit 414 has a function of a communication interface (I / F), various types of information are transmitted and received between the image display apparatus 300 and another device such as a remote control device.

  In this case, transmission / reception of various types of information in the communication unit 414 is performed regardless of wired or wireless, for example. The communication unit 414 of this embodiment may be a communication module that communicates with a communication server via a base station (not shown), such as a mobile phone, and between other navigation devices and information terminals. It may be a communication module that performs direct wireless communication.

  Here, the wireless communication by the communication unit 414 refers to communication performed using radio waves, infrared rays, ultrasonic waves, or the like without using a wire line as a communication medium. Various standards such as wireless LAN (Local Area Network), IrDA (Infrared Data Association), HomeRF (Home Radio Frequency) and BlueTooth are known as standards enabling wireless communication. Various wireless communication technologies can be used. Note that a wireless LAN can be used as a preferable example from the viewpoint of the transfer speed of various information, and infrared communication can be used as a preferable example from the viewpoint of cost.

  Moreover, the communication part 414 may receive road traffic information, such as traffic congestion and traffic regulation, regularly or irregularly. Specifically, the reception of the road traffic information by the communication unit 414 may be performed at the timing when the road traffic information is distributed from the VICS (Vehicle Information and Communication System) center, or the road traffic information is periodically transmitted to the VICS center. This may be done by requesting traffic information distribution. The communication unit 414 can be realized as an AM / FM tuner, a TV tuner, a VICS / beacon receiver, and other communication devices, for example.

  Although detailed description is omitted because it is a well-known technique, “VICS” is a real-time transmission of road traffic information such as traffic jams and traffic regulations edited and processed at the VICS Center. This is an information communication system that displays characters and figures on an in-vehicle device. As a system for transmitting road traffic information (VICS information) edited and processed in the VICS center to the navigation device, there is a system using “beacon” and “FM multiplex broadcasting” set on each road.

  Here, “beacons” include “radio wave beacons” mainly used on highways and “optical beacons” used on major general roads. In addition, when “FM multiplex broadcasting” is used, road traffic information in a wide area can be received. When using "Beacon", it is possible to receive necessary road traffic information at the location where the vehicle is located, such as detailed information on the most recent road based on the current location of the vehicle. It becomes. For example, when the communication method with another image display device (not shown) is different from the communication method for receiving image information, map information, or road traffic information, the communication unit 414 communicates with each other. You may provide the some communication means corresponding to a system.

  The route search unit 415, for example, from the current location to the destination location based on the current location information of the vehicle acquired by the GPS 437 of the acquisition unit 430 and information related to designation of the destination location input from the user operation unit 406 by the user. The optimal route is calculated. The route guidance unit 416 records, for example, information on the route (guidance route) searched by the route search unit 415, route information received by the communication unit 414, current location information acquired by the GPS 437 of the acquisition unit 430, and the like. Based on the map information obtained from the medium 409 via the recording medium decoding unit 410, real-time route guidance information is generated.

  Note that the map information may be acquired from an external server 441 or the like via the communication unit 414 as described above, or may be acquired from the DB 442. The route guidance information generated by the route guidance unit 416 is output to the display screen 408 via the navigation control unit 400 and the image circuit 407.

  The audio processing unit 417 selects audio information obtained from the recording medium 409 through the recording medium decoding unit 410, audio information obtained from the communication unit 414 through the navigation control unit 400, and performs reproduction processing of the selected audio information. . Further, the audio processing unit 417 may perform a reproduction process of audio information stored in a storage device such as the DB 442. Furthermore, when the user operation unit 406 is configured by a voice input device such as a microphone, for example, the voice processing unit 417 performs predetermined voice conversion processing on the input voice to generate corresponding input information, and performs navigation. Voice processing may be performed so that the input information generated by the control unit 400 can be recognized.

  Examples of the audio information reproduced by the audio processing unit 417 include audio information such as audio information and sound effects constituting a musical composition. The reproduction processing in the sound processing unit 417 includes, for example, control of a sound field formed by sound output from the speaker 412. In addition, the audio processing unit 417 reproduces sound of radio or television, for example, when the image display device 300 is provided in an in-vehicle navigation device or the like and includes an AM / FM tuner or TV tuner. Good.

  In addition, the sound processing unit 417 controls output of sound output from the speaker 412, for example. Specifically, the sound output state is controlled by adjusting the sound volume, equalizing process, sound image localization process, and the like based on the sound information to be selected and reproduced. The audio output control by the audio processing unit 417 is performed by an input operation from the user operation unit 406 or a control by the navigation control unit 400, for example.

  The image processing unit 418 performs overall image processing in an in-vehicle navigation device provided with the image display device 300. Specifically, the image processing unit 418 is, for example, image information acquired via the communication unit 414 and an image input / output I / F 419 described later, or from the recording medium 409 via the image input / output I / F 419 or shooting. Image processing of the image information acquired from the unit 420 via the image input / output I / F 419 is performed. Specifically, the image processing unit 418 is configured by CPAU or the like like the image circuit 407 described above.

  Here, as the image processing by the image processing unit 418, specifically, the vehicle user uses the route guidance image behind the vehicle acquired from the imaging unit 420 via the image input / output I / F 419, for example. And performing image processing such as making it possible to visually recognize a route guidance image behind the vehicle in an optimal state on the display screen 408.

  More specifically, the image processing unit 418 performs a left / right reversing process for horizontally reversing the route guidance image behind the vehicle acquired from the photographing unit 420 via the image input / output I / F 419, for example. Then, the image processing unit 418 performs a specifying process for specifying an image related to characters from the route guidance images that are reversed left and right. Further, the image processing unit 418 performs a reversal / generation process of reversing an image related to the specified character to generate a route guidance image. In this way, the image processing unit 418 performs image processing on the acquired route guidance image.

  In addition to the image processing described above, the image processing unit 418 cooperates with the navigation control unit 400 to refer to an image related to road sign information or advertising billboard information from, for example, map information and compare it with the acquired route guidance image. Verification and image identification / recognition processing may be performed. In this case (for example, when the route guidance image that has been identified / recognized includes information indicating “right / left turn guide sign / distance 300 m”), the navigation control unit 400 is based on the route guidance image that has been identified / recognized. Information indicated by the route guidance image may be acquired from the DB 442 or the like and displayed on the display screen 408. Note that the image processing unit 418 may automatically perform the image processing according to a control command from the navigation control unit 400, for example.

  Here, the image processing unit 418 receives image information captured by an external imaging device such as a digital still camera (DSC) or a digital video camera (DVC) from an image input / output I / F 419 through an external recording medium. An image to be displayed and displayed on the display screen 408 may be generated based on the acquired image information. Therefore, the image processing unit 418 may have a configuration having, for example, a DSP (Digital Signal Processor) function. The route guidance image refers to an image of information that guides the route of the vehicle among all the images related to (exists) information drawn on the road. An image related to a character indicating “point direction”, an image related to a number indicating “point distance”, an image related to a line indicating “shape of road”, and the like.

  The image input / output I / F 419 performs input / output processing of image information input / output from / to the image processing unit 418 from, for example, the communication unit 414, an external recording medium, and a photographing unit 420 described later. Specifically, the image input / output I / F 419, for example, stores image information from a recording medium 409 that stores an image captured by the DSC or DVC, or an image stored in the DSC or DVC or the like on a USB (Universal Serial). Bus), IEEE 1394 (Institute of Electrical and Electronic Engineers 1394) and image information input from the communication unit 414 by communication such as infrared rays, and image information such as a route guidance image behind the vehicle imaged by the imaging unit 420 The image information is output to the processing unit 418, and the image information output from the image processing unit 418 is output to the recording medium 409 and the communication unit 414.

  Note that the image input / output I / F 419 may have a controller function for directly controlling read / write of the recording medium 409, for example, when inputting / outputting image information to / from the recording medium 409. Further, the image input / output I / F 419 may have a function of a communication controller that directly controls communication in the communication unit 414, for example, when inputting / outputting image information to / from the communication unit 414.

  The imaging unit 420 includes, for example, imaging devices (cameras) 317 and 318 mounted on the vehicle in FIG. 3 and external imaging devices such as the above-described DSC and DVC, and a photoelectric conversion element such as a C-MOS or a CCD. To capture images around the vehicle. In the first embodiment, the photographing unit 420 specifically photographs a route guidance image behind the vehicle, for example. The imaging unit 420 is connected to the image display device 300 in a wired or wireless manner, and captures, for example, a route guidance image behind the vehicle, for example, by an imaging command from the navigation control unit 400. The route guidance image photographed by the photographing unit 420 is input to the image processing unit 418 via the image input / output I / F 419.

  For example, the acquisition unit 430 acquires various information used in an in-vehicle navigation device provided with the image display device 300. The acquisition unit 430 includes a speed sensor 431, an inclination angle sensor 432, an acceleration sensor 433, an angular velocity sensor 434, a lateral G (Gravity) sensor 435, a gyro sensor 436, and a GPS 437. Each sensor 431-436 acquires information (behavior information) regarding the behavior of the vehicle. Examples of the behavior information include vehicle speed information, inclination angle information, acceleration information, angular velocity information, lateral G information, and traveling direction information.

  The speed sensor 431 detects the vehicle speed from the output side shaft of the vehicle transmission and outputs speed information. The tilt angle sensor 432 detects the tilt angle on the road surface of the vehicle and outputs tilt angle information. The acceleration sensor 433 detects the acceleration of the vehicle and outputs acceleration information. The angular velocity sensor 434 detects angular velocity at the time of cornering of the vehicle, and outputs angular velocity information and relative azimuth information. The lateral G sensor 435 detects lateral G, which is an outward force (gravity) generated by centrifugal force during cornering of the vehicle, and outputs lateral G information. The gyro sensor 436 detects the traveling direction of the vehicle.

  In addition, mileage information is also included as vehicle behavior information. The travel distance information is calculated by, for example, calculating the number of pulses per one rotation of the wheel by counting the number of pulses of a pulse signal with a predetermined period output with the rotation of the wheel by a travel distance sensor (not shown). This is information on the travel distance based on the number of pulses per hit.

  The GPS 437 of the acquisition unit 430 acquires current point information (latitude and longitude information) of the vehicle on which the image display device 300 is mounted, for example, by receiving radio waves from an artificial satellite. Here, the current point information is information for receiving a radio wave from an artificial satellite and obtaining a geometric position with the artificial satellite as described above, and can be measured anywhere on the earth. The acquisition unit 430 includes a receiving device such as a GPS antenna (not shown).

  Here, the GPS (Global Positioning System) is a system that accurately obtains a position on the ground by receiving radio waves from four or more artificial satellites. Here, since it is a well-known technique, description about GPS is abbreviate | omitted. The GPS 437 can be configured by, for example, a tuner that demodulates radio waves received from artificial satellites, an arithmetic circuit that calculates the current location based on the demodulated information, and the like.

  In addition, as a radio wave from an artificial satellite, it is performed using a C / A (Coarse and Access) code and a L1 radio wave carrying a navigation message with a 1.57542 GHz carrier wave. Thereby, the current location (latitude and longitude) of the vehicle on which the image display device 300 is mounted is detected.

  The DB 442 is directly connected to the navigation control unit 400, for example, and includes background information including the above-described background shape information, background type information, road structure information, and advertising signboard information, and traffic condition information having road sign information. Map information including road shape information, various image information, and the like are stored. The DB 442 may be provided in an external server 441 or the like, and may be indirectly connected to the navigation control unit 400 through communication via the communication unit 414.

  Note that the input unit 101 in FIG. 1 specifically realizes its function by, for example, an image input / output I / F 419, and includes a first inversion unit 102, a specifying unit 103, a second inversion unit 104, and an erasing unit. The function is realized by the navigation control unit 400 and the image processing unit 418, for example. Further, specifically, the display unit 105 in FIG. 1 realizes its function by, for example, the image circuit 407 and the display screen 408, and the photographing unit 107 realizes its function by, for example, the photographing unit 420.

(Image display processing procedure of image display device)
Next, an image display processing procedure of the image display apparatus according to the first embodiment will be described. FIG. 5 is a flowchart illustrating an example of an image display processing procedure of the image display apparatus according to the first embodiment of the present invention. Here, a display process using a guide sign image indicating a direction / distance as a route guidance image will be described.

  Specifically, the processing shown in FIG. 5 is executed by the CPU 401 executing a program stored (recorded) in the RAM 402, ROM 403, memory 404, recording medium 409, etc. of the navigation control unit 400 shown in FIG. This is realized by performing processing together with each part of 300. In the following, description will be made mainly with reference to FIG. 4, but portions overlapping with those already described are denoted by the same reference numerals and description thereof is omitted.

  In FIG. 5, first, the navigation control unit 400 of the image display device 300 inputs, for example, a guide sign image of the rear of the vehicle photographed by the photographing unit 420 to the image processing unit 418 through the image input / output I / F 419 ( Step S501). In this step S501, when the guide sign image input to the image processing unit 418 is displayed on the display screen 408 of the image display device 300, specifically, for example, as shown in FIG. 6 and FIG. .

  FIG. 6 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment of the present invention. FIG. 7 is an explanatory diagram showing an enlarged part of an image displayed by the image display apparatus according to Embodiment 1 of the present invention. In FIG. 6, the display screen 408 is provided with a navigation display area 601 for displaying various information related to navigation and an image display area 602 for displaying a guidance sign image. In the navigation display area 601, a two-dimensional image that three-dimensionally represents a building or a ground surface that has been rendered by the image circuit 407 based on the map information is displayed. In the image display area 602, a guide sign image 650 is displayed. Has been. FIG. 7 shows the image display area 602 in an enlarged manner.

  Assuming that there is “Kasumigaseki” in the traveling direction of the vehicle, “Akasaka” in the direction opposite to the traveling direction of the vehicle, and “Ginza” on the right side of the traveling direction of the vehicle, as shown in FIG. The guide sign image 650 displayed at 602 displays the guide sign image displayed rearward of the vehicle by the photographing unit 420, that is, the guide sign image displayed toward the oncoming vehicle traveling in the direction opposite to the traveling direction of the vehicle. Therefore, if the image is displayed in the image display area 602 as it is, the upper, lower, left and right directions are displayed in opposite directions. Therefore, the image display device 300 needs to perform image processing on the guide sign image 650 and display it on the image display area 602. Here, first, a case where image processing is performed on the left and right directions will be described.

  Returning to FIG. 5, when the guide sign image 650 behind the vehicle is input in step S501, the guide sign image 650 is reversed left and right by the image processing unit 418 (step S502). When the guide sign image 650 is reversed left and right in this manner, the image processing unit 418 specifies a direction display character image as an image related to the character from the left and right reversed guide sign images 650 (step S503). Since the left / right reversing process in step S502 and the specifying process in step S503 are performed using a known image processing technique, description thereof is omitted here. Note that the guide sign image 650 that has been subjected to the left-right reversal processing and the specific processing in this way is, for example, as shown in FIG.

  FIG. 8 is an explanatory diagram showing an example of a guide sign image subjected to image processing by the image display apparatus according to Embodiment 1 of the present invention. In FIG. 8, in the guide sign image 850 that has been horizontally reversed by the image display device 300, for example, in the image display area 602, the position of the arrow indicating the horizontal direction is reversed and displayed. Further, “Akasaka” and “Ginza” which are the direction display character images 851 and 852 are displayed in an inverted manner. Note that the direction display character images 851 and 852 may be specified on the guide sign image 850 as, for example, images of predetermined ranges surrounding the direction display character images 851 and 852, respectively.

  Returning to FIG. 5, when the direction display character images 851 and 852 are specified in step S503, the specified direction display character images 851 and 852 are reversed by the image processing unit 418 (step S504). Here, the direction display character image reversal processing in step S504 may be performed on the direction display character image that displays at least the left and right directions with respect to the traveling direction of the vehicle.

  FIG. 9 is an explanatory diagram illustrating an example of a guide sign image that has been subjected to image processing by the image display device according to the first embodiment of the present invention. In FIG. 9, in the direction sign character image 950 obtained by reversing at least the direction display character image 852 among the direction display character images 851 and 852 by the image display device 300, the direction display character image 851 inverts the characters “Akasaka”. However, the direction display character image 852 is displayed with the characters “Ginza” correctly displayed. The direction display character image 851 may be displayed in a state where the characters “Akasaka” are correctly represented.

  Returning to FIG. 5, when the specified direction display character image 852 is reversed in step S <b> 504, the navigation control unit 400 causes the image processing unit 418 to display an opposite direction related image as an image related to the traveling direction of the vehicle in the guide sign image 950. It is determined whether or not to erase (step S505).

  That is, in this step S505, the image display device 300, for example, in step S504, the direction display character image 851 in which the characters “Akasaka” are reversed and the direction display character image in which the characters “Ginza” are correctly represented. A guide sign image 950 including 852 (see FIG. 9) may be displayed on the display screen 408. In this case, however, the display may be confusing for the user of the vehicle (the direction and its direction are incorrect). There is. Therefore, in this step S505, whether or not to delete the opposite direction related image including the direction display character image 851 that is inverted and the arrow image 853 (see FIG. 9) that indicates the direction represented by the direction display character image 851. Determine whether.

  If it is determined in step S505 that the opposite direction related image is to be deleted (step S505: Yes), the image processing unit 418 performs, for example, the opposite direction related image including the direction display character image 851 and the arrow image 853 in the guide sign image 950. Is deleted (step S506), and the guide sign image 950 from which the opposite direction related image is deleted is displayed on the display screen 408 (step S507).

  FIG. 10 is an explanatory diagram illustrating an example of a guide sign image that has been subjected to image processing by the image display device according to the first embodiment of the present invention. In FIG. 10, the image related to the opposite direction is erased by the image display device 300 by the process of step S506, and the character “Ginza” is correctly represented in the guide sign image 1050 displayed on the display screen 408 by the process of step S507. A direction display character image 852 and an arrow image 854 indicating the direction represented by the direction display character image 852 are displayed.

  On the other hand, if it is determined in step S505 that the opposite direction related image is not deleted (step S505: No), the navigation control unit 400 causes the image processing unit 418 to make the opposite direction related image symmetric in the guide sign image 950. It is determined whether or not to display the position (step S508). When it is determined that the opposite direction related image is not displayed at a symmetrical position in the guide sign image 950 (step S508: No), the image display unit 418 has reversed the direction display character image 852, for example, in step S504. The direction display character image 851 representing the reversed characters “Akasaka” included in the opposite direction related image of the guide sign image 950 (see FIG. 9) is inverted, and the process proceeds to step S507 and the guide sign image 950 is transferred. Is displayed on the display screen.

  FIG. 11 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment of the present invention. In FIG. 11, in the image display area 602 of the display screen 408, reverse processing is performed so that these characters are correctly displayed on the direction display character images 851 and 852 representing the characters “Akasaka” and “Ginza”. An applied guide sign image 950 is displayed. However, as in the case described with reference to FIG. 6, for example, there is “Kasumigaseki” in the traveling direction of the vehicle, “Akasaka” in the direction opposite to the traveling direction of the vehicle, and “Ginza” on the right side in the traveling direction of the vehicle. Then, in the guide sign image 950 displayed in the image display area 602, the upper and lower directions are displayed oppositely in this state. For this reason, it is necessary to determine whether or not to display the opposite direction related image at a symmetrical position in the guide sign image 950 in step S508.

  Returning to FIG. 5, when the navigation control unit 400 determines to display the opposite direction related image at a symmetrical position in the guide sign image 950 (step S508: Yes), the image processing unit 418 and the video circuit 407 A guide sign image in which the opposite direction related image is displayed at a symmetrical position in the guide sign image 950 is displayed on the display screen 408 (step S509). Thereby, a series of processing by this flowchart is complete | finished.

  FIG. 12 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment of the present invention. In FIG. 12, by the processing in step S509, the characters “Akasaka” and “Ginza” are correctly displayed in the image display area 602 of the display screen 408 (not shown), and the directions “Akasaka” and “Ginza” are correctly displayed. A displayed guide sign image 1250 is displayed. If displayed in this way, information can be displayed using the guide sign image behind the vehicle, and the convenience of the user of the vehicle can be improved.

  As described above, the image display apparatus according to Embodiment 1 of the present invention can display the guide sign image behind the vehicle without a sense of incongruity. For this reason, it is possible to display information using a guide sign image at the rear of the vehicle and to improve convenience for the user of the vehicle.

  Next, an image display apparatus according to Embodiment 2 of the present invention will be described. In the image display apparatus according to the first embodiment, a guide sign image can be displayed as a route guidance image behind the vehicle. On the other hand, the image display device according to the second embodiment employs a configuration capable of displaying a billboard image of a utility pole as a route guidance image behind the vehicle. Since the hardware configuration of the second embodiment is the same as that of the first embodiment, the same reference numerals as those in FIG. 4 are used in the following description, and the illustration and description are omitted. Shall be given the same symbol.

(Image display processing procedure of image display device)
The image display processing procedure of the image display apparatus according to Embodiment 2 of the present invention will be described below. FIG. 13 is a flowchart illustrating an example of an image display processing procedure of the image display apparatus according to the second embodiment of the present invention. As described above, here, display processing using an advertisement signboard image for facility guidance as a route guidance image will be described.

  Specifically, the process shown in FIG. 13 is executed by the CPU 401 by executing a program stored (recorded) in the RAM 402, ROM 403, memory 404, recording medium 409, etc. of the navigation control unit 400 shown in FIG. This is realized by performing processing together with each part of 300.

  In FIG. 13, first, the navigation control unit 400 of the image display device 300 inputs, for example, the advertising billboard image of the utility pole behind the vehicle photographed by the photographing unit 420 to the image processing unit 418 through the image input / output I / F 419. (Step S1301). In this step S1301, when the advertising signboard image input to the image processing unit 418 is displayed on the display screen 408 of the image display device 300, specifically, for example, as shown in FIG. 14 and FIG. .

  FIG. 14 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the second embodiment of the present invention. FIG. 15 is an explanatory diagram showing an enlarged part of an image displayed by the image display apparatus according to the second embodiment of the present invention. In FIG. 14, the display screen 408 is provided with a navigation display area 1401 for displaying various information related to navigation, and an image display area 1402 for displaying an advertisement signboard image. In the navigation display area 1401, a two-dimensional image that three-dimensionally represents a building or ground object drawn by the image circuit 407 based on the map information is displayed. In the image display area 1402, an advertisement signboard image 1450 is displayed. Has been. FIG. 15 shows the image display area 1402 in an enlarged manner.

  Assuming that “XX clinic” is on the left side 200 m behind the vehicle, as shown in FIG. 14, the advertising signboard image 1450 displayed in the image display area 1402 is displayed on the rear side of the vehicle by the photographing unit 420. Since the advertisement signboard image displayed in the image display area 1402 in this state is displayed as it is, the advertisement signboard image displayed toward the oncoming vehicle traveling in the direction opposite to the traveling direction of the vehicle is displayed as it is. It is conceivable that contents and guidance directions are displayed differently. Accordingly, the image display device 300 needs to perform image processing on the advertising signboard image 1450 and display it on the image display area 1402.

  In the second embodiment, with respect to the advertising billboard for the electric pole that performs the image display processing, for example, by the regulations of each local government, the position where the advertising billboard etc. on the electric pole can be installed is limited. For this reason, when the advertising signboard image 1450 is photographed by the photographing unit 420, if the photographing range by the photographing unit 420 is set in advance by the navigation control unit 400 based on the restriction information, a highly accurate advertisement is obtained. Acquisition (input) of the signboard image 1450 can be performed.

  In this case, the restriction information is acquired from, for example, an external server 441 via the communication unit 414, and the restriction information in the actual travel region of the vehicle is obtained using the current point information from the GPS 437 of the acquisition unit 430. The advertising signboard image 1450 may be taken while referring to it as appropriate. The acquisition method of restriction information is not limited to acquisition from an external server 441 via the communication unit 414.

  Returning to FIG. 13, when the advertising billboard image 1450 behind the vehicle is input in step S1301, the advertising billboard image 1450 is reversed left and right by the image processing unit 418 (step S1302). When the advertising signboard image 1450 is reversed left and right in this manner, the image processing unit 418 specifies a character image and an arrow image as images related to characters and arrows from the advertising signboard image 1450 reversed left and right (step S1303). Since the left-right reversing process in step S1302 and the specifying process in step S1303 are performed using a known image processing technique, description thereof is omitted here. Note that the advertisement signboard image 1450 that has been subjected to the left-right reversal processing and the specific processing in this manner is, for example, as shown in FIG.

  FIG. 16 is an explanatory diagram illustrating an example of an advertising billboard image that has been subjected to image processing by the image display device according to the second embodiment of the present invention. In FIG. 16, an advertisement signboard image 1650 that has been horizontally reversed by the image display device 300 is displayed in, for example, a character image 1651 indicating “XX clinic”, a character image 1652 indicating “beyond”, “200 m” in the image display area 1402. ], A character image 1654 indicating “turn right”, and an arrow image 1655 are inverted and displayed. The character images 1651 to 1654 and the arrow image 1655 may be specified on the advertising signboard image 1450 as, for example, images of a predetermined range area surrounding the character images 1651 to 1654 and the arrow image 1655, respectively.

  Returning to FIG. 13, when the character images 1651 to 1654 and the arrow image 1655 are specified in step S1303, the image processing unit 418 inverts or changes a predetermined image among the specified character images 1651 to 1654 and the arrow image 1655 ( Step S1304). In step S1304, the predetermined image to be reversed / changed means that, for example, an image including characters or arrows set in advance in the image display device 300 or an image processing unit 418 does not invert / change the image. Is an image that cannot be communicated or cannot be consistent. The inversion / change process in step S1304 is performed as follows in the second embodiment.

  FIG. 17 is an explanatory diagram illustrating an example of an advertising billboard image that has been subjected to image processing by the image display device according to the second embodiment of the present invention. In FIG. 17, the character image 1651 (see FIG. 16) indicating “XX clinic” is reversed by the image display device 300 and displayed as a character image 1751 correctly representing the characters “XX clinic”. Displayed in area 1402. In addition, the character image 1652 (see FIG. 16) indicating “beyond” is changed and displayed in the image display area 1402 as the character image 1752 indicating “rear”.

  Further, the character image 1653 (see FIG. 16) indicating “200 m” is reversed and displayed in the image display area 1402 as the character image 1753 indicating “200 m”. Further, the character image 1654 indicating “turn right” (see FIG. 16) is changed and displayed in the image display area 1402 as the character image 1754 indicating “turn left”. Further, the arrow image 1655 (see FIG. 16) is displayed in the display area 1402 as an arrow image 1755 as it is. In this way, an advertising billboard image 1750 in which the character images 1751 to 1754 and the arrow image 1755 are displayed is generated.

  Returning to FIG. 13, after the predetermined image is reversed / changed in step S1304, the advertising signboard image 1750 obtained by inverting / changing the predetermined image is displayed on the display screen 408 by the image processing unit 418 and the video circuit 407 (step S1305). . Thereby, a series of processing by this flowchart is complete | finished.

  Although illustration and description are omitted, for example, a character image 1753 (see FIG. 17) indicating the above “200 m” is based on signals from the sensors 431 to 436 of the acquisition unit 430, vehicle current point information, and the like. The display may be changed as appropriate (for example, changed to “250 m”, “300 m”, etc.) according to the traveling state of the vehicle. In addition, when a plurality of advertisement signboard images behind the vehicle are input, an identifier such as a number is added to each advertisement signboard image displayed in the image display area 1402 and displayed. The advertisement signboard image displayed in the image display area 1402 may be switched as appropriate according to input information associated with the input operation (direct input operation or voice input operation).

  As described above, the image display apparatus according to Embodiment 2 of the present invention can display an advertisement signboard image such as a utility pole behind the vehicle without a sense of incongruity. For this reason, while being able to display information using the advertising signboard image behind the vehicle, it is possible to improve the convenience of the user of the vehicle.

(Other)
Although illustration and detailed description are omitted, the image display apparatus 300 according to the first and second embodiments can perform the following image display. That is, the image display device 300 displays, for example, an overlooked advertisement signboard image or a road sign image to the user, and reverses an image taken with a camera or the like as in a normal vehicle rearview mirror. is there. In this case, when the contents of the information (character image, arrow image, etc.) indicated by the advertisement signboard image or road sign image displayed on the display screen 408 can be recognized, the displayed advertisement signboard image or road sign image is inverted. Instead, display it as is.

  In addition, when the vehicle has already passed through the advertisement signboard installation position or the road sign installation position and only the back side of the advertisement signboard or road sign can be recognized on the display screen 408 (when only the back side of the advertisement signboard or road sign can be photographed), An identifier such as a numerical value (or an image recognized together with the numerical value or an icon together with the numerical value) is displayed on the advertisement signboard image or the road sign image on the back side by the image processing unit 418 or the like.

  Further, when the image display device 300 recognizes the arrow image in the advertisement signboard image or the road sign image, the image display apparatus 300 can display the corrected arrow image based on the traveling direction of the car, for example, the advertisement signboard image. When a road sign image is enlarged or cut out, or recorded on a recording device or the like, it can be realized by designating its operation with a voice or a remote controller. In this case, in order to avoid displaying these images too much, the image display of the road sign image may be displayed only on the normal navigation screen.

  In addition, the image display device 300 can select and designate information corresponding to an advertisement signboard image or a road sign image by using an identifier such as a numerical value as described above. And road sign information. Therefore, for example, when going on a trip, information such as local advertising signboards such as hot spring resort information can be displayed on the display screen 408. As described above, the user of the image display apparatus 300 can perform image display switching and selection instruction by voice input or remote control input.

  In this case, on the display screen 408, when a plurality of advertising billboard images and road sign images behind the vehicle are displayed, the display area of each image is divided in a pseudo manner (for example, the display screen 408 is divided into four). You may make it display. In this way, it is possible to make it easier to select and specify information.

  Also, an advertisement signboard image of an advertisement signboard installed on a utility pole or the like can be displayed as described in the first embodiment. Similarly, the road sign image of the guide sign installed on the road can be displayed in the same manner as described in the second embodiment. If the photographing unit 420 is configured by a stereo camera or the like, the distance from the route guidance image can be measured and used for image display. In this case, even if there are a plurality of route guidance images, it is possible to measure the distance to each route guidance image, so that a better and finer image display can be performed. In addition, since the distance measurement by a stereo camera is a well-known technique, description is abbreviate | omitted here.

  As described above, according to the image display device, the image display method, the image display program, and the recording medium according to the present invention, the route guidance image behind the vehicle can be displayed without a sense of incongruity. For this reason, it is possible to display information using a route guidance image such as a road sign image and an advertisement signboard image behind the vehicle, and to improve the convenience of the user of the vehicle.

  The image display method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a computer or a personal computer incorporated in the image display apparatus. This program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. Further, this program may be a transmission medium that can be distributed via a network such as the Internet.

It is a block diagram which shows an example of a functional structure of the image display apparatus concerning embodiment. It is a flowchart which shows an example of the image display process sequence of the image display apparatus concerning embodiment. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram illustrating an example of a hardware configuration of an image display apparatus according to Embodiment 1; 6 is a flowchart illustrating an example of an image display processing procedure of the image display apparatus according to the first embodiment. FIG. 6 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment. FIG. 3 is an explanatory diagram illustrating an enlarged part of an image displayed by the image display apparatus according to the first embodiment. It is explanatory drawing which shows an example of the guidance sign image which the image display apparatus concerning Example 1 image-processed. It is explanatory drawing which shows an example of the guidance sign image which the image display apparatus concerning Example 1 image-processed. It is explanatory drawing which shows an example of the guidance sign image which the image display apparatus concerning Example 1 image-processed. FIG. 6 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment. FIG. 6 is an explanatory diagram illustrating an example of an image displayed by the image display apparatus according to the first embodiment. 12 is a flowchart illustrating an example of an image display processing procedure of the image display apparatus according to the second embodiment. FIG. 10 is an explanatory diagram illustrating an example of an image displayed by the image display device according to the second embodiment. FIG. 10 is an explanatory diagram illustrating an enlarged part of an image displayed by an image display device according to a second embodiment. It is explanatory drawing which shows an example of the advertising signboard image which the image display apparatus concerning Example 2 image-processed. It is explanatory drawing which shows an example of the advertising signboard image which the image display apparatus concerning Example 2 image-processed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Input part 102 1st inversion part 103 Identification part 104 2nd inversion part 105 Display part 106 Erase part 107 Imaging | photography part 400 Navigation control part 406 User operation part 407 Image circuit 409 Recording medium 410 Recording medium decoding part 414 Communication part 415 Route search unit 416 Route guidance unit 418 Image processing unit 430 Acquisition unit 440 Network 441 Server

Claims (7)

An input means for receiving an input of a route guidance image in a direction opposite to the traveling direction of the vehicle, which is taken from the rear of the vehicle toward the rear;
First inversion means for generating a first inverted image by inverting the left and right of the route guidance image input by the input means;
Specifying means for specifying an image relating to a character from among the first inverted images obtained by the first inversion means;
Second inversion means for generating a second inverted image by inverting the image relating to the character specified by the specifying means;
Display means for displaying a second inverted image obtained by the second inversion means;
An image display device comprising: An erasing unit for erasing an image related to a direction opposite to the traveling direction of the vehicle from the second inverted image obtained by the second inverting unit;
The display means includes
The image display apparatus according to claim 1, wherein a second reverse image in which an image related to the traveling direction is erased by the erasing unit is displayed. The display means includes
Further, among the second reverse image, an image relating to a direction opposite to the traveling direction of the vehicle that has not been deleted by the erasing unit is symmetric with respect to the vertical direction of the display unit in the second reverse image. The image display apparatus according to claim 1, wherein the image display apparatus displays the position.   The route guidance image input by the input means is at least one of a road sign image, a road structure image, and an advertisement signboard image. Image display device. In the image display method of the image display device,
An input step for inputting a route guidance image in a direction opposite to the traveling direction of the vehicle, photographed from the rear to the rear of the vehicle ;
A first inversion step for generating a first inversion image by inverting the left and right of the route guidance image input in the input step;
A specifying step of specifying an image relating to characters from the first reverse image obtained by the first reverse step;
A second inversion step of generating a second inverted image by inverting the image relating to the character specified in the specifying step;
A display step of displaying the second reverse image obtained by the second reverse step;
An image display method comprising:   An image display program for causing a computer to execute the image display method according to claim 5.   A computer-readable recording medium on which the image display program according to claim 6 is recorded.

Images