JP2017072520A - Display device for vehicle - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device for a vehicle that appropriately recognizes route guidance information displayed by an onboard monitor device and can display it on a head-up display.SOLUTION: The display device for a vehicle includes: an image taking unit 31 for taking an image including map information and route guidance information displayed by an onboard monitor device 20; an information image detection unit 32 for detecting an arrow image Y indicating predetermined route guidance information from the image taken by the image taking unit 31; an information recognition unit 33 for recognizing the route guidance information indicated by the arrow image Y; and an information display unit 34 for displaying the route guidance information recognized by the information recognition unit 33 on a head-up display 34b.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a vehicle display device that is mounted on a vehicle such as an automobile and displays route guidance information.

  2. Description of the Related Art Conventionally, there is known a vehicle display device that is communicably connected to a portable terminal having an application that creates and displays an image related to route guidance information, and displays an image created by the portable terminal on a vehicle-mounted display ( For example, see Patent Document 1).

JP2015-141072

  By the way, there are a plurality of applications for creating and displaying an image relating to route guidance information, and the data format of the route guidance information differs for each application. Therefore, even if an attempt is made to pick up necessary route guidance information from the mobile terminal and display it on the vehicle-mounted display, there is a problem that the route guidance information cannot be properly recognized if the application is different, and the necessary route guidance information cannot be displayed.

  Accordingly, an object of the present invention is to provide a vehicle display device that can appropriately recognize route guidance information displayed by an image display device and display the information on an in-vehicle display.

In order to achieve the above object, a vehicle display device according to the present invention includes:
An image capturing unit that captures an image including map information and route guidance information displayed by the image display device;
An information image detecting unit for detecting an information display image indicating predetermined route guidance information from the image captured by the image capturing unit;
An information recognition unit for recognizing route guidance information indicated by the information display image detected by the information image detection unit;
An information display unit for displaying the route guidance information recognized by the information recognition unit on the vehicle-mounted display;
It has.

According to the present invention, an image displayed by an image display device is captured to detect an information display image, and route guidance information indicated by the detected information display image is recognized. The recognized route guidance information is displayed on the in-vehicle display.
That is, the route guidance information displayed on the in-vehicle display is recognized by performing image processing on the image displayed by the image display device. Therefore, even if the data format of the route guidance information differs depending on the application installed in the image display device, the necessary route guidance information can be recognized.
As a result, the route guidance information displayed by the image display device can be properly recognized and displayed on the in-vehicle display.

It is a block diagram which shows the information display system using the display apparatus for vehicles of Example 1. FIG. 1 is a configuration diagram illustrating a head-up display of Example 1. FIG. It is a flowchart which shows the information display process performed with the display apparatus for vehicles of Example 1. FIG. FIG. 6 is an explanatory diagram illustrating a captured navigation image in the vehicle display device according to the first embodiment. FIG. 3 is an explanatory diagram illustrating a rectangular area detected from a navigation image in the vehicle display device according to the first embodiment. In the display apparatus for vehicles of Example 1, it is an explanatory view showing a square field selected from a navigation image, an arrow image, and a distance image. FIG. 6 is an explanatory diagram illustrating a quadrangular area stored in a memory after deleting one stored quadrangular area in the vehicle display device according to the first embodiment. In the vehicle display apparatus of Example 1, it is explanatory drawing which shows the route guidance information shown on the head-up display. It is a block diagram which shows the other 1st example of the information display system using the display apparatus for vehicles of Example 1. FIG. It is a block diagram which shows the other 2nd example of the information display system using the display apparatus for vehicles of Example 1. FIG. It is a block diagram which shows the other 3rd example of the information display system using the display apparatus for vehicles of Example 1. FIG.

  EMBODIMENT OF THE INVENTION Hereinafter, the form for implementing the display apparatus for vehicles of this invention is demonstrated based on Example 1 shown in drawing.

Example 1
First, the configuration will be described.
The vehicle display device according to the first embodiment is applied to an information display system including a portable terminal capable of creating and displaying an image and a navigation device that displays an image transmitted from the portable terminal. Hereinafter, the configuration of the vehicular display device according to the first embodiment will be described by dividing it into “entire system configuration” and “information display processing configuration”.

[Overall system configuration]
FIG. 1 is a block diagram illustrating an information display system using the vehicle display device according to the first embodiment. The overall system configuration of the first embodiment will be described below with reference to FIG.

  The information display system according to the first embodiment is mounted on a vehicle such as an automobile and displays information required by the driver. As shown in FIG. 1, this information display system includes a mobile terminal 10, a vehicle-mounted monitor device 20 that is fixed to a vehicle, and a vehicle display device 30.

  The mobile terminal 10 is a high-performance mobile phone (smart phone) having various functions, and includes a GPS receiving unit 11, a terminal control unit 12, a terminal memory 13, a terminal display 14, and an image output unit 15. Have.

  The GPS receiver 11 is a receiver that has a GPS antenna 11a, receives transmission data (radio waves) from a GPS satellite (not shown), and generates position information indicating the current position of the host vehicle. The position information generated by the GPS receiving unit 11 is output to the terminal control unit 12.

The terminal control unit 12 includes, for example, a microcomputer, and includes a CPU that performs various processes, a RAM that functions as a main memory of the CPU, and a ROM that stores various applications for causing the CPU to perform various processes. ing. The terminal control unit 12 executes various applications stored in the ROM, so that various functions such as a call function, a mail function, a music data reproduction function, a still image data reproduction function, a moving image data reproduction function, and a web browsing function are provided. Is realized. Further, when the navigation application is executed, based on the position information input from the GPS receiving unit 11, the map information input from the terminal memory 13, the destination information set by an operation unit (not shown), etc. A navigation function for performing route guidance from the current position to the destination is realized, and an image including map information and route guidance information (hereinafter referred to as “navigation image”) is displayed on the terminal display 14.
The terminal display 14 is a liquid crystal display provided in the main body of the mobile terminal 10. The terminal display 14 has a touch panel, and displays an image and has a function as an operation unit for executing an application.

  The image output unit 15 is an interface for wireless connection with the in-vehicle monitor device 20. The mobile terminal 10 transmits the image displayed on the terminal display 14 to the in-vehicle monitor device 20 via the image output unit 15.

  The in-vehicle monitor device 20 (image display device) displays an image created by the terminal control unit 12 of the mobile terminal 10 and displayed on the terminal display 14, and includes an image input unit 21, a monitor control unit 22, and the like. And a vehicle-mounted display 23.

  The image input unit 21 is an interface for wireless connection with the mobile terminal 10. The in-vehicle monitor device 20 receives an image displayed on the terminal display 14 of the mobile terminal 10 via the image input unit 21.

  The monitor control unit 22 selects the image received by the image input unit 21 and transmits the image data of the selected image to the in-vehicle display 23. Note that image selection is performed based on whether or not there is an obstacle to driving. For example, image data such as navigation images and facility information images around the vehicle is transmitted to the in-vehicle display 23. On the other hand, image data such as game images and web images are not transmitted to the in-vehicle display 23.

The in-vehicle display 23 is a liquid crystal display fixed to the instrument panel in the front part of the passenger compartment, and displays the image selected by the monitor control unit 22 as it is.
That is, a navigation image having the same content as the navigation image created by the mobile terminal 10 and displayed on the terminal display 14 is displayed on the in-vehicle display 23.

  The vehicle display device 30 recognizes and displays necessary information from an image (navigation image) displayed on the vehicle-mounted display 23 of the vehicle-mounted monitor device 20, and includes an image capturing unit 31 and an information image detection unit. A unit 32, an information recognition unit 33, and an information display unit 34.

The image capturing unit 31 has a function of capturing a navigation image including map information and route guidance information displayed by the in-vehicle monitor device 20, and a camera 31a that captures the screen of the in-vehicle display 23, and the camera 31a. And an image storage unit 31b for storing the obtained image (still image).
Here, the camera 31a is a so-called CCD camera, and is attached to an arbitrary position in the vehicle compartment where the vehicle-mounted display 23 can be photographed.

The information image detection unit 32 has a function of detecting an information display image indicating predetermined route guidance information from the navigation image captured by the image capture unit 31, and the detected information display image is transmitted to the information recognition unit 33. Output. Here, the information image detection unit 32 detects an arrow image and a distance image displayed on the navigation image as the information display image.
In addition, the information image detection unit 32 detects the information display image for each rectangular image area that is an image area of a predetermined shape identified from the navigation image. That is, first, a rectangular area existing in the navigation image is identified. Next, one rectangular image is selected, and it is determined whether or not an arrow image exists in the selected rectangular area. If it is determined that an arrow image or the like exists, the arrow image is detected and output to the information recognition unit 33. If no arrow image exists, the remaining rectangular area is searched.
Further, the information image detection unit 32 detects the information display image along a preset search direction. Here, the navigation image is searched in the horizontal direction from the upper left to the right, and gradually searched toward the lower part of the navigation image. If the information display image is detected before searching the entire area of the navigation image, the search of the information display image is stopped and the entire area of the navigation image is not searched. In addition, the information image detection unit 32 includes a memory 32a and stores necessary information as appropriate.

  The information recognition unit 33 has a function of recognizing route guidance information indicated by the information display image detected by the information image detection unit 32, and outputs the recognized route guidance information to the information display unit 34. Here, the information recognizing unit 33 recognizes the traveling direction information indicated by the arrow image as the route guidance information indicating the traveling direction at the road branch point, and the distance information indicated by the distance image is the current information. It is recognized as route guidance information indicating the distance from the vehicle position to the road branch point.

The information display unit 34 has a function of displaying route guidance information recognized by the information recognition unit 33, and includes an information output unit 34a and a head-up display 34b (on-vehicle display).
The information output unit 34a is a controller of the head-up display 34b, receives information from the information recognition unit 33, and transmits the information to the head-up display 34b.
As shown in FIG. 2, the head-up display 34b includes a HUD unit 35a (display unit) and a windshield 35b that is a reflective member, and is projected from the HUD unit 35a to the front of the driver D. The projected light is reflected by the windshield 35b, and a virtual image 36 is formed in front of the driver D.
That is, the head-up display 34b projects light from the light source 35c provided in the instrument panel to the HUD unit 35a and reflects the display image displayed on the HUD unit 35a to the windshield 35b by the reflecting mirror 35d. Thus, the virtual image 36 is displayed superimposed on the field of view of the driver D.
Here, the traveling direction at the road branch point and the distance to the road branch point are displayed on the head-up display 34b.

[Information display processing configuration]
FIG. 3 is a flowchart illustrating information display processing executed by the vehicle display device according to the first embodiment. Hereinafter, each step of FIG. 3 showing an example of the information display processing configuration will be described. This information display process is repeated from when the ignition switch is turned on until it is turned off.

In step S <b> 1, it is determined whether or not the navigation image transmitted from the mobile terminal 10 is displayed on the in-vehicle display 23 of the in-vehicle monitor device 20. If YES (the navigation image is displayed), the process proceeds to step S2. If NO (no navigation image is displayed), step S1 is repeated.
Here, whether or not a navigation image is displayed is determined based on a control signal from the monitor control unit 22.

In step S2, following the determination that the navigation image is displayed in step S1, the navigation image displayed on the in-vehicle display 23 is captured, and the process proceeds to step S3.
Here, the navigation image is captured by capturing the in-vehicle display 23 with the camera 31a and storing the captured still image in the image storage unit 31b. FIG. 4A shows an image of the captured navigation image.

In step S3, following the capture of the navigation image in step S2, a quadrangular area displayed in the captured navigation image is searched, and when the quadrangular area is detected, it is stored in the memory 32a, and the process proceeds to step S4.
Here, the “rectangular region” is a region having four linear boundary lines and having the same interior angle at the four corners, and is a region indicated by “S” in FIG. 4B. Note that even if the inner angle of the corner is not a right angle and is an R shape, it is defined as a “square area” (indicated by “SA” in FIG. 4B). Also, a parallelogram-shaped or rhombus-shaped region (indicated by “SB” in FIG. 4B) in which adjacent sides do not extend in the orthogonal direction is excluded from the “square region”.

In step S4, following the search for the quadrangular shape in step S3, it is determined whether or not a quadrangular search error has occurred. If YES (no search error), the process proceeds to step S5. In the case of NO (with a search error), it is determined that the quadrilateral shape has not been properly detected, and the process returns to step S1 and the navigation image is captured again.
Here, the search error occurs when the quadrilateral shape cannot be detected within a predetermined time from the start of the detection of the quadrilateral shape due to the captured image being unclear.

  In step S5, following the determination that there is no quadrangle area search error in step S4, it is determined whether or not the quadrangular area search has been completed in the entire navigation image captured in step S2. If YES (search the entire navigation image), the process proceeds to step S6. If NO (the entire navigation image has not been searched yet), the process returns to step S3 and the search for the rectangular shape is continued.

In step S6, following the determination that the search for the quadrangular area in step S5 is completed, the quadrangular area that is located on the leftmost side and located at the top in the navigation image is selected from the quadrangular areas stored in the memory 32a. Proceed to step S7.
In the case of the navigation image shown in FIG. 4C, S1 is selected at the first selection, and S2 is selected at the second selection. That is, the quadrangular area is sequentially selected along the horizontal direction from the upper left to the right of the navigation image, and the area gradually located at the lower part is selected.

In step S7, following the selection of the quadrangular area in step S6, it is determined whether or not only one arrow image exists in the selected quadrangular area. If YES (one arrow image exists), the process proceeds to step S8. If NO (no arrow image or multiple images), the process proceeds to step S10.
Here, the “arrow image” is an image displayed by an arrow shape displayed at one end and a line shape extending from the arrow shape. That is, it is indicated by “Y” in FIG. 4C.

In step S8, following the determination that there is one arrow image in step S7, a distance image displayed at a position closest to the arrow image that has detected the presence is detected, and the process proceeds to step S9.
Here, the “distance image” means that distance units such as m (meters), km (kilometers), ft (feet), and mi (miles) and numbers on the left or upper side thereof are within a certain range. The image is displayed together. That is, it is indicated by “K” in FIG. 4C.
Note that the detection of the arrow image and the detection of the distance image are performed using a known image recognition program. Further, when detecting the distance image, all the information of the rectangular area stored in the memory 32a is deleted.

In step S9, following the detection of the distance image in step S8, it is determined whether or not a distance image detection error has occurred. If YES (no detection error), the process proceeds to step S12. If NO (with a detection error), it is determined that the distance image has not been properly detected, and the process returns to step S1.
Here, the detection error is when a plurality of distance images having substantially the same distance from the arrow image are detected, or when the captured image is unclear and the distance image cannot be detected within a certain time from the start of the distance image detection. To occur.

In step S10, following the determination that the arrow image has not been detected or multiple detections have been made in step S7, the information on the rectangular area selected in step S6 is deleted from the memory 32a, and the process proceeds to step S11. As a result, the square area stored in the memory 32a is reduced by one.
That is, when the quadrangular area S1 shown in FIG. 4C is selected in step S6, it is determined in step S7 that the arrow image has not been detected, and in this step S10, the quadrangular area S1 is deleted from the memory 32a. .

  In step S11, following the deletion of the square area in step S10, it is determined whether or not the square area is stored in the memory 32a. If YES (no rectangular area is stored), it is determined that the arrow image has not been properly detected, and the process returns to step S1. If NO (there is a rectangular area stored), the process returns to step S6 to continue the detection of the arrow image.

In step S12, following the determination that there is no distance image detection error in step S9, the traveling direction information indicated by the arrow image detected in step S7 is used as route guidance information indicating the traveling direction at the road branch point. Recognize and go to step S13.
Here, the traveling direction information is recognized based on the direction of the tip of the arrow image.

In step S13, following the recognition of the traveling direction information in step S12, the distance information indicated by the distance image detected in step S8 is used as route guidance information indicating the distance from the current vehicle position to the road branch point. Recognize and go to step S14.
Here, the distance information is recognized based on the numerical display and the distance unit display in the distance image.

In step S14, following the recognition of the distance information in step S13, the traveling direction information recognized in step S12 and the distance information recognized in step S13 are displayed on the head-up display 34b, and the process proceeds to return.
Here, the display format on the head-up display 34b is set based on a preset specification. That is, it is displayed in the display style set on the head-up display 34b.

Next, the operation will be described.
First, “the configuration and problems of the vehicle display device of the comparative example” will be described, and then “information display operation” in the vehicle display device of the first embodiment will be described.

[Configuration and Problem of Vehicle Display Device of Comparative Example]
In recent years, the functions of mobile terminals have been highly developed, and those having a navigation function using GPS in addition to functions such as making a call, mailing, and enjoying music and web browsing are becoming widespread. On the other hand, in order to realize these functions in the mobile terminal, software called an application is indispensable, and in order to realize a navigation function, a so-called navigation application is necessary.

  Here, there are various types of navigation applications, and the purpose of “implementing a navigation function using GPS” is the same, but the display format on the terminal display and the type of information displayed (for each application) Content) is different. Furthermore, even in the case of information data indicating the same concept (for example, information data indicating the concept of “turn right at an intersection”), the data format differs for each application.

  On the other hand, a display device for a vehicle that transmits an image created by a portable terminal, that is, an image displayed on a terminal display as image data as it is and displays it on a vehicle-mounted display is considered. In the vehicle display device of this comparative example, even when the navigation application is different and the data format of the information data is different, the same image as the terminal display is displayed on the in-vehicle display by transmitting the image data. can do.

  However, if the on-vehicle display device of the vehicle display device has a display screen set in the driver's field of view, such as a head-up display, if too much information is displayed, it may interfere with the driver's field of view, There is a problem that the forward visibility is lowered while the driver grasps the information. Therefore, there is a need to extract only necessary information from the information displayed on the terminal display and display it on the in-vehicle display.

However, as described above, even the information data indicating the same concept has a different data format for each application. Therefore, a database corresponding to each application on the vehicle-mounted display side (the concept indicated by the information data and the information data) If you do not have a database that associates with the data, even if you receive information data from the mobile terminal side, you will not be able to recognize the concept indicated by the information data, can be displayed properly on the vehicle-mounted display There wasn't.
That is, the vehicle display device of the comparative example has a problem that if the application on the mobile terminal side is different, the information data cannot be recognized and necessary information cannot be displayed on the vehicle-mounted display.

[Information display function]
An information display operation in the vehicle display device 30 according to the first embodiment that extracts necessary information from the navigation image displayed on the terminal display 14 of the mobile terminal 10 and displays the information on the head-up display 34b will be described.

  First, in the flowchart shown in FIG. 3, the process proceeds from step S1 to step S2, and a navigation image is captured. Here, the navigation image displayed on the terminal display 14 is transmitted to the vehicle-mounted display 23 of the vehicle-mounted monitor device 20 and is also displayed on the vehicle-mounted display 23. Therefore, the navigation image displayed on the in-vehicle display 23 is taken by the camera 31a. Then, the captured image is stored in the image storage unit 31b to capture the navigation image (see FIG. 4A).

  Next, it progresses to step S3 and searches for a square area from the taken-in navigation image. Information on the quadrangular area detected as a result of the search is stored in the memory 32a. Then, the process proceeds from step S4 to step S5, and the entire navigation image is searched unless a search error occurs. Note that the square area detected at this time is indicated by “S” or “SA” in FIG. 4B.

When the search for the quadrangular area is completed in the entire navigation image, the process proceeds from step S6 to step S7, and among the quadrangular areas stored in the memory 32a, the quadrangular area that is located on the leftmost and uppermost position in the navigation image. That is, the rectangular area S1 in FIG. 4C is selected. Then, it is determined whether or not there is only one arrow image in the selected quadrilateral area S1.
Here, since there is no arrow image in the quadrangular area S1, the process proceeds to step S10, and the quadrangular area S1 is deleted from the memory 32a. As a result, the quadrangular area stored in the memory 32a is in the state shown in FIG. 4D. Then, the process proceeds to step S11, and it is determined whether or not there is a rectangular area stored in the memory 32a. In this case, as shown in FIG. 4C, since the quadrangular area is stored, the process proceeds to step S6 and is again the leftmost and quadrangular area located at the top in the navigation image, that is, the quadrangular area in FIG. 4C. Region S2 is selected.

Then, the process proceeds to step S7, and it is determined whether or not there is only one arrow image in the selected quadrangular area S2.
Here, since there is only one arrow image in the rectangular area S2, the process proceeds to step S8, and the distance image (FIG. 4C) displayed at the closest position from the arrow image Y (see FIG. 4C) that detected the presence. (Indicated by “K”) in FIG.

  When the arrow image Y and the distance image K are detected, the process proceeds from step S9 to step S12 to step S13, and the direction information (here, “right turn”) indicated by the arrow image Y is used to indicate the traveling direction at the road branch point. Recognize as guide information. Further, the distance information (here, “190 meters”) indicated by the distance image K is recognized as route guidance information indicating the distance from the current vehicle position to the road branch point. Finally, the process proceeds to step S14, and the recognized route guidance information ("right turn" "190 meters") is displayed on the head-up display 34b. A virtual image displayed by the head-up display 34b at this time is shown in FIG.

Thus, in the vehicle display device 30 according to the first embodiment, the navigation image created by the mobile terminal 10 and displayed on the in-vehicle display 23 of the in-vehicle monitor device 20 is captured, and the captured navigation image is subjected to image processing. The route guidance information displayed in the navigation image is recognized. Then, necessary information is displayed on the head-up display 34b. That is, in the vehicle display device 30 according to the first embodiment, route guidance information is not received as data from the mobile terminal 10 or the in-vehicle monitor device 20, but necessary information is grasped from the displayed navigation image.
Thereby, even if the navigation application installed in the portable terminal 10 is different and the data format of the route guidance information indicating the same concept is different, the route guidance information displayed on the in-vehicle display 23 is appropriately recognized, and the head It can be displayed on the up display 34b.

  In the first embodiment, first, quadrilateral areas S and SA (see FIG. 4B), which are image areas of a predetermined shape, are detected from the navigation image (see FIG. 4A). Then, the arrow image Y (see FIG. 4C) displayed in the navigation image is searched for each of the rectangular areas S and SA. Therefore, the search range of the arrow image Y can be limited, and erroneous detection of the arrow image Y can be prevented. Moreover, since the entire navigation image is not searched at once, the search load can be reduced.

  In the first embodiment, the shape of the image area is set to quadrilateral areas S and SA having four linear boundary lines and equal inner angles of the four corners, and adjacent sides do not extend in the orthogonal direction. The region SB (see FIG. 4B) having a parallelogram shape or a rhombus shape is excluded. Thereby, the erroneous detection of the arrow image Y can be further suppressed.

Further, in the first embodiment, the quadrangular areas S and SA detected from the navigation image are selected in order along a horizontal direction from a preset search direction, that is, from the upper left side of the navigation image. Thereby, the search for the arrow image Y is performed along the search direction, and the search for the arrow image Y can be performed efficiently.
When the arrow image Y is detected, the distance image K is detected even if the rectangular areas S and SA are stored in the memory 32a, that is, even if the unsearched square areas S and SA remain in the arrow image Y. . Therefore, the search load of the arrow image Y can be reduced and the image processing speed can be improved.

In the first embodiment, the arrow image Y and the distance image K displayed in the navigation image are detected, and the direction indicated by the arrow image Y is recognized as route guidance information indicating the traveling direction at the road branch point. . Further, the distance information indicated by the distance image K is recognized as route guidance information indicating the distance from the current host vehicle position to the road branch point. Then, the traveling direction at the road branch point and the distance to the road branch point are displayed on the head-up display 34b.
As a result, only the information necessary for turn-by-turn can be extracted from the navigation image and displayed on the head-up display 34b, and the information necessary for the driver can be simply transmitted.

Moreover, in the first embodiment, the route guidance information recognized by performing image processing on the navigation image (the traveling direction at the road branch point and the distance to the road branch point) is projected onto the driver's front. Is reflected on the windshield 35b and displayed on the head-up display 34b that forms a virtual image in front of the driver.
This makes it possible for the driver to recognize necessary route guidance information while suppressing the movement of the driver's line of sight while driving.

  Further, when the route guidance information is displayed on the head-up display 34b, the route guidance information is displayed according to the display style set on the head-up display 34b (see FIG. 5). For this reason, since the navigation application installed in the portable terminal 10 is different, the display style displayed on the head-up display 34b is unified even if the navigation screen is different. This makes it easier for the driver to recognize the route guidance information.

Next, the effect will be described.
In the vehicle display device 30 of the first embodiment, the effects listed below can be obtained.

(1) an image capturing unit 31 that captures an image (navigation image) including map information and route guidance information displayed by the image display device (the in-vehicle monitor device 20);
An information image detecting unit 32 for detecting an information display image (an arrow image Y, a distance image K) indicating predetermined route guidance information from an image (navigation image) captured by the image capturing unit 31;
An information recognition unit 33 for recognizing route guidance information (advancing direction at a road branch point, a distance to a road branch point) indicated by an information display image (arrow image Y, distance image K) detected by the information image detection unit 32. When,
An information display unit 34 for displaying the route guidance information recognized by the information recognition unit 33 (the direction of travel at the road branch point, the distance to the road branch point) on the vehicle-mounted display (head-up display 34b);
It was set as the structure provided with.
Thereby, the route guidance information displayed by the image display device (vehicle-mounted monitor device 20) can be appropriately recognized and displayed on the vehicle-mounted display (head-up display 34b).

(2) The information image detection unit 32 searches the information display image (arrow image Y) for each image region (rectangular region S, SA) having a predetermined shape identified from the image (navigation image). The configuration.
Thereby, it is possible to prevent erroneous detection of the information display image (arrow image Y) and to suppress the search load.

(3) The information image detection unit 32 searches the information display image (arrow image Y) along a preset search direction, and detects the information display image (arrow image Y) when the information display image (arrow image Y) is detected. The search for the arrow image Y) is stopped.
Thereby, the information display image (arrow image Y) can be searched efficiently, and the search load can be reduced.

(4) The information image detection unit 32 detects an arrow image Y and a distance image K displayed on the image (navigation image),
The information recognition unit 33 recognizes the direction indicated by the arrow image Y as route guidance information indicating a traveling direction at a road branch point, and the distance indicated by the distance image K is a distance to the road branch point. Is recognized as route guidance information indicating
The information display unit 34 is configured to display the traveling direction at the road branch point and the distance to the road branch point on the in-vehicle display (head-up display 34b).
Thereby, information required for turn-by-turn can be extracted and displayed on the vehicle-mounted display (head-up display 34b).

(5) The vehicle-mounted display is configured as a head-up display 34b that reflects the projection light projected in front of the driver with a reflective member (front glass 35b) and forms a virtual image in front of the driver.
This makes it possible for the driver to recognize necessary route guidance information while suppressing the movement of the driver's line of sight while driving.

  As mentioned above, although the display apparatus for vehicles of the present invention has been described based on the first embodiment, the specific configuration is not limited to this embodiment, and the gist of the invention according to each claim of the claims. As long as they do not deviate, design changes and additions are permitted.

  In the vehicle display device 30 according to the first embodiment, the navigation image created by the mobile terminal 10 is displayed on the terminal display 14 and also displayed on the vehicle-mounted display 23 of the vehicle-mounted monitor device 20. And the navigation image is taken in by photographing the navigation image displayed on this vehicle-mounted display 23 with the camera 31a. However, the present invention is not limited to this, and for example, as shown in FIG. 6, the navigation image displayed on the terminal display 14 of the mobile terminal 10 is captured by the camera 31 a of the vehicle display device 30 to capture the navigation image. But you can.

  Further, as shown in FIG. 7, the image capturing unit 31 of the vehicle display device 30 includes a video capture board 31c instead of the camera 31a, and the monitor control unit 22 of the in-vehicle monitor device 20 and the video. The capture board 31c is connected by the communication line X. The image data output from the monitor control unit 22 may be captured by the video capture board 31c and stored in the image storage unit 31b, so that the navigation image may be captured.

Furthermore, the vehicle display device 30 according to the first embodiment recognizes necessary route guidance information by performing image processing on a navigation image created by the mobile terminal 10, but is not limited thereto. For example, as shown in FIG. 8, a navigation image created by a car navigation device 40 mounted on a vehicle and displayed on the in-vehicle display 44 may be captured.
In this case, first, the position information input from the GPS receiver 41 by the car navigation control unit 42 of the car navigation device 40, the map information input from the car navigation memory 43, and the destination information set by an operation unit (not shown). Based on the above, an image (navigation image) including map information indicating the guide route from the current position of the vehicle to the destination and route guide information is created. The navigation image is input from the image output unit 45 to the in-vehicle display 44 via the communication line X, and is displayed on the in-vehicle display 44. On the other hand, the video capture board 31 c of the vehicle display device 30 is connected to the communication line X. Therefore, the image data transmitted from the image output unit 45 is also input to the video capture board 31c, and the navigation image is stored in the image storage unit 31b.

In the first embodiment, the arrow image Y and the distance image K are detected as the information display image, the direction indicated by the arrow image Y is recognized as the route guidance information indicating the traveling direction at the road branch point, and the distance image Although the example which recognizes the distance information shown by K as route guidance information which shows the distance from the present own vehicle position to a road branch point was shown, it is not restricted to this.
For example, as an information display image, an image indicating the estimated arrival time at the destination, an image indicating the remaining distance to the destination, and an image indicating the name of the surrounding point of the host vehicle are captured, and the estimated arrival time information, the remaining distance information, the point name The information may be recognized as route guidance information. Alternatively, only the arrow image Y may be detected and only the route guidance information indicating the traveling direction at the road branch point may be displayed.
That is, the route guidance information to be recognized can be arbitrarily set.

  In the first embodiment, the route guidance information is displayed on the head-up display 34b. However, the present invention is not limited to this. For example, when a navigation image created by the mobile terminal 10 and displayed on the terminal display 14 is captured and necessary route guidance information is recognized by image processing, only necessary information is displayed on the in-vehicle display 23 of the in-vehicle monitor device 20. It may be. In this case, the “image display device” is the mobile terminal 10 and the “vehicle display” is the vehicle display 23.

10 mobile terminal 20 in-vehicle monitor device (image display device)
23 vehicle-mounted display 30 vehicle display device 31 image capture unit 31a camera 31b image storage unit 32 information image detection unit 33 information recognition unit 34 information display unit 34a information output unit 34b head-up display (vehicle display)

Claims (5)

An image capturing unit that captures an image including map information and route guidance information displayed by the image display device;
An information image detecting unit for detecting an information display image indicating predetermined route guidance information from the image captured by the image capturing unit;
An information recognition unit for recognizing route guidance information indicated by the information display image detected by the information image detection unit;
An information display unit for displaying the route guidance information recognized by the information recognition unit on the vehicle-mounted display;
A vehicle display device comprising: The vehicle display device according to claim 1,
The information image detection unit searches the information display image for each image region having a predetermined shape identified from the image. In the vehicle display device according to claim 1 or 2,
The vehicle display device, wherein the information image detection unit searches for the information display image along a preset search direction, and stops the search of the information display image when the information display image is detected. In the vehicle display device according to any one of claims 1 to 3,
The information image detection unit detects an arrow image and a distance image displayed in the image,
The information recognition unit recognizes the direction indicated by the arrow image as route guidance information indicating the traveling direction at the road branch point, and the route indicated by the distance image indicates the distance to the road branch point. Recognize as guidance information,
The information display unit displays a traveling direction at the road branch point and a distance to the road branch point on the in-vehicle display device. In the vehicle display device according to any one of claims 1 to 4,
The vehicle display device, wherein the vehicle-mounted display device is a head-up display that reflects the projection light projected in front of the driver with a reflective member and forms a virtual image in front of the driver.