JP2010122135A - In-vehicle display system and display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an "in-vehicle display system and a display method" capable of easily recognizing a target such as an institution or a building displayed on a mobile display in a vehicle. <P>SOLUTION: The in-vehicle display system includes an imaging part 20 for imaging the periphery of an own vehicle, a mobile terminal device 50 including a display, a direction detecting part 121 for detecting a direction of the mobile terminal device 50, a capturing part 122 for capturing imaged data based on the detected direction, an institution searching part 123 for searching for institution information from map data based on a position of the own vehicle and the detected direction of the display 50A, and a display control part for displaying the captured imaged data Q1 and the institution information 52 on the display 50A. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a display system for displaying imaging data obtained by imaging the outside of a vehicle with an imaging camera on a portable display in the vehicle.

  A view system in which an in-vehicle camera is installed in a rear part or a side mirror of a vehicle and image data obtained by imaging the periphery of the vehicle is displayed on a display is being put into practical use. The imaged data is generally displayed on a display fixed in the vehicle. In addition to this, display on a display such as a mobile phone or a portable terminal device capable of moving in the vehicle space is also being considered. For example, Patent Document 1 discloses an out-of-vehicle situation display device that displays an out-of-vehicle situation in an arbitrary direction on an image display device as an image viewed from the viewpoint position of a user inside the vehicle. More specifically, the position of the image display device provided detachably with respect to the vehicle is detected, and on the basis of the detected position, an out-of-vehicle condition on the extension line toward the image display device is acquired by the in-vehicle camera. Cut out from the image and display the cut out image on the image display device.

JP 2005-184142 A

  As shown in Patent Document 1, it is possible to display an image obtained by imaging a situation outside the vehicle on a display that can move inside the vehicle. However, if there are obstacles such as the body of the vehicle in the direction of the mobile display, you cannot actually see the facilities and buildings displayed on the display with the naked eye. There is a problem that it takes time to search for buildings. In particular, the rear seat occupant has a narrower field of view than the front seat occupant, making it difficult to find the object. Further, in a large bus or the like, since the field of view varies greatly depending on the seat position, the ease of finding an object varies depending on the seat. Furthermore, in the case of a mobile display, since the display size is small, it may be difficult to visually recognize a building or facility from an image displayed there.

  The present invention solves such a conventional problem and provides an in-vehicle display system and a display method capable of easily recognizing a facility or a building displayed on a movable display whose direction can be changed in a vehicle. For the purpose.

  An in-vehicle display system according to the present invention includes an imaging unit that captures an image of the periphery of the host vehicle and outputs the captured image data, a movable display that can change the direction in the host vehicle, and a detection unit that detects the direction of the movable display. Cutting means for cutting out the imaging data based on the detected direction of the movable display, storage means for storing map data including facility information relating to buildings and facilities, own vehicle position detecting means for detecting the own vehicle position, Search means for searching for facility information from the map data stored in the storage means based on the detected vehicle position and the detected direction of the movable display; the extracted imaging data; and the searched facility information Display control means for displaying on a movable display.

  Preferably, the display control means displays facility names included in the retrieved facility information in a list form. Preferably, the display control means displays facility information corresponding to a building or facility shown in the imaging data.

  An in-vehicle display system according to the present invention includes an imaging unit that captures an image of the periphery of the host vehicle and outputs the captured image data, a movable display that can change the direction in the host vehicle, and a detection unit that detects the direction of the movable display. Cutting means for cutting out the imaging data based on the detected direction of the movable display, storage means for storing map data including facility information relating to buildings and facilities, own vehicle position detecting means for detecting the own vehicle position, Input means for inputting a target facility, position detecting means for detecting the position of the target facility with reference to the map data stored in the storage means, and display control means for displaying the cut-out imaging data on a movable display The direction of the detected movable display is compared with the detected position of the target facility, and the facility information of the target facility is displayed on the movable display. There and a guide means for guiding the direction of change of the movable display to be displayed.

  Preferably, the movable display is a display provided in a portable communication terminal or a portable electronic processing terminal, and the display control means provides imaging data and facility information to the portable communication terminal or the portable electronic processing terminal via wireless communication. To do.

  The display method according to the present invention is to display imaging data outside the vehicle in the direction in which the movable display is directed on a movable display that can change the direction inside the vehicle. Providing data, detecting a direction in which the movable display is directed with respect to a reference direction, cutting out imaging data based on the detected direction of the movable display, and the vehicle position and detected Searching for facility information used for navigation based on the direction of the movable display, and displaying the extracted imaging data and the retrieved facility information on the movable display.

  The display method according to the present invention is to display imaging data outside the vehicle in a direction in which the movable display is directed on a movable display that can change the direction in the host vehicle. Referring to map data used for navigation, detecting a direction in which the movable display is directed with respect to the direction in which the movable display is directed, cutting out imaging data obtained by imaging the periphery of the vehicle based on the direction of the movable display Searching for the position of the target facility, and guiding the change in the direction of the movable display so that the target facility is displayed in the extracted imaging data when the extracted imaging data is displayed on the movable display. Have

  According to the present invention, since the facility information corresponding to the imaging data displayed on the movable display is also displayed, it is easy to recognize the projected building or facility. Furthermore, when searching for a destination facility, a guidance (guide) indicating which direction the movable display should be directed is given, so that the destination facility can be easily found in a short time.

  In the embodiment of the present invention, by providing a combination of information from an in-vehicle navigation device and an in-vehicle camera, a mobile see-through image (projecting the situation outside the vehicle to a movable display in the vehicle) can be quickly provided to the passenger. It is characterized by. The best mode for carrying out the present invention will be described below in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an in-vehicle display system according to an embodiment of the present invention. The in-vehicle display system 10 includes an imaging unit 20 that captures the vicinity of the vehicle and the interior of the vehicle, an input unit 30 that inputs an instruction from the user, a storage unit 40 that stores various data such as map data, and the imaging unit 20. A portable terminal device 50 capable of displaying captured image data around the vehicle, a voice output unit 60 that outputs voice, a navigation function unit 70 that provides road guidance to a destination, and a control unit that controls each unit 80.

  As shown in FIG. 2, the imaging unit 20 includes outside-vehicle imaging cameras 22 a, 22 b, 22 c, and 22 d that image a range of about 360 degrees around the host vehicle, and an in-vehicle imaging camera that images the inside of the vehicle. The on-vehicle imaging cameras 22a to 22d and the on-vehicle imaging camera preferably have fisheye lenses with a large viewing angle. The outside imaging cameras 22a to 22d are attached to the front and rear bumpers and the left and right door mirrors of the host vehicle. The outside imaging cameras 22a and 22b have a viewing angle θ1, and the outside imaging cameras 22c and 22d have a viewing angle θ2. The entire periphery of the vehicle is imaged by overlapping.

  Although the portable terminal device 50 is not particularly limited, the direction can be freely changed in the vehicle, and a communication function for data communication of data such as imaging data with the control unit 80, and a display function for displaying the imaging data on a display, It has. For example, a mobile phone, a portable electronic terminal, a notebook personal computer, or the like can be used.

  The input unit 30, the storage unit 40, and the audio output unit 60 may be provided independently by the in-vehicle display system 10, and when an audio system, a video system, and a navigation system are installed in the vehicle, It may be shared with other systems.

  The navigation function unit 70 reads the map data around the detected vehicle position from the storage unit 40 and the vehicle position detection function that detects the vehicle position based on positioning data from autonomous navigation sensors such as GPS satellites and gyro sensors. It has a display function for displaying this on the display, a function for searching for a guidance route from the vehicle position to the destination, and performing guidance using the optimum guidance route. The map data used by the navigation function unit 70 may be provided in the navigation function unit 70 or stored in the storage unit 40. Here, it is assumed that the map data is stored in the storage unit 40.

  The map data includes road map data related to roads and topography, and facility data related to buildings and facilities, and the road map data includes link data and intersection data. The facility data includes hierarchical data as shown in FIG. 3, for example. That is, the facility data includes a plurality of facility genres and facility names belonging to each facility genre, and each facility name includes facility coordinates, facility address, facility polygon, and the like. The facility genre includes, for example, a sightseeing spot, a lodging spot, an amusement park, a station, and a restaurant. The facility name and facility address include text information indicating them, and the facility coordinates include latitude and longitude information. The facility polygon is appearance shape data for identifying a facility, and two-dimensional or three-dimensional polygon data can be used.

  Next, the control unit 80 will be described. The control unit 80 is configured using a microcontroller, a microcomputer, or the like, stores a program in a memory such as a ROM or a RAM, and controls various operations by executing the program.

  FIG. 4 is a functional block diagram of the control unit 80. The control unit 80 includes a direction detection unit 121 that detects a direction in which the portable terminal device or the display thereof is facing, a cutout unit 122 that cuts out imaging data, and facility information from the direction of the portable terminal device and the vehicle position. A facility search unit 123 that searches for the image data, and an image composition unit 124 that creates a composite image obtained by combining the extracted imaging data and the retrieved facility information.

  In this example, the direction detection unit 121 detects the direction of the portable terminal device 50 using image data captured by the in-vehicle imaging camera. For this reason, the in-vehicle imaging camera is preferably installed at a position overlooking the entire interior of the vehicle, for example, on the ceiling of the vehicle, and images the inside of the vehicle from above. FIG. 5 is a schematic imaging example when the inside of the vehicle is imaged by the in-vehicle imaging camera. In the figure, D is a driver's seat, P1 is a passenger seat, P2 and P3 are rear seats, M is a traveling direction of the vehicle, α is an angle formed by the traveling direction M and the reference line B (here, a right angle), S is a direction in which the portable terminal device 50 is facing, and β is an angle formed by the direction S and the reference line B. The reference line B is not particularly limited. For example, if the direction is parallel to the axis connecting the front wheels of the host vehicle, the traveling direction of the host vehicle is always orthogonal to the reference line B.

  The direction detection unit 121 receives in-vehicle image data as shown in FIG. 5 and analyzes the image. Thereby, the position of the portable terminal device 50 is detected, and the direction of the portable terminal device 50 is detected. Here, it is assumed that the portable terminal device 50 has a thin rectangular appearance, the display 50A is installed on one surface thereof, and the direction orthogonal to the display 50A is the direction S of the portable terminal device 50. Accordingly, the direction detection unit 121 detects the direction S of the portable terminal device 50, that is, the angle β formed by the direction S and the reference line B.

  The cutout unit 122 receives the vehicle outside imaging data around the own vehicle from the vehicle outside imaging cameras 22a to 22d, and cuts out the vehicle outside imaging data based on the direction S of the portable terminal device 50 detected by the direction detection unit 121. FIG. 6 shows a method for extracting imaged data. Image data Q outside the vehicle in the range of 360 degrees is obtained with the vehicle position O at the center by the image pickup cameras 22a to 22d outside the vehicle. When the portable terminal device 50 faces in the direction S, the imaging data Q1 corresponding to the cut-out angle of γ is cut out around the direction S. The cut-out angle γ can be appropriately selected according to the display size and resolution of the portable terminal device.

  The facility search unit 123 searches for facility data to be presented to the portable portable terminal device 50 from the facility data stored in the storage unit 40. The facility search unit 123 preferably searches the cut-out imaging data Q1, that is, the facility data existing within the cut-out angle 2γ. FIG. 7 shows a facility data search method. In the figure, r is a distance that can be imaged around the vehicle position O. The facility search unit 123 is surrounded by the vehicle position (latitude and longitude coordinates) obtained from the navigation function unit 70, the imaging distance r, and the cut-out angle 2α centered on the direction S of the portable terminal device 50. Whether or not the facility coordinates (see FIG. 3) of the facility data exist in the search area (shown by hatching) is searched, and the facility information such as the corresponding facility name and facility polygon is extracted.

  In addition to the above, the facility information search method can use, for example, a peripheral facility search result centered on the vehicle position obtained from the navigation function unit 30. In this case, facilities belonging to the cut-out angle 2γ may be extracted from the coordinate position of the facility obtained from the peripheral facility search result. Furthermore, facility extraction is not necessarily limited to the cut-out angle 2γ, and facilities included in a wider angle may be extracted.

  The image composition unit 124 synthesizes the cut-out imaging data Q1 and the facility information retrieved by the facility retrieval unit 123. The synthesized image is displayed on the display of the portable terminal device 50. FIG. 8 is a display example of the synthesized image. On the display 50A of the portable terminal device 50, imaging data Q1 outside the vehicle on the extension line in the direction S of the portable terminal device 50 is displayed on a constant scale. Further, the facility list 52 indicating the facility names of the facilities included in the imaging data Q1 is displayed on the display 50A. In the facility list 52, some facility names are displayed side by side in the vertical direction. However, when the number of facility names is large, the facility names may be scrolled. The facility list 52 is preferably synthesized at a position that does not block the image of the imaging data Q1, for example, at the top and bottom or left and right ends of the imaging data Q1.

  Next, the operation of the in-vehicle display system of this embodiment will be described with reference to the flowchart of FIG. First, the imaging unit 20 starts imaging around the vehicle and inside the vehicle (step S101). Next, the direction detection unit 121 detects in which direction the portable terminal device 50 is directed, using image data in the vehicle (step S102). Next, based on the direction S detected by the direction detection unit 121, the cutout unit 122 cuts out outside-vehicle imaging data at the cutout angle 2γ as shown in FIG. 6 (step S103).

  Next, the facility search unit 123 receives the vehicle position information from the navigation function unit 70, and within the range of the vehicle position information, the direction S of the portable terminal device 50, and the imaging distance r, as shown in FIG. Existing facility information is searched from map data (step S104). Then, the facility search unit 123 creates a facility list including a plurality of searched facility names (step S105).

  Next, the image synthesizing unit 124 creates an image obtained by synthesizing the extracted imaging data Q1 and the created facility list 52 (step S106), and the synthesized image is displayed on the display 50A of the portable terminal device 50. (Step S107). Thereby, on the display 50A of the portable terminal device 50, imaging data on the extension line or outside the vehicle in the direction of the user's line of sight is displayed, and the facility name regarding the building or facility being displayed is also displayed. Easily find the target facility from the buildings and facilities displayed in the imaging data even when the outside of the vehicle cannot be seen or when the display size of the display 50A is small and it is difficult to see the building. Can do. Further, the facility name may be output from the audio output unit 60 together with the display of the facility name.

  In the said Example, although the list | wrist of the facility name was displayed, this is an example and facility information may be displayed with another form. For example, the facility genre and facility address may be displayed together with the facility name or instead of the facility name. Furthermore, the facility polygon included in the facility information is used to perform pattern matching with buildings and facilities of actual imaging data, to identify individual facilities or buildings, and to display the facility names for them. Good. For example, as shown in FIG. 10, corresponding facility names such as “Tokyo Tower”, “A Building”, and “B Building” are displayed for each identified facility or building. Thereby, it is possible to know details of individual facilities and buildings shown in the imaging data.

  Next, a second embodiment of the present invention will be described. The second embodiment has a function of guiding the search for the target facility input by the user. FIG. 11 is a functional block diagram of the control unit 80 according to the second embodiment. Components similar to those of the first embodiment are denoted by the same reference numerals.

  From the input unit 30 of the in-vehicle display system 10, the user can input a target facility. When the target facility is input, the target facility position detection unit 125 refers to the map data in the storage unit 40 and detects the coordinate position of the facility data that matches the target facility. Further, the position detection unit 125 converts the coordinate position of the target facility into a position vector when the host vehicle position O is used as a reference.

  The guiding unit 126 compares the position vector of the target facility with the direction M (or angle β) of the portable terminal device 50, and rotates the portable terminal device so that the target facility is reflected in the extracted imaging data Q1. Do direction guidance. For example, as shown in FIG. 12, if the target facility is at the position T1, the portable terminal device 50 is guided to rotate counterclockwise so that the target facility T1 is included in the cut-out angle 2γ, If the target facility is at the position T2, the portable terminal device 50 is guided to rotate in the clockwise direction so that the target facility T2 is included in the cut-out angle 2γ. In other words, the rotation of the portable terminal device is induced in a direction in which the difference between the angle β formed by the direction S of the portable terminal device 50 and the reference B and the angle β1 formed by the target facility and the reference B is reduced.

FIG. 13 is an example of guidance displayed on the display of the portable terminal device 50.
As shown in the figure, a guide image in which the direction to the target facility T1 or T2 is indicated by an arrow Y is synthesized and displayed on the display 50A. At this time, the voice output unit 60 may perform voice guidance such as “Please rotate the portable terminal device to the left”. Then, when the target facility T1 or T2 is displayed in the extracted image data Q1, the facility name of the target facility is displayed. In the example of FIG. 13, “Tokyo Tower” is displayed as the name of the target facility. As a result, even if the direction of the target facility is not known, the target facility can be confirmed in the imaging data by rotating the portable terminal device according to the guidance, and at the same time, the line of sight from the own vehicle You can easily know if you want to turn.

  The preferred embodiment of the present invention has been described in detail above. However, the present invention is not limited to the specific embodiment, and various modifications and changes can be made within the scope of the gist described in the claims. It can be changed.

It is a block diagram which shows the structure of the vehicle-mounted display system which concerns on the Example of this invention. It is the example of installation of the imaging camera outside a vehicle of the imaging part shown in FIG. It is a figure which shows the example of facility data. It is a functional block diagram of the control part shown in FIG. It is a figure which shows the example of an imaging by the in-vehicle imaging camera of the imaging part shown in FIG. It is a figure which shows the cutting-out method of imaging data. It is a figure which shows the search method of facility data. It is an example of the synthetic | combination image of cut-out imaging data and facility information. It is a flowchart which shows operation | movement of the vehicle-mounted display system which concerns on a present Example. It is another example of a display of the facility information of a present Example. It is a functional block diagram of a control part concerning the 2nd example of the present invention. It is a figure explaining operation | movement of the guidance | induction part in a 2nd Example. It is a display example of the synthesized image which concerns on a 2nd Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10: Vehicle-mounted display apparatus 20: Imaging part 30: Input part 40: Memory | storage part 50: Portable terminal device 50A: Display 52: Facility information 60: Audio | voice output part 70: Navigation function part 80: Control part M: Own vehicle Traveling direction S: Direction of portable terminal device B: Reference line α: Angle formed by traveling direction M with reference line β: Angle formed by direction S formed with reference line γ: Cutting angle r: Captureable distance Q: Surrounding of own vehicle Imaging data Q1: Extracted imaging data T1, T2: Location of target facility

Claims (7)

Imaging means for imaging the periphery of the vehicle and outputting the captured image data;
A movable display that can change direction in the vehicle,
Detection means for detecting the direction of the movable display;
Cutting means for cutting out the imaging data based on the detected direction of the movable display;
Storage means for storing map data including facility information relating to buildings and facilities;
Own vehicle position detecting means for detecting the own vehicle position;
Search means for searching facility information from map data stored in the storage means based on the detected vehicle position and the detected direction of the movable display;
Display control means for displaying the extracted imaging data and the retrieved facility information on a movable display;
A vehicle-mounted display system. The in-vehicle display system according to claim 1, wherein the display control unit displays facility names included in the retrieved facility information in a list form. The in-vehicle display system according to claim 1, wherein the display control unit displays facility information corresponding to a building or facility shown in the imaging data. Imaging means for imaging the periphery of the vehicle and outputting the captured image data;
A movable display that can change direction in the vehicle,
Detection means for detecting the direction of the movable display;
Cutting means for cutting out the imaging data based on the detected direction of the movable display;
Storage means for storing map data including facility information relating to buildings and facilities;
Own vehicle position detecting means for detecting the own vehicle position;
An input means for inputting a destination facility;
Position detecting means for detecting the position of the target facility with reference to the map data stored in the storage means;
Display control means for displaying the extracted imaging data on a movable display;
Guidance means for comparing the direction of the detected movable display and the detected position of the target facility, and inducing a change in the direction of the movable display so that the facility information of the target facility is displayed on the movable display;
A vehicle-mounted display system. The movable display is a display provided in a portable communication terminal or a portable electronic processing terminal, and the display control means provides imaging data and facility information to the portable communication terminal or the portable electronic processing terminal via wireless communication. Item 5. A vehicle-mounted display system according to any one of Items 1 to 4. A display method for displaying imaging data outside the vehicle in a direction in which the movable display is directed to a movable display that can change the direction in the vehicle,
Imaging the surroundings of the vehicle and providing the imaging data;
Detecting a direction in which the movable display is directed with respect to a reference direction;
Cutting out imaging data based on the detected direction of the movable display;
Retrieving facility information used for navigation based on the vehicle position and the direction of the detected movable display;
Displaying the extracted imaging data and the retrieved facility information on a movable display;
Display method. A display method for displaying imaging data outside the vehicle in a direction in which the movable display is directed to a movable display that can change the direction in the vehicle,
Entering a destination facility;
Detecting a direction in which the movable display is directed with respect to a reference direction;
Cutting out imaging data obtained by imaging the periphery of the vehicle based on the direction of the movable display;
Searching for the location of the target facility with reference to the map data used for navigation;
A step of inducing a change in the direction of the movable display so that the target facility is displayed in the extracted imaging data when the extracted imaging data is displayed on the movable display;
Display method.

Images