CN110039996B - Display device for vehicle - Google Patents

Display device for vehicle Download PDF

Info

Publication number
CN110039996B
CN110039996B CN201811514542.5A CN201811514542A CN110039996B CN 110039996 B CN110039996 B CN 110039996B CN 201811514542 A CN201811514542 A CN 201811514542A CN 110039996 B CN110039996 B CN 110039996B
Authority
CN
China
Prior art keywords
information
vehicle
driver
display device
personal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811514542.5A
Other languages
Chinese (zh)
Other versions
CN110039996A (en
Inventor
佐佐木章
安藤荣祐
早岛美纱子
鬼头早纪
山下真央
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toyota Motor Corp
Original Assignee
Toyota Motor Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toyota Motor Corp filed Critical Toyota Motor Corp
Publication of CN110039996A publication Critical patent/CN110039996A/en
Application granted granted Critical
Publication of CN110039996B publication Critical patent/CN110039996B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
    • G06V20/582Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of traffic signs
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60KARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
    • B60K35/00Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
    • B60K35/65Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive
    • B60K35/654Instruments specially adapted for specific vehicle types or users, e.g. for left- or right-hand drive the user being the driver
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/09Arrangements for giving variable traffic instructions
    • G08G1/0962Arrangements for giving variable traffic instructions having an indicator mounted inside the vehicle, e.g. giving voice messages
    • G08G1/0967Systems involving transmission of highway information, e.g. weather, speed limits
    • G08G1/096766Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission
    • G08G1/096783Systems involving transmission of highway information, e.g. weather, speed limits where the system is characterised by the origin of the information transmission where the origin of the information is a roadside individual element
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/146Display means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/043Identity of occupants
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Atmospheric Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Traffic Control Systems (AREA)
  • Instructional Devices (AREA)
  • Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
  • Instrument Panels (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The present invention relates to a display device for a vehicle. A display device for a vehicle is provided with: a personal information acquisition unit that acquires personal information of a driver of the vehicle from an identification tag in which the personal information of the driver is recorded; an environmental information acquisition unit that acquires environmental information around a vehicle; an information conversion unit capable of converting environmental information according to personal information of a driver; and a display unit that displays information converted from the personal information of the driver toward the interior of the vehicle.

Description

Display device for vehicle
Technical Field
The present disclosure relates to a display device for a vehicle.
Background
Japanese patent application laid-open No. 2009-. The road sign display device photographs a road sign through a camera, translates the contents of the road sign, and displays the road sign of the driver's own country on the display device.
The road sign display device of japanese patent laid-open No. 2009-109404 determines the native language of the driver from data input in advance by the driver. However, when the driver inputs the native language by mistake, the road sign may not be translated properly, and information that the driver cannot understand may be displayed on the display device.
Disclosure of Invention
In view of the above, it is an object of the present disclosure to provide a display device for a vehicle that can display information that can be understood by a driver.
The display device for a vehicle according to claim 1 includes: a personal information acquisition unit that acquires personal information of a driver of a vehicle from an identification tag in which the personal information of the driver is recorded; an environmental information acquisition unit that acquires environmental information around the vehicle; an information conversion unit capable of converting the environmental information based on personal information of the driver; and a display unit that displays information converted from the personal information of the driver toward an interior of the vehicle.
According to the vehicle display device of claim 1, the information conversion means converts the environmental information around the vehicle acquired by the environmental information acquisition means. At this time, the information conversion means converts the environmental information based on the personal information of the driver acquired from the identification tag in which the personal information of the driver is recorded. Therefore, it is difficult to erroneously acquire the personal information of the driver, for example, as compared with a case where the driver manually inputs the personal information of the driver. This allows information that can be understood by the driver to be displayed on the display means. The "environment information" is information outside the vehicle, and includes information on an object visible to a vehicle occupant, traffic information invisible to the vehicle occupant, and the like. The "personal information of the driver" is information including at least the nationality of the driver.
A vehicular display device according to claim 2 is the vehicular display device according to claim 1, wherein the imaging device as the environment information acquiring means acquires a road sign as the environment information, and the information converting means converts the road sign into character information understandable by the driver.
According to the display device for a vehicle of claim 2, the road sign acquired by the imaging device is converted into character information understandable by the driver by the information conversion means. Therefore, even when the driver cannot directly understand the contents indicated by the road sign pattern, the driver can understand the contents by the character information. This enables the driver to understand the road sign even when driving the vehicle in a country having a road sign different from the country of residence, for example.
The vehicular display device according to claim 3 is the vehicular display device according to claim 1 or 2, wherein the environment information acquisition means includes a communication device that acquires traffic information as the environment information, and the information conversion means converts the traffic information into character information.
According to the vehicular display device of claim 3, the traffic information acquired by the communication device is converted into character information that can be understood by the driver by the information conversion means. Therefore, even when the driver cannot directly understand the traffic information acquired by the communication device, the driver can understand the content by the character information. Thus, the driver can understand the traffic information even when driving the vehicle in a country having a language different from the country of residence, for example.
The vehicular display device according to claim 4 is the vehicular display device according to claim 3, wherein the communication device has a transmission function of transmitting the traffic information to another vehicle.
According to the display device for a vehicle of claim 4, the communication device has a transmission function of transmitting traffic information to another vehicle, and therefore the traffic information can be transmitted between the vehicles. Therefore, for example, in the case where an accident occurs around the vehicle, the accident information can be transmitted to the following vehicle. The following vehicle can then transmit the accident information to the vehicle at the back. Thus, the communication device can obtain information with a higher degree of urgency more quickly than a case where accident information is acquired only from the internet, for example.
The vehicle display device according to claim 5 is the vehicle display device according to claim 1, wherein the information conversion means converts the environment information into image information.
According to the display device for a vehicle of claim 5, the environment information is converted into the image information by the information conversion means. For example, a road sign as the environment information is converted into image information that can be understood by the driver. Therefore, even when the driver cannot directly understand the contents indicated by the road sign pattern, the driver can understand the contents through the image information.
Alternatively, for example, a landscape that is uncomfortable to the driver as the environmental information is converted into image information that is not uncomfortable to the driver by the information conversion unit. Thus, the stress on the driver driving the vehicle in different countries of the cultural circle can be reduced.
A vehicle display device according to claim 6 is the vehicle display device according to any one of claims 1 to 5, wherein when an occupant other than the driver is present in the vehicle, the personal information acquisition means acquires the personal information of the occupant from an identification tag in which the personal information of the occupant is recorded, the information conversion means converts the environmental information based on the personal information of the occupant, and the display means displays the information converted based on the personal information of the occupant toward the interior of the vehicle.
According to the display device for a vehicle of claim 6, the display means displays information converted from personal information of a passenger other than the driver in addition to information converted from personal information of the driver. Therefore, the occupant other than the driver can understand the environmental information acquired by the environmental information acquisition means.
The vehicle display device according to claim 7 is the vehicle display device according to any one of claims 1 to 6, wherein the display means displays additional information related to the environmental information based on personal information of the driver.
According to the display device for a vehicle of claim 7, the display unit displays additional information related to the environmental information in addition to the information converted according to the personal information of the driver. Thus, the driver can get additional knowledge about the environmental information.
According to the display device for a vehicle of the present disclosure, information that can be understood by the driver can be displayed.
Drawings
Exemplary embodiments of the invention are described in detail with reference to the following drawings, wherein:
fig. 1 is a conceptual diagram schematically illustrating a vehicle mounted with a vehicle display device according to an embodiment of the present disclosure;
fig. 2 is a side view showing an example of displaying a position of information converted according to personal information of a driver in the display device for a vehicle of the embodiment of the present disclosure;
fig. 3A is a flowchart showing a flow in which the information conversion unit converts the information transmitted from the environmental information acquisition unit in the display device for a vehicle of the embodiment of the present disclosure;
fig. 3B is a conceptual diagram illustrating an example of information acquired by the environmental information acquisition unit and converted information converted by the information conversion unit in the display device for a vehicle according to the embodiment of the present disclosure;
fig. 4 is a conceptual diagram illustrating a state in which traffic information is transmitted between vehicles mounted with the vehicle display device of the embodiment of the present disclosure;
fig. 5A is a perspective view showing a logo as environmental information that is visually recognized by a driver in a vehicle mounted with the display device for a vehicle according to the embodiment of the present disclosure;
fig. 5B is a perspective view showing a state in which the converted information is displayed at a position overlapping with the mark in the display section;
fig. 6 is a block diagram showing a hardware configuration of the display device for a vehicle.
Detailed Description
< display device for vehicle >
The display device 20 for a vehicle of the embodiment of the present disclosure is a driving assistance mechanism for assisting a driver P (see fig. 2) in driving the vehicle in a country other than a country of residence. The vehicle display device 20 displays a display for suppressing driving troubles caused by a difference in traffic regulations, for example, to the interior of the vehicle cabin.
As shown in fig. 1, the vehicle display device 20 is mounted on a vehicle 10, and includes a personal information acquisition unit 30, an environmental information acquisition unit 40, an information conversion unit 50, and a display unit 60.
As shown in fig. 6, the information conversion Unit 50 has a CPU52(Central Processing Unit: processor), a ROM54(Read Only Memory), a RAM56(Random Access Memory), and a Memory 58. These respective configurations in the information conversion unit 50, the personal information acquisition unit 30, the environmental information acquisition unit 40, and the display unit 60 are communicably connected to each other via a bus 90.
The CPU52 is a central arithmetic processing unit, executes various programs, and controls the respective sections. That is, the CPU52 reads out a program from the ROM54 or the memory 58, and executes the program with the RAM56 as a work area. The CPU52 performs control of the above-described configurations and various arithmetic processes in accordance with programs recorded in the ROM54 or the memory 58. In the present embodiment, the ROM54 or the memory 58 stores an information acquisition program for causing the personal information acquisition unit 30 and the environmental information acquisition unit 40 to acquire information, an information conversion program for converting information acquired by the personal information acquisition unit 30 and the environmental information acquisition unit 40, and an information display program for displaying the converted information on the display unit 60.
The ROM54 stores various programs and various data. The RAM56 temporarily stores programs or data as a work area. The memory 58 is constituted by an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores various programs including an operating system and various data.
When the various programs are executed, the vehicle display device 20 realizes various functions using the hardware resources. The functional configuration realized by the display device 20 for a vehicle will be described.
(personal information acquisition Unit)
The personal information acquisition unit 30 is an information acquisition device for obtaining personal information of a boarding person. The CPU52 reads out the information acquisition program from the ROM54 or the memory 58, and expands it into the RAM56 to execute it, thereby performing personal information acquisition processing. The personal information acquisition unit 30 transmits the acquired personal information of the boarding person to the information conversion unit 50 or the display unit 60 in the form of an electric signal. The personal information acquisition unit 30 includes an identification tag reading unit 32 and a biological sign reading unit 34.
The identification tag is an identification document in which at least nationality is recorded as personal information. Specifically, passports, international drivers licenses, and the like, in which IC chips for nationality registration are embedded, correspond to identification tags. Preferably, the identification tag includes, as personal information, a country of residence, year, month, day of birth, sex, religious belief, language used by the owner, and occupation, in addition to nationality.
As shown in fig. 2, the identification tag reading unit 32 is a detection device provided in the instrument panel 12 of the vehicle 10. When the rider of the vehicle 10 brings the identification tag close to the identification tag reading section 32, the identification tag reading section 32 acquires personal information of the rider from, for example, an IC chip embedded in the identification tag. At this time, the identification tag reading unit 32 acquires personal information of at least the driver P among the boarding persons. Further, "driver" means a passenger sitting in a driver seat. The driver's seat includes a seat in which a passenger seated in the seat drives during manual driving in a vehicle having an automatic driving function. The acquired personal information is passed to the information conversion unit 50.
The biological sign reading unit 34 is a detection device that detects the position of the eyes of the person riding thereon. For example, as shown in fig. 2, the biological sign reading section 34 detects the position PE of the eyes of the driver P. The biological sign reading unit 34 detects positions SP1 and SP2 at which straight lines L1 and L2, which connect the eye position PE and the signs S1 and S2 located outside the vehicle 10, intersect the display unit 62 (details will be described later) on the front window 14.
The detected positions SP1, SP2 are transmitted to the HUD unit 64 (details will be described later). The positions of the markers S1 and S2 relative to the vehicle 10 are detected by the imaging device 42, which will be described later, and transmitted to the vital sign reading unit 34. In fig. 2, the biological sign reading unit 34 is provided in the vehicle 10, but may be provided in the head of the driver P as a wearable terminal, for example.
(environmental information acquiring Unit)
The environment information acquisition unit 40 shown in fig. 1 is an information acquisition means for obtaining environment information. The CPU52 reads out the information acquisition program from the ROM54 or the memory 58, and expands it into the RAM56 to execute it, thereby performing the environment information acquisition processing. The environmental information acquisition unit 40 transmits the acquired environmental information to the information conversion unit 50 or the biological sign reading unit 34 as an electric signal. The environment information acquisition unit 40 includes an imaging device 42 and a communication device 44.
The "environment information" refers to information outside the vehicle 10. Specifically, the traffic information includes information related to traffic regulations such as logos and road markings, information related to buildings fixed on the land such as building names, bridge names, and station names, information related to objects visible to the occupants of the vehicle 10 such as information related to mountains and rivers, traffic information invisible to the occupants of the vehicle 10 such as traffic accident information and traffic jam information, and the like.
The imaging device 42 is a camera that images the space outside the vehicle 10, and preferably can image a range that the driver P shown in fig. 2 can visually recognize through the front window 14. The imaging device 42 includes a distance measuring device, and is capable of detecting a distance between the vehicle 10 and a sign around the vehicle 10, an inclination angle, a vehicle-to-vehicle distance from a leading vehicle, and the like.
The communication device 44 includes a GPS receiver and is capable of detecting positional information of the vehicle 10. In addition, the communication device 44 can access a database on the internet, and receive a logo, a road sign, a building name, a bridge name, a station name, and the like, which are located in the periphery of the vehicle 10, and map information (hereinafter, these are collectively referred to as "logo, and the like"). In addition, the communication device 44 can receive traffic information such as traffic accident information and congestion information from a database on the internet.
Further, the communication device 44 can communicate with vehicles around the vehicle 10. For example, as shown in fig. 4, when a collision accident occurs in the vicinity of the vehicle 10A, the image pickup device 42A mounted in the environment information acquisition unit 40A of the vehicle 10A acquires accident information (information I1) as traffic information. The information I1 is transmitted by the communication device 44A to the following vehicle 10B.
The vehicle 10B receives the information I1 transmitted from the communication device 44A through the communication device 44B in the environment information acquisition unit 40B. Further, the imaging device 42B detects the inter-vehicle distance from the vehicle 10A (information I2). The information I1 and the information I2 are transmitted to the following vehicle 10C by the communication device 44B.
The following vehicle 10C receives the information I1 transmitted from the communication device 44B and the information I2 through the communication device 44C in the environment information acquisition unit 40C. Further, the imaging device 42C detects the inter-vehicle distance to the vehicle 10B (information I3). The information I1, the information I2, and the information I3 are transmitted from the communication device 44C to the following vehicle, not shown.
In this way, the communication device 44 can communicate with the vehicles around the vehicle 10. Therefore, in the case where an accident occurs in the vicinity of the vehicle 10, the driver P of the vehicle 10 can obtain the accident information earlier than in the case where the accident information is acquired after uploading onto the internet.
Further, the communication device 44 transmits the accident information (information I1) to the following vehicle, and also transmits the inter-vehicle distances to the preceding vehicle (information I2, I3, …) to the following vehicle. Therefore, the driver P can confirm the presence or absence of congestion due to the accident and the possibility of congestion occurrence using the information converted by the information conversion means 50 described later.
(information conversion unit)
The information conversion unit 50 is an information processing device that converts the environment information acquired by the environment information acquisition unit 40 into information "understandable by at least the driver P" or "information that does not feel uncomfortable" among the boarding persons. The CPU52 reads out the information conversion program from the ROM54 or the memory 58, and executes it by expanding it to the RAM56, thereby performing information conversion processing.
An example of an information processing method by the information conversion unit 50 will be described with reference to the flowchart of fig. 3A. Fig. 3A shows a flow in which the CPU52 converts the "identification information" acquired by the imaging device 42 in the environment information acquisition unit 40 into "information that the driver P can understand".
First, the CPU52 reads the information acquisition program, and the image captured by the imaging device 42 is transferred from the imaging device 42 to the information conversion unit 50 (step 100). The image transfer is continuously performed in sequence.
The CPU52 extracts an image from the video image for a predetermined number of frames (step 102), and verifies whether the image includes a recognizable tag (step 104). The authentication of the image is determined based on whether the identification information can be detected from a part of the image. The identification information is stored in advance in the ROM54 or the memory 58 in the information converting unit 50.
When the image includes a recognizable logo, the CPU52 reads the information conversion program and converts the logo into information understandable by the driver P based on the personal information of the driver P acquired by the personal information acquisition unit 30 (step 106). Specifically, for example, as shown in fig. 3B, the sign S1 having the meaning "no overtaking" in japan is converted into a sign S1G having the meaning "no overtaking" in the united kingdom and character information (native language) S1T having the meaning "no overtaking" in the united kingdom so that the driver P, who is an english officer, can understand it. Then, the converted information (the symbol S1G, the character information S1T) is displayed on the display unit 60 described later (step 108).
If a recognizable marker is not included in the image extracted from the video captured by the imaging device 42 in step 104, the process returns to step 102. Then, the image of the next frame is taken out, and whether the image contains the recognizable mark or not is verified.
In the present embodiment, it is verified whether or not the identification information can be detected from the image taken out from the video captured by the imaging device 42, based on the identification information stored in the ROM54 or the memory 58 in the information conversion unit 50 in step 104, but the embodiment of the present disclosure is not limited thereto. For example, the CPU52 may read the information acquisition program, and the communication device 44 may detect the identification information from the image based on the identification information of the surroundings of the vehicle 10 acquired from a database on the internet. This allows the identification information to be detected even when the resolution of the image is low, and therefore the converted information can be displayed early.
Different examples of the information processing method of the CPU52 in the information conversion unit 50 are explained. For example, the CPU52 can read the information conversion program and convert the "information other than the identification information" acquired by the imaging device 42 in the environment information acquisition unit 40 into information that can be understood by the driver P. Specifically, for example, when a historical building is reflected in the video, the building name of the building is converted into the native language of the driver P. When the sightseeing spot is reflected in the video, the name of the sightseeing spot is converted into the native language of the driver P.
The CPU52 can read the information conversion program to convert the "information other than the identification information" acquired by the imaging device 42 in the environment information acquisition unit 40 into "information that the driver P does not feel uncomfortable". Specifically, for example, when the driver P believes that the cow is a religious religion of the sheng, when a restaurant or a meat processing place where beef is provided is reflected in the video, the restaurant or the meat processing place can be converted into a mosaic image.
The CPU52 can read the information conversion program and convert the "traffic information" acquired by the communication device 44 in the environment information acquisition unit 40 into information that can be understood by the driver P. Specifically, for example, when the communication device 44 acquires the accident information from the position of the vehicle 10 to the destination of the vehicle 10, the information is converted into the native language of the driver P (i.e., character information).
When traffic information is transmitted from a leading vehicle, the CPU52 determines the presence or absence of congestion and the possibility of congestion occurrence based on the inter-vehicle distances (information I2, I3, …) accumulated by the transmission between the leading vehicles. Then, the information conversion program is read out, and the judgment result is converted into character information. In this way, the CPU52 can also convert information estimated from the obtained information into character information.
As in the above-described example, the environment information acquired by the environment information acquiring unit 40 is converted into at least one of image information and character information by the CPU 52. In the following description, the environmental information converted by the CPU52 may be referred to as "converted information".
(display unit)
The display unit 60 is a display device for displaying the converted information toward the interior of the vehicle 10. The CPU52 reads out an information display program from the ROM54 or the memory 58, and develops it into the RAM56 to execute it, thereby performing information display processing. As shown in fig. 2, the display unit 60 includes a display unit 62 and a HUD (head up display) unit 64. The display 62 is a head-up display formed on the front window 14 of the vehicle 10. The display unit 62 is formed substantially over the entire surface of the windshield 14.
A HUD (head up display) unit 64 is provided below the front window 14 in order to display at least one of image information and character information on the display 62. The HUD unit 64 projects the converted information delivered from the information conversion unit 50 to the display unit 62.
For example, as shown in fig. 5A, the logo S1 as the environment information acquired by the imaging device 42 (see fig. 1) is converted into information (the logo S1G, the character information S1T) understandable by the driver P as shown in fig. 3B by reading out the information conversion program by the CPU 52. As shown in fig. 2, the converted information is displayed by the HUD unit 64 at a position SP1 detected by the biological sign reading section 34 in the display section 62. As a result, as shown in fig. 5B, the driver P can visually recognize the converted information displayed so as to overlap the position where the indicator S1 exists when viewed from the driver P.
In addition, regardless of the position of the eyes of the driver P, traffic information such as accident information (information I1) acquired by the communication device 44 is displayed at a predetermined position on the display unit 62. For example, as shown at position SP3 shown in fig. 5A and 5B, the display portion is displayed at a position where it is difficult to disturb driving, such as the uppermost portion of the display portion 62.
Further, the mark or the like and the converted information obtained by converting the mark or the like into the information understandable by the driver P can be displayed at the position SP 3. For example, by collectively setting the sign S1, the sign S1G, and the character information S1T at the position SP3, the driver P can understand the meaning of the sign S1 visually recognized on the outside of the front window 14. When there are a plurality of signs around the vehicle 10, the signs are displayed from the top to the bottom in order from the nearest sign, so that the driver P can easily understand the meaning of the signs. In this case, the mark S1G and the character information S1T can be displayed at the position SP 1.
Further, for example, when an accident occurs in front of the vehicle 10 or a person or an animal intrudes into the vehicle, or when the driver P needs to brake suddenly, information is displayed at a position with high visibility in front of the driver P, such as the position SP 4. The vehicle display device 20 can display emergency information with such a high degree of emergency. In addition, when the emergency information is displayed, it is preferable to sound an alarm sound to alert the driver P.
Further, when an animal breaks the road, if the animal is emphasized more than the resident country of the driver in the country in which the vehicle 10 is traveling, the message is displayed on the display unit 62 as additional information. Specifically, for example, in the case of driving the vehicle 10 in a country that lives a religious national citizen that many beliefs regard cattle as a sheng, when cattle break the road, a message that cattle are regarded as a sheng is displayed at the position SP3, for example. Alternatively, the display unit 62 displays the position overlapping the cow. Thereby, the driver P can drive with special attention paid not to collision with the cow.
Such "additional information" is not information obtained by directly converting a logo, an animal, or the like into an image or text that can be understood by the driver P. The additional information is information that is preferable for driving in accordance with the difference between the country where the driver P resides and the country where the vehicle 10 travels, and is stored in the information conversion unit 50 in advance, for example. The display function of the emergency information and the additional information is not essential in the present disclosure, and can be omitted as appropriate.
< action, Effect >
As described above, according to the vehicle display device 20 of the present embodiment, when the driver P drives the vehicle 10 in a country (foreign country) other than the home country (home country), the foreign country identification can be displayed in a manner that the foreign country identification is converted to the home country identification of the driver P. Therefore, the risk of safety when driving in a foreign country can be reduced.
The vehicle display device 20 can convert the building name of the historic building and the place name of the sightseeing spot into the native language of the driver P and display them. Therefore, when the driver P is a visitor, information on a nearby place can be easily obtained. In this way, the embodiment of displaying the names of sightseeing spots is applied to the case of the automatic drive control vehicle 10, for example. By displaying such sightseeing information in the case of automatic driving control, the guest can effectively utilize the travel time.
The vehicle display device 20 can convert a landscape in which the driver P may feel uncomfortable into an image (e.g., a mosaic image) in which the driver P does not feel uncomfortable, and display the image. Therefore, the uncomfortable experience based on the cultural difference between the country of the driver P and the country in which the vehicle 10 is driven can be alleviated.
In the vehicle display device 20 of the present embodiment, the identification tag reading unit 32 acquires the personal information of the driver P from the identification tag owned by the driver P. Therefore, for example, compared to the case where the driver P manually inputs the personal information by himself, it is easy to obtain the accurate personal information. In addition, when the driver shifts, the contents displayed on the display unit 62 can be changed only by reading the identification tag of the driver after the shift by the identification tag reading unit 32.
In the present embodiment, as shown in fig. 3B, the logo S1 is converted into the logo S1G and the character information S1T and displayed, but the embodiment of the present disclosure is not limited thereto. For example, when the contents indicated by the logo S1 and the logo S1G completely match each other, the character information S1T does not necessarily need to be displayed, and only the logo S1G may be displayed. Alternatively, when the sign corresponding to the sign S1 does not exist in the country where the driver P lives, only the character information S1T may be displayed.
In the present embodiment, the example in which the personal information of the driver P is acquired by the identification tag reading unit 32 and the converted information is displayed on the display unit 62 at a position where the logo or the like exists when viewed from the driver P has been described, but the embodiment of the present disclosure is not limited to this.
For example, the identification tag reading unit 32 may acquire personal information of a passenger other than the driver P. In this case, the converted information can be displayed at a position where a logo or the like exists when viewed from the passenger. Alternatively, the display unit 62 may be divided into two in the vehicle width direction, and the converted information may be displayed at a position where the indicator or the like exists when viewed from the driver P in the display unit 62 on the driver's seat side, and the converted information may be displayed at a position where the indicator or the like exists when viewed from the passenger who rides on the passenger seat in the display unit 62 on the passenger seat side.
In the present embodiment, the display unit 62 is formed only on the front window 14, but the embodiment of the present disclosure is not limited thereto. For example, it may be formed in a side window. This can increase the amount of information obtained.
In the present embodiment, the environment information acquisition unit 40 includes the communication device 44 that can communicate with the internet and other vehicles, but the embodiments of the present disclosure are not limited thereto. For example, the vehicle may not necessarily have a function of enabling communication with another vehicle. Traffic information can be obtained from databases on the internet even without communication with other vehicles.
In addition, the communication device 44 may be omitted in the environmental information acquisition unit 40. The environmental information acquisition unit 40 can acquire the environmental information around the vehicle 10 by the imaging device 42 even without the communication device 44. By not including the communication device 44, the configuration of the vehicle display device 20 can be simplified.
Note that the information acquisition process, the information conversion process, and the information display process, which are executed by the CPU reading software (program) in the above-described embodiment, may be executed by various processors other than the CPU. As a processor in this case, a PLD (Programmable Logic Device) such as an FPGA (Field-Programmable Gate Array) whose Circuit configuration can be changed after manufacture, an ASIC (Application Specific Integrated Circuit), and the like are exemplified as a dedicated Circuit having a processor with a Circuit configuration specifically designed for executing a Specific process. The information acquisition process, the information conversion process, and the information display process may be executed by one of these various processors, or may be executed by a combination of two or more processors of the same kind or different kinds (for example, a plurality of FPGAs, a combination of a CPU and an FPGA, or the like). The hardware configuration of these various processors is, more specifically, a circuit in which circuit elements such as semiconductor elements are combined.
In the above embodiments, the image transmission program, the image distribution program, and the image display program are stored (installed) in the ROM or the memory in advance, but the present invention is not limited thereto. The program may be provided in the form of a recording medium stored in a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), a USB (Universal Serial Bus) Memory, or the like. The program may be downloaded from an external device via a network. As such, the present disclosure can be implemented in various embodiments.

Claims (8)

1. A display device for a vehicle is provided with:
a personal information acquisition unit that acquires personal information including at least nationality of a driver of a vehicle from an identification tag in which the personal information of the driver is recorded;
an environmental information acquisition unit that acquires environmental information around the vehicle;
an information conversion unit that can convert the environmental information into information that can be understood by the driver or information that does not feel uncomfortable, based on personal information of the driver; and
a display unit that displays information converted from the personal information of the driver toward an interior of the vehicle,
in a case where a landscape in which the driver is likely to feel discomfort is acquired as the environment information by the image pickup device as the environment information acquisition means, the information conversion means converts the environment information into a mosaic image as the information that does not feel discomfort.
2. A display device for a vehicle is provided with:
a personal information acquisition unit that acquires personal information of a driver of a vehicle including at least a nationality and a country of residence from an identification tag in which the personal information of the driver is recorded;
an environmental information acquisition unit that acquires environmental information around the vehicle;
an information conversion unit that can convert the environmental information into information that can be understood by the driver or information that does not feel uncomfortable, based on personal information of the driver; and
a display unit that displays information converted from the personal information of the driver toward an interior of the vehicle,
the display unit displays additional information related to the environmental information according to personal information of the driver, wherein the additional information is information considered in driving according to a difference between a country where the driver lives and a country where the vehicle travels.
3. The display device for a vehicle according to claim 2,
in a case where a landscape in which the driver is likely to feel discomfort is acquired as the environment information by the image pickup device as the environment information acquisition means, the information conversion means converts the environment information into a mosaic image as the information that does not feel discomfort.
4. The display device for a vehicle according to any one of claims 1 to 3,
a photographing device as the environment information acquisition unit acquires a road sign as the environment information,
the information conversion unit converts the road sign into character information that can be understood by the driver.
5. The display device for a vehicle according to any one of claims 1 to 3,
the environment information acquisition unit is provided with a communication means,
the communication device acquires traffic information as the environment information,
the information conversion unit converts the traffic information into character information.
6. The display device for a vehicle according to claim 5,
the communication device has a transmission function of transmitting the traffic information to another vehicle.
7. The display device for a vehicle according to any one of claims 1 to 3,
the information conversion unit converts the environment information into image information.
8. The display device for a vehicle according to any one of claims 1 to 3,
when a passenger other than the driver is present in the vehicle,
the personal information acquisition unit acquires the personal information of the rider from an identification tag in which the personal information of the rider is recorded,
the information conversion unit converts the environmental information based on the personal information of the rider,
the display means can display information converted from the personal information of the rider toward the interior of the vehicle compartment.
CN201811514542.5A 2018-01-17 2018-12-12 Display device for vehicle Active CN110039996B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-005819 2018-01-17
JP2018005819A JP7024427B2 (en) 2018-01-17 2018-01-17 Display device for vehicles

Publications (2)

Publication Number Publication Date
CN110039996A CN110039996A (en) 2019-07-23
CN110039996B true CN110039996B (en) 2022-09-16

Family

ID=64744463

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811514542.5A Active CN110039996B (en) 2018-01-17 2018-12-12 Display device for vehicle

Country Status (4)

Country Link
US (1) US11117595B2 (en)
EP (1) EP3514725A1 (en)
JP (1) JP7024427B2 (en)
CN (1) CN110039996B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2999004C (en) * 2015-09-18 2021-06-15 Nissan Motor Co., Ltd. Vehicular display device and vehicular display method
JP6702390B2 (en) 2018-10-09 2020-06-03 トヨタ自動車株式会社 Vehicle drive control device, vehicle-mounted electronic control unit, learned model, machine learning system, vehicle drive control method, electronic control unit manufacturing method, and output parameter calculation device
US20220055633A1 (en) * 2020-08-21 2022-02-24 Hyundai Motor Company Method and apparatus for providing information
JP7354172B2 (en) * 2021-03-18 2023-10-02 ヤフー株式会社 Information provision device, information provision method, and information provision program
JP2023042661A (en) * 2021-09-15 2023-03-28 キヤノン株式会社 Display device, control device, control method, and program
FR3138103A1 (en) * 2022-07-22 2024-01-26 Psa Automobiles Sa Method and device for presenting textual road signs for vehicles

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60204137A (en) * 1984-03-28 1985-10-15 Hochiki Corp Broadcast equipment guiding hotel disaster preventing equipment
JPH11353587A (en) * 1998-06-10 1999-12-24 Sony Corp Navigation system
US8068942B2 (en) * 1999-12-15 2011-11-29 Automotive Technologies International, Inc. Vehicular heads-up display system
US20010032070A1 (en) * 2000-01-10 2001-10-18 Mordechai Teicher Apparatus and method for translating visual text
JP4084550B2 (en) * 2001-07-05 2008-04-30 アルパイン株式会社 Navigation device
US20030202683A1 (en) * 2002-04-30 2003-10-30 Yue Ma Vehicle navigation system that automatically translates roadside signs and objects
JP2004139510A (en) 2002-10-21 2004-05-13 Alpine Electronics Inc On-vehicle information device
JP2007315861A (en) 2006-05-24 2007-12-06 Nissan Motor Co Ltd Image processing device for vehicle
JP2008280026A (en) * 2007-04-11 2008-11-20 Denso Corp Driving assistance device
JP4985324B2 (en) 2007-10-31 2012-07-25 株式会社エクォス・リサーチ Road sign display device
JP2010073006A (en) * 2008-09-19 2010-04-02 Oki Electric Ind Co Ltd Display condition determining device and transaction confirming system
DE112009004886T5 (en) * 2009-06-09 2012-06-14 Toyota Jidosha Kabushiki Kaisha Driving support device
JP2011207397A (en) 2010-03-30 2011-10-20 Panasonic Corp On-vehicle display device
US20120215403A1 (en) * 2011-02-20 2012-08-23 General Motors Llc Method of monitoring a vehicle driver
KR101411951B1 (en) * 2013-06-19 2014-07-03 한진정보통신(주) System and apparatus for providing multilingual information
US9758116B2 (en) * 2014-01-10 2017-09-12 Sony Corporation Apparatus and method for use in configuring an environment of an automobile
GB2541519B (en) * 2014-02-21 2018-02-21 Jaguar Land Rover Ltd A system for use in a vehicle
GB2523353B (en) * 2014-02-21 2017-03-01 Jaguar Land Rover Ltd System for use in a vehicle
US9436682B2 (en) * 2014-06-24 2016-09-06 Google Inc. Techniques for machine language translation of text from an image based on non-textual context information from the image
US9552830B2 (en) 2014-10-17 2017-01-24 James E. Niles Vehicle language setting system
US9507775B1 (en) * 2014-10-17 2016-11-29 James E. Niles System for automatically changing language of a traveler's temporary habitation by referencing a personal electronic device of the traveler
JP2016095688A (en) 2014-11-14 2016-05-26 株式会社デンソー On-vehicle information display device

Also Published As

Publication number Publication date
US20190217872A1 (en) 2019-07-18
US11117595B2 (en) 2021-09-14
JP7024427B2 (en) 2022-02-24
CN110039996A (en) 2019-07-23
EP3514725A1 (en) 2019-07-24
JP2019125190A (en) 2019-07-25

Similar Documents

Publication Publication Date Title
CN110039996B (en) Display device for vehicle
WO2016186039A1 (en) Automobile periphery information display system
US20150321698A1 (en) Formation of an emergency lane
JP4311426B2 (en) Display system, in-vehicle device, and display method for displaying moving object
CN107209987B (en) Driver assistance system and method for traffic sign verification
US20190244515A1 (en) Augmented reality dsrc data visualization
Naranjo et al. Application of vehicle to another entity (V2X) communications for motorcycle crash avoidance
SE1450193A1 (en) Driver support
US10909848B2 (en) Driving assistance device
TW201333896A (en) Remote traffic management system using video radar
JP6104279B2 (en) Driver notification method and driver notification device
US10132642B2 (en) Unit setting apparatus and unit setting method
JP2017040773A (en) Head-mounted display device
JP7359099B2 (en) Mobile object interference detection device, mobile object interference detection system, and mobile object interference detection program
JP2018169945A (en) Driving support apparatus, driving support method, and driving support program
KR20180123553A (en) Moving body surround display method and moving body surround display apparatus
JP2021022325A (en) Drive support control device, drive support system, drive support control method, and program
US20190139408A1 (en) Device, server, and method for determining a case of wrong-way driving and for providing a warning about the wrong-way driving
US20190381936A1 (en) Device for assisting night-time road navigation
US20230418541A1 (en) Vehicle display system, display system, display method, and non-transitory computer readable storage medium
JP7432198B2 (en) Situation awareness estimation system and driving support system
WO2024057357A1 (en) Driving assistance device, driving assistance method, and recording medium
JP6740644B2 (en) Notification device
JP6681044B2 (en) Reverse running detection system
JP2023166227A (en) Information processing device, information processing system, information processing method, and information processing program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant