DE60318430T2 - Computer-aided system and method for outputting information to a driver of a vehicle - Google Patents

Abstract

A computer-based system (1; 3; 9) for outputting information to a driver of a vehicle (7), which is adapted to be mounted in a vehicle (7) comprises translation means (13; 93) having storage means (18b; 98) for storing a plurality of first information data and a plurality of second information data, the second information data being related to said first information ata including a translation of the first information data, input means 11, 17; 31a, 31b; 91) for inputting the first information data into the computer-based system (1; 3; 9), data processing means (45) for retrieving the second information data on the basis of the input first information data from the data storage means, and output means (14-16) for utputting the retrieved second information data to the driver. The transation includes a linguistic translation of words from one language into another as well as a semantic translation of a sign such as a traffic signs by outputting information reflecting the meaning of the traffic sign. <IMAGE>

Description

Field of the invention

The The invention relates to a computer-based system for issuing a Information about a driver of a vehicle, which is suitable to be mounted in a vehicle, and a method of outputting an information to a driver of a vehicle.

Related situation of the technique

In Lately, many vehicles have been computer-based System for outputting information to a driver, such as telematics systems, navigation systems or merely Car radio receiver. The purpose of these systems is to provide information which the traffic situation, such as traffic congestion, a road Closed for the Traffic and the like, or travel information, such as for example viewpoints of the area, hotel information, traffic announcements and the like for the area where the driver drives instantly.

To the Example, navigation systems calculate a route to a Target in dependence of one Input from the driver and give driving recommendations according to the calculated Route out. Car radios give traffic announcements, which from radio stations be received, and can with additional functions, such as RDS-TMC (Radio Data System - Traffic Message Channel) or TIM (Traffic Information Memory) for saving and using traffic announcements for navigation purposes be. Telematic devices provide a wireless connection to, for example the Internet for receiving further travel and traffic information and more useful Services ready.

US 6,148,105 A discloses a portable translation apparatus which is a character recognition and translation system for capturing camera images of characters written on sightseeing panels.

DE 199 38 256 A discloses a system for electronic identification of street signs using a camera, where non-compliant traffic signs are detected by a template comparison.

Summary of the invention

In spite of The development of the systems described above, there are still a need, an improved method, and a system for issuing others more useful Information to the driver during the journey, in particular travel and / or traffic information to provide.

These Tasks are performed by a computer-based system and a procedure for outputting information to a driver of a vehicle Claim 1 or claim 17 solved.

The Computer-based system according to the invention includes a translation tool with a storage means for storing a plurality of first information data and a plurality of second information data related to the first one Information data is available and a translation of the first information data comprise an input means for inputting first information data in the computer-based system, a data processing means for Querying second information data based on the inputted first information data from the data storage means, and output means for outputting the retrieved second information data to the driver.

The The invention further provides a method for outputting information to a driver of a vehicle, comprising the steps of: Inputting first information data into a translation means of a computer-based one System which is configured mounted in a vehicle to be querying second information data from a storage means for storing a plurality of first information data and a plurality of second Information data, wherein the second information data related to be the first informational data, which is a translation any of the first information data include, and outputting the queried second information data to the driver.

Detailed description the invention

According to the present Invention is a computer based system used in a vehicle attachable, such as a navigation system, a telematics system or any other on-board computer (control unit or head unit) with a translation device fitted.

The Invention takes advantage of the fact that many vehicles already have one On-board computers include, which for Navigation or Telematics applications is used and a data processing power comparable to that of a personal computer and which to realize a translation function can be used.

Due to the fact that the computer-based system according to the invention is installed inside the vehicle, it can easily be operated simultaneously with driving the vehicle, so that the attention of the driver focuses exclusively on the surrounding traffic and driving the vehicle. That is, mounting the system according to the invention inside the vehicle ensures operation in a simple and safe manner even during driving.

The System according to the invention can be a built-in system. The installation can be of a conventional Be kind of like a plug-in housing. The computer-based For example, system may be located within the housing of a radio receiver be. It may also be mounted in a separate console. Mounting the computer system in the vehicle may include that inside the case a navigation system installed in the vehicle, is trained. in principle in this case, the on-board computer of the vehicle is both for the function navigation and translation.

by virtue of the installation inside the vehicle, the driver is immediate able to translate perform, without stopping the car, so that traffic safety considerably is enlarged and the information state is improved without losing time, what about stopping the vehicle and reading a book or a card or an operation of a laptop or any one would go hand in hand with another portable computer.

Of course you can the driver of the vehicle within the meaning of the invention, the passenger be.

A preferred embodiment The computer system of the invention comprises a language translation means to translate a word of a first language into a word of a second language.

There the driver of a vehicle traveling abroad, often with a foreign Language is the language translation tool realized in the on-board computer of the vehicle, in a large number useful for situations. For example, in the case of an emergency, it is extremely important to the driver to be able to communicate directly with an emergency station for replacement Communicate information, for example, where the accident took place has, who has been injured, etc. More examples of useful applications concern the help of other road users or a communication at a gas station, a repair shop or with foreign ones Visitors, for example Taxi driver.

The Language translation means of the system according to the invention can be an automatic language translation tool for one Contextual translation of related records or comprise formulations from one language to another. Since the meaning of words can depend heavily on the context, In this case, the storage means additionally comprises voice data which is referred to as a database for realizing the function of translation from connected written or spoken text passages serve. The voice data of the voice data storage means extend over the data of a dictionary and further includes data having a contextual meaning of words and phrases.

Preferably can the database, which second information data, d. H. the translation data includes, on transport and / or Travel applications be oriented so that text passages, which the area of traffic and travel, such as broadcasting stations received traffic announcements, translated by the language translation means can be.

Of the Term "translation" in the sense of the invention is not, however, on its linguistic aspect of translation but limited from words from one language to another includes the translation any character or symbol by adding information what is the meaning of the sign or symbol in terms of any other sign, symbol or word (or any other characters, symbols or words).

To the Example becomes the meaning of a traffic sign, which usually known only to residents of a special country, "translated" for a driver who is not with the meaning of this traffic sign of the foreign country trusts is in which he / she currently travels. This feature is for drivers, who travel in foreign countries, where they have no knowledge of the meaning of local traffic signs own, very useful and leads to a significant improvement in traffic safety, in particular in countrys, where letters are used which are different from those of the driver's home country, such as Japanese or Arabic letters for Europeans.

One Outputting the second information data, d. H. the translation, can by issuing a description of the meaning of the traffic sign by language and / or displaying a text and / or displaying a Image of the corresponding traffic sign of the driver's home country accomplished become.

For the comfort of the driver, the one a microphone and a means for speech recognition associated with the microphone. Furthermore, the output means may include means for text / speech conversion of the words or text output to the driver. An advantage of the invention is that devices, such as a speech recognition unit and / or a text / speech conversion unit, which in many cases are already an integrated device of an onboard computer, such as a navigation system, can be used to implement a translation means which can be operated in a simple and secure way.

The Input means may further comprise a keyboard, a joystick, a Rotary encoder, a touch-sensitive Screen and / or a touch-sensitive area which covers the operation of the computer-based system the translation module includes, by the driver during to support driving.

Favorable Way, the input means of the language translation means comprises means for providing information from an external information source. This data can for example, traffic and / or travel information. Not restrictive examples for Information data received from an external information source are traffic information received from a broadcasting station, but also an information sign or a traffic sign, which on the street is arranged as an external source of information in the sense the invention be construed.

The Means for providing traffic and / or travel information from an external source of information includes a digital photo and / or video camera for For example, detecting an information sign in the environment of the vehicle. A means for a pattern recognition for analyzing one of the digital photo and / or video camera recorded image can be provided which means for one Information character recognition includes an information sign on the basis of its external form and to recognize dimensions.

For the determination The position of the information sign can be a video camera for Measuring the distance and the angle related to a traffic sign be provided on the vehicle. Because the position of the video camera is known on the vehicle, the position of the information sign based on the vehicle simply calculated from these measurements become.

There the absolute position of the vehicle and, if necessary, its Driving direction by a position detecting means, such as a GPS unit and / or a gyrometer can be determined the exact position of the detected information sign simply according to the known method photogrammetry and stereo image analysis. By Compare the specific position of the information sign and the location data of the route of the vehicle, which of the navigation system is made available, it becomes possible to calculate if the information sign is on the current route of the vehicle is or not.

The Pattern recognition means for Pattern recognition may include means for text recognition. After the recognition of words / text of the information sign, the appropriate words from the translation agency automatically translated be issued to the driver.

Farther the pattern recognition means may identify an identifying means a traffic sign of a country. The identification means for identifying a traffic sign of a country Traffic sign image storage means for storing a pixel of the Traffic sign of the foreign country, with which elements of the be compared by the video camera captured image. By identifying of traffic signs from foreign countries becomes the driver one provided important traffic information, which to recognize otherwise he would not be able to. This will ensure driving safety significantly increased.

The inventive system can decision-making means for deciding whether the information sign, which of the means for an information sign recognition was detected, issued to the driver will or not. This feature allows the driver to adjust whether any information or for example only a specific one Information, such as traffic signs, to his attention be issued.

The Computer-based system according to the invention may be adjustment means for adjusting the language of the input words or the text in dependence from the position determined by the position determining means, to Example of a GPS unit is determined include.

According to a preferred embodiment of the invention, the means for providing traffic and / or travel information from an external information source comprises a radio receiver for receiving a traffic or travel announcement from a broadcasting station. By issuing a Translation of a traffic announcement as soon as it has been recorded will further improve driving safety and the level of information of a driver traveling through foreign countries. The traffic announcements received by the radio receiver may first be stored in the computer system by the driver and translated in response to another command input by the driver, or alternatively may be immediately translated into the voice translation means by an automatic input become.

The A method of outputting information to a driver of a vehicle preferably comprises the step of inputting information from an external source of information. As previously mentioned, can the external information source is an informational sign which is arranged next to the roadway. In this case, the inventive method and the steps of monitoring the environment of a vehicle by means of a video camera and a continuous execution a pattern recognition of an image of the video camera for detecting an information sign.

If An informational sign could be captured as another step an analysis of the image of the detected information sign for identification a traffic sign of the country in which the vehicle currently is moves, accomplished become. When a traffic sign is identified during this procedure has been able to continue a picture of a corresponding traffic sign the home country of the driver or textual information that the Meaning of the traffic sign reproduces, issued to the driver become.

The A method of outputting information to a driver of the vehicle according to the invention may further comprise the steps of: detecting the position of the vehicle, Detecting a relative position of an information sign in the environment of the vehicle, determining the position of the information sign from the position of the vehicle and the relative position of the information sign, Compare the position of the traffic sign and the position data the route of the vehicle, and output a translation of the traffic sign to the driver when the traffic sign is arranged on the route is.

According to the procedure The invention can be the traffic information represented by a traffic sign only be issued to the driver when a traffic sign of a Country in which the vehicle is currently driving, by comparing the captured image of the information sign with the data, which in a traffic sign storage means which traffic sign from different countries contains stored was identified. Furthermore, the output can a translation a text recognized by the text recognition means dependent on be issued from this result.

Additionally or alternatively, the information which may be provided by the language translation means and / or provided by the traffic sign identification means, dependent on from the result of the position determination of the vehicle and / or dependent on by determining whether the traffic sign on the route of the Vehicle is arranged to be issued. This allows the Driver provided information automatically on the basis the above criteria or any other criterion so that information not needed by the individual driver is identified and an output to the driver is prevented so that the driver's attention to driving and perceiving relevant traffic information can be directed.

A another embodiment of the method according to the invention concerns the translation of Traffic announcements received by a broadcasting station what is done automatically can be or after an appropriate Be, which of the User, for example, the driver, is entered. This embodiment of the method according to the invention comprises the steps of receiving first information data from a broadcasting station, performing a speech recognition analysis the received data, a translation the first information data by querying the associated second Information data, and outputting the second information data, d. H. the translation the first informational data, to the driver.

Further Features and advantages of the system and method of dispensing an information to a driver of a vehicle according to the invention will become apparent from the following description of the preferred embodiments with reference to the attached Drawings become clear.

1 12 shows a schematic functional block diagram of a first embodiment of the computer-based system according to the invention with a speech recognition function and a text / speech conversion function,

2 FIG. 12 is a flow chart showing the steps of outputting information to a driver of a vehicle according to a first embodiment of the invention, which includes voice-recognition assisted input and have an output by a text / language conversion,

3 shows a schematic functional block diagram of a second embodiment of the computer-based system according to the invention,

4 FIG. 12 is a schematic functional block diagram of the control unit of the second embodiment of the computer-based system according to FIG 3 shown invention,

5 FIG. 12 is a flow chart showing the steps of outputting information to a driver of a vehicle according to a second embodiment of the invention, including detecting and translating an information sign; FIG.

6 FIG. 12 is a flowchart showing the steps of outputting information to a driver of a vehicle according to a third embodiment of the invention including the translation of a traffic sign; FIG.

7A shows a situation illustrating the determination of the position of a traffic sign in relation to a route according to the invention,

7B shows a situation illustrating the determination of the position of a traffic sign with respect to a road according to the invention,

8th FIG. 12 is a flowchart showing the steps of outputting information to the driver of a vehicle according to a third embodiment of the method of the invention, which includes determining the position of an information sign according to FIG 7A include,

9 12 shows a schematic functional block diagram of a third embodiment of a computer-based system according to the invention with a function for translating a traffic announcement received from a broadcasting station, and

10 FIG. 10 is a flow chart illustrating the steps of outputting information to the driver of a vehicle according to a fourth embodiment of the invention, which includes translating a traffic announcement received from a broadcasting station.

A first embodiment of a computer-based system according to the invention is disclosed in 1 shown schematically. The computer system 1 includes a control unit 10 , a microphone 11 , a group of speakers 15 , an ad 16 , and a control panel 17 , The control unit 10 is with the microphone 11 for inputting words or sentences to be translated. The microphone 11 can be part of a headset or handsfree phone.

The control unit 10 includes a speech recognition module 12 for entering words to translate, a translation module 13 connected to the speech recognition module 12 connected, and a text / speech module 14 to convert the translation result into speech and output via the loudspeaker 15 or the ad 16 connected to the control unit 10 are connected. The speech recognition module 12 , the translation module 13 and the text / speech synthesizer 14 are with a storage device 18 of the computer-based system 10 which is a voice recognition database 18a , a dictionary database 18b which includes data of multiple words and characters of at least two languages, a TSS synthesizer database 18c and a RAM (not shown). The computer-based system 1 is with an ignition lock 19 connected to start the engine of the vehicle.

The use of the computer-based system 1 according to the first embodiment of the invention will now be with reference to 2 described. In step 20 becomes the computer-based system 10 started up when the engine of the vehicle from the driver, which the ignition 19 by means of an ignition key rotates, is started. In step 21 the driver switches the microphone 11 for voice input by entering a command from the control panel 17 one. In step 22 the driver gives a word to be translated, e.g. As "ACCIDENT", by a voice input in the microphone 11 one. An analog-to-digital conversion of the analog audio signal to a digital signal is made in step 23 from the speech recognition module 12 carried out.

In step 24 compares the speech recognition module 12 for decrypting the speech signal the signal with data stored in the database 18b which includes words and / or syllables which are stored in the RAM of the computer-based system 1 getting charged. By the way, the database can 18b be changed by the driver to increase their recognition performance according to the known principles of speech recognition. By comparing the output of the A / D conversion with the stored patterns of the database 18b becomes the driver's speech input in step 24 converted to text. In step 25 is after the decrypted text to the translation module 13 the English translation "ACCIDENT" of the German word "ACCIDENT" from the translation module 13 from the dictionary database 18b accessed. In step 26 This will be the translation module 13 transmitted translation result through a speech synthesis of the text / speech module 14 , which has natural language processing and digital signals according to the known principles of TTS synthesis, converted to speech. In step 27 is the English translation "ACCIDENT" over the speakers 15 and at the same time on the ad 16 issued to the driver.

The configuration of a computer-based system according to a second embodiment of the invention, which includes digital video cameras for detecting traffic information during travel, will now be described with reference to FIG 3 and 4 explained. Compared with in 1 shown computer-based system 1 according to the first embodiment of the invention comprises in 3 shown computer-based system 3 a control unit 30 and, as additional components, a pair of digital video cameras 31a and 31b , a GPS module 32 for determining the position of the vehicle and a gyrometer 33 for determining the direction of movement of the vehicle.

The control unit 30 of the computer-based system 3 according to the second embodiment is more detailed in FIG 4 shown. Compared with the control unit 10 of the computer-based system 1 according to the in 1 shown first embodiment, the control unit 30 furthermore a pattern recognition unit 44 to analyze the from the digital video cameras 31a and 31b won pictures.

The pattern recognition module 44 has a text recognition module 44a , an information character recognition module 44b , a traffic sign identification means 44c and an information character storage means 44d on. The task of the information character recognition module 44b This is the video cameras 31a . 31b continuously capture captured image to capture an informational sign based on its shape and dimensions. To determine if this is the information character recognition module 44b detected information sign is a traffic sign or not, analyzes the traffic sign identification means 44c the image of the detected information sign by being associated with traffic signs of different countries included in the information sign storage means 44d are compared is compared. The text recognition module 44a performs an image analysis to recognize and extract a text of the information character.

The control unit 30 comprises a data processing unit 45 associated with the pattern recognition unit 44 connected, a translation module 13 , a data storage device 46 , a vehicle position determining means 43 for determining the position of the vehicle based on a GPS module 32 received signals, an information character position determining means 42 for determining the position of an information sign which is in the one of the digital video cameras 31a and 31b acquired images as described below, and a navigation module 47 , The main task of the navigation module 47 is the calculation of a travel distance in response to an input of an end destination from the driver using map data of an area where the driver is traveling, which is in the map data storage device 48 stored (for example, a CD-ROM), and the current position of the vehicle, as determined by the vehicle position determining means 43 was determined, and the output of driving recommendations depending on the current position of the moving vehicle according to the known principles of a vehicle navigation to the driver.

The data processing unit 45 serves as a data processing unit, for example for comparing data or transferring data between the components 13 . 42 - 44 and 46 - 48 according to predetermined procedures defined by the respective software module and / or according to a user control.

An embodiment of the method for outputting information to a driver of a vehicle using the in 3 and 4 shown system is below with reference to 5 described. A vehicle, which is an in 3 and 4 shown computer-based system 3 includes, for example, driving along an Italian motorway (A22, which is called "Autostrada del Brennern") 31a and 31b monitor in step 50 continuously the environment of the highway, which lies in front of the vehicle. That is, their images may include a portion of the driver's field of view. The captured images are continuously on the display 15 of the computer-based system 30 shown while driving.

As the vehicle moves forward, appears in step 51 an information sign of a traffic control system installed above the highway in the currently of the video cameras 31a . 31b monitored image displaying the traffic information "10 CHILOMETRI DI COLONNA DELLO SVINCOLO DI CARPI ALL'ALLACCIAMENTO DELL'A1." When the driver notices the information sign, he selects the "save image" entry in step 52 from the software menu and in step 53 the entry "Translate the text." This translation command can be easily executed by pointing a finger at the information sign of the picture when typing 15 is formed by a touch-sensitive screen.

After that, in step 54 a text recognition analysis of the whole in step 52 stored image, which may not only have the information sign, but also the highway, more in front of the vehicle driving cars, the sky over the highway, etc., through the word processing module 44a for recognizing and extracting the above textual content of the information character of the user's in step 52 saved image. In step 55 becomes the identified text of the information character which is used by the text recognition module 44a of the pattern recognition module 44 was received from the language translation module 13 translated by retrieving the German translation of the Italian text of the image recorded by the driver. A word by word translation of the text "10 KM OF JAM FROM EXIT FROM CARPI TO THE CONNECTION OF A1" will be added in step 56 visually on the display 16 as well as acoustically via the speakers 15 after a text / language conversion as previously with reference to 1 and 2 described, issued. The output on the display may be overlaid by overlaying the translation result over the original Italian text within the image of the informational sign or in a separate automatically opened window on the display 16 be executed.

As the present embodiment of the language translation module 13 with the vehicle positioning module 43 is connected, the input language from the current position of the vehicle is automatically from the language translation module 13 derived. Therefore, it is not necessary for the driver to specify the input language of the translation by another input command. Because the relevant data of the database 18b which is to be searched for a translation, can be significantly limited to only one language to be examined, the data processing for translation is greatly accelerated. Of course, the input language as well as the output language can be preset by the driver.

This in 3 and 4 shown system according to the second embodiment of the invention allows the driver Informa tion signs, which are installed in the area where he / he is currently driving, easy to translate. The translation result may be in the storage device 46 of the computer-based system 30 so that the driver can retrieve the information given by the road or information signs at any time during the journey for information purposes, for example as a reminder. As a result, the information level of the driver who travels abroad, can be significantly improved. Since it is not necessary for the driver to memorize a text that includes several words of a foreign language that he is not used to, he / she can concentrate on driving and thus the traffic safety is considerably increased. Due to the possibility of performing an immediate translation, there is no need for a time-consuming stopover to search a conventional dictionary.

As previously mentioned, the translation function of the system according to the invention is not limited to a language translation, but further includes the translation of traffic signs, for example, located beside the highway. An example of a method for identifying and translating a traffic sign in a foreign country using the in 3 and 4 is shown below with reference to 6 be explained.

In step 60 becomes the environment of the vehicle traveling abroad, for example in Egypt, through one of the video cameras 31a . 31b supervised. The image captured by the video camera is continuously passed through the information character recognition module 44a the pattern recognition unit 44 to recognize an information sign in step 61 based on its dimensions and shape by comparison with data stored in the information and traffic sign storage device 44d ge stores are analyzed. As long as no information character is detected, the process is returned to step 60 continued. If an information mark from the information character acquisition module 44a in step 62 is captured in step 63 the image data of the information character to the traffic sign identification module 44c where further image analysis is performed by comparing the elements of the image with characteristic elements of official traffic signs of the respective country (for example, Egypt in the present example) used in the information and traffic sign storage device 44d are compared.

As shown, for example, in the present embodiment, data exists between the traffic sign identification module 44c and the vehicle position determination module 43 by means of the data processing unit 45 from the current position of the vehicle, for example from the determination of the country where the vehicle is currently traveling, the relevant group of traffic signs can be automatically restricted by reducing (in the present example) to those of Egypt, before the traffic sign identification method is executed. This allows the Datenverarbeitungsge be increased significantly.

When in step 64 an Egyptian traffic sign has been identified, the meaning of this traffic sign which is used in the information and traffic sign storage device 44d is stored, queried and visually displayed on the display as a translation result 16 or acoustically via the speakers 15 in step 65 output. Alternatively or in addition to the text output, the corresponding traffic sign of the driver's home country, for example the corresponding German traffic sign, can be displayed 16 are displayed. Otherwise, if the detected information sign is not a traffic sign from the traffic sign identification module 44c could be identified, the process returns to step 61 back.

As From the foregoing description, the detection is and translation an "information mark" in the sense of Invention not on official traffic signs, which of the corresponding State spent, limited, but has any kind of information, such as Example traffic signs showing the way to, for example, a Hotel description, or any other advertisement, such as Example sales offers and the like, which after their translation can be easily considered by the driver. D. h., the term information sign covers official traffic signs according to the traffic rules the country and any other informational signs, which the traffic area or any other information which the driver considers useful.

Although the traffic sign identification module 44c and the information character recognition module 44b in 6 Incidentally, as shown as separate modules, it goes without saying that a single software module can be provided for realizing both functions.

In 7A . 7B and 8th A further embodiment of the method according to the invention is shown, wherein the output of a translation of an information sign is carried out in dependence on the position of the information sign relative to the road and / or the route of the vehicle.

The starting situation is schematic in 7A respectively. 7B shown. A vehicle 7 which comes with a computer-based system 3 is equipped on the road along a route A. At the current position of the vehicle 7 which is in 7A is shown capture the video cameras 31a . 31b within their observation area 74 the traffic signs 72 and 73 wherein the first is arranged on the route A and the latter is arranged on the route B. In such a case, the system and method according to the invention enable the output of a translation of these traffic signs 72 . 73 depending on whether or not the traffic sign is located at the current driving distance of the vehicle.

An example of such a method will be described below with reference to FIG 8th described. In step 80 become those of the digital video cameras 31a and 31b images obtained continuously from the information character acquisition module 44b by comparing these images with the pattern data of the information and traffic sign storage device 44d analyzed. When in step 81 one of the traffic signs 72 . 73 is detected, the position of traffic signs 72 . 73 in relation to the vehicle 7 in step 82 by the information character positioning module 42 based on the distance of the traffic sign 72 . 73 to the vehicle and the angle of the camera positions relative to the informational signs 72 . 73 certainly. Because the position of the vehicle 7 and its direction of forward movement as well as the orientation of the video cameras 31a . 31b with respect to the vehicle 7 are known, it is possible the exact position of the information signs 72 . 73 According to the known principles of photogrammetry, in particular a stereo analysis, which is based on two images, as described for example in "Photogrammetry" by Kraus, K., Dümmler Verlag, Bonn 1997, to calculate exactly.

Although the in 3 shown embodiment of the computer-based system according to the invention, a pair of video cameras 31a . 31b Incidentally, a single camera may also be used, particularly if position data of the information sign is included in map data of the corresponding area. Furthermore, the position of the information can also be determined by using a 3D laser sensor.

In step 83 become the calculated position data of the information characters 72 . 73 with location data of the routes A, B of the vehicle 7 which comes from the navigation module 47 be obtained from the data processing unit 45 compared and the distance between the road according to route A and the information signs 72 . 73 is determined. Based on this result will be in step 74 calculates if the traffic signs 72 . 73 the current route of the vehicle or not. In the in 7 illustrated exemplary case, it is found that the information character 72 the current route A of the vehicle 7 whereas, on the other hand, the information sign 73 not affected.

When in step 84 for the traffic signs 72 . 73 is found out that they affect the current route, in step 85 a text recognition analysis from the text recognition module 44a the pattern recognition unit 44 executed and any text from the text recognition engine 44a in step 86 is recognized, the recognized text becomes the language translation module 13 for a translation. In step 87 becomes the translation, which is the translation module 13 from the dictionary storage means 18a is queried on the ad 16 or over the speakers 15 in step 88 as previously with reference to 5 described issued to the driver.

Although the embodiment of the 8th as a method of translating a text of an information sign 72 . 73 has been described, the invention is not limited to this embodiment, and further provides an embodiment in which, instead of or in addition to the recognition and translation of the text, an analysis for identifying a traffic sign is performed, as with reference to steps 63 and 64 of the 6 described.

Instead of determining whether or not the information relates to a driving route of the vehicle, it is also possible to use the method after determining the distance between the traffic signs 72 . 73 and the street 9 to end. Such a situation is in 7B shown. In this case, executing a translation depends on the result of determining the distance between the traffic signs 72 . 73 and the road on which the vehicle is traveling. This method is based on the assumption that traffic signs are located within a shorter distance to the road compared to those information signs which are not official traffic signs. Referring to the in 7B The situation shown may be the short distance of the information sign 72 to be closed to the road that the information sign 72 is a traffic sign and accordingly only becomes sign 72 proposed for an identification analysis for translation. In contrast, from the relatively long distance between the road and the traffic sign 73 closed that in 7B shown traffic signs 73 not a traffic sign, but any other informational sign.

A third embodiment of a computer-based system according to the invention is disclosed in 9 which allows the translation of traffic announcements received from a radio receiver. The computer-based system 9 includes a radio receiver 91 , a control unit 90 , an ad 16 , Speaker 15 and a control panel 17 for controlling the control unit 90 and / or the radio receiver 91 , The control unit 90 comprises a storage device 98 for storing traffic announcements issued by the radio receiver 91 received, a voice recognition module 92 for decrypting the traffic announcement received from a broadcasting station, an automatic language translation module 93 and a text / speech module 14 and related storage devices 98a containing data for voice / text synthesis, a voice data storage device 98 and a storage device 18c which includes data for a text / speech synthesis. The radio receiver 91 may be an analog or digital device. The speech recognition module 92 may be adapted to it and may or may not include an A / D converter.

An example of a method for providing information to a driver of a vehicle using the in 9 shown computer-based system 9 is in 10 shown. In step 100 the radio receiver receives 91 a traffic announcement in a foreign language. If the radio receiver 91 is turned off while driving, traffic announcements become in the traffic announcement storage device 98 in step 101 saved. In step 102 The driver calls the last of the radio receiver 91 received traffic announcements from the traffic announcement storage device 98 by pressing a button on the control unit 17 from. In response, the polled traffic announcement is transmitted through the loudspeaker 15 issued to the driver. Thereafter, the driver retrieves a translation of the traffic announcement by selecting a corresponding entry of the software menu shown on the display using the control panel. In response, the traffic announcement data becomes the automatic language translation module 93 transfer. In step 103 becomes the received traffic announcement from the language translation module 93 translated and the translation of the traffic announcement in the German language is in step 104 on the display 16 as a text and / or after a TTS conversion from the TTS module 14 over the speakers 15 of the audio system to the driver.

According to the in 10 In the embodiment shown, the driver of a vehicle traveling in a foreign country is able to translate traffic announcements received in foreign languages, resulting in a considerably increased level of information regarding the last traffic events.

The invention as defined by the appended claims is not limited to the specific configurations of the embodiments of the computer-based systems described above 1 . 3 and 9 limited. On the contrary, as will be apparent to one of ordinary skill in the art, the individual components of these systems may be combined in any suitable manner to practice the invention in accordance with the appropriate needs of the user. Although it is not in 9 can be shown, for example, the computer-based system 9 furthermore, the components of the computer-based systems 1 and 3 , what a 1 and 3 are shown, such as a microphone 11 for a voice input from the driver, a navigation module 47 , Video cameras 31a and 31b and a pattern recognition module 34 etc. and vice versa.

Of course, this relates in a similar way to the steps of the method according to the invention. For example, the methods according to 8th for determining whether the traffic sign is arranged on the driving route of the vehicle, with the method for identifying a traffic sign according to 6 be combined, so that, before the identification of a foreign traffic sign is performed, it is checked whether this traffic sign is arranged on the route of the driver or not.

Claims (24)

Computer-based system for outputting information to a driver of a vehicle, the system ( 1 ; 3 ; 9 ) is configured in a vehicle ( 7 ), comprising a translation device ( 13 ; 93 ) with - a storage means ( 18b ; 98 ; 44d ) for storing a plurality of first information data and a plurality of second information data, wherein the second information data related to the first information data comprises a translation thereof, an input means ( 11 . 13 . 17 ; 31a . 31b ; 91 ) for inputting first information data into the computer-based system ( 1 ; 3 ; 9 ), the input means being a digital camera and / or video camera ( 31a . 31b ) and a means for pattern recognition ( 44 ) one of the digital photo and / or video camera ( 31a . 31b ), wherein the means for pattern recognition ( 44 ) a means ( 44c ) for recognizing a traffic sign comprising a traffic sign image storage means ( 44d ) for storing picture elements of traffic signs of different countries, - a data processing means ( 45 ) for retrieving second information data based on the inputted first information data from the data storage means (Fig. 18b ; 98 ), and - an output means ( 14 . 15 . 16 ) for outputting the requested second information data to the driver, the system further comprising position determining means ( 32 ) for determining the position of the vehicle ( 7 ), characterized by further comprising - a means for determining the direction of movement of the vehicle ( 7 ) and a navigation means ( 47 ) for calculating a route to a destination input by the driver, - a decision means for deciding whether the destination of the recognition means ( 44c ) recognized traffic sign is issued to the driver or not, - wherein the decision means comprises a comparison means for determining whether the camera ( 31a . 31b ) detected traffic signs on the route of the vehicle ( 7 ) and / or within a predetermined distance to the road where the vehicle ( 7 ) currently drives, is or is not included. System according to claim 1, characterized in that the translation means comprise a language translation means ( 13 ) for translating a word of a first language into a word of a second language. System according to claim 1 or 2, characterized in that the language translation means ( 13 ) an automatic language translation means ( 93 ) for a contextual translation of a phrase or phrase of the first language into a phrase or sentence of the second language. System according to one of the preceding claims, characterized in that the translation means ( 13 ; 93 ) a traffic sign translation means ( 13 ; 44 ) for translating a traffic sign ( 72 . 73 ) by outputting information data indicating the meaning of the traffic sign ( 72 . 73 ). System according to claim 4, characterized in that a translation by outputting a description of the meaning of the traffic sign ( 72 . 73 ) is performed by voice and / or displaying a text and / or displaying an image of the corresponding traffic sign of the driver's home country. System according to one of the preceding claims, characterized in that the output means comprise a means for a text / speech conversion ( 14 ). System according to one of the preceding claims, characterized in that the input means is a microphone ( 11 ) and a means for speech recognition ( 12 ), which with the microphone ( 11 ). System according to one of the preceding claims, characterized characterized in that the input means comprises a control lever, a keyboard, a rotary encoder and / or a touch screen includes. System according to one of the preceding claims, characterized in that the input means comprise a means ( 91 ) for providing traffic and / or travel information from an external information source. System according to one of the preceding claims, characterized by a means for pattern recognition ( 44 ), which is a means ( 44b ) for recognizing an information sign. System according to one of the preceding claims, characterized by a means ( 42 ) for determining a position of an information sign within the environment of the vehicle ( 7 ). System according to one of the preceding claims, characterized in that the means ( 44 ) for a pattern recognition, a means ( 44a ) for a text recognition. System according to one of the preceding claims, characterized by a translation setting means for automatically setting an input speech as a function of the position determining means ( 32 ) certain position. System according to one of claims 2 to 13, characterized by a radio receiver ( 91 ) for receiving traffic and / or travel messages comprising first language words. System according to one of claims 2 to 14, characterized by a telematics unit for receiving terms of the first Language. Navigation system for a vehicle, marked by a system according to any one of the preceding claims. Method for outputting information to a driver of a vehicle, comprising the steps of: inputting first information data into a translation means ( 13 ; 93 ) of a computer-based system ( 1 ; 3 ; 9 ), which is configured in a vehicle ( 7 ), querying second information data from a storage means ( 18b ; 44d ; 98 ) for storing a plurality of first information data and a plurality of second information data, the second information data being related to the first information data comprising a translation thereof, outputting the retrieved second information data to the driver, monitoring the environment of a vehicle by means of a video camera ( 31a . 31b ) and - continuously performing a pattern recognition analysis of one of the video camera ( 31a . 31b ) recorded image for detecting a traffic sign ( 72 . 73 ), characterized by the further steps - detecting the position of the vehicle ( 7 ), - detecting a position of the traffic sign ( 72 . 73 ) relative to the vehicle ( 7 ), Determining the absolute position of the traffic sign from the position of the vehicle ( 7 ) and the relative position of the traffic sign ( 72 . 73 ), - comparing the position of the traffic sign and position data of the road where the vehicle is located, and - performing a translation of the traffic sign when the traffic sign is located within a predetermined distance to the road. A method of outputting information to a driver of a vehicle according to claim 17, characterized in that the step of inputting detecting or receiving the first information data from an external information source ( 91 ). Method for outputting information to a driver of a vehicle according to claim 17, characterized by performing a pattern recognition analysis of the image of a detected information sign ( 72 . 73 ) for determining a traffic sign of the country where the vehicle is moving when an information sign ( 72 . 73 ) was recorded. A method of outputting information to a driver of a vehicle according to claim 19, characterized by the further step of displaying an image of a corresponding traffic sign of the driver's home country on a display ( 16 ), if a traffic sign was determined. Method for outputting information to a Driver of a vehicle according to claim 19 or 20, characterized by the further step of outputting a text information in one second language, which concerns the meaning of the traffic sign, if a traffic sign has been determined. Method for outputting information to a driver of a vehicle according to one of Claims 17 to 21, characterized by the further steps of - performing a text recognition analysis of the image of the information sign and - inputting any text obtained from the text recognition analysis into the language translation means for a translation. Method for outputting information to a driver of a vehicle according to one of Claims 17 to 22, characterized by the further steps - determining a driving route of the vehicle ( 7 ) in response to an input of a final destination of the driver, - Detecting a position of the vehicle ( 7 ), - detecting a position of an information sign ( 72 . 73 ) relative to the vehicle ( 7 ), - determining the absolute position of the information sign ( 72 . 73 ) from the position of the vehicle ( 7 ) and the relative position of the information sign ( 72 . 73 ), - comparing the position of the information sign ( 72 . 73 ) and location data of the particular route of the vehicle ( 7 ) and - carrying out a translation of the information sign ( 72 . 73 ), if the information sign ( 72 . 73 ) is located within a predetermined distance to the road of the route. Method for outputting information to a Driver of a vehicle according to one of claims 17 to 23, marked through the steps - receive first information data, which is a traffic message from a Broadcasting station, - To save the received first information data, - Perform a speech recognition analysis the received data, - Translate the traffic message and - Output a translation the traffic message to the driver.