JP2010179875A - Information presentation system and mobile terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information presentation system capable of properly transmitting vehicle information from an on-vehicle device to a mobile terminal while enabling improvement of freedom of installation of the mobile terminal. <P>SOLUTION: The information presentation system equipped with the on-vehicle device and mobile terminal. The on-vehicle device 1 is provided with a vehicle information acquisition means for acquiring vehicle information, a data conversion means for converting the acquired vehicle information into data and an output means 50 for outputting a sound-wave signal based on the data converted by the data conversion means. The mobile terminal 2 is provided with a sound-collecting means 70 for sound-collecting a sound-wave signal output from the on-vehicle device 1, a vehicle information conversion means for seeking data from the sound-collected sound-wave signal and converting the data into vehicle information and information presentation means 100, 110 for presenting to a user the information for presentation, based on the vehicle information converted by the vehicle information conversion means. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information presentation system including a vehicle-mounted device and a mobile terminal, and a mobile terminal.

  Conventionally, a PND (Personal Navigation Device) which is a portable navigation device is connected to an in-vehicle device via a power line in the vehicle, and vehicle information including vehicle speed information transmitted from the in-vehicle device using this power line. Is known to improve the position positioning accuracy of the PND by causing the PND to receive (Patent Document 1).

JP 2007-255938 A

  However, in the prior art, a mobile terminal such as a PND receives vehicle information transmitted from an in-vehicle device using a power line attached to the vehicle, so that the degree of freedom of installation of the PND is limited. There was a problem.

  The problem to be solved by the present invention is to provide an information presentation system capable of appropriately transmitting vehicle information from an in-vehicle device to a mobile terminal such as a PND while improving the degree of freedom of installation of a mobile terminal such as a PND. It is to be.

  The present invention provides an information presentation system including an in-vehicle device and a mobile terminal, wherein the in-vehicle device outputs vehicle information of the host vehicle as a sound wave signal to the mobile terminal and obtains the sound wave signal from the sound wave signal by the mobile terminal. The above problem is solved by presenting the presentation information based on the vehicle information to the user.

  According to the present invention, vehicle information acquired by the in-vehicle device is transmitted to the mobile terminal by means of a sound wave signal, so that the vehicle terminal can be appropriately transmitted from the in-vehicle device to the mobile terminal while improving the freedom of installation of the mobile terminal. can do.

It is a block diagram which shows the structure of the information presentation system which concerns on 1st Embodiment. It is a flowchart which shows the information presentation process which concerns on 1st Embodiment. It is a block diagram which shows the structure of the information presentation system which concerns on 2nd Embodiment. It is a flowchart which shows the information presentation process which concerns on 2nd Embodiment. It is a block diagram which shows the structure of the information presentation system which concerns on 3rd Embodiment. It is a flowchart which shows the information presentation process which concerns on 3rd Embodiment.

<< First Embodiment >>
Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, an information presentation system mounted on a vehicle will be described as an example. Here, FIG. 1 is a block diagram showing a configuration of the information presentation system according to the present embodiment. As shown in FIG. 1, the information presentation system exemplified in this embodiment includes an in-vehicle device 1 mounted on a vehicle and a PND 2 that is a navigation device that can be carried by a user.

  The in-vehicle device 1 includes a controller 10, a vehicle controller 20, an audio controller 30, a correspondence table 40, and a speaker 50. The in-vehicle device 1 is connected by a CAN (Controller Area Network) or other in-vehicle LAN, and exchanges information with each other. It can be performed.

  The vehicle controller 20 is connected to various sensors and various meters including a vehicle speed sensor 21, a seat belt reminder 22, and a side brake alarm device 23 by CAN, and acquires vehicle information from these sensors and meters. For example, the vehicle controller 20 outputs a vehicle speed pulse from the vehicle speed sensor 21, a seat belt alarm signal indicating that the user is not wearing the seat belt from the seat belt reminder 22, and without returning the side brake from the side brake alarm device 23. A side brake forgetting alarm signal indicating that the vehicle is running is acquired. Further, the vehicle controller 20 calculates fuel consumption information from the acquired travel distance, remaining fuel, and the like. The acquired vehicle information is transmitted to the controller 10 by the vehicle controller 20.

  The audio controller 30 acquires, for example, audio information such as track information, a song title, and an artist name of a song being played on the in-vehicle device 1 and transmits it to the controller 10 via the CAN.

  In the correspondence table 40, vehicle information and data (for example, sound data indicating alarm sound such as sound data and buzzer sound) are stored in association with each other. The controller 10 can convert the vehicle information transmitted from the vehicle controller 20 into data corresponding to the vehicle information by referring to the correspondence table 40.

  The speaker 50 converts the data output from the controller 10 into a sound wave signal and outputs it to the passenger compartment. In addition, the sound wave signal output from the speaker 50 is not particularly limited, and is appropriately determined according to the type of vehicle information, such as a buzzer sound (warning sound) or a utterance sound for announcing the contents of the vehicle information to the user. As will be described later, the sound wave signal output from the speaker 50 is an audible sound that can be heard by the user or a non-audible sound that cannot be heard by the user, depending on the type of vehicle information. Is output.

  Next, the controller 10 will be described. The controller 10 is accessible to a ROM (Read Only Memory) 11 that stores a program for transmitting vehicle information including audio information to the PND 2 and a CPU (Central Processing Unit) 12 that executes the program stored in the ROM 11. And a RAM (Random Access Memory) 13 that functions as a simple storage device. As the operation circuit, instead of or together with the CPU (Central Processing Unit) 12, an MPU (Micro Processing Unit), a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array). Etc. can be used.

  The controller 10 of this embodiment has the following functions. The vehicle information acquisition function which acquires vehicle information, the data conversion function which converts the acquired vehicle information into data, and the output function which outputs the converted data to the speaker 50 are provided. And each function is performed by cooperation of the software for implement | achieving each function, and the hardware containing the controller 10 mentioned above.

  Below, each function with which the controller 10 mentioned above is provided is each demonstrated in detail.

  First, the vehicle information acquisition function of the controller 10 will be described. The vehicle information acquisition function acquires vehicle information including audio information. That is, the vehicle information acquisition function acquires vehicle information such as a vehicle speed pulse, fuel consumption information, and alarm information from the vehicle controller 20, and acquires audio information from the audio controller 30.

  Next, the data conversion function of the controller 10 will be described. The data conversion function refers to the correspondence table 40 provided in the in-vehicle device 1 and converts vehicle information including audio information acquired by the vehicle information acquisition function into data. As described above, the correspondence table 40 stores vehicle information including audio information and data in association with each other. Therefore, the data conversion function can convert the acquired vehicle information into data stored in association with the vehicle information by referring to the correspondence table 40.

  Next, the output function of the controller 10 will be described. The output function transmits the data converted by the data conversion function to the speaker 50. Thereby, the data converted into the sound wave signal from the speaker 50 is output into the vehicle interior.

  Next, the configuration of the PND 2 will be described. The PND 2 is a small device that functions as a simple navigation device or audio device. The PND 2 includes a navigation controller 60, a microphone 70, an A / D converter 80, a correspondence table 90, a display device 100, and a speaker 110.

  The microphone 70 collects the sound wave signal output from the in-vehicle device 10, converts the collected sound wave signal into data, and transmits the data to the navigation controller 60.

  Similar to the correspondence table 40 of the in-vehicle device 1, the correspondence table 90 stores vehicle information including audio information and predetermined data in association with each other. As a result, the PND 2 is output from the in-vehicle device 1 by referring to the correspondence table 90 and collating the data obtained from the sound wave signal output from the in-vehicle device 1 with the data stored in the correspondence table 90. The data obtained from the sound wave signal can be converted into vehicle information.

  The PND 2 includes a display device 100 and a speaker 110 in order to present presentation information based on vehicle information to the user. The display device 100 is information based on vehicle information, receives presentation information to be presented to the user from the navigation controller 60, and displays the presentation information on a screen provided in the display device 100. Thereby, the display 100 can present the detailed contents of the vehicle information including the audio information to the user. An example of the display device 100 is a display. The speaker 110 receives data generated based on the vehicle information from the navigation controller 60, and outputs this data as an announcement voice or a buzzer sound. Thereby, the speaker 110 can present presentation information based on vehicle information including audio information to the user.

  Next, the navigation controller 60 will be described. The navigation controller 60 also includes a ROM 61, a CPU 62, and a RAM 63, similar to the controller 10 of the in-vehicle device 1. As with the controller 10, an MPU, DSP, ASIC, FPGA, or the like can be used as the operation circuit instead of or in addition to the CPU 62.

  The navigation controller 60 has a vehicle information conversion function for performing voice recognition processing on the data transmitted from the A / D converter 80 and converting this data into vehicle information. For example, the vehicle information conversion function analyzes the frequency component, amplitude, and the like of data transmitted from the A / D converter 80, and obtains a series of characteristic parameters of this data. Then, by referring to the correspondence table 90, the feature parameter of the acquired data is collated with the feature parameter of the data stored in the correspondence table 90, so that the most likely data among the data stored in the correspondence table 90 is obtained. Vehicle information stored in association with highly frequent data is acquired. In addition, the vehicle information conversion function acquires presentation information to be presented to the user based on the acquired vehicle information. For example, when the vehicle information is a vehicle speed pulse, the vehicle information conversion function corrects the position information of the host vehicle using the vehicle speed pulse transmitted from the in-vehicle device 1, thereby correcting the corrected vehicle information to be presented to the user. Obtain vehicle location information.

  Next, the information presentation process according to the present embodiment will be described based on the flowchart of FIG. FIG. 2 is a flowchart showing information presentation processing according to the present embodiment. In the following, in the situation where the position information of the host vehicle cannot be properly displayed in the PND 2 brought into the vehicle, the vehicle speed pulse is transmitted from the in-vehicle device 1 to the PND 2 and corrected based on the transmitted vehicle speed pulse. An example of a scene where the position information of the host vehicle is presented to the user will be described. In addition, as a situation where the position information of the own vehicle cannot be appropriately displayed on the PND 2 brought into the vehicle, for example, due to traffic jams in the tunnel, the own vehicle from the GPS (Global Positioning System) (not shown) provided in the PND 2 The position information cannot be acquired, and the acceleration cannot be appropriately detected from an acceleration sensor (not shown) included in the PND 2.

  In step S <b> 101, the vehicle information acquisition function of the controller 10 acquires the vehicle speed pulse detected by the vehicle speed sensor 21 via the vehicle controller 20.

  In step S102, the data conversion function of the controller 10 determines whether the vehicle speed of the host vehicle is equal to or lower than a predetermined speed, for example, 5 km / hour or less. When the speed of the host vehicle is equal to or lower than a predetermined speed, the PND 2 may not be able to detect acceleration for correcting the position information of the host vehicle. Therefore, if the speed of the host vehicle is equal to or lower than the predetermined speed, the process proceeds to step S103 in order to transmit a vehicle speed pulse for correcting the position information of the host vehicle to the PND 2. On the other hand, when the speed of the host vehicle is higher than the predetermined speed, the acceleration can be acquired in the PND 2 and it is not necessary to transmit the vehicle speed pulse to the PND 2, so this information presentation process is terminated. In this way, it is determined whether the vehicle speed of the host vehicle is equal to or lower than the predetermined speed, and when it is not necessary to transmit the vehicle speed pulse to the PND 2, the burden of the CPU 12 is reduced by terminating the information presentation process. Can do.

  In this example, the vehicle is traveling at a vehicle speed of 5 km / h or less due to a traffic jam in the tunnel, and the data conversion function determines that the vehicle speed of the vehicle is equal to or lower than a predetermined speed. The process proceeds to S103.

  In step S103, the data conversion function of the controller 10 refers to the correspondence table 40 and converts the vehicle speed pulse acquired in step S101 into data stored in association with the vehicle speed pulse. In subsequent step S104, the output function of the controller 10 outputs the data converted from the vehicle speed pulse in step S103 to the speaker 50. And the speaker 50 converts the data transmitted from the controller 10 into a sound wave signal, and outputs this sound wave signal to the vehicle interior.

  Here, in the present embodiment, the vehicle information included in the sound wave signal output from the in-vehicle device 1 is a vehicle speed pulse, and this vehicle speed pulse does not give a warning or warning to the user. Therefore, the sound wave signal output from the speaker 50 in step S104 is output as a sound in a non-audible range that cannot be heard by the user. Thus, the vehicle speed pulse can be appropriately transmitted from the in-vehicle device 1 to the PND 2 without giving the user a discomfort due to the sound output corresponding to the vehicle speed pulse continuously sounding. The sound wave signal output from the speaker 50 is output as a predetermined buzzer sound, for example. Thereby, PND2 can convert the data calculated | required from this buzzer sound into the vehicle speed pulse by detecting a predetermined buzzer sound by voice recognition processing.

  By outputting the sound wave signal corresponding to the vehicle speed pulse from the speaker 50 in step S104, the information presentation process in the in-vehicle device 1 is completed. Subsequently, an information presentation process in the PND 2 will be described.

  In step S105, the navigation controller 60 of the PND 2 determines whether the position information or acceleration of the host vehicle can be acquired. As described above, in a traffic jam in a tunnel, the PND 2 may not be able to acquire the position information of the own vehicle from the GPS and may not be able to acquire the acceleration from the vehicle speed sensor. In such a case, the position information of the host vehicle cannot be appropriately presented in the PND 2. Therefore, it is determined whether or not the navigation controller 60 can acquire the position information or acceleration of the host vehicle. If the navigation controller 60 cannot acquire the position information or acceleration of the host vehicle, the vehicle speed pulse transmitted from the in-vehicle device 1 is determined. In order to appropriately present the position information of the own vehicle by using it, the process proceeds to step S106. On the other hand, when the PND 2 can acquire the position information or acceleration of the vehicle, the PND 2 can appropriately present the position information of the host vehicle using these pieces of information, and thus the information presentation process ends. As described above, when the position information or acceleration of the host vehicle can be acquired, the position information of the host vehicle can be appropriately presented in the PND 2, and thus the information presentation process is terminated without performing the voice recognition process in the PND 2. Thus, a decrease in the charge amount of the PND 2 can be suppressed. In this example, the navigation controller 60 cannot detect the position information and acceleration of the host vehicle due to traffic congestion in the tunnel, and thus the process proceeds to step S106.

  In step S106, the microphone 70 provided in the PND 2 starts collecting the sound wave signal output into the vehicle. Here, in step S104, since the vehicle speed pulse is output as the sound wave signal from the in-vehicle device 1, the PND 2 can collect the sound wave signal including the vehicle speed pulse. The microphone 70 converts the collected sound wave signal into data and transmits it to the navigation controller 60.

  Next, in step S107, the vehicle information conversion function of the navigation controller 60 acquires data transmitted from the A / D converter 80, and performs voice recognition processing on the acquired data. For example, the vehicle information conversion function analyzes the frequency component, amplitude, and the like of the acquired data, and acquires a series of feature parameters of this data. Then, referring to the correspondence table 90, the feature parameter of this data is collated with the feature parameter of the data stored in association with the vehicle speed pulse in the correspondence table 90, and the data obtained from the collected sound wave signal is obtained. Then, it is determined whether the data is based on the vehicle speed pulse. If the data obtained from the acquired sound wave signal is the same as the data stored in association with the vehicle speed pulse, the acquired data is converted into a vehicle speed pulse.

  In step S108, the vehicle information conversion function calculates the vehicle speed of the host vehicle based on the vehicle speed pulse converted from the data. Here, as described above, since the vehicle-mounted device 1 outputs the vehicle speed pulse as a predetermined buzzer sound in accordance with the timing at which the vehicle speed pulse is detected, data is obtained from the predetermined buzzer sound collected in the PND 2. The vehicle speed of the host vehicle can be calculated by converting the data into vehicle speed pulses. The vehicle information conversion function corrects position information such as latitude and longitude where the host vehicle is located using the calculated vehicle speed. In addition, what is necessary is just to perform correction | amendment of the positional information on the own vehicle using a well-known method.

  In subsequent step S109, the vehicle information conversion function transmits the position information of the host vehicle corrected in step S108 to display device 100. Thereby, the display device 100 can display the corrected position of the host vehicle on the screen provided in the display device 100. In addition, by generating the sound data for announcing the surrounding information of the own vehicle using the corrected position information by the vehicle information conversion function, and transmitting the generated sound data to the speaker 110, the surroundings of the own vehicle from the speaker 110 are generated. You may output the sound which announces information.

  After the position information of the host vehicle corrected based on the vehicle speed pulse in step S109 is presented to the user, the information presentation process is terminated. The information presentation system starts the information presentation process again after the information presentation process is completed. Thereby, every time a vehicle speed pulse is detected, the vehicle speed pulse can be transmitted from the in-vehicle device 1 to the PND 2. As a result, even while the PND 2 cannot acquire the position information or acceleration of the own vehicle, the PND 2 can appropriately correct the position information of the own vehicle using the vehicle speed pulse transmitted from the in-vehicle device 1. The corrected position information of the host vehicle can be appropriately presented to the user.

  As described above, in the first embodiment, a predetermined buzzer sound is output to the vehicle interior in accordance with the vehicle speed pulse detected by the in-vehicle device 1, the buzzer sound is collected in the PND 2, and the buzzer sound is based on the buzzer sound. Get velocity pulse. Thereby, in 1st Embodiment, a vehicle speed pulse can be appropriately transmitted from the vehicle-mounted apparatus 1 to PND2, enabling improvement of the freedom degree of installation of PND2. As a result, even if the position information and acceleration of the host vehicle cannot be detected in the PND 2 due to traffic jams in the tunnel, the PND 2 can detect the position information of the host vehicle based on the vehicle speed pulse transmitted from the in-vehicle device 1. And the corrected position information of the host vehicle can be appropriately presented to the user.

  In addition, in 1st Embodiment, the vehicle-mounted apparatus 1 outputs a vehicle speed pulse as a sound of a non-audible range which a user cannot hear. Since the vehicle speed pulse is not information for alerting the user, if the vehicle speed information is output as a sound in the audible range, the sound continues to sound, which causes discomfort to the user. Therefore, by outputting the vehicle speed pulse as a sound in a non-audible range, the vehicle speed pulse necessary for correcting the position information of the host vehicle can be transmitted from the in-vehicle device 1 to the PND 2 without causing discomfort to the user. Further, even when radio communication or electromagnetic waves cannot be performed properly due to radio interference or noise that affects radio waves, the vehicle speed pulse is output from the in-vehicle device 1 to the PND 2 by outputting the vehicle pulse as a sound wave. Can be communicated appropriately.

  In step S102 of the first embodiment, in addition to the case where the vehicle speed is equal to or lower than a certain speed, when position information of the host vehicle cannot be detected by a GPS (not shown) included in the in-vehicle device 1, step S103 and subsequent steps. You may make it progress to the process of. Furthermore, when the in-vehicle device 1 determines that the host vehicle is stopped, the information presenting process may be terminated. Thereby, the burden of CPU12 of the controller 10 can be reduced.

<< Second Embodiment >>
Then, the information presentation process which concerns on 2nd Embodiment is demonstrated using FIG. 3 and FIG. FIG. 3 is a block diagram of an information presentation system according to the second embodiment. FIG. 4 is a flowchart showing information presentation processing according to the second embodiment. In 2nd Embodiment, except the point demonstrated below, it has the structure similar to the information presentation system of 1st Embodiment, and performs the operation | movement similar to the information presentation system of 1st Embodiment.

  As shown in FIG. 3, the PND 2 in the second embodiment includes an acoustic model 120 and a dictionary 130. The acoustic model 120 stores, for example, a model such as a hidden Markov model or a mixed Gaussian distribution model, and the dictionary 130 stores a vocabulary including normal words and abbreviations. By referring to the acoustic model 120 and the dictionary 130, the PND 2 can perform voice recognition processing of voice data obtained from the voice input to the microphone 70. That is, the vehicle information conversion function of the navigation controller 60 compares the voice data stored in the correspondence table 90 with the acquired voice data, and in addition to the voice recognition process by acoustic analysis that determines whether the voice data is the same, When the acquired speech data is speech data based on speech, the acoustic model 120 or the dictionary 130 is used to synthesize the model, the acoustically analyzed speech data is compared with the synthesized model, and the highest likelihood is obtained. A speech recognition process for recognizing speech by acquiring a word is also performed.

  Next, information presentation processing according to the second embodiment will be described with reference to FIG. In the following, since the user is not wearing a seat belt when the vehicle is traveling, a seat belt warning signal is transmitted from the in-vehicle device 1 to the PND 2 and a seat belt warning prompting the user to wear the seat belt in the PND 2 is presented to the user. An example will be described.

  First, processing in the in-vehicle device 1 will be described. In step S <b> 201, the vehicle information acquisition function of the controller 10 acquires vehicle information including alarm information from the vehicle controller 20. In this example, the controller 10 acquires a seat belt warning signal from the seat belt reminder 22 via the vehicle controller 20.

Next, in step S202, the voice data conversion function of the controller 10 determines whether alarm information has been acquired. Here, the alarm information is not limited to the seat belt alarm signal. For example, as shown in Table 1, a reverse alarm signal, a door lock alarm signal, a tire air pressure alarm signal, a side brake forget alarm signal, and a turn signal Meter warning signals such as hazard return forgotten warning signals, ITS warning signals for ensuring safety in the vehicle front-rear direction and side direction, and the like.

  If it is determined in step S202 that the voice data conversion function has acquired alarm information, the process proceeds to step S203. On the other hand, when it is determined that the voice data conversion function has not acquired the alarm information, the information presentation process is terminated. In this way, the in-vehicle device 1 determines whether the alarm information has been acquired. If the alarm information has not been acquired, it is not necessary to transmit the alarm information from the in-vehicle device 1 to the PND 2, and thus the information presentation process is terminated. As a result, the burden on the CPU 12 can be reduced. In this example, the seat belt warning signal is acquired from the seat belt reminder 22 in step S201, and the sound data conversion function determines that the seat belt warning signal has been acquired, and the process proceeds to step S203.

  In step S203, the sound data conversion function of the controller 10 refers to the correspondence table 40 and converts the seat belt warning signal acquired in step S201 into sound data. Here, in the correspondence table 40, voice data for announcing the contents of each alarm information in association with each alarm information is stored in advance. In this example, since the seat belt warning signal is acquired in step S201, the audio data conversion function refers to the correspondence table 40, and uses the acquired seat belt warning signal, for example, “ Please convert the announcement voice “” to voice data for output.

  Further, in step S203, the sound data conversion function refers to the correspondence table 40 and acquires sound data for outputting the first control sound wave signal. Here, the first control sound wave signal is, for example, a sound wave of a predetermined frequency or a predetermined sound pressure, and a trigger for causing the PND 2 to start a voice recognition process of the voice data corresponding to the seat belt warning signal. It is a sound wave. Here, the sound wave signal corresponding to the seat belt warning signal is a voice such as “Please wear your seat belt.” The voice recognition processing for voice data including such voice is performed by the frequency of the voice data. In addition to acoustic analysis of components and the like, it is necessary to synthesize a model with reference to the acoustic model 120 and the dictionary 130, and to recognize the voice by comparing the analyzed voice data with the synthesized model. Therefore, the first control sound wave signal is used as a trigger for causing the PND 2 to start the voice recognition process of the sound data corresponding to the seat belt warning signal, so that after the first control sound wave signal, Voice recognition processing can be appropriately performed on the voice data of the output seat belt warning signal, and as a result, the decrease in the charge amount of the PND 2 can be suppressed. That.

  In step S204, the output function of the controller 10 outputs to the speaker 50 audio data for outputting the first control sound wave signal acquired in step S203. The speaker 50 that has received the audio data for outputting the first control sound wave signal from the controller 10 outputs the first control sound wave signal converted from the sound data to the vehicle interior for a predetermined time. The first control sound wave signal may be a sound in the audible range, but does not call the user's attention, and is preferably a sound in the non-audible range.

  Subsequent step S205 is processing in PND2. In step S205, the microphone 70 provided in the PND 2 collects a sound wave signal in the passenger compartment. Here, since the in-vehicle device 1 outputs the first control sound wave signal in step S204, the microphone 70 can collect the first control sound wave signal in step S205. The sound wave signal collected by the microphone 70 is transmitted to the controller 10 as digital audio data via the A / D converter 80.

  Next, in step S206, the vehicle information conversion function of the navigation controller 60 determines whether the first control sound wave signal has been detected. For example, the vehicle information conversion function analyzes frequency components, amplitudes, and the like of transmitted voice data, and acquires a series of feature parameters of the voice data. Then, the vehicle information conversion function refers to the correspondence table 90, and transmits the feature parameter of the transmitted voice data and the feature parameter of the voice data stored in the correspondence table 90 in association with the first control sound wave signal. Match. As a result, if it can be determined that the transmitted sound data and the sound data stored in association with the first control sound wave signal are the same, it is determined that the first control sound wave signal has been detected. The process proceeds to step S207. On the other hand, if the transmitted voice data and the voice data stored in association with the first control sound wave signal are different as a result of the collation, it is determined that the first control sound wave signal cannot be detected, and this information presentation process Exit.

  In continuing step S207, the information presentation process of the vehicle-mounted apparatus 1 is performed again. In step S207, the output function of the controller 10 outputs the audio data converted from the seat belt warning signal in step S203 to the speaker 50. Then, the speaker 50 converts the received audio data into a sound wave signal, and outputs the sound wave signal to the passenger compartment. As described above, the in-vehicle device 1 outputs a sound wave signal corresponding to the seat belt warning signal after outputting the first control sound wave signal for a predetermined time in step S204. Here, the sound wave signal corresponding to the alarm information is an audible sound that can be heard by the user, and is output as an announcement sound for notifying the user of the content of the seat belt alarm. For example, when the alarm information is a seat belt alarm signal as in this example, the output function outputs an announcement voice such as “Please wear your seat belt”. The user can be notified of the content of the alarm by outputting an audible sound that announces the content of the alarm information.

  Further, the sound wave signal corresponding to the seat belt warning signal includes a second control sound wave signal. The second control sound wave signal is, for example, a sound wave having a predetermined frequency or sound pressure, and is added to the head of the sound wave signal corresponding to the seat belt warning signal. Therefore, the PND 2 can recognize the sound wave signal including the seat belt warning signal by using the second control sound wave signal as an index, and can start the sound recognition process of the sound data obtained from the sound wave signal. Thereby, voice recognition processing can be performed only for a sound wave signal including alarm information among sound wave signals including a conversation voice or audio sound by a user. As described above, the voice recognition processing of the voice data corresponding to the seat belt warning signal is performed from the voice data using the acoustic model 120 and the dictionary 130 in addition to the voice recognition processing by acoustic analysis such as frequency analysis of the voice data. It is necessary to recognize the speech by collating the obtained feature parameters with the acoustic model and obtaining the word with the highest likelihood, and suppose that speech recognition is performed for speech data obtained from all collected sound wave signals. When processing is performed, the reduction in the amount of charge of the CPU 62 increases. Therefore, a decrease in the charge amount of the PND 2 can be suppressed by performing the voice recognition process only on the voice data obtained from the sound wave signal including the alarm information among the sound wave signals output in the vehicle.

  In step S207, after outputting the sound wave signal including the second control sound wave signal, the information presentation process in the in-vehicle device 1 ends. And it returns to the process in PND2 again.

  Next, in step S208, the sound waves in the vehicle are collected by the microphone 70 provided in the PND 2. Here, in step S207, the in-vehicle device 1 outputs a sound wave signal including a second control sound wave signal and a sound wave signal indicating a seat belt warning signal. Therefore, in step S208, the microphone 70 can collect the sound wave signal. The collected sound wave signal is transmitted to the navigation controller 60 via the A / D converter 80.

  In step S209, the vehicle information conversion function of the navigation controller 60 acquires the sound data of the sound wave signal collected in step S208, performs sound recognition processing on the sound data, and uses the second control sound wave signal in the sound wave signal. Determine if it can be detected. For example, the frequency component, amplitude, etc. of this audio data are analyzed, and a series of characteristic parameters of the acquired audio data is acquired. Then, the vehicle information conversion function refers to the correspondence table 90 to obtain the feature parameter of the received voice data and the feature parameter of the voice data stored in the correspondence table 90 in association with the second control sound wave signal. Match. As a result of the collation, when it is determined that a part of the acquired voice data and the voice data stored in association with the second control sound wave signal are the same, the second control sound wave signal can be detected. It judges that it was completed and progresses to step S210. On the other hand, if it is determined as a result of the collation that a part of the acquired voice data is different from the voice data stored in association with the second control sound wave signal, the second control sound wave signal is detected. Therefore, it is determined that the acquired sound wave signal is not a sound wave signal output for reaching the alarm information from the in-vehicle device 1 to the PND 2, and the information presentation process is terminated.

  In step S210, voice recognition processing is performed on voice data obtained from a sound wave signal subsequent to the second control sound wave signal, that is, a sound wave signal indicating a seat belt warning signal. Here, since the sound wave signal indicating the seat belt warning signal is a voice such as “Please wear the seat belt”, the acoustic model 120 and the dictionary 130 are referred to in addition to the voice recognition processing by acoustic analysis. For example, the vehicle information converter analyzes the frequency component, amplitude, speed, etc. of the voice data and obtains a series of feature parameters of the voice data, and further performs the voice recognition process in step S210. , The model is synthesized based on the words stored in the dictionary 130 using the hidden Markov model or the mixed Gaussian distribution model stored in the acoustic model 120. Then, the feature parameter is compared with the synthesized model, A word having a high likelihood is acquired as a recognition result.In this way, the vehicle information conversion function is, for example, ““ seat bell. The voice data obtained from the sonic signal following the second control sonic signal corresponds to the seat belt alarm signal. The sound data is converted into a seat belt warning signal.

  Next, in step S211, the vehicle information conversion function generates text information indicating the detailed content of the seat belt warning based on the seat belt warning signal converted in step S210, and the text information is displayed on the display device 100. Output. For example, the vehicle information conversion function generates text information ““ the seat belt is not worn ”” using the seat belt warning signal, and transmits the text information to the display device 100. The display device 100. Displays the transmitted text information on the screen provided in the display device 100. Thus, the PND 2 displays the detailed contents of the seat belt warning signal based on the seat belt warning signal transmitted from the in-vehicle device 1. It can be presented to the user.

  After the detailed content of the seat belt warning is presented to the user in step S211, the information presentation process is terminated. The information presentation system starts the information presentation process again after the information presentation process is completed. Thereby, the PND 2 can transmit the alarm information from the in-vehicle device 1 to the PND 2 every time the alarm information is acquired.

  As described above, in the second embodiment, as in the first embodiment, alarm information is transmitted as a sound wave signal from the in-vehicle device 1 to the PND 2, so that the degree of freedom in installing the PND 2 can be improved. Alarm information can be transmitted appropriately. Furthermore, in 2nd Embodiment, in addition to being able to show alarm information to a user by the vehicle-mounted apparatus 1 because the vehicle-mounted apparatus 1 outputs alarm information as a sound of an audible range, in PND2, alarm information is also displayed. Since the detailed contents can be presented to the user, the contents of the alarm information can be appropriately presented to the user.

  In addition, in the second embodiment, when the PND 2 detects the first control sound wave signal, the voice recognition process for the voice data corresponding to the seat belt warning signal is started. Here, the speech recognition processing of the speech speech such as the announcement speech of the alarm information needs to recognize the speech by synthesizing the model with reference to the acoustic model 120 and the dictionary 130 in addition to the acoustic recognition processing by acoustic analysis. Therefore, the decrease in the amount of charge is large. Therefore, after detecting the first control sound wave signal, the voice recognition process is started for the sound data of the sound wave signal corresponding to the alarm information output after the first control sound wave signal, thereby reducing the charge amount of the PND 2 Can be suppressed. Furthermore, a second control sound wave signal indicating that the sound wave signal is to be subjected to voice recognition processing is added to the head of the sound wave signal corresponding to the alarm information. Thereby, PND2 recognizes the sound wave signal output in order to transmit alarm information from in-vehicle device 1 to PND 2 among the sound wave signals output in the vehicle including a user's conversation voice, audio sound, etc. it can. As a result, since only the sound wave signal output from the in-vehicle device 1 for transmitting the alarm information to the PND 2 can be subjected to the voice control processing of the voice with a heavy burden on the CPU 62, the decrease in the charge amount of the PND 2 can be suppressed. .

  In the second embodiment, an example in which a seat belt warning signal is transmitted to the PND 2 by outputting an announcement voice prompting the user to wear the seat belt from the speaker 50 of the in-vehicle device 1 has been described. A predetermined warning sound corresponding to the seat belt warning signal from 50 may be output. In this case, for example, the in-vehicle device 1 refers to the correspondence table 40 and converts the acquired seat belt warning signal into sound data stored in association with the seat belt warning signal. The audio data is converted into a predetermined warning sound and output from the speaker 50. On the other hand, the PND 2 refers to the correspondence table 90, performs voice recognition processing on the voice data obtained from the collected warning sound, and compares the acquired voice data with the voice data stored in association with the seat belt warning signal. Then, the acquired audio data is converted into a seat belt warning signal. Then, voice data for announcing the content of the seat belt warning is created based on the converted seat belt warning signal, and a guidance voice indicating the content of the seat belt warning signal on the speaker 110, for example, “” worn by the seat belt. "" Is output. By this, the seat belt warning signal detected by the in-vehicle device 1 is appropriately transmitted to the PND 2, and the guidance voice indicating the content of the transmitted seat belt warning signal is used. The content of the seat belt warning signal can be appropriately presented to the user.

<< Third Embodiment >>
Subsequently, an information presentation process according to the third embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a block diagram of an information presentation system according to the third embodiment. FIG. 6 is a flowchart showing information presentation processing according to the third embodiment. In 3rd Embodiment, except the point demonstrated below, it has the structure similar to the information presentation system of 1st Embodiment, and performs the operation | movement similar to the information presentation system of 1st Embodiment.

  As illustrated in FIG. 5, the PND 2 according to the third embodiment includes a switch SW140. The switch SW140 is connected to the navigation controller 60 via the CAN, and the navigation controller 60 that has received a signal indicating that the switch SW140 has been pressed instructs the microphone 70 to start collecting the sound wave signal. As a result, vehicle information is transmitted from the in-vehicle device 1 to the PND 2. Thus, the user can confirm vehicle information at a timing desired by the user by pressing the switch SW140. The switch 140 may be, for example, a switch as hardware installed in the in-vehicle device 1 or a switch as software displayed on the screen of the display device 100 that also serves as a touch panel. Also good.

  Next, information presentation processing according to the third embodiment will be described with reference to FIG. Here, in the following, when the user presses the switch SW140 of the PND2 in order to confirm the fuel consumption information calculated by the vehicle controller 20 of the vehicle-mounted device 1 in the PND2, the vehicle-mounted device is triggered by the switch SW140 being pressed. The fuel efficiency information is transmitted from 1 to the PND 2 and the scene in which the fuel efficiency information is presented to the user in the PND 2 is described as an example.

  First, processing in the in-vehicle device 1 will be described. In step S <b> 301, the vehicle information acquisition function of the controller 10 acquires fuel efficiency information calculated by the vehicle controller 20 from the vehicle controller 20. Next, in step S302, the data conversion function of the controller 10 refers to the correspondence table 40 and converts the acquired fuel consumption information into data. In the correspondence table 40, predetermined data is stored in association with each fuel consumption information, and the data conversion function refers to the correspondence table 40 and stores the acquired fuel consumption information in correspondence with the fuel consumption information. Can be converted to In step S303, the converted data is output to the speaker 50. The speaker 50 converts this data into a sound wave signal, and outputs the converted sound wave signal into the vehicle interior. Note that the sound wave signal output from the speaker 50 includes the second control sound wave signal, as in the second embodiment. Moreover, the vehicle-mounted apparatus 1 outputs fuel consumption information as a sound of a non-audible range similarly to 1st Embodiment. The fuel consumption information is not information for urging the user to pay attention as in the case of the vehicle speed pulse, but is intended to prevent the user from feeling uncomfortable by continuously sounding an audible range corresponding to the fuel consumption information.

  Processing subsequent to step S304 is performed in the PND 2. First, in step S304, the PND 2 determines whether or not the switch SW140 has been pressed by the user. If the switch SW140 is pressed, the process proceeds to the next step S305. On the other hand, if the switch SW140 is not pressed, it is not necessary to present the fuel consumption information to the user, and the information presentation process is terminated.

  In step S305, the microphone 70 provided in the PND 2 starts collecting a sound wave signal in the passenger compartment. The collected sound wave signal is converted into data by the A / D converter 80 and transmitted to the navigation controller 60.

  In the next step S306, the vehicle information conversion function of the navigation controller 60 performs voice recognition processing on the data transmitted from the A / D converter 80 as in the second embodiment, and the second control sound wave signal is used in this data. It is determined whether or not can be detected. If the vehicle information function can detect the second control sound wave signal, it is determined that this data includes the fuel consumption information transmitted from the in-vehicle device 1, and the process proceeds to step S307. On the other hand, if the vehicle information function cannot detect the second control sound wave signal, it is determined that this data is not data output for transmitting fuel consumption information from the in-vehicle device 1 to the PND 2, and this information presentation processing is performed. Exit. As described above, by detecting the second control sound wave signal, among the various sound wave signals collected by the microphone 70, the sound wave signal corresponding to the fuel consumption information output for transmission from the in-vehicle device 1 to the PND 2 Since only the voice recognition process in step S307 can be performed, a decrease in the charge amount of the PND 2 can be suppressed.

  In step S307, the vehicle information conversion function performs voice recognition processing on data obtained from the sound wave signal following the second control sound wave signal, that is, data corresponding to the fuel consumption information. For example, the frequency component, amplitude, and the like of the data obtained from the sound wave signal following the second control sound wave signal are analyzed, and a series of feature parameters of this data is acquired. Then, the vehicle information conversion function refers to the correspondence table 90, the characteristic parameter of the data obtained from the sound wave signal following the second control sound wave signal, and the data stored in the correspondence table 90 corresponding to the fuel consumption information. The fuel consumption information associated with the data obtained from the sound wave signal following the second control sound wave signal and the data having the highest likelihood is obtained by collating the characteristic parameter.

  In step S308, the vehicle information changing function transmits information based on the fuel consumption information acquired in step S307 to the display device 100 and the speaker 110. For example, in this example, the vehicle information changing function generates text information indicating the detailed contents of the fuel efficiency information based on the converted fuel efficiency information, and outputs the text information to the display device 100. The display device 100 receives this text information and displays the detailed contents of the fuel consumption information on the screen of the display device 100. Further, the vehicle information conversion function generates data for announcing fuel efficiency information based on the converted fuel efficiency information, and transmits the data to the speaker 110. The speaker 110 receives this data and outputs a sound for announcing the content of the fuel consumption information. In this way, the PND 2 can appropriately present the detailed contents of the fuel consumption information transmitted from the in-vehicle device 1 to the user.

  In step S308, after the fuel efficiency information is presented to the user, the information presentation process is terminated. However, the information presentation system starts the information presentation process again after the information presentation process ends. Thereby, whenever the user depresses the switch SW140 of the PND 2, the detailed contents of the fuel consumption information calculated by the in-vehicle device 1 can be presented on the PND 2.

  As described above, in the third embodiment, the depression of the switch SW140 is detected in the PND 2, and sound wave signal collection is started. Therefore, in addition to the effect of 1st Embodiment, when a user wants to confirm vehicle information, in PND2, the vehicle information can be appropriately shown to a user. Further, since the collection of the sound wave signal is not started in the PND 2 until the switch SW 140 is pressed, the decrease in the charge amount of the PND 2 due to the voice recognition process or the like can be suppressed.

  In the third embodiment, fuel consumption information is exemplified as vehicle information. However, the vehicle information is not limited to fuel consumption information. For example, the track information of the music being played, the audio information such as the song name, artist information, and the like can be used. Good. When the vehicle information is audio information, for example, when the user wants to know the name of a song being played on the in-vehicle device 1, the predetermined switch SW is pressed. When the switch SW 140 is pressed as a trigger, the audio information including the song name of the song detected by the in-vehicle device 1 is transmitted to the PND 2, and for example, the song name of the song is displayed on the screen of the display device 100 provided in the PND 2, A sound for announcing the name of a song can be output from the speaker 110.

  The embodiment described above is described for facilitating understanding of the present invention, and is not described for limiting the present invention. Therefore, each element disclosed in the above embodiment is intended to include all design changes and equivalents belonging to the technical scope of the present invention. In particular, the vehicle information transmitted from the in-vehicle device 1 to the PND 2 is not limited to the vehicle information described above, but includes all vehicle information that can be obtained by the in-vehicle device 1. In addition, the present invention is not limited to the above-described embodiments, and the first to third embodiments described above may be combined.

  In addition, in the information presentation processing in the above-described embodiment, for example, the processing in the in-vehicle device 1 and the processing in the PND 2 may be performed at the same time as long as vehicle information can be appropriately transmitted from the in-vehicle device 1 to the PND 2.

  The PND 2 of the above-described embodiment is the mobile terminal of the present invention, the vehicle information acquisition function is the vehicle information acquisition means of the present invention, the data conversion function is the data conversion means of the present invention, and the output function is the output means of the present invention. The microphone 70 corresponds to the sound collecting means of the present invention, the vehicle information conversion function corresponds to the vehicle information converting means of the present invention, and the display device 100 and the speaker 110 correspond to the information presenting means of the present invention.

1 ... In-vehicle device 10 ... Controller 11 ... ROM
12 ... CPU
13 ... RAM
DESCRIPTION OF SYMBOLS 20 ... Vehicle controller 21 ... Vehicle speed sensor 22 ... Seat belt reminder 23 ... Side brake alarm device 30 ... Audio controller 40 ... Correspondence table 50 ... Speaker 2 ... PND
60 ... Navigation controller 61 ... ROM
62 ... CPU
63 ... RAM
70 ... Microphone 80 ... A / D converter 90 ... Correspondence table 100 ... Display device 110 ... Speaker 120 ... Acoustic model 130 ... Dictionary 140 ... Switch SW

Claims (11)

An information presentation system comprising an in-vehicle device mounted on a vehicle and a mobile terminal,
The in-vehicle device is
Vehicle information acquisition means for acquiring the vehicle information;
Data conversion means for converting the vehicle information acquired by the vehicle information acquisition means into data;
Output means for outputting a sound wave signal based on the data converted by the data conversion means,
The mobile terminal
Sound collecting means for collecting the sound wave signals output by the output means of the in-vehicle device;
Vehicle information conversion means for obtaining the data from the sound wave signal collected by the sound collection means and converting the data into the vehicle information;
An information presentation system comprising: information presentation means for presenting presentation information based on the vehicle information converted by the vehicle information conversion means to a user. The information presentation system according to claim 1,
The data conversion means converts the vehicle information into data for outputting a sound in an audible range that can be heard by the user or a sound in a non-audible range that cannot be heard by the user, depending on the type of the acquired vehicle information. An information presentation system characterized by conversion. The information presentation system according to claim 1 or 2,
The vehicle information converting means converts the data into the vehicle information by performing a voice recognition process on the data obtained from the sound wave signal collected by the sound collecting means. Presentation system. The information presentation system according to any one of claims 1 to 3,
The data conversion means determines whether to convert the vehicle information into the data based on the type of the acquired vehicle information, and converts the vehicle information into the data based on the determination result. Information presentation system. The information presentation system according to claim 4,
When the vehicle information is vehicle speed information, fuel consumption information, warning information, or audio information indicating that the vehicle speed is equal to or less than a predetermined speed, the data conversion means converts the vehicle information into the data. Characteristic information presentation system. An information presentation system according to any one of claims 1 to 5,
In addition to the sound wave signal, the output means of the in-vehicle device converts the data obtained from the sound wave signal collected by the mobile terminal into the vehicle information in the mobile terminal in relation to the sound wave signal. Output a control sound wave signal to start,
When the vehicle information conversion means of the mobile terminal detects the control sound wave signal output from the output means of the in-vehicle device, the data obtained from the sound wave signal output in relation to the control sound wave signal Is converted to the vehicle information. The information presentation system according to claim 6,
The information presentation system, wherein the control sound wave signal is a sound wave having a predetermined frequency and / or a predetermined sound pressure. An information presentation system according to any one of claims 1 to 7,
The mobile terminal starts the sound collection of the sound wave signal output by the output means of the in-vehicle device by the sound collection means when a predetermined operation is performed by a user. . The information presentation system according to any one of claims 1 to 8,
When the vehicle information is vehicle speed information, the information presenting means presents to the user presentation information based on the position information of the host vehicle corrected based on the vehicle speed information. Sound collecting means for collecting sound wave signal sound;
Obtaining information from the sound wave signal collected by the sound collecting means, and converting the data to obtain information acquisition means for obtaining reception information included in the sound wave signal;
A mobile terminal comprising: information presenting means for obtaining presentation information to be presented to a user based on the received information obtained by the information obtaining means and presenting the presentation information to the user. The mobile terminal according to claim 10, wherein
When the information acquisition unit detects a control sound wave signal for starting acquisition of reception information included in the sound wave signal, the information acquisition unit obtains the data from the sound wave signal collected in association with the control sound wave signal. The mobile terminal obtains the reception information included in the sound wave signal by converting the data.

Images