JP2010035138A - Communication processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve both safety of a driver in driving and convenience in a speech by the driver, during the speech by the driver while driving a vehicle. <P>SOLUTION: When a driver who drives a vehicle makes a speech with a speaking partner, data containing reception voices from the speaking partner to the driver are received and then temporarily stored in a reception cache 122. A driving high-load state determining section 128 determines whether a driving state of the driver is a high-load state where received voices should not be heard and when the high-load state is determined, a received voice processing section 123 and a received image processing section 124 are controlled not to perform playback. Thus, if the driving state is the high-load state, outputting voice and image to the driver is not performed. Furthermore, when the driving state is recovered from the high-load state to a low-load state, playback of data stored in the reception cache 122 is resumed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a communication processing device that realizes a call by a driver while driving a vehicle.

  2. Description of the Related Art Conventionally, there are many technologies for controlling a call of a driver of a vehicle in a situation where there is a possibility that the vehicle will be hindered in safe driving. In such a conventional technique, control for prohibiting incoming / outgoing calls or temporarily suspending calls (holding calls) is performed based on the driving situation of the driver.

  For example, in Patent Document 1 below, a state that hinders safe driving of a driver (a state in which the driver needs to increase attention to driving: hereinafter, a case where the driving state becomes a high load state in this specification) If a state that allows the driver and the other party to hold the call, the call is put on hold and the call hold can be released, the call is put on hold. A technique for canceling and returning to the original call state is disclosed.

  Further, for example, in Patent Document 2 below, the technology described in Patent Document 1 is improved, and a driver's margin is determined by comprehensively judging a plurality of states that may impede safe driving of the driver. A technique has been disclosed that allows calculation to be performed and allows the other party to leave a message when the call is on hold.

JP-A-10-304464 (paragraphs 0030-0035) JP 2003-125454 A (paragraphs 0041-0050, 0090-0093)

BMJ, doi: 10.1136 / bmj.38537.397512.55, “Role of mobile phones in motor vehicle crashes resulting in hospital attendance: a case-crossover study” (published 12 July 2005), (Reference URL: http: //bmj.bmjjournals .com / cgi / rapidpdf / bmj.38537.397512.55v1.pdf)

  It is widely known that calls while driving a vehicle reduce the safety of driving. For example, current Japanese law prohibits the operation of mobile phones while driving or calls held by hand. . On the other hand, when using a hands-free set (a device with a speaker and a microphone that can be operated and talked without having a mobile phone), talking while driving is permitted. However, even when a hands-free set is used, it cannot be said that safety during a call is high.

  For example, in the non-patent document 1 described above, a research result has been reported that the accident occurrence risk is 3.8 times higher even when a call using the hands-free set is used than when the call is not made. (See Table 4 of Non-Patent Document 1). This is considered to be because the act of talking with a remote partner who does not know the driving situation of the driver itself causes a reduction in the attention required for driving and hinders safe driving of the vehicle.

  In a call using a hands-free set, it is considered that an action of listening to an utterance from the other party (an incoming call for the driver) is a major factor that hinders safe driving of the vehicle, in particular, rather than an action of the driver to speak. The utterance from the driver can be controlled by the driver itself, for example, when the driving state is a high load state, the utterance is not performed. However, the utterance from the call partner (received by the driver) is performed without much consideration of the driving state of the driver, and it is practical to appropriately interrupt the utterance of the call partner according to the driving state of the driver. It is difficult to. In addition, if the audio heard by the driver is music or the like, the driver can hear it, but in the case of conversation, it is difficult to perform the act of listening, and driving with concentration (attention) to listen to the conversation. The concentration (attentiveness) required for distraction will be distracted.

  On the other hand, as described in Non-Patent Document 1, since it is considered difficult to completely prohibit calls by a driver while driving a vehicle, a more complete hands can be used to reduce the risk of accidents. Development of a free call system is required. In the techniques described in Patent Literature 1 and Patent Literature 2, when the driving state of the driver becomes a high load state, the call is not disconnected, but is put on hold, and when the driving state of the driver becomes a low load state. Control to resume the call. However, in that the voice is not transmitted between the callers while the call is on hold, it is substantially the same as the disconnection of the voice call in that the conversation between the callers is interrupted. It cannot be said that it is a complete hands-free call system that considers the nature of the game. Further, in Patent Document 2, a message is recorded on the call partner side, and a recorded message is transmitted from the call partner to the driver at the same time when the call is resumed. Although it can be heard, the voice is not transmitted between the callers while the call is on hold, which is the same, and it cannot be said that the convenience of the driver is sufficiently taken into consideration.

  In order to solve the above problems, an object of the present invention is to provide a communication processing device that takes into consideration both the safety of driving of a driver and the convenience of calling by a driver in a call by a driver while driving a vehicle. And

According to the present invention, in order to achieve the above object, a driver for driving a vehicle is a communication processing device mounted on the vehicle for making a call with a call partner,
An audio output unit that outputs the received audio from the other party to the driver via an audio output device so that the driver can listen;
Via a sound collector, a voice input unit for acquiring speech from the driver to the other party;
A reception cache that temporarily stores data including the received voice received by a wireless communication device that receives data including received voice from the other party to the driver;
An operation state quantification means for acquiring and quantifying a detection result by an operation state detection device that detects the operation state of the driver;
Based on the result of quantification by the driving state quantifying means, it is determined whether or not the driving state of the driver is a high load state where listening to the received voice should not be performed, and the driving state of the driver is a high load state. A driving high load state determination means for sending a reproduction interruption instruction for controlling to interrupt reproduction of data including the received voice in the case,
When the reproduction interruption instruction is received from the driving high load state determination unit, the reproduction processing of the data including the received voice stored in the reception cache is not performed, and the driving high load state determination unit When a reproduction interruption instruction has not been received, reproduction processing means for performing reproduction processing of data including the received voice stored in the reception cache;
A communication processing apparatus is provided.
With this configuration, in the call by the driver while driving the vehicle, both the driver's driving safety and the convenience of the call by the driver are taken into consideration, and the driver “listens to” when the driving state of the driver is a high load state. "It is possible to prevent the act from being performed.

Further, in the present invention, in addition to the above configuration, retransmission request determination means for determining whether to request retransmission of data including received voice from the other party to the driver,
When the retransmission request determination unit determines to request retransmission of data including the received voice, the retransmission requesting the communication apparatus storing the data including the received voice to retransmit the data including the received voice Request means,
A communication processing apparatus is provided.
With this configuration, it is possible to acquire data lost during communication and data that the driver wants to acquire (listen) again.

Further, according to the present invention, in addition to the above configuration, the communication device stores data including the received voice transmitted from the driver to the call partner or the call terminal used by the call partner or the call partner. There is provided a communication processing device which is a device on a network having the function of
With this configuration, for a communication device (such as a center) that can store data stored in a call terminal used for a call by the other party or data transmitted from the driver to the other party on the network. A retransmission request can be made.

Further, according to the present invention, in addition to the above-described configuration, a jingle indicating that a reproduction delay is caused when the driving state of the driver shifts from a low load state where the received voice may be heard to the high load state. There is provided a communication processing apparatus having a high-load state jingle transmitting means for transmitting to the call terminal of the other party.
With this configuration, the other party can grasp that the driving state of the driver has shifted to the high load state.

Further, according to the present invention, in addition to the above-described configuration, a jingle indicating that a reproduction delay is caused when the driving state of the driver shifts from a low load state where the received voice may be heard to the high load state. There is provided a communication processing device having a high-load state jingle notification means for causing the audio output unit to output via the audio output device.
With this configuration, the driver can grasp that the driving state of the driver has shifted to the high load state.

Further, according to the present invention, in addition to the above configuration, when the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to the received voice, the reproduction is resumed. There is provided a communication processing device having a low load state jingle transmitting means for transmitting a jingle indicating that the jingle is to be transmitted to the call terminal of the other party.
With this configuration, the call partner can grasp that the driving state of the driver has shifted to the low load state.

Further, according to the present invention, in addition to the above configuration, when the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to the received voice, the reproduction is resumed. There is provided a communication processing device having a low load state jingle notification means for outputting a jingle indicating that the sound is output to the audio output unit via the audio output device.
With this configuration, the driver can grasp that the driving state of the driver has shifted to the low load state.

Furthermore, in the present invention, in addition to the above-described configuration, silence detection means for detecting that the uttered voice acquired by the voice input unit via the sound collection device has been silent for a predetermined time; ,
Provided is a communication processing apparatus having a silent state jingle transmitting means for transmitting a jingle indicating a silent state detection to the call terminal of the other party when a silent state of the predetermined time or more is detected by the silent detecting means. .
With this configuration, the call partner can grasp the end of the utterance (conversation break) from the driver to the call partner.

Further, according to the present invention, in addition to the above configuration, when the driver inputs the end of the utterance from the driver to the other party through the operation input device, the jingle indicates the end of the utterance from the driver to the other party. Is provided. The communication processing device has an utterance end jingle transmission means for transmitting the message to the call terminal of the other party.
With this configuration, the call partner can grasp the end of the utterance (conversation break) from the driver to the call partner.

Further, according to the present invention, in addition to the above configuration, the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to received voice, When the reproduction processing of the data including the received voice stored in the cache is resumed, the voiced section of the received voice stored in the reception cache is reproduced and the silent section of the received voice is skipped or There is provided a communication processing apparatus having a short-time reproduction control means for performing short-time reproduction when fast-forwarding.
With this configuration, when playback of the received voice that was stored while the driver's operating state was in a high load state has been resumed, the time that is delayed by skipping or fast-forwarding the silent section is reduced, and the actual playback time It becomes possible to catch up with.

Further, according to the present invention, in addition to the above configuration, the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to received voice, When the reproduction process of the data including the received voice stored in the cache is resumed, the short-time playback is performed to reproduce the received voice stored in the reception cache at a speed faster than the speed at the time of speaking. A communication processing device having a control means is provided.
With this configuration, when the reproduction of the received voice accumulated while the driving state of the driver is in a high load state is resumed, the reproduction is performed at a speed higher than usual (that is, a speed faster than the speed at the time of speaking). Accordingly, it is possible to reduce the delay time and catch up with the actual reproduction time.

Further, according to the present invention, in addition to the above configuration, the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to received voice, When the reproduction processing of the data including the received voice stored in the cache is resumed, the received voice stored in the received cache is stored based on the instruction input from the driver. There is provided a communication processing apparatus having a short-time reproduction control means for performing short-time reproduction for skipping or fast-forwarding the received voice, or reproducing at a speed faster than the speed at the time of utterance.
With this configuration, when playback of received audio that has been accumulated while the driver's operating state is in a high load state is resumed, the delay time caused by the playback process according to the input operation by the driver is reduced. It is possible to catch up with the playback time of.

Further, according to the present invention, in addition to the above-described configuration, the short time reproduction control means performs a reproduction process of data including the received voice stored in the reception cache when the short time reproduction catches up with a current time. A communication processing device configured to return to a normal playback state is provided.
With this configuration, it is possible to return to the normal call state when the normal call timing is caught up by the special reproduction performed when the operation state shifts from the high load state to the low load state.

Furthermore, in the present invention, in addition to the above-described configuration, the reception cache includes a communication processing device configured to continue to hold data including the received voice that has been played back by the playback processing unit. Provided.
With this configuration, the driver can listen to the received voice once played again.

Further, according to the present invention, in addition to the above configuration, the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to received voice, A delay for notifying the delay time difference between the current time and the time at which playback should have been performed in the absence of playback interruption due to the high load state when the playback processing of the data including the received voice stored in the cache is resumed A communication processing apparatus having a time difference notification means is provided.
With this configuration, in this configuration, when the reproduction of the received voice that has been accumulated while the driver's operation state is a high load state is resumed, the driver grasps the delay time of the resume of the received voice that has been resumed. It becomes possible.

Furthermore, in the present invention, in addition to the above-described configuration, a communication processing apparatus is provided that includes a voice quality improvement unit that improves voice quality related to data including the received voice stored in the reception cache.
With this configuration, it is possible to improve the voice quality of the received voice while data is stored in the reception cache, for example, when playback is temporarily interrupted in a high load state.

Further, according to the present invention, in addition to the above configuration, a determination result as to whether or not the driving state of the driver determined by the driving high load state determination unit is a high load state is transmitted to the call terminal of the other party. There is provided a communication processing apparatus having an operation state transmitting means.
With this configuration, the call partner can grasp the driving state of the driver.

Furthermore, in addition to the above configuration, the present invention provides a communication processing device configured to perform multi-person simultaneous communication with a plurality of the other parties.
With this configuration, the technology of the present invention can be applied to a call in simultaneous communication with a large number of people.

Furthermore, in addition to the above configuration, the present invention provides a communication processing device in which the call is performed by transmitting both voice and images.
With this configuration, the technology of the present invention can be applied to a TV phone that transmits both sound and images.

Further, according to the present invention, in addition to the above-described configuration, there is provided a communication processing device configured such that the reproduction processing unit reproduces data including the received voice that is continuously held in the reception cache. Provided.
With this configuration, the driver can listen to the received voice once played again.

Further, in the present invention, in addition to the above-described configuration, an upper limit value for determining a maximum speed is set in the short-time playback for playback at a speed faster than the speed at the time of speaking, and the short-time playback control means A communication processing device configured to perform reproduction at a speed equal to or less than a value is provided.
With this configuration, it is possible to prevent the driver from being able to hear the voice and increase to a speed at which it cannot be heard during playback at a speed higher than usual. As a result, inhibition of visual concentration due to auditory concentration can be controlled, and driving safety can be maintained without reducing the driver's concentration on driving.

Further, in the present invention, in addition to the above configuration, a basic value equal to or less than the upper limit value is set, and the short-time playback control means is configured to start the short-time playback with the basic value as an initial speed. A communication processing apparatus is provided.
With this configuration, the short-time playback mechanism can be started at a speed faster than the normal speed (1.0 times speed). In addition, this makes it possible to quickly return to the normal playback state.

Furthermore, in the present invention, in addition to the above configuration, there is provided a communication processing apparatus having an upper limit value changing means capable of changing the upper limit value.
With this configuration, it is possible to give flexibility to the playback system at a speed higher than usual according to the present invention, and an upper limit value is determined in real time according to the permissible amount of hearing concentration depending on the individual's hearing ability and driving situation. It becomes possible to do.

Further, in the present invention, in addition to the above-described configuration, the input interface that can be operated and input by the driver is provided, and the upper limit value changing unit is configured to change the upper limit value in accordance with an operation input from the input interface. A communication processing apparatus is provided.
With this configuration, the driver can set the upper limit value himself.

Furthermore, in the present invention, in addition to the above configuration, an input interface that can be operated and input by the driver;
A playback speed changing means capable of manually changing the current speed of playback in the short-time playback,
And manually changing the current speed in accordance with an operation input from the input interface, and when the current speed is changed to a value exceeding the upper limit value, the upper limit value changing means sets the upper limit value. There is provided a communication processing device configured to change the upper limit value so that the value of the current speed changed in excess is reflected in the upper limit value.
With this configuration, the driver can change the playback speed related to playback at a speed higher than normal, and the playback speed changed by the driver is reflected in the upper limit value.

Furthermore, in the present invention, in addition to the above-described configuration, there is provided a test execution unit that performs an upper limit determination test for determining the upper limit suitable for each of the drivers, and the upper limit change unit includes There is provided a communication processing apparatus configured to change the upper limit value based on a test result obtained by a test execution unit.
With this configuration, an upper limit value suitable for each driver can be set.

Furthermore, in the present invention, in addition to the above configuration, there is provided a communication processing apparatus having a playback speed changing means capable of changing the current playback speed in the short-time playback.
With this configuration, it is possible to change the playback speed related to playback at a higher speed than usual according to various situations. For example, the user may change the current playback speed by an operation input, the current speed may be automatically changed from the initial value to the upper limit value, and the current speed is the situation (driving concentration, speech tempo of the other party) It may be automatically changed according to.

Further, in the present invention, in addition to the above-described configuration, an input interface that can be operated and input by the driver is provided, and the playback speed changing unit is configured to change the current speed in accordance with an operation input from the input interface. A communication processing apparatus is provided.
With this configuration, the driver can manually change the playback speed related to playback at a higher speed than usual.

Furthermore, in the present invention, in addition to the above configuration, there is a speech speed calculation means for calculating the speech speed of the conversation included in the received voice,
In the short-time playback for playback at a speed faster than the speed at the time of the utterance, the short-time playback control means automatically changes the current speed based on the speech speed of the conversation calculated by the speech speed calculation means. A communication processing device configured as described above is provided.
With this configuration, the playback speed related to playback at a speed higher than normal is changed in consideration of the speaking speed of the conversation included in the voice.

Further, in the present invention, in addition to the above-described configuration, an upper limit value for determining the maximum speed in the short-time playback is set, and the short-time playback control means is based on the upper limit value in addition to the speech speed of the conversation. Thus, there is provided a communication processing device configured to automatically change the current speed of reproduction in the short-time reproduction.
With this configuration, the playback speed related to playback at a speed higher than normal is changed in consideration of the set upper limit value in addition to the speaking speed of the conversation included in the voice.

Furthermore, the present invention provides a communication processing device in which the upper limit value is set in accordance with the speech speed of a conversation included in speech in addition to the above configuration.
With this configuration, it is possible to set the relationship between the conversation speed included in the voice and the upper limit value.

  The present invention has the above-described configuration, and has an effect of realizing both the driving safety of the driver and the convenience of the calling by the driver in the call by the driver while driving the vehicle.

It is a figure which shows an example of a structure of the vehicle-mounted system in the 1st Embodiment of this invention. It is a flowchart which shows an example of the reception process performed at the time of the telephone call using the vehicle-mounted system in the 1st Embodiment of this invention. It is a flowchart which shows an example of the reproduction | regeneration processing performed at the time of the telephone call using the vehicle-mounted system in the 1st Embodiment of this invention. It is a flowchart which shows an example of the driving | operation high load determination process performed at the time of the telephone call using the vehicle-mounted system in the 1st Embodiment of this invention. It is a figure which shows an example of the communication system in the 2nd Embodiment of this invention. It is a figure which shows an example of a structure of the vehicle-mounted system in the 2nd Embodiment of this invention. It is a figure which shows an example of a structure of the center in the 2nd Embodiment of this invention. It is a figure which shows the 1st example of the communication system in the 3rd Embodiment of this invention. It is a figure which shows the 2nd example of the communication system in the 3rd Embodiment of this invention. It is a figure which shows an example of the communication system in the 4th Embodiment of this invention. In this invention, it is a figure which shows an example of the mode transition of the reproduction | regeneration state of the received data from the other party who is accumulate | stored in the cache for reception. In the 5th Embodiment of this invention, it is a graph which shows an example of the relationship between reproduction speed and time in the case of performing simple double speed reproduction. In the 5th Embodiment of this invention, it is a block diagram which shows an example of a structure of the received voice process part which has a double speed reproduction | regeneration function which performs double speed reproduction. It is a graph of the audio | voice waveform which shows an example of the process by the double speed reproduction | regeneration processing of the double speed reproduction | regeneration processing in the 5th Embodiment of this invention. In the 5th Embodiment of this invention, it is a graph which shows an example of the relationship between reproduction speed and time in the case of performing fluctuation | variation of reproduction speed within a practical speed range. It is a figure for demonstrating the concept of the sound pulse width and reproduction speed (magnification) in the 5th Embodiment of this invention. In the 5th Embodiment of this invention, it is a flowchart which shows an example of the method in which a driver changes an upper limit directly. In the 5th Embodiment of this invention, it is a flowchart which shows an example of the method in which a driver changes a basic value directly. 14 is a flowchart illustrating an example of a method for changing an upper limit value reflecting a reproduction speed set by an operation input by a driver in the fifth embodiment of the present invention. 14 is a flowchart illustrating an example of a method for changing a basic value reflecting a reproduction speed set by an operation input by a driver in the fifth embodiment of the present invention. In the 5th Embodiment of this invention, it is a graph which shows an example of the relationship between the reproduction speed at the time of performing an initial test, and time. It is a graph which shows an example of the relationship between the reproduction speed (magnification) in the 5th Embodiment of this invention, and a suitable average sound beat width. In the 5th Embodiment of this invention, it is a flowchart which shows an example of the process changed to the reproduction speed suitable for speech speed.

  Hereinafter, first to fifth embodiments of the present invention will be described.

  In the present invention, when a driver makes a call, the driver can control the utterance by himself / herself, while the driver himself / herself controls the listening of the utterance by the other party (that is, the reception for the driver). Therefore, it is considered that the risk of accident occurrence increases when listening to the utterance (received) from the other party, and the convenience of the driver's call is not significantly impaired. It is to make. In the present invention, when the driving state of the driver becomes a high load state, control is performed so that the received voice from the other party is not reproduced and output.

  In the following description, an example is given of a case where a call is possible between a vehicle-mounted system mounted on a vehicle driven by a driver and a call terminal of a call partner by a videophone that transmits both voice and images. However, the present invention can be applied to a call in which either one of voice and image is transmitted. Considering the safety of driving by the driver, even videophones that transmit both voice and images are restricted to voice calls while the driver is driving, and image pickup, transmission / reception, playback, etc. are started. It is also possible to prevent the processing relating to the image to be performed.

  Further, in the following description, the call performed between the driver and the other party will be described on the premise of data packet communication in which voice and images are communicated in a packet format. The invention can also be applied.

<First Embodiment>
First, a first embodiment of the present invention will be described. FIG. 1 is a diagram illustrating an example of a configuration of an in-vehicle system according to the first embodiment of the present invention. The communication processing device 100 illustrated in FIG. 1 is mounted on an in-vehicle system 10 operated by a driver, and the communication processing device 100 performs transmission processing for processing data transmitted from the driver to the other party during a call. The apparatus 110 includes a reception processing device 120 that processes data sent from the call partner to the driver (data received by the driver from the call partner).

  In FIG. 1, the transmission processing apparatus 110 includes a transmission audio processing unit 111, a transmission image processing unit 112, a transmission cache 113, and a transmission processing unit 114.

  The transmission voice processing unit 111 has a function of processing (for example, encoding processing) voice acquired by the microphone 300 that can collect a driver's speech for data communication. The microphone 300 can use any sound collecting means such as a sound collecting function installed in advance in the in-vehicle system or a microphone provided in a hands-free set.

  In addition, the transmission image processing unit 112 uses an image acquired by the camera 400 that can capture a face image of the driver or an image of an object that the driver wants to transmit to the call partner (for example, a material that the driver wants to show to the call partner) for data communication. Have a function of processing (for example, encoding processing). The camera 400 can use any imaging means such as an imaging function installed in advance in the in-vehicle system or an imaging means connected to the in-vehicle system.

  The transmission cache 113 has a buffer function for temporarily storing data processed by the transmission audio processing unit 111 and the transmission image processing unit 112. The transmission cache 113 can be realized by a packet buffer or an arbitrary memory.

  The transmission processing unit 114 has a function of processing data stored in the transmission cache 113 and transmitting the processed data to a call terminal used by the call partner via the communication module 200. Note that the communication module 200 can use any communication means such as a wireless communication function installed in advance in the in-vehicle system or a mobile phone connected to the in-vehicle system.

  In FIG. 1, in the transmission processing apparatus 110, the transmission audio processing unit 111 and the transmission image processing unit 112 exist independently of each other, but the mutual processing is associated with each other, and image and audio synchronization processing is performed. It is desirable to be done. An image in this specification represents a moving image (video) or a still image, and an image transmitted and received during a call may be either a moving image or a still image.

  On the other hand, in FIG. 1, the reception processing device 120 includes a reception processing unit 121, a reception cache 122, a reception audio processing unit 123, a reception image processing unit 124, an audio reproduction output unit 125, an image reproduction output unit 126, and driving load quantification. Unit 127 and driving high load state determination unit 128.

  The reception processing unit 121 has a function of receiving and processing data transmitted from the call terminal of the call partner during the call from the call terminal used by the call partner via the communication module 200. Note that the data received from the call partner's call terminal includes an image and a sound in the same manner as the data received to the call partner's call terminal.

  In addition, the reception cache 122 has a buffer function for temporarily storing data processed by the reception processing unit 121. In the present invention, when the operation state is a high load state, data is stored without performing data reproduction (reading of data). Therefore, it is desirable to have a capacity sufficient to store data accumulated up to the upper limit time (delay allowable time) when a call is delayed in a high load state. As with the transmission cache 113, the reception cache 122 can be realized by a packet buffer or an arbitrary memory.

  The reception voice processing unit 123 has a function of reading the voice data stored in the reception cache 122 and processing (for example, decoding processing) for voice output. Further, the reception voice processing unit 123 performs processing of voice data (reading of voice data from the reception cache 122) based on whether or not reproduction (permission / non-permission) instructed by the driving high load state determination unit 128 is performed. It is possible to start / interrupt. In other words, when receiving a reproduction non-permission instruction from the driving high load state determination unit 128, the reception voice processing unit 123 temporarily interrupts the processing of the voice data, and thereafter, the driving high load state determination unit 128 When receiving an instruction for permission of reproduction from, the audio data processing can be resumed.

  The reception image processing unit 124 has a function of reading out image data stored in the reception cache 122 and processing (for example, decoding processing) for image output. Further, the received image processing unit 124 performs image data processing (reading of image data from the reception cache 122) based on whether or not the reproduction is instructed (permitted / not permitted) from the driving high load state determination unit 128. It is possible to start / interrupt. In other words, the received image processing unit 124 temporarily interrupts the processing of the image data when receiving an instruction not to permit reproduction from the driving high load state determination unit 128, and then the driving high load state determination unit 128. When a reproduction permission instruction is received from, image data processing can be resumed.

  Note that the reception audio processing unit 123 and the reception image processing unit 124 perform a process for improving the quality of the audio data / image data once stored in the reception cache 122 (for example, a process for improving the sampling rate) and then output. It is also possible to do. The call according to the present invention is not based on real-time communication but reads and reproduces data once stored in the reception cache 122. If a certain amount of delay is allowed, output after quality improvement processing is performed. It is possible to be done. In particular, when the driving state of the driver is a high load state, data is stored in the reception cache 122, so that it is possible to perform data quality improvement processing during this period.

  In addition, the audio reproduction output unit 125 has a function of processing the audio data processed by the reception audio processing unit 123 to generate an audio signal and informing the driver through the speaker 500 so that the driver can listen to the audio signal. Yes. Note that the speaker 500 can use any sound output means such as a sound output function installed in advance in the in-vehicle system or a speaker provided in the hands-free set.

  The image reproduction output unit 126 has a function of processing the image data processed by the received image processing unit 124 to generate an image signal and notifying the driver through the monitor 600 so that the driver can see the image signal. Yes. The monitor 600 may use any image output means such as an image output function installed in advance in the in-vehicle system or a monitor connected to the in-vehicle system.

  The driving load quantification unit 127 has a function of referring to the detection result by the driving state detection unit 700 that detects the driving state of the driver and quantifying the driving state of the driver from the detection result.

  The driving state detection unit 700 has a function of detecting an arbitrary condition indicating the driving state of the driver. Examples of conditions include vehicle speed, own vehicle position and travel miracle, steering angle (handle angle), state of accelerator, brake, gear, etc., distance between other vehicles, guidance route, and frequent accident points. It is possible to use a map (distance from the frequent accident points). Various conditions described in Patent Document 1 and Patent Document 2 may be used.

  Also, any algorithm can be used as the quantification algorithm used for the calculation of the driving load quantification unit 127. For example, you may use the algorithm described in patent document 1 or patent document 2, such as using the margin described in patent document 2 as a quantification result of the driving load quantification part 127.

  Further, the driving high load state determination unit 128 determines whether or not the driving state of the driver is a high load state based on the quantified value of the detection result by the driving state detection unit 700 calculated by the driving load quantification unit 127. The reception audio processing unit 123 and the reception image processing unit 124 have a function of instructing whether or not reproduction is permitted (permitted / not permitted). When it is determined that the driving state of the driver is a high load state, the driving high load state determination unit 128 instructs the reception audio processing unit 123 and the reception image processing unit 124 to prohibit the reproduction. Send an instruction signal.

  For example, as a condition for determining that the driving state is a high load state, for example, when the vehicle is passing an accident-prone point (such as a merging point or an intersection), when there are many steering operations by the driver, or when the vehicle speed is high Or when the number of times of braking is large, or when the distance between the vehicle traveling forward and backward is small. Note that any algorithm can be used as the algorithm for determining the driving high load state by the driving high load state determining unit 128. For example, a learning algorithm such as a neural network or a Bayesian network may be used as an algorithm for determining a driving high load state, or an algorithm described in Patent Document 1 or Patent Document 2 may be used.

  Further, for example, the driving high load state determination unit 128 instructs the reception audio processing unit 123 and the reception image processing unit 124 to permit / deny reproduction according to whether or not the driving state of the driver is a high load state. Alternatively, the reception voice processing unit 123 and the reception image processing unit 124 are configured to perform reproduction when an instruction from the driving high load state determination unit 128 is not received, and the driving high load state determination The unit 128 does not give an instruction to the reception voice processing unit 123 and the reception image processing unit 124 when the driving state of the driver is not a high load state, and receives the reception voice only when the driving state of the driver is a high load state. Reproduction prohibition may be instructed to the processing unit 123 and the received image processing unit 124.

  Although not shown in FIG. 1, a determination result (or presence information obtained by processing this determination result) indicating whether or not the driving state of the driver determined by the driving high load state determination unit 128 is a high load state is transmitted. It is also possible to transmit from the processing unit 114 to the other party's call terminal through the communication module 200.

  In FIG. 1, the reception processing device 120 includes a reception audio processing unit 123 and a reception image processing unit 124 that are independent of each other, but are associated with each other and perform image and audio synchronization processing. It is desirable.

  Next, an example of the operation in the first embodiment of the present invention will be described based on the above configuration example. FIG. 2 is a flowchart showing an example of reception processing performed during a call using the in-vehicle system according to the first embodiment of the present invention.

  When a call using the in-vehicle system is started, data communication by a call with the call partner is started, and the communication module 200 receives data sent from the call partner in step S201. The communication module 200 sends the received data to the reception processing unit 121, and after processing by the reception processing unit 121, in step S202, the data received in step S201 is stored in the reception cache.

  In addition, when the call is ended in step S203, the reception process is also ended. On the other hand, if the call has not ended yet in step S203, the process returns to step S201, and the above reception process is repeated until the call ends.

  FIG. 3 is a flowchart showing an example of a reproduction process performed during a call using the in-vehicle system according to the first embodiment of the present invention. When a call using the in-vehicle system is started, data communication by a call with the call partner is started, and in step S301, a driving high load state determination process is started. The operation high load state determination process is a process in which the operation high load state determination unit 128 determines whether or not the received data can be reproduced according to the operation state. Details of the operation high load state determination processing will be described later with reference to FIG.

  The process of reproducing data received from the other party is controlled based on the determination result (whether or not the reproduction of received data is permitted) determined by the driving high load state determination unit 128 (step S302). If the determination result of the driving high load state does not permit the reproduction of the received data in step S302, the driving high load state in step S301 is not performed without performing the reproduction of the received data (the processing in steps S303 and S304 described later). Return to determination processing. That is, when the determination result of the driving high load state does not permit the reproduction of the received data, until the determination result of the driving high load state permits the reproduction of the reception data (the driving state is low load). The operation high load state determination process is repeated.

  On the other hand, if it is determined in step S302 that the determination result of the high operating load state permits the reproduction of the received data, the received audio processing unit 123 and the received image processing unit 124 transfer the data from the reception cache 122 in step S303. In step S304, the audio reproduction output unit 125 and the image reproduction output unit 126 output the data through the speaker 500 and the monitor 600. As a result, the driver views the sound and images sent from the other party. If no data is stored in the reception cache 122 at this time, there is no data to be reproduced (that is, data received from the other party), and there is no need to perform reproduction processing.

  Note that when the call is ended in step S305, the reproduction process is also ended. On the other hand, if the call has not ended yet in step S305, the process returns to step S301, and the above reproduction process is repeated until the call ends.

  FIG. 4 is a flowchart showing an example of a driving high load determination process performed during a call using the in-vehicle system according to the first embodiment of the present invention. The driving high load determination process shown in FIG. 4 shows an example of detailed processing in the driving high load state determination process in step S301 shown in FIG.

  In the driving high load state determination process, first, in step S3011, the driving state detection unit 700 detects the driving state of the driver (the state in which the driver is driving the vehicle), and in step S3012, the driving load quantification unit 127 Based on the driving state detected by the driving state detection unit 700, processing for quantifying the driving state of the driver is performed. It should be noted that any conditions and algorithms can be used as the conditions (operation states) detected by the operation state detection unit 700 and algorithms for quantification thereof as described above.

  In step S3013, it is determined whether or not the driving state of the driver is a high load state based on the quantification result of the driving state obtained in step S3012. In addition, the algorithm used when determining whether the driving | running state of a driver is a high load state can use arbitrary algorithms as mentioned above.

  If it is determined in step S3013 that the driving state of the driver is not a high load state (that is, a low load state), in step S3014, the driving high load state determination unit 128 determines the reproduction permission of the received data and receives the received data. The audio processing unit 123 and the received image reproduction unit 124 are controlled to reproduce the received data (that is, the processes in steps S303 and S304 in FIG. 3).

  On the other hand, if it is determined in step S3013 that the driving state of the driver is a high load state, in step S3015, the driving high load state determination unit 128 determines that the reception data is not allowed to be reproduced, and the reception voice processing unit 123. The received image reproduction unit 124 is controlled not to reproduce the received data (that is, the processes in steps S303 and S304 in FIG. 3).

  According to the reproduction control of the data in the reception cache 122 by the driving high load state determination unit 128, the data is not reproduced in the high load state, but the reception data is accumulated in the reception cache 122, and the reception data is received in the low load state. The received data stored in the cache 122 is reproduced.

  Note that in the first embodiment of the present invention, a call partner with whom the driver makes a call using the in-vehicle system can use any call terminal, and the call partner of the call partner can communicate with the driver. If the function for making a call is implemented, there is no need to implement a special function. That is, the call terminal of the other party may be a mobile phone or a PC (Personal Computer) on which an IP phone application is already widely used.

<Second Embodiment>
Next, a second embodiment of the present invention will be described. FIG. 5 is a diagram illustrating an example of a communication system according to the second embodiment of the present invention. In FIG. 5, the in-vehicle system 20 can communicate with a call terminal 950 as a call partner via a call line network 940. Further, data exchanged between the in-vehicle system 20 and the call terminal 950 is performed via the center 900 on the call line network 940, as indicated by arrows in FIG. The telephone line network 940 is an arbitrary communication network. For example, the telephone line network 940 represents the Internet or a telephone line network.

  Moreover, the vehicle-mounted system in FIG. 5 has the structure shown, for example in FIG. FIG. 6 is a diagram illustrating an example of the configuration of the in-vehicle system according to the second embodiment of the present invention. The communication processing device 150 illustrated in FIG. 6 is mounted on the in-vehicle system 20 operated by the driver, and the communication processing device 150 performs transmission processing for processing data transmitted from the driver to the other party during a call. And a reception processing device 170 that processes data sent from the call partner to the driver (data received by the driver from the call partner).

  In FIG. 6, the transmission processing device 160 includes a transmission audio processing unit 111, a transmission image processing unit 112, a transmission cache 113, a transmission processing unit 114, and a retransmission request unit 161. The transmission audio processing unit 111, the transmission image processing unit 112, the transmission cache 113, and the transmission processing unit 114 have the same functions as those illustrated in FIG.

  When the retransmission request unit 161 receives a retransmission request instruction together with the identification information of the retransmission request target data from the retransmission request determination unit 171 of the reception processing apparatus 170, the retransmission request unit 161 retransmits the retransmission request target data to the center 900. And a function for generating a retransmission request message for requesting and sending the message to the transmission processing unit 114. This retransmission request message is transmitted to the center 900 via the communication module 200, and it becomes possible to request the center 900 to retransmit the data to be retransmitted.

  On the other hand, in FIG. 6, the reception processing device 170 includes a reception processing unit 121, a reception cache 122, a reception audio processing unit 123, a reception image processing unit 124, an audio reproduction output unit 125, an image reproduction output unit 126, and driving load quantification. Unit 127, operation high load state determination unit 128, and retransmission request determination unit 171. The reception processing unit 121, the reception cache 122, the reception audio processing unit 123, the reception image processing unit 124, the audio reproduction output unit 125, the image reproduction output unit 126, the driving load quantification unit 127, and the driving high load state determination unit 128. Has the same function as that shown in FIG. 1, and a description thereof is omitted here.

  The retransmission request determination unit 171 determines whether there is a case where data stored in the reception cache 122 is missing or a case where the driver desires to view (reproduce) the reception from the other party. When there is data to be acquired, the retransmission request unit 161 is instructed to make a retransmission request for the data. Note that as identification information for identifying data to be retransmitted, it is possible to use the time at which the data was communicated, the sequence number included in the data (packet), or the like.

  FIG. 7 is a diagram illustrating an example of the configuration of the center according to the second embodiment of the present invention. The center 900 illustrated in FIG. 7 includes a communication module 901, a data reception unit 902, a cache 903, a data transmission unit 904, a retransmission request reception unit 905, and a retention period determination unit 906.

  The communication module 901 is a network interface that can receive data transmitted on the telephone line network 940 and send data to the telephone line network 940.

  Further, the data receiving unit 902 has a function of processing data acquired from the telephone line network 940 via the communication module 901 and storing the data in the cache 903.

  The cache 903 has a function of storing data exchanged between the in-vehicle system 20 and the call terminal 950. The cache 903 can store the data passed from the data receiving unit 902 and can pass the data to the data transmitting unit 904 in response to a request from the data transmitting unit 904. Note that the cache 903 can continue to hold the data for the retention period determined by the retention period determination unit 906 even when the data is transferred to the data transmission unit 904. Further, only data transmitted to the in-vehicle system 20 may be held in the cache 903.

  The data transmission unit 904 has a function of reading data stored in the cache 903 and transmitting the data from the communication module 901 onto the telephone line network 940. During a normal call, the data stored in the cache 903 by the data receiving unit 902 is immediately transferred to the call line network 940 again. Further, the data transmission unit 904 can read out the data requested for retransmission from the cache 903 and transmit it to the in-vehicle system 20 in response to an instruction from the retransmission request reception unit 905.

  The retransmission request receiving unit 905 has a function of processing a retransmission request message received from the in-vehicle system 20. The retransmission request reception unit 905 refers to the identification information of the retransmission request target data included in the received retransmission request message, and transmits the data so that the retransmission request target data is read from the cache 903 and transmitted to the in-vehicle system 20. It is possible to instruct the unit 904.

  The retention period determination unit 906 determines a retention period for storing data in the cache 903 and deletes data stored in the cache for a predetermined retention period with reference to a timer (not shown), for example. It has a function.

  The center 900 can be realized by any network entity on the telephone line network 940 capable of relaying data exchanged between the in-vehicle system 20 and the telephone terminal 950. The center 900 includes, for example, a server newly provided to provide a service according to the present invention, a home agent of the in-vehicle system 20 (when the in-vehicle system 20 is equipped with mobile IP), and a gateway of the telephone line network 940. It can be realized by using a circuit switch.

  Next, an example of the operation in the second embodiment of the present invention will be described based on the above-described configuration example. Data transmitted between the in-vehicle system 20 and the call terminal 950 (particularly, data transmitted from the call terminal 950 to the in-vehicle system 20) is stored in the cache 903 of the center 900 and held by the center 900 for a predetermined holding period. Is done. The in-vehicle system 20 transmits a retransmission request message (a message including identification information of data to be retransmitted) to the center 900, and the center 900 transmits the data to be retransmitted according to the retransmission request message to the call terminal 950. Send to. Through this series of operations, the in-vehicle system 20 can acquire data received from the call terminal 950 (or data that should have been received but could not be received) and reproduce the data. . In particular, in the case of call data transmission / reception, since UDP (User Datagram Protocol) is basically used, the retransmission function according to the second embodiment of the present invention is very useful.

  If the communication processing device 100 shown in FIG. 1 or the communication processing device 150 shown in FIG. 6 is also implemented in the call terminal 950 of the call partner, data that can be retransmitted to the call terminal 950 Therefore, the in-vehicle system 20 can directly make a data retransmission request to the call terminal 950. In this case, data retransmission according to the second embodiment of the present invention can be realized without providing the center 900 having a data cache function on the telephone line network 940.

  Further, in the second embodiment of the present invention, data that can be retransmitted is accumulated in the center 900 or the call terminal 950, so that a handover (change of connected base station) is performed in the communication module 200 of the in-vehicle system 10. Thus, the data transmitted from the other party without being affected by the handover in the in-vehicle system 20 is stored in the center 900 or the telephone terminal 950 in a retransmittable state. Accordingly, the other party speaks regardless of disconnection (instantaneous interruption) due to handover in the in-vehicle system 20, and the communication processing device 150 of the in-vehicle system 20 may request data stored in the center 900 or the telephone terminal 950. It is possible to realize seamless handover without interrupting the conversation.

  In addition, as described in the second embodiment of the present invention, by storing data that can be retransmitted in the center 900 or the call terminal 950, the driver continues the conversation using a mobile phone after getting off the vehicle. It is possible to achieve hardware seamlessness. In this case, it is desirable to cooperate with a directory service (such as a dictionary or address book) such as SIP (Session Initiation Protocol) or DNS (Domain Name System) for specifying the communication address of the call terminal of the other party.

<Third Embodiment>
Next, a third embodiment of the present invention will be described. FIG. 8 is a diagram illustrating a first example of a communication system according to the third embodiment of the present invention. The communication processing device 180 illustrated in FIG. 8 is mounted on the in-vehicle system 30 operated by the driver, and the communication processing device 180 performs transmission processing for processing data sent from the driver to the other party during a call. And a reception processing device 185 that processes data sent from the call partner to the driver (data received by the driver from the call partner).

  In FIG. 8, the transmission processing device 160 has the same function as that shown in FIG. 1, and a description thereof is omitted here.

  On the other hand, in FIG. 8, the reception processing device 185 includes a reception processing unit 121, a reception cache 122, a reception audio processing unit 123, a reception image processing unit 124, an audio reproduction output unit 125, an image reproduction output unit 126, and an operation load quantification. Unit 127, operating high load state determination unit 128, and jingle output unit 187. The reception processing unit 121, the reception cache 122, the reception audio processing unit 123, the reception image processing unit 124, the audio reproduction output unit 125, the image reproduction output unit 126, and the driving load quantification unit 127 are illustrated in FIG. The functions are the same as those described above, and a description thereof is omitted here.

  In addition to the function of the driving high load state determination unit 128 in the first embodiment of the present invention described above, the driving high load state determination unit 186 further changes the driving state of the driver from the low load state to the high load state. A function to instruct the jingle output unit 187 to output jingle (audio with a short reproduction time) when it is determined that the driving state has changed from a high load state to a low load state. have.

  Further, the jingle output unit 187 has a function of reading a predetermined jingle and passing it to the transmission audio processing unit 111 and the audio reproduction output unit 125 when receiving an instruction to output the jingle from the driving high load state determination unit 186. have. The jingle passed from the jingle output unit 187 to the transmission voice processing unit 111 is transmitted to the other party's call terminal via the communication module 200, and the jingle passed from the jingle output unit 187 to the voice reproduction output unit 125 is a speaker. 500 is notified to the driver.

  The following operations are performed by the configuration shown in FIG. When the driving state of the driver becomes a high load state, the driving high load state determination unit 186 detects the high load state and instructs the jingle output unit 187 to output the jingle. The jingle output unit 187 outputs a jingle indicating that a high load state has been reached, transmits the jingle to the other party's call terminal, and outputs the jingle from a speaker that allows the driver to listen to the sound. As a result, the other party and the driver can grasp the fact that the driving state of the driver has become a high load state (as a result, the playback on the driver side is interrupted and a playback delay occurs) by listening to the jingle, It is possible to continue the conversation while considering that the driving state of the driver is a high load state, or to temporarily refrain from the conversation based on the judgment of the driver and the other party.

  Similarly, when the driving state of the driver returns to the low-load state, the jingle output unit 187 outputs a jingle indicating that the low-load state has occurred, so that the other party and the driver are in the driving state of the driver. By listening to the jingle, it is possible to grasp that the low-load state has been reached (and as a result, playback on the driver side will be resumed). It is possible to continue the conversation while considering that it was in a loaded state (for example, confirming whether or not the contents spoken in a high load state can be grasped each other).

  The jingle that is output when the driving state of the driver changes from a low load state to a high load state is different from the jingle that is output when the driving state of the driver changes from a high load state to a low load state. It is desirable to use voice. As a result, the other party and the driver can easily grasp whether the state has shifted to the high load state or the low load state by listening to the jingle.

  Moreover, FIG. 9 is a figure which shows the 2nd example of the communication system in the 3rd Embodiment of this invention. The communication processing device 190 illustrated in FIG. 8 is mounted on the in-vehicle system 35 operated by the driver, and the communication processing device 190 performs transmission processing for processing data transmitted from the driver to the other party during a call. And a reception processing device 120 that processes data sent from the other party to the driver (data received by the driver from the other party).

  In FIG. 9, the reception processing device 120 has the same function as that shown in FIG. 1, and a description thereof is omitted here.

  On the other hand, in FIG. 9, the transmission processing apparatus 195 includes a transmission audio processing unit 111, a transmission image processing unit 112, a transmission cache 113, a transmission processing unit 114, a silence detection unit 196, and a jingle output unit 197. The transmission audio processing unit 111, the transmission image processing unit 112, the transmission cache 113, and the transmission processing unit 114 have the same functions as those illustrated in FIG.

  The silence detection unit 196 detects a case where the audio data to be transmitted to the other party's call terminal is in a silence state for a predetermined period (for example, about several seconds), and when the silence state is detected, Have a function to instruct to output jingle.

  In addition, the jingle output unit 197 has a function of reading a predetermined jingle and passing it to the transmission audio processing unit 111 and the audio reproduction output unit 125 when receiving an instruction to output the jingle from the silence detection unit 196. ing. The jingle passed from the jingle output unit 197 to the transmission voice processing unit 111 is transmitted to the other party's call terminal via the communication module 200. Although not shown in FIG. 9, the jingle may be further passed from the jingle output unit 197 to the audio reproduction output unit 125 and notified to the driver through the speaker 500.

  The following operations are performed by the configuration shown in FIG. When the driver has a conversation, the silence detection unit 196 can detect a speech break from the driver by detecting a silence state, and can communicate the speech break to the call partner. As a result, the other party can grasp the utterance separation by the driver. For example, even if the silent state continues, the driver does not intentionally speak (for example, the driving state is a high load state). In the case of the above) or whether the driver's utterance was cut off halfway due to the unstable communication line.

  Further, instead of the silence detection unit 196 and the jingle output unit 197 (or in addition to the silence detection unit 196 and the jingle output unit 197), a PTT (Push To Talk) button 800 that can be operated by the driver may be provided. The driver can indicate the separation of his / her speech by pressing the PTT button 800 while he / she is speaking and speaking the PTT button 800 when not speaking. When the driver releases the PTT button 800 from the pressed state (that is, when the utterance is ended), the jingle is output in the same manner as the jingle output unit 197. As a result, the driver can send a jingle (a jingle equivalent to that output from the jingle output unit 197) to the other party by operating the PTT button 800. For example, when the driving state is a high load state, the driver sends a jingle to the other party by pressing and releasing the PTT button 800, and notifies that the driver cannot respond (speak) because the driving state is a high load state. It is also possible.

  The jingle output from the jingle output unit 197 (or the jingle output from the PTT button 800) includes two types of jingles () sent to the other party in the first example and jingles in the two examples. (Jingle output when the driving state of the driver changes from a low load state to a high load state and jingle output when the driving state of the driver changes from a high load state to a low load state) It is desirable to use

  It is also possible to construct a communication processing device by combining the configurations of the first and second examples in the third embodiment of the present invention described above. The jingle that is output when the status changes from low load to high load, the jingle that is output when the driver's operating status changes from high load to low load, and the jingle that indicates the break of the driver's speech Three types of jingles will be notified. The other party of the call may hear these jingles by voice so that the state of each can be grasped. In addition, a function for specifying the type of each jingle and performing a process corresponding to each jingle (for example, a process for notifying the calling party of the state of the driver indicated by each jingle) may be implemented in the calling terminal of the calling party. Good.

<Fourth embodiment>
Next, a fourth embodiment of the present invention will be described. FIG. 10 is a diagram illustrating an example of a communication system according to the fourth embodiment of the present invention. In FIG. 10, the in-vehicle system 40 can communicate with the call terminals 1010 and 1020 of a plurality of call partners via a call line network (not shown in FIG. 10). Is feasible. Note that FIG. 10 shows an example of a system configuration in which there are two other parties in addition to the driver and a total of three people make a call. May be performed.

  Even when a multi-person call as shown in FIG. 10 is performed, a call using the in-vehicle system 40 according to the present invention is possible. The in-vehicle system 40 can use any of the in-vehicle systems 10, 20, 30, and 35 described in the first to third embodiments of the present invention. At this time, for example, when the driving state of the driver using the in-vehicle system 40 becomes a high load state, the reproduction of the received data in the in-vehicle system 40 is temporarily stopped. However, the temporary stop of the reproduction of the received data in the in-vehicle system 40 does not affect the calls of other call terminals, and calls (conversations) between the call terminals 1010 and 1020 of other callers are still possible. Maintained. Then, the in-vehicle system 40 in the high load state receives data related to the call between the call terminals 1010 and 1020 of the caller and stores the data in the reception cache 122. Thus, when the driving state changes from a high load state to a low load state, the driver using the in-vehicle system 40 views the call data between the callers' call terminals 1010 and 1020 stored in the high load state. It becomes possible.

  In addition, although it demonstrated independently regarding each of the above-mentioned 1st-4th embodiment of this invention, it is also possible to carry out combining the structure and process which concern on each embodiment. In the first to fourth embodiments of the present invention described above, description has been given using schematic block diagrams. However, each block described in these block diagrams is hardware and / or It can be realized by software. The operation represented by the flowchart can be realized by causing a CPU (Central Processing Unit) to execute a program that defines hardware and / or each process.

  In the first to fourth embodiments of the present invention described above, it is assumed that both sound and image are transmitted between the in-vehicle system and the call terminal, but either sound or image is used. It is also possible to apply the present invention to a call in which only data is transmitted. Also, for example, when the vehicle is stopped, both the image and sound are reproduced and output (videophone), during low-load operation, the image is stopped and only the sound is reproduced and output (voice call only), and during high-load operation A configuration may be adopted in which playback of both images and sounds is stopped.

  In the first to fourth embodiments of the present invention described above, the present invention is applied to an in-vehicle system, but the system to which the present invention is applied is not particularly limited. In other words, in the above example, it is determined whether or not the driving state of the vehicle is a high load state and whether or not the regeneration process is possible, but in any system, the caller (corresponding to the driver in the above example) An arbitrary status may be acquired, and based on the status, it may be determined whether or not the caller is in a state suitable for making a call.

  Further, in the first to fourth embodiments of the present invention described above, the operation high load state determination units 128 and 186 allow the reception audio processing unit 123 and the reception image processing unit 124 to reproduce (allow / reject reproduction). ) Is executed, the playback process is controlled to be executed / stopped, but the operation in which the data stored in the reception cache 122 is finally output to be viewable by the driver is interrupted. If possible, arbitrary processing may be stopped. For example, the driving high load state determination unit 128 may instruct the sound reproduction output unit 125 or the image reproduction output unit 126 to temporarily stop the process when the driving state of the driver is a high load state.

  In the first to fourth embodiments of the present invention described above, the data stored in the reception cache 122 may be immediately erased or erased when read by the reproduction output. It may continue to be stored in the cache 122 for reception without any problem. When the data is continuously stored in the reception cache 122 without being erased, the data can be reproduced again, for example, because the driver missed it. Further, when the data is continuously stored in the reception cache 122 without being deleted, the data stored for a predetermined time or longer may be deleted.

  In the first to fourth embodiments of the present invention described above, when the operation state returns from the high load state to the low load state, the received data from the call partner stored in the reception cache 122 is stored. Playback starts again, but at this time, the playback data can be played back with the silent part packed, for example, by skipping or fast-forwarding the silent part, or at a playback speed (double speed playback) faster than normal. It is also possible to enable the driver to skip data reproduction. This makes it possible for the driver to listen to and sort out the received data more quickly when the driving state is a high load state, and the original that was performed between the driver and the other party. It is possible to quickly return to the conversation state.

  Next, as a fifth embodiment of the present invention, a description will be given of double-speed playback in which received data from a call partner stored in the reception cache 122 is played back at a playback speed faster than usual.

  In the first to fourth embodiments of the present invention described above, when the operation state returns from the high load state to the low load state, the received data from the call partner stored in the reception cache 122 is reproduced at double speed. In this case, for example, it is expected that the reproduction speed is changed as shown in FIG. In other words, during normal playback, playback was performed at a playback speed of 1.0 times, but when the driving state became a high load state, the playback was suppressed and the sound was silenced, and the driving state returned from the high load state to the low load state. In this case, double-speed playback is performed at a constant playback speed (1.3 times in FIG. 12), and when the received data catches up to a state where it can be played back in real time, the playback speed returns to normal playback of 1.0 times again. .

  Although it is possible to perform simple double speed reproduction as shown in FIG. 12, however, such simple double speed reproduction has problems such as impeding the driver's concentration on driving during double speed reproduction. It can happen. In the fifth embodiment of the present invention, the safety as described above is maintained during the double speed reproduction by taking the following measures.

  In the double-speed playback system according to the fifth embodiment of the present invention, an upper limit (peak) is set as a practical speed range for double-speed playback, and double-speed playback at a speed exceeding this upper limit is not performed. Such an upper limit value is not set in the existing double speed reproduction system, and it is not desirable to directly apply the existing double speed reproduction system to the double speed reproduction of the audio data according to the present invention.

  In general, there is an upper limit to the speed of double-speed playback that can be heard by humans, and there is also an upper limit of the speed of double-speed playback that does not impair the concentration of the driver during driving. In addition, the upper limit of the speed of double-speed playback differs depending on the individual listening ability. If double-speed playback at a speed exceeding the upper limit is performed during the driver's operation, the driver's consciousness may be suitable for listening to the sound by double-speed playback, which may impair the driver's concentration on driving. is there. In order to prevent such a decrease in driving safety, the present invention determines the upper limit of the range in which safe driving can be maintained (the range in which the driver can sufficiently hear) regarding the speed of double speed regeneration, and double speed at a speed exceeding this upper limit. Prevent playback.

  Although there may be a maximum speed at which double-speed playback is possible in existing double-speed playback systems, this value is determined depending on, for example, the capabilities of the double-speed playback system, and this increases driving safety. This is significantly different from the upper limit of the present invention considered.

  In the double speed reproduction system according to the fifth embodiment of the present invention, the basic value is set based on the above upper limit value. The basic value is a reproduction speed lower than the above upper limit value (and a reproduction speed higher than the reproduction speed when double-speed reproduction is not performed), and double-speed reproduction is started with this basic value as an initial value. Regarding the basic value and upper limit value, the basic value and upper limit value (basic value and upper limit value on the system) of manual transmission mode in which the driver performs double speed playback while manually changing the playback speed, and the double speed playback system plays back The basic value and the upper limit value of the automatic transmission mode in which the double speed reproduction is performed while automatically changing the speed may be set separately, and as described later, the basic value corresponding to each sound width in the automatic transmission mode. A value and an upper limit value may be set.

  In the double-speed playback system according to the fifth embodiment of the present invention, the driver can easily hear and operate by performing double-speed playback at a playback speed within the playback speed range (practical speed range) determined by the above upper limit value. It is possible to realize double speed reproduction without degrading the safety. When changing the playback speed during double-speed playback (particularly in the case of the automatic transmission mode), it is desirable that the playback speed be varied so as not to deviate from this practical speed range.

  In the double speed reproduction system according to the fifth embodiment of the present invention, the driver can set the upper limit value in advance. It is also possible to perform a test for determining the above upper limit value, or to perform an operation for learning the upper limit value from a manual operation in the manual shift mode.

  FIG. 13 is a block diagram showing an example of a configuration of a received voice processing unit having a double speed reproduction function for performing double speed reproduction in the fifth embodiment of the present invention. The received voice processing unit 123 illustrated in FIG. 13 includes a playback / stop control unit 1231 and a double speed playback mechanism unit 1232. The double speed playback function in the received voice processing unit 123 can also be realized by a program that can be executed by a computer.

  The playback / stop control unit 1231 receives audio data from the reception cache 122 based on an instruction from the outside (for example, whether or not playback is instructed from the driving high load state determination unit 128 (not shown in FIG. 13)). Can be started / interrupted, or the playback speed of the audio data can be changed based on an external instruction (for example, input by a driver).

  The double speed reproduction mechanism unit 1232 has a function for reproducing the reception data from the call partner stored in the reception cache 122 at a reproduction speed faster than usual. The automatic transmission control unit 1233, sound A pulse width analysis unit 1234 and a practical speed upper limit value learning unit 1235 are included.

  The automatic transmission control unit 1233 has a function of automatically adjusting the reproduction speed of audio data. The automatic shift control unit 1233 includes an upper limit value determination unit 1236, a basic value determination unit 1237, and a shift instruction unit 1238.

  The upper limit determination unit 1236 has a function of determining the upper limit value of the practical playback speed when performing double speed playback, and the basic value determination unit 1237 determines the basic value of the practical playback speed when performing double speed playback. It has a function to do. The upper limit value determined by the upper limit value determination unit 1236 and the basic value determined by the basic value determination unit 1237 are notified to the shift instruction unit 1238.

  The upper limit value used when performing double-speed playback is determined depending on the playback speed at which the driver can hear (or the upper limit playback speed at which the concentration on driving does not decrease). Is a reproduction speed having a margin with respect to the upper limit (double speed reproduction slower than the upper limit double speed reproduction). The maximum value of the reproduction speed is defined by the upper limit value in the fluctuation range of the reproduction speed in actual double speed reproduction. Further, the above-described basic value may be used as the lower limit value, or a special value may not be defined (for example, the same speed may be set as the lower limit value). In this specification, the speed of double speed reproduction is expressed by a magnification with respect to the reproduction speed of the original audio data, and the upper limit value and the basic value are also expressed by the magnification of the reproduction speed.

  Further, the shift instruction unit 1238 is based on the upper limit value and basic value of the practical playback speed determined when performing double-speed playback, and also based on the sound pulse width (considering the speech speed) analyzed by the sound width analysis unit 1234. Thus, it has a function of determining the playback speed when actually performing double speed playback. The reproduction speed for actual double-speed reproduction determined by the shift instruction unit 1238 is notified to the audio reproduction output unit 125, and double-speed reproduction processing of audio data is performed based on this reproduction speed. That is, the playback speed determined by the shift instruction unit 1238 is the playback speed that the driver actually feels.

  In addition, the sound duration analysis unit 1234 has a function of analyzing the sound duration contained in the audio data to be reproduced. For example, the sound width analysis unit 1234 may perform a sound recognition result of the sound data to be reproduced (speech recognition may be performed by the sound width analysis unit 1234 or may be a sound recognition system implemented in an in-vehicle system. It may be performed), and has a function of analyzing the pitch width of the sound. The sound duration will be described later.

  The practical speed upper limit learning unit 1235 has a function of determining an upper limit value (practical playback speed upper limit value) suitable for a specific user (that is, a driver) by learning. As with the upper limit value, a basic value appropriate for the driver may be determined by learning regarding the basic value. Further, an initial test execution unit 1239 and a real-time learning unit 1240 are provided. The initial test execution unit 1239 has a function of determining a playback speed suitable for a specific user (that is, a driver) by performing an initial test. In addition, the real-time learning unit 1240 has a function of learning the playback speed set by the driver in real time when double-speed playback is actually performed, and determining a practical speed upper limit value.

  Further, the audio reproduction output unit 125 performs a double speed reproduction process of the audio data according to the reproduction speed determined by the shift instruction unit 1238. The present invention is not particularly limited with respect to this double-speed playback processing method, and the audio playback output unit 125 may perform double-speed playback processing by, for example, normal digital signal processing. In normal double speed reproduction processing, pitch conversion processing is performed that maintains the original pitch (that is, does not change the voice quality of the speaker). In general, voice expansion is realized by performing Fourier transform and performing equivalent division on the time axis with respect to the similar waveform of the voice part and the similar waveform of the silent part.

  FIG. 14 is a graph of an audio waveform showing an example of processing by double-speed playback processing of double-speed playback processing in the fifth embodiment of the present invention. As shown in FIG. 14, the voice waveform is usually formed by several similar waveforms, and it is possible to shorten the voice reproduction time by cutting the voice expansion of the original voice waveform. FIG. 14 shows a double-speed audio waveform in which the original audio waveform is halved as an example, but an N-times audio waveform is realized by setting it to N times.

  The conversation speed (speaking speed) can be expressed by the number of sound beats included per unit time. One sound beat has, for example, a sound range including one vowel. For example, the word “yaki niku” is “ya (YA)”, “ki (KI)”, “ni (NI)”, “ku”. (KU) ”(four voiced sounds including four vowels).

  For example, as shown in FIG. 15, the word “YAKINIKU” multiplied by 1.0 times (normal playback speed) is 1.1 times, 1.3 times, 1.5 times, and 2.0 times. As the playback speed is increased, each sound beat width is shortened, and the sound beat width included per unit time (the reciprocal of the number of sound beats, that is, the reciprocal of the speech speed) is increased. If the conversation is fast (such as speaking fast), the per-unit time will be smaller, and if the conversation is slow (such as speaking slowly) The pitch range included per unit time increases. Note that in normal conversation, there are mixed voices with different sound widths, and there is also a silent part (a state in which no speaker is present) in addition to a sound part (a state in which a speaker is present). Therefore, it is desirable that the average number of sound beats obtained from the number of sound beats included in a certain period of time (the reciprocal is the average sound beat width) be considered as the speech speed.

  It is also conceivable that the ability of the driver to hear double speed playback depends on the sound duration. In this case, if it becomes impossible to hear the content of the conversation if it becomes smaller than a certain sound width, the sound width that is the boundary of whether the driver can hear the content of the conversation (the minimum sound that can be heard) (Beat width) exists. The minimum sound beat width that becomes this boundary is not simply determined only by the reproduction speed (magnification), but it is necessary to consider the speech speed in addition to the reproduction speed (magnification).

  In addition, the upper limit value of the actual practical reproduction speed may vary depending on the length of the average sound pulse width and other disturbances (such as noise). For example, if the word “YAKINIKU” shown in FIG. 15 is reproduced at a reproduction speed higher than 1.3 times, it becomes difficult to hear the word, and 1.3 times is determined as the upper limit value of the practical reproduction speed. However, when the original utterance is quicker and the original word is shorter, the value determined as the upper limit value of the practical playback speed is expected to be smaller.

  Next, the operation in the fifth embodiment of the present invention will be described.

  As the upper limit value, for example, a predetermined initial value (default value) is set in an initial state (at the time of factory shipment). In addition, the applicant has verified by statistics and has obtained a result that it is desirable to set the upper limit to 1.3 times. In the initial state (at the time of factory shipment), the basic value may be set to a value (for example, 1.2 times) lower than the initial value of the upper limit value, and the basic value is set to the same value as the upper limit value. It may be set.

  As the most basic operation, a method can be used in which the default initial values cannot be changed, and double speed reproduction is performed according to the default upper limit value and basic value. For example, as shown in FIG. 16, when double speed playback is started, the playback speed at the start time is set to the basic value. In FIG. 16, the playback speed is set to 1.2 times the default basic value, but the default basic value may be any value, for example, 1.0 times. It is also possible. In this way, when the basic value is set to a value lower than the upper limit value, double-speed playback is started from the set basic value, and sudden high-speed playback is not performed, It is possible to prevent unpleasant double-speed playback from being performed and not to reduce the driver's concentration on driving.

  In addition, it is desirable that the playback speed of the double speed playback be varied within a practical speed range having an upper limit as an upper limit (a basic value may be set as the lower limit). At this time, if the double-speed playback is performed at the highest possible playback speed, the time until returning to the normal playback is shortened. However, in the fifth embodiment of the present invention, the playback speed exceeding the set upper limit value is reduced. Avoid double-speed playback. For example, as shown in FIG. 16, the playback speed is fluctuated (increased) so as to approach the upper limit step by step, and when the upper limit value is reached, double-speed playback is performed without increasing the playback speed further. Do. Note that, here, the playback speed is increased stepwise (the playback speed is varied by a discrete value), but the playback speed may be increased smoothly. Alternatively, the playback speed may be controlled so as not to exceed a value lower than the upper limit value by a certain value without reaching the upper limit value. Thus, by preventing the double-speed reproduction exceeding the upper limit value from being performed, it is possible to prevent double-speed reproduction that is difficult to hear and not to reduce the driver's concentration on driving.

  Regarding the fluctuation of the reproduction speed, the driver may be allowed to change the reproduction speed (manual shift mode), or the reproduction speed may be automatically changed in the double speed reproduction system (automatic shift). mode). In both the manual shift mode and the automatic shift mode, it is desirable that the playback speed of the double speed playback is changed within a practical speed range with the upper limit as the upper limit. If the playback speed is changed beyond the upper limit, the playback speed value that exceeds the upper limit will be set at the next double speed playback. May be reflected in the new upper limit value.

(Manual shift mode)
At the time of double speed reproduction, the driver itself may be able to change the reproduction speed of the double speed reproduction. The driver can play the playback speed from various input interfaces such as GUI (Graphocs User Interface), steering switch (operating switch attached to the steering wheel (handle)), voice input (analysis by voice recognition system), etc. It is possible to make changes. Note that when the driver is driving (or when the vehicle is moving), the driver's ability to concentrate on driving is not obstructed by the consciousness of the input to change the playback speed. It is also possible to prohibit the change of the playback speed due to or to make it possible to change the playback speed only via a specific input interface (steering switch or voice input).

  In manual shift mode that allows manual setting of the driver, the driver can change the playback speed within the range that does not exceed the upper limit (or within the practical speed range between the basic value and the upper limit). In exceptional cases, the playback speed may be changed even outside the practical speed range. Also, considering the driving condition of the driver, for example, when the vehicle is moving (or when the vehicle is moving at a certain speed or higher), the playback speed is changed within the practical speed range that does not exceed the upper limit value. The manual transmission mode may be set so that the regeneration speed can be changed to a range exceeding the upper limit value when the vehicle is stopped (or when the vehicle is moving at a constant speed or less).

  If the driver can change the playback speed only within the practical speed range that does not exceed the upper limit, the playback speed will not exceed the upper limit no matter how much the driver increases the playback speed. . By adopting such a configuration, for example, even if a driving driver mistakenly performs an operation that excessively increases the playback speed, the playback speed does not exceed the upper limit value, and always Playback is performed within a playback speed range that can be heard (practical speed range). In addition, it is possible to avoid a situation in which the driver speeds up due to an increase in the reproduction speed due to an erroneous operation, and as a result, the concentration on driving decreases.

  On the other hand, in the manual shift mode in which the driver can change the reproduction speed to a range exceeding the upper limit value, the driver can set the reproduction speed exceeding the upper limit value by performing an operation input. The upper limit value is a value held in the system, and does not consider factors such as the speech speed of the conversation at that time or other disturbance (noise). Therefore, even if double speed playback is performed at a playback speed higher than the upper limit value, the driver may be able to hear easily, which is effective in such a case.

  In addition, each driver has a different ability to hear a double-speed playback conversation, and the playback speed at which each driver can be heard sufficiently is different. Due to this factor, there is a possibility that the driver has set the playback speed exceeding the upper limit. That is, there is a possibility that the driver's ability to hear the double-speed playback conversation can hear double-speed playback at a playback speed higher than the default initial value. It is desirable that such individual capabilities of the driver be reflected by increasing the upper limit value itself. Therefore, it is desirable to allow the driver to change the set upper limit value itself, or to change the upper limit value to reflect the driver's ability to hear double speed playback.

  The method of changing the upper limit value itself (the method of resetting the upper limit value) includes a method in which the driver directly changes the upper limit value, or a manual shift mode in which the driver can change the playback speed within the range exceeding the upper limit value. A method of changing the upper limit value by reflecting the playback speed set by the operation input of (a playback speed higher than the upper limit value), or a method of changing the upper limit value by some other test (referred to as an initial test here) can be considered. . Similarly, the basic value can be changed.

  First, an example of a method in which the driver directly changes the upper limit value or the basic value will be described. FIGS. 17 and 18 are flowcharts showing an example of a method in which the driver directly changes the upper limit value and the basic value in the fifth embodiment of the present invention.

  In FIG. 17, when the upper limit value changing operation is performed, first, the upper limit value (playback magnification) of the currently set playback speed is displayed on the GUI property (step S2101). The driver can increase / decrease (increment / decrement) the upper limit value displayed on the GUI property.

  When the driver inputs to lower the upper limit value on the GUI property (step S2102), the upper limit value is decremented (down) in accordance with this input (step S2103). When the upper limit value is smaller than the basic value (step S2104), the basic value is decremented so that the basic value is equal to or lower than the upper limit value (step S2105). Furthermore, if double-speed playback is being performed, if the current double-speed playback speed (current speed: magnification in double-speed playback during playback) is smaller than the basic value (step S2106). The current speed may be decremented so that the current speed is less than or equal to the upper limit value (step S2107). When the driver inputs to increase the upper limit value on the GUI property (step S2108), the upper limit value is incremented (up) in accordance with this input (step S2109).

  In FIG. 18, when the basic value changing operation is performed, first, the basic value (reproduction magnification) of the currently set reproduction speed is displayed on the GUI property (step S2201). The driver can increase / decrease (increment / decrement) the basic value displayed on the GUI property.

  When the driver inputs to lower the basic value on the GUI property (step S2202), the basic value is decremented (down) according to this input (step S2203). If the driver inputs to increase the basic value on the GUI property (step S2204), the basic value is incremented (up) in accordance with this input (step S2205). If the basic value is larger than the current speed during double speed playback (step S2206), the current speed is incremented so that the current speed is equal to or higher than the basic value. It is also possible (step S2207). If the basic value is larger than the upper limit value (step S2208), the upper limit value is incremented so that the upper limit value is equal to or higher than the basic value (step S2209).

  If the upper limit and basic value can be easily increased or decreased on the GUI property in this way, double-speed playback is performed at a playback speed that greatly exceeds the playback speed that can actually be heard, depending on the driver settings. There is a possibility that. Therefore, when the upper limit value or the basic value is increased or decreased on the GUI property, a warning may be notified once, and the upper limit value or the basic value may be changed on the user's responsibility.

  Next, an example of a method for changing the upper limit value reflecting the reproduction speed set by the operation input by the driver in the manual shift mode in which the driver himself can change the reproduction speed within a range exceeding the upper limit value will be described. . 19 and 20 are flowcharts showing an example of a method for changing each of the upper limit value and the basic value to reflect the reproduction speed set by the operation input by the driver in the fifth embodiment of the present invention. .

  In FIG. 19, when double speed playback is being performed and the driver inputs to lower the current speed using the steering switch (step S2301), the current speed is decremented (down) according to this input. (Step S2302). At this time, if the current speed is smaller than the basic value (step S2303), the basic value is decremented so that the current speed is equal to or higher than the basic value (step S2304). If the driver inputs using the steering switch to increase the current speed (step S2305), the current speed is incremented (up) in response to this input (step S2306). At this time, if the current speed is larger than the upper limit value (step S2307), the upper limit value is incremented so that the current speed is equal to or lower than the upper limit value (step S2308).

  It is also possible to change the playback speed during double-speed playback using voice input (input by voice recognition). In this case, in FIG. 20, when the voice input by the driver is recognized (step S2401) and the driver inputs to lower the current speed by voice input (step S2402), the current speed is decremented ( Down) (step S2403). At this time, if the current speed is smaller than the basic value (step S2404), the basic value is decremented so that the current speed is equal to or higher than the basic value (step S2405). In addition, when the driver inputs the voice speed to increase the current speed (step S2406), the current speed is incremented (increased) in response to the input (step S2407). At this time, if the current speed is larger than the upper limit value (step S2408), the upper limit value is incremented so that the current speed is equal to or lower than the upper limit value (step S2409).

  When the upper limit value and the basic value are changed to reflect the playback speed set by the operation input by the driver, for example, the upper limit value and the basic value are immediately set in steps S2304 and S2308 in FIG. 19 and steps S2405 and S2409 in FIG. The values may be changed, but by accumulating these results and identifying trends in the upper limit and basic values that are considered appropriate for the driver through learning operations, changes to appropriate upper limits and basic values can be made. You may go.

  Also, for example, the current speed change input itself performed in FIG. 19 and FIG. 20 is accumulated, and a playback speed change method that is considered appropriate for the driver (for example, when the playback speed is increased or decreased in stages) By specifying the number, the magnification at each stage, and the slope of fluctuation when moving up and down smoothly, etc.) by learning operation, the method of changing the playback speed when double speed playback is performed in the automatic transmission mode is suitable for the driver It becomes possible to.

  17 and 18, the upper limit value or basic value is changed by the driver using the GUI property. In FIGS. 19 and 20, the upper limit value or basic value is changed to reflect the change in the playback speed by the driver. However, the present invention is not limited to these input interfaces, and any input interface can be used in both methods. However, when driving safety is taken into consideration, it is desirable to provide a restriction such that setting by GUI property cannot be performed during driving.

  Next, an example of a method for changing the upper limit value and the basic value by the initial test will be described. FIG. 21 is a graph showing an example of the relationship between reproduction speed and time when performing an initial test in the fifth embodiment of the present invention. The initial test is a test for determining an appropriate upper limit value or basic value for each driver. For example, as shown in FIG. 21, in the initial test, double-speed playback of a conversation (sample) having a high playback speed is started, and the playback speed is gradually decreased so that the driver can hear the content of the conversation. The playback speed is determined as the upper limit value. In addition, for example, a test for determining the upper limit boundary by randomly changing the playback speed of sample double speed playback and measuring the playback speed that can be heard and the playback speed that cannot be heard. Various initial test methods can be adopted.

  The upper limit value and the basic value may be defined only by the reproduction speed (magnification), and in this case, the upper limit value and the basic value are respectively defined as values of the reproduction speed (magnification). On the other hand, as described above, in addition to the playback speed (magnification), it may be defined in consideration of the speech speed (sound pulse width). In this case, how much the upper limit value and the basic value are for a certain playback speed? It is defined by the relationship that the conversation at the speaking speed can be heard (or the relationship that it can be heard at any playback speed up to a certain speaking speed). If the average beat width (reciprocal of the speech speed) is large (if the conversation is slow), the driver can hear the content of the conversation even if double speed playback is performed at a high playback speed (magnification). Even if the upper limit value and the basic value are held by a relationship such as a graph or a table shown in FIG. 22 (a table for specifying the upper limit value or basic value of the average sound pulse width for each of several playback speed (magnification) stages). Good. In this way, when the upper limit value and the basic value are held in the relationship between the playback speed and the average sound pulse width, the upper limit value and the basic value in each of the flowcharts described above are the average sound pulse width that is being played at double speed at that time Held together. The double speed playback system may have both an upper limit value and a basic value defined only by the playback speed (magnification), and an upper limit value and a basic value that differ depending on the average sound duration. In this case, for example, an upper limit associated with the average pitch, such as not allowing double-speed playback exceeding a certain absolute upper limit even if double-speed playback can be performed at a high playback speed for a slow conversation. It is possible to control such that the value does not exceed the upper limit value (absolute upper limit value) defined only by the reproduction speed (magnification).

(Automatic shift mode)
Further, at the time of double speed reproduction, the reproduction speed may be automatically changed without operation by the driver. In this case, it is desirable that the playback speed of the double-speed playback be varied within the practical speed range, thereby realizing the double-speed playback at a playback speed that can be heard by the driver (and easy to hear). In addition, driving safety by the driver is also realized.

  As a method of automatic shifting by the double speed playback system, in addition to a method of changing the playback speed according to a predetermined changing method (for example, a method of changing as shown in FIG. 16 described above), A method for performing fluctuations in the playback speed suitable for the above can be considered.

  Hereinafter, an example of processing for changing to a playback speed suitable for the speech speed will be described with reference to FIG. FIG. 23 is a flowchart showing an example of processing for changing to a playback speed suitable for the speech speed in the fifth embodiment of the present invention.

  In FIG. 23, when the double speed reproduction in the automatic transmission mode is started (step S3001), the double speed reproduction system first acquires the currently set upper limit value (step S3002). Note that the upper limit value acquired at the start of double speed playback is the factory default value or the upper limit value that is set (directly set or reset according to fluctuations in playback speed) based on the driver's operation. . Further, when the double speed reproduction process proceeds and the upper limit value is changed as will be described later, the upper limit value acquired in step S3002 becomes the upper limit value temporarily stored in step S3005.

  In addition, with the start of double-speed playback, the double-speed playback system starts processing for analyzing the speech speed of the conversation included in the audio data to be played at double speed (step S3003). The analysis of the speech speed is performed, for example, by analyzing the number of sound beats included in the conversation in the latest playback section of the audio data to be reproduced (audio data stored in the reception cache 122). Specifically, for example, the number of sound beats included in a certain interval to be reproduced thereafter is counted by, for example, a look-ahead window function, and the speech speed of that interval (for example, expressed as an average sound beat width) Is calculated.

  Then, the double speed playback system determines whether or not the playback speed should be changed so that the playback speed is suitable for the speaking speed (step S3004). Specifically, for example, the upper limit value should be changed with reference to a graph or table that defines the relationship between the playback speed and the average sound duration (corresponding to the speech speed) as shown in FIG. A determination is made whether or not. If the graph or table shown in FIG. 22 represents the upper limit value and the average sound beat width at that time, the upper limit value to be set for the speech speed (average sound beat width) in a certain section can be easily set. Desired. For example, when the upper limit value to be set for the previous speech speed is different from the upper limit value to be set for the currently calculated speech speed, it is determined that the speech speed should be changed.

  If it is determined that the upper limit value should be changed, the upper limit value corresponding to the calculated speech speed is temporarily stored (step S3005), and an arbitrary speed within the practical speed range defined by the upper limit value is stored. The value is determined as the playback speed used for actual double speed playback (step S3006). Note that the upper limit value temporarily stored in step S3005 is the upper limit value acquired in the next step S3002. Further, the playback speed determined in step S3006 may be a value within the practical speed range, and the upper limit value may be simply set to the playback speed, or various factors (noise and double speed playback may be started). The playback speed may be determined on the basis of the elapsed time.

  For example, the above-described processing is sequentially performed at a predetermined time interval during double-speed reproduction, whereby the reproduction speed corresponding to the speech speed can be changed. When the double speed reproduction is finished, the reproduction speed determination process in the automatic transmission mode is also finished, and the upper limit value temporarily stored in step S3006 is also erased.

  In the process using the look-ahead window function shown in FIG. 23, the reproduction result is obtained from the upper limit value determined by the previous speech speed (step S3002) and the current speech speed calculation result (step S3003). Although it is determined whether or not to change the value, these values may be synchronized. However, if you try to synchronize these values, processing delay may occur and processing load (high processing capacity that can execute the synchronization algorithm) may occur. Also good. Further, the mode may be switched to the manual shift mode during the automatic shift mode, and conversely, the mode switch from the manual shift mode to the automatic shift mode may be performed.

  In consideration of the driving state of the driver, when the vehicle is in operation (for example, when the vehicle is moving), the interface operated in the manual shift mode is deleted from the GUI, and double speed reproduction is performed only in the automatic shift mode. It may be performed. In the manual shift mode during vehicle driving, only voice input using a steering switch or a voice recognition system that can be easily operated during vehicle driving may be used.

  In the third embodiment of the present invention described above, jingle notification is performed. However, jingles (for example, a jingle indicating a change in a load state or a jingle indicating the start of double-speed playback, etc.) are used for listening to playback sound by double-speed playback. ) Has become a hindrance, and the applicant has found through trial that there is a risk that the listening ability for double-speed playback and the concentration on driving may decrease. Therefore, it is desirable to perform control so that jingle notification is not performed during double-speed playback.

  Further, the technical idea according to the present invention is greatly different from the technique described in Patent Document 2 in the following points.

  With the technique described in Patent Document 2, the transmission of voice between the in-vehicle system and the other party's call terminal is stopped while the call is on hold.

  On the other hand, the technology according to the present invention merely stops the playback of the received voice (and received image) in the in-vehicle system, and continues with respect to transmission of the driver's utterance (transmitted voice) and playback from the other party's call terminal. To be done. That is, even when the driving state of the driver is in a high load state, a call from the driver to the other party is still possible. In this way, by making a call from the driver to the other party, for example, when the driver's driving situation is a high load state for a short time, the other party's driving situation is temporarily high. You will be able to continue talking without feeling the state. In addition, the other party can check the status of the driver in a high load state with the voice and image sent from the in-vehicle system, or the driver himself has been in a high load state. It is also possible to explain the situation to the other party.

  Further, in the technique described in Patent Document 2, when a call is put on hold during real-time communication, voice transmission between the in-vehicle system and the other party's call terminal is stopped.

  On the other hand, the technology according to the present invention merely stops the playback of the received voice (and received image) in the in-vehicle system, and continues with respect to transmission of the driver's utterance (transmitted voice) and playback from the other party's call terminal. To be done. That is, even when the driving state of the driver is in a high load state, a call from the driver to the other party is still possible. In this way, by making a call from the driver to the other party, for example, when the driver's driving situation is a high load state for a short time, the other party's driving situation is temporarily high. The call can be continued without being aware of the state. It is also possible to send a jingle indicating that the load is high to the call partner's call terminal, and to clearly indicate to the call partner that the driving status of the driver is high. In addition, the other party can check the status of the driver in a high load state with the voice and image sent from the in-vehicle system, or the driver himself is in a high load state. It is also possible to explain the situation to the other party.

  Also, in the technique described in Patent Document 2, the call terminal of the call partner records and accumulates a message while the call is on hold, receives an instruction when the call hold state is canceled, and accumulates according to the instruction It is necessary to send a message to the in-vehicle system. It is impossible for all existing call terminals to perform such control. That is, the technique described in Patent Document 2 needs to provide a function equivalent to that of the in-vehicle system or at least a function capable of the above control even in a call terminal used by a driver's call partner.

  On the other hand, the technology according to the present invention basically does not implement a special function for a call terminal used by a call partner, and the call partner can use a legacy call terminal. It can be said that it is very effective that the present invention is operable even for calls with many call terminals that are already widely used.

  In the technique described in Patent Document 2, when a call is performed by real-time communication and the call is put on hold, the call terminal of the call partner records and stores a message.

  On the other hand, in the technology according to the present invention, in a normal call, data received from the other party is temporarily stored in the reception cache, and the data stored in the reception cache is read out and reproduced and output. When the state becomes a high load state, the reproduction output processing of the data stored in the reception cache is temporarily stopped. Therefore, in the technique described in Patent Document 2, it is necessary to provide a special message recording function, but in the technique according to the present invention, it is not necessary to provide such a special message recording function, and the message is stored in the reception cache. It is only necessary to control the data reproduction output timing.

  In addition, when the technique described in Patent Document 2 is applied to a call by a large number of people, the call is put on hold when the driving status of a driver who is one caller is in a high load state, and a call ( (Conversation) is not possible.

  On the other hand, as described above, the present invention does not stop a call (conversation) between other parties even when the driving situation of the driver who is one party is in a high load state. It is possible to smoothly carry out a conversation of a large number of people without being affected by the driving situation of the driver.

  INDUSTRIAL APPLICABILITY The present invention has the effect of realizing both the driving safety of a driver and the convenience of calling by a driver in a call by a driver while driving a vehicle, and realizing a call by a driver while driving a vehicle. It can be applied to communication technology.

10, 20, 30, 35 In-vehicle system 100, 150, 180, 190 Communication processing device 110, 160, 195 Transmission processing device 111 Transmission voice processing unit 112 Transmission image processing unit 113 Cache for transmission 114 Transmission processing unit 120, 170, 185 Reception processing device 121 Reception processing unit 122 Cache for reception 123 Received audio processing unit 124 Received image processing unit 125 Audio reproduction output unit 126 Image reproduction output unit 127 Driving load quantification unit 128, 186 Driving high load state determination unit 161 Retransmission request unit 171 Retransmission request determination unit 187, 197 Jingle output unit 196 Silence detection unit 200 Communication module 300 Microphone 400 Camera 500 Speaker 600 Monitor 700 Operation state detection unit 800 PTT button 900 Center 901 Communication module 902 Data reception unit 903 Cache 904 Data transmission unit 905 Retransmission request reception unit 906 Holding period determination unit 940 Call line network 950, 1010, 1020 Call terminal 1231 Playback / stop control unit 1232 Double speed playback mechanism unit 1233 Automatic transmission control unit 1234 Sound pulse width Analysis unit 1235 Practical speed upper limit learning unit 1236 Upper limit determination unit 1237 Basic value determination unit 1238 Shift instruction unit 1239 Initial test execution unit 1240 Real time learning unit

Claims (31)

A communication processing device mounted on the vehicle for a driver driving the vehicle to make a call with a call partner,
An audio output unit that outputs the received audio from the other party to the driver via an audio output device so that the driver can listen;
Via a sound collector, a voice input unit for acquiring speech from the driver to the other party;
A reception cache that temporarily stores data including the received voice received by a wireless communication device that receives data including received voice from the other party to the driver;
An operation state quantification means for acquiring and quantifying a detection result by an operation state detection device that detects the operation state of the driver;
Based on the result of quantification by the driving state quantifying means, it is determined whether or not the driving state of the driver is a high load state where listening to the received voice should not be performed, and the driving state of the driver is a high load state. A driving high load state determination means for sending a reproduction interruption instruction for controlling to interrupt reproduction of data including the received voice in the case,
When the reproduction interruption instruction is received from the driving high load state determination unit, the reproduction processing of the data including the received voice stored in the reception cache is not performed, and the driving high load state determination unit When a reproduction interruption instruction has not been received, reproduction processing means for performing reproduction processing of data including the received voice stored in the reception cache;
Communication processing device having. Retransmission request determination means for determining whether to request retransmission of data including received voice from the other party to the driver;
When the retransmission request determination unit determines to request retransmission of data including the received voice, the retransmission requesting the communication apparatus storing the data including the received voice to retransmit the data including the received voice Request means,
The communication processing apparatus according to claim 1.   3. The communication device is a call terminal used by the call partner for a call or a device on a network having a function of storing data including the received voice transmitted from the driver to the call partner. The communication processing device according to 1.   A high-load state jingle that transmits a jingle indicating that playback is delayed to the call terminal of the other party when the driving state of the driver shifts from the low-load state where the received voice may be heard to the high-load state. The communication processing apparatus according to claim 1, further comprising a transmission unit.   When the driving state of the driver shifts from the low load state where the received voice may be heard to the high load state, a jingle indicating that playback is delayed is output to the voice output unit via the voice output device The communication processing apparatus according to claim 1, further comprising a high-load state jingle notifying unit.   When the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to the received voice, a jingle indicating that playback is resumed is sent to the call terminal of the other party. The communication processing apparatus according to claim 1, further comprising a low-load state jingle transmitting unit that transmits the information.   When the driving state of the driver shifts from the high load state to a low load state where the driving state of the driver may listen to received voice, a jingle indicating that playback is resumed is displayed in the audio output unit. The communication processing device according to any one of claims 1 to 6, further comprising a low-load state jingle notifying unit that outputs the output via an output device. Silence detection means for detecting that the uttered voice acquired by the voice input unit via the sound collection device is silent for a predetermined time;
The silent state jingle transmitting means for transmitting a jingle indicating a silent state detection to the call terminal of the other party when a silent state of the predetermined time or longer is detected by the silent detecting means. The communication processing device according to claim 1.   When the driver inputs the end of the utterance from the driver to the call partner through the operation input device, a jingle indicating the end of the utterance from the driver to the call partner is transmitted to the call terminal of the call partner. The communication processing apparatus according to claim 1, further comprising a transmission unit.   The driving state of the driver shifts from the high load state to a low load state in which the driving state of the driver may listen to the received voice, and the data including the received voice stored in the reception cache Claims: When the reproduction process is resumed, there is provided a time-short reproduction control means for reproducing the voiced voice period stored in the reception cache and performing the short-time reproduction for skipping or fast-forwarding the silent period of the received voice. Item 10. The communication processing device according to any one of Items 1 to 9.   The driving state of the driver shifts from the high load state to a low load state in which the driving state of the driver may listen to the received voice, and the data including the received voice stored in the reception cache 10. A short-time reproduction control means for performing short-time reproduction for reproducing the received voice stored in the reception cache at a speed higher than a speed at the time of utterance when the reproduction process is resumed. The communication processing device according to one.   The driving state of the driver shifts from the high load state to a low load state in which the driving state of the driver may listen to the received voice, and the data including the received voice stored in the reception cache When the reproduction process is resumed, based on an instruction input from the driver, the received voice stored in the received voice reception cache is skipped or fast-forwarded, or uttered, based on an instruction input from the driver The communication processing apparatus according to claim 1, further comprising a short-time reproduction control unit that performs short-time reproduction that reproduces at a speed higher than the speed of the first speed.   The short-time playback control unit is configured to return the playback processing of data including the received voice stored in the reception cache to a normal playback state when the short-time playback catches up with a current time. The communication processing device according to any one of 10 to 12.   The communication processing apparatus according to any one of claims 1 to 13, wherein the reception cache is configured to continuously hold data including the received voice that has been reproduced by the reproduction processing unit.   The driving state of the driver shifts from the high load state to a low load state in which the driving state of the driver may listen to the received voice, and the data including the received voice stored in the reception cache 15. The delay time difference notifying means for notifying a delay time difference between a current time and a time at which the playback should have been performed in a state where the playback is not interrupted due to the high load state when the playback process is resumed. The communication processing apparatus according to one.   The communication processing apparatus according to claim 1, further comprising: a voice quality improvement unit that improves a voice quality related to data including the received voice stored in the reception cache.   17. The driving state transmitting unit according to claim 1, further comprising: a driving state transmitting unit configured to transmit a determination result as to whether or not the driving state of the driver determined by the driving high load state determining unit is a high load state to the calling terminal of the communication partner. The communication processing device according to claim 1.   The communication processing device according to any one of claims 1 to 17, wherein the communication processing device is configured to perform multi-person simultaneous communication with a plurality of the other parties.   The communication processing apparatus according to any one of claims 1 to 18, wherein the call is performed by transmitting both voice and an image.   The communication processing device according to claim 14, wherein the reproduction processing unit is configured to reproduce again the data including the received voice that is continuously held in the reception cache.   In short-time playback for playback at a speed faster than the speed at the time of speaking, an upper limit value for determining a maximum speed is set, and the short-time playback control means is configured to perform playback at a speed equal to or lower than the upper limit value. The communication processing device according to claim 11 or 12.   The communication processing device according to claim 21, wherein a basic value equal to or less than the upper limit value is set, and the short-time reproduction control unit is configured to start the short-time reproduction using the basic value as an initial speed.   The communication processing apparatus according to claim 21, further comprising upper limit value changing means capable of changing the upper limit value.   24. The communication processing apparatus according to claim 23, further comprising an input interface capable of performing an operation input by the driver, wherein the upper limit value changing unit is configured to change the upper limit value according to an operation input from the input interface. An input interface operable by the driver;
A playback speed changing means capable of changing the current speed of playback in the short-time playback,
And changing the current speed in accordance with an operation input from the input interface, and when the current speed is changed to a value exceeding the upper limit value, the upper limit value changing means exceeds the upper limit value. The communication processing device according to claim 23, wherein the upper limit value is changed so that the changed value of the current speed is reflected in the upper limit value.   Test execution means for performing an upper limit determination test for determining the upper limit value suitable for each of the drivers, and the upper limit value changing means is configured to determine the upper limit value based on a test result by the test execution means. The communication processing device according to claim 23, wherein the communication processing device is configured to make a change.   The communication processing apparatus according to claim 21, further comprising a reproduction speed changing unit capable of changing a current speed of reproduction in the short-time reproduction.   27. The communication processing apparatus according to claim 26, further comprising an input interface capable of performing an operation input by the driver, wherein the reproduction speed changing unit is configured to change the current speed in accordance with an operation input from the input interface. Having a speech speed calculating means for calculating a speech speed of a conversation included in the received voice;
In the short-time playback for playback at a speed faster than the speed at the time of the utterance, the short-time playback control means automatically changes the current speed based on the speech speed of the conversation calculated by the speech speed calculation means. The communication processing device according to claim 11 or 12, configured as described above.   An upper limit value that determines the maximum speed in the short-time playback is set, and the short-time playback control means automatically sets the current speed of playback in the short-time playback based on the upper limit value in addition to the speaking speed of the conversation. 30. The communication processing device according to claim 29, wherein the communication processing device is configured to be changed.   The communication processing device according to any one of claims 21 to 30, wherein the upper limit value is set in accordance with a speech speed of a conversation included in speech.

Images