JP2020150550A - Audio reproduction apparatus and vehicle - Google Patents

Abstract

To provide a communication system capable of safely transmitting and receiving outgoing content such as content desired to tweet even when a user has difficulty in operating or visually recognizing a terminal device, and provide the terminal device.SOLUTION: A communication system includes a plurality of terminal devices capable of communicating with each other. Each terminal device includes voice input conversion means, voice transmission means, voice reception means, and voice reproduction means. When there are a plurality of voice signals reproduction of which is not completed, the voice reproduction means arranges voices so that the voices corresponding to the voice signals do not overlap and performs reproduction.SELECTED DRAWING: Figure 10C

Description

Cross-reference of related applications

This international application is filed with Japanese Patent Application No. 2011-273578 and Japanese Patent Application No. 2011-273579 filed with the Japanese Patent Office on December 14, 2011, and Japan on March 28, 2012. It claims priority based on Japanese Patent Application No. 2012-074627 and Japanese Patent Application 2012-0746228 filed with the National Patent Office, and Japanese Patent Application Nos. 2011-273578 and 2011-. The entire contents of Nos. 273579, 2012-0746227, and 2012-0746228 are incorporated herein by reference.

The present invention relates to a communication system including a plurality of terminal devices and a terminal device.

A system is known in which a large number of users use a terminal device such as a mobile phone to input transmission contents such as the content to be tweeted in characters, and the server distributes the transmission contents to each terminal device in order. (See, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2011-215861

It is preferable that even a user who has difficulty in operating or visually recognizing the terminal device can safely send and receive the transmitted contents such as the contents to be tweeted.

One aspect of the present invention is
A communication system equipped with a plurality of terminal devices capable of communicating with each other.
Each terminal device
A voice input conversion means that converts the voice into a voice signal when the user inputs the voice,
A voice transmission means for transmitting the voice signal to a device including another terminal device,
A voice receiving means for receiving a voice signal transmitted by another terminal device, and
Audio reproduction means for reproducing the received audio signal,
With
When there are a plurality of audio signals whose reproduction has not been completed, the audio reproduction means arranges the audio signals corresponding to the respective audio signals so that they do not overlap, and then reproduces the audio signals.

In addition, another aspect of the present invention is
A communication system including a plurality of terminal devices and a server device capable of communicating with each of the plurality of terminal devices.
Each terminal device
A voice input conversion means that converts the voice into a voice signal when the user inputs the voice,
A voice transmission means for transmitting the voice signal to the server device, and
A voice receiving means for receiving a voice signal transmitted by the server device, and
Audio reproduction means for reproducing the received audio signal,
With
The server device
It is provided with a distribution means that receives voice signals transmitted from the plurality of terminal devices, arranges the voices corresponding to the voice signals so as not to overlap, and then distributes the voice signals to the plurality of terminal devices. ..

According to a communication system such as these, it is possible to input the transmission content by voice and reproduce the transmission content from another communication device by voice, so that even a user who has difficulty in operating or visually recognizing the terminal device can use it. It is possible to safely send and receive outgoing content such as the content you want to tweet.

Further, in a communication system such as these, when the voice is reproduced, the voice can be reproduced so as not to be duplicated, so that the voice can be easily heard.
Further, in any of the above communication systems, the voice reproduction means may re-play the already reproduced voice signal when receiving a specific command from the user. In particular, the audio signal reproduced immediately before may be reproduced.

According to such a communication system, an audio signal that cannot be heard due to noise or the like can be reproduced again according to a user command.
Further, in any of the above communication systems, the terminal device may be mounted on the vehicle, and the terminal device includes motion detecting means for detecting the movement of the user's hand on the handle of the vehicle and voice by the motion detecting means. Start input Start When a specific action is detected, the voice input conversion means starts the operation, and the motion detection means ends the voice input. End When a specific action is detected, the voice input conversion means ends the operation. The operation control means for causing the operation may be provided.

According to such a communication system, an operation for inputting voice can be performed on the steering wheel. Therefore, the user who is driving the vehicle can input the voice more safely.
Further, in any of the above communication systems, the start specific operation and the end specific operation may be movements of the hand in a direction different from the operation direction when operating the horn.

According to such a communication system, it is possible to suppress the sounding of the horn during the start specific operation or the end specific operation.
Next, the terminal device may be configured as a terminal device constituting any of the above communication systems.

According to such a terminal device, the same effect as that of any of the above communication systems can be enjoyed.
In the above communication system (terminal device), the voice transmission means generates a new voice signal in which identification information for identifying the user is added by voice to the voice signal input by the user, and the generation is performed. The voice signal may be transmitted.

Further, in a communication system including a plurality of terminal devices and a server device capable of communicating with each of the plurality of terminal devices, the distribution means uses identification information for identifying the user in a voice signal input by the user. A new voice signal to which is added by voice may be generated, and the generated voice signal may be distributed.

According to a communication system such as these, it is possible to input the transmission content by voice and reproduce the transmission content from another communication device by voice, so that even a user who has difficulty in operating or visually recognizing the terminal device can use it. It is possible to safely send and receive outgoing content such as the content you want to tweet.

Further, in a communication system such as these, identification information for identifying a user can be added by voice, so that the user notifies another user of the user of the voice originator without speaking his / her own identification information. can do.

Further, in any of the above communication systems, the identification information to be added may be the real name of the user or a nickname other than the real name. Further, the content to be added as the identification information (for example, the real name, the first nickname, the second nickname, etc.) may be changed according to the communication mode. For example, information for identifying themselves may be exchanged in advance, and the identification information to be added may be changed depending on whether or not the communication partner is a pre-registered partner.

Further, in any of the above communication systems, a keyword extraction means for extracting a preset keyword included in the voice signal from the voice signal and another word for the keyword included in the voice signal before reproducing the voice signal. A voice replacement means for replacing the voice or a preset sound may be provided.

According to such a communication system, words that are not preferable for distribution (obscene words, words indicating personal names, barbaric words, etc.) are registered as keywords and replaced with words or sounds that may be distributed. Can be delivered.

Note that, for example, the voice replacement means may or may not be activated depending on the conditions of the communication partner and the like. In addition, for words that have no meaning peculiar to spoken words, such as "ah" and "um", an audio signal may be generated by omitting these words. In this case, the reproduction time of the audio signal can be shortened by the amount omitted.

Further, in any of the above communication systems, each terminal device acquires its own position information and transmits the position information to another terminal device in association with a voice signal transmitted from its own terminal device. Depending on the positional relationship between the position information transmitting means, the position information acquiring means for acquiring the position information transmitted by another terminal device, the position of the terminal device corresponding to the reproduced voice, and the position of the own terminal device. Further, it may be provided with a volume control means for controlling the volume output when the voice is reproduced by the voice reproduction means.

According to such a communication system, the volume is controlled according to the positional relationship between the position of the terminal device corresponding to the reproduced voice and the position of the own terminal device, so that the user listening to the voice can use another terminal device. It is possible to intuitively grasp the positional relationship between the device and its own terminal device.

Note that the volume control means may be controlled so that the volume decreases as the distance to another terminal device increases, and when sound is output from a plurality of speakers, other volume control means may be used with respect to the position of its own terminal device. Depending on the orientation in which the terminal device is located, the volume may be controlled so that the volume from the direction in which the other terminal device is located becomes louder from the user's point of view. Moreover, such control may be combined.

Further, the communication system may include character conversion means for converting an audio signal into characters and character output means for outputting the converted characters to a display device.
According to such a communication system, it is possible to confirm the information missed by voice in characters.

In any of the above communication systems, information indicating the state of the vehicle and the driving operation of the user (operating state of lights, wipers, televisions, radios, etc., running speed, running state such as traveling direction, detection value by the vehicle sensor) (Control status such as presence / absence of failure) may be transmitted together with the voice.

At this time, these information may be output by voice or by characters. Further, for example, various information such as traffic jam information may be generated based on information obtained from another terminal device, and the generated information may be output.

In any of the above communication systems, preset conditions (a configuration in which each terminal device directly exchanges voice signals and a configuration in which each terminal device exchanges voice signals via a server device are set. For example, switching may be performed depending on the distance to the base station connected to the server device, the communication state between the terminal devices, the setting by the user, or the like).

Further, the advertisement may be played by voice every fixed time, every fixed number of voice signal reproductions, or according to the position of the terminal device. The content of the advertisement may be transmitted from the advertiser's terminal device, server device, or the like to the terminal device that reproduces the audio signal.

At this time, even if the user can make a call (communication) with the advertiser by inputting a predetermined operation to the terminal device, or guide the user of the terminal device to the advertiser's store. Good.

Further, in any of the above communication systems, the communication partner may be an unspecified number of communication partners, or the communication partner may be limited.
For example, in the case of a configuration in which position information is exchanged, a terminal device within a certain distance may be used as a communication partner, or a specific user (preceding vehicle, oncoming vehicle, etc. (number plate imaging using a camera, specified by GPS)). ), Users in a preset group may be the communication partner. Further, the communication partner may be changed by the setting (the communication mode may be changed).

In addition, when the terminal device is mounted on the vehicle, the terminal device moving in the same direction on the same road is used as the communication partner, or the terminal device having the same behavior of the vehicle (when it deviates to a side road). May be the communication partner (such as removing from the communication partner).

In addition, other users may be specified and configured so that favorite registration, exclusion registration, and the like can be set in advance so that a favorite partner can be selected and communicated. In this case, when transmitting voice, the communication partner information that identifies the communication partner is transmitted, or if the server device exists, the communication partner information is registered in the server device to specify the communication partner. It suffices to be able to transmit an audio signal only to the server.

Further, if a direction is associated with each switch such as a plurality of buttons and the user specifies the direction in which the communication partner is present with this switch, only the user in that direction may be set as the communication partner.

Furthermore, the emotions and polite way of speaking when the user inputs voice are judged by detecting the amplitude of the input level and the polite expression contained in the voice from the voice signal, and the emotions are high. , It is possible not to deliver the voice by the user who does not speak politely.

In addition, a user who speaks badly about a person or a user who has high emotions or does not speak politely may be notified of a false word or the like. In this case, the determination may be made based on whether or not a word registered as a keyword as a bad word is included in the audio signal.

Further, in any of the above communication systems, the voice signal is exchanged, but the information composed of characters may be acquired, and this information may be converted into voice and reproduced. Also,
When transmitting the voice, the voice may be converted into characters and then transmitted, and the voice may be restored and then played back. In this configuration, the amount of data to be transmitted by communication can be reduced.

Further, in the configuration in which data is transmitted by characters in this way, the data may be transmitted after being translated into the language having the smallest amount of data among the plurality of preset languages.

By the way, in recent years, the number of users of services such as Twitter (registered trademark) and Facebook (registered trademark) that manage information transmitted by a user so that other users can view it is rapidly increasing. In such services, terminal devices such as personal computers and mobile phones (including so-called smartphones) are used for transmitting and viewing information (Japanese Patent Laid-Open No. 2011-215861).

On the other hand, a user (for example, a driver of a vehicle) who is in a vehicle (for example, a car) often has time to spare because his / her behavior is restricted as compared with a state in which he / she is not in the vehicle. Therefore, if the service as described above is used while the vehicle is on board, the time can be effectively utilized. However, it cannot be said that the conventional service fully considers the usage mode by the user who got on the vehicle.

Therefore, it is required to provide a technique for constructing a service useful for a user who gets on a vehicle.
As a technique for this purpose, the terminal device of the first reference invention uses an input means for inputting voice, an acquisition means for acquiring position information, and voice information representing the voice input by the input means of the voice. A transmission means for transmitting to a server shared by a plurality of the terminal devices in a form in which a voice position, which is position information acquired by the acquisition means at the time of input, can be specified, and transmission from the other terminal devices to the server. A reproduction means for receiving the voice information from the server and reproducing the voice represented by the voice information is provided, and the reproduction means is among the voice information transmitted from the other terminal device to the server. The voice represented by the voice information located in the peripheral area whose voice position is set based on the position information acquired by the acquisition means is reproduced.

Voices made by a user at a location are often useful to other users who are (or are heading for) that location. In particular, the position of the user who is in the vehicle can change significantly with the passage of time (running of the vehicle) as compared with the user who is not in the vehicle. Therefore, for the user who gets on the vehicle, the voice of another user emitted in the surrounding area based on the current location can be useful information.

In this regard, according to the above-described configuration, the user of a certain terminal device A has a peripheral area set based on the current location of the terminal device A among the voices emitted by the user of the other terminal device B (another vehicle). You can hear the voice emitted inside. Therefore, according to such a terminal device, useful information can be provided to a user who has boarded the vehicle.

Further, in the terminal device described above, the peripheral area may be an area having a bias toward the traveling direction with respect to the position information acquired by the acquisition means. According to this configuration, it is possible to reduce the sound emitted at the place where it has already passed from the reproduction target and increase the sound emitted at the place where it is going from now on. Therefore, according to such a terminal device, the usefulness of the information can be enhanced.

Further, in the terminal device described above, the peripheral area may be an area along the planned travel route. According to this configuration, it is possible to exclude the sound emitted from the area other than the area along the planned progress route from the reproduction target. Therefore, according to such a terminal device, the usefulness of the information can be enhanced.

Further, the terminal device of the second reference invention has a detection means for detecting the occurrence of a specific event related to the vehicle, and the specific event when the detection means detects that the specific event has occurred. Transmission means for transmitting voice information representing voice corresponding to an event to another terminal device or a server shared by a plurality of the terminal devices, and the voice information from the other terminal device or the server. A reproduction means for receiving and reproducing the sound represented by the voice information is provided.

According to this configuration, the user of one terminal device A can hear the sound corresponding to a specific event related to the vehicle transmitted from the other terminal device B (another vehicle). Therefore, the user of the terminal device can grasp the state of another vehicle while driving.

Further, in the terminal device described above, the detection means detects that a specific driving operation has been performed by the user of the vehicle as the specific event, and the transmitting means uses the detecting means to detect the specific driving operation. When is detected, the voice information representing the voice of the content notifying that the specific driving operation has been performed may be transmitted. According to this configuration, the user of the terminal device can grasp while driving that a specific driving operation has been performed in another vehicle.

Further, in the terminal device described above, the detecting means detects a sudden braking operation, and the transmitting means notifies that the sudden braking operation has been performed when the sudden braking operation is detected by the detecting means. The audio information representing the audio of the content may be transmitted. According to this configuration, the user of the terminal device can grasp while driving that the sudden braking operation has been performed in another vehicle. Therefore, it is possible to realize safe driving as compared with the case where the state of another vehicle is confirmed only by visual inspection.

It is a block diagram which shows the schematic structure of the communication system. It is a block diagram which shows the schematic structure of the device mounted on a vehicle. It is explanatory drawing which shows the structure of the input part. It is a block diagram which shows the schematic structure of a server. It is a flowchart which shows a part of voice transmission processing. It is a flowchart which shows the rest of the voice transmission processing. It is a flowchart which shows the classification process. It is a flowchart which shows operation voice determination processing. It is a flowchart which shows the state voice determination process. It is a flowchart which shows the authentication process. It is a flowchart which shows a part of voice distribution processing. It is a flowchart which shows another part of the audio distribution processing. It is a flowchart which shows the rest of the audio distribution processing. It is a flowchart which shows a part of audio reproduction processing. It is a flowchart which shows the rest of the audio reproduction processing. It is a flowchart which shows the speaker setting process. It is a flowchart which shows the mode transition process. It is a flowchart which shows the replay processing. It is a flowchart which shows the accumulation process. It is a flowchart which shows the request processing. It is a flowchart which shows a part of response processing. It is a flowchart which shows the rest of the response processing. It is a figure which shows the peripheral area set within a predetermined distance from the own vehicle position. It is a figure which shows the peripheral area set within a predetermined distance from a reference position. It is a figure which shows the peripheral area set along the planned travel route. It is a flowchart which shows a part of the response processing of a modification. It is a flowchart which shows the remaining part of the response processing of a modification. It is a flowchart which shows a part of the audio reproduction processing of a modification. It is a flowchart which shows another part of the audio reproduction processing of a modification. It is a flowchart which shows still another part of the audio reproduction processing of a modification. It is a flowchart which shows the remaining part of the audio reproduction processing of a modification. It is a flowchart which shows the doze determination process. It is a flowchart which shows the additional information display processing.

Hereinafter, embodiments according to the present invention will be described with reference to the drawings.
[Structure of the present embodiment]
FIG. 1 is a block diagram showing a schematic configuration of a communication system 1 to which the present invention is applied, and FIG. 2 is a block diagram showing a schematic configuration of an apparatus mounted on a vehicle. Further, FIG. 3A-3C is an explanatory diagram showing the configuration of the input unit 45. Further, FIG. 4 is a block diagram showing a schematic configuration of the server 10.

The communication system 1 is a system having a function that allows users of the terminal devices 31 to 33 to communicate with each other by voice with a simple operation. The user referred to here is a vehicle occupant (for example, a driver). As shown in FIG. 1, the communication system 1 includes a plurality of terminal devices 31 to 33 capable of communicating with each other, and a server 10 capable of communicating with each of these terminal devices 31 to 33 via base stations 20 and 21. It has. That is, the server 10 is shared by a plurality of terminal devices 31 to 33. In this embodiment, three terminal devices 31 to 33 are shown for convenience of explanation, but more terminal devices may be used.

The terminal devices 31 to 33 are configured as in-vehicle devices mounted on vehicles such as passenger cars and trucks, and are configured as well-known microcomputers including a CPU 41, a ROM 42, a RAM 43, and the like, as shown in FIG. .. The CPU 41 performs various processes such as a voice transmission process and a voice reproduction process, which will be described later, based on a program stored in the ROM 42 or the like.

In addition, the terminal devices 31 to 33 also include a communication unit 44 and an input unit 45. The communication unit 44 has a function of communicating with base stations 20 and 21 configured as wireless base stations of mobile phones (communication for communicating with a server 10 and other terminal devices 31 to 33 via a mobile phone network). (Part) and a function to directly communicate with other terminal devices 31 to 33 (terminal devices 31 to 33 mounted on other vehicles such as preceding vehicles, rear vehicles, and oncoming vehicles) located within their own line-of-sight range (section). (Communication unit) for direct communication with other terminal devices 31 to 33).

The input unit 45 is configured as a button, a switch, or the like for each user of the terminal devices 31 to 33 to input a command. The input unit 45 also has a function for reading the biological characteristics of the user.

Further, as shown in FIG. 3A, the input unit 45 is also configured as a plurality of touch panels 61 and 62 on the user side surface of the steering wheel 60 of the vehicle. The touch panels 61 and 62 are arranged around the horn switch 63 and at positions that are not touched when the steering wheel is operated when the vehicle is turning. Such touch panels 61 and 62 detect the movement of the user's hand (finger) on the steering wheel 60 of the vehicle.

Further, as shown in FIG. 2, the terminal devices 31 to 33 include a navigation device 48, an audio device 50, an ABSECU 51, a microphone 52, a speaker 53, a brake sensor 54, a passing sensor 55, a winker sensor 56, and a lower surface provided in the vehicle. It is connected to a sensor 57, a crosswind sensor 58, a collision / tipping sensor 59, and a plurality of other well-known sensors via a communication line (for example, an in-vehicle LAN).

Similar to a well-known navigation device, the navigation device 48 includes a current location detection unit that detects the current location of the vehicle and a display that displays an image. The navigation device 48 executes a well-known navigation process based on information such as the position coordinates (current location) of the vehicle detected by the GPS receiver 49. Further, when the terminal device 31 to 33 requests the current location, the navigation device 48 returns the latest current location information to the terminal devices 31 to 33. Further, when the navigation device 48 receives a command from the terminal devices 31 to 33 to display the character information, the navigation device 48 causes the display to display the character corresponding to the character information.

The audio device 50 is a well-known audio reproduction device that reproduces music and the like. The music or the like reproduced by the audio device 50 is output from the speaker 53.
The ABS ECU 51 is an electronic control unit (ECU) that controls the anti-lock braking system (ABS). The ABSECU 51 suppresses the lock of the brake by controlling the braking force (brake oil pressure) so that the slip ratio of the wheels is within a preset range (slip ratio that can brake the vehicle safely and quickly). That is, the ABSECU 51 functions as a brake lock suppressing device. Further, the ABS ECU 51 outputs a notification signal to the terminal devices 31 to 33 when the ABS is activated (when the control of the braking force is started).

The microphone 52 inputs the voice emitted by the user.
The speaker 53 is configured as a 5.1ch surround system including, for example, five speakers and a subwoofer. Each of these speakers is arranged so as to surround the user.

The brake sensor 54 detects as a sudden braking operation when the depression speed of the brake pedal by the user is equal to or higher than the determination reference value. The determination of the sudden braking operation is not limited to this, and may be determined based on, for example, the amount of depression of the brake pedal, or may be determined based on the acceleration (deceleration) of the vehicle.

The passing sensor 55 detects a passing operation (an operation of temporarily changing the headlight from a low beam to a high beam) by the user.
The winker sensor 56 detects a winker operation (an operation of blinking either the left or right winker) by the user.

The bottom surface sensor 57 detects a state in which a step on the road surface and the bottom surface of the vehicle are in contact with each other or a state in which there is a high risk of contact with the vehicle surface. In the present embodiment, a detection member that easily deforms or displaces when it comes into contact with an external object (such as a step on the road surface) and returns to the original (before deformation or before displacement) state when released from the contact state. Is provided on the lower surface of the front and rear bumpers (the lowest part on the lower surface of the vehicle excluding the wheel portion). Then, the bottom surface sensor 57 detects a state in which a step on the road surface and the bottom surface of the vehicle are in contact with each other or a state in which there is a high risk of contact by detecting the deformation or displacement of the detection member. A sensor that detects a state in which a step on the road surface and the lower surface of the vehicle are in contact with each other or a state in which there is a high risk of contact with an external object may be used.

The crosswind sensor 58 detects a strong crosswind to the vehicle (for example, a crosswind whose wind pressure is equal to or higher than the determination reference value). The crosswind sensor 58 may be a sensor for detecting wind pressure or a sensor for detecting air volume.

The collision / fall sensor 59 detects a state in which the vehicle has a high possibility of having an accident, such as a state in which the vehicle collides with an external object (including another vehicle) or a state in which the vehicle has fallen. The collision / fall sensor 59 can be configured as a sensor that detects that a strong impact (acceleration) has occurred in the vehicle. It should be noted that the collided state and the fallen state may be detected independently. For example, it may be determined whether or not the vehicle is in a fallen state according to the degree of inclination of the vehicle (vehicle body). It may also include other conditions in which the vehicle is likely to have an accident (eg, the airbag is open).

As shown in FIG. 4, the server 10 has a hardware configuration as a well-known server including a CPU 11, a ROM 12, a RAM 13, a database (storage device) 14, a communication unit 15, and the like. The server 10 performs various processes such as audio distribution processing described later.

Further, in the database 14 of the server 10, a name / nickname DB in which the names of the users of the terminal devices 31 to 33 and the nicknames of these users are associated with each other, an ID of the terminal devices 31 to 33, and a communication partner are described. It includes a communication partner DB, a prohibited word DB in which prohibited words are registered, an advertisement DB in which the ID of the advertiser's terminal device and the range in which the advertisement is performed are described. The user can use the service of this system by registering the name, nickname, communication partner, etc. in the server 10.

[Processing of this embodiment]
The processing performed in such a communication system 1 will be described with reference to the drawings of FIGS. 5A and 5B and below. 5A and 5B are flowcharts showing a voice transmission process executed by the CPU 41 of the terminal devices 31 to 33.

The voice transmission process is a process that is started when the power of the terminal devices 31 to 33 is turned on and then repeatedly executed. Further, the voice transmission process is a process of transmitting voice information or the like representing a voice emitted by a user to another device (server 10, other terminal devices 31 to 33, etc.). In the following description, voice information for transmission to another device is also referred to as "transmission voice information".

More specifically, as shown in FIGS. 5A and 5B, first, it is determined whether or not there is an input operation via the input unit 45 (S101). Here, as the input operation, there are a normal input operation and an emergency input operation, and they are registered in a memory such as a ROM of their own as different input operations.

As a normal input operation, for example, as shown in FIG. 3B, the movement of the hand sliding in the radial direction of the handle 60 is registered on the touch panels 61 and 62, and as an emergency input operation, for example, it is shown in FIG. 3C. As described above, the movement of the hand sliding in the circumferential direction of the handle 60 is registered on the touch panels 61 and 62. In this process, it is determined whether or not any of these operations is input via the touch panels 61 and 62.

It is preferable that the input operation is set to operate in a direction different from the operating direction (pushing direction) of the horn switch 63 because the malfunction of the horn can be suppressed.

If there is no input operation (S101: NO), the process proceeds to S110, which will be described later. Further, if there is an input operation (S101: YES), recording of the voice (voice to be transmitted voice information) emitted by the user is started (S102).

Then, it is determined whether or not there is an end operation via the input unit 45 (S103). The end operation is registered in advance in a memory such as a ROM like the input operation. This end operation may be the same operation as the input operation, or may be a different operation.

If there is no end operation (S103: NO), it is determined whether or not a preset reference time (for example, 20 seconds) has elapsed after the input operation (S104). Here, the reference time is provided to prohibit long-term voice input, and is it the same when communicating with a specific communication partner as compared with the case of communicating with an unspecified communication partner? A longer reference time is set. Further, the reference time may be set to an infinite time.

If the reference time has not elapsed (S104: NO), the process returns to the process of S102. If the reference time has elapsed (S104: YES) or if the end operation has been performed in the process of S103 (S103: YES), the recording is ended and the input operation is an emergency operation input. It is determined whether or not there is (S105). If it is an emergency operation input (S105: YES), an emergency information flag indicating that it is emergency voice information is added (S106), and the process proceeds to S107.

If it is not an emergency operation input (S105: NO), the process immediately proceeds to S107. Subsequently, the recorded voice (real voice) is converted into a synthetic voice (machine sound) (S107). Specifically, first, the recorded voice is converted into text (character data) by using a well-known voice recognition technology. Next, the text obtained by the conversion is converted into synthetic speech using a well-known speech synthesis technique. In this way, the recorded voice is converted into synthetic voice.

Subsequently, it is set to add the operation content information to the transmitted voice information (S108). Here, the operation content information refers to information indicating the state of the vehicle and the driving operation of the user (operation state such as winker operation, passing operation, sudden braking operation, operating state of lights, wipers, televisions, radios, etc., running speed, acceleration. , Driving state such as traveling direction, control state such as detection value by various sensors and presence / absence of failure). This information is acquired via a communication line in the vehicle (for example, an in-vehicle LAN).

Subsequently, the transmitted voice information is classified into one of a plurality of predetermined types (genres), and a classification process for setting to add the classification information representing the classified types to the transmitted voice information is executed (S109). .. Such classification is used, for example, when the server 10 or the terminal devices 31 to 33 extract (search) necessary voice information from a large amount of voice information. The transmission voice information may be classified manually by the user or automatically. For example, a selection item (a plurality of predetermined types) may be displayed on the display and the user may select the selection item. Further, for example, the content of the statement may be analyzed and classified into types according to the content. Further, for example, it may be classified into types according to the situation at the time of speaking (vehicle condition, driving operation, etc.).

FIG. 6 is a flowchart showing an example of the classification process in the case of automatically classifying the transmitted voice information. First, it is determined whether or not a specific driving operation was performed at the time of speaking (S201). In this example, the passing operation detected by the passing sensor 55 and the sudden braking operation detected by the brake sensor 54 correspond to the specific driving operation referred to here. Further, in this example, the voice information is classified into three types of "normal", "caution" and "warning".

When it is determined that a specific driving operation is not performed at the time of speaking (S201: NO), the transmitted voice information is classified into "normal" and the classification information representing "normal" is added to the transmitted voice information. (S202).

On the other hand, when it is determined that the passing operation was performed at the time of speaking (S201: YES, S203: YES), the transmitted voice information is classified into "Caution", and the classification information indicating "Caution" is added to the transmitted voice information. (S204). If it is determined that the sudden braking operation was performed at the time of speaking (S203: NO, S205: YES), the transmitted voice information is classified into "warning", and the classification information representing "warning" is used as the transmitted voice information. Set to add (S206).

After such a classification process, the process proceeds to S114 (FIG. 5B) described later. If it is determined in S205 that the sudden braking operation has not been performed at the time of speaking (S205: NO), the process returns to S101 (FIG. 5A).

By the way, in this example, the transmitted voice information is classified into one type, but the present invention is not limited to this, and two or more types are assigned to one transmitted voice information such as tag information. You may be able to do it.

Returning to FIG. 5A, when it is determined in S101 described above that there is no input operation (S101: NO), it is determined whether or not a specific driving operation has been performed (S110). The specific driving operation referred to here is an operation as a trigger for transmitting voice not uttered by the user as transmitted voice information, and may be different from the specific driving operation determined in S201 described above. .. When it is determined that a specific driving operation has been performed (S110: YES), an operation voice determination process for determining the transmitted voice information according to the driving operation is executed (S111).

FIG. 7 is a flowchart showing an example of the operation voice determination process. In this example, the winker operation detected by the winker sensor 56, the passing operation detected by the passing sensor 55, and the sudden braking operation detected by the brake sensor 54 correspond to the specific driving operation referred to in S110.

First, it is determined whether or not the winker operation is detected as the specific driving operation referred to in S110 (S301). When it is determined that the winker operation has been detected (S301: YES), the voice of the content notifying that the winker operation has been performed (for example, "the winker operation has been performed", "move to the left (right)". Set voices such as "Masu" and "Please be careful") as the transmitted voice information (S302).

On the other hand, when it is determined that the winker operation is not detected (S301: NO), it is determined whether or not the passing operation is detected as the specific operation operation referred to in S110 (S303). If it is determined that a passing operation has been detected (S303: YES), a voice that notifies that the passing operation has been performed (for example, "passing operation has been performed", "be careful", etc. Voice) is set as the transmission voice information (S304).

Then, in both the case where the winker operation is detected (S301: YES) and the case where the passing operation is detected (S303: YES), the transmitted voice information is classified into "Caution", and the classification information indicating "Caution" is displayed. Is set to be added to the transmitted voice information (S305). After that, the operation voice determination process is terminated, and the process proceeds to the process of S114 (FIG. 5B) described later.

On the other hand, when it is determined that the passing operation is not detected (S303: NO), it is determined whether or not the sudden braking operation is detected as the specific driving operation referred to in S110 (S306). When it is determined that a sudden braking operation has been detected (S306: YES), a voice (for example, a voice such as "a sudden braking operation has been performed") is transmitted to notify that the sudden braking operation has been performed. Set to voice information (S307). And "warning" the transmitted voice information
It is set to add the classification information representing "warning" to the transmitted voice information (S308). After that, the operation voice determination process is terminated, and the process proceeds to the process of S114 (FIG. 5B) described later. If it is determined that the sudden braking operation is not detected as the specific driving operation referred to in S110 (S306: NO), the process returns to S101 (FIG. 5A).

Returning to FIG. 5A, when it is determined that the specific driving operation has not been performed in S110 described above (S110: NO), it is determined whether or not a specific state has been detected (S112). The specific state referred to here is a state as a trigger for transmitting voice that is not uttered by the user as transmission voice information. If it is determined that a specific state has not been detected (S112: NO), the voice transmission process is terminated. On the other hand, when it is determined that a specific state has been detected (S112: YES), a state voice determination process for determining transmission voice information according to the state is executed (S113).

FIG. 8 is a flowchart showing an example of the state voice determination process. In this example, the ABS is activated, the step on the road surface is in contact with the lower surface of the vehicle or there is a high risk of contact, a strong crosswind to the vehicle is detected, and the vehicle collides or falls. Corresponds to the specific state referred to in S112.

First, it is determined whether or not the ABS has been activated based on the notification signal output from the ABS ECU 51 (S401). When it is determined that the ABS has been activated (S401: YES), a voice notifying that the ABS has been activated (for example, a voice such as "ABS has been activated" or "Be careful of slipping"). Is set as the transmitted voice information (S402).

On the other hand, when it is determined that the ABS is not operating (S401: NO), has the bottom sensor 57 detected a state in which a step on the road surface is in contact with the bottom surface of the vehicle or a state in which there is a high risk of contact? Whether or not it is determined (S403). Then, when it is determined that a contact state or a state having a high risk of contact is detected (S403: YES), a voice of the content notifying that there is a risk of rubbing the lower surface of the vehicle (for example, "of the vehicle" Set voices such as "There is a risk of rubbing the bottom surface" and "There is a step") as the transmitted voice information (S404).

On the other hand, when it is determined that the contact state or the state having a high risk of contact has not been detected (S403: NO), the crosswind sensor 58 determines whether or not a strong crosswind to the vehicle has been detected (S405). ). Then, when it is determined that a strong crosswind has been detected (S405: YES), a voice (for example, a voice such as "Be careful of the crosswind") for notifying that a strong crosswind has been detected is transmitted. Set to information (S406).

Then, when the ABS is activated (S401: YES), when a state in which a step on the road surface is in contact with the lower surface of the vehicle or a state in which there is a high risk of contact is detected (S403: YES), and a strong crosswind is generated. In any case (S405: YES), the transmitted voice information is classified into "attention", and the classification information indicating "attention" is set to be added to the transmitted voice information (S407). After that, the state voice determination process is terminated, and the process proceeds to the process of S114 (FIG. 5B) described later.

On the other hand, when it is determined that a strong crosswind has not been detected (S405: NO), the collision / fall sensor 59 detects a state in which the vehicle has collided or has fallen (a state in which the vehicle is likely to have caused an accident). It is determined whether or not it has been done (S408). When it is determined that a vehicle has collided or has fallen (S408: YES), a voice notifying that the vehicle has collided or has fallen (for example, "the vehicle has collided (or has fallen)", " A voice such as "An accident has occurred") is set as the transmitted voice information (S409). Then, the transmitted voice information is classified into "warning", and the classification information representing "warning" is set to be added to the transmitted voice information (S410). After that, the state voice determination process is terminated, and the process proceeds to the process of S114 (FIG. 5B) described later. If it is determined that the state in which the vehicle has collided or has fallen has not been detected (S408: NO), the process returns to S101 (FIG. 5A).

Returning to FIG. 5B, in S114, the position information is acquired by requesting the position information from the navigation device 48, and the position information is set to be added to the transmitted voice information. The position information is information that represents the current location of the navigation device 48 (in other words, the current location of the vehicle, the current location of the terminal devices 31 to 33, the current location of the user) at the time of acquisition in absolute position (latitude, longitude, etc.). .. In particular, the position information acquired in S114 represents a position (speech position) in which the user has uttered a voice. The utterance position may be any one that can identify the position where the user utters the voice, and factors such as the time difference between the timing of inputting the voice and the timing of acquiring the position information (change in position due to the running of the vehicle) Therefore, some variation may occur.

Subsequently, a voice packet is generated using the transmitted voice information, the emergency information, the position information, the operation content information, the classification information, and the information including the user's nickname set in the authentication process described later as the transmitted data (S115). Then, the generated voice packet is wirelessly transmitted to the communication partner device (server 10 or other terminal devices 31 to 33) (S116), and the voice transmission process is terminated. That is, the transmitted voice information representing the voice uttered by the user is transmitted in a form in which emergency information, position information (voiced position), operation content information, classification information, and nickname can be specified (associated state). It should be noted that all voice packets are transmitted to the server 10, and specific voice packets (for example, those including transmitted voice information to which "caution" or "warning" is added as classification information) can be directly communicated with other terminals. It may also be transmitted to the devices 31 to 33.

Further, the terminal devices 31 to 33 carry out the authentication process shown in FIG. 9 at the time of activation or when a specific operation is input by the user. The authentication process is a process for identifying a user who performs voice input.

In the authentication process, as shown in FIG. 9, first, the biological characteristics of the user (for example, any one of fingerprint, retina, palm, voiceprint, etc.) are acquired via the input unit 45 of the terminal devices 31 to 33. (S501). Then, the user is specified by referring to the database in which the user name (ID) registered in the memory such as RAM and the biological feature are associated with each other, and the nickname set by the user is set to be inserted into the voice ( S502). When such a process is completed, the authentication process is terminated.

Next, the audio distribution process will be described with reference to the flowchart shown in FIGS. 10A-10C. In the voice distribution process, the server 10 performs a predetermined operation (process) on the voice packet transmitted from the terminal devices 31 to 33, and distributes the operated voice packet to the other terminal devices 31 to 33. Is.

Specifically, as shown in FIGS. 10A-10C, first, it is determined whether or not the voice packet transmitted from the terminal devices 31 to 33 has been received (S701). If the voice packet is not received (S701: NO), the process proceeds to S725, which will be described later.

If the voice packet is received (S701: YES), the voice packet is acquired (S702), and the nickname is added to the voice packet by referring to the name / nickname DB (S703). In this process, a new voice packet in which a nickname, which is identification information for identifying the user, is added by voice to the voice packet input by the user is generated. At this time, the nickname is added before or after the voice input by the user so that the voice input by the user and the nickname do not overlap.

Subsequently, the voice represented by the voice information included in the new voice packet is converted into characters (S704). This process utilizes a well-known process of converting speech into characters readable by other users. At this time, the position information, the operation content information, and the like are also converted into character data in the same manner. When the terminal devices 31 to 33, which are the sources of voice packets, perform the conversion process from voice to characters, the server is obtained by acquiring the character data obtained by the conversion process from the terminal devices 31 to 33. The conversion process in 10 may be omitted (or simplified).

Next, the name (personal name) in the voice (or converted character data) is extracted, and it is determined whether or not there is a name (S705). If the voice packet contains emergency information, the processing from S705 to S720 described later is omitted, and the process proceeds to the processing of S721 described later.

If there is no name in the voice (S705: NO), the process proceeds to S709, which will be described later. If there is a name in the voice (S705: YES), it is determined whether or not this name exists in the name / nickname DB (S706). If the name in the voice exists in the name / nickname DB (S706: YES), the name is replaced with the corresponding nickname by voice (in the character data, the name is replaced with the nickname with characters) (S707), and the processing of S709. Move to.

If the name in the voice does not exist in the name / nickname DB (S706: NO), the name is replaced with the sound "pee" (in the character data, the name is replaced with another character such as "***". ) (S708), and the process proceeds to S709.

Subsequently, a preset prohibited word in the voice (or converted character data) is extracted (S709). As for the prohibited words, words such as vulgar and obscene that may make the listener uncomfortable are registered in the prohibited word DB, and in this process, the words in the voice (or converted character data) and the prohibited word DB are registered. The prohibited words are extracted by collating with the prohibited words in.

The prohibited word is replaced with a "boo" sound (in the character data, the name is replaced with another character such as "XXX") (S710). Subsequently, an intonation check and a polite expression check are carried out (S711, S712).

In these processes, the amplitude (absolute value and rate of change) of the input level to the microphone 52 and the polite expression included in the voice are expressed as the emotion and the polite way of speaking when the user inputs the voice. Judgment is made by detecting from the information, and it is detected whether or not the situation is such that emotions are high or the speech is not polite.

As a result of the check, if the input voice is a normal emotion and the speaking style is polite (S713: YES), the process immediately proceeds to the process of S715 described later. In addition, as a result of the check, if the input voice has high emotions or is not spoken politely (S713: NO), a voice distribution prohibition flag is set to indicate that the distribution of this voice packet is prohibited. Then (S714), the process proceeds to S715.

Subsequently, the behavior of the terminal devices 31 to 33 that transmitted the corresponding voice packet is identified by tracking the position information, and the behavior of the terminal devices 31 to 33 deviates from the main road to the side road or for a certain period of time. It is determined whether or not the vehicle has stopped for (for example, about 5 minutes) or more (S715).

If the behavior of the terminal devices 31 to 33 deviates from the main road to the side road or is stopped (S715: YES), the break flag is set as if the terminal device is resting (S716), and the process proceeds to S717. Further, if the behavior of the terminal devices 31 to 33 does not correspond to deviating from the main road to the side road or stopping (S715: NO), the process immediately shifts to the process of S717.

Then, preset terminal devices (for example, all terminal devices that are turned on, some terminal devices that are extracted based on the settings, etc.) are set as communication partners (S717), and voice input is also performed. Notify the original terminal devices 31 to 33 of the result of the false word (result of presence / absence of name or prohibited word, result of intonation check, polite expression check, etc.) (S718).

Subsequently, it is determined whether or not the position of the terminal devices 31 to 33 (delivery destination vehicle) for distribution has passed a specific position (S719). Here, in the server 10, a plurality of advertisements are registered in the advertisement DB, and in this advertisement DB, an area for delivering the advertisement is set for each advertisement. In this process, it is detected that the terminal devices 31 to 33 have entered the area where the advertisement (CM) is distributed.

If the delivery destination vehicle has passed the specific position (S719: YES), the advertisement corresponding to the specific position is added to the voice packet transmitted to the terminal devices 31 to 33 (S720). If the delivery destination vehicle has not passed the specific position (S719: NO), the process proceeds to S721.

Subsequently, it is determined whether or not there are a plurality of voice packets to be delivered (S721). When there are a plurality of voice packets (S721: YES), the voice packets are arranged so as not to be duplicated (S722), and the process proceeds to S723. In this process, the voice packets in which the emergency information reproduction order is prioritized are arranged first, and the voice packets for which the break flag is set are arranged so that the order is later.

If there is only one voice packet (S721: NO), the process immediately proceeds to S723. Subsequently, it is determined whether or not the voice packet is already being transmitted (S723).
If the voice packet is being transmitted (S723: YES), the voice packet to be transmitted is set to be transmitted after the packet being transmitted (S724), and the process proceeds to S726. Further, if the voice packet is not being transmitted (S723: NO), the process immediately proceeds to the process of S726.

By the way, in the process of S725, it is determined whether or not there is a voice packet to be transmitted (S725). If there is a voice packet (S725: YES), the voice packet to be transmitted is transmitted (S726), and the voice distribution process is terminated. If there is no voice packet (S726: NO), the voice distribution process ends.

Next, the audio reproduction process in which the CPU 41 of the terminal devices 31 to 33 reproduces the audio will be described with reference to the flowcharts shown in FIGS. 11A and 11B. In the voice reproduction process, as shown in FIGS. 11A and 11B, first, it is determined whether or not a packet has been received from another device such as the other terminal devices 31 to 33 or the server 10 (S801). If no packet has been received (S801: NO), the audio reproduction process ends.

Further, if the packet is received (S801: YES), it is determined whether or not this packet is a voice packet (S802). If it is not a voice packet (S802: NO), the process proceeds to S812, which will be described later.

If it is a voice packet (S802: YES), playback of the voice information currently being played is stopped, and the voice information being played is deleted (S803). Then, it is determined whether or not the delivery prohibition flag is set (S804). If the delivery prohibition flag is set (S804: YES), a voice message (pre-recorded in a memory such as ROM) indicating that voice playback is prohibited is generated, and the characters corresponding to this voice message are generated. Generate a message (S805).

Subsequently, in order to make the sound easier to hear, the playback volume of the music or the like being played by the audio device 50 is turned off (S806). The playback volume may be lowered, or the playback itself may be stopped.

Subsequently, the voice is sounded according to the positional relationship between the positions of the terminal devices 31 to 33 (speaking positions) corresponding to the distribution source of the reproduced voice and the positions of the terminal devices 31 to 33 (current location). A speaker setting process for setting the volume to be output when playing from 53 is performed (S807), and the voice message generated in the process of S805 is played (starting playback) at the set volume (S808). At this time, the character data including the character message is output to the display of the navigation device 48 and displayed (S812).

The character data displayed in this process includes character data indicating the content of the voice represented by the voice information included in the voice packet, character data indicating the operation content by the user, and a voice message.

Further, if the distribution prohibition flag is not set in the process of S804 (S804: NO), the playback volume of the music or the like being played by the audio device 50 is turned off (S809) as in the above-mentioned S806. Further, the speaker setting process is performed (S810), the voice represented by the voice information included in the voice packet is reproduced (S811), and the process proceeds to the process of S812. Since the voice represented by the voice information is a synthetic voice, the reproduction mode can be easily changed. For example, it can be changed based on or automatically by the user operation, such as adjusting the reproduction speed, suppressing the emotional component contained in the words, adjusting the tone, and adjusting the voice color.

In the process of S811, since the voice represented by the voice information included in the aligned voice packets is reproduced in order, it is assumed that the voice packets do not overlap, but the voice packets are received from the plurality of servers 10. When there is a risk of duplication of voice packets, the above-mentioned process of S722 (process of aligning voice packets) may be performed.

Subsequently, it is determined whether or not the voice representing the command has been input by the user (S813). In the present embodiment, when a voice representing a command to skip the voice being played (for example, a voice called "cut") is input during voice playback (S813: YES), the voice information currently being played is set as a predetermined unit. Skip with and play the next audio information (S814). That is, the voice that you do not want to hear can be skipped and played by voice operation. The predetermined unit referred to here may be, for example, a comment unit or a speaker unit. When the reproduction of the audio for all the received audio information is completed (S815: YES), the reproduction volume of the music or the like being reproduced by the audio device 50 is turned back on (S816), and the audio reproduction process is terminated.

Next, the details of the speaker setting process executed in S807 and S810 will be described with reference to FIG. FIG. 12 is a flowchart showing a speaker setting process in the audio reproduction process. In the speaker setting process, as shown in FIG. 12, first, position information (including past position information) indicating the position of the own vehicle is acquired from the navigation device 48 (S901).

Subsequently, the position information (speech position) included in the voice packet to be reproduced is extracted (S902), and the positions (distances) of the other terminal devices 31 to 33 with respect to the movement vector of the own vehicle are detected (S903). In this process, the direction in which the terminal device of the source of the voice packet to be reproduced is located and the distance to the terminal device when the traveling direction of the own terminal device 31 to 33 (vehicle) is used as a reference is detected. ..

Subsequently, the volume ratio of the speaker is adjusted according to the orientation in which the terminal device that is the source of the voice packet is located (S904). In this process, the volume ratio is set so that the volume of the speaker located in the direction in which the terminal device is located is maximized so that the sound can be heard from the direction in which the terminal device of the transmission source is located.

Then, the maximum value of the volume for the speaker having the largest volume ratio is set according to the distance to the terminal device from which the voice packet is transmitted (S905). By this process, the volume for other speakers can also be set based on the volume ratio. When such processing is completed, the speaker setting processing is completed.

Next, the mode transition process will be described. FIG. 13 is a flowchart showing a mode transition process executed by the CPU 41 of the terminal devices 31 to 33. The mode transition process is a process for switching between a distribution mode in which an unspecified number of communication partners is used and an interactive mode in which a specific party is a communication partner, and is started when the power of the terminal devices 31 to 33 is turned on. , And then repeated.

More specifically, as shown in FIG. 13, first, it is determined whether the current setting mode is the interactive mode or the distribution mode (S1001, S1004). If the setting mode is neither the interactive mode nor the distribution mode (S1001: NO, S1004: NO), the process returns to the process of S1001.

Further, if the setting mode is the interactive mode (S1001: YES), it is determined whether or not there is a mode transition operation via the input unit 45 (S1002). If there is no mode transition operation (S1002: NO), the mode transition process ends.

If there is a mode transition operation (S1002: YES), the mode shifts to the distribution mode (S1003). At this time, the server 10 is notified to set the communication partner to an unspecified number of persons, and the server 10 receives this notification and changes the setting of the communication partner (description of the communication partner DB) for the terminal devices 31 to 33. To do.

Further, if the setting mode is the distribution mode (S1001: NO, S1004: YES), it is determined whether or not there is a mode transition operation via the input unit 45 (S1005). If there is no mode transition operation (S1005: NO), the mode transition process ends.

If there is a mode transition operation (S1005: YES), a dialogue request is transmitted to the other party playing the voice packet (S1006). Specifically, when a voice packet (the terminal device of the transmission source) is specified to the server 10 and a dialogue request is transmitted, the server 10 transmits the dialogue request to the corresponding terminal device. Then, the server 10 receives a reply to the dialogue request from this terminal device and sends the reply to the terminal devices 31 to 33 of the dialogue request source.

If there is a reply that the dialogue request is accepted (S1007: YES), the terminal devices 31 to 33 shift to the dialogue mode in which the terminal device that has accepted the dialogue request is the communication partner (S1008). At this time, the server 10 is notified by designating the terminal device to set the communication partner to a specific terminal device, and the server 10 receives this notification and changes the setting of the communication partner.

If there is no response to accept the dialogue request (S1007: NO), the mode transition process ends.
Next, FIG. 14 is a flowchart showing a replay process executed by the CPU 41 of the terminal devices 31 to 33. The replay processing is an interrupt process that is started when a replay operation for repeating playback is input during playback of the voice represented by the voice information included in the voice packet. This process is performed by interrupting the audio reproduction process.

In the replay process, as shown in FIG. 14, first, a designated voice packet is selected (S1011). In this process, the audio packet being reproduced or the audio packet immediately after reproduction (within the reference time (for example, 3 seconds) after the end of reproduction) is selected according to the time after the start of reproduction of the audio packet currently being reproduced.

Subsequently, the selected voice packet is reproduced from the beginning (S1012), and the reproduction process is terminated. When this process is completed, the audio reproduction process is restarted.
By the way, the server 10 receives the voice packet transmitted from the terminal devices 31 to 33 and stores the voice information, and when the request is received from the terminal devices 31 to 33, the server 10 requests from the stored voice information. The voice information corresponding to the original terminal devices 31 to 33 may be extracted and the extracted voice information may be transmitted.

FIG. 15 is a flowchart showing a storage process executed by the CPU 11 of the server 10. The storage process is a process for accumulating (storing) voice packets transmitted from the terminal devices 31 to 33 in the voice transmission process (FIGS. 5A and 5B) described above. The accumulation process may be performed in place of the audio distribution process (FIGS. 10A-10C) described above, or may be performed together with the audio distribution process (for example, in parallel).

In the storage process, first, it is determined whether or not the voice packet transmitted from the terminal devices 31 to 33 has been received (S1101). If no voice packet has been received (S1101: NO), the storage process ends.

When the voice packet is received (S1101: YES), the received voice packet is stored in the database 14 (S1102). Specifically, the voice information is stored in a searchable form based on various information (voice information, emergency information, location information, operation content information, classification information, user's nickname, etc.) included in the voice packet. After that, the accumulation process is terminated. Note that voice information satisfying a predetermined deletion condition (for example, old voice information, voice information of a churn user, etc.) may be deleted from the database 14.

FIG. 16 is a flowchart showing a request process executed by the CPU 41 of the terminal devices 31 to 33. Request processing is executed every predetermined time (for example, several tens of seconds or several minutes).
In the request processing, first, it is determined whether or not the route guidance process is executed by the navigation device 48 (in other words, the guidance route to the destination is set) (S1201). When it is determined that the route guidance process is being executed (S1201: YES), the navigation device 48 provides position information (current position information) indicating the position of the own vehicle and guidance route information (destination and purpose). Information on the route to the ground) and is acquired as vehicle position information (S1202). After that, it shifts to S1206. The vehicle position information is information for causing the server 10 to set a peripheral area to be described later.

On the other hand, when it is determined that the route guidance process is not executed (S1201: NO), it is determined whether or not the vehicle is running (S1203). Specifically, when the traveling speed of the vehicle exceeds the determination reference value, it is determined that the vehicle is traveling. This judgment reference value is set to be higher than the general speed at the time of turning left or right (low speed as compared with straight running). Therefore, when it is determined that the vehicle is running, there is a high possibility that the traveling direction of the vehicle does not change significantly. In other words, in S1203, it is determined whether or not the traveling direction is easy to predict based on the change in the position information of the vehicle. However, the present invention is not limited to this, and for example, 0 or a value close to 0 may be set as the determination reference value.

When it is determined that the vehicle is running (S1203: YES), the navigation device 48 provides the vehicle with position information (current position information) indicating the position of the own vehicle and one or more past position information. Acquired as position information (S1204). After that, it shifts to S1206. When acquiring a plurality of past position information, the position information having the same time interval may be acquired, for example, the position information 5 seconds ago and the position information 10 seconds ago.

On the other hand, when it is determined that the vehicle is not running (S1203: NO), the position information (current position information) indicating the position of the own vehicle is acquired as the vehicle position information from the navigation device 48 (S1205). After that, it shifts to S1206.

Subsequently, favorite information is acquired (S1206). Favorite information is information that can be used to extract (search) the voice information required by the user from a large amount of voice information, and is manually or automatically by the user (for example, from the user's remarks). It is set (by analyzing the taste). For example, when a specific user (for example, a user specified in advance) is set as favorite information, the voice information transmitted by the specific user is preferentially extracted. Similarly, for example, when a specific keyword is set as favorite information, voice information including the specific keyword is preferentially extracted. In the process of S1206, the favorite information that has already been set may be acquired, or the user may be allowed to set the favorite information at this stage.

Subsequently, the type (genre) of the requested voice information is acquired (S1207). The type referred to here is a type classified by the above-mentioned processing such as S109 (in this embodiment, "normal", "caution", and "warning").

Subsequently, the server makes an information request including vehicle position information, favorite information, the type of voice information, and the ID (information for the server 10 to specify the reply destination) of itself (terminal devices 31 to 33). It is transmitted to 10 (S1208). After that, the request processing ends.

17A and 17B are flowcharts showing the response processing executed by the CPU 11 of the server 10. The response process is a process for responding to an information request transmitted from the terminal devices 31 to 33 in the request process (FIG. 16) described above. The response process may be performed in place of the voice distribution process (FIGS. 10A-10C) described above, or may be performed together with the voice distribution process (for example, in parallel).

In the response process, first, it is determined whether or not the information request transmitted from the terminal devices 31 to 33 has been received (S1301). If the information request has not been received (S1301: NO), the response process ends.

When the information request is received (S1301: YES), the peripheral area corresponding to the vehicle position information included in the received information request is set (S1302 to S1306). In the present embodiment, as described above, (S1201 to S1205, S1208), (P1) position information indicating the position of the own vehicle, (P2) position information indicating the position of the own vehicle, and one or more past position information, (P3). ) Either the position information indicating the position of the own vehicle or the information of the guidance route is provided as the vehicle position information.

When it is determined that the vehicle position information included in the received information request is (P1) position information indicating the own vehicle position (S1302: YES), the own vehicle position (vehicle) is illustrated as shown in FIG. Area A1 within a predetermined distance L1 from (current location) C is set as a peripheral area (S1303). After that, it shifts to S1307. In FIG. 18, vertical and horizontal lines indicate roads on which the vehicle can travel, and “x” indicates the vocalization position of the voice information stored in the server 10.

On the other hand, when it is determined that the vehicle position information included in the received information request is (P2) position information indicating the own vehicle position and one or more past position information, (S1302: NO, S1304: YES). ), As illustrated in FIG. 19, the area A2 within a predetermined distance L2 from the reference position Cb shifted to the traveling direction side (right side in FIG. 19) from the own vehicle position (current location of the vehicle) C is set as the peripheral area. (S1305). After that, it shifts to S1307.

Specifically, the traveling direction of the vehicle is estimated based on the positional relationship between the current position information C and the past position information Cp. The distance from the current location C to the reference position Cb may be larger than the radius L2 of the area. That is, the area A2 that does not include the current location C may be set as the peripheral area.

On the other hand, if it is determined that the vehicle position information included in the received information request is (P3) position information indicating the position of the own vehicle and information on the guidance route (S1304: NO), the vehicle follows the planned travel route. The area is set to the surrounding area (S1306). After that, it shifts to S1307.

Specifically, for example, as shown in FIG. 20, of the planned travel routes (thick line portion) from the departure point S to the destination G, the area along the route from the current location C to the destination G (determined to be on the route). Area) A3 is set as the surrounding area. Here, the area along the route may be set, for example, as a range in which the distance from the route is within a predetermined distance L3. In this case, the value of L3 may be changed according to the road attribute (for example, the width and type of the road). Further, the range may be within a predetermined distance L4 from the current location C instead of the range to the destination G. Further, although the route that has already been traveled (the route from the departure point S to the current location C) is excluded here, the route is not limited to this, and the route that has already been traveled may be included.

Subsequently, from the voice information stored in the database 14, the voice information whose utterance position is in the peripheral area is extracted (S1307). In the examples of FIGS. 18 to 20, the voice information in the peripheral area (the area surrounded by the broken line) A1, A2, and A3 where the vocalization position is located is extracted.

Subsequently, the voice information corresponding to the type of voice information included in the received information request is extracted from the voice information extracted in S1307 (S1308). Further, from the voice information extracted in S1308, the voice information corresponding to the favorite information included in the received information request is extracted (S1309).

By the above processing (S1302 to S1309), the voice information corresponding to the information request received from the terminal devices 31 to 33 is extracted as the voice information of the transmission candidate to be transmitted to the terminal devices 31 to 33 from which the information request is transmitted. To do.

Subsequently, the content of the voice is analyzed for each of the voice information of the transmission candidates (S1310). Specifically, the voice represented by the voice information is converted into text (character data), and the keywords included in the converted text are extracted. The text (character data) representing the content of the voice information may be stored in the database 14 together with the voice information, and the stored information may be used.

Subsequently, it is determined whether or not the content of each of the voice information of the transmission candidate overlaps with other voice information (S1311). For example, when a keyword included in a certain voice information A and a keyword included in another voice information B match by a predetermined ratio or more (for example, half or more), it is determined that the contents of the voice information A and B are duplicated. It should be noted that the duplication of contents may be determined based on the context or the like, instead of simply determining the ratio of keywords.

Then, when it is determined that the contents of all the voice information of the transmission candidate do not overlap with other voice information (S1311: NO), the process proceeds to S1313, and the voice information of the transmission candidate is used as the transmission source of the information request. Is transmitted to the terminal devices 31 to 33 (S1313), and the response process is completed. It should be noted that the transmitted voice information may be stored for each of the transmission destination terminal devices 31 to 33, and the already transmitted voice information may not be transmitted.

On the other hand, when it is determined that the voice information whose contents overlap with other voice information exists in the voice information of the transmission candidate (S1311: YES). Of the plurality of voice information having duplicate contents, the duplication of contents is eliminated by excluding from the voice information of the transmission candidates other than one voice information left as the voice information of the transmission candidate (S1312). For example, the latest voice information may be left among a plurality of voice information having overlapping contents, and conversely, the oldest voice information may be left. Further, for example, the one with the most keywords included in the voice information may be left. After that, the voice information of the transmission candidate is transmitted to the terminal devices 31 to 33 of the transmission source of the information request (S1313), and the response process is completed.

The voice information transmitted from the server 10 to the terminal devices 31 to 33 is reproduced by the above-mentioned voice reproduction processing (FIGS. 11A and 11B). When a new voice packet is received during the reproduction of the voice represented by the already received voice packet, the terminal devices 31 to 33 preferentially reproduce the voice represented by the newly received voice packet. Also, the voice represented by the old voice packet is deleted without being played. As a result, the voice represented by the voice information according to the position of the vehicle is preferentially reproduced.

[Effect of this embodiment]
As described above, according to the present embodiment, the following effects can be obtained.
(1) The terminal devices 31 to 33 input the voice uttered by the user in the vehicle (S102) and acquire the position information (current location) (S114). Then, the terminal devices 31 to 33 share the voice information representing the input voice with the plurality of terminal devices 31 to 33 in a form in which the position information (speaking position) acquired at the time of inputting the voice can be specified. It is transmitted to the server 10 (S116). Further, the terminal devices 31 to 33 receive the voice information transmitted from the other terminal devices 31 to 33 to the server 10 from the server 10 and reproduce the voice represented by the received voice information (S811). Specifically, the terminal devices 31 to 33 are in the peripheral area (S1303, S1305) in which the vocalization position of the voice information transmitted from the other terminal devices 31 to 33 to the server 10 is set based on the current location. , S1306), the voice represented by the voice information is reproduced.

Voices made by a user at a location are often useful to other users who are (or are heading for) that location. In particular, the position of the user who is in the vehicle can change significantly with the passage of time (running of the vehicle) as compared with the user who is not in the vehicle. Therefore, for the user who gets on the vehicle, the voice of another user emitted in the surrounding area based on the current location can be useful information.

In this regard, in the present embodiment, the user of a certain terminal device 31 has a peripheral area set based on the current location of the terminal device 31 among the voices emitted by the users of the other terminal devices 32 and 33 (other vehicles). You can hear the voice emitted inside. Therefore, according to the present embodiment, it is possible to provide useful information to the user who has boarded the vehicle.

The voice generated in the surrounding area is not limited to real-time voice, but may include past voice (for example, emitted several hours ago), but such voice is outside the surrounding area (for example, in a distant place). ) Can be useful information compared to the real-time voice emitted in. For example, when lane regulation or the like is enforced at a specific point on a road, one user can tweet the information, and another user heading for that point can choose to avoid that point. Also, for example, when the scenery seen from a specific point on the road is wonderful, one user can tweet the information so that another user heading to that point does not miss the scenery.

(2) When the past position information or the planned travel route (scheduled travel route) information is transmitted from the terminal devices 31 to 33 to the server 10 in addition to the current position information of the vehicle as the vehicle position information, the surrounding area Is set in an area that is biased toward the traveling direction with respect to the current location of the vehicle (FIGS. 19 and 20). Therefore, it is possible to reduce the sound emitted at the place where it has already passed from the playback target and increase the sound emitted at the place where it is heading from now on. As a result, the usefulness of the information can be increased.

(3) When the surrounding area is set to an area along the planned travel route, voices emitted in areas other than the planned travel route can be excluded, further improving the usefulness of the information. Can be made to.

(4) The terminal devices 31 to 33 automatically acquire the vehicle position information at predetermined time intervals (S1202, S1204, S1205) and transmit the vehicle position information to the server 10 (S1208), so that the voice information according to the current location of the vehicle is obtained. To get. Therefore, even if the position changes as the vehicle travels, it is possible to acquire voice information according to the position. In particular, when new voice information is received from the server 10, the terminal devices 31 to 33 erase the received voice information (S803) and reproduce the new voice information (S811). That is, at predetermined time intervals, the voice information for which the voice should be reproduced is updated with the voice information corresponding to the latest vehicle position information. Therefore, the reproduced sound can be made to follow the change in the position due to the traveling of the vehicle.

(5) The terminal devices 31 to 33 transmit the vehicle position information including the current location of the vehicle to the server 10 (S1208), and cause the server 10 to extract the voice information according to the current location (S1302 to S1312). The voice represented by the voice information received from the server 10 is reproduced (S811). Therefore, the amount of voice information received from the server 10 can be reduced as compared with the configuration in which the terminal devices 31 to 33 extract the voice information.

(6) The terminal devices 31 to 33 input the voice uttered by the user (S102) and convert the input voice into synthetic voice (S107). By reproducing the voice after converting it into a synthetic voice in this way, it is possible to make it easier to change the playback mode as compared with the case where the voice is played as it is. For example, it is possible to easily make changes such as adjustment of playback speed, suppression of emotional components contained in words, adjustment of tone, and adjustment of voice color.

(7) When a voice representing a command is input during playback of voice, the terminal devices 31 to 33 change the voice reproduction mode according to the command. Specifically, when a voice representing a command for skipping the voice being played is input (S813: YES), the voice being played is skipped in a predetermined unit and played back (S814). Therefore, the voice that is not desired to be heard can be skipped and reproduced in a predetermined unit such as a comment unit or a speaker unit.

(8) The server 10 determines whether or not the content of each of the voice information of the transmission candidate is duplicated with other voice information (S1311), and if it is determined to be duplicated (S1311: YES), the contents are duplicated. The audio information of the content is deleted (S1312). For example, when a plurality of users make similar remarks for the same event, such as remarks about an accident that occurred in a certain place, a phenomenon in which the same remarks are repeatedly reproduced is likely to occur. In this respect, according to the present embodiment, since the reproduction of the voice having duplicated contents is omitted, it is possible to prevent the phenomenon that the same remark is repeatedly reproduced.

(9) The server 10 extracts the voice information corresponding to the favorite information from the voice information of the transmission candidates (S1309) and transmits the voice information to the terminal devices 31 to 33 (S1313). Therefore, it is possible to efficiently extract the voice information required by the user (which satisfies the priority condition according to the user) from a large amount of voice information transmitted by many other users and play it preferentially. it can.

(10) The terminal devices 31 to 33 are configured to be communicable with the audio device mounted on the vehicle, and the volume of the audio device during sound reproduction is lowered as compared with the volume before the sound is reproduced (10). S806). Therefore, the voice can be easily heard.

(11) The terminal devices 31 to 33 detect that a specific event related to the vehicle has occurred in the vehicle (S110, S112). Then, when the terminal devices 31 to 33 detect that a specific event has occurred (S110: YES or S112: YES), the terminal devices 31 to 3 to the other terminal devices 31 to provide voice information representing the voice corresponding to the specific event. It is transmitted to 33 or the server 10 (S116). Further, the terminal devices 31 to 33 receive voice information from the other terminal devices 31 to 33 or the server 10 and reproduce the voice represented by the received voice information (S811).

According to the present embodiment, the user of a certain terminal device 31 can hear the sound corresponding to a specific event related to the vehicle transmitted from the other terminal devices 32, 33 (another vehicle). Therefore, the user of the terminal devices 31 to 33 can grasp the state of another vehicle while driving.

(12) The terminal devices 31 to 33 detect that a specific driving operation has been performed by the user of the vehicle as a specific event (S301, S303, S306). Then, when the terminal devices 31 to 33 detect a specific driving operation (S301: YES, S303: YES or S306: YES), a voice representing a voice indicating that the specific driving operation has been performed is performed. Information is transmitted (S302, S304, S307, S116). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that a specific driving operation has been performed in another vehicle.

(13) When the terminal devices 31 to 33 detect a sudden braking operation (S306: YES), the terminal devices 31 to 33 transmit voice information representing a voice of the content notifying that the sudden braking operation has been performed (S307). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that the sudden braking operation has been performed in another vehicle. Therefore, it is possible to realize safe driving as compared with the case where the state of another vehicle is confirmed only by visual inspection.

(14) When the terminal devices 31 to 33 detect the passing operation (S303: YES), the terminal devices 31 to 33 transmit voice information representing the voice of the content notifying that the passing operation has been performed (S304). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that the passing operation has been performed in another vehicle. Therefore, it is possible to easily grasp the signal from the other vehicle as compared with the case where the state of the other vehicle is confirmed only by visual inspection.

(15) When the terminal devices 31 to 33 detect the winker operation (S301: YES), the terminal devices 31 to 33 transmit voice information representing the voice of the content notifying that the winker operation has been performed (S30).
2). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that the winker operation has been performed in another vehicle. Therefore, it is possible to easily predict the movement of the other vehicle as compared with the case of confirming the state of the other vehicle only by visual inspection.

(16) The terminal devices 31 to 33 detect a specific state related to the vehicle as a specific event (S401, S403, S405, S408). Then, when the terminal devices 31 to 33 detect a specific state (S401: YES, S403: YES, S405: YES or S408: YES), the terminal device 31 to 33 emits a voice of the content notifying that the specific state has been detected. The voice information to be represented is transmitted (S402, S404, S406, S409, S116). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that a specific state has been detected in another vehicle.

(17) When the terminal devices 31 to 33 detect the operation of the ABS (S401: YES), the terminal devices 31 to 33 transmit voice information representing the voice of the content notifying that the ABS has been operated (S402). Therefore, the user of the terminal devices 31 to 33 can grasp that the ABS has been operated in another vehicle while driving. Therefore, it is possible to easily predict the slip-prone situation as compared with the case where the road surface condition is visually confirmed.

(18) When the terminal devices 31 to 33 detect a state in which a step on the road surface is in contact with the lower surface of the vehicle or a state in which there is a high risk of contact (S403: YES), there is a risk of rubbing the lower surface of the vehicle. The voice information representing the voice of the content notifying the existence is transmitted (S404). Therefore, it is possible to easily predict a situation in which there is a high risk of rubbing the lower surface of the vehicle as compared with the case where the condition of the road surface is visually confirmed.

(19) When the terminal devices 31 to 33 detect a state in which the vehicle is receiving a crosswind (S405: YES), the terminal devices 31 to 33 transmit voice information representing a voice of the content notifying that the vehicle is receiving a crosswind. (S406). Therefore, it is possible to easily predict the situation that is easily affected by the crosswind as compared with the case where the situation outside the vehicle is visually confirmed.

(20) When the terminal devices 31 to 33 detect a state in which the vehicle has fallen or collided (S408: YES), the terminal devices 31 to 33 transmit voice information representing the voice of the content notifying that the vehicle has fallen or collided (S409). ). Therefore, the user of the terminal devices 31 to 33 can grasp while driving that another vehicle has fallen or collided. Therefore, it is possible to realize safe driving as compared with the case where the state of another vehicle is confirmed only by visual inspection.

(21) In addition, the following effects can be obtained.
The communication system 1 described in detail as described above includes a plurality of terminal devices 31 to 33 capable of communicating with each other, and also includes a server 10 capable of communicating with each of the plurality of terminal devices 31 to 33. .. When the user inputs voice, the CPU 41 of each terminal device 31 to 33 converts the voice into voice information and transmits the voice information to a device including other terminal devices 31 to 33.

Then, the CPU 41 receives the voice information transmitted by the other terminal devices 31 to 33, and reproduces the received voice information. Further, the server 10 receives the voice information transmitted from the plurality of terminal devices 31 to 33, arranges the voices corresponding to the voice information so as not to overlap, and then voices the voices to the plurality of terminal devices 31 to 33. Distribute information.

According to such a communication system 1, it is possible to input the transmission content by voice and reproduce the transmission content from other terminal devices 31 to 33 by voice, so that even a driving user wants to tweet. Etc. can be safely transmitted and received. Further, in such a communication system 1, when the voice is reproduced, the voice can be reproduced so as not to be duplicated, so that the voice can be easily heard.

Further, in the communication system 1, when the CPU 41 receives a specific command from the user, the CPU 41 replays the already played voice information. In particular, the voice information played immediately before may be played back. According to such a communication system 1, voice information that cannot be heard due to noise or the like can be reproduced again by a user command.

Further, in the communication system 1, the terminal devices 31 to 33 are mounted on the vehicle, and the CPU 41 of the terminal devices 31 to 33 includes touch panels 61 and 62 for detecting the movement of the user's hand on the handle of the vehicle. When the touch panels 61 and 62 detect the start specific action of starting the voice input, the process of generating the voice packet is started, and when the touch panels 61 and 62 detect the end specific action of ending the voice input. The process of generating a voice packet is terminated. According to such a communication system 1, an operation for inputting voice can be performed on the steering wheel. Therefore, the user who is driving the vehicle can input the voice more safely.

Further, in the communication system 1, the CPU 41 detects the start specific operation and the end specific operation input via the touch panels 61 and 62 as hand movements in a direction different from the operation direction when operating the horn. According to such a communication system 1, it is possible to suppress the sounding of the horn at the time of the start specific operation or the end specific operation.

Further, in the communication system 1, the server 10 generates new voice information in which identification information for identifying the user is added by voice to the voice information input by the user, and distributes the generated voice information. .. In such a communication system 1, since identification information for identifying a user can be added by voice, the user notifies another user of the user who originated the voice without speaking his / her own identification information. Can be done.

Further, in the communication system 1, the server 10 extracts a preset keyword included in the voice information from the voice information before playing the voice information, and sets the keyword included in the voice information into the voice of another word or in advance. Replace with the set sound. According to such a communication system 1, words that are not preferable for distribution (obscene words, words indicating personal names, barbaric words, etc.) are registered as keywords and replaced with words or sounds that may be distributed. Can be delivered.

Further, in the communication system 1, the CPU 41 of each terminal device 31 to 33 acquires its own position information, associates the position information with the voice information transmitted from its own terminal devices 31 to 33, and associates the position information with other terminal devices 31. It is transmitted to ~ 33, and the position information transmitted by other terminal devices 31 to 33 is acquired. Then, the volume output when the sound is reproduced is controlled according to the positional relationship between the positions of the terminal devices 31 to 33 corresponding to the reproduced sound and the positions of the own terminal devices 31 to 33.

In particular, the CPU 41 controls the volume to decrease as the distance to the other terminal devices 31 to 33 increases, and when outputting audio from a plurality of speakers, the CPU 41 refers to the position of its own terminal devices 31 to 33. The volume is controlled so that the volume from the direction in which the other terminal devices 31 to 33 are located becomes louder from the user's point of view according to the orientation in which the other terminal devices 31 to 33 are located.

According to such a communication system 1, the volume is controlled according to the positional relationship between the positions of the terminal devices 31 to 33 corresponding to the reproduced voice and the positions of the own terminal devices 31 to 33, so that the voice is heard. The user can intuitively grasp the positional relationship between the other terminal devices 31 to 33 and his / her own terminal devices 31 to 33.

Further, in the communication system 1, the server 10 converts voice information into characters and outputs the converted characters to the display device. According to such a communication system 1, it is possible to confirm the information missed by voice in characters.

Further, in the communication system 1, the CPU 41 of each terminal device 31 to 33 is used to display information indicating the state of the vehicle and the driving operation of the user (operating state of lights, wipers, televisions, radios, etc., traveling speed, traveling direction, etc.). The state, the value detected by the vehicle sensor, the control state such as the presence or absence of a failure, etc.) are transmitted together with the voice. In such a communication system 1, information indicating a user's driving operation can also be sent to other terminal devices 31 to 33.

Further, in the communication system 1, the advertisement is played by voice according to the positions of the terminal devices 31 to 33. The content of the advertisement is inserted in the server 10, and the advertisement is transmitted to the terminal devices 31 to 33 in which the server 10 reproduces the voice information. According to such a communication system 1, it is possible to provide a business model capable of earning advertising revenue.

Further, in the communication system 1, the distribution mode in which an unspecified number of communication partners are set and the dialogue mode in which a call is made with a specific communication partner are set to be changeable. According to such a communication system 1, it is possible to enjoy a call with a specific party.

Further, in the communication system 1, the server 10 detects from the voice information the amplitude of the input level and the polite expression included in the voice, such as the emotion when the user inputs the voice and the polite way of speaking. Do not deliver audio by users who have high emotions or do not speak politely. According to such a communication system 1, it is possible to eliminate a statement from a user that causes a quarrel.

Further, in the communication system 1, the server 10 notifies a user who speaks badly about a person or a user who has high emotions or does not speak politely, such as a false word. In this case, the judgment is made based on whether or not the word registered as a keyword as a bad word is included in the voice information. According to such a communication system 1, it is possible to urge the user who has made a mistake not to make a mistake.

Note that S102 corresponds to an example of processing as an input means, S114, S1202, S1204, and S1205 correspond to an example of processing as an acquisition means, S116 corresponds to an example of processing as a transmission means, and S811 corresponds to reproduction. It corresponds to an example of processing as a means.

[Other Embodiments]
The embodiment of the present invention is not limited to the above embodiment, and various forms may be adopted as long as it belongs to the technical scope of the present invention.

(1) In the above embodiment, the server 10 executes an extraction process for extracting voice information according to the terminal devices 31 to 33 that reproduce the voice from the accumulated voice information. (S1302 to S1312), and the present invention is not limited to this. For example, a part or all of such an extraction process may be executed by the terminal devices 31 to 33 that reproduce the sound. For example, the server 10 transmits audio information to the terminal devices 31 to 33 in a form that may include extra audio information that may not be reproduced by the terminal devices 31 to 33, and the terminal devices 31 to 33 receive the received audio. The audio information to be reproduced may be extracted from the information (unnecessary audio information is discarded). The transmission of voice information from the server 10 to the terminal devices 31 to 33 may be performed in response to a request from the terminal devices 31 to 33, or may be performed regardless of the request. ..

(2) In the above embodiment, the server 10 determines whether or not the content of each of the voice information of the transmission candidate is duplicated with other voice information (S1311), and when it is determined that the contents are duplicated (S1311: YES). ), The duplication of contents is eliminated (S1312). By doing so, it is possible to prevent the phenomenon that similar remarks are repeatedly reproduced, but from a different point of view, the greater the number of overlapping audio information, the higher the credibility of the content. Conceivable. Therefore, it may be a condition for reproducing the audio of the content that the number of audio information having duplicate contents is a certain number or more.

For example, the response processing shown in FIGS. 21A and 21B replaces the processing of S1311 to S1312 in the response processing of FIGS. 17A and 17B described above with the processing of S1401 to S1403. That is, in the response processing shown in FIGS. 21A and 21B, it is determined whether or not each of the voice information of the transmission candidate includes a specific preset keyword such as "accident" or "traffic control" (S1401). ).

Then, when it is determined that the voice information including the specific keyword exists in the voice information of the transmission candidate (S1401: YES), the same content (contents are duplicated) in the voice information including the specific keyword. (S) Determines whether or not there is less than a certain number (for example, three) of voice information (S1402). Here, when it is determined that there is less than a certain number of voice information having the same content (S1402: YES), the voice information of the content is excluded from the voice information of the transmission candidate (S1403). After that, the voice information of the transmission candidate is transmitted to the terminal devices 31 to 33 of the transmission source of the information request (S1313), and the response process is completed.

On the other hand, it is determined that there is no voice information including a specific keyword in the voice information of the transmission candidate (S1401: NO), or that there is no voice information having the same content less than a certain number. In the case (S1402: NO), the process proceeds to S1313 as it is, the voice information of the transmission candidate is transmitted to the terminal devices 31 to 33 of the transmission source of the information request (S1313), and the response process is terminated.

That is, according to the response processing illustrated in FIGS. 21A and 21B, the voice information including a specific keyword is not transmitted to the terminal devices 31 to 33 until a certain number of voice information having the same content is accumulated, and is constant. It is transmitted to the terminal devices 31 to 33 on condition that the number is reached. By doing so, it is possible to suppress the reproduction of unreliable voice such as false information on the terminal devices 31 to 33.

In the examples of FIGS. 21A and 21B, it is a condition for transmission that a certain number of voice information having the same content exists for voice information including a specific keyword, but the present invention is not limited to this. .. For example, it may be a condition for transmission that a certain number of voice information having the same content exists for all the voice information of the transmission candidate regardless of whether or not a specific keyword is included. Further, in determining whether or not a certain number of voices having the same content exist, even if there are a plurality of voice information having the same source, they may be counted as one (not counted as a plurality). By doing so, it is possible to prevent the same user from reciting the voice of the same content a plurality of times, so that the voice having low credibility of the content is reproduced by the terminal devices 31 to 33 of another user. it can.

(3) In the above embodiment, the terminal devices 31 to 33 for transmitting voice information perform a process of converting the recorded voice into synthetic voice (S107), but the present invention is not limited to this. .. For example, a part or all of such conversion processing may be executed by the server 10, or may be executed by the terminal devices 31 to 33 that reproduce the voice.

(4) In the above embodiment, the terminal devices 31 to 33 execute the request process (FIG. 16) at predetermined time intervals, but the present invention is not limited to this, and the request processing is executed at another predetermined timing. You may. For example, each time the vehicle travels a predetermined distance, it may be executed at the time of a request operation by the user, at the time of arrival of a designated time, at the time of passing through a designated point, at the time of leaving the surrounding area, and the like.

(5) In the above embodiment, the audio information in the surrounding area is extracted and reproduced, but the present invention is not limited to this. For example, an enlarged area including the surrounding area (wider than the surrounding area) may be set, audio information in the enlarged area may be extracted, and audio information in the peripheral area may be further extracted and reproduced. .. Specifically, in S1307 of the above embodiment, the voice information in the area where the vocalization position is expanded is extracted. Then, in the terminal devices 31 to 33, the voice information in the enlarged area received from the server 10 is stored (cached), and at the stage of reproducing the voice represented by the voice information, the voice information is stored in the peripheral area. Extract and play. In this way, even if the surrounding area based on the current location changes as the vehicle travels, if the surrounding area after the change is within the expanded area when the voice information is received, the voice information according to the surrounding area can be obtained. The represented voice can be played.

(6) In the above embodiment, the surrounding area is set based on the current location (actual position) of the vehicle, but the present invention is not limited to this, and location information other than the current location is acquired and acquired. The surrounding area may be set based on the position information. Specifically, the position information set (input) by the user may be acquired. In this way, for example, by setting the surrounding area based on the destination, the voice information transmitted in the vicinity of the destination can be confirmed in advance at a place far away from the destination.

(7) In the above embodiment, as the terminal device, terminal devices 31 to 33 configured as an in-vehicle device mounted on a vehicle are illustrated, but the terminal device is not limited thereto. For example, a device (such as a mobile phone) that can be carried by the user and used in a vehicle may be used. In addition, the terminal device shares at least a part of the configuration (for example, a configuration for detecting a position, a configuration for inputting voice, a configuration for reproducing voice, etc.) with a device mounted on the vehicle. It may or may not be shared.

(8) In the above embodiment, among the voice information transmitted from the other terminal devices 31 to 33 to the server 10, the voice represented by the voice information whose utterance position is set in the peripheral area set based on the current location. Although the configuration for reproducing the sound is illustrated, the present invention is not limited to this, and the audio information may be extracted and reproduced regardless of the position information.

(9) The information input by the terminal device from the user is not limited to the voice uttered by the user, and may be, for example, character information input by the user. That is, the terminal device may input character information from the user instead of (or together with the voice) uttered by the user. In this case, the terminal device may display the character information so that the user can see it, or may convert the character information into synthetic voice and reproduce it.

(10) The above embodiment is only an example of the embodiment to which the present invention is applied. The present invention can be realized in various forms such as a system, an apparatus, a method, a program, a recording medium for recording, and the like.

(11) In addition, the following may be performed.
For example, in the communication system 1, the content to be added as identification information (for example, real name, first nickname, second nickname, etc.) may be changed according to the communication mode. For example, information for identifying themselves may be exchanged in advance, and the identification information may be changed depending on whether or not the communication partner is a pre-registered partner.

Further, in the above embodiment, the keyword is configured to be replaced with another word or the like in any case, but for example, the process of replacing the keyword with another word or the like is not performed depending on the conditions such as the communication partner and the communication mode. May be good. This is because when communicating with a specific party, it is not necessary to perform such processing, unlike the case of distributing to the public.

In addition, for words that have no meaning peculiar to spoken words, such as "ah" and "um", voice information may be generated by omitting these words. In this case, the reproduction time of the audio information can be shortened by the amount omitted.

Further, in the above embodiment, the CPU 41 of each terminal device 31 to 33 outputs information indicating the state of the vehicle and the driving operation of the user in characters, but it may be output by voice. Further, for example, various information such as traffic jam information may be generated based on the information obtained from other terminal devices 31 to 33, and the generated information may be output.

Further, in the communication system 1, a configuration in which the terminal devices 31 to 33 directly exchange voice information and a configuration in which the terminal devices 31 to 33 exchange voice information via the server 10 are set in advance. It may be switched according to the specified conditions (for example, the distance to the base station connected to the server 10, the communication state between the terminal devices 31 to 33, the setting by the user, etc.).

Further, in the above embodiment, the advertisement is configured to be played by voice according to the position of the terminal devices 31 to 33, but the advertisement may be played by voice at regular time intervals and at regular voice information playback counts. .. Further, the content of the advertisement may be transmitted from the advertiser's terminal devices 31 to 33 to other terminal devices 31 to 33. At this time, the user can make a call (communication) with the advertiser by inputting a predetermined operation to the terminal devices 31 to 33, or guide the user of the terminal devices 31 to 33 to the advertiser's store. You may try to do it.

Further, in the above embodiment, a mode for communicating with a plurality of specific communication partners may be set. For example, in the case of a configuration in which position information is exchanged, terminal devices 31 to 33 within a certain distance may be used as communication partners, or a specific user (preceding vehicle, oncoming vehicle, etc. (number plate imaging using a camera, GPS). (Specified in), a user in a preset group may be used as a communication partner, and the communication partner may be changed by setting (communication mode can be changed).

Further, when the terminal devices 31 to 33 are mounted on the vehicle, the terminal devices 31 to 33 moving in the same direction on the same road are used as communication partners, or the terminal devices 31 in which the behaviors of the vehicles match. ~ 33 (such as removing it from the communication partner if it deviates from the side road) may be used as the communication partner.

In addition, another user may be specified and configured so that favorite registration, exclusion registration, and the like can be set in advance so that a favorite partner can be selected and communicated. In this case, when transmitting voice, the communication partner information that identifies the communication partner is transmitted, or if the server exists, the communication partner information is registered in the server, so that only the specified partner can be reached. It suffices to be able to transmit voice information.

Further, if a direction is associated with each switch such as a plurality of buttons and the user specifies the direction in which the communication partner is present with this switch, only the user in that direction may be set as the communication partner.

Further, although the communication system 1 is configured to exchange voice information, information composed of characters may be acquired, and this information may be converted into voice and reproduced. Further, when transmitting the voice, the voice may be converted into characters and then transmitted, and the voice may be restored and then reproduced. In this configuration, the amount of data to be transmitted by communication can be reduced.

Further, in the configuration in which data is transmitted by characters in this way, the data may be transmitted after being translated into the language having the smallest amount of data among the plurality of preset languages.

Further, the terminal devices 31 to 33 may perform a part of the functions of the server 10 of the above embodiment. For example, in the CPU 41 of the terminal devices 31 to 33, when there are a plurality of voice information whose reproduction has not been completed, the voice corresponding to each voice information may be arranged so as not to be duplicated before being reproduced. The CPU 41 may generate new voice information in which identification information for identifying the user is added by voice to the voice information input by the user, and transmit the generated voice information.

Specifically, in the voice transmission processing and the voice reproduction processing, a part of the voice distribution processing may be performed. For example, when a part of the audio distribution process is performed in the audio reproduction process, as shown in FIGS. 22A-22D, between S802 and S804 of the audio reproduction process, the audio distribution processes S703 to S722 (S717). ) May be carried out.

Even in such a communication system, when the voice is reproduced, the voice can be reproduced so as not to be duplicated, so that the voice can be easily heard. Further, even in such a communication system 1, since the identification information for identifying the user can be added by voice, the user does not speak his / her own identification information, and the voice source can be added to another user. The user can be notified.

Further, in the above embodiment, it is prohibited to reproduce the sound in duplicate, but a part of the sound may be reproduced in duplicate. In this case, only the last few seconds of the previous voice and the first few seconds of the later voice may overlap. In this case, the fade-out effect of gradually reducing the volume at the end of the preceding voice and the fade-in effect of gradually increasing the volume at the beginning of the subsequent voice may be combined.

Further, it may be determined whether or not the driver is dozing off based on the presence or absence of the voice emitted by the user. In order to realize this configuration, for example, the doze determination process shown in FIG. 23 may be performed.
The doze determination process is a process performed in parallel with the voice transmission process in the terminal devices 31 to 33, and an alarm is given when the user does not speak for a certain period of time or when it is estimated that the consciousness level is low even if the user speaks. It is a process of issuing a vehicle or controlling a vehicle such as stopping. Specifically, as shown in FIG. 23, first, the time from the last occurrence by the user is counted (S1401).

Then, it is determined whether or not a preset first reference time (for example, about 10 minutes) has elapsed from the final utterance by the user (S1402). If the first reference time has not elapsed (S1402: NO), the doze determination process ends.

If the first reference time has elapsed (S1402: YES), the user is asked a question (S1403). In this process, the user asks a question that prompts the user to speak in order to confirm the level of consciousness. For this reason, it may be a direct question such as "Are you awake?" Or an indirect question such as "Please tell me the current time".

Subsequently, it is determined whether or not a response to such a question has been obtained (S1404). If a response to the question is obtained (S1404: YES), the level of the response is determined (S1405).

Here, the response level indicates an item whose level (loudness, accuracy by voice recognition) decreases when sleepy, such as loudness of voice and smooth tongue, and any of these items is used in this process. And the preset threshold value are compared to make a judgment.

If the response level is sufficiently high (S1405: YES), the doze determination process ends. Further, when the response level is insufficient (S1405: NO) and when the response to the question is not obtained in the processing of S1404 (S1404: NO), the first criterion described above is obtained from the final utterance by the user. It is determined whether or not the second reference time (for example, about 10 minutes and 10 seconds) set to a value equal to or longer than the time has elapsed (S1406).

If the second reference time has not elapsed (S1406: NO), the process returns to S1403. If the second reference time has elapsed (S1406: YES), an alarm is issued via the speaker 53 or the like (S1407).

Subsequently, it is determined whether or not a response to the alarm (for example, a voice such as "Wow" or an operation via the input unit 45 for canceling the alarm) has been obtained (S1408). If a response to the alarm is obtained (S1408: YES), the level of the response is determined (S1409) in the same manner as in the processing of S1405. When an operation is input via the input unit 45, it is determined that the response level is sufficient.

If the response level is sufficiently high (S1409: YES), the doze determination process ends. Further, when the response level is insufficient (S1409: NO) and when the response to the question is not obtained in the processing of S1408 (S1408: NO), the second criterion described above is obtained from the final utterance by the user. It is determined whether or not the third reference time (for example, about 10 minutes and 30 seconds) set to a value equal to or longer than the time has elapsed (S1410).

If the third reference time has not elapsed (S1410: NO), the process returns to S1407. Further, if the third reference time has elapsed (S1410: YES), vehicle control such as stopping the vehicle is performed (S1411), and the doze determination process is terminated.

By carrying out such a process, it is possible to suppress the user (driver) from falling asleep.
Further, when the advertisement is inserted by voice (S720) or when the voice is displayed by characters (S812), additional character information may be further displayed on a display such as the navigation device 48.

In order to realize such a configuration, for example, the additional information display process shown in FIG. 24 may be performed. The additional information display process is a process performed on the server 10 in parallel with the voice distribution process.

In the additional information display processing, as shown in FIG. 24, first, it is determined whether or not an advertisement (CM) is inserted (S1501) and whether or not a character is displayed (S1502) in the voice distribution processing. When the advertisement is inserted (S1501: YES) or the character is displayed (S1502: YES), the information related to the character to be displayed is acquired (S1503).

Here, the information related to the character is associated with this character string, for example, an advertisement or area information corresponding to the character string (keyword) to be displayed, or information for explaining information about the character string. The information is applicable. This information may be acquired from inside the server 10 or from outside the server 10 (on the Internet, etc.).

When the information related to the characters is acquired, this information is displayed on the display as characters or images (S1504), and the additional information display process is terminated.
If no advertisement is inserted and characters are not displayed in the processes of S1501 and S1502 (S1501: NO and S1502: NO), the additional information display process is terminated.

According to such a configuration, not only the voice can be displayed as characters, but also related information can be displayed.
The display for displaying the character information is not limited to the display of the navigation device 48, and may be any display such as a head-up display in the vehicle.

1 ... Communication system, 10 ... Server, 20 ... Base station, 31-33 ... Terminal device, 41 ... CPU, 42 ... ROM, 43 ... RAM, 44 ... Communication unit, 45 ... Input unit, 48 ... Navigation device, 49 ... GPS receiver, 52 ... microphone, 53 ... speaker

The present invention relates to a voice reproduction device configured to reproduce voice information and a vehicle provided with the voice reproduction device .

It is preferable that even a user who has difficulty in operating or visually recognizing the voice reproduction device can safely send and receive the transmitted contents such as the contents to be tweeted.

Claims (3)

A communication system equipped with a plurality of terminal devices capable of communicating with each other.
Each terminal device
A voice input conversion means that converts the voice into a voice signal when the user inputs the voice,
A voice transmission means for transmitting the voice signal to a device including another terminal device,
A voice receiving means for receiving a voice signal transmitted by another terminal device, and
Audio reproduction means for reproducing the received audio signal,
With
The audio reproduction means is a communication system in which, when there are a plurality of audio signals whose reproduction has not been completed, the audio corresponding to each audio signal is arranged so as not to overlap and then reproduced. A communication system including a plurality of terminal devices and a server device capable of communicating with each of the plurality of terminal devices.
Each terminal device
A voice input conversion means that converts the voice into a voice signal when the user inputs the voice,
A voice transmission means for transmitting the voice signal to the server device, and
A voice receiving means for receiving a voice signal transmitted by the server device, and
Audio reproduction means for reproducing the received audio signal,
With
The server device
It is provided with a distribution means that receives voice signals transmitted from the plurality of terminal devices, arranges the voices corresponding to the voice signals so as not to overlap, and then distributes the voice signals to the plurality of terminal devices. ,Communications system. In the communication system according to claim 1 or 2.
The voice reproduction means is a communication system that reproduces an already reproduced voice signal when a specific command is received by the user.

Images