CN113225243A

CN113225243A - Voice output device and voice output method

Info

Publication number: CN113225243A
Application number: CN202010081243.8A
Authority: CN
Inventors: 丛玉琳
Original assignee: Alpine Electronics Inc
Current assignee: Alpine Electronics Inc
Priority date: 2020-02-06
Filing date: 2020-02-06
Publication date: 2021-08-06

Abstract

The invention provides a voice output device and a voice output method, which can make a user easily grasp the content of a message according to each sender even if a plurality of messages are received from different senders in a short time. When three or more messages are received within a monitoring period and when there is a message with a duplicate sender among the three or more received messages, an in-vehicle device (2) as a voice output device outputs the messages in a voice manner in order of the messages with the duplicate sender continuing.

Description

Voice output device and voice output method

Technical Field

The present invention relates to a voice output device and a voice output method, and is particularly suitable for a voice output device and a voice output method for outputting a received message in a voice manner.

Background

Conventionally, there is a voice output device mounted on a vehicle, configured to be able to receive a message in a chat application or a message (mail) in a mail system, and to output the contents thereof in voice when receiving the message. Such a voice output device generally performs voice output of messages in the order in which the messages are received. Patent document 1 describes the following technique: when outputting a plurality of voice messages, one or more voice messages are selected from among the voice messages so that the sum of the reproduction times falls within a predetermined time limit, and the reproduction order of each voice message is determined based on the attribute information of each voice message.

Prior art documents:

patent documents:

patent document 1: japanese patent laid-open No. 2014-63054

Disclosure of Invention

However, the conventional voice output device described above has the following problems. That is, in the conventional voice output device, since the messages are output in the receiving order uniformly, when a plurality of messages are received from different senders in a short time, even if a plurality of messages having correlation are received from a certain sender, the messages of the different senders are output by voice alternately. When this occurs, it is difficult for the user to grasp the contents of the message for each sender, and for example, it is necessary to perform a troublesome task such as re-listening to a message received in the past for each sender.

The present invention has been made to solve the above-described problems, and an object of the present invention is to enable a user to easily grasp the contents of a message for each sender even when a plurality of messages are received from different senders in a short time.

In order to solve the above problem, according to the present invention, when three or more messages are received within a monitoring period and when there is a message that overlaps with the sender among the three or more received messages, the messages are outputted as voice in the order in which the messages that overlap with the sender continue.

The invention has the following effects:

according to the present invention configured as described above, when three or more messages are received from different senders within a monitoring period and when a plurality of messages sent from a common sender are included in the three or more messages, the plurality of messages sent from the common sender are collected continuously and outputted as voice. Therefore, it is easy for the user to grasp the content of the message for each sender.

Drawings

Fig. 1 is a block diagram showing an example of a functional configuration of a speech output system according to a first embodiment of the present invention.

Fig. 2 is a diagram showing the contents of message data.

Fig. 3 is a diagram for explaining the processing of the procedure determining unit according to the first embodiment of the present invention.

Fig. 4 is a flowchart showing an example of the operation of the in-vehicle device according to the first embodiment of the present invention.

Fig. 5 is a flowchart showing an example of the operation of the in-vehicle device according to the first embodiment of the present invention.

Fig. 6 is a flowchart showing an example of the operation of the in-vehicle device according to the first embodiment of the present invention.

Fig. 7 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the first modification of the first embodiment of the present invention.

Fig. 8 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the second modification of the first embodiment of the present invention.

Fig. 9 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the third modification of the first embodiment of the present invention.

Fig. 10 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the fourth modification of the first embodiment of the present invention.

Fig. 11 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the fifth modification of the first embodiment of the present invention.

Fig. 12 is a diagram showing start timings and end timings of voice output of a plurality of message voice data.

Fig. 13 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the sixth modification of the first embodiment of the present invention.

Fig. 14 is a flowchart showing an example of the operation of the in-vehicle apparatus according to the seventh modification of the first embodiment of the present invention.

Fig. 15 is a block diagram showing an example of a functional configuration of the speech output system according to the first embodiment of the present invention.

Fig. 16 is a diagram for explaining the processing of the procedure determining unit according to the second embodiment of the present invention.

Fig. 17 is a flowchart showing an example of the operation of the in-vehicle device according to the second embodiment of the present invention.

Fig. 18 is a flowchart showing an example of the operation of the in-vehicle device according to the second embodiment of the present invention.

Description of the reference numerals

2. 2A vehicle device (Voice output device)

11 message receiving part

12. 12A reception determination unit

13. 13A repeat sender determination unit

14. 14A order determination unit

15. 15A voice output part

Detailed Description

< first embodiment >

Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a block diagram showing an example of a functional configuration of the speech output system 1. As shown in fig. 1, the speech output system 1 includes an in-vehicle device 2 (corresponding to a "speech output device" in the claims) and a portable terminal 3 according to the present embodiment. The in-vehicle device 2 is a device mounted on a vehicle, and as an example, a so-called car navigation system can function as the in-vehicle device 2. The in-vehicle device 2 is connected to a voice processing device 4 provided in the vehicle. The voice processing device 4 includes a D/a converter, an amplifier, and a speaker provided in the vehicle, and performs D/a conversion and amplification on an input voice signal, and outputs the signal as voice from the speaker.

The portable terminal 3 is a portable terminal that is brought into the vehicle by a vehicle occupant, and as an example, a so-called smart phone, a mobile phone other than a smart phone, or a tablet computer can be made to function as the portable terminal 3. The mobile terminal 3 is provided with a text chat application (hereinafter referred to as "chat application") that enables messages to be exchanged with others in the form of a chat. The chat application has a function of providing a user interface related to text chat in the mobile terminal 3, and a function of transmitting message data MD to the in-vehicle device 2 in response to reception of a message (the function will be described in detail later). Hereinafter, the owner of the mobile terminal 3 will be referred to as "user". In the present embodiment, the user listens to the message output by the in-vehicle device 2.

As shown in fig. 1, the in-vehicle device 2 includes, as a functional configuration, an in-vehicle device side communication unit 10, a message receiving unit 11, a reception determination unit 12, a repeat originator determination unit 13, a sequence determination unit 14, and a voice output unit 15. The mobile terminal 3 includes a mobile terminal side communication unit 16 and a chat application execution unit 17 as functional configurations. Each of the functional blocks 10 to 17 may be configured by any of hardware, a DSP (Digital Signal Processor), and software. For example, when the functional blocks are constituted by software, the functional blocks 10 to 17 are actually constituted by a CPU, a RAM, a ROM, or the like of a computer, and are realized by operating a program stored in a recording medium such as a RAM, a ROM, a hard disk, or a semiconductor memory. The same applies to the second embodiment described later. The mobile terminal 3 includes a mobile terminal-side storage unit 18 as a storage medium. The portable terminal side storage unit 18 stores a registered person database 19. The registered person database 19 will be described later.

The in-vehicle device side communication unit 10 of the in-vehicle device 2 and the portable terminal side communication unit 16 of the portable terminal 3 perform wireless communication in accordance with a predetermined communication standard for wireless communication. The communication standard of wireless communication is, for example, a communication standard of Bluetooth (registered trademark) or wireless LAN. The in-vehicle device 2 and the portable terminal 3 may be connected by wire, and the in-vehicle device side communication unit 10 and the portable terminal side communication unit 16 may perform wire communication according to a predetermined communication standard for wire communication. The chat application execution unit 17 of the mobile terminal 3 reads out and executes the chat application and a program (including a program and an API that are part of the OS) attached to the chat application by hardware such as a CPU, and executes various processes.

The following describes in detail the processing of the mobile terminal 3 and the in-vehicle device 2 after the mobile terminal 3 receives the text chat message.

The mobile terminal 3 can access a network N including the internet. The access to the network N may be performed by directly accessing the mobile communication network, or may be performed by indirectly accessing the mobile communication network by using a binding (tethering) function of the portable router. When a message for a text chat is transmitted from another terminal having a chat application installed therein to the mobile terminal 3, the chat application execution unit 17 of the mobile terminal 3 receives the message. In the present embodiment, basically, a message can be received only from a person registered in the registered person database 19 (hereinafter referred to as a "registered person"). In response to the reception of the message, chat application execution unit 17 executes predetermined processing such as voice output, vibration of the housing of mobile terminal 3, or the like to notify the user of the reception of the message, or display of necessary information on the display device of mobile terminal 3.

In addition to this processing, the chat application execution unit 17 according to the present embodiment controls the mobile terminal side communication unit 16 to transmit the message data MD to the mobile terminal 3. Fig. 2 is a diagram showing the contents of the message data MD. As shown in fig. 2, the message data MD includes a message ID, a sender ID, reception date and time information, and text data for voice output. The message ID is identification information uniquely assigned to each message, and is generated by the chat application execution unit 17 each time a message is received. The originator ID is identification information uniquely assigned for each originator, and is managed for each registered person who can become an originator in the registered person database 19 of the portable terminal side storage unit 18. The reception date and time information is information indicating the date and time when the message was received.

The text data for speech output is data in which output message information is described in text, and the output message information is configured to include supplemental information and a message body. As described below, the information described as text data for speech output is finally speech-output by the in-vehicle device 2. The supplementary information is information for supplementing and conveying matters related to the message body before outputting the message body as voice. In the present embodiment, the supplementary information is information including the name of the sender and the date and time of reception of the message. For example, the chat application executing unit 17 may receive hello from the sender with the name "AA" at "10 months, 1 days, 13 hours, and 30 minutes". "this message body. Then, the information described as text in the text data for voice output is "10 months, 1 days, 13 points, 30 points. From AA. You are good. ". The text data for voice output is generated by the chat application execution unit 17. When the message body contains a symbol, a stamp, and a graphic character, the chat application execution unit 17 executes omission, conversion to information expressed as text, and the like according to a predetermined rule. The registered person database 19 of the portable terminal side storage unit 18 manages the name of the sender for each registered person who can become the sender.

When the chat application execution unit 17 transmits the message data MD, the message reception unit 11 of the in-vehicle device 2 controls the in-vehicle device communication unit 10 to receive the message data MD, and stores the received message data MD in the first buffer 22. The first buffer 22 is a storage area formed in a work area such as a RAM. The message data MD is a target to be received as a message by the message receiving unit 11, and corresponds to a "message" in the claims.

As a result of the above processing between the chat application executing unit 17 and the message receiving unit 11, the message data MD is immediately stored in the first buffer 22 in response to the reception of the message by the chat application executing unit 17. Therefore, when the chat application executing unit 17 receives a plurality of (for example, five) messages in a short time, the message data MD corresponding to all the messages is stored in the first buffer 22 in the short time. In addition, the date and time of reception of one message is synchronized with the date and time of storage of the message data MD corresponding to the one message in the first buffer 22.

The reception determination unit 12 of the in-vehicle device 2 determines whether or not three or more messages are received by the message reception unit 11 during the monitoring period. The processing of the reception determination unit 12 will be described in detail below.

It is assumed that the current time is not the monitoring period (described later). While the message reception unit 11 is not monitoring the period, the reception determination unit 12 monitors whether or not the message data MD is newly received. The reception determination unit 12 refers to the first buffer 22, monitors whether or not the message data MD is newly stored in the first buffer 22, and monitors whether or not the message data MD is received.

When the message data MD is newly received by the message receiving unit 11, the reception determination unit 12 sets a predetermined time as a monitoring period from the timing when the message data MD is received. In the present embodiment, the monitoring period is set to "5 seconds". Hereinafter, the message data MD newly stored in the first buffer 22 during a period other than the monitoring period is referred to as "initial storage data".

Next, the reception determination unit 12 stands by until the monitoring period elapses, and determines whether or not three or more message data MD including the first stored data are received by the message reception unit 11 during the monitoring period after the monitoring period elapses. When three or more message data MD are not stored in the first buffer 22 after the monitoring period elapses (when two or less message data MD are stored), the reception determination unit 12 outputs the normal output instruction information to the voice output unit 15.

On the other hand, when three or more message data MD are received by the message receiver 11 after the monitoring period has elapsed, the reception determiner 12 outputs the first plurality of reception notification information to the repeat originator determiner 13.

When the reception determination unit 12 determines that three or more messages have been received within the monitoring period, the repeat originator determination unit 13 of the in-vehicle device 2 determines whether there is a message whose originator is repeated among the three or more messages received within the monitoring period. The process of the repeat originator determination unit 13 will be described in detail below.

When the first plurality of reception notification information is input from the reception determination unit 12, the repeat originator determination unit 13 refers to the originator IDs of the three or more message data MD stored in the first buffer 22, and determines whether or not there is one or more message data MD whose originator ID values match. For example, the sender IDs are set to "S01", "S02", "S03", "S04", and "S05", respectively, for five message data MDs. In this case, since there are no message data MD of which sender ID values match, the repeat sender determination unit 13 determines that there are no message data MD of which sender ID values match.

For example, the sender IDs are "S01", "S01", "S01", "S03" and "S04" for five message data MDs, respectively. In this case, since there is one set of message data MD in which the sender ID values match (set of three "S01"), there is one or more set of message data MD in which the repeat sender determination unit 13 determines that the sender ID values match. For example, the sender IDs are "S01", "S01", "S02", "S03" and "S03" for five message data MDs, respectively. In this case, since there are two sets of message data MD in which the sender ID values match (two sets of "S01" and two sets of "S03"), the repeat sender determination unit 13 determines that there is one or more sets of message data MD in which the sender ID values match.

When there are no message data MD of which sender ID values match, the repeat sender determination unit 13 outputs normal output instruction information to the voice output unit 15.

On the other hand, when there is one or more sets of message data MD in which the sender ID values match, the repeat sender determination unit 13 outputs the first repeat notification information to the order determination unit 14.

When the repeat originator determining unit 13 determines that there is an originator-duplicated message among three or more messages received within the monitoring period, the order determining unit 14 of the in-vehicle device 2 determines the voice output order of the three or more messages received within the monitoring period so that the originator-duplicated messages are consecutive. The process of the procedure determining unit 14 will be described in detail below.

When the first repeat notification information is input from the repeat originator determining unit 13, the order determining unit 14 determines the speech output order of the plurality of message data MD stored in the first buffer 22 by the following method. The voice output sequence means a sequence of voice output when the voice output unit 15 then outputs voice to the output message information described in the text data for voice output of the message data MD. In the following description, for convenience of explanation, a case where the message data MD is voice-output using the output message information described in the text data for voice output may be referred to as "voice-output using the message data MD" or "voice-output using the message voice data" (the message voice data will be described later).

That is, the order determination unit 14 groups the message data MD according to the sender ID. It is also possible to generate a group to which only one message data MD belongs. For example, it is assumed that five message data MD11 to MD15 illustrated in fig. 3(a) are stored in the first buffer 22. In the example of fig. 3(a), the originator ID of the message data MD11, MD13 is "X01", the originator ID of the message data MD12, MD14 is "X02", and the originator ID of the message data MD15 is "X03". In this case, the order determination unit 14 groups the message data MD into three groups, that is, a group whose originator ID is "X01" to which the message data MD11 and MD13 belong, a group whose originator ID is "X02" to which the message data MD12 and MD14 belong, and a group whose originator ID is "X03" to which the message data MD15 belongs.

Next, the order determination unit 14 specifies the reception date and time of the message data MD having the earliest reception date and time in each group (hereinafter referred to as "group earliest reception date and time"). In the example of fig. 3(a), the order determination unit 14 determines the reception date and time (10/1/13:00:00.001) of the message data MD11 as the group first reception date and time for the group whose originator ID is "X01", determines the reception date and time (10/1/13:00:00.050) of the message data MD12 as the group first reception date and time for the group whose originator ID is "X02", and determines the reception date and time (10/1/13:00:03.050) of the message data MD15 as the group first reception date and time for the group whose originator ID is "X03".

Next, the order determination unit 14 sorts each group in the order of the group first reception date and time from morning to evening, and sorts the message data MD in each group in the order of the reception date and time from morning to evening, and sets the ranking order at this time as the voice output order. In the example of fig. 3(a), the order determination unit 14 arranges groups in order of < a group whose sender ID is "X01" (group reception date and time first is "10/1/13: 00: 00.001") > → < a group whose sender ID is "X02" (group reception date and time first is "10/1/13: 00: 00.050") > → < a group whose sender ID is "X03" (group reception date and time first is "10/1/13: 00: 03.050") > and arranges the message data MD in the order of reception date and time from the morning to the evening within each group, and sets the arrangement order at this time as a voice output order. As a result, as shown in fig. 3(B), the speech output sequence becomes "MD 11 → MD13 → MD12 → MD14 → MD 15".

In the above-described method, the order determination unit 14 determines the voice output order, and therefore message data MD that the sender repeats (i.e., the sender ID has the same value) is continuous in the voice output order. After determining the speech output order, the order determination unit 14 outputs first speech output order information indicating the speech output order to the speech output unit 15.

The voice output unit 15 outputs voice for three or more messages received during the monitoring period based on the voice output order determined by the order determination unit 14. The processing of the voice output unit 15 will be described in detail below.

When the normal output instruction information is input, the voice output unit 15 reads the message data MD stored in the first buffer 22 in the order stored in the first buffer 22, and performs voice output in a normal manner. This process is omitted. In addition, the message data MD is deleted from the first buffer 22 when being read out from the first buffer 22.

On the other hand, when the first speech output order information is input from the order determination unit 14, the speech output unit 15 reads the message data MD from the first buffer 22 in the speech output order indicated by the first speech output order information. Each time the message data MD is read, the speech output unit 15 generates speech data (hereinafter referred to as "message speech data") for outputting, as speech, output message information described as text in the text data for speech output based on the text data for speech output included in the message data MD, and stores the speech data in the second buffer 23. The message voice data is, for example, voice waveform data obtained by sampling voice at a predetermined sampling cycle (16 kHz as an example). The second buffer 23 is a storage area formed in a work area of a RAM or the like. In addition, the generation of the message voice data may be appropriately performed using a voice synthesis technique, other existing techniques. As a result, the message voice data corresponding to each message data MD is stored in the second buffer 23 in the voice output order determined by the order determination unit 14.

Next, the voice output unit 15 reads the message voice data stored in the second buffer 23 in the order stored in the second buffer 23 (i.e., the voice output order), and outputs the voice signal based on the message voice data to the voice processing device 4, thereby causing the voice processing device 4 to voice-output the voice based on the message voice data. As a result, the three or more message data MD received during the monitoring period are sequentially outputted in accordance with the voice output order determined by the order determination unit.

Here, in the present embodiment, the length of the monitoring period is set to "5 seconds". This is because of the following reason. That is, when a certain message data MD is received during a period other than the monitoring period, the message data MD is not outputted with voice at least during the monitoring period from the timing when the message data MD is received. Therefore, the longer the length of the monitoring period, the longer the time lag between the timing of receiving the message data MD and the timing of outputting the message data MD. On the other hand, if the monitoring period is too short, the possibility of receiving a plurality of message data MD of a common sender within one monitoring period is reduced. Accordingly, the length of the monitoring period is set to the time of "5 seconds". However, the length of the monitoring period may be set in consideration of the above-described situation, and may be a length other than "5 seconds".

As described above in detail, when three or more message data MD (messages) are received within the monitoring period and when there is message data MD for which the sender overlaps among the three or more received message data MD, the in-vehicle device 2 according to the present embodiment outputs the message data MD by voice in the order in which the message data MD for which the sender overlaps are continuous.

According to this configuration, when three or more messages are received from different senders within the monitoring period, and when a plurality of messages sent from a common sender are included among the three or more messages, the plurality of messages sent from the common sender are continuously collected and output as voice. Therefore, it is easy for the user to grasp the content of the message for each sender.

Next, the operation of the in-vehicle device 2 according to the present embodiment will be described with reference to a flowchart. First, the operation of the main part of the in-vehicle device 2 will be described with reference to a flowchart FA in fig. 4. As shown in fig. 4, the reception determination unit 12 determines whether or not three or more message data MD have been received by the message reception unit 11 during the monitoring period (step SA 1). When the reception determination unit 12 determines that three or more messages have been received within the monitoring period, the repeat originator determination unit 13 determines whether or not there is a message whose originator is repeated among the three or more messages received within the monitoring period (step SA 2).

When the repeat originator determining unit 13 determines that there is an originator-repeated message among three or more messages received within the monitoring period, the order determining unit 14 determines the voice output order of the three or more messages received within the monitoring period so that the originator-repeated messages are consecutive (step SA 3). The voice output unit 15 outputs voice for three or more messages received during the monitoring period in accordance with the voice output order determined by the order determination unit 14 (step SA 4).

Next, the detailed operation of the in-vehicle device 2 will be described with reference to a flowchart. The flowchart FB in fig. 5(a) is a flowchart showing the operation of the message receiver 11. The message receiving unit 11 repeatedly executes the processing of the flowchart FB. As shown in fig. 5a, the message receiver 11 monitors whether or not the message data MD is received (step SB 1). When received (yes in step SB1), the message receiver 11 stores the received message data MD in the first buffer 22 (step SB 2).

The flowchart FC in fig. 5(B) is a flowchart showing the operation of the reception determination unit 12. The reception determination unit 12 repeatedly executes the processing of the flowchart FC. At the start time of the flowchart FC, a period other than the monitoring period is set. As shown in fig. 5B, the reception determination unit 12 monitors whether or not the message data MD is newly received by the message reception unit 11 (whether or not the message data MD is newly stored in the first buffer 22) (step SC 1). When received (yes in step SC1), the reception determination unit 12 sets a predetermined time (in the present embodiment, "5 seconds") as a monitoring period from the timing at which the new message data MD is stored (step SC 2). Next, the reception determination unit 12 waits for a monitoring period, and determines whether or not three or more message data MD including the first-time stored data are received by the message reception unit 11 during the monitoring period (step SC 3).

When three or more message data MD are not received after the monitoring period elapses (no in step SC3), the reception determination unit 12 outputs the normal output instruction information to the speech output unit 15 (step SC 4). On the other hand, when three or more message data MD are received after the monitoring period elapses, the reception determination unit 12 outputs the first plurality of reception notification information to the repeat originator determination unit 13 (step SC 5).

The flowchart FD in fig. 5(C) is a flowchart showing the operation of the repeat originator determining unit 13. The repeat sender determination unit 13 repeatedly executes the process of the flowchart FD. As shown in fig. 5C, the repeat sender determining unit 13 monitors whether or not the first plurality of reception notification information is input from the reception determining unit 12 (step SD 1). When the first plurality of reception notification information items are input (step SD1), the repeat originator determination unit 13 determines whether or not there is any message data MD in which one or more originator IDs have the same value, for the three or more message data MD stored in the first buffer 22 (step SD 2).

When none of the message data MD sets having the same sender ID value exists (NO in step SD2), the repeat sender determination unit 13 outputs the normal output instruction information to the speech output unit 15 (step SD 3). On the other hand, when there is one or more sets of message data MD for which the sender ID values match (yes in step SD2), the repeat sender determination unit 13 outputs the first repeat notification information to the sequence determination unit 14 (step SD 4).

The flowchart FE in fig. 6(a) is a flowchart showing the operation of the order determination unit 14. The procedure determining unit 14 repeatedly executes the process of the flowchart FE. As shown in fig. 6 a, the sequence determining unit 14 monitors whether or not the first repeat notification information is input from the repeat sender determining unit 13 (step SE 1). When the first duplicate notification information is input (yes in step SE1), the order determination unit 14 groups the message data MD for each sender ID (step SE 2). Next, the order determination unit 14 specifies the group first reception date and time of each group (step SE 3).

Next, the order determination unit 14 sorts each group in the order of the reception date and time of the group first from the morning to the evening, and arranges the message data MD in the order of the reception date and time from the morning to the evening within each group, and sets the arrangement order at this time as the speech output order (step SE 4). Next, the sequence determining unit 14 outputs the first speech output sequence information indicating the speech output sequence to the speech output unit 15 (step SE 5).

The flowchart FF in fig. 6(B) is a flowchart showing the operation of the voice output unit 15. The voice output unit 15 repeatedly executes the processing of the flowchart FF. As shown in fig. 6B, the voice output unit 15 monitors whether or not the normal output instruction information is input from the reception determination unit 12 or the repeat originator determination unit 13 (step SF1), and also monitors whether or not the first voice output sequence information is input from the sequence determination unit 14 (step SF 2). When the normal output instruction information is input (yes in step SF1), the message data MD stored in the first buffer 22 is outputted as a voice in a normal manner in the order of being stored in the first buffer 22 (step SF 3).

When the first speech output order information is input (yes in step SF2), the speech output unit 15 reads the message data MD from the first buffer 22 in the speech output order indicated by the first speech output order information, generates message speech data based on the read message data MD, and stores the message speech data in the second buffer 23 (step SF 4). Next, the voice output unit 15 sequentially reads the message voice data stored in the second buffer 23 and outputs the voice signal to the voice processing device 4, thereby voice-outputting the output message information (step SF 5).

< first modification of the first embodiment >

Next, a first modification of the first embodiment will be described with reference to fig. 1. In the present modification, the order determination unit 14 analyzes the content of the message repeated by the sender when the repeat sender determination unit 13 determines that there is a sender-repeated message among three or more messages received within the monitoring period, and continues the messages when the correlation of the content is high. The process of the procedure determining unit 14 of the present modification will be described in detail below.

The order determination unit 14 groups the three or more message data MD stored in the first buffer 22 into packets according to the sender ID, as in the first embodiment. Next, the order determination unit 14 executes the following processing for the group to which the plurality of message data MD belong. That is, the contents of message bodies included in a plurality of message data MD (hereinafter, simply referred to as "contents of message data MD") are analyzed, and the message data MD having a high degree of correlation with the contents of the message bodies are further grouped so as to belong to one group.

The order determination unit 14 determines the degree of correlation between the contents of the plurality of message data MD by, for example, the following method. That is, the order determination unit 14 performs morphological analysis, syntactic analysis, and semantic analysis on the content of each message data MD by using a conventional technique related to natural language processing. Further, the order determination unit 14 performs context (context) analysis for the contents of the plurality of message data MD, analyzes the degree of correlation between the content of one message data MD and the content of the other message data MD, and calculates a score indicating the degree of correlation. The analysis of the degree of relevance is performed based on the existing technology related to natural language processing, taking into account the grammatical or lexical relationship and context of the content of each message data MD (not only the relevance of the article itself but also the concept of the environment including the cultural environment and situation). The order determination unit 14 determines that the degree of correlation is high when the score indicating the degree of correlation is equal to or greater than the threshold, and determines that the degree of correlation is low when the score is less than the threshold. The illustrated method is an example, and the correlation may be analyzed by another method. For example, when the message body includes subject names, the order determination unit 14 may determine that the degree of correlation is high when the subject names have commonality.

For example, when the message data MD are grouped into three groups of groups A, B, C, the groups are grouped into groups of sender IDs. The four message data MD belong to the group a, and the four message data MD belonging to the group a are set as the first data MS1, the second data MS2, the third data MS3, and the fourth data MS 4. In this case, the order determining unit 14 determines that the correlation between the first data MS1 and the second data MS2 is high and the correlation between the third data MS3 and the fourth data MS4 is high among the four message data MD belonging to the group a. Then, the order determination unit 14 further groups the four data items so that the first data MS1 and the second data MS2 belong to one group and the third data MS3 and the fourth data MS4 belong to the other group.

Thereafter, the order determination unit 14 sorts each group in the order of the reception date and time of the group first from the morning to the evening, and sorts the message data MD in the order of the reception date and time from the morning to the evening in each group, and sets the ranking order at this time as the voice output order, by the same method as the first embodiment.

According to the present modification, even when a plurality of message data MD whose senders are common and whose contents of message bodies have a high degree of correlation are received during the monitoring period, the plurality of message data MD whose senders are common and whose contents of message data MD have a high degree of correlation are continuously collected and output as voice even when another message data MD is received between timings of receiving the respective data. Therefore, it is easy for the user to grasp the contents of such a plurality of message data MD.

The flowchart FG in fig. 7 is a flowchart showing the operation of the procedure determining unit 14 in the present modification. The order determination unit 14 repeatedly executes the processing in the flowchart FG. As shown in fig. 7, the sequence determination unit 14 monitors whether or not the first repeat notification information is input from the repeat sender determination unit 13 (step SG 1). When the first duplicate notification information is input (yes in step SG1), the sequence determination unit 14 groups the message integrated data MS for each sender ID (step SG 2).

Next, the order determination unit 14 further groups the groups to which the plurality of message data MD belong so that the message data MD having a high degree of correlation with the content of the message body belongs to one group (step SG 3). Next, the order determination unit 14 specifies the group first reception date and time of each group (step SG 4). Next, the order determination unit 14 sorts each group in the order of the group first reception date and time from morning to evening, sorts the message data MD in each group in the order of the reception date and time from morning to evening, and sets the ranking order at this time as the speech output order (step SG 5). Next, the order determination unit 14 outputs first speech output order information indicating the speech output order to the speech output unit 15 (step SG 6).

< second modification of the first embodiment >

Next, a second modification of the first embodiment will be described with reference to fig. 1. In the order determination unit 14 according to this modification, when the repeat originator determination unit 13 determines that there is an originator duplicate message among three or more messages received in the monitoring period, the order determination unit analyzes the degree of human relationship between each originator of the three or more messages received in the monitoring period and the user, and preferentially sets the speech output order of the message of the originator having a high degree of human relationship to the upper order. The process of the procedure determining unit 14 of the present modification will be described in detail below.

In the present modification, the message data MD generated and transmitted by the chat application execution unit 17 includes the personal relationship information in addition to the information of the message data MD of the first embodiment. The personal relationship information is set in advance for each registered person by the user, and is registered in the registered person database 19. In addition, values of the human relationship information that can be selected are prepared in advance, and the user selects a certain value. The value of the personal relationship information is, as an example, family, friend, boss, colleague, no attribute (the user does not set the personal relationship information).

The order determination unit 14 groups the three or more message data MD stored in the first buffer 22 into packets according to the sender ID, as in the first embodiment. Next, the order determination unit 14 does not specify the reception date and time of the group first for each group as in the first embodiment, but executes the following processing. That is, the order determination unit 14 sorts the groups in descending order of the degree of relationship between the originator of the group and the user. This processing corresponds to the processing of giving priority to the voice output order of the message of the sender with high degree of interpersonal relationship to the higher order. The interpersonal relationship degree means the strength of interpersonal contact between the user and the registered person, and is previously sorted according to the value of each interpersonal relationship information. As an example, in the case where there are family, friend, boss, colleague, and no attribute as the value of the personal relationship information (the user does not set the personal relationship information), the level of the personal relationship is ranked as "family > friend > boss > colleague > no attribute".

When the values of the personal relationship information of the different groups are the same, the order determination unit 14 identifies the group first reception date and time of the groups, and prioritizes the group having the first reception date and time as the upper level. The method of determining the degree of relationship between the plurality of senders is not limited to the method described in the present embodiment.

For example, when the message data MD are grouped according to the sender ID, the message data MD are grouped into three groups A, B, C. The personal relationship information of the originator in group a is "boss", the personal relationship information of the originator in group B is "friend", and the personal relationship information of the originator in group C is "family". The interpersonal relationship degree is set as family > friend > Shangshi. In this case, the order determination unit 14 sorts the groups in the order of group C → group B → group a.

The order determination unit 14 sorts each group by the above method, arranges the message data MD in the order of the reception date and time from morning to evening in each group, and sets the arrangement order at this time as the voice output order.

According to the present modification, the following effects can be obtained in addition to the effects of the first embodiment. That is, it is assumed that the user wants to recognize the content of the message data MD of the sender having a high degree of personal relationship with the user earlier than the message data MD of the sender having a low degree of personal relationship. Accordingly, according to the present modification, it is possible to respond to such a user's desire, and to improve the satisfaction of the user.

The flowchart FH of fig. 8 is a flowchart showing the operation of the procedure determining unit 14 of the present modification. The order determination unit 14 repeatedly executes the process of the flowchart FH. As shown in fig. 8, the sequence determination unit 14 monitors whether or not the first repeat notification information is input from the repeat sender determination unit 13 (step SH 1). When the first duplicate notification information is input (yes in step SH1), the sequence determination unit 14 groups the message integrated data MS for each sender ID (step SH 2).

Next, the order determination unit 14 sorts each group by the degree of personal relationship between the sender and the user of each group, sorts the message data MD in the order of reception date and time from morning to evening within each group, and sets the ranking at this time as the speech output order (step SH 3). Next, the order determination unit 14 outputs the first speech output order information indicating the speech output order to the speech output unit 15 (step SH 4).

< third modification of the first embodiment >

Next, a third modification of the first embodiment will be described with reference to fig. 1. In the present modification, the order determination unit 14 analyzes the contents of three or more messages received in the monitoring period and preferentially ranks the speech output order of the message with a high urgency when the repeat originator determination unit 13 determines that there is an originator duplicate message among three or more messages received in the monitoring period. The process of the procedure determining unit 14 of the present modification will be described in detail below.

In the present modification, the message data MD generated and transmitted by the chat application executing unit 17 includes the urgency information in addition to the information of the message data MD of the first embodiment. The urgency level information is information indicating the urgency level (degree of urgency level) of the content of the message data MD, and is set as additional information when the sender transmits a message. In the present embodiment, high, medium, and low are prepared as the value of the urgency level information (wherein the urgency level is in the order of "high > medium > low" from high to low).

The order determination unit 14 groups the three or more message data MD stored in the first buffer 22 into packets according to the sender ID, as in the first embodiment. Next, the order determination unit 14 does not specify the reception date and time of the group first for each group as in the first embodiment, but executes the following processing. That is, the order determination unit 14 determines the urgency level for each group. Further, the order determination unit 14 sets the urgency level of the message data MD with the highest urgency level as the urgency level of a group including a plurality of message data MD. For example, the order determination unit 14 includes, in a certain group, the degree of urgency: message data MD of "high" and urgency: in the case of the "small" message data MD, the urgency level of the group is set to "high". Further, the order determination unit 14 sets the urgency level of a group including one message data MD as the urgency level of the group.

Next, the order determination unit 14 sorts the groups in descending order of urgency. This processing corresponds to a processing for prioritizing the speech output order of a message with a high urgency level. The method of determining the degree of emergency for each group is not limited to the method exemplified in the present embodiment. As an example, the order determination unit 14 may analyze the content of the message data MD belonging to each group by natural language processing to determine the urgency level.

For example, when the message data MD are grouped according to the sender ID, three groups are grouped into the group A, B, C. The urgency level of group a is "low", the urgency level of group B is "medium", and the urgency level of group C is "high". In this case, the order determination unit 14 sorts the groups in the order of group C → group B → group a.

The order determination unit 14 sorts each group by the above method, sorts the message data MD in the order of reception date and time from morning to evening in each group, and sets the ranking order at this time as the voice output order.

According to the present modification, the following effects can be obtained in addition to the effects of the first embodiment. That is, it is assumed that the user wants to recognize the content of the message data MD having a high urgency level of the content earlier than the message data MD having a low urgency level of the content. Accordingly, according to the present modification, the satisfaction of the user can be improved in response to such a user's desire.

The flowchart FI in fig. 9 is a flowchart showing the operation of the procedure determining unit 14 in the present modification. The order determination unit 14 repeatedly executes the processing of the flowchart FI. As shown in fig. 9, the procedure determining unit 14 monitors whether or not the first repeat notification information is input from the repeat sender determining unit 13 (step SI 1). When the first duplicate notification information is input (yes in step SI1), the sequence determination unit 14 groups the message integrated data MS for each sender ID (step SI 2).

Next, the order determination unit 14 determines the urgency level of each group (step SI 3). Next, the order determination unit 14 sorts each group in the order of the highest degree of urgency based on the degree of urgency determined in step SI3, and sorts the message data MD in the order of the date and time of reception in each group, and sets the ranking order at this time as the speech output order (step SI 4). Next, the order determination unit 14 outputs the first speech output order information indicating the speech output order to the speech output unit 15 (step SI 5).

< fourth modification of the first embodiment >

Next, a fourth modification of the first embodiment will be described with reference to fig. 1. In the present modification, the order determination unit 14 detects the environment of the current position of the user when the repeat originator determination unit 13 determines that there is an originator duplicate message among three or more messages received within the monitoring period, analyzes the contents of the three or more messages received within the monitoring period, and prioritizes the voice output order of the message having the content with a high degree of correlation with the environment of the current position of the user to be higher. The process of the procedure determining unit 14 of the present modification will be described in detail below.

The order determination unit 14 groups the three or more message data MD stored in the first buffer 22 into packets according to the sender ID, as in the first embodiment. Next, the order determination unit 14 does not specify the reception date and time of the group first for each group as in the first embodiment, but executes the following processing.

That is, the order determination unit 14 receives information indicating the current position of the vehicle from a GPS unit, not shown, provided in the in-vehicle device 2, and detects the current position of the vehicle. In addition, the user rides in the vehicle, and the current position of the vehicle is the same as the current position of the user. The GPS unit may be provided in a device different from the in-vehicle device 2, or the order determination unit 14 may acquire the current position of the user by another method. Other methods are for example: when the mobile terminal 3 has a function of detecting the current position of the mobile terminal (i.e., the current position of the user), the order determination unit 14 inputs information indicating the current position of the mobile terminal from the mobile terminal and detects the current position of the user.

Next, the order determination unit 14 obtains the place name of the area where the user is located (i.e., the area where the vehicle is located) as the environment of the current position of the user. In the present embodiment, the geographical names of the regions are, for example, names of hierarchical administrative regions (administrative geographical names), names of provinces, regions, counties, and villages in china, and names of administrative regions lower than prefectural prefectures, municipalities, and municipalities in japan. Here, the in-vehicle device 2 stores a database in which the area on the map is associated with the name thereof for each area, and the order determination unit 14 specifies the area to which the current position of the user belongs and acquires the name of the area based on the database. The database may store another device (or the portable terminal 3) that can communicate with the in-vehicle device 2.

Next, the order determination unit 14 analyzes the content of the message data MD belonging to each group based on the name of the area acquired as the environment of the current position of the user, and determines the environmental relevance for each group. The environmental relevance means a degree of high degree of relevance between the environment of the current position of the user and the content of the message data MD, and particularly, in the present embodiment, means a degree of likelihood that the content of the message data MD has the region to which the current position of the user belongs as a topic. In the present embodiment, the environmental relevance assumes some value of "high" and "low" (where the environmental relevance is in the order of "high > low" from high to low).

In the present embodiment, the order determination unit 14 determines that the environmental relevance of one group is "high" when a name of a region acquired as the environment of the current position of the user is included in any of the message texts of the message data MD belonging to the one group, and determines that the environmental relevance of the one group is "low" when the name of the region is not included. This is because, when the message body includes the name of the area to which the current position of the user belongs, the possibility that the message body has the area as a topic is very high.

After determining the environmental relevance, the order determination unit 14 sorts the groups in the order of the environmental relevance from high to low. This processing corresponds to a processing for prioritizing the voice output order of a message having a content with a high degree of correlation with the environment of the current position of the user. When the values of the environmental correlations of the plurality of different groups are the same, the group first reception date and time of the groups is determined, and the group having the first reception date and time of the group is prioritized to be the upper level. For example, when the message data MD are grouped into two groups of groups A, B, the environmental relevance of group a is "low" and the environmental relevance of group B is "high". In this case, the order determination unit 14 sorts the groups in the order of group B → group a.

According to the present modification, the following effects can be obtained in addition to the effects of the first embodiment. That is, it is assumed that, when the message data MD has the region to which the current position of the user belongs as a topic, the interest of the user is more strongly attracted than when the region is not regarded as a topic. Thus, it is assumed that the user wants to recognize the content of the message data MD which is topical on the region to which the user's current location belongs earlier. Accordingly, according to the present modification, the satisfaction of the user can be improved in response to such a user's desire.

The flowchart FJ in fig. 10 is a flowchart showing the operation of the procedure determining unit 14 in the present modification. The order determination unit 14 repeatedly executes the processing of the flowchart FJ. As shown in fig. 10, the sequence determination unit 14 monitors whether or not the first repeat notification information is input from the repeat sender determination unit 13 (step SJ 1). When the first repeat notification information is input (yes in step SJ1), the sequence determination unit 14 groups the message integrated data MS for each sender ID (step SJ 2).

Next, the order determination unit 14 detects the current position of the vehicle (which is the current position of the user) (step SJ 3). Next, the sequence determination unit 14 acquires the place name of the area where the user is located (i.e., the area where the vehicle is located) as the environment of the current position of the user (step SJ 4). Next, the order determination unit 14 analyzes the content of the message data MD belonging to each group based on the name of the area acquired as the environment of the current location of the user, and determines the environment correlation degree for each group (step SJ 5).

Next, the order determination unit 14 sorts the groups in the order of the environmental relevance degree from high to low (step SJ 6). When the values of the environmental correlations of the plurality of different groups are the same, the group first reception date and time of the groups is determined, and the group having the first reception date and time of the group is prioritized to be the upper level. Next, the order determination unit 14 sorts the message data MD in each group in the order of the reception date and time from morning to evening, and sets the ranking at this time as the speech output order (step SJ 7). Next, the sequence determining unit 14 outputs the first speech output sequence information indicating the speech output sequence to the speech output unit 15 (step SJ 8).

In the present modification, the environment of the current position of the user is the name of the administrative area to which the current position of the user belongs, but the environment of the current position of the user is not limited to the illustrated contents.

For example, the environment of the current position of the user may be the name of a facility (may include a natural object such as a mountain or a river) located in the vicinity of the current position of the user. In this case, the order determination unit 14 acquires the names of facilities around the current location of the user, for example, based on a database in which the locations of the facilities are associated with the names of the facilities. In this case, the order determination unit 14 determines the environmental relevance degree based on, for example, whether or not the message body includes the name of the facility. According to this example, the following effects are obtained. That is, it is assumed that the user wants to recognize the content of the message data MD which is subject to the facility located in the vicinity of the user's current location earlier. Accordingly, according to this example, the satisfaction of the user can be improved in response to such a user's desire.

Further, for example, the environment of the current location of the user may also include natural phenomena such as weather, air temperature, day and night, and the like at the current location of the user. In this case, the order determination unit 14 obtains the situation of the natural phenomenon from, for example, an external server, and obtains the situation of the natural phenomenon based on detection values of various sensors provided in the vehicle. In this case, the order determination unit 14 determines the environmental relevance based on, for example, whether or not a word representing a natural phenomenon is included in the message body. According to this example, the following effects are obtained. That is, regarding the message data MD which is topical on the natural phenomenon at the user's current position, the user wants to recognize its content earlier. Accordingly, according to this example, the satisfaction of the user can be improved in response to such a user's desire.

< fifth modification of the first embodiment >

Next, a fifth modification of the first embodiment will be described with reference to fig. 1. In the present modification, the order determination unit 14 detects the environment of the current position of the user when the repeat originator determination unit 13 determines that there is an originator duplicate message among three or more messages received within the monitoring period, and prioritizes the voice output order of a message having a high correlation between the environment of the current position of the user and the originator as an upper order. The procedure determining unit 14 of the present modification will be described below.

In the present modification, the message data MD generated and transmitted by the chat application executing unit 17 includes the information of the source location name of the originator in addition to the information of the message data MD of the first embodiment. The originator source location name information is information indicating a location name originating from the originator, and is registered in advance by the user in the registered person database 19 for each registered person. For example, the user registers, in advance, sender source location name information indicating a location name of a place where the sender is present, a location name of a work place, and a location name of a region where the sender has liked.

That is, the order determination unit 14 acquires the place name of the area where the user is located as the environment of the current position of the user by the method described in the fourth modification of the first embodiment. Next, the order determination unit 14 compares the place name of the area acquired as the environment of the current location of the user with the place name of the area indicated by the originator-source place name information, and determines the environment originator correlation for each group based on the comparison result. The environmental originator relevance means a degree of high relevance between the environment of the current location of the user and the originator, and particularly means, in the present embodiment, a strength of relevance between the area to which the current location of the user belongs and the originator. In the present embodiment, the environmental originator relevance assumes any of "high" and "low" (where the environmental originator relevance is in order of "high > low" from high to low).

The order determination unit 14 determines the environmental originator correlation of one group as "high" when the location name indicated by the originator location name information of the originator of the one group (originator location name information included in the message data MD belonging to the one group) matches the location name of the area to which the current location of the user belongs, and determines the environmental originator correlation of the one group as "low" when none of the matching persons exists. This is because, when the place name indicated by the originator-source place name information of a certain originator matches the place name of the area to which the current position of the user belongs, it can be said that the current user is located in the area originating from the originator, and in this case, it can be said that the area to which the current position of the user belongs has a strong correlation with the originator.

After determining the environmental originator correlation, the order determination unit 14 sorts the groups in the order of the environmental originator correlation from high to low. This processing corresponds to a processing for prioritizing the voice output order of a message having a high degree of correlation between the environment of the current position of the user and the sender. When the environmental originator correlation values of different groups are the same, the group first reception date and time of the groups is determined, and the group having the first reception date and time is prioritized to be the upper level. For example, when the message data MD are grouped into two groups of groups A, B, the environmental originator correlation of group a is "low" and the environmental urgency of group B is "high". In this case, the order determination unit 14 sorts the groups in the order of group B → group a.

According to the present modification, the following effects can be obtained in addition to the effects of the first embodiment. That is, it is assumed that the message data MD of the sender having a strong correlation with the area to which the current position of the sender belongs is more interesting to the user than the message data MD of the sender having a weak correlation. This is because there is a possibility that the sender knows the user's own region by some method and transmits the items related to the region and the advice related to the driving of the vehicle. Thus, it is assumed that the user wants to recognize the content earlier for the message data MD sent from the sender having a strong correlation with the region to which the user's current position belongs. Accordingly, according to the present modification, the satisfaction of the user can be improved in response to such a user's desire.

The flowchart FK in fig. 11 is a flowchart showing an operation of the procedure determining unit 14 in the present modification. The order determination unit 14 repeatedly executes the processing of the flowchart FK. As shown in fig. 11, the sequence determining unit 14 monitors whether or not the first repeat notification information is input from the repeat originator determining unit 13 (step SK 1). When the first duplicate notification information is input (YES in step SK1), the sequence determining unit 14 groups the message integrated data MS according to the sender ID (step SK 2).

Next, the order determination unit 14 detects the current position of the vehicle (which is the current position of the user) (step SK 3). Next, the order determination unit 14 acquires the place name of the area where the user is located (i.e., the area where the vehicle is located) as the environment of the current position of the user (step SK 4). Next, the order determination unit 14 compares the place name acquired as the environment of the current position of the user with the place names of the regions indicated by the originator source place name information of the originators of each group, and determines the environment originator correlation for each group based on the comparison result (step SK 5).

Next, the order determination unit 14 sorts the groups in the order of the highest degree of correlation among the environmental senders (step SK 6). When the environmental originator correlation values of different groups are the same, the group first reception date and time of the groups is determined, and the group having the first reception date and time is prioritized to be the upper level. Next, the order determination unit 14 sorts the message data MD in each group in the order of the reception date and time from morning to evening, and sets the ranking at this time as the speech output order (step SK 7). Next, the order determination unit 14 outputs the first speech output order information indicating the speech output order to the speech output unit 15 (step SK 8).

In the present modification, the order determination unit 14 is configured to determine the correlation between the environment of the current position of the user and the sender based on the correspondence between the area to which the current position of the user belongs and the area derived from the sender. However, the method of determining the degree of correlation between the environment of the current location of the user and the sender is not limited to the illustrated method. As an example, the following configuration is also possible: the order determination unit 14 acquires the name of a facility located in the vicinity of the current position of the user as the environment of the current position of the user, further acquires the name of a facility originating from the sender, and determines the degree of correlation between the environment of the current position of the user and the sender based on the correspondence or correlation between the facility located in the vicinity of the current position of the user and the facility originating from the sender.

< sixth modification of the first embodiment >

Next, a sixth modification of the first embodiment will be described with reference to fig. 1. The voice output unit 15 of the present modification obtains a first pre-control timing as an output start timing of each message when three or more messages received within the monitoring period are voice-output in the order of reception, and obtains a first post-control timing as an output start timing of each message when three or more messages received within the monitoring period are voice-output in the order of voice output determined by the order determination unit, and increases the output speed of a message higher than the message when there is a message whose first post-control timing is later than the first pre-control timing, so that the timing at which voice output of the message is actually started is made to be close to the first pre-control timing. The processing of the voice output unit 15 according to the present modification will be described in detail below.

When the first speech output order information is input from the order determination unit 14, the speech output unit 15 of the present modification stores the message speech data of each message data MD in the second buffer 23 in the speech output order, and then executes the following processing. That is, the voice output unit 15 calculates, for each message voice data stored in the second buffer 23, the length of time (hereinafter referred to as "output time length") required from the start of voice output to the end of voice output when voice output is performed based on the message voice data. For example, regarding the output time length of one message voice data, the voice output section 15 recognizes the number of samples of the one message voice data, and converts the number of samples into the output time length.

Next, the voice output unit 15 acquires the output start timing (hereinafter referred to as "first pre-control timing") of each message voice data when the message voice data stored in the second buffer 23 is voice-output in the order of reception of the corresponding message data MD. For example, three message voice data corresponding to three message data MD are stored in the second buffer 23, and the three message voice data are respectively set as the first voice data S1, the second voice data S2, and the third voice data S3. When the message voice data are arranged in the order of reception of the corresponding message data MD, "first voice data S1 → second voice data S2 → third voice data S3".

Fig. 12(a) is a diagram on the abscissa with the elapse of time schematically showing the timing at which the voice output of each message voice data starts and the timing at which the voice output of each message voice data ends when each message voice data is voice-output in the order of "first voice data S1 → second voice data S2 → third voice data S3". Referring TO fig. 12(a), in the above case, the voice output unit 15 acquires the timing TO as the first pre-control timing with respect TO the first voice data S1, the timing TA as the first pre-control timing with respect TO the second voice data S2, and the timing TB as the first pre-control timing with respect TO the third voice data S3. Voice output unit 15 recognizes, for example, timing TA and timing TB as elapsed time from timing TO.

Further, the voice output unit 15 acquires output start timings (hereinafter referred to as "first post-control timings") of the respective message voice data when the message voice data stored in the second buffer 23 are respectively voice-outputted in the voice output order indicated by the first voice output order information. For example, with respect to the first voice data S1, the second voice data S2, and the third voice data S3 in fig. 12(a), it is assumed that the voice output order is "first voice data S1 → third voice data S3 → second voice data S2". Fig. 12(B) is a diagram showing the start timing and end timing of voice output in the case where the message voice data is voice-output in the order of "first voice data S1 → third voice data S3 → second voice data S2". In the above case, as shown in fig. 12(B), the voice output unit 15 acquires the timing TO as the first post-control timing with respect TO the first voice data S1, the timing TA as the first post-control timing with respect TO the third voice data S3, and the timing TC as the first post-control timing with respect TO the second voice data S2.

Next, the voice output unit 15 determines whether or not there is message voice data whose first post-control timing is later than the first pre-control timing. In the example of (a) and (B) of fig. 12, the first post-control timing (timing TC) of the second speech data S2 is later than the first pre-control timing (timing TA). Therefore, in this example, the voice output unit 15 determines that there is message voice data whose first post-control timing is later than the first pre-control timing. Hereinafter, the message voice data whose timing after the first control is later than the timing before the first control is referred to as "first delay data".

When the first delay data is present, the voice output unit 15 increases the output speed of the message voice data higher than the first delay data when the voice output is performed for each message voice data, thereby bringing the timing at which the voice output of the first delay data is actually started close to the first pre-control timing for the first delay data. For example, in the example of fig. 12(a) and (B), the first speech data S1 and the third speech data S3 are present in the data higher than the second speech data S2 as the first delay data in the speech output order. Therefore, when the voice output unit 15 outputs the first voice data S1 and the third voice data S3, the voice output unit outputs the voice at a higher output speed. The output speed of the voice output may be increased in any manner, and may be configured as follows, for example: the audio output unit 15 performs audio output by increasing the output speed by about 10 to 20% for both the first audio data S1 and the third audio data S3. The output speed of the first speech data S1 and the third speech data S3 may be increased so that the timing at which the speech output of the second speech data S2 (the first delay data in this example) actually starts is the same as the first pre-control timing for the second speech data S2.

Fig. 12(C) shows the start timing and the end timing of the voice output with respect to each data in the case where the first voice data S1 and the third voice data S3 are accelerated in the output speed in the case where each message voice data is voice-output in the order of "the first voice data S1 → the third voice data S3 → the second voice data S2" (voice output order). As shown in fig. 12(C), the timing at which the speech output of the second speech data S2 actually starts is the timing TD, and is closer to the timing TA than the timing TC.

According to this modification, the time lag between the timing of starting output when the voice output is performed in the reception order as usual and the timing of actually starting output of the first delay data can be reduced with respect to the first delay data, and the user's sense of incongruity that may occur when the time lag is large can be reduced.

The flowchart FL of fig. 13 is a flowchart showing the operation of the voice output unit 15. The voice output unit 15 repeatedly executes the processing of the flowchart FL. As shown in fig. 13, the voice output unit 15 monitors whether or not the normal output instruction information is input from the reception determination unit 12 or the repeat originator determination unit 13 (step SL1), and also monitors whether or not the first voice output order information is input from the order determination unit 14 (step SL 2). When the normal output instruction information is input (yes in step SL1), the message data MD stored in the first buffer 22 is outputted as a voice in a normal manner in the order of being stored in the first buffer 22 (step SL 3).

When the first speech output order information is input (yes in step SL2), the speech output unit 15 reads the message data MD from the first buffer 22 in the speech output order indicated by the first speech output order information, generates message speech data based on the read message data MD, and stores the message speech data in the second buffer 23 (step SL 4). Next, the voice output unit 15 calculates the output time length for each message voice data stored in the second buffer 23 (step SL 5). Next, the voice output unit 15 acquires the first pre-control timing of each message voice data (step SL 6).

Next, the voice output unit 15 acquires the first post-control timing of each message voice data (step SL 7). Next, the voice output unit 15 determines whether or not the first delay data exists (step SL 8). If the first delay data is not present (no at step SL8), the voice output unit 15 reads the message voice data stored in the second buffer 23 and outputs a voice signal based on the message voice data to the voice processing device 4 in the order in which the message voice data is stored in the second buffer 23 (step SL 9). In step SL9, the voice output unit 15 sets all voice outputs based on the message voice data to a normal output speed.

On the other hand, when the first delay data exists (step SL 8: YES), the voice output unit 15 reads the message voice data stored in the second buffer 23 and outputs the voice signal based on the message voice data to the voice processing device 4 in the order in which the message voice data is stored in the second buffer 23 (step SL 10). In step SL10, the voice output unit 15 adjusts the output of the voice signal so as to increase the output speed with respect to the voice output based on the message voice data higher than the first delay data.

< seventh modification of the first embodiment >

Next, a seventh modification of the first embodiment will be described with reference to fig. 1. The voice output unit 15 of the present modification obtains the pre-control timing as the output end timing of each message when three or more messages received within the monitoring period are voice-output in the order of reception, and obtains the post-control timing as the output end timing of each message when three or more messages received within the monitoring period are voice-output in the order of voice-output determined by the order determination unit 14, and when there is a message whose post-control timing is later than the pre-control timing, the output speed of the message itself or a message higher than the message is increased in the order of voice-output determined by the order determination unit 14, so that the timing at which the voice-output of the message actually ends is made to approach the pre-control timing. The processing of the voice output unit 15 according to the present modification will be described in detail below.

When the first speech output order information is input from the order determination unit 14, the speech output unit 15 of the present modification stores the message speech data of each message data MD in the second buffer 23 in the speech output order, and then executes the following processing. That is, the voice output unit 15 calculates the output time length for each message voice data stored in the second buffer 23.

Next, the voice output unit 15 acquires output end timing (hereinafter referred to as "second pre-control timing") of each message voice data when the message voice data stored in the second buffer 23 is voice-output in the reception order of the corresponding message data MD.

For example, in the example of fig. 12(a), the voice output unit 15 acquires the timing TA as the second pre-control timing with respect to the first voice data S1, the timing TB as the second pre-control timing with respect to the second voice data S2, and the timing TE as the second pre-control timing with respect to the third voice data S3.

Further, the voice output unit 15 acquires output end timings (hereinafter referred to as "second post-control timings") of the respective message voice data when the message voice data stored in the second buffer 23 are voice-output in the voice output order indicated by the first voice output order information. For example, in the case of fig. 12(B), the voice output unit 15 acquires the timing TA as the second post-control timing with respect to the first voice data S1, the timing TC as the second post-control timing with respect to the third voice data S3, and the timing TE as the second post-control timing with respect to the second voice data S2.

Next, the voice output unit 15 determines whether or not there is message voice data whose second post-control timing is later than the second pre-control timing. In the example of (a) and (B) of fig. 12, the second post-control timing (timing TE) of the second speech data S2 is later than the second pre-control timing (timing TB). Therefore, in this example, the voice output unit 15 determines that there is message voice data whose second post-control timing is later than the second pre-control timing. Hereinafter, the message voice data whose timing after the second control is later than the timing before the second control is referred to as "second delay data".

When the second delay data is present, the voice output unit 15 increases the output speed of at least one of the second delay data itself and the message voice data higher than the second delay data when the voice output is performed for each message voice data, thereby bringing the timing at which the voice output of the second delay data is actually completed close to the pre-second-control timing for the second delay data. Fig. 12(D) shows the start timing and the end timing of the voice output of each data in the case where the output speeds of both the second voice data S (the delay data itself) and the first voice data S1 and the third voice data S3 (the message voice data higher than the delay data) are increased in the case where each message voice data is voice-output in the order of "the first voice data S1 → the third voice data S3 → the second voice data S2" (the voice output order).

As shown in fig. 12(D), the timing at which the speech output of the second speech data S2 actually ends is the timing TF, and is closer to the timing TB than the timing TE. For example, in the example of fig. 12(D), the voice output unit 15 may increase the output speed of the voice output for all of the first voice data S1, the second voice data S2, and the third voice data S3, but may increase the output speed of the voice output for one or both of these data. Further, the output speed of the other message voice data may be increased so that the timing at which the voice output of the second voice data S3 (second delay data in this example) actually ends is the same as the timing before the second control with respect to the second voice data S3.

According to this modification, the time lag between the timing at which the output ends when the voice is output in the reception order as usual and the timing at which the output of the second delay data actually ends can be reduced for the second delay data, and the user's sense of discomfort that may occur when the time lag is large can be reduced.

The flowchart FM of fig. 14 is a flowchart showing the operation of the voice output unit 15. The voice output unit 15 repeatedly executes the processing of the flowchart FM. As shown in fig. 14, the voice output unit 15 monitors whether or not the normal output instruction information is input from the reception determination unit 12 or the repeat sender determination unit 13 (step SM1), and also monitors whether or not the first voice output order information is input from the order determination unit 14 (step SM 2). When the normal output instruction information is input (YES in step SM1), the message data MD stored in the first buffer 22 is speech-output in a normal manner in the order of storage in the first buffer 22 (step SM 3).

When the first speech output order information is input (yes in step SM2), the speech output unit 15 reads the message data MD from the first buffer 22 in the speech output order indicated by the first speech output order information, generates message speech data based on the read message data MD, and stores the message speech data in the second buffer 23 (step SM 4). Next, the voice output unit 15 calculates the output time length for each message voice data stored in the second buffer 23 (step SM 5). Next, the voice output unit 15 acquires the second pre-control timing of each message voice data (step SM 6). Next, the voice output unit 15 acquires the second post-control timing of each message voice data (step SM 7). Next, the voice output unit 15 determines whether or not the second delay data exists (step SM 8). If the second delay data does not exist (no in step SM8), the speech output unit 15 reads the message speech data stored in the second buffer 23 and outputs the speech signal based on the message speech data to the speech processing device 4 in the order in which the message speech data is stored in the second buffer 23 (step SM 9). In step SM9, the voice output unit 15 sets a normal output speed for all voice outputs based on the message voice data.

On the other hand, when the second delay data exists (YES in step SM8), the speech output unit 15 reads the message speech data stored in the second buffer 23 and outputs the speech signal based on the message speech data to the speech processing device 4 in the order in which the message speech data is stored in the second buffer 23 (step SM 10). In step SM10, the voice output unit 15 increases the output speed of at least either one of the second delay data itself and the message voice data higher than the second delay data.

< other modification of the first embodiment >

Next, another modification of the first embodiment will be described. The reception determination unit 12 may be configured as follows: the monitoring period is set so that monitoring periods of a predetermined time (for example, 5 seconds) are continuous, and whether or not three or more message data MD have been received is determined in each monitoring period. The length of the monitoring period is determined to be 5 seconds, for example. The reception determination unit 12 sets a monitoring period of 5 seconds (referred to as "first monitoring period") with a certain timing as a starting point. The reception determination unit 12 monitors whether three or more message data MD are received by the message reception unit 11 in the first monitoring period. When the first monitoring period ends, the reception determination unit 12 sets a new monitoring period (referred to as a "second monitoring period") immediately thereafter, and monitors whether three or more message data MD are received by the message reception unit 11 during the second monitoring period. In this case, the monitoring period is set every 5 seconds, and the reception determination unit 12 monitors whether or not three or more message data MD are received in each monitoring period.

< second embodiment >

Next, a second embodiment will be explained. Fig. 15 is a block diagram showing an example of a functional configuration of the speech output system 1A according to the present embodiment. As shown in fig. 15, the speech output system 1A includes an in-vehicle device 2A instead of the in-vehicle device 2 of the first embodiment. The in-vehicle device 2A differs from the first embodiment in that it includes a reception determination unit 12A instead of the reception determination unit 12, a repeat originator determination unit 13A instead of the repeat originator determination unit 13, a sequence determination unit 14A instead of the sequence determination unit 14, and a voice output unit 15A instead of the voice output unit 15.

When one message is received by the message receiving unit 11 during a period other than the monitoring period, the reception determining unit 12A instructs the voice output unit 15A to output the one message, sets a period during which the voice output unit 15A outputs the voice of the one message as the monitoring period, and determines whether or not three or more messages including the one message are received during the monitoring period. The processing of the reception determination unit 12A will be described in detail below.

Currently, it is not the monitoring period. The reception determination unit 12A refers to the first buffer 22 and monitors whether or not the message data MD is newly stored in the first buffer 22 during the period other than the monitoring period. In the case of storage, the reception determination unit 12A acquires the sender ID of the stored message data MD, and outputs the initial output instruction information to the voice output unit 15A. As in the first embodiment, the message data MD newly stored in the first buffer 22 during a period other than the monitoring period is referred to as "initial storage data". The sender ID of the first storage data is referred to as "first sender ID".

When the initial output instruction information is input, the voice output unit 15A reads the message data MD stored in the first buffer 22 at that time, generates message voice data based on the message data MD, and outputs the message voice data as voice. In particular, when the message voice data is generated based on the initial output instruction information, the voice output unit 15A executes the following processing. That is, the voice output unit 15A calculates the output time length of the generated message voice data. Since the generation of the message voice data and the voice output are immediately executed, the voice output of the message voice data is executed during the output time length from the current time. Next, the voice output unit 15A outputs output time length information indicating the length of the output time to the reception determination unit 12A.

As described above, the present embodiment differs from the first embodiment in that if the message data MD is received when it is not the monitoring period, voice output is immediately performed on the message data MD. According to the present embodiment, since the message data MD received when it is not the monitoring period is immediately output by voice without waiting for the monitoring period, the user can recognize the content of the message data MD at an early timing, and the satisfaction of the user can be improved in this point.

When the output time length information is input, the reception determination unit 12A sets the time of the output time length indicated by the output time length information from the current time as the monitoring period. That is, in the present embodiment, the monitoring period is a period during which the message data MD received when the monitoring period is not the monitoring period is outputted.

Next, the reception determination unit 12A determines whether or not three or more messages including the first stored data are received within the monitoring period. That is, the reception determination unit 12A determines whether two or more message data MD are received by the message reception unit 11 in addition to the first stored data during the monitoring period. When two or more message data MD are not received (only one or less message data MD are received) at the time when the monitoring period has elapsed, other than the first stored data, and when one message data MD different from the first stored data is received, the reception determination unit 12A outputs the normal output instruction information to the voice output unit 15A. When the normal output instruction information is input, the voice output unit 15A performs voice output on the message data MD stored in the first buffer 22 at that time, in the same manner as in the first embodiment. In addition, when the message data MD other than the first stored data is not received within the monitoring period, the reception determination section 12A does not perform any operation.

When two or more message data MD are received in addition to the first stored data at the time when the monitoring period has elapsed, the reception determination unit 12A outputs the first originator ID and the second plurality of reception notification information to the repeat originator determination unit 13A.

When the reception determination unit 12A determines that three or more messages have been received within the monitoring period, the repeat originator determination unit 13A determines whether or not the same message as the originator of the one message exists in two or more messages other than the one message (the first stored data). The process of the repeat originator determination unit 13A will be described in detail below.

When the first originator ID and the second plurality of reception notification information are input from the reception determination unit 12A, the repeat originator determination unit 13A determines whether or not there is data of an originator ID having the same value as the value of the first originator ID among the two or more message data MD stored in the first buffer 22. When there is no message data MD having the same value as the primary originator ID, the repeat originator determining unit 13A outputs the normal output instruction information to the voice output unit 15A. When the normal output instruction information is input, the voice output unit 15A performs voice output on the message data MD stored in the first buffer 22 at that time, in the same manner as in the first embodiment.

On the other hand, when there is message data MD having the sender ID having the same value as the first sender ID, the repeat sender determining unit 13A outputs the second repeat notification information to the order determining unit 14A.

The order determining unit 14A determines the voice output order of two or more messages other than one message (first stored data), and when determining the voice output order, if the repeat originator determining unit 13A determines that there is a message whose originator is the same as the originator of the one message among the two or more messages other than the one message, the order of the voice output order is the highest for the message whose originator is the same as the originator of the one message, and voice output is performed continuously for a plurality of messages related to the originator of the one message. The process of the procedure determining unit 14A will be described in detail below.

When the second repeat notification information is input from the repeat sender determining unit 13A, the order determining unit 14A determines the voice output order by the following method. That is, the order determination unit 14A determines the voice output order so that the voice output order of the message data MD having the sender ID having the same value as the first sender ID (hereinafter referred to as "same sender data") is the highest among the two or more message data MD stored in the first buffer 22. When there are a plurality of identical data of the same sender, the order determination unit 14A sets the higher order as the reception date and time is earlier. The order determination unit 14A also sets the higher order of the message data MD other than the same originator data, the reception date and time earlier than the group lower order of the same originator data.

For example, the four message data MD21 to MD24 illustrated in fig. 16(a) are stored in the first buffer 22 in the order MD21 → MD22 → MD23 → MD 24. The message ID of the message data MD21 is "P01", and the sender ID is "Q02". The message ID of the message data MD22 is "P02", and the sender ID is "Q01". The message ID of the message data MD23 is "P03", and the sender ID is "Q03". The message ID of the message data MD24 is "P04", and the sender ID is "Q01". The value of the primary sender ID is "Q01".

In the example of fig. 16 a, the order determination unit 14A positions the message data MD22 and MD24 having the same sender ID value as the first sender ID value ("Q01") at the top in the speech output order. However, the order determination unit 14A sets MD22 to the 1 st and MD24 to the 2 nd, based on the reception order. Further, the order determination unit 14A sets MD21 to the 3 rd and MD23 to the 4 th in accordance with the reception order with respect to the message data MD21 and MD 23. As a result, as shown in fig. 16(B), the speech output sequence becomes "MD 22 → MD24 → MD21 → MD 23".

After determining the speech output order, the order determination unit 14A outputs second speech output order information indicating the speech output order to the speech output unit 15A.

When the second speech output order information is input from the order determination unit 14A, the speech output unit 15A outputs the message data MD stored in the first buffer 22 in the speech output order indicated by the second speech output order information, in the same manner as in the first embodiment.

As described above in detail, the in-vehicle device 2A (voice output device) according to the present embodiment has the same sender data (message data MD for which the sender is the same as the first sender) positioned at the top in the voice output order. As a result, after the first stored data is voice-outputted, the same sender data is voice-outputted continuously therewith. Therefore, in the unique configuration of the present embodiment in which when a certain message data MD is received without a monitoring period, the message data MD is immediately voice-outputted, when a message data MD which is the same sender as the message data MD is received within the monitoring period, a plurality of message data MD transmitted from the common senders are continuously collected and voice-outputted. Therefore, it is easy for the user to grasp the content of the message data MD of the first sender.

Next, the operation of the in-vehicle device 2A will be described in detail with reference to a flowchart. The flowchart FN of fig. 17(a) is a flowchart showing the operation of the reception determination unit 12A. The reception determination unit 12A repeatedly executes the processing of the flowchart FN. Note that the start time of the flowchart FN is a period other than the monitoring period. As shown in fig. 17 a, the reception determination unit 12A monitors whether or not the message data MD is newly stored in the first buffer 22 (step SN 1). When the data is stored (step SN 1: YES), the reception judging unit 12A acquires the initial sender ID from the initial storage data (step SN2), and outputs the initial output instruction information to the voice output unit 15A (step SN 3).

Next, the reception determination unit 12A monitors whether or not the output time length information is input (step SN 4). When the input is received (YES in step SN4), reception determining unit 12A sets the time of the output time length indicated by the output time length information from the current time as the monitoring period (step SN 5). Next, the reception determination unit 12A waits for the monitoring period and determines whether or not three or more message data MD including the first stored data are received within the monitoring period (step SN 6).

When two or more message data MD are not received except the first stored data when the monitoring period has elapsed (no in step SN6), the reception determination unit 12A determines whether or not one message data MD different from the first stored data is received (step SN 7). When receiving the instruction (yes in step SN7), the reception determination unit 12A outputs the normal output instruction information to the speech output unit 15A (step SN 8). If the reception is not performed (no in step SN7), the reception determination unit 12A does not perform any operation and ends the processing in the flowchart FN.

On the other hand, when two or more message data MD are received in addition to the first stored data when the monitoring period elapses (yes in step SN6), the reception determination unit 12A outputs the first originator ID and the second plurality of reception notification information to the repeat originator determination unit 13A (step SN 9).

The flowchart FO in fig. 17(B) is a flowchart showing the operation of the repeat originator determining unit 13A. The repeat originator determining unit 13A repeatedly executes the process of the flowchart FO. As shown in fig. 17B, the repeat sender determining unit 13A monitors whether or not the second plurality of reception notification information is input from the reception determining unit 12A (step SO 1). When the second plurality of reception notification information is inputted (yes in step SO1), the repeat originator determining unit 13A determines whether or not there is data of the originator ID having the same value as the value of the primary originator ID among the two or more message data MD stored in the first buffer 22 (step SO 2). If not (NO in step SO2), repeat sender determining unit 13A outputs the normal output instruction information to voice output unit 15A (step SO 3). If SO (step SO 2: yes), the repeat sender determining unit 13A outputs the second repeat notification information to the order determining unit 14A (step SO 4).

The flowchart FP in fig. 18(a) is a flowchart showing the operation of the order determination unit 14A. The order determination unit 14A repeatedly executes the processing of the flowchart FP. As shown in fig. 18 a, the order determination unit 14A monitors whether or not the second repeat notification information is input from the repeat sender determination unit 13A (step SP 1). When the second repeat notification information is input (yes in step SP1), the order determination unit 14A determines the voice output order so that the order of the same sender data becomes the highest for two or more message data MD stored in the first buffer 22 (step SP 2). Next, the order determination unit 14A outputs second speech output order information indicating the speech output order to the speech output unit 15A (step SP 3).

The flowchart FQ in fig. 18(B) is a flowchart showing the operation of the voice output unit 15A. The voice output unit 15A repeatedly executes the processing of the flowchart FQ. As shown in fig. 18B, the voice output unit 15A monitors whether or not the first output instruction information is received from the reception determination unit 12A (step SQ1), further monitors whether or not the normal output instruction information is input from the reception determination unit 12A or the repeat originator determination unit 13A (step SQ2), and further monitors whether or not the second output sequence information is input from the sequence determination unit 14A (step SQ 3).

When the initial output instruction information is input (YES in step SQ1), the voice output unit 15A outputs the message data MD stored in the first buffer 22 as voice and outputs the output time length information to the reception judging unit 12A (step SQ4)

When the normal output instruction information is input (step SQ2), the voice output unit 15A outputs the message data MD stored in the first buffer 22 in a normal manner in the order of being stored in the first buffer 22 (step SQ 5).

When the second output order information is input (yes in step SQ3), the speech output unit 15A outputs the message data MD stored in the first buffer 22 in the speech output order indicated by the second speech output order information (step SQ 6).

While the second embodiment has been described above, the second embodiment can be applied to various modifications of the first embodiment. An example of processing of the in-vehicle device 2A in the case where each modification of the first embodiment is applied to the second embodiment will be described below.

< example of processing in the case where the first modification of the first embodiment is applied >

The order determining unit 14A of this example only sets the same sender data to the highest level in the voice output order when the correlation between the content of the first-time stored data and the content of the same sender data is high. That is, the order determination unit 14A outputs the message data MD of the first originator received during the monitoring period in the voice subsequent to the voice output of the first stored data only when the correlation between the content of the first stored data and the content of the same originator data is high.

< example of processing in the case where the second modification of the first embodiment is applied >

In the second embodiment, the order determination unit 14A sets the message data MD other than the same originator data to have the message data with the reception date and time earlier in the upper order range lower than the group of the same originator data. On the other hand, the order determination unit 14A of the present example preferentially places, in a higher order range than the group of the same originator data, message data MD having a high degree of personal relationship with the user for message data MD other than the same originator data.

< example of processing in the case where the third modification of the first embodiment is applied >

In the second embodiment, the order determination unit 14A sets the message data MD other than the same originator data to have the message data with the reception date and time earlier in the upper order range lower than the group of the same originator data. On the other hand, the order determination unit 14A of the present example preferentially places the message data MD with a high degree of urgency in an order range lower than the group of the same sender data with respect to the message data MD other than the same sender data.

< example of processing in the case where the fourth modification of the first embodiment is applied >

In the second embodiment, the order determination unit 14A sets the message data MD other than the same originator data to have the message data with the reception date and time earlier in the upper order range lower than the group of the same originator data. On the other hand, the order determination unit 14A of the present example preferentially places the voice output order of the message data MD having a content with a high degree of correlation with the environment of the current position of the user in a higher order range than the group of the same originator data with respect to the message data MD other than the same originator data.

< example of processing in the case where the fifth modification of the first embodiment is applied >

In the second embodiment, the order determination unit 14A sets the message data MD other than the same originator data to have the message data with the reception date and time earlier in the upper order range lower than the group of the same originator data. On the other hand, the order determination unit 14A of the present example preferentially places the voice output order of the message data MD having a high correlation between the environment of the current position of the user and the sender in a higher order range than the group of the same sender data with respect to the message data MD other than the same sender data.

< example of processing in the case where the sixth modification of the first embodiment is applied >

The voice output unit 15A of the present example acquires, for the message data MD received in the monitoring period, other than the first stored data, a pre-control timing as an output start timing of each data when voice output is performed in the reception order, and a post-control timing as an output start timing of each data when voice output is performed in the voice output order determined by the order determination unit 14A. When there is message data MD whose timing after control is later than the timing before control, the voice output unit 15A increases the output speed of message data MD higher than the message data MD in the voice output order determined by the order determination unit 14, and thereby brings the timing at which the voice output of the message data MD actually starts close to the timing before control.

< example of processing in the case where the seventh modification of the first embodiment is applied >

The voice output unit 15A of the present example acquires the pre-control timing, which is the output end timing of each data when the voice output is performed in the reception order, and the post-control timing, which is the output end timing of each data when the voice output is performed in the voice output order determined by the order determination unit 14A, for the message data MD other than the first stored data received during the monitoring period. When there is a message whose post-control timing is later than the pre-control timing, the voice output unit 15A increases the output speed of the message data MD itself or the message data MD higher than the message data MD in the voice output order determined by the order determination unit 14, and thereby brings the timing at which the voice output of the message is actually completed close to the pre-control timing.

While the two embodiments (including the modified examples) have been described above, each of the embodiments described above is merely an example of concrete implementation of the present invention, and the technical scope of the present invention is not to be interpreted in a limited manner. That is, the present invention can be implemented in various forms without departing from the gist or main features thereof.

For example, in the first embodiment described above, the in-vehicle device 2 functions as a "voice output device" in the claims. However, all the functions of the functional blocks of the in-vehicle device 2 may be mounted on the portable terminal 3, and the portable terminal 3 may function as a "voice output device". Further, a configuration may be adopted in which a part of the functions of the functional blocks of the in-vehicle device 2 is mounted on the portable terminal 3, and the in-vehicle device 2 and the portable terminal 3 function as "voice output devices". This is also the same for the second embodiment.

In the first embodiment, the chat application is installed in the mobile terminal 3, but the chat application may be installed in the in-vehicle device 2, and the in-vehicle device 2 may receive a message transmitted from another terminal. This is also the same for the second embodiment.

In the above embodiments, messages are exchanged in text chat, but the messages are not limited to this, and may be, for example, mails.

Claims

1. A voice output device mounted on a vehicle, comprising:

a message receiving unit which receives a message;

a reception determination unit configured to determine whether or not three or more messages have been received by the message reception unit during a monitoring period;

a repeat originator determination unit configured to determine whether there is an originator-duplicated message among the three or more messages received within the monitoring period, when the reception determination unit determines that the three or more messages are received within the monitoring period;

a sequence determination unit that determines a voice output sequence of three or more messages received within the monitoring period so that messages repeated by the sender are consecutive when the repeated sender determination unit determines that there is a message repeated by the sender among three or more messages received within the monitoring period; and

and a voice output unit that outputs voice for three or more messages received during the monitoring period in accordance with the voice output order determined by the order determination unit.

2. The speech output device of claim 1,

when one message is received by the message receiving unit during a period other than the monitoring period, the reception determination unit does not instruct the voice output unit to output the one message, sets a period of a predetermined time from a timing at which the one message is received as the monitoring period, and determines whether or not three or more messages including the one message are received within the monitoring period.

3. The speech output device of claim 1,

when one message is received by the message receiving unit during a period other than the monitoring period, the reception determining unit instructs the voice output unit to output the one message, sets a period during which the voice output unit outputs the one message as the monitoring period, and determines whether or not three or more messages including the one message are received within the monitoring period,

when the reception determination unit determines that three or more messages have been received during the monitoring period, the repeat originator determination unit determines whether or not a message having the same originator as the originator of the one message exists in two or more messages other than the one message,

the order determination unit determines a voice output order of two or more messages other than the one message, and when it is determined that the sender is the same message as the sender of the one message among the two or more messages other than the one message, the repeat sender determination unit determines the voice output order such that the order of the voice output order is the highest for the message having the same sender as the sender of the one message and that voice output of a plurality of messages related to the sender of the one message is continuously performed.

4. The speech output device of claim 1,

when the repeat originator determining unit determines that there is an originator-repeated message among three or more messages received within the monitoring period, the order determining unit analyzes the content of the originator-repeated message and, when the correlation degree of the content is high, continues the originator-repeated message.

5. The speech output device of claim 1,

when the repeat originator determining unit determines that there is an originator duplicate message among three or more messages received within the monitoring period, the order determining unit analyzes the degree of human relationship between each originator of the three or more messages received within the monitoring period and the user, and prioritizes the voice output order of the message of the originator having a high degree of human relationship to be higher.

6. The speech output device of claim 1,

when the repeat originator determining unit determines that there is an originator-repeated message among three or more messages received within the monitoring period, the order determining unit analyzes the contents of the three or more messages received within the monitoring period, and prioritizes the speech output order of the message with a high degree of urgency to be an upper order.

7. The speech output device of claim 1,

when the repeat originator determining unit determines that there is an originator duplicate message among three or more messages received within the monitoring period, the order determining unit detects the environment of the current position of the user, analyzes the contents of the three or more messages received within the monitoring period, and preferentially places the speech output order of the message having a high degree of correlation with the environment of the current position of the user at an upper position.

8. The speech output device of claim 1,

when the repeat originator determining unit determines that there is an originator duplicate message among three or more messages received within the monitoring period, the order determining unit detects the environment of the current position of the user and preferentially places the speech output order of a message having a high correlation between the environment of the current position of the user and the originator in an upper order.

9. The speech output device of claim 1,

the voice output unit acquires pre-control timings as output start timings of the respective messages when outputting the voice of three or more messages received in the monitoring period in the order of reception, and acquires post-control timings as output start timings of the respective messages when outputting the voice of three or more messages received in the monitoring period in the order of voice output determined by the order determination unit,

when there is a delay message that is a message whose post-control timing is later than the pre-control timing, the voice output unit increases the output speed of a message that is higher than the delay message in the voice output order determined by the order determination unit, and thereby brings the timing at which the voice output of the delay message actually starts close to the pre-control timing.

10. The speech output device of claim 1,

the voice output unit acquires pre-control timings as output end timings of the respective messages when outputting the voice of three or more messages received in the monitoring period in the order of reception, and acquires post-control timings as output end timings of the respective messages when outputting the voice of three or more messages received in the monitoring period in the order of voice output determined by the order determination unit,

when there is a delay message that is a message whose post-control timing is later than the pre-control timing, the voice output unit increases the output speed of at least one of the delay message itself and a message higher than the delay message, thereby bringing the timing at which the voice output of the delay message is actually completed closer to the pre-control timing.

11. A method for outputting speech, comprising:

a step in which a reception determination unit of the voice output device determines whether or not three or more messages have been received within a monitoring period;

a step in which, when the reception determination unit determines that three or more messages have been received within a monitoring period, the repeat originator determination unit of the speech output device determines whether or not there is an originator repeat message among the three or more messages received within the monitoring period;

a step in which, when the repeat originator determination unit determines that there is an originator-repeated message among three or more messages received within the monitoring period, the order determination unit of the voice output device determines the voice output order of the three or more messages received within the monitoring period so that the originator-repeated messages are consecutive; and

and a step in which the voice output unit of the voice output device outputs voice for three or more messages received in the monitoring period in accordance with the voice output order determined by the order determination unit.