WO2016092765A1

WO2016092765A1 - Sound control system, onboard device, and sound control method

Info

Publication number: WO2016092765A1
Application number: PCT/JP2015/005921
Authority: WO
Inventors: 諒中川; 吉田　一郎
Original assignee: 株式会社デンソー
Priority date: 2014-12-08
Filing date: 2015-11-27
Publication date: 2016-06-16
Also published as: JP6405964B2; JP2016107868A

Abstract

This sound control system has reproduction apparatuses (200, 201, 202) that reproduce a sound and output the reproduced sound via earphones (200e, 201e, 202e) or headphones, and an onboard device (100) that is connected to the reproduction apparatuses so as to be able to communicate therewith. The onboard device is provided with an input detection device (11) that detects inputs from a driver, and a suppression signal transmission device (18) that, when the input detection device detects an input from the driver, transmits a suppression signal for suppressing the output of sound to the reproduction apparatuses. The reproduction apparatuses are provided with a suppression device (24) that, when a suppression signal is received, suppresses the output of the sound that is being outputted from the earphones or headphones.

Description

Voice control system, in-vehicle device, voice control method

Cross-reference of related applications

This application is based on Japanese Patent Application No. 2014-248023 filed on Dec. 8, 2014, the contents of which are incorporated herein by reference.

This disclosure relates to a voice control system, an in-vehicle device, and a voice control method that facilitate communication between a driver and a passenger.

Vehicle drivers may want to communicate with their passengers by communicating with them. For example, you may want to talk about the scenery you see while driving, talk about how to get to your destination, and where and what to eat for lunch. Even if there is no special purpose, you may want to share a pleasant feeling by talking with a passenger.

On the other hand, in recent years, playback devices such as smartphones and rear seat displays have been developed, and passengers sometimes enjoy content (music, games, videos, etc.) played on playback devices. However, in such cases, passengers often wear earphones or headphones to listen to the audio of the content being played (content audio), so the driver may not be aware of it even when calling. .

Therefore, a technique has been proposed in which a message sound for a passenger is output from an earphone or a headphone over the content sound being reproduced (Patent Document 1). In this way, even if the passenger is wearing earphones or headphones, the message can be delivered to the passenger's ear.

However, although the above-mentioned proposed technology can transmit a message to the passenger, there is a problem that the driver cannot sufficiently communicate with the passenger. That is, even if the driver tries to talk with the passenger, the voice output from the earphone or the headphones is obstructed, and the passenger cannot concentrate on the conversation with the driver. For this reason, there was a problem that it was impossible to communicate with subtle nuances such as the tone of the voice and how to speak, and communication could not be sufficiently achieved.

JP 2013-134700 A

This disclosure is intended to provide a voice control system, an in-vehicle device, and a voice control method that facilitate communication between a passenger wearing an earphone or headphones and a driver.

In the first aspect of the present disclosure, the audio control system includes: a reproduction device that reproduces audio and outputs the reproduced audio via an earphone or a headphone; and an in-vehicle device that is communicably connected to the reproduction device. Have The in-vehicle device includes an input detection device that detects an input by a driver, and a suppression signal that suppresses output of the audio to the playback device when the input detection device detects an input by the driver. A signal transmission device. The playback device includes a suppression device that suppresses output of the sound being output from the earphone or the headphones when receiving the suppression signal.

In the above voice control system, when the driver wants to have a conversation with the passenger, the driver can stop outputting voice from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.

In the second aspect of the present disclosure, the in-vehicle device that is connected so as to be able to communicate with a playback device that plays back sound and outputs the played back sound via an earphone or a headphone, detects input by a driver. And a suppression signal transmission device that transmits a suppression signal that suppresses output of the sound being output from the earphone or the headphones to the playback device when the input detection device detects an input by the driver. Is provided.

In the on-vehicle apparatus described above, when the driver wants to talk with the passenger, the driver can stop outputting sound from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.

In the third aspect of the present disclosure, an audio control method for controlling an audio output from an earphone or a headphone of the reproduction device while being reproduced by the reproduction device using an in-vehicle device is provided in the in-vehicle device. Detecting an input by the driver, and when detecting an input by the driver, the vehicle-mounted device transmits a suppression signal for suppressing output of the sound being output from the earphone or the headphones to the playback device. Prepare to do.

In the above voice control method, when the driver wants to talk with the passenger, the driver can stop outputting voice from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.

The above and other objects, features, and advantages of the present disclosure will become more apparent from the following detailed description with reference to the accompanying drawings. The drawing
FIG. 1 is an explanatory diagram showing a vehicle 1 equipped with a voice control system in which an in-vehicle device and a playback device (rear seat display or portable terminal) of the present embodiment are connected so as to communicate with each other. FIG. 2 is an explanatory diagram showing a rough internal configuration of a voice control system in which an in-vehicle device and a playback device are communicably connected, FIG. 3 is a flowchart of the first half of the signal transmission process executed by the in-vehicle device of the present embodiment. FIG. 4 is a flowchart of the latter half of the signal transmission process executed by the in-vehicle device of the present embodiment. FIG. 5 is a flowchart of the signal handling process executed by the playback device of this embodiment. 6 (a) and 6 (b) are explanatory diagrams conceptually showing the function of the voice control system of this embodiment. FIG. 7 is an explanatory diagram conceptually showing functions of another aspect of the voice control system of the present embodiment. FIG. 8 is an explanatory diagram showing a rough internal configuration of a voice control system in which a vehicle-mounted device and a playback device of a modification are connected to be communicable, FIG. 9 is a flowchart of the state confirmation process executed by the in-vehicle device of the modification example. FIG. 10 is a flowchart of the status response process executed by the playback device of the modification example. FIG. 11A and FIG. 11B are explanatory diagrams conceptually showing the processing content of the voice control system of the modification.

Hereinafter, examples will be described in order to clarify the contents of the present disclosure described above.
A. Device configuration :
FIG. 1 shows a vehicle 1 on which an in-vehicle device 100 is mounted. As shown in the figure, an input operation unit 101 composed of a touch panel type display device provided on an instrument panel in front of the driver's seat is connected to the in-vehicle device 100 so as to be communicable. Menu items are displayed on the input operation unit 101. When a driver's finger touches (touches) a predetermined menu item, information indicating the touched menu item is transmitted to the in-vehicle device 100. Thereby, the in-vehicle device 100 detects that the driver has selected a predetermined menu item.

Also, the rear seat display 201 provided in front of the rear seat is connected to the in-vehicle device 100 so as to be communicable. The rear seat display 201 can reproduce various contents such as music, games, and videos independently of the in-vehicle device 100. A passenger in the rear seat (passenger) can view the content image on the display unit of the rear seat display 201 and wears an earphone 201e and headphones (not shown) connected to the rear seat display 201. , Can hear the audio of the content (content audio).

In addition, a mobile terminal 202 such as a smartphone carried by a passenger in the rear seat (passenger) may be connected to the in-vehicle device 100 so as to be communicable. For example, a Bluetooth (registered trademark) signal, which is one of the near field communication standards, may be connected so as to be able to transmit and receive. In this case, the process (initial registration process) which memorize | stores the BD address which is one of the apparatus identification information of the portable terminal 202 in the vehicle-mounted apparatus 100 is performed beforehand. After performing the initial registration process, the various signals are transmitted to the portable terminal 202 by transmitting various signals from the in-vehicle device 100 to the BD address.

Needless to say, the mobile terminal 202 can reproduce various contents, and an occupant in the rear seat can view an image of the content on the display unit of the mobile terminal 202, and the earphone 202 e connected to the mobile terminal 202. And by wearing headphones (not shown), you can listen to the content audio.

In the present embodiment, the above-described system (voice control system) in which both or one of the rear seat display 201 and the portable terminal 202 is connected to the in-vehicle device 100 so as to be communicable corresponds to the “voice control system” in the present disclosure. To do.

In the following, when the rear seat display 201 and the portable terminal 202 are not particularly distinguished, they are collectively expressed as “reproducing device 200”. When the earphone 201e and the earphone 202e are not particularly distinguished, they are collectively expressed as “earphone 200e”.

FIG. 2 shows a rough internal configuration of a voice control system in which the in-vehicle device 100 and the playback device 200 of the present embodiment are communicably connected. As shown in the figure, the in-vehicle device 100 of the present embodiment includes an input detection unit 11, a conversation operation determination unit 12, an availability information storage unit 13, a notification availability determination unit 14, a notification signal transmission unit 15, and whether or not to stop. A determination unit 16, a stop signal transmission timing determination unit 17, and a stop signal transmission unit 18 are provided.

Note that these eight “parts” are abstract concepts in which the inside of the in-vehicle device 100 is classified for convenience, and do not represent that the in-vehicle device 100 is physically divided into eight parts. Therefore, these “units” can be realized as a computer program executed by the CPU, can be realized as an electronic circuit including an LSI or a memory, and further realized by combining them. You can also.

The input detection unit 11 detects a driver's operation on the input operation unit 101. The conversation operation determination unit 12 determines whether the driver's operation on the input operation unit 101 is “normal conversation operation” or “emergency conversation operation” based on the driver's operation detected by the input detection unit 11. To do. Here, in this embodiment, the driver performs a “normal conversation operation” when he / she wants to have a normal conversation with a passenger in the rear seat, for example, when he / she wants to consult where to eat and what to eat. On the other hand, when it is desired to have an emergency conversation with an occupant in the rear seat, for example, when consulting whether or not to proceed straight through the intersection immediately before the intersection, an “emergency conversation operation” is performed.

These “normal conversation operation” and “emergency conversation operation” are performed as follows. For example, an image indicating “normal conversation” (normal conversation icon) and an image indicating “emergency conversation” (emergency conversation icon) are displayed on the input operation unit 101 as menu items that can be selected by the driver. The driver selects the “normal conversation icon” as the “normal conversation operation” when he / she wants to have a normal conversation, and selects the “emergency conversation icon” as the “emergency conversation operation” when he / she wants to have an emergency conversation. Naturally, the conversation operation determination unit 12 determines that the “normal conversation operation” is performed when the “normal conversation icon” is selected, and the “emergency conversation operation” is selected when the “emergency conversation icon” is selected. Determine that it was done.

Note that an image (conversation icon) indicating “conversation” may be simply displayed on the input operation unit 101 without displaying the “normal conversation icon” or the “emergency conversation icon”. In this case, the conversation operation determination unit 12 determines that the “normal conversation operation” has been performed when the “conversation icon” is operated only once within a predetermined time, and the “conversation icon” is operated a plurality of times within the predetermined time. It is determined that an “emergency conversation operation” has been performed (when so-called continuous hitting is performed). This has the following advantages. That is, when the driver wants to carry out an emergency conversation, there is a possibility that there is no room for distinguishing between the “normal conversation icon” and the “emergency conversation icon”. Furthermore, when a human needs to operate a predetermined operation unit in a hurry, the same operation is often performed continuously on the predetermined operation unit (especially when a pressing operation is necessary, so-called continuous hitting is performed). Often). In this regard, if an “emergency conversation operation” is performed by repeatedly hitting a “conversation icon (predetermined operation unit)”, a natural operation when a driver wants to perform an emergency conversation (a behavior that is likely to be performed) ) Can be used to perform an “emergency conversation operation”, and operability can be improved.

Further, instead of the touch panel type display device, the input operation unit 101 employs switches provided on the instrument panel and the steering, and when the switches are operated, the above-described “normal conversation operation” and “ It may be determined that the “emergency conversation operation” has been performed.

When the “emergency conversation operation” is performed, the stop signal transmission unit 18 transmits a stop signal for stopping the output of the content audio from the earphone 200e to the playback device 200.

Here, as will be described in detail later, the in-vehicle device 100 according to the present embodiment is not limited to the case where the “emergency conversation operation” is performed, but the content from the earphone 200e not only when the “normal conversation operation” is performed. A stop signal for stopping the output of sound may be transmitted. However, when the “normal conversation operation” is performed, a notification signal for causing the playback device 200 to notify the output stop of the content audio is transmitted before the stop signal is transmitted. Further, when the “normal conversation operation” is performed, the notice signal and the stop signal are transmitted to the playback device 200 that is permitted to receive the notice signal and the stop signal (the playback device that refuses reception). 200 is not transmitted). In the availability information storage unit 13, information indicating permission / rejection of reception of the warning signal and information indicating permission / rejection of reception of the stop signal (corresponding to each playback device 200, these information are collectively referred to as “ Is stored). The availability information is set (by the occupant) in each playback device 200 and transmitted from the playback device 200 to the in-vehicle device 100 at predetermined intervals. The in-vehicle device 100 stores the availability information in the availability information storage unit 13 every time the availability information is received from the playback device 200.

In the availability information stored in the availability information storage unit 13, the availability information storage unit 13 indicates whether or not the advance playback signal 200 is permitted to be received for the predetermined playback device 200 when the “normal conversation operation” is performed. Judgment based on. The warning signal transmission unit 15 transmits the warning signal to the playback device 200 that is permitted to receive the warning signal.

Further, whether or not the stop possibility determination unit 16 stores in the availability information storage unit 13 whether or not the predetermined playback device 200 is permitted to receive a stop signal when the “normal conversation operation” is performed. Determine based on information. The stop signal transmission timing determination unit 17 determines whether or not it is timing to transmit a stop signal. In this embodiment, the timing for transmitting the stop signal is set after the elapse of a predetermined time (for example, 5 seconds) after the notification signal is transmitted.
Therefore, the stop signal transmission timing determination unit 17 determines whether or not a predetermined time has elapsed since the notification signal was transmitted. In this case, the stop signal transmission unit 15 transmits a stop signal to the playback device 200 that is permitted to receive the stop signal at the timing of transmitting the stop signal.

In this embodiment, the input detection unit 11 corresponds to the “input detection device” in the present disclosure, the stop signal corresponds to the “suppression signal” in the present disclosure, and the stop signal transmission unit 18 corresponds to the “suppression signal” in the present disclosure. Corresponding to “transmitting device”, the warning signal transmitting unit 15 corresponds to “warning signal transmitting device” in the present disclosure.

FIG. 2 shows the internal structure of the playback device 200 in addition to the internal structure of the in-vehicle device 100 described above. As shown in the figure, the playback device 200 of this embodiment includes an audio data storage unit 21, a preview audio output unit 22, a content audio output unit 23, and an output stop unit 24.

Note that these four “parts” are also abstract concepts in which the inside of the playback device 200 is classified for convenience, and do not represent that the playback device 200 is physically divided into four parts. Therefore, these “units” can be realized as a computer program executed by the CPU, can be realized as an electronic circuit including an LSI or a memory, and further realized by combining them. You can also.

The audio data storage unit 21 stores audio data of various contents and audio data of a warning sound to be described later. The content audio output unit 23 reads audio data of various contents from the audio data storage unit 21, and outputs content audio based on the audio data from the earphone 200e. When receiving the warning signal from the in-vehicle device 100, the warning voice output unit 22 reads the voice data of the warning voice from the voice data storage unit 21, and outputs the warning voice based on the voice data from the earphone 200e. The warning sound (preliminary information) is a sound for notifying the output stop of the content sound, for example, “the driver wants a conversation. The output of the content sound will be stopped soon”. When the output stop unit 24 receives a stop signal from the in-vehicle device 100, the output stop unit 24 stops the content audio output by the content audio output unit 23. Note that the playback device 200 also includes a display unit, and images of various contents can be displayed on the display unit, but the display unit is not illustrated.

In the present embodiment, the output stop unit 24 corresponds to the “suppression device” in the present disclosure.

Below, the signal transmission process performed by the vehicle-mounted apparatus 100 mentioned above and the signal corresponding | compatible process performed by the reproducing | regenerating apparatus 200 mentioned above are demonstrated.
B. Signal transmission processing executed by the in-vehicle device 100:
3 and 4 show flowcharts of signal transmission processing executed by the in-vehicle device 100. FIG. This process is executed every predetermined time (for example, every 0.5 seconds) as a timer interrupt process.

As shown in the figure, when the in-vehicle device 100 starts the signal transmission process, first, it is determined whether or not the driver has operated the input operation unit 101 (S101). As a result, when an operation is performed on the input operation unit 101 (S101: yes), it is determined whether the operation is an “emergency conversation operation” (“normal conversation operation”) (S102). .

If an “emergency conversation operation” is performed (S102: yes), it is determined whether or not there is a communicable playback device 200 (S103). As a result, if there is a communicable playback device 200 (S103: yes), the playback device 200 is stored as a transmission destination of a stop signal (a stop signal for stopping output of content audio from the earphone 200e) (S104). ). For example, when the rear seat display 201 is connected to the in-vehicle device 100, the communication port to which the rear seat display 201 is connected, the MAC address of the rear seat display 201, and the like are stored as a stop signal transmission destination. If there is a mobile terminal 202 that is initially registered, the BD address or MAC address of the mobile terminal 202 is stored as a transmission destination.

Thus, when the communicable playback device 200 is stored as the stop signal transmission destination (S104), it is determined whether there is another communicable playback device 200 (S105). As a result, if there is another playback device 200 that can communicate (S105: yes), the playback device 200 is also stored as a stop signal transmission destination (S104). That is, by repeating the processing of S104 and S105, all of the communicable playback devices 200 are stored as stop signal transmission destinations. Then, the stop signal is transmitted to the playback device 200 stored as the stop signal transmission destination (S106). If there is no communication device 200 that can communicate (S103: no), the stop signal is naturally not transmitted (the processing of S104 to S106 is omitted).

As described above, the in-vehicle device 100 according to the present embodiment stops the output of the content audio from the earphone 200e for all of the communicable playback devices 200 when the “emergency conversation operation” is performed by the driver. Send a signal. On the other hand, if the “normal conversation operation” is performed by the driver (S102: no), the process proceeds to the flowchart shown in FIG. 4 and whether there is a playback device 200 that can communicate as in the process of S103. It is determined whether or not (S107). Then, if there is a communicable playback device 200 (S107: yes), the communicable playback device 200 sends a warning signal (content) based on the availability information stored in the availability information storage unit 13 (see FIG. 2). It is determined whether or not reception of a notice signal for notifying the stop of the output of sound is permitted (S108). As a result, when the reception of the warning signal is permitted (S108: yes), the playback device 200 is stored as the transmission destination of the warning signal (S109). In contrast, when the communicable playback device 200 refuses to receive the warning signal (S108: no), the playback device 200 does not store it as the destination of the warning signal (the process of S109 is omitted). ).

In this way, when the playback device 200 that is communicable and is permitted to receive the warning signal is stored as the transmission destination of the warning signal (S109), it is determined whether there is any other playback device 200 that can communicate (S109). S110). As a result, if there is another playback device 200 that can communicate (S110: yes), it is determined whether the playback device 200 is also permitted to receive the warning signal (S108), and the reception of the warning signal is performed. Is permitted (S108: yes), it is stored as the transmission destination of the warning signal (S109). That is, by repeating the processing of S108 to S110, all of the playback devices 200 that are communicable and are permitted to receive the warning signal are stored as the transmission destination of the warning signal. Then, the notification signal is transmitted to the playback device 200 stored as the transmission destination of the notification signal (S111). Thus, when the notice signal is transmitted (S111), in order to determine the transmission timing of the stop signal, the measurement of the elapsed time since the notice signal was transmitted (hereinafter referred to as "time after notice transmission") is started (S112). .

If there is no playback device 200 that is communicable and is permitted to receive the warning signal, it is natural that the warning signal is not transmitted and the measurement of the time after transmission of the warning is not started (S108 to S112). Skip processing).

As described above, the in-vehicle device 100 according to the present embodiment provides content to all of the playback devices 200 that can communicate and permit the reception of the warning signal when the driver performs a “normal conversation operation”. A warning signal is sent to notify the stop of audio output. And the measurement of the time after notice transmission is started.

When the “normal conversation operation” is performed by the driver, it is further determined whether or not the time after the notice transmission is being measured (S113). Of course, immediately after starting the measurement of the time after the transmission of the advance notice, the time after the transmission of the advance notice is being measured (S113: yes). (That is, whether or not it is timing to transmit a stop signal) (S114). If the time after the notice transmission has not yet reached the predetermined time (S114: no), the signal transmission processing shown in FIGS. 3 and 4 is terminated. In this case, if it is determined that there is no operation by the driver in the signal transmission process after the next time (S101: no in FIG. 3), the time after the notice transmission is being measured again in the process of S113 in FIG. (S113: yes), it is determined whether or not the time after the advance notice transmission has reached a predetermined time (S114). That is, if the time after notification transmission is being measured, it is repeatedly determined whether or not the time after notification transmission has reached a predetermined time (S114).

When the time after the notification transmission reaches the predetermined time (S114: yes), it is determined whether or not there is a communicable playback device 200 (S115), as in the process of S107. When there is a communicable playback device 200 (S115: yes), the communicable playback device 200 receives the stop signal based on the availability information stored in the availability information storage unit 13 (see FIG. 2). Whether or not is permitted (S116). As a result, if reception of the stop signal is permitted (S116: yes), the playback device 200 is stored as a stop signal transmission destination (S117). In contrast, when the communicable playback device 200 refuses to receive the stop signal (S116: no), the playback device 200 does not store it as the stop signal transmission destination (the process of S117 is omitted). ).

When the playback device 200 that is communicable and is permitted to receive the stop signal is stored as the stop signal transmission destination (S117), it is determined whether there is another communicable playback device 200 (S117). S118). As a result, if there is another playback device 200 that can communicate (S118: yes), it is determined whether or not the playback device 200 is also permitted to receive the stop signal (S116), and the stop signal is received. Is permitted (S116: yes), it is stored as a stop signal transmission destination (S117). That is, by repeating the processing of S116 to S118, all of the playback devices 200 that are communicable and are permitted to receive the stop signal are stored as stop signal transmission destinations. Then, the stop signal is transmitted to the playback device 200 stored as the stop signal transmission destination (S119).

It should be noted that when there is no playback device 200 that can communicate and is permitted to receive a stop signal, the stop signal is naturally not transmitted (the process of S119 is omitted).

As described above, the in-vehicle device 100 according to the present embodiment provides content to all of the playback devices 200 that can communicate and permit the reception of the warning signal when the driver performs a “normal conversation operation”. A warning signal is sent to notify the stop of audio output. And the measurement of the time after notice transmission is started. Thereafter, when the time after the notification transmission reaches a predetermined time (when it is time to transmit the stop signal), the

earphones

200e and 200e are connected to all of the playback devices 200 that are communicable and permit reception of the stop signal. A stop signal for stopping output of the content sound from the earphone 201e is transmitted.
C. Signal handling processing executed by the playback device 200:
FIG. 5 shows a flowchart of signal correspondence processing executed by the playback device 200. In the signal handling process, a process corresponding to the warning signal or the stop signal transmitted from the in-vehicle device 100 is performed. This process is executed as a timer interrupt process every predetermined time (for example, every 0.5 seconds).

As shown in the figure, when the playback device 200 starts the signal handling process, it first determines whether or not a notice signal has been received (S200). As described above with reference to FIG. 4, the notice signal is a signal transmitted from the in-vehicle device 100 when the “normal conversation operation” is performed by the driver. As a result of the determination process in S200, when it is determined that a warning signal is received (S200: yes), the voice data of the warning sound is read (S201). Then, based on the read audio data of the warning sound, the warning sound for notifying the output stop of the content sound is output from the earphone 200e (S202). For example, a warning sound is output (notifying the driver) that the driver wants a conversation. The output of the content sound will be stopped soon. Of course, when the warning signal is not received (S201: no), the warning voice is not output (the processing of S202 and S203 is omitted).

In addition to outputting the notice sound, information for notifying the output stop of the content sound may be displayed on the display unit of the playback device 200, or an image for notifying the output stop of the content sound instead of outputting the notice sound. (Preliminary image) may be displayed on the display unit of the playback device 200. In addition, when playing content (games, videos, etc.) that outputs an image (content image) together with content audio, a preview image may be displayed over the content image being played, or a preview image may be displayed. Accordingly, the playback of the content image may be continued in the background, the playback of the content image may be temporarily stopped with the display of the preview image, or the content image may be displayed with the display of the preview image. Playback may be terminated.

Also, the content of “notice sound” and “notice image” may be input by the driver. For example, the driver may select one example sentence from a plurality of example sentences for notifying the output stop of the content sound, and the contents of “notice sound” and “notice image” may be input. A voice input unit such as a microphone may be provided in the seat, and the driver may generate the voice input unit to input the content of “precautionary sound” or “precautionary image”.

Subsequently, the playback device 200 determines whether or not a stop signal has been received (S204). The stop signal indicates that a predetermined time has elapsed since the notice signal was transmitted when the driver performed an “emergency conversation operation” (see FIG. 3) and when the driver performed a “normal conversation operation”. In some cases (see FIG. 4), the signal is transmitted from the in-vehicle device 100. As a result of the determination process in S204, if it is determined that a stop signal is received (S204: yes), it is determined whether or not the content is being played back by the playback device 200 (S205). . If the content is being reproduced, the output of the content audio output from the earphone 200e is stopped (S206). Of course, if the stop signal has not been received (S204: no), or if the content is not being reproduced even though the stop signal has been received (S205: no), the process of S206 is omitted. When content (game or video) that outputs a content image along with the content audio is being played back, the content image playback may be continued even if the output of the content audio is stopped, or the output of the content audio is output. Accordingly, the reproduction of the content image may be temporarily stopped, or the reproduction of the content image may be terminated with the output of the content audio.

6A and 6B, the signal transmission processing of the in-vehicle device 100 described above with reference to FIGS. 3 and 4 and the signal correspondence processing of the playback device 200 described above with reference to FIG. 5 are performed. The functions to be realized are shown.

As shown in FIG. 6A, when an “emergency conversation operation” is performed by the driver, the in-vehicle device 100 transmits a stop signal to all of the playback devices 200 that can communicate. That is, the stop signal is also transmitted to the playback device 200 that has refused to receive the stop signal. When the playback device 200 receives the stop signal, the playback device 200 stops the output of the content sound output from the earphone 200e.

Here, the driver of the vehicle 1 may want to communicate with the passenger in the rear seat (passenger). For example, you may want to talk about the scenery you see while driving, talk about how to get to your destination, and where and what to eat for lunch. Even if there is no special purpose, you may want to share a pleasant feeling by talking with a passenger. However, if the occupant in the rear seat wears the earphone 200e and listens to the content sound, the content sound output from the earphone 200e is obstructed and the occupant in the rear seat concentrates on the conversation with the driver. I can't. For this reason, there is a problem that it is impossible to communicate with subtle nuances such as the tone of the voice and how to speak, and communication cannot be sufficiently achieved.

In this regard, in this embodiment, as described above, when the driver wants to have an urgent conversation, the content voice output from the earphone 200e worn by the passenger in the rear seat is performed by performing an “emergency operation”. Can be stopped. Since the original function of the earphone 200e that has stopped outputting the content audio is stopped (that is, the content audio that is the object of interest of the passenger in the rear seat is not output), There is a high possibility that the occupant removes such an earphone 200e. When the rear seat occupant removes the earphone 200e in this way, there is no obstacle to the conversation between the driver and the rear seat occupant, so the rear seat occupant can concentrate on the conversation with the driver. Can communicate well with each other. In addition, even if the rear seat occupant does not remove the earphone 200e, the content audio that is the object of interest of the rear seat occupant is not output, so the interest of the rear seat occupant is discussed with the driver. Can be directed to.

Note that, instead of stopping the content sound, it is also possible to output from the earphone 200e “sound that prompts the user to remove the earphone 200e” superimposed on the content sound. However, even in this case, since the interest of the occupant of the rear seat remains directed to the content audio, the occupant of the rear seat is unlikely to remove the earphone 200e, and the occupant of the rear seat is talking to the driver. There is a problem that you cannot concentrate on.

The above describes the case where the driver performs an “emergency conversation operation”. On the other hand, as shown in FIG. 6B, when a “normal conversation operation” is performed by the driver, the in-vehicle device 100 is capable of communicating and is a playback device that is permitted to receive a warning signal. 200 sends a warning signal. When the playback device 200 receives the warning signal, the playback device 200 outputs a warning voice from the earphone 200e.

In-vehicle device 100 is communicable and permits reception of the stop signal when a predetermined time (time after the notification transmission) elapses after the notification signal is transmitted (when the stop signal is transmitted). A stop signal is transmitted to the playback device 200. When the playback device 200 receives the stop signal, the playback device 200 stops the output of the content sound output from the earphone 200e.

Here, when the driver wants to have a normal conversation (when it is not urgent), he / she wants to start the conversation without disturbing the viewing of the backseat occupant's content if possible (without disturbing the backseat occupant's mood) Is. However, if the output of the content audio from the earphone 200e is suddenly stopped, naturally the viewing of the content of the occupant in the rear seat is hindered, and there is a possibility that the feeling of the occupant in the rear seat may be harmed.

In this respect, as described above, in this embodiment, when a normal conversation is desired (when not urgent), the warning sound is output before the output of the content sound from the earphone 200e is stopped. In this way, the output of the content audio can be stopped after the passengers in the rear seat are prepared to stop the output of the content audio. As a result, it is possible to prevent the passengers in the rear seat from being offended.

Further, as described above, in this embodiment, it is possible to set the reception permission / reception of the warning signal and the reception permission / reception of the stop signal for each playback device 200. That is, the passenger in the rear seat can set permission / rejection of output of the warning sound and permission / rejection of output stop of the content sound. If it carries out like this, since the above-mentioned setting can be performed according to a crew member's preference of a backseat, it can control further that a passenger's mood of a backseat is harmed.

In the above-described embodiment, when the “normal conversation operation” is performed, the in-vehicle device 100 transmits a warning signal and a stop signal to the playback device 200. Instead, it may be as shown in FIG. That is, when the “normal conversation operation” is performed, the in-vehicle device 100 transmits a “notice stop signal for stopping the output of the notice sound and the output of the content sound” to the playback device 200. When the playback device 200 receives the warning stop signal, it first outputs a warning voice. Thereafter, the playback device 200 measures the elapsed time since the announcement sound is output, and stops the output of the content sound from the earphone 200e when the elapsed time reaches a predetermined time (for example, 5 seconds). Even in this case, the same effects as those described above with reference to FIG.
D. Modified example:
Next, a modified example of the present disclosure will be described. In the above-described embodiment, when the “emergency conversation operation” is performed by the driver, the output of the content sound output from the earphone 200e is stopped. In addition, when the “normal conversation operation” is performed by the driver, the output of the content sound being output is stopped after outputting the warning sound from the earphone 200e. However, there are cases where the passenger in the rear seat does not watch the content and the content audio is not output from the earphone 200e. In this case, driving without performing the “emergency conversation operation” or “normal conversation operation” It is possible to have a conversation between the passenger and the rear seat occupant.

Also, although the driver does not stop the content audio, if the passenger in the back seat does not watch the content, the driver may try to have a conversation without love.

Further, since the sound output from the earphone 200e may be heard even if the earphone 200e is not worn, when the content sound is not output from the earphone 200e, the “normal conversation operation” is performed to output the warning sound. This warning sound may be heard by a passenger in the rear seat. In this case, the occupant of the rear seat is given a feeling of discomfort that “the announcement sound (contents for stopping the output of the content sound) has been output even though the content sound has not been output in the first place”.

From the above, it is preferable that the driver can confirm whether or not the passenger in the rear seat is watching the content. However, since it is necessary for the driver to concentrate on the driving operation, it is difficult to visually confirm whether or not the passenger in the rear seat is viewing the content.

Therefore, in the modified example, a function is realized in which it is possible to confirm whether or not the passenger in the rear seat is viewing the content without depending on visual observation. For this purpose, the following configuration is provided in addition to the configuration of the embodiment described above.

FIG. 8 shows a rough internal structure of a voice control system in which the in-vehicle device 100 and the playback device 200 of the modification are connected so as to communicate with each other. In addition to the eight “units” of the embodiment described above with reference to FIG. 2, the in-vehicle device 100 of the modified example includes a confirmation operation determination unit 31, a state confirmation signal transmission unit 32, and a state output unit 33 illustrated in FIG. 8. And. In FIG. 8, for convenience of explanation, illustration of seven “parts” other than the input detection unit 11 among the eight “parts” of the embodiment is omitted. In addition to the four “units” described above with reference to FIG. 2, the reproduction device 200 according to the modification includes a state response signal transmission unit 41 illustrated in FIG. 8. In FIG. 8, for convenience of explanation, illustration of the four “parts” of the embodiment is omitted. The “part” newly added in the modification is also an abstract concept in which the inside of the in-vehicle device 100 and the playback device 200 is classified for convenience, and the in-vehicle device 100 and the playback device 200 are physically separated. It does not represent that. Therefore, these “units” can be realized as a computer program executed by the CPU, can be realized as an electronic circuit including an LSI or a memory, and further realized by combining them. You can also.

The confirmation operation determination unit 31 determines whether the driver's operation on the input operation unit 101 is a “confirmation operation” based on the driver's operation detected by the input detection unit 11. Here, in the modification, the driver performs “confirmation operation” to confirm whether or not the passenger in the rear seat is viewing (that is, the state where the playback device 200 is playing back content). There are things to do. This “confirmation operation” is performed as follows. For example, an image (confirmation icon) indicating “confirmation” is displayed on the input operation unit 101 as a menu item that can be selected by the driver. When the driver wants to confirm whether or not the passenger in the rear seat is viewing the content (the playback device 200 is playing back the content), the “confirmation icon” is used as the “confirmation operation”. Select. The confirmation operation determination unit 31 determines that the “confirmation operation” has been performed when the “confirmation icon” is selected.

The input operation unit 101 employs switches provided on the instrument panel or steering instead of the touch panel display device, and the above-described “confirmation operation” is performed when the switches are operated. It may be determined that

In response to the “confirmation operation” performed by the driver, the state confirmation signal transmission unit 32 of the in-vehicle device 100 reproduces a state confirmation signal for requesting confirmation of whether or not the content is being reproduced. Transmit to the device 200. Further, the state output unit 33 of the in-vehicle device 100 receives a state response signal indicating whether or not the content is being reproduced from the reproduction device 200. Then, based on the state response signal, it outputs to the output device 102 whether or not the playback device 200 is playing back content.

The output device 102 may be a display device that indicates whether or not the playback device 200 is playing back content by image display, or whether or not the playback device 200 is playing back content. It may be a speaker that indicates by sound output. Further, the output device 102 may be formed integrally with the input operation unit 101 (the same device). For example, when the input operation unit 101 is a touch panel display device, an image indicating whether or not the playback device 200 is playing content may be displayed on the display screen of the display device. Alternatively, sound indicating whether or not the playback device 200 is playing content may be output from a speaker included in the touch panel display device.

When the state response signal transmission unit 41 of the playback device 200 receives the state confirmation signal from the in-vehicle device 100, the state response signal transmission unit 41 determines whether or not itself (the playback device 200) is playing back the content. Then, a state response signal indicating the result (whether or not the playback device 200 is playing back content) is transmitted to the in-vehicle device 100.

Below, the state confirmation process performed by the vehicle-mounted apparatus 100 of a modification and the state response process performed by the reproducing | regenerating apparatus 200 of a modification are demonstrated.
D-1. State confirmation process executed by the in-vehicle device 100 of the modified example:
FIG. 9 shows a flowchart of a state confirmation process executed by the in-vehicle device 100 of the modification. This process is executed every predetermined time (for example, every 0.5 seconds) as a timer interrupt process.

As shown in the figure, when the in-vehicle device 100 starts the state confirmation process, first, it is determined whether or not a “confirmation operation” has been performed by the driver (S301). If a “confirmation operation” has been performed (S301: yes), it is determined whether or not there is a communicable playback device 200 (S302). As a result, if there is a communicable reproduction device 200 (S302: yes), the reproduction device 200 is in a state confirmation signal (a state confirmation signal for requesting confirmation of whether or not the content is being reproduced). As a transmission destination (S303). Thus, when the communicable playback device 200 is stored as the transmission destination of the status confirmation signal (S303), it is determined whether there is another communicable playback device 200 (S304). As a result, if there is another playback device 200 that can communicate (S304: yes), the playback device 200 is also stored as the transmission destination of the status confirmation signal (S303). That is, by repeating the processes of S303 and S304, all of the communicable playback devices 200 are stored as the transmission destination of the status confirmation signal. Then, the state confirmation signal is transmitted to the playback device 200 stored as the transmission destination of the state confirmation signal (S305).

In the status confirmation process, it is further determined whether or not status response signals have been received from all of the playback devices 200 that are the destinations of the status confirmation signals (S306). As described above with reference to FIG. 8, the status response signal is a signal received from the playback device 200 that is the transmission destination of the status confirmation signal, and whether or not the playback device 200 is playing back content. It is a signal which shows. If it is determined in S306 that the status response signal has been received from all of the playback devices 200 that are the destinations of the status confirmation signal (S306: yes), the playback device 200 determines that the status response signal has been received. It is determined whether or not the content is being reproduced (S307).

As a result, when the playback device 200 is not playing the content (S307: no), it is easy to have a conversation with the passenger in the rear seat, that is, “emergency conversation operation” or “normal conversation operation”. Information (image, sound, etc.) indicating that there is no need to perform is output to the output device 102. The driver who receives such an output calls the passenger in the rear seat and starts the conversation without performing the “emergency conversation operation” or the “normal conversation operation”.

On the other hand, when the playback device 200 is playing back content (S307: yes), it is difficult to converse with the passenger in the rear seat, that is, "emergency conversation operation" or "normal conversation" Information (image, sound, etc.) indicating that it is necessary to perform “operation” is output to the output device 102. The driver who receives such an output performs the “emergency conversation operation” or “normal conversation operation” in the same manner as in the above-described embodiment, and then removes the earphone 200e from the rear seat occupant, and then occupies the rear seat. To start a conversation.

Here, when status response signals are received from a plurality of playback devices 200, that is, when communication with a plurality of playback devices 200 is possible, there is no playback device 200 that is playing back content. When the information indicating that it is not necessary to perform the “emergency conversation operation” or the “normal conversation operation” is displayed on the output device 102 and there is at least one reproduction device 200 that is reproducing the content, Information indicating that it is necessary to perform “operation” or “normal conversation operation” is displayed on the output device 102. This is because there is a possibility that the occupant in the rear seat is wearing the earphone 200e in order to listen to the content sound output from the playback device 200 when there is even one playback device 200 that is playing back the content. This is because it is expensive.
D-2. State response process executed by the reproduction apparatus 200 of the modified example:
FIG. 10 shows a flowchart of the status response process executed by the reproduction device 200 of the modification. This process is executed every predetermined time (for example, every 0.5 seconds) as a timer interrupt process.

As shown in the figure, when the playback device 200 starts the state response process of the modified example, first, it is determined whether or not a state confirmation signal is received (S401). As described above with reference to FIG. 9, the state confirmation signal is a signal transmitted from the in-vehicle device 100 when the “confirmation operation” is performed by the driver. As a result of the determination process in S401, if it is determined that a state confirmation signal has been received (S401: yes), whether or not it is in a state of reproducing content (that is, the earphone) It is determined whether or not the sound is being output from 200e (S402). As a result, when the content is being reproduced (S402: yes), a state response signal indicating that the content is being reproduced is transmitted to the in-vehicle device 100 (S403), and the content is If it is not being played back (S402: no), a state response signal indicating that the content is being played back is transmitted to the in-vehicle device 100 (S404). Upon receiving these state response signals, the in-vehicle device 100 indicates that it is necessary or necessary to perform an “emergency conversation operation” or a “normal conversation operation” as described above with reference to FIG. Information is output to the output device 102.

In FIG. 11A and FIG. 11B, the state confirmation process of the in-vehicle device 100 described above with reference to FIG. 9 and the state response process of the playback device 200 described above with reference to FIG. 10 are performed. The function to be realized is shown.

As shown in FIG. 11A, when the “confirmation operation” is performed by the driver, the in-vehicle device 100 transmits a state confirmation signal to all of the playback devices 200 that can communicate. When the playback device 200 receives the state confirmation signal, the playback device 200 transmits a state response signal indicating that the content is being played back to the in-vehicle device 100 if the content is being played back. When the in-vehicle device 100 receives the state response signal indicating that the content is being reproduced, the in-vehicle device 100 outputs information indicating that the “emergency conversation operation” or the “normal conversation operation” is necessary to the output device 102. .

Further, as shown in FIG. 11B, when the playback device 200 receives the state confirmation signal, the state indicating that the content is not being played back if the content is not being played back. A response signal is transmitted to the in-vehicle device 100. When the in-vehicle device 100 receives the state response signal indicating that the content is not being reproduced, the in-vehicle device 100 outputs information indicating that the “emergency conversation operation” or the “normal conversation operation” is not required to the output device 102. .

In this way, the driver can check whether the passenger in the rear seat is watching the content while concentrating on the driving operation (without relying on visual observation). As a result, when the passenger in the rear seat is not viewing the content, it is possible to perform a conversation with the passenger in the rear seat without performing the “emergency conversation operation” or the “normal conversation operation”. In addition, although the driver does not stop the content audio, if the passenger in the rear seat is not watching the content, the driver may try to have a conversation without love. Such a conversation without love can be carried out without hesitation if it can be confirmed that the passenger in the rear seat is not viewing the content. Further, it is possible to prevent the notice voice from being output by performing the “normal conversation operation” even though the passenger in the rear seat is not viewing the content. As a result, it is possible to prevent the passenger in the rear seat from being given an uncomfortable feeling that “the announcement sound (contents for stopping the output of the content sound) was output even though the content sound was not output in the first place”.

As mentioned above, although an Example and a modification were demonstrated, this indication is not restricted to said Example and a modification, It can implement in a various aspect in the range which does not deviate from the summary.

For example, in the above-described embodiments and modifications, the case where the earphone 200e is connected to the playback device 200 has been described, but the same processing as when the earphone 200e is connected is performed even when headphones are connected. It is possible and has the same effect.

Here, the flowchart described in this application or the process of the flowchart is configured by a plurality of sections (or referred to as steps), and each section is expressed as S101, for example. Further, each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section. Further, each section configured in this manner can be referred to as a device, module, or means.

Although the present disclosure has been described based on the embodiments, it is understood that the present disclosure is not limited to the embodiments and structures. The present disclosure includes various modifications and modifications within the equivalent range. In addition, various combinations and forms, as well as other combinations and forms including only one element, more or less, are within the scope and spirit of the present disclosure.

Claims

A playback device (200, 201, 202) for playing back sound and outputting the played back sound through an earphone (200e, 201e, 202e) or headphones;
A voice control system having an in-vehicle device (100) communicably connected to the playback device,
The in-vehicle device is
An input detection device (11) for detecting an input by the driver;
When the input detection device detects an input by the driver, a suppression signal transmission device (18) that transmits a suppression signal that suppresses the output of the sound to the playback device, and
The playback device includes a suppression device (24) that suppresses output of the sound being output from the earphone or the headphones when receiving the suppression signal.
An in-vehicle device (100) connected to be communicable with a playback device (200, 201, 202) that plays back sound and outputs the played back sound through earphones (200e, 201e, 202e) or headphones. ,
An input detection device (11) for detecting an input by the driver;
A suppression signal transmission device that transmits a suppression signal (18) for suppressing output of the sound being output from the earphone or the headphones to the playback device when the input detection device detects an input by the driver; A vehicle-mounted device comprising:
The in-vehicle device according to claim 2,
The suppression signal transmission device transmits a signal for stopping output of the sound being output from the earphone or the headphones as the suppression signal.
The in-vehicle device according to claim 2 or claim 3,
Before the suppression signal transmission device transmits the suppression signal, a warning signal transmission that transmits a warning signal that causes the playback device to suppress the output of the sound being output from the earphone or the headphone. A vehicle-mounted device further comprising a device (15).
Audio that is played back on the playback device (200, 201, 202) and that controls the output of the sound output from the earphone (200e, 201e, 202e) or the headphone of the playback device using the in-vehicle device (100) A control method,
Detecting an input by a driver in the in-vehicle device (S101);
When an input by the driver is detected, a suppression signal for suppressing output of the sound being output from the earphone or the headphones is transmitted from the in-vehicle device to the playback device (S106, S119).
A voice control method comprising: