WO2016092765A1 - Système de commande sonore, dispositif embarqué, et procédé de commande sonore - Google Patents

Système de commande sonore, dispositif embarqué, et procédé de commande sonore Download PDF

Info

Publication number
WO2016092765A1
WO2016092765A1 PCT/JP2015/005921 JP2015005921W WO2016092765A1 WO 2016092765 A1 WO2016092765 A1 WO 2016092765A1 JP 2015005921 W JP2015005921 W JP 2015005921W WO 2016092765 A1 WO2016092765 A1 WO 2016092765A1
Authority
WO
WIPO (PCT)
Prior art keywords
output
sound
playback device
driver
content
Prior art date
Application number
PCT/JP2015/005921
Other languages
English (en)
Japanese (ja)
Inventor
諒 中川
吉田　一郎
Original Assignee
株式会社デンソー
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社デンソー filed Critical 株式会社デンソー
Publication of WO2016092765A1 publication Critical patent/WO2016092765A1/fr

Links

Images

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60R—VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R11/00—Arrangements for holding or mounting articles, not otherwise provided for
    • B60R11/02—Arrangements for holding or mounting articles, not otherwise provided for for radio sets, television sets, telephones, or the like; Arrangement of controls thereof

Definitions

  • This disclosure relates to a voice control system, an in-vehicle device, and a voice control method that facilitate communication between a driver and a passenger.
  • Vehicle drivers may want to communicate with their passengers by communicating with them. For example, you may want to talk about the scenery you see while driving, talk about how to get to your destination, and where and what to eat for lunch. Even if there is no special purpose, you may want to share a pleasant feeling by talking with a passenger.
  • playback devices such as smartphones and rear seat displays have been developed, and passengers sometimes enjoy content (music, games, videos, etc.) played on playback devices.
  • content music, games, videos, etc.
  • passengers often wear earphones or headphones to listen to the audio of the content being played (content audio), so the driver may not be aware of it even when calling. .
  • Patent Document 1 a technique has been proposed in which a message sound for a passenger is output from an earphone or a headphone over the content sound being reproduced. In this way, even if the passenger is wearing earphones or headphones, the message can be delivered to the passenger's ear.
  • This disclosure is intended to provide a voice control system, an in-vehicle device, and a voice control method that facilitate communication between a passenger wearing an earphone or headphones and a driver.
  • the audio control system includes: a reproduction device that reproduces audio and outputs the reproduced audio via an earphone or a headphone; and an in-vehicle device that is communicably connected to the reproduction device.
  • the in-vehicle device includes an input detection device that detects an input by a driver, and a suppression signal that suppresses output of the audio to the playback device when the input detection device detects an input by the driver.
  • the playback device includes a suppression device that suppresses output of the sound being output from the earphone or the headphones when receiving the suppression signal.
  • the driver when the driver wants to have a conversation with the passenger, the driver can stop outputting voice from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.
  • the in-vehicle device that is connected so as to be able to communicate with a playback device that plays back sound and outputs the played back sound via an earphone or a headphone, detects input by a driver.
  • a suppression signal transmission device that transmits a suppression signal that suppresses output of the sound being output from the earphone or the headphones to the playback device when the input detection device detects an input by the driver.
  • the driver when the driver wants to talk with the passenger, the driver can stop outputting sound from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.
  • an audio control method for controlling an audio output from an earphone or a headphone of the reproduction device while being reproduced by the reproduction device using an in-vehicle device is provided in the in-vehicle device. Detecting an input by the driver, and when detecting an input by the driver, the vehicle-mounted device transmits a suppression signal for suppressing output of the sound being output from the earphone or the headphones to the playback device. Prepare to do.
  • the driver when the driver wants to talk with the passenger, the driver can stop outputting voice from the earphone or headphones worn by the passenger by performing a predetermined input. Since the earphones and headphones that have stopped outputting sound are in a state where their original functions are stopped, passengers are likely to remove such earphones and headphones. And if the passenger removes the earphones or headphones in this way, there will be no obstacle to the conversation between the driver and the passenger, so the passenger can concentrate on the conversation with the driver and communicate Can be sufficiently planned.
  • FIG. 1 is an explanatory diagram showing a vehicle 1 equipped with a voice control system in which an in-vehicle device and a playback device (rear seat display or portable terminal) of the present embodiment are connected so as to communicate with each other.
  • FIG. 2 is an explanatory diagram showing a rough internal configuration of a voice control system in which an in-vehicle device and a playback device are communicably connected
  • FIG. 3 is a flowchart of the first half of the signal transmission process executed by the in-vehicle device of the present embodiment.
  • FIG. 4 is a flowchart of the latter half of the signal transmission process executed by the in-vehicle device of the present embodiment.
  • FIG. 5 is a flowchart of the signal handling process executed by the playback device of this embodiment.
  • 6 (a) and 6 (b) are explanatory diagrams conceptually showing the function of the voice control system of this embodiment.
  • FIG. 7 is an explanatory diagram conceptually showing functions of another aspect of the voice control system of the present embodiment.
  • FIG. 8 is an explanatory diagram showing a rough internal configuration of a voice control system in which a vehicle-mounted device and a playback device of a modification are connected to be communicable,
  • FIG. 9 is a flowchart of the state confirmation process executed by the in-vehicle device of the modification example.
  • FIG. 10 is a flowchart of the status response process executed by the playback device of the modification example.
  • FIG. 11A and FIG. 11B are explanatory diagrams conceptually showing the processing content of the voice control system of
  • FIG. 1 shows a vehicle 1 on which an in-vehicle device 100 is mounted.
  • an input operation unit 101 composed of a touch panel type display device provided on an instrument panel in front of the driver's seat is connected to the in-vehicle device 100 so as to be communicable.
  • Menu items are displayed on the input operation unit 101.
  • a driver's finger touches (touches) a predetermined menu item
  • information indicating the touched menu item is transmitted to the in-vehicle device 100.
  • the in-vehicle device 100 detects that the driver has selected a predetermined menu item.
  • the rear seat display 201 provided in front of the rear seat is connected to the in-vehicle device 100 so as to be communicable.
  • the rear seat display 201 can reproduce various contents such as music, games, and videos independently of the in-vehicle device 100.
  • a passenger in the rear seat can view the content image on the display unit of the rear seat display 201 and wears an earphone 201e and headphones (not shown) connected to the rear seat display 201. , Can hear the audio of the content (content audio).
  • a mobile terminal 202 such as a smartphone carried by a passenger in the rear seat (passenger) may be connected to the in-vehicle device 100 so as to be communicable.
  • a Bluetooth (registered trademark) signal which is one of the near field communication standards, may be connected so as to be able to transmit and receive.
  • the process which memorize
  • the mobile terminal 202 can reproduce various contents, and an occupant in the rear seat can view an image of the content on the display unit of the mobile terminal 202, and the earphone 202 e connected to the mobile terminal 202. And by wearing headphones (not shown), you can listen to the content audio.
  • the above-described system in which both or one of the rear seat display 201 and the portable terminal 202 is connected to the in-vehicle device 100 so as to be communicable corresponds to the “voice control system” in the present disclosure. To do.
  • the rear seat display 201 and the portable terminal 202 are not particularly distinguished, they are collectively expressed as “reproducing device 200”.
  • the earphone 201e and the earphone 202e are not particularly distinguished, they are collectively expressed as “earphone 200e”.
  • FIG. 2 shows a rough internal configuration of a voice control system in which the in-vehicle device 100 and the playback device 200 of the present embodiment are communicably connected.
  • the in-vehicle device 100 of the present embodiment includes an input detection unit 11, a conversation operation determination unit 12, an availability information storage unit 13, a notification availability determination unit 14, a notification signal transmission unit 15, and whether or not to stop.
  • a determination unit 16, a stop signal transmission timing determination unit 17, and a stop signal transmission unit 18 are provided.
  • these eight “parts” are abstract concepts in which the inside of the in-vehicle device 100 is classified for convenience, and do not represent that the in-vehicle device 100 is physically divided into eight parts. Therefore, these “units” can be realized as a computer program executed by the CPU, can be realized as an electronic circuit including an LSI or a memory, and further realized by combining them. You can also.
  • the input detection unit 11 detects a driver's operation on the input operation unit 101.
  • the conversation operation determination unit 12 determines whether the driver's operation on the input operation unit 101 is “normal conversation operation” or “emergency conversation operation” based on the driver's operation detected by the input detection unit 11. To do.
  • the driver performs a “normal conversation operation” when he / she wants to have a normal conversation with a passenger in the rear seat, for example, when he / she wants to consult where to eat and what to eat.
  • an “emergency conversation operation” is performed.
  • normal conversation operation and “emergency conversation operation” are performed as follows. For example, an image indicating “normal conversation” (normal conversation icon) and an image indicating “emergency conversation” (emergency conversation icon) are displayed on the input operation unit 101 as menu items that can be selected by the driver. The driver selects the “normal conversation icon” as the “normal conversation operation” when he / she wants to have a normal conversation, and selects the “emergency conversation icon” as the “emergency conversation operation” when he / she wants to have an emergency conversation. Naturally, the conversation operation determination unit 12 determines that the “normal conversation operation” is performed when the “normal conversation icon” is selected, and the “emergency conversation operation” is selected when the “emergency conversation icon” is selected. Determine that it was done.
  • an image (conversation icon) indicating “conversation” may be simply displayed on the input operation unit 101 without displaying the “normal conversation icon” or the “emergency conversation icon”.
  • the conversation operation determination unit 12 determines that the “normal conversation operation” has been performed when the “conversation icon” is operated only once within a predetermined time, and the “conversation icon” is operated a plurality of times within the predetermined time. It is determined that an “emergency conversation operation” has been performed (when so-called continuous hitting is performed). This has the following advantages. That is, when the driver wants to carry out an emergency conversation, there is a possibility that there is no room for distinguishing between the “normal conversation icon” and the “emergency conversation icon”.
  • the input operation unit 101 employs switches provided on the instrument panel and the steering, and when the switches are operated, the above-described “normal conversation operation” and “ It may be determined that the “emergency conversation operation” has been performed.
  • the stop signal transmission unit 18 transmits a stop signal for stopping the output of the content audio from the earphone 200e to the playback device 200.
  • the in-vehicle device 100 is not limited to the case where the “emergency conversation operation” is performed, but the content from the earphone 200e not only when the “normal conversation operation” is performed.
  • a stop signal for stopping the output of sound may be transmitted.
  • a notification signal for causing the playback device 200 to notify the output stop of the content audio is transmitted before the stop signal is transmitted.
  • the notice signal and the stop signal are transmitted to the playback device 200 that is permitted to receive the notice signal and the stop signal (the playback device that refuses reception). 200 is not transmitted).
  • the availability information storage unit 13 information indicating permission / rejection of reception of the warning signal and information indicating permission / rejection of reception of the stop signal (corresponding to each playback device 200, these information are collectively referred to as “ Is stored).
  • the availability information is set (by the occupant) in each playback device 200 and transmitted from the playback device 200 to the in-vehicle device 100 at predetermined intervals.
  • the in-vehicle device 100 stores the availability information in the availability information storage unit 13 every time the availability information is received from the playback device 200.
  • the availability information storage unit 13 indicates whether or not the advance playback signal 200 is permitted to be received for the predetermined playback device 200 when the “normal conversation operation” is performed. Judgment based on.
  • the warning signal transmission unit 15 transmits the warning signal to the playback device 200 that is permitted to receive the warning signal.
  • the stop possibility determination unit 16 stores in the availability information storage unit 13 whether or not the predetermined playback device 200 is permitted to receive a stop signal when the “normal conversation operation” is performed. Determine based on information.
  • the stop signal transmission timing determination unit 17 determines whether or not it is timing to transmit a stop signal. In this embodiment, the timing for transmitting the stop signal is set after the elapse of a predetermined time (for example, 5 seconds) after the notification signal is transmitted. Therefore, the stop signal transmission timing determination unit 17 determines whether or not a predetermined time has elapsed since the notification signal was transmitted. In this case, the stop signal transmission unit 15 transmits a stop signal to the playback device 200 that is permitted to receive the stop signal at the timing of transmitting the stop signal.
  • a predetermined time for example, 5 seconds
  • the input detection unit 11 corresponds to the “input detection device” in the present disclosure
  • the stop signal corresponds to the “suppression signal” in the present disclosure
  • the stop signal transmission unit 18 corresponds to the “suppression signal” in the present disclosure.
  • the warning signal transmitting unit 15 corresponds to “warning signal transmitting device” in the present disclosure.
  • FIG. 2 shows the internal structure of the playback device 200 in addition to the internal structure of the in-vehicle device 100 described above.
  • the playback device 200 of this embodiment includes an audio data storage unit 21, a preview audio output unit 22, a content audio output unit 23, and an output stop unit 24.
  • these four “parts” are also abstract concepts in which the inside of the playback device 200 is classified for convenience, and do not represent that the playback device 200 is physically divided into four parts. Therefore, these “units” can be realized as a computer program executed by the CPU, can be realized as an electronic circuit including an LSI or a memory, and further realized by combining them. You can also.
  • the audio data storage unit 21 stores audio data of various contents and audio data of a warning sound to be described later.
  • the content audio output unit 23 reads audio data of various contents from the audio data storage unit 21, and outputs content audio based on the audio data from the earphone 200e.
  • the warning voice output unit 22 When receiving the warning signal from the in-vehicle device 100, the warning voice output unit 22 reads the voice data of the warning voice from the voice data storage unit 21, and outputs the warning voice based on the voice data from the earphone 200e.
  • the warning sound (preliminary information) is a sound for notifying the output stop of the content sound, for example, “the driver wants a conversation. The output of the content sound will be stopped soon”.
  • the output stop unit 24 When the output stop unit 24 receives a stop signal from the in-vehicle device 100, the output stop unit 24 stops the content audio output by the content audio output unit 23.
  • the playback device 200 also includes a display unit, and images of various contents can be displayed on the display unit, but the display unit is not illustrated.
  • the output stop unit 24 corresponds to the “suppression device” in the present disclosure.
  • an “emergency conversation operation” is performed (S102: yes)
  • the playback device 200 is stored as a transmission destination of a stop signal (a stop signal for stopping output of content audio from the earphone 200e) (S104). ).
  • a stop signal a stop signal for stopping output of content audio from the earphone 200e
  • the communication port to which the rear seat display 201 is connected the MAC address of the rear seat display 201, and the like are stored as a stop signal transmission destination.
  • the BD address or MAC address of the mobile terminal 202 is stored as a transmission destination.
  • the playback device 200 is stored as the stop signal transmission destination (S104), it is determined whether there is another communicable playback device 200 (S105). As a result, if there is another playback device 200 that can communicate (S105: yes), the playback device 200 is also stored as a stop signal transmission destination (S104). That is, by repeating the processing of S104 and S105, all of the communicable playback devices 200 are stored as stop signal transmission destinations. Then, the stop signal is transmitted to the playback device 200 stored as the stop signal transmission destination (S106). If there is no communication device 200 that can communicate (S103: no), the stop signal is naturally not transmitted (the processing of S104 to S106 is omitted).
  • the in-vehicle device 100 stops the output of the content audio from the earphone 200e for all of the communicable playback devices 200 when the “emergency conversation operation” is performed by the driver. Send a signal.
  • the process proceeds to the flowchart shown in FIG. 4 and whether there is a playback device 200 that can communicate as in the process of S103. It is determined whether or not (S107). Then, if there is a communicable playback device 200 (S107: yes), the communicable playback device 200 sends a warning signal (content) based on the availability information stored in the availability information storage unit 13 (see FIG. 2).
  • the playback device 200 that is communicable and is permitted to receive the warning signal is stored as the transmission destination of the warning signal (S109), it is determined whether there is any other playback device 200 that can communicate (S109). S110). As a result, if there is another playback device 200 that can communicate (S110: yes), it is determined whether the playback device 200 is also permitted to receive the warning signal (S108), and the reception of the warning signal is performed. Is permitted (S108: yes), it is stored as the transmission destination of the warning signal (S109). That is, by repeating the processing of S108 to S110, all of the playback devices 200 that are communicable and are permitted to receive the warning signal are stored as the transmission destination of the warning signal.
  • the notification signal is transmitted to the playback device 200 stored as the transmission destination of the notification signal (S111).
  • the notice signal is transmitted (S111)
  • the measurement of the elapsed time since the notice signal was transmitted (hereinafter referred to as "time after notice transmission") is started (S112). .
  • the in-vehicle device 100 provides content to all of the playback devices 200 that can communicate and permit the reception of the warning signal when the driver performs a “normal conversation operation”.
  • a warning signal is sent to notify the stop of audio output. And the measurement of the time after notice transmission is started.
  • the communicable playback device 200 receives the stop signal based on the availability information stored in the availability information storage unit 13 (see FIG. 2). Whether or not is permitted (S116). As a result, if reception of the stop signal is permitted (S116: yes), the playback device 200 is stored as a stop signal transmission destination (S117). In contrast, when the communicable playback device 200 refuses to receive the stop signal (S116: no), the playback device 200 does not store it as the stop signal transmission destination (the process of S117 is omitted). ).
  • the playback device 200 that is communicable and is permitted to receive the stop signal is stored as the stop signal transmission destination (S117), it is determined whether there is another communicable playback device 200 (S117). S118). As a result, if there is another playback device 200 that can communicate (S118: yes), it is determined whether or not the playback device 200 is also permitted to receive the stop signal (S116), and the stop signal is received. Is permitted (S116: yes), it is stored as a stop signal transmission destination (S117). That is, by repeating the processing of S116 to S118, all of the playback devices 200 that are communicable and are permitted to receive the stop signal are stored as stop signal transmission destinations. Then, the stop signal is transmitted to the playback device 200 stored as the stop signal transmission destination (S119).
  • the in-vehicle device 100 provides content to all of the playback devices 200 that can communicate and permit the reception of the warning signal when the driver performs a “normal conversation operation”.
  • a warning signal is sent to notify the stop of audio output.
  • the measurement of the time after notice transmission is started. Thereafter, when the time after the notification transmission reaches a predetermined time (when it is time to transmit the stop signal), the earphones 200e and 200e are connected to all of the playback devices 200 that are communicable and permit reception of the stop signal.
  • a stop signal for stopping output of the content sound from the earphone 201e is transmitted.
  • FIG. 5 shows a flowchart of signal correspondence processing executed by the playback device 200. In the signal handling process, a process corresponding to the warning signal or the stop signal transmitted from the in-vehicle device 100 is performed. This process is executed as a timer interrupt process every predetermined time (for example, every 0.5 seconds).
  • the playback device 200 when the playback device 200 starts the signal handling process, it first determines whether or not a notice signal has been received (S200).
  • the notice signal is a signal transmitted from the in-vehicle device 100 when the “normal conversation operation” is performed by the driver.
  • the voice data of the warning sound is read (S201).
  • the warning sound for notifying the output stop of the content sound is output from the earphone 200e (S202).
  • a warning sound is output (notifying the driver) that the driver wants a conversation. The output of the content sound will be stopped soon.
  • the warning signal is not received (S201: no)
  • the warning voice is not output (the processing of S202 and S203 is omitted).
  • information for notifying the output stop of the content sound may be displayed on the display unit of the playback device 200, or an image for notifying the output stop of the content sound instead of outputting the notice sound.
  • Preliminary image may be displayed on the display unit of the playback device 200.
  • a preview image may be displayed over the content image being played, or a preview image may be displayed. Accordingly, the playback of the content image may be continued in the background, the playback of the content image may be temporarily stopped with the display of the preview image, or the content image may be displayed with the display of the preview image. Playback may be terminated.
  • the content of “notice sound” and “notice image” may be input by the driver.
  • the driver may select one example sentence from a plurality of example sentences for notifying the output stop of the content sound, and the contents of “notice sound” and “notice image” may be input.
  • a voice input unit such as a microphone may be provided in the seat, and the driver may generate the voice input unit to input the content of “precautionary sound” or “precautionary image”.
  • the playback device 200 determines whether or not a stop signal has been received (S204).
  • the stop signal indicates that a predetermined time has elapsed since the notice signal was transmitted when the driver performed an “emergency conversation operation” (see FIG. 3) and when the driver performed a “normal conversation operation”. In some cases (see FIG. 4), the signal is transmitted from the in-vehicle device 100.
  • S204 if it is determined that a stop signal is received (S204: yes), it is determined whether or not the content is being played back by the playback device 200 (S205). . If the content is being reproduced, the output of the content audio output from the earphone 200e is stopped (S206).
  • the process of S206 is omitted.
  • content game or video
  • the content image playback may be continued even if the output of the content audio is stopped, or the output of the content audio is output. Accordingly, the reproduction of the content image may be temporarily stopped, or the reproduction of the content image may be terminated with the output of the content audio.
  • the in-vehicle device 100 transmits a stop signal to all of the playback devices 200 that can communicate. That is, the stop signal is also transmitted to the playback device 200 that has refused to receive the stop signal.
  • the playback device 200 stops the output of the content sound output from the earphone 200e.
  • the driver of the vehicle 1 may want to communicate with the passenger in the rear seat (passenger). For example, you may want to talk about the scenery you see while driving, talk about how to get to your destination, and where and what to eat for lunch. Even if there is no special purpose, you may want to share a pleasant feeling by talking with a passenger.
  • the occupant in the rear seat wears the earphone 200e and listens to the content sound, the content sound output from the earphone 200e is obstructed and the occupant in the rear seat concentrates on the conversation with the driver. I can't. For this reason, there is a problem that it is impossible to communicate with subtle nuances such as the tone of the voice and how to speak, and communication cannot be sufficiently achieved.
  • the content voice output from the earphone 200e worn by the passenger in the rear seat is performed by performing an “emergency operation”. Can be stopped. Since the original function of the earphone 200e that has stopped outputting the content audio is stopped (that is, the content audio that is the object of interest of the passenger in the rear seat is not output), There is a high possibility that the occupant removes such an earphone 200e. When the rear seat occupant removes the earphone 200e in this way, there is no obstacle to the conversation between the driver and the rear seat occupant, so the rear seat occupant can concentrate on the conversation with the driver. Can communicate well with each other. In addition, even if the rear seat occupant does not remove the earphone 200e, the content audio that is the object of interest of the rear seat occupant is not output, so the interest of the rear seat occupant is discussed with the driver. Can be directed to.
  • the in-vehicle device 100 when a “normal conversation operation” is performed by the driver, the in-vehicle device 100 is capable of communicating and is a playback device that is permitted to receive a warning signal. 200 sends a warning signal. When the playback device 200 receives the warning signal, the playback device 200 outputs a warning voice from the earphone 200e.
  • In-vehicle device 100 is communicable and permits reception of the stop signal when a predetermined time (time after the notification transmission) elapses after the notification signal is transmitted (when the stop signal is transmitted).
  • a stop signal is transmitted to the playback device 200.
  • the playback device 200 receives the stop signal, the playback device 200 stops the output of the content sound output from the earphone 200e.
  • the warning sound is output before the output of the content sound from the earphone 200e is stopped.
  • the output of the content audio can be stopped after the passengers in the rear seat are prepared to stop the output of the content audio.
  • the passenger in the rear seat can set permission / rejection of output of the warning sound and permission / rejection of output stop of the content sound. If it carries out like this, since the above-mentioned setting can be performed according to a crew member's preference of a backseat, it can control further that a passenger's mood of a backseat is harmed.
  • the in-vehicle device 100 transmits a warning signal and a stop signal to the playback device 200. Instead, it may be as shown in FIG. That is, when the “normal conversation operation” is performed, the in-vehicle device 100 transmits a “notice stop signal for stopping the output of the notice sound and the output of the content sound” to the playback device 200.
  • the playback device 200 receives the warning stop signal, it first outputs a warning voice. Thereafter, the playback device 200 measures the elapsed time since the announcement sound is output, and stops the output of the content sound from the earphone 200e when the elapsed time reaches a predetermined time (for example, 5 seconds).
  • the driver does not stop the content audio, if the passenger in the back seat does not watch the content, the driver may try to have a conversation without love.
  • the “normal conversation operation” is performed to output the warning sound.
  • This warning sound may be heard by a passenger in the rear seat. In this case, the occupant of the rear seat is given a feeling of discomfort that “the announcement sound (contents for stopping the output of the content sound) has been output even though the content sound has not been output in the first place”.
  • the driver can confirm whether or not the passenger in the rear seat is watching the content.
  • it is necessary for the driver to concentrate on the driving operation it is difficult to visually confirm whether or not the passenger in the rear seat is viewing the content.
  • a function is realized in which it is possible to confirm whether or not the passenger in the rear seat is viewing the content without depending on visual observation.
  • the following configuration is provided in addition to the configuration of the embodiment described above.
  • FIG. 8 shows a rough internal structure of a voice control system in which the in-vehicle device 100 and the playback device 200 of the modification are connected so as to communicate with each other.
  • the in-vehicle device 100 of the modified example includes a confirmation operation determination unit 31, a state confirmation signal transmission unit 32, and a state output unit 33 illustrated in FIG. 8.
  • illustration of seven “parts” other than the input detection unit 11 among the eight “parts” of the embodiment is omitted.
  • the reproduction device 200 according to the modification includes a state response signal transmission unit 41 illustrated in FIG. 8.
  • FIG. 8 shows a rough internal structure of a voice control system in which the in-vehicle device 100 and the playback device 200 of the modification are connected so as to communicate with each other.
  • the in-vehicle device 100 of the modified example includes a confirmation operation determination unit 31, a state confirmation signal transmission unit 32, and a state output unit 33 illustrated in FIG. 8.
  • the confirmation operation determination unit 31 determines whether the driver's operation on the input operation unit 101 is a “confirmation operation” based on the driver's operation detected by the input detection unit 11.
  • the driver performs “confirmation operation” to confirm whether or not the passenger in the rear seat is viewing (that is, the state where the playback device 200 is playing back content).
  • This “confirmation operation” is performed as follows. For example, an image (confirmation icon) indicating “confirmation” is displayed on the input operation unit 101 as a menu item that can be selected by the driver.
  • the confirmation operation determination unit 31 determines that the “confirmation operation” has been performed when the “confirmation icon” is selected.
  • the input operation unit 101 employs switches provided on the instrument panel or steering instead of the touch panel display device, and the above-described “confirmation operation” is performed when the switches are operated. It may be determined that
  • the state confirmation signal transmission unit 32 of the in-vehicle device 100 reproduces a state confirmation signal for requesting confirmation of whether or not the content is being reproduced. Transmit to the device 200. Further, the state output unit 33 of the in-vehicle device 100 receives a state response signal indicating whether or not the content is being reproduced from the reproduction device 200. Then, based on the state response signal, it outputs to the output device 102 whether or not the playback device 200 is playing back content.
  • the output device 102 may be a display device that indicates whether or not the playback device 200 is playing back content by image display, or whether or not the playback device 200 is playing back content. It may be a speaker that indicates by sound output. Further, the output device 102 may be formed integrally with the input operation unit 101 (the same device). For example, when the input operation unit 101 is a touch panel display device, an image indicating whether or not the playback device 200 is playing content may be displayed on the display screen of the display device. Alternatively, sound indicating whether or not the playback device 200 is playing content may be output from a speaker included in the touch panel display device.
  • the state response signal transmission unit 41 of the playback device 200 receives the state confirmation signal from the in-vehicle device 100, the state response signal transmission unit 41 determines whether or not itself (the playback device 200) is playing back the content. Then, a state response signal indicating the result (whether or not the playback device 200 is playing back content) is transmitted to the in-vehicle device 100.
  • FIG. 9 shows a flowchart of a state confirmation process executed by the in-vehicle device 100 of the modification. This process is executed every predetermined time (for example, every 0.5 seconds) as a timer interrupt process.
  • the in-vehicle device 100 starts the state confirmation process, first, it is determined whether or not a “confirmation operation” has been performed by the driver (S301). If a “confirmation operation” has been performed (S301: yes), it is determined whether or not there is a communicable playback device 200 (S302). As a result, if there is a communicable reproduction device 200 (S302: yes), the reproduction device 200 is in a state confirmation signal (a state confirmation signal for requesting confirmation of whether or not the content is being reproduced). As a transmission destination (S303).
  • the communicable playback device 200 is stored as the transmission destination of the status confirmation signal (S303), it is determined whether there is another communicable playback device 200 (S304). As a result, if there is another playback device 200 that can communicate (S304: yes), the playback device 200 is also stored as the transmission destination of the status confirmation signal (S303). That is, by repeating the processes of S303 and S304, all of the communicable playback devices 200 are stored as the transmission destination of the status confirmation signal. Then, the state confirmation signal is transmitted to the playback device 200 stored as the transmission destination of the state confirmation signal (S305).
  • the status confirmation process it is further determined whether or not status response signals have been received from all of the playback devices 200 that are the destinations of the status confirmation signals (S306).
  • the status response signal is a signal received from the playback device 200 that is the transmission destination of the status confirmation signal, and whether or not the playback device 200 is playing back content. It is a signal which shows. If it is determined in S306 that the status response signal has been received from all of the playback devices 200 that are the destinations of the status confirmation signal (S306: yes), the playback device 200 determines that the status response signal has been received. It is determined whether or not the content is being reproduced (S307).
  • FIG. 10 shows a flowchart of the status response process executed by the reproduction device 200 of the modification. This process is executed every predetermined time (for example, every 0.5 seconds) as a timer interrupt process.
  • the playback device 200 starts the state response process of the modified example, first, it is determined whether or not a state confirmation signal is received (S401).
  • the state confirmation signal is a signal transmitted from the in-vehicle device 100 when the “confirmation operation” is performed by the driver.
  • S401 if it is determined that a state confirmation signal has been received (S401: yes), whether or not it is in a state of reproducing content (that is, the earphone) It is determined whether or not the sound is being output from 200e (S402).
  • a state response signal indicating that the content is being reproduced is transmitted to the in-vehicle device 100 (S403), and the content is If it is not being played back (S402: no), a state response signal indicating that the content is being played back is transmitted to the in-vehicle device 100 (S404).
  • the in-vehicle device 100 indicates that it is necessary or necessary to perform an “emergency conversation operation” or a “normal conversation operation” as described above with reference to FIG. Information is output to the output device 102.
  • FIG. 11A and FIG. 11B the state confirmation process of the in-vehicle device 100 described above with reference to FIG. 9 and the state response process of the playback device 200 described above with reference to FIG. 10 are performed. The function to be realized is shown.
  • the in-vehicle device 100 transmits a state confirmation signal to all of the playback devices 200 that can communicate.
  • the playback device 200 receives the state confirmation signal, the playback device 200 transmits a state response signal indicating that the content is being played back to the in-vehicle device 100 if the content is being played back.
  • the in-vehicle device 100 receives the state response signal indicating that the content is being reproduced, the in-vehicle device 100 outputs information indicating that the “emergency conversation operation” or the “normal conversation operation” is necessary to the output device 102. .
  • the playback device 200 when the playback device 200 receives the state confirmation signal, the state indicating that the content is not being played back if the content is not being played back.
  • a response signal is transmitted to the in-vehicle device 100.
  • the in-vehicle device 100 receives the state response signal indicating that the content is not being reproduced, the in-vehicle device 100 outputs information indicating that the “emergency conversation operation” or the “normal conversation operation” is not required to the output device 102. .
  • the driver can check whether the passenger in the rear seat is watching the content while concentrating on the driving operation (without relying on visual observation).
  • the passenger in the rear seat is not viewing the content, it is possible to perform a conversation with the passenger in the rear seat without performing the “emergency conversation operation” or the “normal conversation operation”.
  • the driver may try to have a conversation without love. Such a conversation without love can be carried out without hesitation if it can be confirmed that the passenger in the rear seat is not viewing the content.
  • the passenger in the rear seat from being given an uncomfortable feeling that “the announcement sound (contents for stopping the output of the content sound) was output even though the content sound was not output in the first place”.
  • each section is expressed as S101, for example.
  • each section can be divided into a plurality of subsections, while a plurality of sections can be combined into one section.
  • each section configured in this manner can be referred to as a device, module, or means.

Abstract

Ce système de commande sonore comporte des appareils (200, 201, 202) de reproduction qui reproduisent un son et émettent le son reproduit par l'intermédiaire d'écouteurs (200e, 201e, 202e) ou d'un casque d'écoute, et un dispositif embarqué (100) qui est connecté aux appareils de reproduction de sorte à pouvoir communiquer avec ceux-ci. Le dispositif embarqué est muni d'un dispositif de détection d'entrée (11) qui détecte des entrées en provenance d'un conducteur, et d'un dispositif de transmission (18) de signal de suppression qui, lorsque le dispositif de détection d'entrée détecte une entrée en provenance du conducteur, transmet un signal de suppression destiné à supprimer la sortie sonore vers les appareils de reproduction. Les appareils de reproduction sont pourvus d'un dispositif de suppression (24) qui, lorsqu'un signal de suppression est reçu, supprime la sortie sonore qui est émis à partir des écouteurs ou du casque d'écoute.
PCT/JP2015/005921 2014-12-08 2015-11-27 Système de commande sonore, dispositif embarqué, et procédé de commande sonore WO2016092765A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2014248023A JP6405964B2 (ja) 2014-12-08 2014-12-08 音声制御システム、車載装置、音声制御方法
JP2014-248023 2014-12-08

Publications (1)

Publication Number Publication Date
WO2016092765A1 true WO2016092765A1 (fr) 2016-06-16

Family

ID=56106993

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/005921 WO2016092765A1 (fr) 2014-12-08 2015-11-27 Système de commande sonore, dispositif embarqué, et procédé de commande sonore

Country Status (2)

Country Link
JP (1) JP6405964B2 (fr)
WO (1) WO2016092765A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6760700B2 (ja) * 2017-02-28 2020-09-23 アルパイン株式会社 コミュニケーションシステム
WO2020157991A1 (fr) * 2019-02-01 2020-08-06 本田技研工業株式会社 Système de gestion d'espace, unité mobile, programme et procédé de gestion d'espace

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006115368A (ja) * 2004-10-18 2006-04-27 Clarion Co Ltd 車載装置、車載装置の制御方法及び制御プログラム
JP2012205149A (ja) * 2011-03-25 2012-10-22 Hitachi Kokusai Electric Inc 電話システム
JP2013134700A (ja) * 2011-12-27 2013-07-08 Denso Corp 車載機、車両用報知システム、および携帯端末

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1886876B1 (fr) * 2000-08-07 2009-05-20 Mitsubishi Denki Kabushiki Kaisha Système visuel audio intégré

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006115368A (ja) * 2004-10-18 2006-04-27 Clarion Co Ltd 車載装置、車載装置の制御方法及び制御プログラム
JP2012205149A (ja) * 2011-03-25 2012-10-22 Hitachi Kokusai Electric Inc 電話システム
JP2013134700A (ja) * 2011-12-27 2013-07-08 Denso Corp 車載機、車両用報知システム、および携帯端末

Also Published As

Publication number Publication date
JP2016107868A (ja) 2016-06-20
JP6405964B2 (ja) 2018-10-17

Similar Documents

Publication Publication Date Title
EP3424229B1 (fr) Systèmes et procédés de réglage audio spatial
US8190438B1 (en) Targeted audio in multi-dimensional space
US9743213B2 (en) Enhanced auditory experience in shared acoustic space
JP5652913B2 (ja) 車載端末装置
US8126159B2 (en) System and method for creating personalized sound zones
US8655157B2 (en) Content reproduction apparatus and content reproduction system
KR102369589B1 (ko) 이어셋, 이어셋 시스템 및 그 제어방법
WO2012022361A1 (fr) Procédé pour fournir des données multimédia à un utilisateur
JP5199797B2 (ja) 車載機および車載機に対する無線通信設定方法
CN110602582A (zh) 具有全自然用户界面的耳机装置及其控制方法
KR101750871B1 (ko) 이어셋 장치 및 그 장치의 제어 방법
US20220095046A1 (en) Hybrid in-car speaker and headphone based acoustical augmented reality system
WO2016092765A1 (fr) Système de commande sonore, dispositif embarqué, et procédé de commande sonore
CN210927936U (zh) 具有全自然用户界面的耳机装置
US11974103B2 (en) In-car headphone acoustical augmented reality system
JP5016345B2 (ja) 割り込み報知システム、その制御方法及び制御プログラム
KR101673787B1 (ko) 차량용 사운드 출력 시스템
US10158751B2 (en) Performing a notification event at a headphone device
JP2010221893A (ja) 車載情報機器
JP6760700B2 (ja) コミュニケーションシステム
JP2006115368A (ja) 車載装置、車載装置の制御方法及び制御プログラム
KR20150047652A (ko) 차량용 오디오 장치
JP2019018771A (ja) 車載システム
JP2021034781A (ja) サウンドシステム
JP2005236791A (ja) 車載音響装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15867721

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15867721

Country of ref document: EP

Kind code of ref document: A1