JP2019144833A - Audio output device, program, and program recording medium - Google Patents

Abstract

To provide an audio output device which reduces the chances of a user missing hearing the output thereof.SOLUTION: An audio output device (2) comprises a controller (22) configured to obtain user detection information, and a speaker (24) for outputting sound. The speaker is configured to output sound when the controller acquires the detection information indicative of the presence of a user within a predetermined range from a position of the audio output device.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an audio output device, a program, and a program recording medium.

  Conventionally, an audio output device (smart speaker) and a display device (television receiver) are connected to be communicable, and the audio output device notifies the display device of information related to reproduced content and broadcast programs, There is a system in which a display device displays notified content and information.

  In Patent Document 1, the audio output device includes a speaker and a display unit. While outputting the audio of the music from the speaker, the audio output device acquires the metadata from the music information inquiry database, and the display unit receives the metadata. A technique for displaying is disclosed.

JP 2008-282348 A (published November 20, 2008)

  In the audio output device of Patent Literature 1, meta information is acquired during the reproduction of content called music, and the meta information is displayed on the display unit when there is a silent section or based on a user operation.

  In the conventional system, when the audio output device outputs the meta information of the content, the information inferred from the meta information, and the like, if the audio is output during the silent period, the audio output device outputs the audio when the user is absent. There was a problem of missing. Moreover, when outputting based on user operation, even if there was a user, information was not output if there was no operation, and there existed a problem that useful information for a user could not be provided.

  An object of one embodiment of the present invention is to reduce a user's hearing loss in an audio output device.

  In order to solve the above problem, an audio output device according to an aspect of the present invention includes a detection information acquisition unit that acquires detection information of a user, and an audio output unit that outputs audio, and the audio output unit includes: The detection information acquisition unit outputs sound due to acquisition of detection information indicating that the user exists in a predetermined range based on the position of the sound output device.

  According to one embodiment of the present invention, in the audio output device, it is possible to reduce a user's hearing loss.

It is a figure which shows the structure of the information notification system which concerns on Embodiment 1 of this invention, and the hardware configuration of an audio | voice output apparatus. It is a flowchart which shows the process of the audio | voice output apparatus which concerns on Embodiment 1 of this invention. It is a block diagram which shows the function structure of the control part which concerns on Example 1 of Embodiment 1 of this invention. It is a block diagram which shows the function structure of the control part which concerns on Example 2 of Embodiment 1 of this invention. It is a block diagram which shows the function structure of the control part which concerns on Example 3 of Embodiment 1 of this invention. It is a table | surface which shows the presence or absence of apparatus information output in the combination of the urgency of the apparatus information which concerns on Example 3 of Embodiment 1 of this invention, and the timing of an audio | voice output apparatus. It is a flowchart which shows the process of the audio | voice output apparatus which concerns on Example 3 of Embodiment 1 of this invention. It is a block diagram which shows the function structure of the control part which concerns on Example 4 of Embodiment 1 of this invention. It is a figure which shows the display form of the information in the display apparatus which concerns on Example 4 of Embodiment 1 of this invention.

Embodiment 1
Hereinafter, Embodiment 1 of the present invention will be described in detail. FIG. 1 is a diagram showing the configuration of the information notification system 1 and the hardware configuration of the audio output device 2 according to the present embodiment.

(Configuration of information notification system 1)
As shown in FIG. 1, the information notification system 1 includes an audio output device 2, a server 3, a display device 4, and an IoT (Internet of Things) home appliance 5. The audio output device 2 is a device that talks with a person or plays music (outputs audio), and is, for example, a smart speaker, an AI (Artificial Intelligence) speaker, or the like. The “voice” output by the voice output device 2 includes music, environmental sounds, notification sounds, and the like. The audio output device 2 can communicate with the server 3 and the IoT home appliance 5 via the Internet, and can communicate with the display device 4 via a LAN (Local Area Network) or the like. The server 3 can communicate with the audio output device 2 and the display device 4 via the Internet.

  The display device 4 is a device that receives broadcast content and outputs the content so as to be viewable. For example, the display device 4 is a television receiver. The display device 4 can communicate with the audio output device 2 via a LAN or the like, and can communicate with the server 3 via the Internet. Communication between the display device 4 and the audio output device 2 may be via the Internet, via a LAN, or via an indoor network.

  The IoT home appliance 5 is a home appliance connected to the Internet, and can communicate with the audio output device 2 via the Internet.

  As shown in FIG. 1, the audio output device 2 includes a server communication unit 21, a control unit 22, a storage unit 23, a speaker 24, a microphone 25, an audio processing unit 26, a display device communication unit 27, an IoT home appliance communication unit 28, and A human detection unit 29 is provided.

  The server communication unit 21 communicates with the server 3. The control unit 22 controls the entire audio output device 2 and is a CPU (Central Processing Unit) or the like. The control unit 22 acquires various types of information from the storage unit 23 via the server communication unit 21, the display device communication unit 27, and the IoT home appliance communication unit 28. The storage unit 23 stores data from each unit and reads out data from each unit. The storage unit 23 is a RAM (Random Access Memory), a nonvolatile memory (HDD (Hard Disk Drive), SSD (Solid State Drive)), or the like. is there.

  The speaker 24 outputs sound. The microphone 25 acquires sound. The audio processing unit 26 processes an audio signal. The display device communication unit 27 performs communication with the display device 4. The IoT home appliance communication unit 28 performs communication with the IoT home appliance 5. The person detection unit 29 detects the presence of a person, and is, for example, a vibration sensor, a human sensor, a microphone, or the like.

(Processing of the audio output device 2)
FIG. 2 is a flowchart showing processing of the audio output device 2 according to the present embodiment. When the power switch of the audio output device 2 is turned on, processing of the audio output device 2 is started.

  There are a first event, a second event, and a third event as events that trigger the audio output device 2 to perform processing.

  The first event is that the power switch of the audio output device 2 is first turned on from off.

  The second event is an event in a state in which the power switch of the audio output device 2 is turned on, and includes an event of detecting a person through the person detection unit 29. A specific example of the second event is shown below.

-Detection of voice input through the microphone 25-Arrival of a predetermined time using the clock function of the control unit 22-Detection of information related to previous speech or content playback The third event is the power saving of the audio output device 2 It is an event in the mode state, and includes detecting a person through the person detection unit 29. A specific example of the third event is shown below.

-Acquisition of keyword through microphone 25-Arrival of a predetermined time using the clock function of control unit 22 Note that the keyword includes a call by a user (for example, "Hello, speaker").

(Step S201)
The control unit 22 of the audio output device 2 performs at least one of utterance corresponding to an event and content reproduction. The control unit 22 outputs audio corresponding to at least one of the utterance according to the event and the reproduction of the content through the audio processing unit 26 and the speaker 24, or transmits information to the display device 4. Is output. The event at the start of processing is the first event, the event when executed according to the determination result of step S202 is the second event, and the event when executed following the processing of step S207. Is the third event. Further, output timing, output information, and specific examples of output destination devices will be described later. The output timing is a timing that satisfies a further condition after the control unit 22 detects a person through the person detection unit 29.

(Step S202)
The control unit 22 determines whether or not the second event has occurred. When the second event occurs (YES in step S202), the control unit 22 executes the process in step S201. When the second event has not occurred (NO in step S202), the control unit 22 performs the determination in step S203.

(Step S203)
The control unit 22 determines whether or not a predetermined time has elapsed after executing the process of step S201. If the predetermined time has not elapsed (NO in step S203), the determination in step S202 is executed again. If the predetermined time has elapsed (YES in step S203), the process of step S204 is executed.

(Step S204)
The control unit 22 speaks through the speaker 24 as necessary. Before the audio output device 2 shifts to the power saving mode, the control unit 22 may utter, for example, “It will be in the standby mode from now”.

(Step S205)
The audio output device 2 shifts to the power saving mode.

(Step S206)
The control unit 22 waits for the third event. That is, the control unit 22 performs the process of step S207 when the third event occurs.

(Step S207)
The control unit 22 shifts the audio output device 2 from the power saving mode to the power-on state. And the process of step S201 is performed.

(Example of output timing)
The example of the output timing by the control part 22 is shown below. The audio output device 2 outputs information at the timing shown below after the control unit 22 detects a person through the person detection unit 29.

<Example of output timing: Timing triggered by the audio output device 2>
When the control unit 22 detects that content (music etc.) is designated by the user.

  When the control unit 22 detects that the content reproduction has ended.

  When the control unit 22 detects that the conversation with the user has ended.

  When the control unit 22 acquires meta information related to the content being reproduced or reproduced from the server communication unit 21 or the storage unit 23.

  When the speaker 24 is speaking or reproducing content.

  -When the control unit 22 transitions to a keyword waiting state.

  -When the control part 22 acquires a keyword. For example, the control unit 22 recognizes a voice such as “Like”, “Eye ~”, “Nasu” during content reproduction or within a predetermined time after the content is finished. "

・ When the control unit 22 recognizes the meaning of “like” when the user hits the table on which the audio output device 2 is placed during content reproduction and the vibration sensor reacts. When content-related information (for example, pre-meta information or post-meta information of a television or radio being broadcast) is acquired from the communication unit 21 or the storage unit 23.

  When the control unit 22 detects that it is between the reproduction of the content and the reproduction of the next content.

  -When the control part 22 detects that it is the output timing according to the urgency of notification information. Examples of the output timing are shown in (1) to (5).

  (1) When the control unit 22 detects that the power of the audio output device 2 has been turned on from off.

  (2) When the control unit 22 detects that the speaker 24 is operating.

  (3) When the control unit 22 detects that the operation of the speaker 24 has ended.

  (4) When the control unit 22 detects that the audio output device 2 is on standby.

  (5) When the control unit 22 detects that the audio output device 2 is in a standby state (ON => standby).

  When the control unit 22 detects that the speaker 24 is before content reproduction.

  When the control unit 22 acquires device information from the IoT home appliance 5 via the IoT home appliance communication unit 28.

  When the control unit 22 acquires meta information about the content from the server communication unit 21 or the storage unit 23 during the reproduction of the content.

The previous meta information is meta information related to a program created in advance by a broadcasting station, for example, information including an outline of the program, a theme, performers, and the like. Further, the post meta information is meta information generated during or after the broadcast of the program. For example, meta information such as a product introduced in the program is manually input by the trader.
<Example of output timing: Timing triggered by a peripheral device>
When the control unit 22 detects that a predetermined event has occurred in the peripheral device.

  When the control unit 22 detects that the peripheral device has acquired the meta information.

  -When the control part 22 detects that the display apparatus 4 acquired back meta information.

  The control unit 22 detects that the display device 4 is turned on / off.

  When the control unit 22 detects that the display device 4 has acquired information from the audio output device 2.

(Example of output information)
An example of the output information by the control unit 22 is shown below.

  The output information includes general information on the Internet, personal lifestyle information, other device information (external device information), usage information of the audio output device 2, meta information (additional information, that is, pre-meta information, post-meta Information).

  The general information is, for example, news, traffic information, stock prices, daily search results, cooking recipes, weather information (temperature, humidity, atmospheric pressure, pollen, PM2.5, yellow sand, etc.) and the like.

  The lifestyle information includes, for example, daily life (wake-up, meal, walk, work, shopping, sleeping), schedule (travel, business trip, garbage day, event, visitor) and the like.

  The device information is, for example, usage status (use timing, use cycle, operation end) of home appliances such as a television, a refrigerator, and a washing machine.

  The information from the IoT home appliance 5 includes, for example, information indicating the information transmission source IoT home appliance 5 (“Notice from refrigerator” or the like).

  The usage information of the audio output device 2 includes, for example, music preference (when and what song was listened to how much), information preference (when and what information was desired), device operation information (when and how other devices were used) ) Etc.

  The meta information is, for example, real-time information related to broadcasting such as music (singer name, album name, genre, age, sales, tie-up information), television, radio, etc. and future information.

  The content uttered by the speaker 24 includes a music / information recommendation according to time, weather, and the state of other home appliances, a short message adapted to the specified content, and a new recommendation from information about the reproduced content. Messages, recommendations for the next user action, related information about the content, content related to the previously played content (music / information recommendations), information about the content that you liked, information from surrounding devices, etc. is there.

  The output information includes information on an album containing music, utterances led by the audio output device 2, utterances according to keywords, and the like. When there is important information, the voice output device 2 may first speak important information and then respond to the keyword (for example, talk about the previous song and then respond to the keyword). Also good). Furthermore, there are a topic according to timing, a topic according to action history, a topic according to other conditions, information according to a transmission source of meta information, and the like.

  The output information includes pre-meta information and post-meta information for television broadcasting and radio broadcasting, utterances related to utterance timing, meta information associated with content to be reproduced, information inferred from meta information, and the like.

  The output information includes information related to the content to be played back and the broadcast program, information about the song that the audio output device 2 has played this time, information about the song that the audio output device 2 played last time, meta information about the content, and the like.

  The output information includes information generated by the audio output device 2. The display device 4 may display the same content as the utterance content, or may display content different from the utterance content, such as information on a song that the audio output device 2 has played back last time.

(Example of output format)
Examples of the information output form include speech of the audio output device 2, display of the display device 4, display of other devices (terminals such as smartphones), and the like.

[Example 1]
Hereinafter, Example 1 of the present embodiment will be described.

The audio output device 2 in the present embodiment basically performs the same operation as the flowchart shown in FIG. 2, but the points that should be described more specifically will be described below.
The audio output device 2 according to the present embodiment includes a detection information acquisition unit 221 that acquires user detection information, and a speaker (audio output unit) 24 that outputs audio. FIG. 3 is a block diagram illustrating a functional configuration of the control unit 22a according to the present embodiment. As illustrated in FIG. 3, the control unit 22 a includes a detection information acquisition unit 221. The detection information acquisition unit 221 acquires the detection signal of the human detection unit 29, the voice signal of the microphone 25 that has acquired the voice of the user and the voice processing unit 26 as user detection information, and recognizes the presence of the user.

  The speaker 24 is caused by the detection information acquisition unit 221 acquiring detection information indicating that the user exists in a predetermined range based on the position of the audio output device 2 (YES in step S202 in FIG. 2). When the control unit 22a instructs, a sound is output (step S201 in FIG. 2). The predetermined range is a detectable range of the human detection unit 29, for example, a range in which vibration is transmitted, a range in which infrared rays from the human sensor reach a predetermined intensity or more, a range in which the user's voice reaches, and the like. .

  On the other hand, the speaker 24 detects that the detection information acquisition unit 221 has acquired detection information indicating that the user no longer exists from the predetermined range (YES in step S202 of FIG. 2), and the control unit 22a By giving the instruction, the audio output is interrupted (step S201 in FIG. 2). For example, detection information indicating that the user no longer exists may be generated by the camera, and the detection information may be transmitted to the audio output device 2. In this case, the audio output device 2 acquires detection information indicating the absence of the user, and interrupts the audio output.

  The state of the audio output device 2 when detecting a person includes waiting, before and after music playback or speech, and during music playback or speech. Next, the audio output device 2 outputs music information, music related information, music, or recommendations regarding user behavior from the speaker 24. Examples of recommendations when people are detected include "Good morning. Today's weather is sunny. Would you like to go somewhere?" There is.

[Example 2]
Hereinafter, Example 2 of the present embodiment will be described.

  The audio output device 2 in the present embodiment basically performs the same operation as the flowchart shown in FIG. 2, but the points that should be described more specifically will be described below.

  In addition to the configuration of the first embodiment, the sound output device 2 according to the present embodiment includes a state determination unit 222 that determines the state of the sound output device 2, and the state of the sound output device 2 that is determined by the state determination unit 222. , The audio output control unit 223 for controlling the timing of audio output by the speaker (audio output unit) 24 is further provided. FIG. 4 is a block diagram illustrating a functional configuration of the control unit 22b according to the present embodiment. As illustrated in FIG. 4, the control unit 22 b includes a detection information acquisition unit 221, a state determination unit 222, and an audio output control unit 223.

  The speaker 24 is caused by acquiring the detection information indicating that the user exists, and at the timing of audio output controlled by the audio output control unit 223 with reference to the state of the audio output device 2 (FIG. 2). In step S202, YES), the control unit 22b instructs to output sound as described in step S201 of FIG. Here, in this embodiment, “audio” in step S201 in FIG. 2 is audio including meta information accompanying content to be reproduced or information inferred from meta information.

  In the audio output device 2, the audio output control unit 223 further supplies the above-described audio to the speaker 24 until the audio output ends when the state determination unit 222 determines that audio is being output by the speaker 24. You may make it wait for the output of the other audio | voice different from an audio | voice. That is, when the sound is being output and the output of the sound is completed (YES in step S202 in FIG. 2), the speaker 24 outputs another sound as instructed by the control unit 22b (FIG. 2). Step S201).

  Here, the “other audio” is, for example, audio obtained by converting meta information into audio. More specifically, when the text indicating the title of the song is included in the meta information, it indicates the sound obtained by converting the text into speech.

  Next, in the audio output device 2, the audio output control unit 223 further includes a case where the speaker 24 can output the first audio and the second audio different from the first audio, When the determination unit 222 determines that the first sound is being output from the speaker 24 (YES in step S202 in FIG. 2), the speaker 24 is caused to reduce the volume of the first sound and the second sound is output. Audio may be superimposed and output. More specifically, when the audio output control unit 223 determines as described above, in step S201, the audio output control unit 223 causes the speaker 24 to reduce the volume of the first audio, and the second Audio may be superimposed and output.

  In the audio output device 2, the audio output control unit 223 further relates to the audio before or after outputting the audio (YES in step S <b> 202 in FIG. 2) when outputting audio to the speaker 24. Another sound may be output (step S201 in FIG. 2).

  The state determination unit 222 specifies, as the state of the audio output device 2, content (music) designation, content reproduction end, speech end, content-related information (pre-meta information of television or radio being broadcast, post-meta information) Judgment such as acquisition of.

  An example of a single message that matches the specified song when the user specified a song is "This song is famous as the theme song for the drama XX", " "It was a break," "It's raining today, so this song goes well."

  In addition, since the information is easily spoken between the reproduction of the music and the reproduction of the next music, it is determined by the state determination unit 222. That is, when the state determination unit 222 determines that it is currently between the reproduction of the music and the reproduction of the next music, or when the music is over, a new connection is made from the information of the reproduced music. Examples of recommendation messages include “This song is included in the album“ XX ”” and “A TV program in which the composer“ XX ”appears is broadcast from 7 o'clock in the evening. In addition, when the music is over, recommendations for the next action include “Laundry is about to end” and “The sun is leaning. Do you turn on the lights?”

Example 3
Hereinafter, Example 3 of the present embodiment will be described.

  The audio output device 2 in the present embodiment basically performs the same operation as the flowchart shown in FIG. 2, but the points that should be described more specifically will be described below.

  In addition to the configuration of the first embodiment, the audio output device 2 according to the present embodiment further includes a device information acquisition unit 224 that acquires device information from the IoT home appliance (predetermined device) 5. The predetermined device is a device that can communicate with the audio output device 2 and outputs its own device information to the audio output device 2.

  FIG. 5 is a block diagram illustrating a functional configuration of the control unit 22c according to the present embodiment. As illustrated in FIG. 5, the control unit 22 c includes a detection information acquisition unit 221 and a device information acquisition unit 224.

  The speaker 24 has acquired the detection information indicating that the user exists, and at a timing according to the degree of urgency included in the device information acquired by the device information acquisition unit 224 (step S202 in FIG. 2). YES), the voice is output as described in step S201 in FIG. Here, in the present embodiment, the “second event” in step S202 of FIG. 2 is acquired by the detection information acquisition unit 221 and the device information acquisition unit 224 acquires the device information from the IoT home appliance 5. It is that. Also, “voice” in step S201 in FIG. 2 is voice including device information acquired from the IoT home appliance 5.

  In the audio output device 2, when the speaker 24 can output device information having a higher degree of urgency than the audio being output (YES in step S202 in FIG. 2), the output of the audio is interrupted. Information may be output (step S201 in FIG. 2). Here, in the present embodiment, the “second event” in step S202 of FIG. 2 is that the speaker 24 can output device information having a higher degree of urgency than the voice being output.

  In the audio output device 2, the speaker 24 further has a difference of a predetermined time or more between the time when the device information acquisition unit 224 acquires the device information and the time when the speaker 24 outputs the device information. 2 (YES in step S202 in FIG. 2), device information including information regarding the time difference between the two may be output (step S201 in FIG. 2). Here, in this embodiment, the “second event” in step S202 of FIG. 2 indicates that the speaker 24 can output the device information after a predetermined time has elapsed since the time when the device information acquisition unit 224 acquired the device information. It became that.

  FIG. 6 is a table showing the presence / absence of device information output in the combination of the urgency level of device information and the timing of the audio output device 2 according to the present embodiment.

  In the timing column of FIG. 6, “OFF” is when the main power switch is off and the AC plug is disconnected from the outlet. “OFF => ON” is a case where the main power switch is turned on when it is turned on from a standby state (by keyword input, human detection or the like). “In operation” is a timing such as during speech or during content reproduction. “At the end of task” is the timing when one utterance is completed. “Standby” is a timing for waiting for keyword input and waiting for human detection. During “standby”, only parts necessary for keyword recognition and human detection can be energized, and the other parts (communication unit, etc.) can be set to the power saving mode. “On => Standby” is a timing at which a transition to the standby mode is made as a result of the absence of silence for a predetermined time after the end of the speech.

  In the urgent level column of FIG. 6, “high” indicates that the urgency level is high and the timing is not missed. The device information with “high” urgency includes, for example, arrival of a viewing reservation time, notification that there is a visitor from a doorphone, operation of a fire alarm, operation of an intrusion door sensor, and the like. The device information with “medium” urgency includes a notification that washing has been completed and a notification that rice has been cooked. The device information with the urgency level “low” includes “Today is XX day”, “It is time to replace the air conditioner filter”, and the like.

  For example, during operation, the audio output device 2 speaks only device information with a high degree of urgency. At the end of the task, the voice output device 2 does not speak because the device information with a high degree of urgency has been spoken during operation. Also, the voice output device 2 needs to wait for the next input at the end of the task (that is, listen silently), and since it is troublesome to speak at this timing, it does not utter device information with low urgency. Even when shifting from on to standby, the voice output device 2 does not speak because information with high urgency has been spoken.

  The audio output device 2 includes the human detection unit 29, and can output device information at a more useful timing. Recommendations for the next action when a person is detected include "Laundry is about to end" and "The sun is leaning. Do you turn on the lights?"

  FIG. 7 is a flowchart illustrating the processing of the audio output device 2 according to the present embodiment.

(Step S701)
In the audio output device 2, the device information acquisition unit 224 determines whether the IoT home appliance communication unit 28 has received device information from the IoT home appliance 5. When the IoT home appliance communication unit 28 receives the device information (YES in step S701), the control unit 22c executes the determination in step S702. When the IoT home appliance communication unit 28 has not received the device information (NO in step S701), the device information acquisition unit 224 executes the determination in step S701 again.

(Step S702)
The device information acquisition unit 224 acquires device information of the IoT home appliance 5 from the IoT home appliance communication unit 28. The control unit 22c extracts the urgency level included in the device information. And the control part 22c determines whether the state of the audio | voice output apparatus 2 is an output timing according to the extracted emergency degree with reference to the table | surface of FIG. When the state of the audio output device 2 is the output timing (YES in step S702), the control unit 22c executes the process of step S703. When the state of the audio output device 2 is not the output timing (NO in step S702), the control unit 22c executes the determination in step S702 again.

(Step S703)
The control unit 22 c causes the audio processing unit 26 and the speaker 24 to utter the device information of the IoT home appliance 5.

Example 4
Hereinafter, Example 4 of the present embodiment will be described.

  The audio output device 2 in the present embodiment basically performs the same operation as the flowchart shown in FIG. 2, but the points that should be described more specifically will be described below.

  The audio output device 2 according to the present embodiment outputs a detection information acquisition unit 221 that acquires user detection information, a state acquisition unit 225 that acquires the state of the audio output device 2, and notification information to be displayed on the display device 4. And a server communication unit (notification information output unit) 21. FIG. 8 is a block diagram illustrating a functional configuration of the control unit 22d according to the present embodiment. As illustrated in FIG. 8, the control unit 22 d includes a detection information acquisition unit 221 and a state acquisition unit 225. The notification information is information related to the content to be reproduced, the broadcast program, etc., for example.

  The server communication unit 21 originates from the fact that the detection information acquisition unit 221 has acquired the detection information indicating that the user exists in a predetermined range with reference to the position of the audio output device 2 in step S202 of FIG. In addition, when the control unit 22d gives an instruction at a timing according to the state of the audio output device 2 acquired by the state acquisition unit 225, information is output to the display device 4 as described in step S201 of FIG. . Here, in the present embodiment, for the “second event” in step S202 of FIG. 2, the detection information acquisition unit 221 acquires the detection information, and the state acquisition unit 225 acquires the state of the audio output device 2. That is. Further, “information” in step S201 in FIG. 2 is notification information to be displayed on the display device 4. The server communication unit 21 outputs the notification information to the display device 4 so that the display device 4 displays the notification information at a timing according to the acquired state of the audio output device 2.

  In this case, the server communication unit 21 transmits notification information to the display device 4 via the server 3. The display device 4 receives the notification information from the audio output device 2 via the server 3 and displays the notification information. The notification information is displayed by a browser function of the display device 4 or the like.

  Note that the display device communication unit 27 may directly output the notification information to the display device 4. In this case, the display device 4 directly receives the notification information from the audio output device 2 and displays the notification information.

  The audio output device 2 further includes a display device communication unit (control signal output unit) 27 that outputs a control signal of the display device 4, and the display device communication unit 27 is configured so that the screen of the display device 4 is not displayed. You may output the control signal which makes the display apparatus 4 start a screen display.

  The status acquisition unit 225 acquires the status of the audio output device 2 as content (music) designation, content playback, during utterance, and content-related information (pre-meta information and post-meta information of a television or radio being broadcast). Get the state. Further, the state acquisition unit 225 acquires a state where a person is detected from the person detection unit 29 or a state where no person is detected.

  For example, when the music is designated by the user, the control unit 22d outputs information related to the music to the display device 4 while playing the music. When the audio output device 2 is playing back content and acquires content-related information, the control unit 22 d outputs the content-related information to the display device 4. Furthermore, when the power of the display device 4 is off, the control unit 22d outputs the notification information to the display device 4 after turning on the power. In addition, when the audio output device 2 includes a display unit, the audio output device 2 may display notification information on the display unit.

  In the configuration in which the audio output device 2 and the display device 4 communicate directly (hereinafter referred to as “configuration A”), the display device 4 detects the person by itself. You may display the information acquired from.

  According to said structure A, the display apparatus 4 can measure the distance between the audio | voice output apparatuses 2 by communicating with the audio | voice output apparatus 2 directly.

  The display device 4 can use, for example, functions such as PXP (Proximity Profile) and beacon that can support BLE (Bluetooth Low Energy). The approximate distance to the audio output device 2 can be specified. The display device 4 can measure the distance to the audio output device 2 at low cost by using Bluetooth (registered trademark).

  Then, the display device 4 uses the measured distance to determine whether the audio output device 2 is in the vicinity of the display device 4 or in the same room as the display device 4, or the audio output device 2 is far from the display device 4. It can be determined whether the user is away or in a room different from the display device 4. Furthermore, the display device 4 can appropriately change the process in the case where a person is detected by its own sensor according to the determination result. Such a display device 4 has a remarkable effect when the audio output device 2 is equipped with a battery or the like and operates as a mobile device.

  For example, when the display device 4 determines that the sound output device 2 is in the vicinity of the display device 4, the display device 4 recognizes that the user of the sound output device 2 is also in the vicinity of the display device 4. In this case, the display device 4 may display the notification information acquired from the audio output device 2 when a person is detected by its own sensor.

  Further, the display device 4 may be considered to play a part of the human detection function of the audio output device 2. That is, when the person detection unit 29 of the voice output device 2 cannot detect a person, the voice output device 2 may be operated when the display device 4 detects a person.

  On the other hand, when the display device 4 determines that the sound output device 2 is far from the display device 4, the display device 4 recognizes that the user of the sound output device 2 is also far from the display device 4. In this case, when the display device 4 detects a person with its own sensor, the display device 4 determines that the person is not a user of the audio output device 2 and does not display the notification information acquired from the audio output device 2. The content may be displayed.

  Note that even in a configuration in which the audio output device 2 and the display device 4 do not communicate directly but communicate via the Internet, the display device 4 acquires from the audio output device 2 when it detects a person by itself. Information may be displayed.

  FIG. 9 is a diagram illustrating a display form of information in the display device 4 according to the present embodiment. FIG. 9A shows a display form when the power of the display device 4 is off. FIG. 9B shows a display form when the power of the display device 4 is on.

  When the power of the display device 4 is off, the display device 4 turns on the power according to the instruction of the audio output device 2. Thereafter, as shown in FIG. 9A, the display device 4 displays the notification information received from the audio output device 2 using the entire screen. In this case, since the user is not viewing, the user can be clearly notified by displaying the notification information using the entire screen.

  When the power of the display device 4 is on, as shown in FIG. 9B, the display device 4 displays the notification information received from the audio output device 2 using a part of the screen. In this case, since the user is viewing, the notification information can be displayed using a part of the screen without disturbing the user's viewing.

  When the power of the display device 4 is off, the display device 4 may display information acquired from the audio output device 2 by turning on its own power when it detects a person. When the power of the display device 4 is on, the display device 4 may display the information acquired from the audio output device 2 when it detects a person by itself. According to the above, the display device 4 displays the information acquired from the audio output device 2 regardless of whether the power is on or off when a person approaches. Thereby, it is possible to notify that the audio output device 2 is in operation, and even when the audio output device 2 is reproducing the content, information about the content being reproduced, etc. acquired from the audio output device 2 can be obtained. You can be notified.

Example 5
Hereinafter, Example 5 of the present embodiment will be described. A present Example is an Example applied in common with Examples 1-4.

  When the first sound is being output, the sound output device 2 may reduce the volume of the first sound and superimpose and output a second sound different from the first sound. The first sound may be interrupted and the second sound may be output. For example, when the second sound is important information, during the reproduction of the content that is the first sound, the volume of the content reproduction may be lowered to utter the important information superimposed, or the content may be reproduced. You may interrupt and utter important information.

  The audio output device 2 may transmit information according to the presence / absence of the user indicated by the detection information and the audio output by the speaker 24 to a peripheral device that can output the information. For example, when the voice output device 2 detects a person during the voice output, the voice output device 2 does not interfere with the voice output, and information useful to the user (pre-meta information about the voice being output, etc.) May be output to a peripheral device. In addition, when the audio output device 2 cannot detect a person and acquires the post meta information related to the sound output by the audio output device 2, the audio output device 2 transmits the post meta information to a peripheral device that may be nearby. It may be output.

  When outputting a plurality of sounds or information, the sound output apparatus 2 may determine the output order or the number of outputs of the sounds or information according to the weighting performed on the sounds or information in advance. For example, the order of output may be changed according to the above weighting, or the most important voice or information may be output.

  When outputting sound or information, the sound output device 2 may determine the output time length of the sound or information with reference to the time zone to be output or the user's action history. For example, since the user is busy on weekday mornings, the utterance may be made shorter. On the other hand, on Saturdays and Sundays when there is no plan for the user, the user may have time, so the utterance may be made longer.

  The audio output device 2 includes a storage unit that stores related information related to audio output from the speaker 24, an acquisition unit that acquires user reaction information indicating a user's reaction, and a reaction timing according to a user response acquired by the acquisition unit. And an extraction unit that extracts the relevant information to be output from the relevant information stored in the storage unit according to the identified reaction timing. In this case, the speaker 24 outputs the related information extracted by the extraction unit by voice.

  For example, in the audio output device 2, voices such as “Like”, “Eh ~”, “Issue”, etc. during the playback of the music by the control unit 22 or within a predetermined time after the music playback ends. , And the speaker 24 may output the relevant information of the music as a sound.

  Also, in the audio output device 2, when the control unit 22 recognizes the meaning of “like” as a result of the vibration sensor reacting when the user taps the audio output device 2 during the reproduction of the music, The speaker 24 may output the related information of the music as a sound.

  The audio output device 2 may output a plurality of audio or information sources, and output audio or information in an output mode according to the information sources. For example, when outputting meta information related to the content being played back, the audio output device 2 outputs an output form (addition of sound, background sound, high / low sound, volume, etc.) that can specify a sender, a transmission site, and the like of the meta information. Etc.), the meta information may be output.

[Effect of Embodiment 1]
Since information is output when a person is detected, information useful to the user can be reliably provided to the user.

[Example of software implementation]
The control block of the audio output device 2 (each unit in the control units 22a, 22b, 22c, and 22d) may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or by software It may be realized.

  In the latter case, the audio output device 2 includes a computer that executes instructions of a program that is software for realizing each function. The computer includes, for example, at least one processor (control device) and at least one computer-readable recording medium storing the program. In the computer, the processor reads the program from the recording medium and executes the program, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, a “non-temporary tangible medium” such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the program may be further provided. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one embodiment of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the program is embodied by electronic transmission.

[Summary]
The audio output device (2) according to aspect 1 of the present invention includes a detection information acquisition unit (221) that acquires user detection information, and an audio output unit (speaker 24) that outputs audio. The detection information acquisition unit outputs sound due to acquisition of detection information indicating that the user exists in a predetermined range based on the position of the sound output device.

  According to said structure, a user's hearing loss can be reduced in an audio | voice output apparatus.

  In the sound output device according to aspect 2 of the present invention, in the aspect 1, the sound output unit acquires detection information indicating that the detection information acquisition unit no longer exists from the predetermined range. The voice output may be interrupted due to the above.

  According to said structure, in a sound output device, when a person is not detected, a useless sound output can be eliminated.

  The sound output device according to aspect 3 of the present invention is the state determination unit (222) that determines the state of the sound output device in state 1 or 2, and the state of the sound output device that is determined by the state determination unit. And an audio output control unit (223) for controlling the timing of audio output by the audio output unit, wherein the audio output unit has acquired detection information indicating that the user exists. The sound may be output in accordance with the sound output timing.

  According to said structure, it is a case where a person is detected and audio | voice output can be performed at the timing according to the state of the audio | voice output apparatus.

  The audio output device according to aspect 4 of the present invention further includes a device information acquisition unit (224) that acquires device information from a predetermined device in the above-described aspect 1 or 2, and the audio output unit includes the user. It is good also as outputting the said apparatus information at the timing according to the urgency contained in the said apparatus information resulting from having acquired the detection information which shows doing.

  According to said structure, it is a case where a person is detected, Comprising: Apparatus information can be output at the timing according to the urgency level.

  The audio output device according to aspect 5 of the present invention acquires a detection information acquisition unit (221) that acquires user detection information, an audio output unit (speaker 24) that outputs audio, and a state of the audio output device. A status acquisition unit (225); and a notification information output unit (server communication unit 21, display device communication unit 27) that outputs notification information to be displayed on the display device (4). The audio output device acquired by the state acquisition unit due to the fact that the information acquisition unit has acquired detection information indicating that the user exists in a predetermined range based on the position of the audio output device The notification information is output to the display device so that the display device displays the notification information at a timing according to the state.

  According to said structure, it is a case where a person is detected, Comprising: Notification information can be displayed on a display apparatus at the timing according to the state of the audio | voice output apparatus.

  The sound output device according to aspect 6 of the present invention is the sound output device according to aspects 1 to 5 described above, wherein when the sound output unit is outputting the first sound, the volume of the first sound is reduced. A second sound different from the first sound may be superimposed and output, or the first sound may be interrupted and the second sound may be output.

  According to said structure, when a person is detected in an audio | voice output apparatus, when outputting a different audio | voice while outputting an audio | voice, both audio | voices can be output.

  In the voice output device according to aspect 7 of the present invention, in the above aspects 1 to 6, the information corresponding to the presence / absence of the user and the voice output by the voice output unit indicated by the detection information May be transmitted to a peripheral device capable of outputting.

  According to said structure, the information according to the presence or absence of a user and the audio | voice which an audio | voice output part outputs can be output from the peripheral device of an audio | voice output apparatus.

  The voice output device according to aspect 8 of the present invention, in the above aspects 1 to 7, when outputting a plurality of voices or information, according to the weighting performed on the voices or information in advance, The number of outputs may be determined.

  According to said structure, an audio | voice output apparatus can output an audio | voice or information according to the output order or the output number determined according to the weighting performed to audio | voice or information previously.

  The voice output device according to aspect 9 of the present invention, in the above aspects 1 to 8, when outputting voice or information, refers to the time zone to be output or the action history of the user, and the output time length of the voice or information To decide.

  According to said structure, an audio | voice or information can be output by the output time length suited to a user's convenience.

  A voice output device according to a tenth aspect of the present invention is the voice output device according to any one of the first to ninth aspects, wherein the storage unit stores related information related to the voice output by the voice output unit, and the acquisition unit acquires user reaction information indicating a user reaction. And an extraction unit that identifies reaction timing according to the user's response acquired by the acquisition unit, and extracts related information to be output from the related information stored in the storage unit according to the identified reaction timing; , And the voice output unit may output the related information extracted by the extraction unit by voice.

  According to said structure, the relevant information with user's reaction can be output with an audio | voice.

  The sound output apparatus according to aspect 11 of the present invention may be configured to output a sound or information in an output form corresponding to the information source in the above aspects 1 to 10 in which a plurality of sound or information information sources exist. .

  According to said structure, since an audio | voice or information is output in the output mode according to the information source which exists in multiple numbers, an information source can be output so that identification is possible.

  The audio output device according to each aspect of the present invention may be realized by a computer. In this case, the audio output device is operated on each computer by causing the computer to operate as each unit (software element) included in the audio output device. The control program for the audio output device realized and the computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

DESCRIPTION OF SYMBOLS 1 Information notification system 2 Audio | voice output apparatus 4 Display apparatus 21 Server communication part (notification information output part)
22 control unit 24 speaker (sound output unit)
27 Display device communication unit (notification information output unit)
221 Detection information acquisition unit 222 State determination unit 223 Audio output control unit 224 Device information acquisition unit 225 State acquisition unit

Claims (13)

An audio output device,
A detection information acquisition unit for acquiring user detection information;
An audio output unit for outputting audio,
The audio output unit
An audio output device characterized in that the detection information acquisition unit outputs a sound due to acquisition of detection information indicating that the user exists in a predetermined range based on the position of the audio output device. . The audio output unit
The audio output device according to claim 1, wherein the detection information acquisition unit interrupts audio output due to acquisition of detection information indicating that the user no longer exists from the predetermined range. . A state determination unit for determining the state of the audio output device;
An audio output control unit that controls the timing of audio output by the audio output unit with reference to the state of the audio output device determined by the state determination unit;
The audio output unit
The audio output apparatus according to claim 1, wherein the audio output device outputs sound in accordance with the acquisition of detection information indicating that the user exists and in accordance with the timing of the audio output. A device information acquisition unit that acquires device information from a predetermined device;
The audio output unit
3. The device information is output due to acquisition of detection information indicating that the user exists and at a timing according to an urgency level included in the device information. The audio output device according to 1. An audio output device,
A detection information acquisition unit for acquiring user detection information;
An audio output unit for outputting audio;
A state acquisition unit for acquiring the state of the audio output device;
A notification information output unit for outputting notification information to be displayed on the display device;
The notification information output unit
The sound acquired by the state acquisition unit due to the detection information acquisition unit acquiring detection information indicating that the user exists in a predetermined range with respect to the position of the audio output device An audio output device that outputs the notification information to the display device so that the display device displays the notification information at a timing according to a state of the output device. The audio output unit is outputting the first audio,
Decreasing the volume of the first sound and superimposing and outputting a second sound different from the first sound, or interrupting the first sound and outputting the second sound The sound output device according to claim 1, wherein the sound output device is a sound output device. The information according to the presence or absence of the user indicated by the detection information and the sound output from the sound output unit is transmitted to a peripheral device capable of outputting the information. The audio output device according to any one of the above. 8. When outputting a plurality of sounds or information, the output order or number of outputs of the sounds or information is determined according to the weighting performed on the sounds or information in advance. The audio output device according to item. The voice or information output time length is determined by referring to the time zone to be output or the user's action history when outputting the voice or information. The audio output device described. A storage unit for storing related information related to the audio output by the audio output unit;
An acquisition unit for acquiring user reaction information indicating a user reaction;
An extraction unit that identifies reaction timing according to a user's response acquired by the acquisition unit, and extracts related information to be output from related information stored in the storage unit according to the specified reaction timing;
Further comprising
The audio output device according to claim 1, wherein the audio output unit outputs related information extracted by the extraction unit by audio. There are multiple sources of audio or information,
The voice output apparatus according to any one of claims 1 to 10, wherein voice or information is output in an output mode according to the information source.   A program for causing a computer to function as the audio output device according to claim 1, wherein the program causes the computer to function as the detection information acquisition unit.   A computer-readable recording medium on which the program according to claim 12 is recorded.

Images