JP7424156B2 - Content output control device, content output system, content output control method, and program - Google Patents

Description

The present invention relates to a content output control device, a content output system, a content output control method, and a program.

2. Description of the Related Art Techniques for outputting audio in addition to displaying content on a display screen, such as electronic books and games that can output audio, are known (for example, see Patent Document 1).

Japanese Patent Application Publication No. 2016-192211

However, when such a device is used, for example, while riding on public transportation, it may be difficult to hear surrounding sounds such as in-car announcements.

The present invention has been made in view of the above, and an object of the present invention is to enable appropriate confirmation of surrounding sounds.

In order to solve the above-mentioned problems and achieve the purpose, a content output control device according to the present invention includes a line-of-sight detecting section that detects the direction of the user's line-of-sight, and a line-of-sight detecting section that detects the direction of the user's line of sight. a gaze determination unit that determines whether or not the user is gazing at a display screen displaying the content; a peripheral sound acquisition unit that acquires ambient sound; an audio acquisition unit that acquires audio related to the content; If it is determined that the user is gazing at a display screen displaying content, the audio acquisition unit outputs the acquired audio related to the content, and it is determined that the user is not gazing at the display screen displaying content. In this case, the apparatus further includes an audio output control section that outputs the ambient sound acquired by the ambient sound acquisition section.

A content output system according to the present invention includes the content output control device described above, a sound collection unit that collects ambient sound, and an audio output unit that outputs audio.

The content output control method according to the present invention includes the steps of: detecting the gaze direction of a user using an audio output device; and determining whether the user is gazing at a display screen displaying content based on the detection result of the gaze direction. a step of determining whether or not the content is displayed; a step of obtaining ambient sound; a step of obtaining audio related to the content; and, if it is determined that the user is not gazing at a display screen displaying content, outputting ambient sound.

The program according to the present invention includes the steps of detecting the line of sight direction of a user using an audio output device, and determining whether or not the user is gazing at a display screen displaying content based on the detection result of the line of sight direction. a step of determining, a step of acquiring ambient sound, a step of acquiring audio related to the content, and if it is determined that the user is gazing at a display screen displaying the content, outputting audio related to the content. , if it is determined that the user is not gazing at the display screen displaying the content, the computer is caused to perform the steps of outputting ambient sound.

According to the present invention, it is possible to appropriately confirm surrounding sounds.

FIG. 1 is a schematic diagram showing a content output system according to the first embodiment. FIG. 2 is a block diagram showing the content output system according to the first embodiment. FIG. 3 is a flowchart showing an example of the flow of processing in the content output system according to the first embodiment. FIG. 4 is a flowchart showing another example of the flow of processing in the content output system according to the first embodiment. FIG. 5 is a block diagram of a content output system according to the second embodiment. FIG. 6 is a flowchart illustrating an example of the flow of processing in the content output system according to the second embodiment. FIG. 7 is a block diagram of a content output system according to a third embodiment. FIG. 8 is a flowchart illustrating an example of the flow of processing in the content output system according to the third embodiment.

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a content output system 1 according to the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[First embodiment]
<Content output system>
FIG. 1 is a schematic diagram showing a content output system 1 according to the first embodiment. FIG. 2 is a block diagram showing the content output system 1 according to the first embodiment. The content output system 1 includes headphones 10 as an audio output device, and content that is composed of video and audio, such as an electronic book terminal, a smartphone, a tablet terminal, a portable music playback device, and a portable game machine. It also includes an electronic device 30 that performs playback, display, etc. In other words, the content output system 1 is a combination of the headphones 10 as an audio output device and the electronic device 30. The content output system 1 outputs audio related to the content displayed on the display screen 36 or peripheral audio from the headphones 10, depending on whether the user is gazing at the display screen 36 or not.

<Headphones>
The headphones 10 are, for example, of an overhead type and are worn on the user's head. The headphones 10 output audio related to the content displayed on the display screen 36 based on audio data output from the content output control device 40 of the electronic device 30. The headphones 10 can output ambient sound based on the audio signal output from the content output control device 40. The headphones 10 are connected to an electronic device 30 so as to be able to transmit and receive data by wire or wirelessly. The headphones 10 include a left audio output section 11 , a right audio output section 12 , a content input section 31 , a left microphone 14 , a right microphone 15 , and a content output control device 40 .

The left audio output unit 11 is an audio output unit for the left ear. The left audio output unit 11 has a housing that covers the left ear. The left audio output unit 11 outputs audio to be heard in the left ear. The left audio output unit 11 acquires audio data from the content output control device 40. The left audio output unit 11 outputs left channel data of audio data. The left audio output section 11 converts the electrical signal obtained by D/A converting the left channel data of the audio data into sound and outputs the sound.

The right audio output unit 12 is an audio output unit for the right ear. The right audio output unit 12 outputs audio to be heard in the right ear. The right audio output unit 12 acquires audio data from the content output control device 40. The right audio output unit 12 outputs right channel data of audio data. The right audio output unit 12 converts the electrical signal obtained by D/A converting the right channel data of the audio data into sound and outputs the sound.

The left microphone 14 is arranged in the casing of the left audio output section 11. The left microphone 14 acquires surrounding sounds. Ambient sounds are environmental sounds including, for example, third party voices and vehicle noises. The left microphone 14 outputs the acquired sound to the surrounding sound acquisition section 52 of the electronic device 30.

The right microphone 15 is arranged in the casing of the right audio output section 12. The right microphone 15 acquires surrounding sounds. The right microphone 15 outputs the acquired sound to the surrounding sound acquisition section 52 of the electronic device 30.

<Electronic equipment>
The electronic device 30 includes a content input section 31, a display section 32, a line of sight sensor 33, and a content output control device 40.

The content input section 31 receives content data of content such as music, video, or games. For example, content data stored in a storage unit (not shown) may be input to the content input unit 31. The content input unit 31 may receive content data from an external storage device via wire or wirelessly. The content data input to the content input section 31 is, for example, content data accompanied by audio output, such as video content, game content, and web content.

The content data includes video data and audio data related to the content. The video data related to the content is the video data of the content displayed on the display screen 36. The audio data related to the content is the audio data of the audio output corresponding to the video data of the content displayed on the display screen 36. The audio data related to the content may be, for example, the audio of text reading of an electronic book, the audio of text reading of a web page, and the audio of commentary.

The line of sight sensor 33 is arranged facing the same direction as the display screen 36 of the electronic device 30. The line of sight sensor 33 is a sensor that detects the line of sight of a person facing the display screen 36 of the electronic device 30 . The line-of-sight sensor 33 is placed at a position facing the user's face when the user is viewing the display screen 36 . The line of sight sensor 33 is arranged, for example, above the display screen 36 of the electronic device 30. The line-of-sight sensor 33 outputs the photographed data to the line-of-sight detection unit 43 of the content output control device 40 .

The line-of-sight sensor 33 includes, for example, an infrared light emitting section composed of a group of infrared LEDs and a pair of infrared cameras. In this embodiment, the line-of-sight sensor 33 irradiates infrared light toward the user's face using a pair of infrared light emitting units, and photographs the user's face with an infrared camera. Based on the image captured by the infrared camera in this manner, a line of sight detection unit 43, which will be described later, determines whether the user's line of sight is directed toward the display screen 36 based on the position of the user's pupil and corneal reflection. . Furthermore, the position of the user's line of sight on the display screen 36 is determined based on the position of the user's pupil and corneal reflex. The line-of-sight sensor 33 may be a visible light camera or other configuration having a similar function.

The display section 32 displays an image of the content input to the content input section 31. The display unit 32 is a display including a liquid crystal display (LCD) or an organic electro-luminescence (EL) display. The display unit 32 displays the video of the content based on the display data output from the display control unit 42. The display unit 32 includes a display screen 36 on which images are displayed.

The headphones 10 may be equipped with a sensor that detects whether the headphones 10 are worn on the user's head. Specifically, the headphones 10 are equipped with a three-axis acceleration sensor, and it is determined that the headphones 10 are worn on the user's head based on the direction in which gravitational acceleration is detected. Additionally, other sensors may be used, such as detecting headband opening or ear pad pressure.

<Content output control device>
The content output control device 40 outputs audio related to the content or ambient sound from the headphones 10 depending on whether the user is gazing at the display screen 36 or not. The content output control device 40 is an arithmetic processing device (control unit) including, for example, a CPU (Central Processing Unit) or a video processing processor. Content output control device 40 loads a program stored in a storage unit (not shown) into memory and executes instructions included in the program. The content output control device 40 includes a video acquisition section 41, a display control section 42, a line of sight detection section 43, a gaze determination section 44, an audio processing section 50, and a storage section that is an internal memory. The audio processing section 50 includes an audio acquisition section 51 , an ambient sound acquisition section 52 , and an audio output control section 53 . The content output control device 40 may be composed of one or more devices.

The video acquisition unit 41 acquires video data of content to be output to the display screen 36 of the display unit 32 from the content input unit 31.

The display control unit 42 displays the video data of the content acquired by the video acquisition unit 41 on the display screen 36 of the display unit 32.

The line-of-sight detection unit 43 detects the user's line-of-sight direction based on the photographic data captured by the line-of-sight sensor 33 . Although the method of detecting the line of sight is not limited, in this embodiment, the line of sight is detected by corneal reflection.

The gaze determination unit 44 determines whether the user is gazing at the display screen 36 of the electronic device 30 on which content is displayed, based on the detection result of the line of sight detection unit 43. Gazing at the display screen 36 means that the display screen 36 is located in the direction of the user's line of sight, or in other words, the state in which the direction of the user's line of sight and the display screen 36 intersect continues for a first predetermined period or longer. means. The first predetermined period is, for example, about 5 seconds. Not looking at the display screen 36 means that the user's line of sight is in a direction different from the display screen 36, in other words, the user's line of sight does not intersect with the display screen 36 for a second predetermined period of time. It means to continue above. The second predetermined period is, for example, about 5 seconds.

The audio acquisition unit 51 acquires audio data related to content to be output from the left audio output unit 11 and the right audio output unit 12 from the content input unit 31.

The surrounding sound acquisition unit 52 obtains surrounding sounds from the left microphone 14 and the right microphone 15.

The audio output control unit 53 performs control to output audio data as sound from the headphones 10. More specifically, the audio output control section 53 causes the left audio output section 11 to output a signal obtained by D/A converting and amplifying the left channel data of the audio data. The audio output control section 53 causes the right audio output section 12 to output a signal obtained by D/A converting and amplifying the right channel data of the audio data.

If the gaze determination unit 44 determines that the user is gazing at the display screen 36 displaying content, the audio output control unit 53 outputs audio related to the content acquired by the audio acquisition unit 51, so that the user can watch the content. If it is determined that the user is not gazing at the display screen 36 displaying , the ambient sound acquisition unit 52 outputs the acquired ambient sound.

If the gaze determination unit 44 determines that the user is not gazing at the display screen 36 on which content is displayed, the audio output control unit 53 acquires surrounding sounds in addition to the audio related to the content acquired by the audio acquisition unit 51. The surrounding sound acquired by the unit 52 may be output. In this case, ambient sounds are output from the headphones 10 along with the audio related to the content.

Next, information processing in the headphones 10 will be explained using FIGS. 3 and 4. FIG. 3 is a flowchart showing an example of the flow of processing in the content output system 1 according to the first embodiment. FIG. 4 is a flowchart showing another example of the flow of processing in the content output system 1 according to the first embodiment. For example, when the headphones 10 are turned on, when the headphones 10 are attached to the user's head, when audio output from the headphones 10 is started, or when an operation to start content output control processing is performed The processes shown in the flowcharts shown in FIGS. 3 and 4 are executed.

First, the processing shown in FIG. 3 will be explained. The content output control device 40 determines whether content accompanied by audio output is being displayed on the display unit 32 (step S101). More specifically, the content input to the content input unit 31 and consisting of audio and video is played back, the video of the content is displayed on the display unit 32, and it is determined whether the audio of the content is being output to the headphones 10. . In other words, it is determined whether content consisting of audio and video is being played. The state in which content with audio output is displayed on the display unit 32 is a state in which the video of the content is displayed on the display unit 32 and the audio of the content is output to the headphones 10. continues until playback ends.

If it is determined that content accompanied by audio output is being displayed on the display unit 32 (Yes in step S101), the process advances to step S102. If it is not determined that content accompanied by audio output is being displayed on the display unit 32 (No in step S101), this process ends. If it is determined that content with audio output is being displayed on the display unit 32 (Yes in step S101), it is determined whether the user is gazing at the display screen 36 (step S101). More specifically, the gaze determination unit 44 determines from the detection result of the line of sight detection unit 43 whether the user is gazing at the display screen 36 of the electronic device 30 on which content is displayed. The gaze determination unit 44 determines whether the display screen 36 remains in the user's line of sight direction for a first predetermined period or longer. If the gaze determining unit 44 determines that the user is gazing at the display screen 36 (Yes in step S102), the process advances to step S103. If the gaze determining unit 44 does not determine that the user is gazing at the display screen 36 (No in step S102), the process advances to step S104.

If it is determined that the user is gazing at the display screen 36 (Yes in step S102), the content output control device 40 outputs the audio of the content (step S103). More specifically, the audio output control unit 53 outputs the audio related to the content acquired by the audio acquisition unit 51 from the headphones 10. As a result, the audio of the content is output from the left audio output section 11 and the right audio output section 12 of the headphones 10. The content output control device 40 proceeds to step S105.

In the process of step S103, if the result in step S101 is Yes and the ambient sound is not being output, the output of the content sound is continued while the peripheral sound is not being output. is being output, the output of the content sound is continued and the output of the surrounding sound is stopped.

If it is not determined that the user is gazing at the display screen 36 (No in step S102), the content output control device 40 outputs ambient sound (step S104). More specifically, the audio output control section 53 outputs the ambient sound acquired by the ambient sound acquisition section 52. As a result, ambient sound is output from the left audio output section 11 and the right audio output section 12 of the headphones 10. The content output control device 40 proceeds to step S105.

In the process of step S104, if the answer is Yes in step S101 and the surrounding sound is not being output, output of the surrounding sound is started, and if the answer is Yes in step S101 and the ambient sound is being output, the output of the surrounding sound is started. Maintains ambient sound output.

The content output control device 40 determines whether to end the use of the content output system 1 such as the headphones 10 or the electronic device 30 (step S105). For example, when the power of the headphones 10 or the electronic device 30 is turned off, when the headphones 10 are removed from the user's head, when the output of audio to the headphones 10 is stopped, or when the content output control process ends When an operation is performed, it is determined that the usage is to be ended (Yes in step S105), and the process is ended. If the above does not apply, the content output control device 40 does not decide to end the use (No in step S105) and executes the process in step S101 again.

Next, the processing shown in FIG. 4 will be explained. Steps S111, S112, S113, and S115 in the flowchart shown in FIG. 4 perform the same processing as steps S101, S102, S103, and S105 in the flowchart shown in FIG.

If it is not determined that the user is gazing at the display screen 36 (No in step S112), the content output control device 40 outputs surrounding sound along with the audio related to the content (step S114). More specifically, the peripheral sound acquired by the peripheral sound acquisition unit 52 is outputted from the left audio output unit 11 and the right audio output unit 12 of the headphones 10, together with the audio related to the content acquired by the audio acquisition unit 51. The content output control device 40 proceeds to step S115.

The process of step S113 is to continue outputting the content sound when the ambient sound is not being output when the answer is Yes in step S111, and to continue outputting the content sound when the ambient sound is not being output. If the ambient sound is being output, the output of the content sound is continued and the output of the ambient sound is stopped.

In the process of step S114, if the content sound is outputted and the surrounding sound is not outputted when the answer is Yes in step S111, output of the surrounding sound is started while the output of the content sound is maintained, and if the answer is Yes in the step S111. If the content sound and ambient sound are being output at the time of , the output of the content sound and ambient sound is maintained.

In step S114, when the ambient sound is output together with the content sound, the volume of the content sound may be set by the user, and the volume of the content sound during the period when the ambient sound is output is set by the user. You can set the volume to a lower level.

In this way, when the user wearing the headphones 10 is gazing at the display screen 36, audio related to the content is output, and when the user is not gazing at the display screen 36, ambient sounds are output.

<Effect>
As described above, this embodiment outputs the audio of the content when the user wearing the headphones 10 is gazing at the display screen 36, and outputs the audio of the content when the user is not gazing at the display screen 36, and outputs the surrounding sound when the user is not gazing at the display screen 36. can be output. According to the present embodiment, when the user stops gazing at the display screen 36 and is presumed to have turned his attention to the surroundings, it is possible to appropriately confirm surrounding sounds. In this way, according to the present embodiment, when the user wants to hear the surrounding sounds, the surrounding sounds can be appropriately confirmed without the user performing any operation.

In this embodiment, when the user is not looking at the display screen 36, ambient sounds can be output together with the audio of the content. According to this embodiment, it is possible to check surrounding sounds while continuing to view content.

[Second embodiment]
A content output system 1A according to this embodiment will be described with reference to FIGS. 5 and 6. FIG. 5 is a block diagram of a content output system 1A according to the second embodiment. FIG. 6 is a flowchart showing an example of the flow of processing in the content output system 1A according to the second embodiment. The content output system 1A has the same basic configuration as the content output system 1 of the first embodiment. In the following description, components similar to those of the content output system 1 are denoted by the same or corresponding symbols, and detailed description thereof will be omitted. In this embodiment, the electronic device 30A includes a GNSS (Global Navigation Satellite System) receiving section 34A, a position information calculation section 45A and a determination section 46A of the content output control device 40A, and processing in the audio output control section 53A. However, this embodiment is different from the first embodiment.

The GNSS receiving unit 34A includes a GNSS receiver that receives GNSS signals from GNSS satellites. The GNSS receiving section 34A outputs the received GNSS signal to the position information calculating section 45A.

The position information calculation unit 45A receives a GNSS signal from the GNSS reception unit 34A. The position information calculation unit 45A calculates current position information based on the GNSS signal. The position information calculation section 45A and the GNSS reception section 34A are not limited to GNSS signals, and may correspond to other types of positioning satellite systems.

The determining unit 46A determines whether the user is using transportation. For example, based on the position information calculated by the position information calculation unit 45A, the determination unit 46A determines whether the current position of the user wearing the headphones 10 corresponds to the position information of a transportation facility in map information (not shown) or the movement history. It may be determined that the person is using transportation based on the person's travel rate or travel speed. The determining unit 46A is not limited to a method for determining whether the person is using transportation, and may use other methods such as using noise or vibrations around the headphones 10, for example.

If the audio output control unit 53A determines that the user is gazing at the display screen 36 on which content is displayed while the user is using transportation, the audio output control unit 53A outputs audio related to the content acquired by the audio acquisition unit 51. If it is determined that the user is not gazing at the display screen 36 on which the content is displayed, the peripheral sound acquired by the peripheral sound acquisition unit 52 is output.

Next, information processing in the content output system 1A will be explained using FIG. 6. Steps S122 to S126 in the flowchart shown in FIG. 6 perform the same processing as steps S101 to S105 in the flowchart shown in FIG.

The content output control device 40A determines whether transportation is being used (step S121). More specifically, the determination unit 46A determines whether the user's current location corresponds to the transportation facility location information in the map information based on the location information calculated by the location information calculation unit 45A. It is determined that you are using . If the determining unit 46A determines that the user is using transportation (Yes in step S121), the process advances to step S122. If the determining unit 46A does not determine that the user is using transportation (No in step S121), the process ends.

In addition to determining whether to end the use of the headphones 10 or the electronic device 30A in step S126, the content output control device 40A also determines whether to end the use of the transportation facility (step S126). More specifically, based on the position information calculated by the position information calculation unit 45A, the determination unit 46A determines whether the user's current position deviates from the position information of the transport system in the map information, or when the user has finished using the transport system. When it is detected that there is a vehicle, it is determined that the use of transportation is to be terminated. If the determination unit 46A determines that the use of the transportation facility is to be terminated (Yes in step S126), the process is terminated. If the determining unit 46A does not determine that the use of transportation is to be terminated (No in step S126), the process advances to step S122.

<Effect>
As described above, in this embodiment, when the user wearing the headphones 10 is using public transportation and the user is not gazing at the display screen 36, ambient sound is output. According to the present embodiment, when a user wearing the headphones 10 stops paying attention to the content display screen 36 in order to listen to announcements while using public transportation, ambient sounds such as announcements are output to the headphones 10. You can listen to it at According to this embodiment, it is possible to suppress the surrounding sound from being outputted inadvertently.

[Third embodiment]
The content output system 1B according to this embodiment will be described with reference to FIGS. 7 and 8. FIG. 7 is a block diagram of a content output system 1B according to the third embodiment. FIG. 8 is a flowchart showing an example of the flow of processing in the content output system 1B according to the third embodiment. The content output system 1B has the same basic configuration as the content output system 1 of the first embodiment. In this embodiment, the electronic device 30B differs from the first embodiment in that it includes a photographing section 35B and a face detection section 47B of a content output control device 40B, and the processing in the audio output control section 53B.

The photographing unit 35B is a visible light camera that photographs a person facing the display screen 36 of the electronic device 30B. The photographing unit 35B photographs the user's face. The photographing unit 35B is arranged at a position where it can photograph the user's face while the user is viewing the display screen. The photographing unit 35B is arranged, for example, above the display screen 36 of the electronic device 30B. The photographing unit 35B outputs the photographed data to the face detection unit 47B of the content output control device 40B. The photographing unit 33A and the line-of-sight sensor 33 may be the same visible light camera.

The face detection section 47B recognizes the user's face from the photographic data photographed by the photographing section 35B, and detects the direction of the recognized face. More specifically, the face detection unit 47B detects whether the face detected by the face detection unit 47B is facing the display screen 36. For example, when the user is gazing at the display screen 36 on which content is displayed, the user's face is facing the display screen 36. For example, when the user pays attention to the surroundings and looks around, the orientation of the user's face is not facing the display screen 36.

The direction facing the display screen 36 refers to the direction in which the user can visually recognize the image of the content displayed on the display screen 36. The direction facing the display screen 36 is, for example, the angle at which the display screen 36 intersects a straight line that passes through the center of the user's eyes and extends in front of the user in the vertical and horizontal directions. The direction in which the user is clearly viewing the display screen 36 may be defined, such as a range of about 90°±30°.

In addition to determining that the user is gazing at the display screen 36 on which content is displayed by the gaze determination unit 44, the audio output control unit 53B determines that the direction of the face detected by the face detection unit 47B is displayed on the display screen 36. If the content is facing the user, the audio acquisition unit 51 outputs audio related to the acquired content. In addition to the fact that the gaze determination unit 44 has determined that the user is not gazing at the display screen 36 on which content is displayed, the audio output control unit 53B also determines whether the direction of the face detected by the face detection unit 47B is on the display screen 36. If the direction is not opposite to the other, the surrounding sound acquisition unit 52 outputs the acquired surrounding sound. Even if the user is not gazing at the display screen 36 on which the content is displayed, if the user's face is facing the display screen 36, it is presumed that the user intends to continue viewing the content. In this case, it is preferable to continue viewing the content. On the other hand, if the user is not gazing at the display screen 36 on which content is displayed and the user's face is not facing the display screen 36, the user is paying close attention to the surroundings. It is estimated that there are. In this case, it is preferable to make surrounding sounds visible.

Next, information processing in the content output system 1B will be explained using FIG. 8. Steps S131, S132, S134 and S136 in the flowchart shown in FIG. 8 perform the same processing as steps S101, S102, S103 and S105 in the flowchart shown in FIG.

The content output control device 40B determines whether the user's face is facing the user (step S133). More specifically, if the direction of the face detected by the face detection unit 47B is facing the display screen 36 (Yes in step S133), the process advances to step S134. If the direction of the face detected by the face detection unit 47B is not facing the display screen 36 (No in step S133), the process advances to step S135.

<Effect>
As described above, in this embodiment, when the user is gazing at the display screen 36 and the direction of the user's face is opposite to the display screen 36, the audio of the content is output, and the user looks at the display screen 36. When the user is not gazing at the user and the direction of the user's face is not facing the display screen 36, the ambient sound acquired by the ambient sound acquisition unit 52 can be output. According to this embodiment, when the user turns his/her face away from the display screen 36 and pays attention to the surroundings, it is possible to appropriately confirm surrounding sounds.

Each component of the illustrated content output system 1 is functionally conceptual, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to what is shown in the diagram, and all or part of it may be functionally or physically distributed or integrated into arbitrary units depending on the processing load and usage status of each device. It's okay.

The configuration of the content output system 1 is realized by, for example, a program loaded into a memory as software. The above embodiments have been described as functional blocks realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms using only hardware, only software, or a combination thereof.

The components described above include those that can be easily imagined by those skilled in the art and that are substantially the same. Furthermore, the configurations described above can be combined as appropriate. Furthermore, various omissions, substitutions, or changes in the configuration are possible without departing from the gist of the present invention.

Although the headphones 10 have been described above as an example of the audio output device, the present invention is not limited thereto. The audio output device may be, for example, an earphone or a neck-mounted speaker.

1 Content output system 10 Headphones (audio output device)
11 Left audio output section 12 Right audio output section 14 Left microphone 15 Right microphone 30 Electronic device 31 Content input section 32 Display section 33 Gaze sensor 40 Content output control device 41 Video acquisition section 42 Display control section 43 Gaze detection section 44 Gaze determination section 50 Audio processing unit 51 Audio acquisition unit 52 Ambient sound acquisition unit 53 Audio output control unit

Claims (6)

a line-of-sight detection unit that detects the user's line-of-sight direction using a line-of-sight sensor disposed facing the same direction as the display screen ;
a gaze determination unit that determines whether the user is gazing at the display screen on which content is displayed based on the detection result of the gaze detection unit;
an ambient sound acquisition unit that acquires ambient sounds of the user from a microphone provided in headphones worn by the user ;
a determination unit that determines that the user uses transportation;
an audio acquisition unit that acquires audio related to the content;
When the user is using transportation, if the gaze determining unit determines that the user is gazing at the display screen on which content is displayed, the user may be gazing at the display screen on which content is displayed. an audio output control unit that outputs audio and, when determining that the user is not gazing at the display screen on which content is displayed, outputs the ambient sound acquired by the ambient sound acquisition unit;
A content output control device comprising: If the audio output control unit determines that the user is not gazing at the display screen on which content is displayed, the audio output control unit may output audio data acquired by the surrounding sound acquisition unit in addition to the audio related to the content acquired by the audio acquisition unit. Outputs surrounding sounds,
The content output control device according to claim 1. further comprising a face detection unit that recognizes the user's face and detects the orientation of the recognized face,
In addition to determining that the user is gazing at the display screen on which content is displayed, the audio output control unit determines that the face direction detected by the face detection unit is facing the display screen. If the orientation is the same, the audio acquisition unit outputs the audio related to the acquired content, and in addition to determining that the user is not gazing at the display screen on which the content is displayed, the face detection unit detects outputting the peripheral sound acquired by the peripheral sound acquisition unit when the direction of the face is not facing the display screen;
The content output control device according to claim 1 or 2. A content output control device according to any one of claims 1 to 3;
A sound collection unit that collects surrounding sounds;
an audio output section that outputs audio;
A content output system comprising : detecting the direction of the line of sight of a user using the audio output device with a line of sight sensor placed facing in the same direction as the display screen;
determining whether the user is gazing at the display screen on which content is displayed based on the detection result of the gaze direction;
acquiring ambient sounds of the user from a microphone provided in headphones worn by the user;
determining that the user uses transportation;
obtaining audio related to the content;
When the user is using transportation, if it is determined that the user is gazing at the display screen on which content is displayed, a sound related to the content is output, and a sound related to the content is output. If it is determined that the user is not looking at the display screen, outputting ambient sound;
A content output control method executed by a content output control device . detecting the direction of the line of sight of a user using the audio output device with a line of sight sensor placed facing in the same direction as the display screen;
determining whether the user is gazing at the display screen on which content is displayed based on the detection result of the gaze direction;
acquiring ambient sounds of the user from a microphone provided in headphones worn by the user;
determining that the user uses transportation;
obtaining audio related to the content;
When the user is using transportation, if it is determined that the user is gazing at the display screen on which content is displayed, a sound related to the content is output, and a sound related to the content is output. If it is determined that the user is not looking at the display screen, outputting ambient sound;
A program that a computer runs, including.

Images