JP2006078732A - Sound information providing method, sound information providing system, and sound information providing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To dynamically change and provide sound information such as music in a distinguishable form. <P>SOLUTION: A content output device 3 divides contents including the sound information provided from a content distributor 2 into two or more pieces of partial sound information constituting the sound information, stores them, and on the basis of the detected result of a camera 4 which detects the state of the listener of the contents including the sound information, outputs the partial sound information corresponding to the detected result to a speaker 6. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a voice information providing technique, and more particularly, to output a content intended for an advertisement of music itself or an advertisement that effectively uses a voice to a large screen, and to an operation of a person in an area where the content can be viewed. The present invention relates to a voice information providing technology that dynamically changes the voice output and the screen output of content.

  Conventionally, content such as advertisements and guidance is output via a large-screen display device such as a plasma display or projector provided in public spaces such as station premises and building entrances, and people in areas where content can be viewed (hereinafter referred to as In some cases, the output of the content is dynamically changed according to the operation of the viewer.

  For example, as shown in FIG. 6, one or a plurality of windows 91 for displaying contents is displayed on a large-screen display 90, and (a) the size of the window 91 when the viewer 92 passes in front of the window 91. (B) When the viewable viewer 92 stops in front of the window 91, detailed information on the content is displayed on the window 91. (c) The viewable viewer 92 stays in front of the window 91 for a long time, Some display information useful for content such as a map or coupon information when a finger is pointed at 91.

  Also, as shown in FIG. 7, a map is displayed on a large-screen display 90, and (d) a window that displays information about the corresponding position when the viewer 92 stops before a predetermined position on the map. 91 is displayed in a pop-up manner, and (e) when the viewer 92 approaches the window 91, detailed information is displayed on the window 91.

As a technique for realizing the service as described above, for example, a multimedia information space in which a user views video or music within a space surrounded by a plurality of screens presenting multimedia information of video or still images. It is used to input and output information. It detects the status of multiple users in the multimedia information space, converts the detected status of multiple users into instruction commands, and processes the converted instruction commands. There is one that updates multimedia information to be output to the multimedia information space in response to an instruction command, and outputs the updated multimedia information to the multimedia information space (see, for example, Patent Document 1).
JP 2001-216527 A

  However, in the above prior art, video information can be dynamically changed and viewed by a viewer, but for audio information such as music, video such as an effective sound usage method or a BGM usage method is used. In general, the presentation method subordinate to the above method is generally used, and there is the following problem when it is desired to advertise audio information such as music.

(Problem 1)
In the case of video, a plurality of information can be presented simultaneously by presenting a plurality of videos to a plurality of viewers at the same time, but in the case of audio information such as music, it is difficult to distinguish each of them by presenting a plurality of different sounds at the same time. Therefore, when audio information such as music is provided to a plurality of viewers, the audio is simply played in order like a jukebox.

(Problem 2)
In consideration of the above problem 1, if only one sound source is played at the same time, only the video can be changed, which is not attractive to the viewer.

  Due to such problems, there remains a problem that it is difficult to effectively advertise audio information such as music.

  The present invention has been made to solve such problems, and its purpose is to prepare audio information such as music to be provided separately for each part and dynamically according to the movement of the viewer. An object of the present invention is to provide a voice information providing technique that can obtain a higher degree of attention with respect to an advertisement of voice information itself such as music.

  In order to solve the above-described problem, the invention according to claim 1 is an audio that changes audio information to be provided to the listener based on a detection result of a sensor that detects a state of a listener of content including audio information. An information providing method, wherein the audio information is divided into a plurality of partial audio information constituting the audio information and stored, and the partial audio information corresponding to the detection result is provided to the listener. Features.

  According to a second aspect of the present invention, the content includes image information, and partial audio information and image information corresponding to the detection result are provided to the listener.

  The invention according to claim 3 is characterized in that when a plurality of pieces of the partial audio information are provided simultaneously, the partial audio information is provided in synchronization.

  According to a fourth aspect of the present invention, the sensor for detecting the state of the listener of the content including the audio information inputs the information about the listener, and the video analyzing unit determines the listener's information from the information about the listener. A step of analyzing the state, a step of generating an event corresponding to the analysis result by the event generation unit, a step of executing a script corresponding to the event by the script execution unit, and a content corresponding to the script by the content output unit A method of providing audio information, wherein the content includes audio information, and the audio information is divided into a plurality of partial audio information constituting the audio information and stored. The script execution unit is a script that outputs partial audio information corresponding to the event received from the event generation unit. Is executed, characterized in that.

  In the invention according to claim 5, the content includes image information, and the script execution unit executes a script that outputs partial audio information and image information corresponding to an event received from the event generation unit. It is characterized by that.

  According to a sixth aspect of the present invention, when the script execution unit executes a script that simultaneously outputs a plurality of partial audio information based on an event input from the event generation unit, the script outputs each partial audio information. It is characterized by being output in synchronization.

  The invention according to claim 7 is characterized in that, when the content output means inputs a plurality of scripts for outputting partial audio information from the script execution unit, the partial audio information is output in synchronization with each other. To do.

  The invention according to claim 8 is characterized in that the voice information is music and the plurality of pieces of partial voice information are each part of the music.

  The invention according to claim 9 is an audio information providing apparatus that changes audio information provided to the listener based on a detection result of a sensor that detects a state of the listener of the content including the audio information. The audio information is divided into a plurality of partial audio information constituting the audio information and stored, and the partial audio information corresponding to the detection result is provided to the listener.

  The invention according to claim 10 is characterized in that the content includes image information, and provides partial audio information and image information corresponding to the detection result to the listener.

  The invention according to claim 11 is characterized in that when a plurality of pieces of the partial audio information are provided simultaneously, the partial audio information is provided in synchronization.

  According to a twelfth aspect of the present invention, the state of a listener of content including audio information is detected, and the state of the listener is analyzed from the sensor that inputs information about the listener and the information about the listener. A video analysis unit; an event generation unit that generates an event corresponding to the analysis result; a script execution unit that executes a script corresponding to the event; and a content output unit that outputs content corresponding to the script. An audio information providing apparatus, wherein the content includes audio information, the audio information is divided and stored into a plurality of partial audio information constituting the audio information, and the script execution unit generates the event A script that outputs partial audio information corresponding to an event received from the section is executed.

  The content of the invention includes image information, and the script execution unit executes a script that outputs partial audio information and image information corresponding to an event received from the event generation unit. It is characterized by that.

  Further, in the invention described in claim 14, when the script execution unit executes a script that simultaneously outputs a plurality of partial audio information based on an event input from the event generation unit, the script outputs each partial audio information. It is characterized by being output in synchronization.

  The invention according to claim 15 is characterized in that when the content output means inputs a plurality of scripts for outputting partial audio information from the script execution unit, the partial audio information is output in synchronization with each other. To do.

  The invention according to claim 16 is characterized in that the voice information is music and the plurality of pieces of partial voice information are each part of the music.

  The invention described in claim 17 is characterized in that the audio information providing method or the audio information providing apparatus according to any one of claims 1 to 16 is described in a computer program and can be executed. And

  According to the first and ninth aspects, since the partial audio information constituting the audio information is provided to the listener based on the detection result of the sensor, the partial audio information expected to be listened to by the listener can be provided, The partial audio information to be provided can be changed according to the person's state.

  The listener is a person who listens to audio information. The viewers used in the “Best Mode for Carrying Out the Invention” below are those who visually recognize the image information and listen to the audio information, and the listener has no limitation on the image information.

  In Claims 2 and 10, since the provided content includes partial audio information and image information, providing partial audio information related to the image information provides more attractive information for the listener. It becomes possible.

  According to the third and eleventh aspects, since a plurality of pieces of partial sound information are provided in synchronization, information can be provided simultaneously as a single piece of sound information by superimposing the plurality of pieces of partial sound information.

  In claims 4 and 12, since the script is executed based on an event corresponding to the state of the listener, it is possible to provide partial audio information that the listener is expected to listen to, or to change the state of the listener. It is possible to change the partial audio information provided accordingly.

  In Claims 5 and 13, since the content to be provided includes partial audio information and image information, providing partial audio information related to the image information provides more attractive information for the listener. It becomes possible.

  In claim 6, claim 7, claim 14 and claim 15, since a plurality of partial voice information is provided in synchronization, a plurality of partial voice information is overlapped and information is simultaneously provided as one voice information. Is possible.

  In claims 8 and 16, since the sound information is music and the partial sound information is each part, the band performance or the like can be performed in various modes such as the performance of each instrument or the overall performance according to the state of the listener. It becomes possible to provide.

  In the seventeenth aspect, a program for executing the inventions of the first to sixteenth aspects can be realized.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to provide the audio | voice information provision technique which can obtain the higher attention degree with respect to the advertisement by audio | voice information, such as music.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of an audio information output system 1 according to an embodiment of the present invention.

  As shown in FIG. 1, the audio information output system 1 includes a content distribution device 2 that distributes content, and a content output device 3 that outputs the content distributed by the content distribution device 2 on a screen.

  The audio information output system 1 can include a plurality of content distribution apparatuses 2 and a plurality of content output apparatuses 3. However, in order to facilitate understanding of the present invention, the audio information output system 1 is 1 in the following description. One content distribution device 2 and one content output device 3 are provided.

  The content distribution device 2 is configured by a computer device having a storage medium for storing a plurality of contents, and the content output device 3 is networked with content intended for advertisement using music itself and advertisements that effectively use sound. Etc. are distributed via a transmission line such as the above.

  The content output device 3 is configured by a computer device, and the content output device 3 is provided with a camera 4. In FIG. 1, two cameras 4 are installed, but it is only necessary to have one or more cameras 4.

  The content output device 3 is connected to a large-screen display 5 such as a liquid crystal display, a plasma display, or a projector, and a speaker 6, and outputs the content distributed by the content distribution device 2 to the display 5. Audio is output to the speaker 6. Although one speaker 6 is installed in the content output apparatus 3 in FIG. 1, the speaker 6 may be one speaker or a plurality of multi-channel speakers.

  FIG. 2 is a block diagram showing the configuration of the content output device 3.

  As shown in FIG. 2, the content output device 3 includes a video analysis unit 21 that analyzes video captured by the camera 4, an event generation unit 22 that generates an event based on the analysis result by the video analysis unit 21, and screen output. Distributed by the content distribution device 2, a script storage unit 23 storing a script describing control, speaker output control, and the like, a script execution unit 24 executing the script stored in the script storage unit 23 according to an event, A content storage unit 25 for storing the content, and a content output unit 26 for outputting the content stored in the content storage unit 25 to the display 5 and the speaker 6 based on a command from the script execution unit 24.

  The video analysis unit 21 identifies the viewer's position by analyzing the video imaged by the camera 4, and outputs the analysis result obtained from the identified viewer's position to the event generation unit 22. ing.

  Specifically, the video analysis unit 21 specifies the position of the viewer based on the difference video between the video captured by the camera 4 and a still image captured in a state where there is no viewer in the imaging area of the camera 4. It is supposed to be. When attention is paid to audio information, the viewer can be expressed as a listener.

  The video analysis unit 21 analyzes the viewer's entry and exit from a specific area, residence time, moving speed and acceleration, and posture based on the difference video.

  The analysis result output by the video analysis unit 21 is input to the event generation unit 22, and the event generation unit 22 generates an event based on the input analysis result.

  Here, the event indicates what action the viewer has taken on the display 5, that is, the state of the viewer. For example, the viewer has entered or exited a specific area. When the dwell time exceeds a predetermined time, moves at a speed equal to or higher than a predetermined speed, moves at an acceleration equal to or higher than a predetermined acceleration, or points to the display 5 There are times when you take a different posture.

  The script execution unit 24 acquires the script stored in the script storage unit 23 according to the event generated by the event generation unit 22, and executes the acquired script.

  Here, the script includes instructions including movement and size change of the window for displaying the content on the display 5, switching of the content, changing and switching of the volume of each part of the sound output to the speaker 6, and the like. .

  For example, when the event generation unit 22 generates an event indicating that a viewer has entered a predetermined area, the script execution unit 24 displays an image on the display 5 at a position that is easily viewable by the viewer. A script for changing or outputting sound from the speaker 6 is acquired from the script storage unit 23 and executed.

  The content output unit 26 is configured to output the content stored in the content storage unit 25 to the display 5 and the speaker 6 based on an instruction by a script executed by the script execution unit 24.

  The video analysis unit 21, the event generation unit 22, the script execution unit 24, and the content output unit 26 are configured by a CPU included in a computer device that configures the content output device 3.

  Further, the audio information output system 1 can also configure a content generation device by the content storage unit 25.

  Here, an example of an image output operation in the audio information output system 1 will be described with reference to FIGS.

  FIG. 3 is an explanatory diagram for explaining an example of a screen output operation in the audio information output system 1. FIG. 4 is an explanatory diagram for explaining an example of music content provided to the viewer. As shown in FIG. 4, the content 40 in which all the parts are arranged, and the parts separated for each part (41 to 44) of the content 40 are prepared.

  In FIG. 3, when there are no viewers, the images 33 to 36 are still images or masked on top.

  When the viewer 31 enters the area before the video 34 (guitar video) displayed on the display 5, the video analysis unit 21 analyzes that the viewer 31 has entered the predetermined area. The event generating unit 22 generates an event indicating that the video has entered before the video 34.

  The script stored in the script storage unit 23 is acquired by the script execution unit 24 in accordance with the event generated by the event generation unit 22, and the acquired script is executed.

  The content stored in the content storage unit 25 is output to the display 5 and the speaker 6 by the content output unit 26 based on the command by the script executed by the script execution unit 24. On the display 5, the reproduction of the image 34 starts or the mask applied on the display 5 is removed and the moving image can be seen, and the guitar part 42 is reproduced from the speaker 6.

  In FIG. 3, when another viewer 32 enters the area in front of the image 36 (vocal video) displayed on the display 5, the video analysis unit 21 analyzes that the viewer 32 has entered the predetermined area. Then, an event that the viewer 32 has entered before the video 36 is generated by the event generating unit.

  The script stored in the script storage unit 23 is acquired by the script execution unit 24 in accordance with the event generated by the event generation unit 22, and the acquired script is executed.

  The content stored in the content storage unit 25 is output to the display 5 and the speaker 6 by the content output unit 26 based on the command by the script executed by the script execution unit 24. On the display 5, the reproduction of the video 36 starts or the mask applied on the display 5 is removed and the moving image can be seen, and the vocal part 44 is reproduced from the speaker 6. At this time, if the viewer 31 is still in front of the image 34, the guitar part 42 and the vocal part 44 are superimposed and reproduced. That is, the script execution unit 24 executes a script that reproduces the guitar part 42 and the vocal part 44 in synchronization, or the content output unit 26 reproduces the script and vocal part 44 that reproduces the guitar part 42. When a script to be received is received, each part is output in synchronization.

  In the present embodiment, all viewers enter the respective areas in front of the respective images 33 to 36, so that all the parts are superimposed and reproduced.

  By changing the script according to the assumed number of passers-by in front of the display 5, when it is assumed that there are many passers-by, playback may start when a certain number of people are in that area. If it is possible and it is assumed that there are few passers-by, once a viewer enters the area, even if the viewer leaves the area, one viewer can continue by playing for a certain period of time. It is also possible to play multiple parts.

  It is also possible to change the volume of the part to be reproduced depending on the distance between the display 5 and the viewer.

  This makes it possible to listen to a different ensemble each time depending on the movement of viewers on the spot.

  In addition, when it is possible to reproduce with the same arrangement as the original music, a privilege video or a coupon may be displayed on the display 5.

  Thereby, a viewer's attention can be acquired rather than using music as a mere sound effect or BGM.

  Here, the operation in the audio information output system 1 will be described with reference to FIG. FIG. 5 is a sequence diagram for explaining the operation in the audio information output system 1.

  In FIG. 5, first, the video analysis unit 21 analyzes the video shot by the camera 4 (S1).

  It is determined whether there is a change in the video (S2). If it is determined that there is a change in the video, the process proceeds to the subsequent S3, and if it is determined that there is no change in the video, the process of S1 is performed.

  If it is determined in S2 that there is a change in the video, the event generator 22 generates an event corresponding to the content of the change (S3).

  The script execution unit 24 acquires an action script corresponding to the generated event (S4), and executes the acquired script (S5).

  As a result, the content is reproduced on the display 5 and the speaker 6 as written in the script.

  In the present invention, the processing functions shown in FIGS. 3 and 5 are realized by using a computer by configuring some or all of the processing functions of the system or apparatus shown in FIGS. 1 and 2 as a program. It can be configured as a program and executed by a computer. In addition, a computer-readable recording medium such as a flexible disk, MO, ROM, or memory card can be used to store a program for realizing the processing function of each unit by the computer or a program for causing the computer to execute the processing procedure. It can be recorded on a CD, a DVD, a removable disk, etc., stored, provided, and distributed via a communication network such as the Internet.

  In the present embodiment, the camera is used as a sensor for detecting the state of the viewer. However, any sensor that can detect the state of the viewer can be used, for example, an infrared sensor (human sensor), a static sensor, or the like. Any sensor such as an electric sensor, an ultrasonic sensor, a wireless tag sensor, a touch sensor, a pressure sensor, and a switch may be used, and these sensors may be used in appropriate combination.

  As described above, according to the audio information output system 1 according to the embodiment of the present invention, music and audio to be provided are prepared separately for each part and dynamically configured according to the movement of the viewer. By doing so, it is possible to provide a voice information providing technology that can obtain a higher degree of attention to the advertisement of the music itself.

The block diagram which shows the structure of the audio | voice information output system of this invention. The block diagram which shows the structure of the audio | voice information output device of this invention. Explanatory drawing for demonstrating the example of the screen output operation | movement in the audio | voice information output system of this invention. Explanatory drawing for demonstrating the example of the music content provided to the viewer of this invention. The sequence diagram explaining the operation | movement in the audio | voice information output system of this invention. Explanatory drawing for demonstrating the example of the screen output operation | movement in the conventional audio | voice information output system. Explanatory drawing for demonstrating the example of the screen output operation | movement in the conventional audio | voice information output system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Audio | voice information output system 2 ... Content distribution apparatus 3 ... Content output apparatus 4 ... Camera 5 ... Display 6 ... Speaker 21 ... Image | video analysis part 22 ... Event generation part 23 ... Script storage part 24 ... Script execution part 25 ... Content storage part 26 ... Content output section 31, 32 ... Audible viewer 33 ... Accordion part 34 ... Guitar part 35 ... Drums part 36 ... Vocal part 40 ... Original music content 41 ... Accordion part 42 ... Guitar part 43 ... Drum part 44 ... Vocal part

Claims (17)

An audio information providing method for changing audio information to be provided to the listener based on a detection result of a sensor that detects a state of a listener of content including audio information,
The audio information providing method, wherein the audio information is divided into a plurality of partial audio information constituting the audio information and stored, and partial audio information corresponding to the detection result is provided to the listener. . The content includes image information,
2. The audio information providing method according to claim 1, wherein partial audio information and image information corresponding to the detection result are provided to the listener.   3. The audio information providing method according to claim 1, wherein when a plurality of pieces of the partial audio information are simultaneously provided, the partial audio information is provided in synchronization. A sensor for detecting the state of the listener of the content containing the audio information inputs information about the listener;
A step of analyzing a state of the listener from information on the listener by the video analysis unit;
An event generating unit generating an event corresponding to the analysis result;
A script execution unit executing a script corresponding to the event;
A content output unit that outputs a content corresponding to the script;
The content includes audio information, and the audio information is divided into a plurality of partial audio information constituting the audio information and stored.
The audio information providing method, wherein the script execution unit executes a script that outputs partial audio information corresponding to an event received from the event generation unit. The content includes image information,
5. The audio information providing method according to claim 4, wherein the script execution unit executes a script that outputs partial audio information and image information corresponding to an event received from the event generation unit.   When the script execution unit executes a script that simultaneously outputs a plurality of partial audio information based on an event input from the event generation unit, the script outputs the partial audio information in synchronization. The audio information providing method according to claim 4 or 5, characterized in that:   The audio information according to claim 4 or 5, wherein when the content output means inputs a plurality of scripts for outputting partial audio information from the script execution unit, the partial audio information is output in synchronization with each other. How to provide. The audio information is music;
The audio information providing method according to claim 1, wherein the plurality of partial audio information are each part of the music. An audio information providing apparatus that changes audio information to be provided to the listener based on a detection result of a sensor that detects a state of a listener of content including audio information,
The audio information providing apparatus, wherein the audio information is divided and stored into a plurality of partial audio information constituting the audio information, and the partial audio information corresponding to the detection result is provided to the listener. . The content includes image information,
The audio information providing apparatus according to claim 10, wherein partial audio information and image information corresponding to the detection result are provided to the listener.   The audio information providing apparatus according to claim 9 or 10, wherein when providing a plurality of pieces of the partial audio information simultaneously, the partial audio information is provided in synchronization. A sensor for detecting a state of a listener of content including audio information and inputting information related to the listener;
A video analysis unit that analyzes the state of the listener from information about the listener;
An event generator for generating an event corresponding to the analysis result;
A script execution unit that executes a script corresponding to the event;
A content output unit that outputs content corresponding to the script,
The content includes audio information, and the audio information is divided into a plurality of partial audio information constituting the audio information and stored.
The audio information providing apparatus, wherein the script execution unit executes a script that outputs partial audio information corresponding to an event received from the event generation unit. The content includes image information,
13. The audio information providing apparatus according to claim 12, wherein the script execution unit executes a script that outputs partial audio information and image information corresponding to an event received from the event generation unit.   When the script execution unit executes a script that simultaneously outputs a plurality of partial audio information based on an event input from the event generation unit, the script outputs the partial audio information in synchronization. The audio information providing apparatus according to claim 12 or 13, characterized in that:   The audio information according to claim 12 or 13, wherein when the content output unit inputs a plurality of scripts for outputting partial audio information from the script execution unit, the partial audio information is output in synchronization with each other. Providing device. The audio information is music;
16. The audio information providing method according to claim 9, wherein the plurality of partial audio information are each part of the music.   A program characterized in that the voice information providing method or the voice information providing apparatus according to any one of claims 1 to 16 is described as a computer program and is executable.

Images