JP2019200598A - server - Google Patents

Abstract

To provide a technology capable of using a smart speaker as an effective advertising medium, or further improving a smart speaker system.SOLUTION: A server includes: receiving means for receiving a distribution request from a microphone and a speaker having a communication function via a network; acquisition means for acquiring an audio content without an image in response to the received distribution request; selection means for selecting a voice advertisement without an image from voice advertisement holding means; and transmitting means for transmitting the acquired audio content and the selected audio advertisement together to the speaker via the network.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a server that communicates with a speaker having a microphone.

  A smart speaker having a microphone and a communication function and capable of performing voice operation and information retrieval has started to be widespread (for example, see Non-Patent Document 1).

https://www.is.nri.co.jp/report/short-research/2017/000213.html, May 9, 2018 search

  Current systems including smart speakers can receive requests from the user and process the requests. In such a situation, it is desired to create a more useful smart speaker system.

  The present invention has been made in view of these problems, and an object thereof is to provide a technique that can use a smart speaker as an effective advertising medium, or to further improve a smart speaker system.

  One embodiment of the present invention relates to a server. The server includes a reception unit that receives a distribution request from a microphone and a speaker having a communication function via a network, an acquisition unit that acquires audio content without an image in response to the received distribution request, and no image. Selecting means for selecting a sound advertisement from the sound advertisement holding means; and transmitting means for transmitting the acquired sound content and the selected sound advertisement together to the speaker via the network.

  It should be noted that any combination of the above-described constituent elements, or those obtained by replacing the constituent elements and expressions of the present invention with each other between apparatuses, methods, systems, computer programs, recording media storing computer programs, and the like are also included in the present invention. It is effective as an embodiment of

  ADVANTAGE OF THE INVENTION According to this invention, the technique which can use a smart speaker as an effective advertising medium can be provided, or a smart speaker system can be improved further.

It is a schematic diagram which shows the structure of the audio | voice advertisement delivery system which concerns on 1st Embodiment. It is a block diagram which shows the function and structure of the smart speaker of FIG. It is a hardware block diagram of the management server of FIG. It is a block diagram which shows the function and structure of the management server of FIG. FIG. 5 is a data structure diagram illustrating an example of an audio content holding unit in FIG. 4. It is a data structure figure which shows an example of the audio | voice advertisement holding | maintenance part of FIG. FIG. 5 is a data structure diagram illustrating an example of a voice information holding unit in FIG. 4. It is a data structure figure which shows an example of the user information holding | maintenance part of FIG. FIG. 5 is a data structure diagram illustrating an example of a session information holding unit in FIG. 4. It is a flowchart which shows the flow of a series of processes in the management server of FIG. It is a typical top view of a user's room. It is a schematic diagram which shows the structure of the voice operation system which concerns on 3rd Embodiment. It is a schematic diagram which shows the structure of the voice operation system which concerns on 4th Embodiment. It is a block diagram which shows the function and structure of the management server of FIG. It is a data structure figure which shows an example of the user information holding | maintenance part of FIG.

  Hereinafter, the same or equivalent components, members, and processes shown in the drawings are denoted by the same reference numerals, and repeated description is appropriately omitted. In addition, in the drawings, some of the members that are not important for explanation are omitted.

(First embodiment)
In the audio advertisement distribution system according to the first embodiment, the user can perform, for example, the following work using the smart speaker.
・ Simple research ・ Check weather forecast ・ Listen to news ・ Set alarm ・ Check schedule ・ Calculate ・ Play music ・ Control smart home appliances.
The voice advertisement distribution system acquires the user's utterance through the microphone of the smart speaker, and the user recognizes the utterance as a voice so that the user can recognize the voice content (for example, search result, weather forecast, news, schedule, calculation result, music, etc.). Understand that you are requesting delivery. The system prepares the requested audio content and distributes it to the smart speaker. At this time, the audio advertisement is distributed to the audio speaker so that the audio advertisement is played before the audio content is played on the smart speaker. Insert into content.

  This voice advertisement is, for example, a voice advertisement tailored to the audio content to be distributed, a voice advertisement based on the content of the previous conversation, or the sound around the smart speaker collected by the smart speaker immediately before the distribution of the audio content. It may be a voice advertisement based on.

  The length of the voice advertisement may be adjusted according to the situation of interaction with the user and the situation around the smart speaker. As a mode of adjustment, for example, the length of the voice advertisement may be adjusted according to the content of the audio content to be distributed, or an important part of the voice advertisement may be extracted.

  When the voice advertisement is played, the user is more effective when the user is around the smart speaker, and when the voice advertisement is output when the user is talking to the smart speaker or another user, the user It may be determined taking into account that it may feel uncomfortable. For example, the voice advertisement may be played only when it is determined that there is a user around the smart speaker. The voice advertisement may not be reproduced when the user is talking to another user or speaking to the smart speaker. In the latter case, the output of the voice advertisement may be started or resumed when the user stops speaking. The voice advertisement may be output in cooperation with another electronic device, for example, a television (hereinafter referred to as TV). For example, after the advertisement is broadcast on the TV, the follow-up report may be output from the smart speaker by voice. In this case, the next TV advertisement may be muted. Alternatively, a related advertisement may be played on the TV after the voice advertisement is reproduced on the smart speaker.

  The voice advertisement distribution system has a function of acquiring a voiceprint from a user's utterance acquired via a smart speaker and performing user authentication by voiceprint authentication. The voice advertisement distribution system is linked with other services such as a web service and SNS, and can associate an authenticated user in the voice advertisement distribution system with a user account in another service. In this case, the voice advertisement distribution system may select a voice advertisement associated with the authenticated user's account for the authenticated user. For example, the voice advertisement distribution system may select a voice advertisement based on information collected by a smart speaker and an account attribute. Further, the voice advertisement distribution system may update the account attribute with information collected by the smart speaker.

  FIG. 1 is a schematic diagram showing a configuration of a voice advertisement distribution system 2 according to the first embodiment. The voice advertisement distribution system 2 includes a management server 4, a smart speaker 10, and a TV 12. The management server 4, the smart speaker 10, and the TV 12 are communicably connected via a network 6 such as the Internet. Both the smart speaker 10 and the TV 12 are installed in the room 14 of the user 8. The smart speaker 10 is a speaker having a microphone and a communication function. The smart speaker 10 is connected to the network 6 as described above, and is configured to be capable of P2P (Peer to Peer) communication 16 with the TV 12. Although FIG. 1 shows an example in which the smart speakers 10 and the management server 4 communicate, the number of smart speakers 10 is not limited, and the number of users 8 is not limited.

  The user 8 represents a delivery request for audio contents such as “I want to listen to something by Taro Komura”, “Tell me today's news”, “What is the weather tonight”, “Tell me about Izumo Taisha”, etc. Speak a sentence toward the smart speaker 10. The microphone of the smart speaker 10 converts the voice uttered by the user 8 into an electrical signal, and the smart speaker 10 transmits the electrical signal obtained as a result of the conversion to the management server 4 via the network 6 as an audio signal. The management server 4 understands what kind of audio content is requested by the user by performing voice recognition processing on the received voice signal. The management server 4 generates distribution information in which an audio advertisement is attached to the requested audio content, and transmits the distribution information to the smart speaker 10 via the network 6. When the smart speaker 10 receives the distribution information, the smart speaker 10 first outputs an audio advertisement, and then outputs audio content.

  The smart speaker 10 may or may not include a display, but the content distributed from the management server 4 is not a content in which an image such as a still image or a moving image and sound are integrated, but is accompanied by an image. There is no audio content (or content consisting only of audio). Similarly, the voice advertisement is a voice advertisement without an image.

  FIG. 2 is a block diagram showing the function and configuration of the smart speaker 10 of FIG. Each block shown here can be realized by hardware and other elements such as a computer CPU and a mechanical device, and software can be realized by a computer program or the like. Draw functional blocks. Therefore, it is understood by those skilled in the art who have touched this specification that these functional blocks can be realized in various forms by a combination of hardware and software.

  The smart speaker 10 includes a speaker 102, a microphone 104, a communication unit 106, an input unit 108, and a processing unit 110. The communication unit 106 functions as an interface in communication with the network 6 and also functions as an interface in the P2P communication 16. The input unit 108 includes physical input mechanisms such as a power button and a volume control button. The processing unit 110 controls the speaker 102, the microphone 104, the communication unit 106, and the input unit 108 to realize various functions of the smart speaker 10.

  In the present embodiment, it is assumed that the microphone 104 converts the user's utterance into an audio signal, the communication unit 106 transmits the audio signal to the management server 4, and the management server 4 performs voice recognition processing on the audio signal. Yes. However, even when at least a part of voice recognition processing is performed on the smart speaker, when audio content acquisition processing and voice advertisement selection processing described later are performed on the smart speaker, or when the smart speaker is stand-alone. The technical idea of the embodiment can be applied. Note that both sending the result of speech recognition performed by the smart speaker to the management server and sending the voice signal from the smart speaker to the management server as they are, the voice information corresponding to the user's utterance is sent to the management server. It can be said to send.

  FIG. 3 is a hardware configuration diagram of the management server 4 of FIG. The management server 4 includes a memory 130, a processor 132, a communication interface 134, a display 136, and an input interface 138. These elements are each connected to the bus 140 and communicate with each other via the bus 140.

  The memory 130 is a storage area for storing data and programs. Data and programs may be stored permanently in the memory 130 or may be temporarily stored. The processor 132 implements various functions in the management server 4 by executing a program stored in the memory 130. The communication interface 134 is an interface for transmitting / receiving data to / from the outside of the management server 4. For example, the communication interface 134 includes an interface for accessing the network 6. The display 136 is a device for displaying various information, and is, for example, a liquid crystal display or an organic EL (Electroluminescence) display. The input interface 138 is a device for receiving input from the user. The input interface 138 includes, for example, a mouse, a keyboard, and a touch panel provided on the display 138.

  FIG. 4 is a block diagram showing the function and configuration of the management server 4 of FIG. Each block shown here can be realized by hardware and other elements such as a computer CPU and a mechanical device, and software can be realized by a computer program or the like. Draw functional blocks. Therefore, it is understood by those skilled in the art who have touched this specification that these functional blocks can be realized in various forms by a combination of hardware and software.

  The management server 4 includes an audio content holding unit 402, an audio advertisement holding unit 404, an audio information holding unit 406, a user information holding unit 408, a session information holding unit 410, an audio signal receiving unit 412, and a voice recognition unit. 414, a user authentication unit 416, a session management unit 418, a content acquisition unit 420, an advertisement selection unit 422, an advertisement adjustment unit 424, a transmission information generation unit 426, a transmission unit 428, and a timing control unit 430. And an attribute updating unit 432.

  FIG. 5 is a data structure diagram showing an example of the audio content holding unit 402 of FIG. The audio content holding unit 402 holds a content ID that specifies audio content, a keyword that characterizes the audio content, and data of the audio content in association with each other. Other metadata such as tags may be used in addition to or instead of keywords.

  The data held in the audio content holding unit 402 may be data generated and registered by the management server 4 in advance or upon request. A known speech synthesis technique may be used when creating audio content data. Alternatively, the data held in the audio content holding unit 402 may be data that the management server 4 acquires from a server of another service in advance or upon request.

  FIG. 6 is a data structure diagram showing an example of the voice advertisement holding unit 404 of FIG. The voice advertisement holding unit 404 holds an advertisement ID that identifies a voice advertisement, a keyword that characterizes the voice advertisement, a voice advertisement attribute, and voice advertisement data in association with each other. Other metadata such as tags may be used in addition to or instead of keywords. The data held in the voice advertisement holding unit 404 may be data received from the advertiser by the entity operating the management server 4.

  FIG. 7 is a data structure diagram showing an example of the audio information holding unit 406 of FIG. The voice information holding unit 406 holds voice information acquired via the microphone 104 of the smart speaker 10. The voice information includes the user's utterance content obtained by voice recognition of a voice signal by a voice recognition unit 414 described later. The voice information holding unit 406 holds a user ID for identifying the user, a session ID of the interactive session between the smart speaker 10 and the user, and the utterance content of the user or the system in the interactive session in association with each other. The voice information holding unit 406 holds a system-specific ID as a user ID corresponding to the utterance content of the system.

  FIG. 8 is a data structure diagram illustrating an example of the user information holding unit 408 of FIG. The user information holding unit 408 includes a user ID, user voiceprint data, an account ID that identifies a user account in another service, an attribute of the account, and an NG advertisement ID that identifies an advertisement that the user feels uncomfortable. Are stored in association with each other. The voiceprint data may be acquired when the user first registers in the voice advertisement distribution system 2.

  FIG. 9 is a data structure diagram illustrating an example of the session information holding unit 410 of FIG. The session information holding unit 410 holds the state of the current interactive session between the smart speaker 10 and the user. The session information holding unit 410 holds the user ID of the user related to the currently existing or maintained interactive session, the session ID of the interactive session, and the state of the interactive session in association with each other. The state of the conversation session is “speaking” indicating that the user is speaking, “conversing” indicating that the user is talking to other users, Or “waiting for utterance” waiting for the next utterance by the system. When it is determined that the interactive session has ended, the entry related to the interactive session is deleted from the session information holding unit 410. That is, when the session ID of a certain interactive session is registered in the session information holding unit 410, it is determined that the interactive session is ongoing and the user related to the interactive session is around the smart speaker 10.

  Returning to FIG. 4, the audio signal reception unit 412 receives an audio signal representing the user's utterance content from the smart speaker 10 via the network 6. As described above, the audio signal is an electric signal obtained by converting the user's uttered voice by the microphone 104, and particularly an electric signal representing a waveform of the voice. The content of the utterance includes a question / response to the smart speaker 10 (or the voice advertisement distribution system 2), a single word, and a conversation with another user.

  The voice recognition unit 414 performs a predetermined voice recognition process on the voice signal received by the voice signal reception unit 412. The voice recognition unit 414 derives the user's utterance content from the voice signal by voice recognition. The voice recognition processing in the voice recognition unit 414 may be realized using a known voice recognition technique using an n-gram or a hidden Markov model.

  The user authentication unit 416 extracts or acquires a voiceprint from the audio signal received by the audio signal reception unit 412. The user authentication unit 416 performs user authentication based on the extracted voice print (ie, voice print authentication). The user authentication unit 416 refers to the user information holding unit 408 and determines whether there is a voice print that matches the extracted voice print in the voice print held in the user information holding unit 408. If there is a matching voice print, the user authentication unit 416 specifies a user ID corresponding to the voice print, and associates the specified user ID with the utterance content derived by the voice recognition unit 414. In this case, the user who has made an utterance corresponding to the audio signal received by the audio signal receiving unit 412 is authenticated by the management server 4. If there is no matching voiceprint, the user authentication unit 416 generates an output indicating no match or user unknown. The management server 4 may start a new user registration in response to this output.

  The session management unit 418 manages an interactive session between the smart speaker 10 and the user. The session management unit 418 manages the audio information holding unit 406 and the session information holding unit 410. The session management unit 418 associates the user ID and utterance content associated by the user authentication unit 416 with the session ID that identifies the interactive session between the smart speaker 10 and the user and registers the associated information in the voice information holding unit 406.

  The session management unit 418 determines the state of the current interactive session between the smart speaker 10 and the user based on the user ID and the utterance content associated by the user authentication unit 416. The session management unit 418 updates the session information holding unit 410 in the determined state. For example, when the analysis result of the utterance content indicates that the utterance is in the middle of the utterance, the session management unit 418 determines that the current conversation session state is “in utterance”. When the analysis result of the utterance content indicates the end of the utterance, the session management unit 418 determines the current conversation session state as “waiting for utterance”. When the analysis result of the utterance content indicates the end of the conversation session (for example, when the utterance content is a word indicating the end of the conversation session such as “Tane” or “Bye Bye”), the session management unit 418 Are deleted from the session information holding unit 410. The session management unit 418 may delete, from the session information holding unit 410, a conversation session for which a predetermined period has elapsed in the “waiting for utterance” state. Here, the state of the conversation session is determined based on the utterance content, but instead of the utterance content or in addition to the utterance content, the state of the conversation session may be determined from imaging information from a separately provided camera. Good. The camera here may be arranged in the smart speaker 10 itself, a separate camera having a communication function may be used separately, or a television having a camera function or a computer having a camera function may be used separately. .

  The content acquisition unit 420 acquires the requested audio content from the audio content holding unit 402 when the utterance content derived by the audio recognition unit 414 includes an audio content distribution request. For example, when the content of the utterance is a distribution request for music content such as “I want to listen to something by Taro Komura”, the content acquisition unit 420 acquires the requested music content from the audio content holding unit 402. Alternatively, the content acquisition unit 420 may access the server of the music distribution service and acquire the requested music content from the server together with the metadata. In this case, the content acquisition unit 420 may register the acquired music content and metadata in the audio content holding unit 402.

  When the content of the utterance is an information content distribution request such as “Tell me today's news” or “What is the weather tonight?”, The content acquisition unit 420 acquires the requested information content from the audio content holding unit 402. . Alternatively, the content acquisition unit 420 may access the server of the information distribution service and acquire the requested information content from the server together with the metadata in text format. In this case, the content acquisition unit 420 may convert the acquired information content in the text format into audio data by using a predetermined speech synthesis process. The content acquisition unit 420 may register the information content and metadata that have become audio data in the audio content holding unit 402. The voice synthesis process may be realized using a known voice synthesis technique.

  When the utterance content is a search result distribution request such as “Tell me about Izumo Taisha”, the content acquisition unit 420 acquires the requested search result from the audio content holding unit 402. Alternatively, the content acquisition unit 420 may access a search service server and acquire a requested search result from the server together with metadata in a text format. In this case, the content acquisition unit 420 may convert the acquired text format search result into audio data by using a predetermined speech synthesis process. The content acquisition unit 420 may register the search results and metadata that have become audio data in the audio content holding unit 402.

  The advertisement selection unit 422 selects an audio advertisement to be attached to the audio content acquired by the content acquisition unit 420 from the audio advertisement holding unit 404. The criteria for selecting an audio advertisement in the advertisement selection unit 422 are (1) relevance with the content of the audio content acquired by the content acquisition unit 420, and (2) the smart speaker 10 held in the audio information holding unit 406. Any or any combination of the relevance to the user's utterance content in the current interactive session with the user, and (3) the relevance to the attribute of the authenticated user's account.

  For example, with respect to (1), in response to a search result distribution request “Tell me about Izumo Taisha”, the content acquisition unit 420 acquires audio data of audio content “Izumo Taisha is old ...”. The advertisement selection unit 422 acquires from the audio content holding unit 402 the keyword “Izumo Taisha, God, Marriage” corresponding to “Izumo Taisha is old ...” acquired by the content acquisition unit 420. The advertisement selection unit 422 refers to the voice advertisement holding unit 404 and wants to travel to “Izumo Taisha Shrine” having the keyword “Izumo Taisha Shrine, matchmaking” corresponding to the acquired keyword “Izumo Taisha Shrine, matchmaking” ABC travel Select the audio data for the voice advertisement that says "I'm consulting the person." As described above, the advertisement selection unit 422 selects the audio advertisement corresponding to the content of the audio content acquired by the content acquisition unit 420 by comparing the keyword of the audio content and the keyword of the audio advertisement.

For example, for (2), between the smart speaker 10 and the user (user)
(Smart speaker 10) “In time”
(User) “What ’s the weather tonight?”
It is assumed that the dialogue In response to the information content distribution request “What is the weather tonight?”, The content acquisition unit 420 acquires the audio data of the audio content “the weather in the C region tonight is showers, the temperature is ...”. The advertisement selection unit 422 refers to the voice information holding unit 406 and identifies “Does it take a taxi to the station?” As the user's utterance content in the current dialogue session between the smart speaker 10 and the user. The advertisement selection unit 422 extracts the keyword “station, taxi” from the specified utterance content “Tax to station? The advertisement selection unit 422 refers to the voice advertisement holding unit 404, and obtains voice data of the voice advertisement “ZZZ taxi dispatch service coming soon” having the keyword “taxi, dispatch” corresponding to the extracted keyword “station, taxi”. select. Thus, by referring to the voice information holding unit 406, the advertisement selection unit 422 can select a voice advertisement based on the user's utterance content in the current conversation session between the smart speaker 10 and the user.

  When the criterion (1) is used instead of (2) in the above example, the advertisement selection unit 422 corresponds to “Tonight's weather in the C region is showers and temperatures are ...” acquired by the content acquisition unit 420. The keyword “C region, rain, low temperature” is acquired from the audio content holding unit 402. The advertisement selecting unit 422 refers to the voice advertisement holding unit 404, and has the keyword “umbrella, rain” corresponding to the acquired keyword “C region, rain, low temperature”. ”Is selected. Thus, even if the content of the dialogue between the smart speaker 10 and the user is the same, the voice advertisement selected may differ depending on the criteria used.

  For example, with regard to (3), in response to a request for distribution of information content “Tell me today's news”, the content acquisition unit 420 “sounds about a fire in A city, B city around 6 o'clock this morning…” Voice data is acquired. In addition, the user who speaks “Tell me today's news” is authenticated by voiceprint authentication in the user authentication unit 416, and the user ID “B102” of the user is specified. The advertisement selecting unit 422 acquires the attribute “child, male, single” of the account corresponding to the specified user ID “B102” from the user information holding unit 408. The advertisement selection unit 422 refers to the voice advertisement holding unit 404 and has the attribute “children, men,” corresponding to the acquired attribute “children, men, single” and “speaking SL when you come to F city”. Select the audio data for the ad. If the attribute of the account corresponding to the identified user ID “B102” is “adult, female, single”, the advertisement selecting unit 422 refers to the voice advertisement holding unit 404 and attributes corresponding to the attribute. The voice data of the voice advertisement “I want to travel to Izumo Taisha? If so, consult ABC Travel Agency” with “Single, Adult” is selected. In this way, by comparing the attribute of the authenticated user account with the attribute of the voice advertisement, the advertisement selection unit 422 selects the voice advertisement corresponding to the attribute of the authenticated user account.

  Alternatively, if the attribute of the account corresponding to the specified user ID “B102” is “adult, male, married”, the advertisement selection unit 422 first selects “XX precious metal ring for a Christmas present” corresponding to the attribute. "I recommend it to XYZ Fire and Marine Insurance for fire insurance", "ZZZ taxi dispatch service coming soon", "I want to travel to Izumo Taisha? Then consult ABC Travel Agency" Is selected as a candidate. Further, the advertisement selection unit 422 receives the keyword “A prefecture, B city, fire” corresponding to “There is a fire in A city and B city around 6 o'clock this morning” acquired by the content acquisition unit 420 as an audio content holding unit. From 402. The advertisement selection unit 422 has the keyword “fire, fire, insurance” corresponding to the acquired keyword “A prefecture, city B, fire” among the four selected candidates. Select the voice data of the voice advertisement " In this way, a combination of the criterion (1) and the criterion (3) in the form of selecting candidates based on the criterion (3) and narrowing down based on the criterion (1) is also possible.

For example, between the smart speaker 10 and the user (user) “I want to listen to something by Taro Komura”
(Smart speaker 10) “How about Christmas songs?”
(User) “So then, then”
It is assumed that the dialogue In response to a distribution request for music content “I want to listen to something by Taro Komura”, the content acquisition unit 420 acquires the audio data of Taro Komura's Christmas song. The management server 4 inquires of the user via the smart speaker 10 whether the Christmas song is acceptable. When the management server 4 receives an affirmative response “Okay, then”, the management server 4 attaches a voice advertisement to the acquired voice data of Taro Komura's Christmas song and transmits it to the smart speaker 10. Here, the advertisement selection unit 422 is a keyword corresponding to the Taro Komura Christmas song acquired by the content acquisition unit 420 “Taro Komura (Lyrics / Composition), Oto Anime (Theme Song), Samurai Movie (Insertion Song), Christmas Song, “Ring” is acquired from the audio content holding unit 402. The advertisement selection unit 422 refers to the voice advertisement holding unit 404 and searches for keywords corresponding to the acquired keywords “Taro Komura (song writing composition), Oto anime (theme song), 丙 movie (insert song), Christmas song, ring”. “Otome anime, airing from 6pm on Friday!” (Keyword: “Otome anime, Friday, 6pm”) and “If you have a Christmas gift, XX precious metal rings are recommended” (keyword: “Christmas, Two voice advertisements of “present, ring”) are selected as candidates. Further, the advertisement selection unit 422 acquires the attribute “adult, male, married” of the account corresponding to the user ID “A101” of the user authenticated by voiceprint authentication from the user information holding unit 408. The advertisement selection unit 422 has an attribute “adult” corresponding to the acquired attribute “adult, male, married” of the two selected candidates, and “XX precious metal ring is recommended for Christmas presents” Select the audio data. If the user ID of the user authenticated by voiceprint authentication is “A105”, the advertisement selection unit 422 selects the attribute “children, women, single” corresponding to the acquired attribute “children, women, single” from the two selected candidates. The voice data of the voice advertisement “Otome Anime, being broadcast from 6 pm Friday!” Having “Women, Children” is selected. In this way, a combination of the criterion (1) and the criterion (3) in which candidates are selected based on the criterion (1) and narrowed down based on the criterion (3) is also possible.

Also, the combination of the standard (1) and the standard (2), the combination of the standard (2) and the standard (3), and the combination of the three standards (1), (2) and (3) Is possible.
Alternatively, in addition to the criteria of (1), (2), and (3), the voice advertisement may be selected based on the surrounding sound of the smart speaker 10 collected by the smart speaker 10 or the conversation between users. . For example, when the smart speaker 10 is picking up a conversation between the user and another user such as “I don't have tissue paper” or “Yes, let's rely on the EC site”, the advertisement selection unit 422 The keyword “tissue paper” may be extracted from the conversation content, and an audio advertisement that promotes the extracted “tissue paper” may be selected. Further, for example, when the smart speaker 10 picks up the cry of a dog or cat, the advertisement selection unit 422 identifies the keyword “dog, cat” from the cry, and the dog food related to the identified “dog, cat”. Or a voice advertisement that promotes cat food may be selected.

  The advertisement adjustment unit 424 determines whether to adjust the length of the voice advertisement selected by the advertisement selection unit 422. When it is determined that adjustment is to be made, the advertisement adjustment unit 424 extracts a part (for example, a relatively important part) from the voice advertisement by applying a predetermined extraction algorithm to the selected voice advertisement. The advertisement adjustment unit 424 determines whether to adjust the length of the audio advertisement based on the content of the audio content acquired by the content acquisition unit 420 and / or the state of the current interactive session between the smart speaker 10 and the user. May be.

  For example, the advertisement adjustment unit 424 refers to the session information holding unit 410 and determines that adjustment is made when the state of the session corresponding to the selected voice advertisement is “conversation”, and does not adjust if the state is “waiting for utterance”. May be determined. Alternatively, the advertisement adjustment unit 424 may determine the length of the audio advertisement based on the content of the audio content acquired by the content acquisition unit 420. For example, the advertisement adjustment unit 424 may determine the length of the voice advertisement according to the playback time of the voice content. For relatively long audio content, the audio advertisement may be played multiple times. In addition, for example, when the audio content is information content such as news or weather forecast, the advertisement adjustment unit 424 may determine that the user wants to adjust because the user is more likely to obtain desired information sooner.

  The technology that extracts the important part of the voice advertisement, such as the part where the person is speaking, the part where the person is speaking with a loud sound, and the part where the background sound becomes louder is known. ing. The predetermined extraction algorithm may be configured using this known technique. Note that the advertisement adjustment unit 424 may adjust the volume of the voice advertisement in addition to or instead of the length of the voice advertisement.

  The transmission information generation unit 426 generates one transmission information by combining the audio content acquired by the content acquisition unit 420 and the audio advertisement selected by the advertisement selection unit 422. When the length of the voice advertisement is adjusted by the advertisement adjustment unit 424, the voice advertisement whose length is adjusted by the advertisement adjustment unit 424 is used instead of the voice advertisement selected by the advertisement selection unit 422. The transmission information generation unit 426 configures the transmission information so that when the transmission information is received and reproduced by the smart speaker 10, the reproduction of the audio advertisement is temporally before the reproduction of the audio content. For example, when the transmission information includes a header, audio content, and audio advertisement, the transmission information generation unit 426 may generate the transmission information so that the header, the audio advertisement, and the audio content are arranged in this order.

  The transmission unit 428 transmits the transmission information generated by the transmission information generation unit 426 to the smart speaker 10 via the network 6. When the smart speaker 10 receives the transmission information via the network 6, the smart speaker 10 first reproduces the audio advertisement included in the transmission information and then reproduces the audio content included in the transmission information. Alternatively, the timing control unit 430 described later may control the output of sound from the smart speaker 10 via the network 6. In this case, the timing control unit 430 causes the smart speaker 10 to first output the audio advertisement included in the transmission information and then output the audio content included in the transmission information. In any case, the audio advertisement and the audio content are continuously played back. That is, there is no other audio between the audio advertisement and the audio content. In particular, the audio advertisement is played immediately before the audio content.

  Alternatively, the audio advertisement may be embedded in the middle of the audio content, or the audio advertisement may be output after the audio content is output.

  The timing control unit 430 communicates with the smart speaker 10 via the network 6 and controls the timing of audio output from the smart speaker 10. The timing control unit 430 refers to the session information holding unit 410 and determines whether there is a user around the smart speaker 10. The timing control unit 430 determines that a user exists around the smart speaker 10 or detects the presence of the user when the session ID of the interactive session between the smart speaker 10 and the user is held in the session information holding unit 410. To do. The timing control unit 430 determines that there is no user around the smart speaker 10 when such a session ID is not held in the session information holding unit 410.

  When the presence of the user is not detected around the smart speaker 10, the timing control unit 430 indicates that the conversation session state between the smart speaker 10 and the user held in the session information holding unit 410 is “speaking” or “ When “conversation” is set, the output of the voice advertisement from the smart speaker 10 is restricted. When the presence of the user is detected, the timing control unit 430 permits the output of the voice advertisement from the smart speaker 10. The timing control unit 430 permits the output of the voice advertisement from the smart speaker 10 when the state of the conversation session is changed to “waiting for utterance”.

  The timing control unit 430 controls the output timing of the audio advertisement so that the output of the TV 12 associated with the smart speaker 10 and the audio advertisement output from the smart speaker 10 cooperate with each other. For example, the timing control unit 430 may start outputting a voice advertisement saying “This product introduced on the TV is…” from the smart speaker 10 at the timing when the advertisement “Continue with the speaker!” Has flowed from the TV 12. The smart speaker 10 is controlled. In this case, the timing control unit 430 acquires the number of the channel currently being broadcast from the TV 12 via the network 6. The timing control unit 430 obtains a broadcast schedule from a server of another service in advance. The timing control unit 430 can specify the content of the advertisement played on the TV 12, the start timing, and the end timing from the acquired channel number and the broadcast schedule. The timing control unit 430 selects an audio advertisement related to the specified content from the audio advertisement holding unit 404 and transmits it to the smart speaker 10 (which may or may not be associated with the audio content). The timing control unit 430 controls the smart speaker 10 to start the output of the transmitted voice advertisement at the end timing of the advertisement played on the TV 12.

  The attribute update unit 432 updates the attribute of the user account with the voice information collected by the smart speaker 10. For example, when the account ID shown in the user information holding unit 408 of FIG. 8 is that of the search service account, this account ID is given to the user who visited the search service site. The attribute of the user's account is derived from the information about what the user is searching for, and is registered as the attribute of the user information holding unit 408 in FIG.

  On the other hand, the management server 4 can grasp the user's preference by analyzing the content of the conversation between the smart speaker 10 and the user and the content of the conversation between the user and another user. The attribute update unit 432 updates the attribute of the user information holding unit 408 with the preference grasped through the smart speaker 10 in this way. The attribute update unit 432 may provide the update content in association with the account ID to the server of the search service. Accordingly, the search service can obtain user preferences that have not been obtained by the search service so far, and can optimize advertisement output of the browser by using the preferences obtained in this way. Note that the user's preferences and attributes obtained via the smart speaker 10 and the preferences and attributes grasped by the search service may be held in an identifiable manner. As a result, it is possible to cope with a case where a voice advertisement is selected using only one preference or attribute.

  In addition, when the voice advertisement is output from the smart speaker 10, the attribute update unit 432 determines whether a direct or indirect expression of no interest from the user is received via the smart speaker 10. When received, the attribute updating unit 432 registers the corresponding output advertisement ID of the voice advertisement in the user information holding unit 408 as the NG advertisement ID in association with the user ID of the user. When selecting the voice advertisement, the advertisement selection unit 422 refers to the user information holding unit 408 and selects the voice advertisement specified by the NG advertisement ID held corresponding to the user ID of the authenticated user from the selection target. except. The advertisement selection unit 422 may exclude the successor voice advertisement of the voice advertisement specified by the NG advertisement ID from the selection target. The advertisement selection unit 422 may exclude a voice advertisement corresponding to or having the same attribute or keyword as the attribute or keyword of the voice advertisement specified by the NG advertisement ID from the selection target.

The operation of the management server 4 having the above configuration will be described.
FIG. 10 is a flowchart showing a flow of a series of processes in the management server 4 of FIG. The management server 4 receives an audio signal representing a delivery request for audio content from the smart speaker 10 via the network 6 (S302). The management server 4 performs a voice recognition process on the received voice signal (S304), thereby specifying the requested voice content. The management server 4 acquires the requested audio content from the audio content holding unit 402 or from the outside (S306). The management server 4 selects a voice advertisement from the voice advertisement holding unit 404 (S308). The management server 4 determines whether or not the length of the selected voice advertisement needs to be adjusted (S310). If it is determined that it is necessary (YES in S310), the management server 4 adjusts the length of the voice advertisement (S312). The management server 4 uses the audio content acquired in step S306 and the audio advertisement selected in step S308 (in the case of NO in step S310) or the audio advertisement whose length is adjusted in step S312 (in the case of YES in step S310). ) And transmission information is generated based on (S314). The management server 4 transmits the generated transmission information to the smart speaker 10 via the network 6 (S316). The management server 4 determines whether or not the current timing is suitable for outputting a voice advertisement (S318). If the timing is appropriate (YES in S318), the management server 4 first causes the smart speaker 10 to output an audio advertisement (S320), and then causes the audio content to be output (S322).

  In the embodiment described above, examples of the holding unit are a hard disk and a semiconductor memory. Further, based on the description of the present specification, each unit is configured by a CPU (not shown), a module of an installed application program, a module of a system program, a semiconductor memory that temporarily stores the content of data read from the hard disk, or the like. It will be appreciated by those skilled in the art who have touched this specification that this can be achieved.

  According to the management server 4 according to the present embodiment, the audio advertisement is reproduced in accordance with the reproduction of the audio content on the smart speaker 10. Thereby, it is possible to provide an audio advertisement in accordance with the distribution of the audio content. In the present embodiment, the audio advertisement is reproduced before the audio content is reproduced. The probability that the user can hear the audio advertisement in this case is higher than that in the case where the audio advertisement is reproduced after the audio content is reproduced. Therefore, more effective advertisement can be provided.

  Further, in the management server 4 according to the present embodiment, the voice advertisement is selected based on the contents of the voice content, the voice information obtained via the smart speaker 10, and the attribute of the authenticated user account. The voice advertisement selected in this way has a high probability of being in line with the user's preference and demand. Therefore, it is possible to provide a voice advertisement with higher appeal to the user.

  In addition, in the management server 4 according to the present embodiment, the output timing of the voice advertisement from the smart speaker 10 is appropriately controlled. Therefore, it is possible to output a voice advertisement that does not interfere with the user's conversation or speech. Alternatively, it is possible to provide a voice advertisement in cooperation with other electronic devices such as the TV 12.

  In the present embodiment, the management server 4 determines whether or not child abuse is being performed by understanding the audio context in connection with the smart speaker 10 being able to acquire surrounding sounds and conversations between users. May be. The management server 4 may edit voice data related to automatic abuse and provide it to a predetermined investigation organization. The investigator can hear the entire audio data.

  In the present embodiment, a user ID is specified by voiceprint authentication by the user authentication unit 416, and an attribute corresponding to this user ID is specified by referring to the user information holding unit 408. In this case, the management server 4 may change the output mode of the audio content or the audio advertisement according to the user attribute. For example, when the user attribute is a child, the management server 4 may use simple words as much as possible in audio contents or audio advertisements, and delete or paraphrase dirty words. Alternatively, when the user attribute is an elderly person, the management server 4 may increase the volume or clarify the pronunciation in the audio content or the audio advertisement.

  In the present embodiment, the case where the user is authenticated by the user authentication unit 416 has been described. However, the present invention is not limited to this, and user authentication may not be performed. In this case, the user attribute is not reflected in the selection of the voice advertisement. Here, in the present embodiment, the operation of outputting the voice advertisement in S320 has been described. However, in addition to the output of this voice advertisement, the output status can also be stored in the management server 4. Examples of output status include “played the target ad to the end”, “the target ad was stopped halfway”, “in addition to playing the target ad, output additional information about the product targeted by the ad” It is. “The target advertisement has been played to the end” can be realized by reporting to the management server 4 that the smart speaker 10 has output the target audio data to the end. Moreover, since the management server 4 controls both the stop and the output of additional information in the middle, it can be managed naturally.

The technical idea according to the present embodiment may be expressed by the following items.
(Item 1)
A function of accepting a distribution request via a network from a microphone and a speaker having a communication function;
In response to the received distribution request, a function for acquiring audio content without an image,
A function for selecting a voice advertisement without an image from the voice advertisement holding means;
A computer program for causing a server to realize a function of transmitting the acquired audio content and a selected audio advertisement to the speaker via the network.
(Item 2)
Receiving a distribution request from a microphone and a speaker having a communication function via a network;
In response to the received distribution request, acquiring audio content without an image,
Selecting a voice advertisement without an image from the voice advertisement holding means,
Transmitting the acquired audio content and the selected audio advertisement together to the speaker over the network.

(Second Embodiment)
In the second embodiment, a plurality of smart speakers are arranged at different positions in a certain real space, and each of them is connected via a management server and a network similar to the management server 4 of the first embodiment. Connected.

  FIG. 11 is a schematic top view of the room 202 of the user 204. In this room 202, a fixed first smart speaker 208, a fixed second smart speaker 210, a fixed third smart speaker 212, a fixed fourth smart speaker 214, and a movable fifth smart speaker 216. And TV 206 are arranged. Each smart speaker communicates with the management server via a network. In FIG. 11, five smart speakers are shown, but the number of smart speakers is not limited. Each smart speaker may be installed on the wall, floor, or ceiling of the room 202.

(1) Automatic determination of smart speaker position The management server records and manages the position of each smart speaker in the room 202. This position may be registered in the management server 4 by the user 204. Alternatively, the management server may automatically determine the position of each smart speaker using the microphones and speakers of the five smart speakers.

  The management server determines the relative position between the smart speakers when another smart speaker 10 detects the sound output from one smart speaker. For example, when the positions of the second smart speaker 210, the third smart speaker 212, and the fourth smart speaker 214 are known, and the position of the first smart speaker 208 is determined, the management server sets the first smart speaker 208 as the speaker. A sound pulse having a predetermined wavelength is output. The management server acquires the time at which a sound pulse having a predetermined wavelength is received from each of the second smart speaker 210, the third smart speaker 212, and the fourth smart speaker 214. The management server calculates the pulse propagation time from the acquired time, and calculates the distance from the calculated propagation time and sound velocity. The management server calculates the position of the first smart speaker 208 from each calculated distance and the known positions of the second, third, and fourth smart speakers 210, 212, and 214.

  The fifth smart speaker 216 is a smart speaker attached to a robot, for example, and can move by itself. When the positions of the first, second, third, and fourth smart speakers 208, 210, 212, and 214 are known, the management server can track the position of the fifth smart speaker 216 by the position calculation process described above. . Further, the fifth smart speaker 216 may move to a position where it can easily receive the sound emitted by the smart speaker when the position of another smart speaker is determined based on its own position.

  As a component of the system shown in FIG. 11, a smart speaker or a smartphone equipped with both a microphone and a speaker is desirable. However, in general, a television, radio, or other electrical device having only a speaker also has a speaker, so that sound reproduction is possible. Can be supported. There are also electrical devices with a communication function. As a result, speaker output from a plurality of positions is possible. The position where the electric device is arranged may be notified by the user setting the management server, or the management server may automatically determine the position calculation processing described above or by radio communication radio waves.

(2) Use of movable smart speaker In audio output, the way the target user hears may change depending on the position of the speaker. Therefore, the management server may perform control to move the fifth smart speaker 216 to a position where sound can be heard more appropriately.

  Further, the TV 206 or the like generally does not have a microphone function, and therefore cannot participate in the position calculation process as it is. However, when the fifth smart speaker 216 moves to the position of the TV 206 and substitutes for the microphone function of the TV 206, the TV 206 can also participate in the position calculation process.

(3) Audio output according to the position of the user When the position of each smart speaker is known, if the position of the user 204 is known, the smart speaker closest to the user 204 can be specified. When the user 204 utters a voice output request such as “turn on the television”, the five smart speakers convert the utterance into a voice signal and transmit it to the management server. The management server performs voice recognition processing on the voice signal and understands the voice output request of the user 204. The management server specifies a smart speaker corresponding to the position of the user 204 in the room 202. In particular, the management server identifies the second smart speaker 210 that is closest to the position of the user 204. At this time, the management server compares the volume when the microphone of each smart speaker receives the user's speech, and specifies the second smart speaker 210 having the highest volume as the smart speaker closest to the position of the user 204. Alternatively, when the user 204 uses a smartphone, the management server can specify the position of the user 204 by acquiring the current position of the smartphone.

  The management server transmits the audio accompanying the video streamed by the TV 206 to the second smart speaker 210 specified as described above. In this way, the user 204 can receive the audio output of the TV 206 from the second smart speaker 210 closest to him / her.

  Alternatively, when the speaker of the smart speaker has directivity, the management server may control the directivity. For example, when the speakers of the first, second, third, and fourth smart speakers 208, 210, 212, and 214 have output directivity, the management server causes the sound output of each speaker to face the position of the user 204. Control each smart speaker. The management server transmits the audio accompanying the video streamed on the TV 206 to each smart speaker. In this case, each smart speaker outputs sound toward the user 204.

  Note that the smart speaker having directivity may be shown to the user in a manner in which the current direction of audio output can be visually recognized. For example, an arrow indicating directivity may be displayed on the top surface of the smart speaker with an LED or the like.

  According to this example, for example, when a user who has instructed the content reproduction to the smart speaker and other users are in the room 202, it is possible to output sound for the instructed user. By taking a configuration in which a server process is assigned to each user, the first smart speaker is controlled to face the position of the first user, and the second smart speaker is controlled to face the position of the second user, You may make it a 1st smart speaker and a 2nd smart speaker output an audio | voice simultaneously. A plurality of audio output devices are provided in one smart speaker, and a server process is assigned to each user in the server, so that one smart speaker is controlled, and voice directed to the position of the first user, You may make it output simultaneously the audio | voice which faces a user's position.

The technical idea according to the present embodiment may be expressed by the following items.
(Item 3)
A system including a microphone and a plurality of speakers each having a communication function,
A system configured to determine a relative position between speakers by detecting sound output from one speaker by another speaker.
(Item 4)
A server that communicates via a network with a plurality of speakers each having a microphone and a communication function, wherein the plurality of speakers are arranged at different positions in the same real space,
The server
Means for receiving a voice output request from a user in the real space via any one of the plurality of speakers;
Means for identifying a speaker corresponding to the position of the user;
Means for transmitting audio content to the identified speaker.
(Item 5)
Each of the servers communicates with a microphone and a plurality of speakers having a communication function via a network, and the plurality of speakers are arranged at different positions in the same real space,
The server
Means for receiving a voice output request from a user in the real space via any one of the plurality of speakers;
A server that controls directivity of at least one of the plurality of speakers so that sound is output toward the position of the user.

(Third embodiment)
FIG. 12 is a schematic diagram illustrating a configuration of a voice operation system 232 according to the third embodiment. The voice operation system 232 includes a management server 234, a smart speaker 240, a TV 242 and a smartphone 248. The management server 234, the smart speaker 240, the TV 242 and the smartphone 248 are communicably connected via a network 236 such as the Internet. Both the smart speaker 240 and the TV 242 are installed in the room 244 of the user 238. Smart speaker 240 is configured to be capable of P2P communication 246 with smartphone 248.

  When the TV 242 is operated by voice, the user 238 utters a sentence indicating an operation instruction such as “turn on the television” to the smart speaker 240. The microphone of the smart speaker 240 converts the voice uttered by the user 238 into an electric signal, and the smart speaker 240 transmits the electric signal obtained as a result of the conversion as an audio signal to the management server 234 via the network 236. The management server 234 understands that the user 238 requests to turn on the TV 242 by performing voice recognition processing on the received voice signal. The management server 234 generates an instruction signal for realizing the requested operation, that is, for turning on the TV 242, and transmits the instruction signal to the TV 242 via the network 236. When the TV 242 receives the instruction signal via the network 236, the TV 242 shifts from the power-off state to the power-on state.

  Thus, control and operation via the smart speaker 10 are basically performed by voice. However, when there is a user other than the user 238 in the room 244, there are also users 238 who dislike voice control. Even when only the user 238 is in the room 244, depending on the control content, it may be desired to avoid voice control. In this case, the voice operation system 232 can perform text control on the system side (management server 234) of the smart speaker 240 via the smartphone 248.

  In order to enable operation on the smartphone 248, the smartphone 248 downloads and installs an application dedicated to the management server 234. When the application is activated on the smartphone 248, the application acquires the URL of the management server 234 from the smart speaker 240 via the P2P communication 246 or the local network. The application establishes a connection with the management server 234 using the acquired URL. When the connection between the smartphone 248 and the management server 234 is established, the operation content input to the smartphone 248 is transmitted to the management server 234 through the connection. The management server 234 generates and transmits an instruction signal so as to realize the received operation content.

  For example, when the management server 234 receives a text string “Turn on TV” from the smartphone 248, the management server 234 analyzes the received text string and understands that the user 238 requests to turn on the TV 242. To do. The management server 234 generates an instruction signal for realizing the requested operation, that is, for turning on the TV 242, and transmits the instruction signal to the TV 242 via the network 236. When the TV 242 receives the instruction signal via the network 236, the TV 242 shifts from the power-off state to the power-on state.

  According to the voice operation system 232 according to the present embodiment, the user 238 can selectively use the voice operation and the operation via the smartphone 248 depending on the situation.

  In the present embodiment, a case has been described in which the management server 234 receives an operation instruction from the user 238 via the smart speaker 240 or the smartphone 248. However, the present invention is not limited to this, and for example, the management server 234 as in the first embodiment. May receive a delivery request for audio content from the user 238 via the smart speaker 240 or the smartphone 248.

The technical idea according to the present embodiment may be expressed by the following items.
(Item 6)
A server that communicates with a microphone and a speaker having a communication function via a network,
Means for processing a request received from a user via a microphone of the speaker;
Means for processing a request received from the user via another electronic device communicating with the speaker.

(Fourth embodiment)
The fourth embodiment relates to layering in the management server. In this embodiment, the server process (or server) is changed for each speaker. The server can recognize who is speaking by voiceprint authentication. The server process (or server) normally used by the target user performs processing.

  FIG. 13 is a schematic diagram illustrating a configuration of a voice operation system 252 according to the fourth embodiment. The voice operation system 252 includes a management server 254, a smart speaker 260, and a TV 262. The management server 254, the smart speaker 260, and the TV 262 are communicably connected via a network 256 such as the Internet. Smart speaker 260 and TV 262 are both installed in room 264, and there are three users (first user 266, second user 268, and third user 270) in room 264.

  When operating the TV 262 with voice, the first user 266 utters a sentence representing an operation instruction such as “turn on the television” toward the smart speaker 260. The microphone of the smart speaker 260 converts the voice uttered by the first user 266 into an electric signal, and the smart speaker 260 transmits the electric signal obtained as a result of the conversion to the management server 254 via the network 256 as an audio signal. The management server 254 performs voiceprint authentication on the received audio signal and identifies the first user 266. The management server 254 selects a server process corresponding to the identified first user 266, and the selected server process processes subsequent requests. When the TV 262 receives an instruction signal from the selected server process of the management server 254 via the network 236, the TV 262 shifts from the power-off state to the power-on state. In the management server 254, a server process different from the server process corresponding to the first user 266 is assigned to the utterances of the second user 268 and the third user 270 different from the first user 266.

  FIG. 14 is a block diagram showing the function and configuration of the management server 254 of FIG. Each block shown here can be realized by hardware and other elements such as a computer CPU and a mechanical device, and software can be realized by a computer program or the like. Draw functional blocks. Therefore, it is understood by those skilled in the art who have touched this specification that these functional blocks can be realized in various forms by a combination of hardware and software.

  The management server 254 includes a user information holding unit 272, an audio signal receiving unit 274, a user authentication unit 276, and a server process group 278. The server process group 278 includes a plurality of server processes SP1, SP2, SP3,... Each assigned to a specific user. In the following, a case where the server process is different for each user will be described. However, in another embodiment, the server itself may be different for each user. Of course, different servers have different server processes.

  FIG. 15 is a data structure diagram showing an example of the user information holding unit 272 of FIG. The user information holding unit 272 holds a user ID, user voiceprint data, and an ID of a server process assigned to the user in association with each other.

  Returning to FIG. 14, the audio signal reception unit 274 receives an audio signal representing the utterance content of any of the three users 266, 268, 270 from the smart speaker 260 via the network 256.

  The user authentication unit 276 extracts or acquires a voiceprint from the audio signal received by the audio signal reception unit 274. The user authentication unit 276 performs voiceprint authentication based on the extracted voiceprint. The user authentication unit 276 refers to the user information holding unit 272 and determines whether there is a voice print that matches the extracted voice print in the voice print held in the user information holding unit 272. If there is a matching voiceprint, the user authentication unit 276 specifies the user ID and server process ID corresponding to the voiceprint. If there is no matching voiceprint, the user authentication unit 276 generates an output indicating no match or user unknown.

  When the server process ID is specified by the user authentication unit 276, a server process having the specified server process ID among the server processes included in the server process group 278 is activated. The activated server process performs subsequent processing on the audio signal received by the audio signal receiving unit 274.

  Each server process included in the server process group 278 realizes the operation function of the electronic device as described in the third embodiment. In another embodiment, the server process may realize an audio content distribution function as described in the first embodiment, for example.

  For example, when the first user 266 is a resident living in the room 264, the authority to control the TV 262 is given to the server process of the first user 266. When the second user 268 and the third user 270 are visitors who have visited the room 264 of the first user 266, the authority to control the TV 262 is not granted to the server processes of those users. Therefore, when the second user 268 or the third user 270 performs a voice operation on the TV 262, the server process of the second user 268 or the third user 270 transmits an operation request for the TV 262 to the server process of the first user 266. The server process that has received the investigation request inquires of the first user 266 whether or not the operation can be performed, and executes the target operation if the consent can be obtained from the first user 266.

  Alternatively, the first user 266 who is the owner of the smart speaker 260 may set authority for the second user 268 and the third user 270 who are guests (visitors). For example, it is possible that the electric light can be controlled via the smart speaker 260, but the purchase at the EC site via the smart speaker 260 is impossible.

  According to the voice operation system 252 according to the present embodiment, by assigning a server process to each user, operations that can be executed, accessible information, authority, and the like can be made different for each user.

  In the present embodiment, a case has been described in which the management server 254 has a plurality of server processes, the management server 254 receives voice signals, performs voiceprint authentication, and identifies a server process to be used, but is not limited thereto. For example, when there are a plurality of servers, the voice signal from the smart speaker 260 may be transmitted to all the servers, and the voiceprint authentication may be performed by each server. Alternatively, any one user's server or server process, or any one server or server process receives an audio signal, extracts only the target user's audio signal, and forwards it to the target server or server process. May be.

  In this embodiment, the case where the first user 266 that issues an operation instruction and the TV 262 to be operated are in the same room 264 has been described. However, the present invention is not limited to this, and remote operation of the electronic device to be operated may be possible. . For example, when the second user 268 is visiting the room 264 of the first user 266, the second user 268 wants to activate the air conditioner in his / her room (different from the room 264). The second user 268 utters a sentence representing an operation instruction “turn on the air conditioner in my room” toward the smart speaker 260. The management server 254 understands the request of the second user 268 by voiceprint authentication and voice recognition. The management server 254 forwards the request of the second user 268 to another management server connected to the smart speaker in the room of the second user 268. At this time, an audio signal is attached as authentication data.

The technical idea according to the present embodiment may be expressed by the following items.
(Item 7)
A server that communicates with a microphone and a speaker having a communication function via a network,
Means for identifying a speaker by analyzing an audio signal acquired via a microphone of the speaker;
Means for performing processing relating to the voice signal using a server process assigned to the identified speaker.

  In each of the embodiments described above, the operation in cooperation with the TV or computer connected to the network is described in addition to the smart speaker. However, after the voice advertisement is output by the smart speaker, additional information is added according to the user's voice control. Can also be displayed on the television or computer. This is realized by the management server 4 sending a URL to be displayed on the television or computer at this time, and information indicating that an additional information request has been made by the smart speaker or the management server 4 in the parameters of this URL. Can also be added. Thereby, it is possible to grasp that the request is made using the management server 4 or the smart speaker on the request destination system side. Here, URL parameters are used as an example of a transmission method, but notification may be made by other methods.

  The configuration and operation of the system according to the embodiment have been described above. It is understood by those skilled in the art that these embodiments are exemplifications, and various modifications are possible for each component and combination of processes, and such modifications are also within the scope of the present invention. Combinations of the embodiments are also possible.

  2 voice advertisement distribution system, 4 management server, 6 network, 8 users, 10 smart speakers.

Claims (10)

Receiving means for receiving a distribution request from a microphone and a speaker having a communication function via a network;
An acquisition means for acquiring audio content without an image in response to the received distribution request;
A selection means for selecting a voice advertisement without an image from the voice advertisement holding means;
A server comprising: transmission means for transmitting the acquired audio content and the selected audio advertisement together to the speaker via the network.   The server according to claim 1, wherein the selection unit selects an audio advertisement corresponding to the acquired audio content from the audio advertisement holding unit.   The server according to claim 1, wherein when the speaker receives the acquired audio content and the selected audio advertisement via the network, the speaker reproduces the audio content after reproducing the audio advertisement. Voice information holding means for holding voice information acquired through the microphone of the speaker;
The server according to any one of claims 1 to 3, wherein the selection unit selects a voice advertisement based on voice information held in the voice information holding unit.   The server according to claim 4, wherein the voice information held in the voice information holding unit includes a user's utterance content in a current dialogue session between the speaker and the user. A determination means for determining whether to adjust the length of the selected voice advertisement;
The server according to any one of claims 1 to 5, wherein, when it is determined to be adjusted, the transmission unit transmits a voice advertisement whose length is adjusted.   The server according to claim 6, wherein the length-adjusted voice advertisement is a part extracted from the voice advertisement by applying a predetermined extraction algorithm to the selected voice advertisement. Control means for controlling the timing of audio output from the speaker via the network,
The said control means restrict | limits the output of the audio | voice advertisement from the said speaker, when it determines with a user's presence not being detected or when a user's conversation is continuing. Server described in. Control means for controlling the timing of audio output from the speaker via the network,
8. The control unit according to claim 1, wherein the control unit controls the output timing of the audio advertisement so that an output of another electronic device associated with the speaker and an audio advertisement output from the speaker cooperate with each other. The server according to one item. Further comprising authentication means for performing user authentication based on voice information acquired through the microphone of the speaker;
The server according to claim 1, wherein the selection unit selects a voice advertisement corresponding to an attribute of an authenticated user account from the voice advertisement holding unit.

Images