JP7136606B2 - CONTENT CONTROL DEVICE, CONTROL METHOD AND CONTROL PROGRAM - Google Patents

Description

TECHNICAL FIELD Embodiments of the present invention relate to a content control device, a control method, and a control program.

2. Description of the Related Art In recent years, with the spread of the Internet, various services for life support have been provided. For example, there is a technique for assisting a user in operating a device.

For example, Japanese Patent Laid-Open No. 2002-200000 discloses a technique for allowing a user such as a visually impaired person to learn an operation without imposing a burden on the user.

JP 2007-13469 A

However, with the conventional technology described above, even when audio content is being listened to, it is not always possible to easily control the music content. For example, the above-described prior art provides a method for easily operating a digital multi-function peripheral (MFP) that integrates the functions provided by a facsimile device, a printer device, a scanner device, and these OA devices into a single unit, even by a user such as a visually handicapped person. The operation explanation information provided by voice and related to the MPF is output-controlled in accordance with the declaration of the user so that the user can learn the operation explanation information.

In the conventional technology described above, it is assumed that the user is trying to listen carefully to the operation explanation information provided by voice. In such a case, it is not always possible to allow the user to easily control the operation explanation information.

The present application has been made in view of the above, and an object of the present application is to easily control music content even when audio content is being listened to.

A content control apparatus according to the present application includes a reception unit that receives a voice instruction from a user for instructing an operation to control reproduction of an output audio content, and an operation that corresponds to the voice instruction received by the reception unit. and a content control unit that performs operations on the content.

According to one aspect of the embodiment, it is possible to easily control the music content even when the audio content is being listened to.

FIG. 1 is a diagram illustrating an example of content control processing according to an embodiment; FIG. 2 is a diagram illustrating a configuration example of a control system according to the embodiment; FIG. 3 is a diagram illustrating a configuration example of a content control device according to the embodiment; 4 is a diagram illustrating an example of a content storage unit according to the embodiment; FIG. 5 is a diagram illustrating an example of an action history storage unit according to the embodiment; FIG. 6 is a diagram illustrating an example of an operation history storage unit according to the embodiment; FIG. 7 is a diagram illustrating an example of a user information storage unit according to the embodiment; FIG. 8 is a diagram illustrating an example of a distribution content storage unit according to the embodiment; FIG. FIG. 9 is a flowchart illustrating an insertion processing procedure according to the embodiment; FIG. 10 is a diagram schematically illustrating insertion processing according to the embodiment; 11 is a flowchart illustrating a UI processing procedure according to the embodiment; FIG. FIG. 12 is a hardware configuration diagram showing an example of a computer that implements the functions of the content control device.

Embodiments (hereinafter referred to as "embodiments") for implementing the content control device, control method, and control program according to the present application will be described below with reference to the drawings. Note that the content control device, control method, and control program according to the present application are not limited to this embodiment. In addition, in the following embodiments, the same parts are denoted by the same reference numerals, and overlapping descriptions are omitted.

[1. Content control processing]
First, an example of content control processing according to the embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of content control processing according to an embodiment; Content control processing according to the embodiment is performed by the content control device 100 . Note that the content control processing according to the embodiment includes processing related to inserting the second audio content into the first audio content (referred to as "insertion processing"), and user control processing for the second audio content inserted by such processing. 2 includes two control processes (referred to as “UI processing”) such as processing for performing an operation on the second audio content in accordance with the voice instruction by receiving the voice instruction.

Prior to the description of FIG. 1, the control system according to the embodiment will be described with reference to FIG. FIG. 2 is a diagram showing a configuration example of the control system 1 according to the embodiment. The control system 1 according to the embodiment includes a terminal device 10, an output device 30, an external device 60, and a content control device 100, as shown in FIG. The terminal device 10, the output device 30, the external device 60, and the content control device 100 are communicatively connected via a network N by wire or wirelessly. The control system 1 shown in FIG. 1 may include a plurality of terminal devices 10, a plurality of output devices 30, a plurality of external devices 60, and a plurality of content control devices 100. FIG.

The terminal device 10 is an information processing device used by a user. The terminal device 10 is, for example, a smart phone, a tablet terminal, a notebook PC (Personal Computer), a desktop PC, a mobile phone, a PDA (Personal Digital Assistant), or the like. For example, the terminal device 10 displays various contents (for example, article contents, advertisement contents, blogs, shopping contents, music contents, etc.) on the display screen in accordance with user operations.

Also, as will be described later, the terminal device 10 displays the content transmitted from the content control device 100 on the screen and outputs the content by voice. That is, the terminal device 10 can operate in cooperation with the content control device 100 . Note that a predetermined application may be pre-installed in the terminal device 10 in order to realize such cooperation.

The output device 30 is, for example, a smart speaker, car navigation system, mobile robot, or the like. In this embodiment, the output device 30 is assumed to be a smart speaker. Therefore, in the following embodiments, the output device 30 may be referred to as "smart speaker 30".

The external device 60 is a provider server device that provides the content control device 100 with the first audio content and the second audio content. The external device 60 may be a server device belonging to a business owner (referred to as “business owner Z”) who manages the content control device 100, or a business owner different from the business owner Z (that is, from the perspective of business owner Z). It may be a server device managed by another company).

Here, the premise of the content control process according to the embodiment will be described. In the present embodiment, the audio content is not provided in response to the user's desire to listen to the audio content, but rather, for example, the user who is doing some work hears the audio to the extent that it can be "caught at the edge of the ear". It is premised on processing and controlling content. In other words, in the present embodiment, audio content that is listened to while listening is processed and controlled, and even if the audio content is listened to while listening, the audio content can be controlled according to the user's instruction. It is assumed that

An example of content control processing for listening while listening is shown. One example is a scene in which the user wakes up and prepares to go to work. For example, when the content control device 100 detects that the user is preparing to go to work, the content control device 100 adds weather near the user's place of work during the main audio content (for example, music channel) output from the smart speaker 30 . Control the forecast to flow as audio content. In addition, the content control device 100 controls so that the delay information of the route that the user usually uses flows as audio content in the middle of the main audio content.

In addition, the content control device 100 performs control so that headlines of news that the user is interested in are played as audio content in the middle of the main audio content. In addition, the content control device 100 performs control so that music of a user's favorite genre is played as audio content in the middle of the main audio content. In addition, the content control device 100 controls so that profitable information about restaurants near the user's place of work is played as audio content in the middle of the main audio content.

Another example is a scene where the user is doing laundry. For example, when the content control device 100 detects that the user is doing laundry, the main audio content (e.g., music channel) output from the smart speaker 30 includes an online shopping service about detergents and washing machines. To control advertisement content to flow as audio content. In addition, the content control device 100 performs control such that the weather forecast for the vicinity of the user's home is played as audio content during the main audio content. In addition, the content control device 100 controls so that profitable information of a supermarket near the user's home is played as audio content in the middle of the main audio content.

As yet another example, a scene in which the user is cooking can be considered. For example, when the content control device 100 detects that the user is cooking, the content control device 100 inserts radio shopping or advertising content about cooking utensils in the middle of the main audio content (for example, music channel) output from the smart speaker 30. controls to flow as audio content.

Note that the main audio content output from the smart speaker 30 in the above example corresponds to the first audio content. Also, the audio content controlled to flow in the middle of the main audio content corresponds to the second audio content.

Also, in such a state, it is assumed that the content control apparatus 100 operates the second audio content that is listened to while listening according to the user's purpose orientation. The user's goal-orientation means, for example, rewinding or fast-forwarding the output second audio content.

Based on the above assumptions, the content control device 100 performs content control processing according to the embodiment. Specifically, as an insertion process, the content control apparatus 100 acquires the candidate second audio content to be inserted into the first audio content, and based on the user information about the user of the distribution destination, the content control apparatus 100 acquires the candidate second audio content. selects the second audio content to be inserted into the first audio content. More specifically, the content control apparatus 100 selects the second audio content to be inserted into the first audio content and the second audio content to be inserted based on the user information about the user of the distribution destination. A time position in the first audio content to be inserted into the first audio content is determined. Then, the content control device 100 selects the determined second audio content and actually inserts it into the first audio content.

Further, as UI processing, the content control device 100 accepts from the user a voice instruction instructing to perform an operation to control the reproduction of the second audio content inserted in the first audio content. The corresponding operation is performed on the audio content. For example, the content control device 100 accepts voice instructions for rewinding, cueing, clipping (extracting), fast-forwarding, and skipping as operations for controlling playback, thereby allowing the second audio content to receive this voice instruction. Perform the operation according to the instructions. An example of content control processing is shown below. In the example of FIG. 1, steps S1 to S6 correspond to insertion processing, and steps S7 to S8 correspond to UI processing.

First, the content control device 100 acquires a candidate second audio content to be inserted into the first audio content (step S1). For example, the content control device 100 can acquire the original data (eg, text) of the candidate second audio content from the external device 60 . The content control device 100 may also acquire the first audio content from the external device 60 . In the example of FIG. 1, the content control device 100 acquires the news content SC11, the advertisement content SC21, the route information SC31, and the weather information SC41 as the source data of the candidate second audio content.

Note that news content, route information, and weather information may be required to be real-time. Therefore, the content control device 100 acquires the latest news content SC11, route information SC31, and weather information SC41, for example, 10 minutes before the scheduled delivery time for the first audio content whose delivery time schedule is determined. , the following processing may be performed before the scheduled delivery time.

The content control device 100 converts the acquired original data into audio data (step S2). The content control device 100 first organizes and edits the acquired original data. For example, when the number of characters exceeds a predetermined number, the content control device 100 edits the original data so that the number of characters is within the predetermined number. Also, for example, the content control apparatus 100 analyzes the text, and reorganizes the original data if there is a problem with the sentence structure or the like. Then, the content control device 100 converts the organized and edited original data into audio data. This converted audio data is the candidate second audio content to be inserted into the first audio content.

Note that the content control device 100 may acquire from the external device 60 the candidate second audio content that has already been converted into audio data. In such a case, the content control apparatus 100 does not organize and edit, for example, and uses the acquired audio data as the second audio content for the following processing.

Next, the content control device 100 selects the second audio content to be inserted into the first audio content and inserts the target second audio content into the first audio content based on the user information about the user of the distribution destination. A time position to be inserted into the audio content and a time position in the first audio content is determined (step S3).

First, an example of user information regarding users of delivery destinations will be described. In the example of FIG. 1, the user of the delivery destination is user U1. Then, the content control device 100 acquires the action history of the user U1 as the user information of the user U1. For example, the content control device 100 acquires the action history of the user U1 from the terminal device 10 of the user U1. In one example, the content control device 100 acquires an action history on the Internet as the action history of user U1. The content control apparatus 100 acquires, for example, browsing history, purchasing history, viewing history of moving images and music, although there is no limitation on what kind of action history is acquired as the action history on the Internet.

In another example, the content control device 100 acquires an action history in daily life as the action history of the user U1. The content control apparatus 100 acquires, for example, wake-up time, bedtime, used route, workplace position, movement history, etc., although there is no limitation on what kind of action history is acquired as the action history in daily life. Note that the content control device 100 may identify the tendency of the lifestyle of the user U1 from the behavior history in daily life, and use this lifestyle as one type of behavior history.

Also, the content control apparatus 100 may acquire, as the action history of the user U1, action information indicating the action that the user U1 is currently performing. For example, when the user U1 is currently washing clothes, the content control device 100 acquires that the user U1 is currently washing clothes as an action history. In addition, when the user U1 is currently cooking, the content control device 100 acquires that the user U1 is currently cooking as an action history.

Although an example of acquiring user U1's action history as user information has been described, the content control device 100 can also acquire user U1's operation history as user U1's user information. Specifically, the content control device 100 acquires the operation history of the user U1 on the smart speaker 30 . For example, the content control device 100 acquires an operation history indicating what kind of content the user U1 listened to by operating the smart speaker 30 .

Returning to the description of step S3, based on the user information, the content control device 100 determines what kind of audio content the user U1 tends to listen to at what time, that is, the time zone for the user U1 and the audio content heard during that time zone. A tendency with the content of the audio content is calculated. Then, the content control device 100 determines the target second audio content and the time position where the target second audio content is to be inserted based on the calculation result.

In the example of FIG. 1, the content control device 100 calculates that user U1 tends to browse web news between 7:00 and 8:00 a.m. every morning, and specifies that manga is his hobby. . In such a state, assume that the first audio content scheduled to be delivered between 7:00 and 8:00 am is the music content MC1. In this case, the content control device 100 determines the news content SC11 and the advertisement content SC21 as the second audio content to be inserted into the music content MC1, which is the first audio content. The advertising content SC21 is, for example, advertising content of comics in accordance with user U1's taste.

In addition, the content control device 100 sets the time position of the music content MC1 at 5 minutes of playback time (the time position corresponding to 7:05 am) as the time position where the news content SC11 is inserted, and the time position of the music content MC1. The position of 30 minutes of playback time (the time position corresponding to 7:30 am) is determined as the time position to insert the advertising content SC21.

For example, the content control apparatus 100 determines the time position of content such as news content that requires real-time performance so that the content is output as early as possible after the start of distribution of the first audio content. The same is true for weather information. On the other hand, the content control apparatus 100 determines the time position of content such as advertising content that does not require much real-time performance so that the content is output around the middle stage after the start of distribution of the first audio content.

Based on the information determined in step S3, the content control device 100 inserts the news content SC11 and the advertisement content SC21 into the music content MC1, which is the first audio content (step S4). Here, the music content MC1 into which the news content SC11 and the advertisement content SC21 are inserted is referred to as music content MSC1.

In such a state, the content control device 100 performs predetermined output control on the music content MSC1 (step S5). For example, when the user U1 is getting ready for work, there is a possibility that the music content MSC1 is hardly heard due to being preoccupied with getting ready for work. Therefore, for example, when the user U1 is expected to be getting ready for work, the content control device 100 controls the volume so that the music content MSC1 is output at a volume higher than a predetermined value. Note that the content control device 100 may control the volume so that only the news content SC11 and the advertising content SC21, which are the second audio content included in the music content MSC1, are output at a volume higher than a predetermined value.

Then, the content control device 100 distributes the music content MSC1 according to the time schedule for distributing the music content MSC1 (for example, scheduled to be distributed from 7:00 am) (step S6). Specifically, the content control device 100 causes the smart speaker 30 to distribute (output or reproduce) the music content MSC1 by transmitting the music content MSC1 to the smart speaker 30 .

In such a state, assume that the user U1 listens to the music content MSC1 while actually getting ready for work. Here, it is assumed that the user U1 wants to listen to the news content SC11 again after the news content SC11 has been output, and has given a voice instruction to the smart speaker 30, "Let me hear it again." This voice instruction instructs the content control device 100 to perform an operation for controlling reproduction of the news content SC11, which is the second voice content.

Upon receiving such a voice instruction, the smart speaker 30 transmits the received voice instruction to the content control device 100 . For example, the smart speaker 30 transmits audio data corresponding to the voice instruction to the content control device 100 . Thereby, the content control device 100 receives a voice instruction from the user U1 (step S7).

Then, the content control device 100 judges that the voice instruction "Let me hear it again" causes the news content SC11 to be heard from the beginning, that is, cueing the news content SC11, and cueing the news content SC11 (step S8). For example, the content control device 100 instructs the smart speaker 30 to cue the news content SC11.

So far, using FIG. 1, the content control device 100, taking the user U1 as an example, converts the main audio content (first audio content) into sub audio content (second audio content) in accordance with the user information of the user U1. Examples of inserting audio contents) and controlling reproduction of audio contents in accordance with user U1's voice instructions are shown. However, the content control apparatus 100 actually performs such content control processing according to each user. In other words, the content control device 100 personalizes the audio content for the user.

In addition, the content control apparatus 100 performs UI processing among the content control processing described in FIG. can. In addition, the content control apparatus 100 performs the insertion processing among the content control processing described with reference to FIG. Therefore, it is possible to effectively provide the information desired by the user even during listening.

[2. Configuration of content control device]
Next, the content control device 100 according to the embodiment will be described using FIG. FIG. 3 is a diagram showing a configuration example of the content control device 100 according to the embodiment. As shown in FIG. 3, the content control device 100 has a communication section 110, a storage section 120, and a control section .

(Regarding communication unit 110)
The communication unit 110 is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from the terminal device 10 and the smart speaker 30, for example.

(Regarding storage unit 120)
The storage unit 120 is realized by, for example, a RAM (Random Access Memory), a semiconductor memory device such as a flash memory, or a storage device such as a hard disk or an optical disk. Storage unit 120 includes content storage unit 121 , action history storage unit 122 , operation history storage unit 123 , user information storage unit 124 , and distribution content storage unit 125 .

(Regarding the content storage unit 121)
The content storage unit 121 stores information regarding the first audio content and the second audio content. Here, FIG. 4 shows an example of the content storage unit 121 according to the embodiment. In the example of FIG. 4, the content storage unit 121 has a content storage unit 121-1 that stores first audio content and a content storage unit 121-2 that stores second audio content.

In the example of FIG. 4, the content storage unit 121-1 has items such as "category", "content ID", "first audio content", and "delivery date and time".

"Category" indicates the category to which the "first audio content" belongs. If the "first audio content" is music content, "music" is entered as the "category." "Content ID" indicates identification information for identifying the "first audio content". "First audio content" indicates the first audio content itself, that is, audio data. "Distribution time" indicates the distribution date and time (time schedule) when the "first audio content" is distributed. In the following description, "content ID" is used when distinguishing the first audio contents. For example, if it is the first audio content identified by the content ID "MC1", it will be written as the first audio content MC1.

That is, in the example of FIG. 4, the first audio content "MDA11" identified by the content ID "MC1" belongs to the category "music" and is distributed on a date and time of "7:00 am to 8:00 am". .

In the example of FIG. 4, the content storage unit 121-2 has items such as "category", "content ID", "pre-conversion content", and "post-conversion content".

"Category" indicates the category to which the "second audio content" belongs. If the "second audio content" is advertisement content, "advertisement" is entered as the "category." "Content ID" indicates identification information for identifying the "second audio content". "Pre-conversion content" is content before being organized, edited, and converted into audio data, and corresponds to the original data of the second audio content. As shown in FIG. 1, the “pre-conversion content” is text data, for example, and is acquired from the external device 60 .

"Post-conversion content" is audio content after the "pre-conversion content" has been organized and edited and further converted into audio data, and is used as a candidate second audio content to be inserted into the first audio content. handle. In the following description, "content ID" is used when distinguishing the second audio contents. For example, the second audio content identified by the content ID "SC11" is expressed as the second audio content SC11.

That is, the example of FIG. 4 indicates that the second audio content "SDA11b" identified by the content ID "SC11" belongs to the category "news." The second audio content stored in the content storage unit 121-2 is a candidate second audio content to be inserted into the first audio content.

(Regarding the action history storage unit 122)
The action history storage unit 122 stores a user's action history. Here, FIG. 5 shows an example of the action history storage unit 122 according to the embodiment. In the example of FIG. 5, the action history storage unit 122 has items such as "user ID", "category", "date and time", and "action history".

“User ID” indicates identification information for identifying the user or the user's terminal device 10 . "Category" indicates identification information that identifies under what circumstances the corresponding "action history" is the action history. For example, when the corresponding "action history" is the action history on the Internet, the category "net" is associated. Further, for example, when the corresponding "action history" is the action history in daily life (on the life line), the category "daily life" is associated.

The "date and time" indicates the date and time when the action indicated by the "action history" was performed. “Action history” indicates history information of actions actually performed by the user. The action history on the Internet includes, for example, browsing history of contents, purchase history, viewing history of moving images and music, and the like. Also, the behavior history in daily life includes wake-up time, bedtime, used route, workplace location, movement history, and the like.

Also, if the content control device 100 can detect an action that the user is currently performing (for example, washing or cooking), the content control device 100 may store action information indicating this action as an action history. Note that the content control device 100 can detect, for example, the action that the user is currently performing via the smart speaker 30 . For example, the content control device 100 detects that the user is currently doing laundry when the smart speaker 30 detects the operation sound of the washing machine.

Also, the content control device 100 may identify a tendency of the user's lifestyle from the action history, and may also store the identified lifestyle as the tendency.

That is, the example of FIG. 5 indicates that the user (user U1) identified by the user ID "U1" accessed the "cosmetics site" at "20:00 on May 20, 2018".

(Regarding the operation history storage unit 123)
The operation history storage unit 123 stores the user's action history. In this embodiment, the operation history storage unit 123 is assumed to store the user's operation history with respect to the smart speaker 30 . Here, FIG. 6 shows an example of the operation history storage unit 123 according to the embodiment. In the example of FIG. 6, the operation history storage unit 123 has items such as "user ID", "date and time", and "operation history".

“User ID” indicates identification information for identifying the user or the user's terminal device 10 . The "date and time" indicates the date and time when the action indicated by the "operation history" was performed. The “operation history” indicates the operation history of the smart speaker 30 operated by the user. Specifically, “operation history” indicates an operation history indicating what content (channel or program) the user has listened to by operating the smart speaker 30 .

That is, in the example of FIG. 6 , the user (user U1) identified by the user ID “U1” operates the smart speaker 30 at “7:00 on May 20, 2018”, and the channel which is the music content. It shows that Ch1 has flowed.

(Regarding the user information storage unit 124)
The user information storage unit 124 stores various information about users. For example, the user information storage unit 124 stores the user's life style, behavioral tendencies, hobbies and preferences, etc. specified from the "action history" and "operation history". Here, FIG. 7 shows an example of the user information storage unit 124 according to the embodiment. In the example of FIG. 7, the user information storage unit 124 has items such as "user ID", "attribute information", "hobbies and preferences", "living situation", and "tendency information".

“User ID” indicates identification information for identifying the user or the user's terminal device 10 . "Attribute information" indicates user attribute information. "Attribute information" includes, for example, the user's age and gender. “Preferences” indicates the preferences of the user. For example, the content control device 100 identifies the user's hobbies and preferences based on the user's "behavior history" and "operation history."

“Lifestyle” indicates the user's lifestyle (living tendency). For example, the content control device 100 identifies the user's living situation based on the user's "behavior history" and "operation history." "Tendency information" indicates user behavior tendencies. The “tendency information” is, for example, information indicating what kind of audio content the user tends to listen to in what time slot.

That is, in the example of FIG. 7, the user (user U1) identified by the user ID "U1" has a hobby of "manga, fashion", a living situation of "waking up at 7 o'clock, working around Roppongi", and trend information of " View news content between 7:00, weather forecast between 7:00, and online shopping between 8:00."

(Regarding the distribution content storage unit 125)
The distribution content storage unit 125 stores the audio content actually distributed to the user, that is, the first audio content into which the second audio content is inserted. In addition, in the following embodiments, the first audio content into which the second audio content is inserted may be referred to as "distribution content". Here, FIG. 8 shows an example of the distributed content storage unit 125 according to the embodiment. In the example of FIG. 8, the distributed content storage unit 125 has items such as "user ID", "distributed content ID", and "distributed content".

“User ID” indicates identification information for identifying the user or the user's terminal device 10 . “Distribution content ID” indicates identification information for identifying distribution content. “Distributed content” indicates the distributed content itself, that is, audio data.

(Regarding the control unit 130)
Returning to FIG. 3, the control unit 130 executes various programs stored in the storage device inside the content control device 100 using the RAM as a work area by means of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. It is realized by Also, the control unit 130 is implemented by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 3, the control unit 130 includes an acquisition unit 131, a conversion unit 132, an identification unit 133, a determination unit 134, a selection unit 135, an output control unit 136, a reception unit 137, and a content control unit. It has a unit 138 and a distribution unit 139, and implements or executes the information processing functions and actions described below. Note that the internal configuration of the control unit 130 is not limited to the configuration shown in FIG. 3, and may be another configuration as long as it performs information processing described later. Moreover, the connection relationship between the processing units of the control unit 130 is not limited to the connection relationship shown in FIG. 3, and may be another connection relationship.

(Regarding the acquisition unit 131)
The acquisition unit 131 acquires a second audio content candidate to be inserted into the first audio content. For example, the acquisition unit 131 acquires the original data (for example, text) of the candidate second audio content. Further, the acquisition unit 131 acquires the second candidate audio content from the content storage unit 121-2 at the timing when the content control process (insertion process) is performed.

Note that the acquisition unit 131 obtains the original data of the audio content that requires real-time performance as the candidate second audio content based on the distribution time schedule determined for the first audio content. For example, the original data of the latest information 10 minutes before (not limited to 10 minutes) before the scheduled delivery time is acquired. Then, the acquisition unit 131 causes content control processing (insertion processing) to be performed using the original data of the latest information.

For example, the acquisition unit 131 can acquire original data from the external device 60 . On the other hand, the acquisition unit 131 may acquire the candidate second audio content itself (converted into audio data) from the external device 60 instead of the original data. The acquisition unit 131 may also acquire the first audio data from the external device 60 . Also, the acquisition unit 131 acquires the first audio content from the content storage unit 121-1 at the timing of performing the content control process (insertion process).

(Regarding the conversion unit 132)
The conversion unit 132 first organizes and edits the original data acquired by the acquisition unit 131 . For example, when the number of characters of the text, which is the original data, exceeds a predetermined number of characters, the conversion unit 132 edits the original data so that the number of characters is within the predetermined number of characters. Also, for example, the conversion unit 132 analyzes the text, which is the original data, and reorganizes the original data if there is a problem with the sentence structure or the like. Then, the conversion unit 132 converts the organized and edited original data into audio data.

(Regarding the specifying unit 133)
The identifying unit 133 identifies behavioral tendencies, lifestyles (living conditions), and tastes and preferences of users to whom distribution content is distributed. Specifically, the identification unit 133 determines behavior trends, lifestyles (living situations) based on the behavior history stored in the behavior history storage unit 122 and the operation history stored in the operation history storage unit 123 as user information. ), to identify hobbies and preferences.

To give an example, the identifying unit 133 identifies (calculates) a behavioral tendency, such as what kind of audio content the user tends to listen to at what time, based on the user information. Based on the user information, the specifying unit 133 also specifies (calculates) behavioral tendencies such as what time the user goes to bed and wakes up every day, and which area the user moves to in daily life. Further, the specifying unit 133 can specify, for example, the place of work of the user from the movement area tendency. Note that the determination unit 134 described below may perform the processing of the identification unit 133 . In such a case, the content control device 100 does not have the specifying unit 133 .

(About decision unit 134)
Based on the user information, the determining unit 134 selects the second audio content to be inserted into the first audio content and the time position at which the second audio content is to be inserted into the first audio content. A time position in the first audio content is determined. Such user information is the action history stored in the action history storage unit 122 and the operation history stored in the operation history storage unit 123 .

Then, the determining unit 134 determines the target second audio content and the time position based on the result of calculating what kind of audio content the user tends to listen to at what time based on the user information. do. Further, based on the user information, the determining unit 134 selects the second audio content to be inserted into the first audio content, among the candidate second audio content, according to the user's living situation or hobbies and tastes. Determined as audio content.

(Regarding the selection unit 135)
The selection unit 135 selects the second audio content to be inserted into the first audio content from the second audio content candidates based on the user information about the user of the distribution destination. For example, the selection unit 135 selects the second audio content to be inserted into the first audio content among the candidate second audio content based on the action history of the user as the user information about the user of the delivery destination. to select. In addition, the selection unit 135 selects the first audio content among the second audio content candidates based on the user's operation history with respect to a predetermined output device that outputs the audio content as the user information about the user of the distribution destination. Selecting the second audio content to be inserted. The selection unit 135 selects the second audio content determined by the determination unit 134 as the target second audio content. For example, the selection unit 135 selects the target second audio content from the content storage unit 121-2.

Also, the selection unit 135 inserts the selected second audio content at the time position determined by the determination unit 134 . That is, the selection unit 135 is also a processing unit corresponding to the insertion unit.

(Regarding the output control unit 136)
The output control unit 136 controls output of the first audio content or the second audio content based on the information regarding the user. Specifically, the output control unit 136 outputs the first audio content or the second audio content based on the user attribute information or the environment information indicating the user's surrounding environment (surrounding noise) as the information about the user. to control.

As an example, the output control unit 136 controls the volume, timbre, or pitch when the first audio content or the second audio content is output, based on the information about the user. As another example, the output control unit 136 rewinds the first audio content or the second audio content based on information about the user.

Note that the output control unit 136 performs the above output control before the first audio content or the second audio content is output from the smart speaker 30, that is, before the distribution content is distributed to the smart speaker 30. good too. On the other hand, the output control unit 136 may perform the above output control on the distributed content while the smart speaker 30 is reproducing the distributed content. In other words, the output control unit 136 may dynamically perform the above-described output control on the distribution content that is being output.

(Regarding the reception unit 137)
The accepting unit 137 accepts a voice instruction from the user that instructs to perform an operation for controlling reproduction of the output audio content. For example, the reception unit 137 receives a voice instruction from the user that instructs to perform an operation to control reproduction of audio content output from the smart speaker 30 . Specifically, the receiving unit 137 receives, from the user, a voice instruction to perform an operation for controlling reproduction of the second audio content inserted in the first audio content as the output audio content.

For example, the receiving unit 137 receives a voice instruction to rewind the audio content as an operation for controlling reproduction of the audio content. Such voice instructions include words such as "rewind! Or rewind" that directly instruct the rewinding operation.

The accepting unit 137 also accepts a voice instruction for cueing the audio content as an operation for controlling the reproduction of the audio content. Examples of such voice instructions include a word such as "cue" that directly instructs a cue operation, as well as a voice instruction that indicates the user's reaction to the audio content. An utterance indicating a user's reaction to audio content includes, for example, words such as "Eh?" as shown in FIG. Further, the accepting unit 137 may accept a voice instruction with a similar meaning, for example, a word such as "Let me hear it again" instead of "cue" that directly instructs a cue operation.

Note that the reception unit 137 can receive not only the voice instruction for the audio content played immediately before, but also the audio instruction for the audio content played earlier than the audio content played immediately before. Taking a cueing operation as an example, the receiving unit 137 may select a word (in this example, "two before") that designates which audio content is to be cueed, such as "go back two places". ) is accepted.

The accepting unit 137 also accepts a voice instruction to extract the second audio content from the first audio content into which the audio content is inserted, as an operation for controlling the reproduction of the audio content. As such a voice instruction, a word such as "clip" that directly instructs the extraction operation is accepted. Further, the receiving unit 137 receives not "clip" that directly instructs the extraction operation, but a voice instruction with a similar meaning, such as "take it" or "I want to hear it later". good too.

The accepting unit 137 also accepts a voice instruction to fast-forward or skip the audio content as an operation for controlling the reproduction of the audio content. As such voice instructions, words such as "fast forward" directly instructing a fast forward operation and "skip" directly instructing a skip operation are accepted. Further, the reception unit 137 does not provide a voice instruction in words directly instructing a fast-forward operation or a skip operation, but a voice instruction with a similar meaning, such as words such as "faster" or "next one". may be accepted.

For example, when the smart speaker 30 detects a voice instruction including the above words, it converts the voice instruction into text and transmits the converted text to the content control device 100 . Accordingly, the reception unit 137 receives the voice instruction converted into text as the voice instruction. Note that, when the smart speaker 30 detects a voice instruction including the words as described above, the smart speaker 30 may transmit the voice instruction itself, that is, the voice data to the content control device 100 .

Further, upon receiving a voice instruction, the receiving unit 137 determines what kind of operation the received voice instruction instructs. Although not shown in FIG. 3, for example, the content control apparatus 100 displays the text of each word indicating a voice instruction (for example, "rewind," "cue," "eh?," "fast forward," etc.) and the word has a storage unit associated with the content of the operation indicated by . In such a case, the reception unit 137 compares the text corresponding to the voice instruction with the storage unit to determine what kind of operation the voice instruction instructs.

(Regarding the content control unit 138)
The content control unit 138 performs an operation on the audio content according to the audio instruction accepted by the accepting unit 137 . For example, the content control unit 138 rewinds the audio content when the receiving unit 137 receives a voice instruction to rewind the audio content. For example, the content controller 138 instructs the smart speaker 30 to rewind the audio content.

Further, the content control unit 138 cue the audio content when the reception unit 137 receives a voice instruction to cue the audio content. For example, the content controller 138 instructs the smart speaker 30 to rewind the audio content.

Further, when the reception unit 137 receives a voice instruction to extract the audio content from the first audio content into which the audio content is inserted, the content control unit 138 extracts the audio content from the first audio content. Extract. The voice instructions in such a case are, as described above, voice instructions such as "clip", "take it", and "listen to it later". In this case, the content control unit 138 transmits (transfers) the audio content extracted from the first audio content, that is, the second audio content, to another device other than the content control device 100 . Another device different from the content control device 100 is, for example, the terminal device 10 of the user. This allows the user to re-listen to the second audio content on the terminal device 10 at his/her desired timing.

Further, the content control unit 138 fast-forwards or skips the audio content when the receiving unit 137 receives a voice instruction to fast-forward or skip the audio content.

(Distribution unit 139)
The distribution unit 139 distributes the distribution content, which is the first audio content in which the second audio content is inserted. For example, the distribution unit 139 distributes distribution content to the smart speaker 30 .

[3. Processing procedure]
(About insert processing)
Next, with reference to FIG. 9, a procedure of insertion processing among content control processing executed by the content control apparatus 100 according to the embodiment will be described. FIG. 9 is a flowchart illustrating an insertion processing procedure according to the embodiment;

First, the identification unit 133 identifies behavioral tendencies, lifestyles (living situations), and tastes and preferences of users to whom distribution content is distributed (step S101). Specifically, the identification unit 133 determines behavior trends, lifestyles (living situations) based on the behavior history stored in the behavior history storage unit 122 and the operation history stored in the operation history storage unit 123 as user information. ), to identify hobbies and preferences. To give an example, based on the user information, the identifying unit 133 determines what kind of audio content the user tends to listen to at what time, that is, the tendency of the time period and the content of the audio content heard in the time period. Calculate User U1 will be described below as an example.

In FIG. 9, the specifying unit 133 determines that the user U1 "tends to watch news between 7:00 and 20:00", "tends to watch radio shopping between 8:00 and 8:00", "comics are his hobby", and "work place "around Roppongi".

Note that in the example of FIG. 9, the specifying unit 133 initially performs such specifying processing, but the timing of performing the specifying processing is not limited. Since the action history and the operation history are accumulated day by day in accordance with the actions of the user, the identification unit 133 repeats the identification process, for example, every predetermined period of time. The stored information (“hobbies and preferences”, “living situation”, and “tendency information”) is updated.

Next, the acquisition unit 131 determines whether or not it is time to perform the insertion process (step S102). For example, the acquisition unit 131 determines whether or not it is time to perform the insertion process based on the delivery date and time (delivery schedule) of the first audio content stored in the content storage unit 121-1. As described above, some of the second audio content to be inserted into the first audio content requires real-time performance. , just before (for example, 10 minutes) before the distribution date and time of the first audio content, it is determined that it is time to perform the insertion process (step S102; Yes). On the other hand, when the obtaining unit 131 determines that it is not the timing to perform the insertion process (step S102; No), it waits until the timing to perform the insertion process.

Note that the acquisition unit 131 does not necessarily need to perform the process of step S102 when there is no second audio content that requires real-time performance. Further, for example, when only weather information related to the outside temperature is inserted as the second audio content as the weather information, the content control device 100 stores the second sound information for each outside temperature in advance in the content storage unit 121-2. Audio content (“converted content”) can be pre-existing. In such a case, the acquisition unit 131 may acquire the second audio content corresponding to the outside temperature at the time of performing the insertion process from the content storage unit 121-2.

Next, the acquisition unit 131 acquires original data corresponding to the second audio content that is a candidate to be inserted into the first audio content (step S103). For example, the acquisition unit 131 externally acquires source data of news content, source data of advertisement content, source data of route information, source data of weather information, etc. as source data (eg, text) of the second voice content of the candidate. Obtained from device 60 .

Next, the conversion unit 132 organizes, edits, and converts the original data acquired by the acquisition unit 131 (step S104). For example, the conversion unit 132 converts the organized and edited original data acquired by the acquisition unit 131 into audio data, that is, the candidate second audio content.

Next, based on the user information, the determining unit 134 determines the second audio content to be inserted into the first audio content, and the second audio content to be inserted into the first audio content. A time position in the first audio content is determined (step S105). For example, the determination unit 134 selects the second audio content to be inserted into the first audio content and the second audio content to be inserted into the first audio content based on the behavioral tendency, lifestyle, and tastes and preferences specified by the specifying unit in step S101. A time position at which the second audio content is to be inserted into the first audio content is determined.

In the example of FIG. 9, the determining unit 134 selects the second audio content SC11, which is news content, and the second audio content SC21, which is advertising content related to manga, as music content scheduled to be delivered between 7:00 am and 8:00 am. Assume that it is determined as a second audio content to be inserted into a certain first audio content MC1 (one-hour program). Further, the determination unit 134 sets the position of 5 minutes of the reproduction time (the time position corresponding to 7:05 am) as the time position of the first audio content MC1 to the time position where the second audio content SC11 is to be inserted. As the time position of the audio content MC1, the position of 30 minutes of playback time (time position corresponding to 7:30 am) is determined as the time position to insert the second audio content SC21.

Further, in the example of FIG. 9, the determination unit 134 selects the second audio content SC41, which is weather information, and the second audio content SC22, which is a store advertisement in the vicinity of user U1's place of work, between 8:00 pm and 9:00 pm. is determined as the second audio content to be inserted into the first audio content MC4 (one-hour program), which is an online shopping program scheduled to be distributed in 2010. Since the user U1 tends to watch online shopping around 20:00, the identification unit 133 has a high possibility that the second audio content played during this time period will be heard. Therefore, the determining unit 134 determines that the second audio content should be inserted into the first audio content MC4 scheduled to be delivered between 8:00 PM and 9:00 PM.

Further, the determination unit 134 sets the position of 5 minutes of the reproduction time (the time position corresponding to 8:05 pm) as the time position of the first audio content MC4 to the time position where the second audio content SC41 is to be inserted. As the time position of the audio content MC4, the position of 30 minutes of playback time (time position corresponding to 8:30 pm) is determined as the time position to insert the second audio content SC22.

Then, the selection unit 135 selects the target second audio content determined by the determination unit 134 from the content storage unit 121-1, and inserts the second audio content at the time position determined by the determination unit 134. (Step S106). Here, steps S105 and S106 will be described with reference to FIG. FIG. 10 is a diagram schematically illustrating insertion processing according to the embodiment;

As shown in FIG. 10, the selection unit 135 divides the first audio content MC1 at the time position "5 minute reproduction time position" and the time position "30 minute reproduction time position". The first audio content MC1 after division becomes three as shown in FIG. Then, the selection unit 135 inserts the second audio content SC11 and the second audio content SC21 between the divided first audio contents MC1.

Further, as shown in FIG. 10, the selection unit 135 divides the first audio content MC4 at the time position "5 minutes of playback time" and the time position of "30 minutes of playback time". The first audio content MC4 after division becomes three as shown in FIG. Then, the selection unit 135 inserts the second audio content SC41 and the second audio content SC22 respectively between the divided first audio contents MC1.

Note that FIG. 10 shows an example in which the selection unit 135 inserts the second audio content between the first audio contents. However, the selection unit 135 may superimpose the second audio content on the first audio content. To give an example, the selection unit 135 aligns the beginning of the second audio content SC11 with the time position “the position of 5 minutes of playback time” of the first audio content MC1 so as to match the first audio content MC1. The second audio content SC11 is superimposed on it. For this reason, in the present embodiment, "inserting" can include the concept of "overlapping."

Next, the output control unit 136 controls the output of the first audio content or the second audio content based on the environment information indicating the surrounding environment of the user or the attribute information of the user as information about the user (step S107). ). For example, the output control unit 136 controls the volume, timbre, or pitch when the first audio content or the second audio content is output, based on the information regarding the user U1. Also, the output control unit 136 rewinds the first audio content or the second audio content based on the information about the user.

For example, output control unit 136 detects, via smart speaker 30, that user U1 is currently washing clothes as user U1's surrounding environment. In such a case, the output control unit 136 adjusts the volume so that the first audio content or the second audio content is output at a volume higher than a predetermined value in order to prevent the audio content from being disturbed by the washing sound and becoming difficult to hear. Control. If the user U1 is currently washing, the output control unit 136 may anticipate that the user U1 has missed the audio content due to the disturbing sound of washing, and may rewind the audio content. In addition, when the user is elderly (eg, 60 years old or older), the output control unit 136 controls the pitch of the voice content to be slower than a predetermined value so that the voice content can be heard more easily.

Note that the output control unit 136 may apply the above output control only to the second audio content. Also, the output control unit 136 may perform output control on the audio content being output instead of performing the output control before the audio content is distributed. For example, the output control unit 136 may increase the volume of the second audio content SC11 when detecting the washing sound while the second audio content SC11 is being played.

Finally, the distribution unit 139 distributes the distribution content, which is the first audio content in which the second audio content is inserted (step S108). For example, the distribution unit 139 distributes distribution content to the smart speaker 30 .

(About UI processing)
Next, the UI processing procedure among the content control processing executed by the content control apparatus 100 according to the embodiment will be described with reference to FIG. 11 . 11 is a flowchart illustrating a UI processing procedure according to the embodiment; FIG.

First, the reception unit 137 determines whether or not a voice instruction instructing to perform an operation for controlling reproduction of the output audio content has been received from the user (step S201). Specifically, the reception unit 137 receives a voice instruction from the user to perform an operation to control reproduction of the output second audio content (the second audio content inserted into the first audio content). Determine whether or not it has been accepted. If the reception unit 137 has not received a voice instruction (step S201; No), it waits until reception.

For example, the receiving unit 137 can receive voice instructions such as “rewind”, “cue”, “clip”, “fast forward”, and “skip” via the smart speaker 30 . Then, when determining that the voice instruction has been received (step S201; Yes), the receiving unit 137 determines what kind of operation the received voice instruction instructs (step S202). The accepting unit 137 also transmits information indicating the determined operation to the content control unit 138 .

The content control unit 138 performs an operation on the second audio content according to the voice instruction accepted by the accepting unit 137 (step S203). For example, the content control unit 138 rewinds the second audio content when the receiving unit 137 receives a voice instruction to rewind the second audio content. In one example, the content controller 138 instructs the smart speaker 30 to rewind the second audio content.

[4. Modification]
The content control device 100 according to the above embodiment may be implemented in various different forms other than the above embodiment. Therefore, another embodiment of the content control device 100 will be described below.

[4-1. About voice instructions]
In the above-described embodiment, an example was shown in which the reception unit 137 receives a voice instruction from the user that instructs to perform an operation for controlling reproduction of audio content. However, not limited to this example, the reception unit 137 may receive from the user a voice instruction instructing to perform an operation related to the content indicated by the audio content. This point will be described using an example in which the second audio content, which is audio advertising content related to cooking utensils, is inserted into the first audio content (online shopping). For convenience of explanation, this second audio content is referred to as a second audio content SC51.

Assume that the user U1 says "I want to buy this!" while the second audio content SC51 is being output from the smart speaker 30 in such a state. That is, it is assumed that the user U1 expresses his or her desire for the content (cooking utensils) indicated by the second audio content SC51. In other words, it is assumed that the reception unit 137 receives from the user U1 a voice instruction instructing to perform an operation related to purchase of the product (cooking utensil) indicated by the second audio content SC51.

In such a case, the content control unit 138 transmits address information (URL) indicating the purchase site of the cooking utensils to, for example, the terminal device 10 of the user U1 as a device different from the content control device 100 . This address information is associated with the second audio content in, for example, the content storage unit 121-2.

Also, in this modified example, an example is shown in which the second audio content is advertising content, but the second audio content may not be advertising content. For example, when the second audio content is route information, assume that user U1 says, "I want to know route information on XX line!" In other words, it is assumed that the receiving unit 137 receives from the user U1 a voice instruction instructing to present route information. In such a case, the content control unit 138 transmits address information (URL) indicating route information of the XX line to the terminal device 10 of the user U1.

As a result, the content control apparatus 100 according to the embodiment can not only simply control the reproduction of audio content according to the user's voice instruction, but also respond to various user requests related to audio content.

[4-2. Regarding the second audio content (1)]
In the above embodiment, an example was given in which the selection unit 135 inserts news content, advertisement content, route information, weather information, etc. as the second audio content. However, the selection unit 135 can insert various audio contents other than these as the second audio contents. For example, it is assumed that user U1 has contracted for an information providing service by paying a monthly usage fee. As an information providing service, for example, there is bus pick-up information and the like. It is assumed that user U1 confirms this bus pick-up information and uses the pick-up bus to commute every morning.

In this case, the determination unit 134 determines the bus pick-up information of the day as the second audio content to be inserted into the first audio content MC1 (music content) broadcast from 7:00 am to 8:00 am. Then, the selection unit 135 inserts the bus pick-up information into the first audio content MC1. Also, the distribution unit 139 distributes distribution content including bus pick-up information according to the time schedule.

Thereby, the content control apparatus 100 according to the embodiment can preferentially provide information that is highly necessary for the user.

[4-3. Regarding the second audio content (2)]
The identifying unit 133 may not be able to accurately identify behavioral tendencies until sufficient behavior history and operation history are accumulated as user information. In such a case, the determination unit 134 may determine the time position without using user information. In a simple example, the determining unit 134 sets a predetermined time position (for example, a position of 1 minute and a position of 5 minutes of playback time) to the time position of inserting the second audio content for the first audio content. Determined as

Also, when the first audio content is provided by another company, the provider may have previously specified a place where the second audio content may be inserted into the first audio content. For example, the provider may have embedded tags in the first audio content at points in time where the second audio content may be inserted. In such a case, the determination unit 134 determines the time position indicated by the tag as the time position to insert the second audio content.

[4-4. voice conversion]
In the above embodiment, the conversion unit 132 converts the text data of the content into speech data, that is, synthesizes speech. At this time, the conversion unit may convert the data into voice data in a form suitable for the user. For example, the conversion unit 132 converts into voice data according to the dialect of the user. Alternatively, the conversion unit 132 may cause the user to select, for example, a favorite celebrity (such as a voice actor) from a list, and convert the selected celebrity's voice into voice data.

[4-5. About output control (1)]
In the above embodiment, an example was given in which the output control unit 136 controls the volume, timbre, or pitch when the first audio content or the second audio content is output based on information about the user. Also, an example in which the output control unit 136 rewinds is shown. However, the output control unit 136 may perform the above-described output control based on the user's positional relationship as information about the user. Here, the user's positional relationship is, for example, the positional relationship between the user U1 and the smart speaker 30, taking the user U1 as an example. The output control unit 136 can acquire location information from the user U1 (terminal device 10) and the smart speaker 30. FIG. Therefore, for example, when the user U1 and the smart speaker 30 are separated by a predetermined distance or more, the output control unit 136 determines that the user U1 is at a position away from the smart speaker 30, so the user U1 cannot hear the voice. Decide that you are in a difficult situation. When determined in this way, the output control unit 136 controls, for example, to increase the volume of the distributed content.

As a result, the content control apparatus 100 according to the embodiment can perform output control according to the user's situation, so that the user's satisfaction with the audibility of the audio content can be enhanced.

[4-6. About output control (2)]
In addition, the output control unit 136 may perform output control using psychoacoustics. One example is the cocktail party effect. The cocktail party effect is the ability of humans to select and hear the sounds they need in the midst of noise. It is believed that this is related to the frequency difference between the noise and the desired voice. Therefore, the output control unit 136 controls the frequency of audio content. For example, the output control unit 136 controls the frequency of the audio content so that the user can easily hear the audio content.

As a result, the content control apparatus 100 according to the embodiment can perform output control according to the user's situation, so that the user's satisfaction with the audibility of the audio content can be enhanced.

[4-7. Regarding output control (3)]
The output control unit 136 may also control the output of the first audio content in conjunction with the output control of the second audio content. For example, if the user U1 is currently washing clothes, the output control unit 136 predicts that the user U1 was disturbed by the sound of washing and missed the audio content, and rewinds the audio content. For example, the output control unit 136 rewinds and plays the second audio content. Further, when the reproduction of the second audio content is completed, the output control unit 136 resumes the reproduction of the first audio content from the continuation. The volume is controlled so that the first audio content is also output at a volume higher than a predetermined value so that the first audio content can be easily heard. In addition, when resuming the reproduction of the first audio content, the output control unit 136 may output more important information for the user U1 in the surrounding environment of the user U1 (for example, when the television is on, the When a broadcast is being played, etc., the volume may be controlled so that the volume of the first audio content is output at a volume lower than a predetermined value.

[5. Hardware configuration]
Also, the content control apparatus 100 according to the above-described embodiments is implemented by a computer 1000 configured as shown in FIG. 12, for example. FIG. 12 is a hardware configuration diagram showing an example of a computer 1000 that implements the functions of the content control device 100. As shown in FIG. Computer 1000 has CPU 1100 , RAM 1200 , ROM 1300 , HDD 1400 , communication interface (I/F) 1500 , input/output interface (I/F) 1600 and media interface (I/F) 1700 .

The CPU 1100 operates based on programs stored in the ROM 1300 or HDD 1400 and controls each section. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started up, a program depending on the hardware of the computer 1000, and the like.

HDD 1400 stores programs executed by CPU 1100 and data used by these programs. Communication interface 1500 receives data from other devices via communication network 50 and sends the data to CPU 1100 , and transmits data generated by CPU 1100 to other devices via communication network 50 .

The CPU 1100 controls output devices such as displays and printers, and input devices such as keyboards and mice, through an input/output interface 1600 . CPU 1100 acquires data from an input device via input/output interface 1600 . CPU 1100 also outputs the generated data to an output device via input/output interface 1600 .

Media interface 1700 reads programs or data stored in recording medium 1800 and provides them to CPU 1100 via RAM 1200 . CPU 1100 loads such a program from recording medium 1800 onto RAM 1200 via media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or a PD (Phase change rewritable disc), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. etc.

For example, when the computer 1000 functions as the content control device 100 according to the embodiment, the CPU 1100 of the computer 1000 implements the functions of the control unit 130 by executing programs loaded onto the RAM 1200 . In addition, data in storage unit 120 is stored in HDD 1400 . CPU 1100 of computer 1000 reads these programs from recording medium 1800 and executes them, but as another example, these programs may be obtained from another device via communication network 50 .

[6. others〕
Of the processes described in the above embodiments, all or part of the processes described as being automatically performed can be manually performed, or all or part of the processes described as being manually performed. Part can also be done automatically by known methods. In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified.

Also, each component of each device illustrated is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution and integration of each device is not limited to the one shown in the figure, and all or part of them can be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions. Can be integrated and configured.

Moreover, each embodiment described above can be appropriately combined within a range in which the processing contents are not inconsistent.

[7. effect〕
The content control device 100 according to the embodiment has a reception section 137 and a content control section 138 . The accepting unit 137 accepts a voice instruction from the user that instructs to perform an operation for controlling reproduction of the output audio content. The content control unit 138 performs an operation on the audio content according to the audio instruction accepted by the accepting unit 137 .

Thereby, the content control apparatus 100 according to the embodiment can easily control the music content even when the audio content is being listened to.

Further, the receiving unit 137 receives, from the user, a voice instruction to perform an operation for controlling reproduction of the second audio content inserted in the first audio content as the output audio content.

Thereby, the content control apparatus 100 according to the embodiment can easily control the music content even when the second audio content is being listened to.

In addition, the reception unit 137 receives a voice instruction to rewind the audio content as an operation for controlling the reproduction of the audio content, and the content control unit 138 causes the reception unit 137 to receive a voice instruction to rewind the audio content. is accepted, rewind the audio content.

As a result, the content control apparatus 100 according to the embodiment can rewind the audio content with a single voice of the user, so that it is possible to easily implement countermeasures against missed hearing.

Further, the reception unit 137 receives a voice instruction to cue the audio content as an operation for controlling the reproduction of the audio content, and the content control unit 138 instructs the reception unit 137 to cue the audio content. To cue audio contents when a voice instruction is accepted.

As a result, the content control apparatus 100 according to the embodiment can cue audio content with a single voice of the user, so that measures against missed hearing can be easily implemented.

In addition, the reception unit 137 receives, as an operation for controlling the reproduction of the audio content, a voice instruction instructing to extract the audio content from the first audio content into which the audio content is inserted. When the audio instruction instructing to extract the audio content from the first audio content into which the audio content is inserted by 137 is received, the audio content is extracted from the first audio content.

As a result, the content control apparatus 100 according to the embodiment can store audio parts that are important to the user.

Also, the content control unit 138 transmits content related to the audio content extracted from the first audio content to another device different from the content control device.

As a result, the content control apparatus 100 according to the embodiment can store the audio portion that is important for the user in the terminal device of the user, so that the user can listen to the audio content again when he or she wants to hear it.

In addition, the reception unit 137 receives a voice instruction to fast-forward or skip the audio content as an operation for controlling the reproduction of the audio content, and the content control unit 138 causes the reception unit 137 to fast-forward the audio content or , fast-forwards or skips the audio content when a voice instruction instructing to skip is received.

As a result, the content control apparatus 100 according to the embodiment can fast-forward or skip audio content with the user's voice, so that the user can easily omit audio content that the user feels is unnecessary.

In addition, the reception unit 137 receives, as the voice instruction, a voice instruction in an utterance indicating the user's reaction to the audio content.

As a result, the content control apparatus 100 according to the embodiment can control the voice content by regarding even words that the user inadvertently uttered as a voice instruction, even if the user does not give a voice instruction according to the operation. can.

Also, the content control device 100 according to the embodiment has an acquisition unit 131 and a selection unit 135 . The acquisition unit 131 acquires a second audio content candidate to be inserted into the first audio content. The selection unit 135 selects the second audio content to be inserted into the first audio content from the second audio content candidates based on the user information about the user of the distribution destination. Then, the reception unit 137 issues a voice instruction to perform an operation for controlling reproduction of the second audio content selected by the selection unit 135, which is the second audio content inserted into the first audio content. Accept from users.

Thereby, the content control apparatus 100 according to the embodiment can easily control the music content even when the audio content is being listened to.

Also, the content control device 100 according to the embodiment has an acquisition unit 131 and a selection unit 135 . The acquisition unit 131 acquires a second audio content candidate to be inserted into the first audio content. The selection unit 135 selects the second audio content to be inserted into the first audio content from the second audio content candidates based on the user information about the user of the distribution destination.

As a result, the content control apparatus 100 according to the embodiment can provide the user with audio content that has been processed and controlled to the extent that the user can "catch it with the edge of the ear". can be provided effectively.

Further, the selection unit 135 selects the second audio content to be inserted into the first audio content from among the candidate second audio content based on the action history of the user as the user information about the user of the distribution destination. select.

Thereby, the content control apparatus 100 according to the embodiment can provide the second audio content that the user can "catch with the edge of the ear".

In addition, the selection unit 135 selects the first audio content among the second audio content candidates based on the user's operation history with respect to a predetermined output device that outputs the audio content as the user information about the user of the distribution destination. Selecting the second audio content to be inserted.

Thereby, the content control apparatus 100 according to the embodiment can make the user listen to the second audio content optimized (personalized) for each user.

Also, the content control device 100 according to the embodiment has a determination unit 134 . Based on the user information, the determining unit 134 selects the second audio content to be inserted into the first audio content and the time position at which the second audio content is to be inserted into the first audio content. A time position in the first audio content is determined. Also, the selection unit 135 selects the second content determined by the determination unit 134 as the target second audio content.

Thereby, the content control apparatus 100 according to the embodiment can provide the second audio content optimized (personalized) for each user at a time suitable for each user.

Further, the determining unit 134 determines the target second audio content and the time position based on the result of calculating what kind of audio content the user tends to listen to at what time based on the user information. do.

Thereby, the content control apparatus 100 according to the embodiment can improve the accuracy of personalization for the second audio content.

Further, based on the user information, the determining unit 134 selects the second audio content to be inserted into the first audio content, among the candidate second audio content, according to the user's living situation or hobbies and tastes. Determined as audio content.

As a result, the content control apparatus 100 according to the embodiment can improve the accuracy of personalization of the second audio content, and can provide audio content with a high degree of interest to the user.

Further, the content control device 100 according to the embodiment has an insertion section (selection section 135). The insertion unit (selection unit 135 ) inserts the second content at the time position determined by the determination unit 134 .

As a result, the content control apparatus 100 according to the embodiment can improve the accuracy of personalization of the second audio content, and can provide audio content with a high degree of interest to the user.

Also, the content control device 100 according to the embodiment has an output control unit 136 . The output control unit 136 controls output of the first audio content or the second audio content based on the information about the user.

Thereby, the content control apparatus 100 according to the embodiment can contribute to the ease of listening to the first audio content or the second audio content.

In addition, the output control unit 136 controls the output of the first audio content or the second audio content based on the environment information indicating the user's surrounding environment or the user's attribute information as information about the user.

Thereby, the content control apparatus 100 according to the embodiment can contribute to the ease of listening to the first audio content or the second audio content.

The output control unit 136 also controls the volume, tone color, or pitch when the first audio content or the second audio content is output, based on the information about the user.

Thereby, the content control apparatus 100 according to the embodiment can contribute to the ease of listening to the first audio content or the second audio content.

Also, the output control unit 136 rewinds the first audio content or the second audio content based on the information about the user.

Thereby, the content control apparatus 100 according to the embodiment can contribute to the ease of listening to the first audio content or the second audio content.

Also, the content control device 100 according to the embodiment has a conversion unit 132 . The conversion unit 132 converts predetermined content into audio data. Then, the acquiring unit 131 acquires the audio data converted by the converting unit 132 as a candidate second audio content to be inserted into the first audio content.

Thereby, the content control apparatus 100 according to the embodiment can synthesize audio content from text data content.

Further, the selection unit 135 selects the second content to be inserted into the first audio content among the candidate second audio content based on the user information about the user of the distribution destination, and the second content to be output from the smart speaker. Select the second content for which you want to

As a result, the content control apparatus 100 according to the embodiment can realize listening while outputting the audio content from the smart speaker.

As described above, the embodiments of the present application have been described in detail based on several drawings, but these are examples, and various modifications and It is possible to carry out the invention in other forms with modifications.

Also, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the acquisition unit can be read as acquisition means or an acquisition circuit.

1 control system 10 terminal device 30 output device 60 external device 100 content control device 121 content storage unit 122 action history storage unit 123 operation history storage unit 124 user information storage unit 125 distribution content storage unit 131 acquisition unit 132 conversion unit 133 identification unit 134 Determination unit 135 Selection unit 136 Output control unit 137 Acceptance unit 138 Contents control unit 139 Delivery unit

Claims (25)

an acquisition unit that acquires second audio content, which is content different in category from the first audio content;
Among the second audio contents acquired by the acquiring unit, the second audio contents belonging to the category determined based on the user information regarding the user of the distribution destination are newly inserted into the first audio contents. a selection unit that selects as the second audio content that
A second audio content inserted into the first audio content so as to be output at a playback position included in the first audio content, the playback position being determined based on the viewing tendency of the user for the audio content. a reception unit that receives from a user a voice instruction instructing to perform an operation for controlling reproduction of the second audio content selected by the selection unit;
and a content control unit that performs an operation on the second audio content according to the voice instruction received by the receiving unit. 2. The content control device according to claim 1, wherein the reception unit receives from a user a voice instruction instructing to perform an operation for controlling reproduction of the second audio content. The receiving unit receives, as an operation for controlling reproduction of the second audio content, a voice instruction instructing to rewind the second audio content,
3. The content control unit rewinds the second audio content when the reception unit receives a voice instruction to rewind the second audio content. 3. The content control device according to . The receiving unit receives, as an operation for controlling reproduction of the second audio content, a voice instruction instructing to cue the second audio content,
2. The content control unit cue the second audio content when the reception unit receives a voice instruction to cue the second audio content. 4. The content control device according to any one of 1 to 3. The reception unit provides, as an operation for controlling reproduction of the second audio content, a voice instruction instructing to extract the second audio content from the first audio content into which the second audio content is inserted. accept the
When the receiving unit receives a voice instruction to extract the second audio content from the first audio content into which the second audio content is inserted, the content control unit controls the second audio content to be extracted. 5. The content control device according to any one of claims 1 to 4, wherein second audio content is extracted from said first audio content. 6. The content control unit according to claim 5, wherein the content control unit transmits content related to the second audio content extracted from the first audio content to another device different from the content control device. content controller. The receiving unit receives a voice instruction instructing to fast-forward or skip the second audio content as an operation for controlling reproduction of the second audio content,
The content control unit fast-forwards or skips the second audio content when the receiving unit receives a voice instruction to fast-forward or skip the second audio content. A content control device according to any one of claims 1 to 6. The content control device according to any one of claims 1 to 7, wherein the receiving unit receives, as the voice instruction, an utterance indicating a user's reaction to the audio content. an acquisition unit that acquires second audio content, which is content different in category from the first audio content;
A selection unit that selects, from among the second audio contents acquired by the acquisition unit, second audio content to be newly inserted into the first audio content, based on user information about users of distribution destinations. When,
The second audio content selected by the selection unit is output at a playback position that is determined based on the viewing tendency of the user with respect to the audio content and is included in the first audio content. and an inserting unit for inserting data forming a second audio content into data forming the first audio content. The selecting unit selects the second audio content to be inserted into the first audio content from among the second audio content based on the action history of the user as user information about the user of the distribution destination. 10. The content control device according to claim 9, characterized by: The selection unit inserts into the first audio content out of the second audio content based on a user's operation history with respect to a predetermined output device that outputs audio content as user information about a user of a distribution destination. 11. The content control device according to claim 9 or 10, wherein the second audio content to be played is selected. A second audio content to be inserted into the first audio content based on the user information, and a playback position at which the target second audio content is inserted into the first audio content, further comprising a determination unit that determines a playback position included in the first audio content;
The content control device according to any one of claims 9 to 11, wherein the selection unit selects the target second audio content determined by the determination unit. The determining unit selects the second audio content of the target based on the viewing tendency, which is a calculation result of calculating what kind of audio content the user tends to listen to at what time based on the user information. and the playback position. Based on the user information, the determining unit selects a second audio content to be inserted into the first audio content, among the second audio content, according to the user's living situation or tastes and preferences. 14. The content control device according to claim 12 or 13, wherein the content is determined as audio content. 15. The inserting unit according to any one of claims 12 to 14, further comprising an inserting unit for inserting the second audio content selected by the selecting unit into the playback position determined by the determining unit. The content control device according to 1. 16. The apparatus according to any one of claims 9 to 15, further comprising an output control unit that controls output of said first audio content or said second audio content based on information regarding said user. Content controller. The output control unit controls the output of the first audio content or the second audio content based on environment information indicating the surrounding environment of the user or attribute information of the user as the information about the user. 17. The content control device according to claim 16, characterized by: 17. The output control unit controls volume, timbre, or pitch when the first audio content or the second audio content is output, based on the information about the user. 18. The content control device according to 17. The content control according to any one of claims 16 to 18, wherein the output control unit rewinds the first audio content or the second audio content based on information about the user. Device. further comprising a conversion unit that converts predetermined content into audio data;
20. The method according to any one of claims 9 to 19, wherein the acquisition unit acquires audio data converted by the conversion unit as second audio content to be inserted into the first audio content. A content controller as described. The selection unit selects second audio content to be inserted into the first audio content among the second audio content based on user information about a user of a distribution destination, the second audio content being output from a smart speaker. The content control device according to any one of claims 9 to 20, characterized in that it selects the target second audio content. A control method executed by a content control device,
an acquisition step of acquiring second audio content, which is content in a category different from that of the first audio content;
Among the second audio contents acquired in the acquiring step, a second audio content belonging to a category determined based on user information about a user of a distribution destination is newly inserted into the first audio content. a selection step of selecting as a second audio content to
A second audio content inserted into the first audio content so as to be output at a playback position included in the first audio content, the playback position being determined based on the viewing tendency of the user for the audio content. a receiving step of receiving from a user a voice instruction instructing to perform an operation for controlling reproduction of the second audio content selected in the selecting step;
and a content control step of performing an operation on the second audio content in accordance with the voice instruction accepted by the accepting step. A control method executed by a content control device,
an acquisition step of acquiring second audio content, which is content in a category different from that of the first audio content;
A selection step of selecting a second audio content to be newly inserted into the first audio content from among the second audio content obtained in the obtaining step, based on user information about a user of a distribution destination. When,
The second audio content selected by the selecting step is output at a playback position determined based on the viewing tendency of the user for the audio content and included in the first audio content. and an inserting step of inserting data constituting a second audio content into data constituting the first audio content. an acquisition procedure for acquiring second audio content, which is other content whose category is different from that of the first audio content;
Among the second audio contents acquired by the acquisition procedure, a second audio content belonging to a category determined based on user information regarding a user of a distribution destination is newly inserted into the first audio content. a selection procedure for selecting as a second audio content that
A second audio content inserted into the first audio content so as to be output at a playback position included in the first audio content, the playback position being determined based on the viewing tendency of the user for the audio content. a reception procedure for accepting a voice instruction from a user for instructing an operation to control reproduction of the second audio content selected by the selection procedure;
A control program for causing a computer to execute a content control procedure for performing an operation on the second audio content in accordance with the voice instruction accepted by the acceptance procedure. an acquisition procedure for acquiring second audio content, which is other content whose category is different from that of the first audio content;
A selection procedure for selecting a second audio content to be newly inserted into the first audio content from among the second audio contents acquired by the acquisition procedure, based on user information about a user of a distribution destination. When,
The second audio content selected by the selection procedure is output at a playback position determined based on the viewing tendency of the user for the audio content and included in the first audio content. A control program for causing a computer to execute an insertion procedure for inserting data constituting a second audio content into data constituting the first audio content.

Images