JP2021018323A - Information providing device, information providing method, and program - Google Patents

Abstract

To provide an information providing device, an information providing method, and a program capable of promptly providing information to vehicle occupants by voice guidance when playing music and voice guidance are performed in parallel.SOLUTION: An information providing device includes a music reproduction unit which reproduces music in a vehicle interior and a voice guidance unit which causes an output unit to output information by voice in the vehicle interior. When the reproduction of music is performed by the music reproduction unit, the voice guidance unit causes the output unit to output the information during a period in which a content of the music being played is a prelude, an interlude, or an end of the music.SELECTED DRAWING: Figure 2

Description

The present invention relates to an information providing device, an information providing method, and a program.

Conventionally, there is known a technique for adjusting the timing of voice guidance between songs that are continuously played in chronological order when the music is played back and voice guidance is performed in parallel (for example, Patent Documents). 1).

International Publication No. 2009/141853

By the way, in the conventional technology, even if voice guidance is performed during music playback, voice guidance cannot be performed until the music playback is completed, and the provision of information to the vehicle occupants by voice guidance is delayed. was there.

The present invention has been made in consideration of such circumstances, and when playing music and performing voice guidance, it is possible to provide information to vehicle occupants by voice guidance at a more appropriate timing. One of the purposes is to provide an information providing device, an information providing method, and a program.

The information providing device, the information providing method, and the program according to the present invention have adopted the following configurations.
(1): The information providing device according to one aspect of the present invention includes a music reproduction unit that reproduces music in the vehicle interior and a voice guidance unit that outputs information by voice to the output unit in the vehicle interior. When the music reproduction unit is playing the music, the voice guidance unit outputs the information to the output unit during a period in which the content of the music being played is a prelude, an interlude, or an end of the music. It is to be output.

(2): In the embodiment of (1) above, the first acquisition unit and the first acquisition unit for acquiring the first required time for the music reproduction unit to reproduce the prelude, interlude, or end of the music. It is further provided with an information adjusting unit that adjusts the information that the voice guidance unit outputs to the output unit based on the first required time acquired by the unit.

(3): In the aspect of the above (1) or (2), the music reproduction unit is described according to the length of the second required time for the voice guidance unit to output the information to the output unit. It repeatedly plays the prelude, interlude, or end of a piece of music.

(4): In the aspects (1) to (3) above, the second acquisition unit for acquiring the reproduction history of the music is further provided, and the voice guidance unit is the music of the music acquired by the second acquisition unit. When the number of times of reproduction is less than or equal to a predetermined number of times, the output of the information by the output unit is suppressed.

(5): In the aspects (1) to (4) above, the third acquisition unit for acquiring the announcement date of the music is further provided, and the voice guidance unit is the music piece acquired by the third acquisition unit. When the elapsed period from the announcement date is less than or equal to a predetermined period, the output of the information by the output unit is suppressed.

(6): In the aspects (1) to (5) above, the fourth acquisition unit for acquiring the voice emitted by the occupant of the vehicle detected by the voice detection device is further provided, and the voice guidance unit is the music piece. When the sound emitted by the occupant of the vehicle is acquired by the fourth acquisition unit while the reproduction unit is playing the music, the output of the information by the output unit is suppressed.

(7): In the above aspects (4) to (6), when the amount of information of the information output from the output unit is suppressed, the voice guidance unit uses the information before being suppressed as the vehicle. It is transmitted to the mobile information terminal of the occupant.

(8): The information providing method according to another aspect of the present invention is a case where a computer reproduces a musical piece in a vehicle interior, outputs information by voice in the vehicle interior, and reproduces the musical piece. , The information is output during the period when the content of the music being played is the prelude, the interlude, or the end of the music.

(9): In the program according to another aspect of the present invention, a computer performs a process of playing a musical piece in a vehicle interior, a process of outputting information by voice in the vehicle interior, and a process of playing the musical piece. If so, the process of outputting the information is executed during the period when the content of the music being played is the prelude, the interlude, or the end of the music.

According to (1) to (9), when playing a musical piece and performing voice guidance, it is possible to provide information to the occupants of the vehicle by voice guidance at a more appropriate timing.

It is a figure which shows the structure of the agent system 1 including the agent apparatus 100. It is a figure which shows the structure of the agent apparatus 100 which concerns on 1st Embodiment, and the apparatus mounted on the vehicle M. It is a figure which shows an example of the data registered in a music DB 122. It is a figure which shows an example of the data registered in the voice guidance DB 124. It is a figure which shows an example of music data. It is a figure for demonstrating an example of the adjustment method of guidance information. It is a figure for demonstrating an example of the adjustment method of guidance information. It is a flowchart for demonstrating the flow of a series of processing of the agent apparatus 100 which concerns on 1st Embodiment. It is a flowchart for demonstrating the flow of a series of processing of the agent apparatus 100 which concerns on 2nd Embodiment. It is a figure which shows the structure of the agent apparatus 100 which concerns on 3rd Embodiment, and the apparatus mounted on the vehicle M.

<First Embodiment>
Hereinafter, the information providing device, the information providing method, and the embodiment of the program of the present invention will be described with reference to the drawings. Hereinafter, as an example of the information providing device, an agent device mounted on a vehicle (hereinafter, vehicle M) and having an agent function will be described. The agent function is, for example, various types of requests (commands) based on the utterance of the occupant while interacting with the occupant of the vehicle M by using at least a part of the network connection using the wireless communication device. It is a function that provides information and mediates network services. Each agent may have different functions, processing procedures, controls, output modes / contents. In addition, some of the agent functions may have a function of controlling vehicle equipment (for example, equipment related to driving control and vehicle body control).

Agent functions include, for example, a voice recognition function that recognizes the voice of an occupant (a function that converts voice into text), a natural language processing function (a function that understands the structure and meaning of text), a dialogue management function, and a network. It is realized by integratedly using a network search function or the like that searches for another device or a predetermined database owned by the own device. Some or all of these functions may be realized by AI (Artificial Intelligence) technology. In addition, a part of the configuration for performing these functions (particularly, the voice recognition function and the natural language processing interpretation function) is an agent server capable of communicating with the in-vehicle communication device of the vehicle M or the general-purpose communication device brought into the vehicle M. It may be mounted on (external device). In the following description, it is assumed that a part of the configuration is installed in the agent server, and the agent device and the agent server cooperate to realize the agent system. Further, a service provider (service entity) in which an agent device and an agent server cooperate to appear virtually is called an agent.

[overall structure]
FIG. 1 is a configuration diagram of an agent system 1 including an agent device 100. The agent system 1 includes, for example, an agent device 100 and an agent server 200. The agent server 200 may be one or a plurality. The agent server 200 is operated by the provider of the agent system. Examples of providers include automobile manufacturers, network service providers, e-commerce businesses, mobile terminal sellers and manufacturers, and any entity (corporation, group, individual, etc.) is the provider of the agent system. Can be.

The agent device 100 communicates with the agent server 200 via the network NW. The network NW includes, for example, a part or all of an Internet, a cellular network, a Wi-Fi network, a WAN (Wide Area Network), a LAN (Local Area Network), a public line, a telephone line, a wireless base station, and the like. Various web servers 300 are connected to the network NW, and the agent server 200 or the agent device 100 can acquire web pages from the various web servers 300 via the network NW.

The agent device 100 interacts with the occupant of the vehicle M, transmits the voice from the occupant to the agent server 200, and presents the answer obtained from the agent server 200 to the occupant in the form of voice output or image display.

[vehicle]
FIG. 2 is a diagram showing the configuration of the agent device 100 according to the first embodiment and the equipment mounted on the vehicle M. The vehicle M is equipped with, for example, one or more microphones 10, a display / operation device 20, a speaker unit 30, a navigation device 40, a vehicle device 50, a communication device 60, and an agent device 100. These devices are connected to each other by a multiplex communication line such as a CAN (Controller Area Network) communication line, a serial communication line, a wireless communication network, or the like. The configuration shown in FIG. 2 is merely an example, and a part of the configuration may be omitted or another configuration may be added.

The microphone 10 is an example of a voice detection device that detects a voice emitted in a vehicle interior. The display / operation device 20 is a device (or a group of devices) capable of displaying an image and accepting an input operation. The display / operation device 20 includes, for example, a display device configured as a touch panel. The display / operation device 20 may further include a HUD (Head Up Display) or a mechanical input device. The speaker unit 30 includes, for example, a plurality of speakers (sound output units) arranged at different positions in the vehicle interior. The display / operation device 20 may be shared by the agent device 100 and the navigation device 40.

The navigation device 40 includes a navigation HMI (Human machine Interface), a positioning device such as a GPS (Global Positioning System), a storage device that stores map information, and a control device that performs route search and the like. A part or all of the microphone 10, the display / operation device 20, and the speaker unit 30 may be used as the navigation HMI. The navigation device 40 searches for a route (navigation route) for moving from the position of the vehicle M specified by the positioning device to the destination input by the occupant, so that the vehicle M can travel along the route. , Navi HMI is used to output guidance information. The route search function may be provided in a navigation server accessible via the network NW. In this case, the navigation device 40 acquires a route from the navigation server and outputs guidance information.

The vehicle equipment 50 includes, for example, a driving force output device such as an engine or a traveling motor, an engine start motor, a door lock device, a door opening / closing device, a window, a window opening / closing device, a window opening / closing control device, a seat, and a seat position. Control device, room mirror and its angle position control device, lighting device inside and outside the vehicle and its control device, wiper and defogger and their respective control devices, direction indicator and its control device, air conditioner, mileage and tire pressure information And vehicle information devices such as fuel level information.

The communication device 60 can access the network NW by using, for example, a cellular network or a Wi-Fi network. The communication device 60 includes, for example, an in-vehicle communication device and a general-purpose communication device such as a smartphone that is brought into the vehicle interior.

[Agent device]
The agent device 100 includes, for example, a control unit 110 and a storage unit 120. The control unit 110 includes, for example, a music reproduction unit 112, an acquisition unit 114, an information adjustment unit 116, and a voice guidance unit 118. Each component other than the storage unit 120 of the agent device 100 is realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components are hardware (circuit parts;) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit). It may be realized by (including circuits), or it may be realized by the cooperation of software and hardware. The program may be stored in advance in a storage device (a storage device including a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or a removable storage device such as a DVD or a CD-ROM. It is stored in a medium (non-transient storage medium) and may be installed by mounting the storage medium in a drive device. The storage unit 120 is realized by an HDD, a flash memory, a RAM (Random Access Memory), or the like. The storage unit 120 stores, for example, the music DB 122, the voice guidance DB 124, and the history information 126. The history information 126 includes information related to the reproduction history of the music, such as the reproduction date and time and the number of times of reproduction for each music.

The control unit 110 functions by executing a program such as an OS (Operating System) or middleware.

The music reproduction unit 112 reproduces the music in the vehicle interior by outputting the music data read from the music DB 122 stored in the storage unit 120 to the speaker unit 30. When the music is reproduced, the music reproduction unit 112 stores information such as the reproduction date and time of the reproduced music and the number of times of reproduction as history information 126 in the storage unit 120. The music reproduction unit 112 may acquire music data from the navigation device 40 and output it to the speaker unit 30.

FIG. 3 is a diagram showing an example of the data content of the music DB 122. In the illustrated example, in the music DB 122, a category, a start time, an end time, and a guidance notification available time are associated with the music ID. The music ID is identification information for the music reproduction unit 112 to identify the music to be reproduced. The category is information indicating a part of a musical piece such as an intro (prelude), an A melody, a B melody, a chorus, an interlude, and an outro (final). The verses, verses, and choruses are information indicating a part of a characteristic section of a musical piece. The characteristic section is, for example, a section in which the tune changes. The prelude is the starting section of a piece of music that does not include a singing voice. The interlude is a section of the music that does not include the singing voice. The end is the end section of the music that does not include the singing voice. The start time is information indicating the time from the beginning of the music to the start of the part of the music. The end time is information indicating the time from the beginning of the music to the end of the part of the music. The guidance notification possible time is information indicating the time during which the voice guidance by the voice guidance unit 118 can be executed in the vehicle interior when the music is being played. In the present embodiment, when the category of the music is prelude, interlude, or end, the time obtained by subtracting the start time from the end time is set as the guidance notification possible time.

The acquisition unit 114 refers to the music DB 122 stored in the storage unit 120, and acquires the first required time for reproducing the prelude, interlude, or end of the music. The acquisition unit 114 is an example of the “first acquisition unit”. For example, when the music reproduction unit 112 plays a music, the acquisition unit 114 has the music ID of the music to be reproduced from the data registered in the music DB 122 based on the information acquired from the music reproduction unit 112. To specify. Further, the acquisition unit 114 sets the time obtained by subtracting the start time from the end time as the first required time for the data whose music category is prelude, interlude, or end among the data corresponding to the designated music ID. get.

The information adjusting unit 116 determines whether or not the guidance information is fixed information, and adjusts the information voice-guided by the voice guidance unit 118 based on the determination result. The information adjusting unit 116 determines, for example, whether or not the voice-guided information is fixed information based on the flag information included in the guidance information. When the information adjusting unit 116 determines that the voice-guided information is fixed information, the information adjusting unit 116 does not adjust the information. Further, when the information adjusting unit 116 determines that the voice-guided information is fixed information, the information adjusting unit 116 adjusts the information. The voice-guided information includes less urgent information such as tourist information provided when the vehicle M travels in the vicinity of a tourist spot. The information adjusting unit 116 adjusts the information to be voice-guided so that the voice guidance is completed within the first required time. The first required time is, for example, the time for the music reproduction unit 112 to reproduce the prelude, interlude, or end of the music. The information adjusting unit 116 adjusts the information voice-guided by the voice guidance unit 118, for example, by combining the elements of the utterance content registered in the voice guidance DB 124.

FIG. 4 is a diagram showing an example of data registered in the voice guidance DB 124. In the illustrated example, the voice guidance DB 124 is associated with an information ID, an utterance content, an essential flag, a priority, a time cost, and a duplicate information ID. The guidance ID is identification information for identifying an utterance used for voice guidance when the voice guidance unit 118 provides voice guidance. The information ID is identification information for specifying the utterance category for each utterance order in a series of voice guidance by the voice guidance unit 118. The essential flag is information for identifying the utterance content that is essential to be included in the voice guidance among the utterance contents used for the voice guidance. When the required flag is set to "1", it indicates that it is essential to include the corresponding utterance content in the voice guidance. The priority is information used when determining the utterance content to be included in the voice guidance, and the higher the priority, the easier it is for the corresponding utterance content to be included in the voice guidance. The time cost is information indicating the time required to reproduce the utterance content used for voice guidance. The duplicate information ID is information that is commonly given to the information IDs whose utterance contents are duplicated among the information IDs corresponding to one guide ID. The duplicate information ID is used to regulate the inclusion of duplicate utterance contents in a series of voice guidance by the voice guidance unit 118. The voice guidance DB 124 is information acquired from the agent server 200, for example, based on a trigger condition described later.

When the trigger condition for notifying the guidance information is satisfied, the voice guidance unit 118 causes the information adjustment unit 116 to refer to the voice guidance DB 124 and output a voice combining the utterance contents from the speaker unit 30 to the occupant of the vehicle M. Provide voice guidance. The speaker unit 30 is an example of an “output unit”. The trigger condition is satisfied when information with low urgency is acquired, for example, when the vehicle M reaches the vicinity of a preset tourist spot.

The voice guidance unit 118 provides voice guidance to the occupants of the vehicle M between the time when the trigger condition is satisfied and the time limit elapses. The time limit is, for example, the time from when the trigger condition is satisfied to when it is not satisfied. Further, the time limit is, for example, a time that fluctuates according to the behavior of the vehicle M. The time limit is, for example, the time from when the traveling vehicle reaches the vicinity of the tourist spot to when the vehicle is separated from the tourist spot by a predetermined distance or more.

FIG. 5 is a diagram showing an example of music data. In the illustrated example, the music data is data including an intro (prelude), verse, B melody, chorus, interlude, and outro (final) as a part of the music, and guide information is provided for the data corresponding to the interlude. Are associated with each other. In this example, the agent device 100 uses the voice guidance unit 118 to provide guidance information associated with the data corresponding to the interlude while the music reproduction unit 112 is playing the interlude as a part of the music. Notify to. For example, the voice guidance unit 118 may notify the guidance information at the timing when the music reproduction unit 112 starts playing the interlude, or the guidance information may be notified at the timing when a predetermined time has elapsed after playing the interlude of the music. You may notify. Further, the voice guidance unit 118 may be controlled so that the notification of the guidance information is completed before the timing when the chorus of the interlude is started, for example. As a result, guidance information can be provided at an appropriate timing.

The music reproduction unit 112 repeatedly reproduces the interlude of the music, for example, according to the length of the second required time for the voice guidance unit 118 to output the voice guidance to the speaker unit 30. FIG. 6 is a diagram for explaining a first example of a method of adjusting guidance information. In the first example, as shown in FIG. 6, in the music reproduction unit 112, the first required time X for reproducing the interlude of the music is the second required time for outputting the guidance information to the speaker unit 30. If it is longer than T1, the interlude of the music is played as usual. FIG. 7 is a diagram for explaining a second example of the method of adjusting the guidance information. In the second example, as shown in FIG. 7, in the music reproduction unit 112, the first required time X for reproducing the interlude of the music is the second required time for outputting the guidance information to the speaker unit 30. If it is shorter than T2, at least a part of the interlude of the music is looped and reproduced so that the output of the guidance information is completed while the interlude of the music is being reproduced. For example, the music reproduction unit 112 extracts a section having a cohesive tone from the interlude of the music, and repeatedly reproduces the extracted section over one or a plurality of times. Further, the music reproduction unit 112 may repeatedly reproduce, for example, the section immediately before the chorus in the interlude of the music. Further, the music reproduction unit 112 may insert an effect sound having an atmosphere similar to that of the interlude of the music. As a result, the interlude of the music can be extended while suppressing the feeling of strangeness. In addition, the above-mentioned section may be the prelude or the end of the music instead of the interlude of the music. Further, in the case of the prelude or the end of the music, the music reproduction unit 112 may extend the prelude or the end of the music by using a part of other music to be continuously reproduced.

[Processing flow of agent device]
Hereinafter, a series of processing flows of the agent device 100 according to the first embodiment will be described with reference to a flowchart. FIG. 8 is a flowchart showing an example of a flow of a series of processes by the agent device 100 according to the first embodiment. FIG. 8 is a flowchart showing an example of notification processing of guidance information. The processing of the flowchart shown in FIG. 8 may be executed, for example, when the trigger condition for notifying the guidance information is satisfied.

The voice guidance unit 118 acquires the time limit for notifying the guidance information (step S10). The time limit may be a fixed time in advance or a time that varies depending on the notification content of the guidance information. Next, the voice guidance unit 118 determines whether or not the time limit acquired in step S10 is smaller than the time until the next interlude acquired by the acquisition unit 114 with reference to the music DB 122 (step S12). When the voice guidance unit 118 determines that the time limit is smaller than the time until the next interlude, the processing of this flowchart ends. On the other hand, when the voice guidance unit 118 determines that the time limit is longer than the time until the next interlude, the voice guidance unit 118 refers to the music DB 122 and acquires the start time of the next interlude.

Then, the voice guidance unit 118 acquires the time from the start time of the next interlude to the end timing of the time limit as the interlude time within the time limit (step S14). Next, the voice guidance unit 118 refers to, for example, the flag information included in the guidance information to be notified, and determines whether or not the guidance information is fixed (step S16). When the voice guidance unit 118 determines that the guidance information is not fixed, the information adjustment unit 116 adjusts the guidance information based on the interlude time within the time limit (step S18).

On the other hand, when the voice guidance unit 118 determines that the guidance information is fixed, the information adjustment unit 116 shifts the processing to step S20 without going through the process of step S18. Next, the voice guidance unit 118 determines whether or not the guidance information can be notified within the interlude time (step S20). When the voice guidance unit 118 determines that the guidance information can be notified within the interlude time, the voice guidance unit 118 determines whether or not the notification timing of the guidance information has been reached (step S26).

On the other hand, when the voice guidance unit 118 determines that the guidance information cannot be notified within the interlude time, the music reproduction unit 112 is equipped with a function of repeating the interlude of the music, and the music can be repeated. Whether or not it is determined (step S22). When the voice guidance unit 118 determines that the music reproduction unit 112 has a function of repeating the interlude of the music and the music can be repeated, the length of the second required time for notifying the guidance information is long. Correspondingly, the music reproduction unit 112 repeatedly reproduces the interlude of the music (step S24).

Next, the voice guidance unit 118 determines whether or not the notification timing of the guidance information has been reached (step S26). When the voice guidance unit 118 determines that the notification timing of the guidance information has been reached, the voice guidance unit 118 outputs the guidance information to the speaker unit 30 and notifies the occupant of the vehicle M (step S28). This completes the processing of this flowchart. On the other hand, if the voice guidance unit 118 determines in step S22 that the function of repeating the interlude of the music is not implemented in the music reproduction unit 112, or that the music is not repeatable, the voice guidance unit 118 provides the guidance information to the vehicle. The processing of this flowchart ends without notifying the occupant of M.

According to the agent device 100 according to the first embodiment described above, when the music reproduction and the voice guidance are performed in parallel, the information can be quickly provided to the occupant of the vehicle M by the voice guidance. .. For example, when playing music and voice guidance in parallel, if voice guidance cannot be executed until the playback of one song is completed, the provision of information to the occupants of vehicle M by voice guidance may be delayed. there were. Therefore, according to the agent device 100 according to the first embodiment, when the music is being reproduced by the music reproduction unit 112, the voice guidance unit 118 is in a period during which the content of the music being reproduced is an interlude of the music. , Perform voice guidance. As a result, when the music is played back and the voice guidance is performed in parallel, the information can be provided to the occupants of the vehicle by the voice guidance at an appropriate timing.

<Second Embodiment>
Hereinafter, the second embodiment will be described. The second embodiment is different from the first embodiment in that when the reproduction of the music is prioritized over the voice guidance, the output of the guidance information during the reproduction of the music is restricted. Hereinafter, this difference will be mainly described. In the second embodiment, the same agent device 100 as in the first embodiment can be applied, so a specific description thereof will be omitted here.

Hereinafter, a series of processing flows of the agent device 100 according to the second embodiment will be described with reference to a flowchart. FIG. 9 is a flowchart showing an example of a flow of a series of processes by the agent device 100 according to the second embodiment. Specifically, FIG. 9 shows an example of the restriction processing of the guidance information. In the example of FIG. 9, it is assumed that the guidance information has already been adjusted by the information adjusting unit 116.

The voice guidance unit 118 refers to the history information 126 stored in the storage unit 120, and determines whether or not the number of times the music is reproduced by the music reproduction unit 112 is equal to or less than a predetermined number of times (step S30). The number of times the music is played is, for example, registered in the music DB 122 in association with the music data, and is acquired by the acquisition unit 114. In this scene, the acquisition unit 114 is an example of the “second acquisition unit”.

When the voice guidance unit 118 determines that the number of times the music has been played is the predetermined number of times or more, the voice guidance unit 118 determines whether or not the elapsed period from the announcement date of the music is the predetermined period or less (step S32). The announcement date of the music is registered in, for example, the music DB 122 or various web servers 300, and is acquired by the acquisition unit 114. In this scene, the acquisition unit 114 is an example of the “third acquisition unit”.

Next, when the voice guidance unit 118 determines that the elapsed period from the announcement date of the music is equal to or longer than a predetermined period, the voice guidance unit 118 is detected by the microphone 10 while the music reproduction unit 112 is playing the music. It is determined whether or not the voice emitted by the occupant of the vehicle M is acquired by the acquisition unit 114 (step S34). In this scene, the acquisition unit 114 is an example of the "fourth acquisition unit". When the voice guidance unit 118 determines that the acquisition unit 114 has not acquired the voice emitted by the occupant of the vehicle M detected by the microphone 10 while the music reproduction unit 112 is playing the music. , The processing of this flowchart is completed without limiting the guidance information. On the other hand, when the voice guidance unit 118 determines that the number of times the music has been played is less than or equal to the predetermined number of times, or when the elapsed period from the announcement date of the music is less than or equal to the predetermined period, or when the music playing unit 112 plays the music. If it is determined that the acquisition unit 114 has acquired the voice emitted by the occupant of the vehicle M detected by the microphone 10 during playback, the output of guidance information to the speaker unit 30 is suppressed (step S36). ). Suppressing the output of guidance information includes, for example, simplifying the guidance information and suppressing the amount of information. Next, the voice guidance unit 118 transmits the guidance information before being suppressed to the mobile information terminal of the occupant of the vehicle M (step S38). This completes the processing of this flowchart.

According to the agent device 100 according to the second embodiment described above, the same effect as that of the agent device 100 according to the first embodiment is obtained, and the intention of the occupant of the vehicle M is contrary to the notification of the voice guidance. Therefore, it is possible to prevent the reproduction of the music from being hindered. As a result, it is possible to suppress the notification of voice guidance during playback of the music that the occupant of the vehicle M does not want to be disturbed. Music that is not desired to be disturbed includes, for example, music that has just been released, music that has just been uploaded, and music that has been played less frequently. Further, the music that is not desired to be disturbed may include, for example, a music that the occupant is singing along with the reproduction of the music.

Further, in the second embodiment, the voice guidance unit 118 transmits the guidance information before the restriction to the mobile information terminal of the occupant of the vehicle M, so that the guidance information is transmitted through the speaker unit 30 mounted on the vehicle M. Even if the output is limited, the guidance information can be accurately transmitted to the occupants of the vehicle M through the mobile information terminal.

<Third Embodiment>
Hereinafter, the third embodiment will be described. The third embodiment is different from the first and second embodiments in that the music reproduction device is configured as a separate body from the agent device 100. Hereinafter, this difference will be mainly described.

FIG. 10 is a diagram showing the configuration of the agent device 100 according to the third embodiment and the equipment mounted on the vehicle M. As shown in FIG. 10, the vehicle M according to the third embodiment includes, for example, communication with one or more microphones 10, a display / operation device 20, a speaker unit 30, a navigation device 40, and a vehicle device 50. The device 60, the agent device 100, and the music playback device 500 are mounted.

The agent device 100 includes, for example, a control unit 110A and a storage unit 120. The control unit 110A includes, for example, an acquisition unit 114A, an information adjustment unit 116A, and a voice guidance unit 118A. The music reproduction device 500 includes, for example, a music reproduction unit 510 and a storage unit 520.

The music reproduction unit 510 acquires music data from the music DB 522 stored in the storage unit 520 and outputs the music data to the agent device 100. The acquisition unit 114A of the agent device 100 acquires the music data output from the music playback device 500. The information adjustment unit 116A adjusts the music data acquired by the acquisition unit 114A. The voice guidance unit 118A outputs the music data adjusted by the information adjustment unit 116A to the speaker unit 30 to play the music in the vehicle interior, and outputs the guidance information to the speaker unit 30 to notify the occupants of the vehicle M. ..

According to the agent device 100 according to the third embodiment described above, the same effect as that of the agent device 100 according to the first and second embodiments is obtained, and the music reproduction device 500 and the agent device 100 configured separately are obtained. By using and, it is possible to provide information to the occupants of the vehicle M by voice guidance at an appropriate timing.

<Modification example of each embodiment>
In the second embodiment, the voice guidance unit 118 determines that the music is nostalgic for the occupant of the vehicle M, for example, when the elapsed time from the day when the music was last heard is longer than a predetermined period. The output of guidance information may be suppressed while the music is being played. Further, the voice guidance unit 118 may suppress the output of guidance information while playing the music even when there is a clear request from the occupant of the vehicle M, for example, a music suitable for a date. ..

In the second embodiment, the voice guidance unit 118 determines that the number of times the music has been played is less than or equal to the predetermined number of times, or when the elapsed period from the announcement date of the music is less than or equal to the predetermined period, or when the music is played. When it is determined that the voice emitted by the occupant of the vehicle M detected by the microphone 10 is acquired by the acquisition unit 114 while the unit 112 is playing the music, the output of the guidance information is not suppressed. Good. In this case, the voice guidance unit 118 reproduces a song that the occupant of the vehicle M is likely to be interested in, such as a song that has just been released, a song that has just been uploaded, and a song that has been played less frequently. By notifying the guidance information while in the meantime, the advertising effect of the guidance information can be enhanced.

In each of the above embodiments, when the guidance information includes an element of the advertisement, the voice guidance unit 118 may determine the notification timing of the guidance information in consideration of the request from the advertiser. For example, when there is a strong request from the advertiser, the voice guidance unit 118 notifies the guidance information not only while playing the interlude of the music but also while playing the chorus of the music. You may. Further, for example, when the occupant of the vehicle M is a member who uses the reproduction of the music in the vehicle interior for a fee, the voice guidance unit 118 notifies the guidance information regardless of whether or not there is a request from the advertiser. You may refuse and give priority to the playback of the music.

In each of the above embodiments, for example, when the vehicle interior camera is mounted on the vehicle M, the agent device 100 recognizes the state of the occupant from the image taken by the vehicle interior camera, and voice guidance is performed based on the recognition result. Notification of voice guidance by units 118 and 118A may be controlled.

In each of the above embodiments, the agent device 100 guides the occupant of the vehicle M in place of or in addition to the voice guidance by the voice guidance units 118 and 118A by text display of the music content using the display / operation device 20. Information may be notified.

In each of the above embodiments, the agent device 100 may notify the occupant of the vehicle M of the guidance information in cooperation with, for example, the mobile information terminal of the occupant of the vehicle M. In this case, the guidance information may include information related to the maintenance of the vehicle M, such as a warning of oil change of the vehicle M.

Although the embodiments for carrying out the present invention have been described above using the embodiments, the present invention is not limited to these embodiments, and various modifications and substitutions are made without departing from the gist of the present invention. Can be added.

10 ... Microphone, 20 ... Display / operation device, 30 ... Speaker unit, 40 ... Navigation device, 50 ... Vehicle equipment, 60 ... Communication device, 100 ... Agent device, 110 ... Control unit, 112 ... Music playback unit, 114 ... Acquisition Unit, 116 ... Information adjustment unit, 118 ... Voice guidance unit, 120 ... Storage unit, 122 ... Music DB, 124 ... Voice guidance DB.

Claims (9)

A music playback unit that plays music in the passenger compartment,
A voice guidance unit that outputs information to the output unit by voice in the vehicle interior,
With
When the music reproduction unit is playing the music, the voice guidance unit outputs the information to the output unit during a period in which the content of the music being played is a prelude, an interlude, or an end of the music. Output,
Information providing device. The first acquisition unit for acquiring the first required time for the music reproduction unit to reproduce the prelude, interlude, or end of the music.
An information adjusting unit that adjusts the information that the voice guidance unit outputs to the output unit based on the first required time acquired by the first acquisition unit.
Further prepare
The information providing device according to claim 1. The music reproduction unit repeatedly reproduces the prelude, interlude, or end of the music according to the length of the second required time for the voice guidance unit to output the information to the output unit.
The information providing device according to claim 1 or 2. A second acquisition unit for acquiring the playback history of the music is further provided.
The voice guidance unit suppresses the output of the information by the output unit when the number of times the music played by the second acquisition unit is less than or equal to a predetermined number of times.
The information providing device according to any one of claims 1 to 3. It also has a third acquisition unit that acquires the release date of the song.
When the elapsed period from the announcement date of the music acquired by the third acquisition unit is less than or equal to a predetermined period, the voice guidance unit suppresses the output of the information by the output unit.
The information providing device according to any one of claims 1 to 4. It is further equipped with a fourth acquisition unit that acquires the voice emitted by the occupant of the vehicle, which is detected by the voice detection device.
The voice guidance unit outputs the information by the output unit when the voice emitted by the occupant of the vehicle is acquired by the fourth acquisition unit while the music reproduction unit is playing the music. Suppress,
The information providing device according to any one of claims 1 to 5. When the amount of information of the information output from the output unit is suppressed, the voice guidance unit transmits the information before the suppression to the mobile information terminal of the occupant of the vehicle.
The information providing device according to any one of claims 4 to 6. The computer
Play music in the car,
Information is output by voice in the passenger compartment.
When the music is being played, the information is output during the period when the content of the music being played is the prelude, the interlude, or the end of the music.
Information provision method. On the computer
The process of playing music in the passenger compartment
The process of outputting information by voice in the passenger compartment,
When the music is being played, the process of outputting the information during the period when the content of the music being played is the prelude, the interlude, or the end of the music.
A program that executes.

Images