JP2019200836A - Reproduction control device, reproduction control method, and program for reproduction control - Google Patents

Abstract

To provide a reproduction control device capable of arousing a user's interest in a piece music that the user listens to and capable of providing the user with various related information corresponding to contents or the like of the piece of music.SOLUTION: The reproduction control device comprises a music specification unit 1 for specifying a piece of music to be reproduced and a timing specification unit 2 for specifying timing as a reproduction timing of related information related to the specified piece of music from among before, after or during reproduction of the piece of music. It is controlled to reproduce the related information at the specified reproduction timing together with the reproduction of the specified piece of music.SELECTED DRAWING: Figure 3

Description

  The present application belongs to a technical field of a playback control device, a playback control method, and a playback control program. More specifically, for example, the present invention belongs to a technical field of a reproduction control apparatus and a reproduction control method for controlling reproduction of reproduction information specified by a user and a program for the reproduction control.

  In recent years, as a so-called Internet radio or the like, content equivalent to a radio broadcast program is acquired through a network such as the Internet and listened to. In general radio broadcasting, music is often played during a disc jockey talk, and this is also true for the Internet radio and the like. Here, in the above-mentioned Internet radio or the like, there are usually many pieces of music that are listened to for the first time, and in this case, there is a request to know related information related to the new music. The related information in this case is, for example, information related to the artist performing the music, information such as the lyrics of the music itself, information indicating the music that is the origin (roots) of the music, or the music was created The information etc. which show the episode at the time are mentioned.

  As a prior art for providing such related information, for example, there is a technique described in Patent Document 1 below. In the technology described in Patent Document 1, the related information of the music is acquired, and the timing at which the related information of the music can be introduced from the beginning to the end of the lyrics in the music is determined. The related information of the music is introduced at the determined timing.

JP 2006-048808 A

  However, the related information assumed in the technology described in the above-mentioned Patent Document 1 and the mechanism of a general Internet radio, for example, is that the music content supplier uses a fixed wording or the like to fix the related information of the artist or music. Used and stored in advance in the server. And the terminal device side which acquires and reproduces the music and related information is configured to acquire a fixed word or the like from the server and reproduce it as related information. Therefore, in this case, since the related information provided does not include anything other than that originally stored in the server, there are few variations as the related information, and there is a problem that the user who views it gets bored. . More specifically, whenever the same artist's music or the same music is listened to, the same related information is reproduced, and the related information is extremely uniform. Furthermore, depending on, for example, a music company serving as a provider of related information, there is a problem in that the original content (bias) of the music company appears in the content as the related information.

  Therefore, the present application has been made in view of the above-mentioned problems, and an example of the problem is that the user's interest in the music to be listened to can be more aroused, and various contents corresponding to the contents of the music, etc. An object of the present invention is to provide a reproduction control apparatus and a reproduction control method capable of providing relevant information to a user, and a program for the reproduction control.

  In order to solve the above-mentioned problem, the invention according to claim 1 is characterized in that the information specifying means for specifying the playback information to be played back and the playback timing of the related information related to the specified playback information as the playback timing. Timing specifying means for specifying timing before or after reproduction of information or during reproduction, and control so that the related information is reproduced at the specified reproduction timing together with reproduction of the identified reproduction information And a control means.

  In order to solve the above problem, the invention according to claim 9 is directed to an information specifying step for specifying playback information to be played back and a playback timing of related information related to the specified playback information. A timing specifying step for specifying a timing before or after reproduction of information or during reproduction, and control so that the related information is reproduced at the specified reproduction timing together with reproduction of the identified reproduction information And a control process.

  In order to solve the above-described problem, the invention described in claim 10 causes a computer to function as the reproduction control device described in any one of claims 1-8.

It is a block diagram which shows the schematic structure of the reproduction | regeneration control apparatus which concerns on embodiment. It is a block diagram which shows schematic structure of the music reproduction system which concerns on an Example. It is a block diagram which shows the detailed structure of the music reproduction system which concerns on an Example, (a) is a figure which illustrates the structure of the related information server and related information database which concern on an Example, (b) is the terminal which concerns on an Example It is a block diagram which shows schematic structure of an apparatus. It is a figure which illustrates the contents of the music database etc. which concern on an Example, (a) is a figure which illustrates the content of the said music database, (b) is a figure which illustrates the content of the music related information table which concerns on an Example. (C) is a figure which illustrates the content of the POI (Point of Interest) cooperation related information table which concerns on an Example. It is a flowchart which shows the music reproduction process which concerns on an Example. It is a figure which shows the relationship etc. of the reproduction timing of the music which concerns on an Example, and the reproduction timing of related information, (a) is a figure which shows an example of the said relationship, (b) is POI information displayed with a map. It is a figure which illustrates a case.

  Next, the form for implementing this application is demonstrated using FIG. FIG. 1 is a block diagram illustrating a schematic configuration of the reproduction control apparatus according to the embodiment.

  As shown in FIG. 1, the reproduction control apparatus S according to the embodiment includes an information specifying unit 1, a timing specifying unit 2, and a control unit 3. At this time, the information specifying unit 1, the timing specifying unit 2 and the control unit 3 do not have to be provided in one reproduction control device. For example, the information specifying unit 1 and the timing specifying unit 2 are not shown in the figure. The control means 3 may be provided in a terminal device (not shown) provided in the device and connected to the server device via a network such as the Internet.

  In this configuration, the information specifying unit 1 specifies reproduction information to be reproduced. The reproduction information in this case may correspond to music information or image information such as a moving image or a still image.

  Then, the timing specifying unit 2 specifies the timing of the related information related to the playback information specified by the information specifying unit 1 either before playback, after playback or during playback. At this time, the related information is, for example, information indicating the origin of the music information when the reproduction information is music information, information related to an artist who performs the music information, and the like.

  The control means 3 controls the reproduction information specified by the information specifying means 1 so that the related information is reproduced at the reproduction timing specified by the timing specifying means 2.

  As described above, according to the operation of the playback control device S according to the embodiment, the playback timing of the related information related to the playback information to be played back can be set before, after playback, or during playback. It is specified as the timing. Then, the reproduction information is controlled so that the related information is reproduced at the specified reproduction timing. Therefore, the related information related to the reproduction information is reproduced together with the reproduction information at any timing before or after reproduction of the reproduction information or during reproduction, which further arouses the user's interest in the reproduction information. be able to. In addition, various related information related to the reproduction information can be provided to the user.

  Next, specific examples corresponding to the above-described embodiment will be described with reference to FIGS. In addition, the Example described below is an example when the embodiment is applied to the reproduction control in the case of reproducing and listening to music on a terminal device connected to a network such as the Internet.

  2 is a block diagram showing a schematic configuration of the music playback system according to the embodiment, FIG. 3 is a block diagram showing a detailed configuration of the music playback system, and FIG. 4 is a music related information table according to the embodiment. It is a figure which illustrates contents, such as. FIG. 5 is a flowchart showing the music reproduction process according to the embodiment, and FIG. 6 is a diagram showing the relationship between the music reproduction timing and the related information reproduction timing according to the embodiment. At this time, in FIG. 3, the same member numbers as the respective constituent members in the regeneration control apparatus S are used for the respective constituent members in the examples corresponding to the respective constituent members in the regeneration control apparatus S according to the embodiment shown in FIG. 1. ing.

  As shown in FIG. 2, the music playback system SS according to the embodiment includes a terminal device T1, a terminal device T2,..., A terminal device Tn (n is a natural number) that are operated by a user, a playlist server PS, The music content server MS, the related information server CS, the terminal device T1, the terminal device T2,..., The terminal device Tn, the playlist server PS, the music content server MS, and the related information server CS. And a network NW such as the Internet that is connected so as to be able to send and receive data. Further, a playlist information related database (shown as “playlist information DB” in FIG. 2) PSB is connected to the playlist server PS, and a music database (“music DB” in FIG. 2) is connected to the music content server MS. MSB is connected, and the related information server CS is connected to a related information database (shown as “related information DB” in FIG. 2). In the following description, when the common items of the terminal device T1, the terminal device T2,..., The terminal device Tn are described, these are simply referred to as “terminal device T”. As a specific example of the terminal device T, for example, a so-called smartphone, personal computer, navigation device, or the like that can be connected to the network NW is applicable.

  In this configuration, the playlist information database PSB stores arbitrary playlists (playback lists) that are combinations of songs that are played back by the user at the terminal device T. In this case, the playlist includes data indicating the song name for each of the one or more songs, data indicating the name or name of the artist performing the song, and data indicating the name of the album in which the song is included. include. In addition to these, the playlist corresponding to one music includes the composition of the music (that is, each section of the intro, interlude, and outro as a part of the music) in units of seconds or the number of samples as digital data. The music analysis data shown in advance is also included. Then, as will be described later in detail, the playlist server PS searches the playlist information database PSB for a playlist including the requested song based on the request for the song from one of the terminal devices T, and sends the request. Is transmitted via the network NW to the terminal device T that has transmitted.

  Next, in the music database MDB, music data serving as the main body of the music played on any of the terminal devices T is stored for each music. This music data is audio data itself to be actually reproduced in the terminal device T. Then, as will be described in detail later, the music content server MS searches the music database MSB for the requested music data based on the music data request from any of the terminal devices T, and transmits the request to the terminal. Transmit to the device T via the network NW.

  On the other hand, as will be described later in detail, the related information database CSB stores information related to the music reproduced in any of the terminal devices T as related information according to the embodiment. The related information in this case is information that is simultaneously played when each piece of music is played on the terminal device T, and is related information that is useful to the user who listens to the music. Specifically, the related information includes data indicating the origin (origin) of the music, data related to the artist who plays the music, or data indicating the location of the music or artist or the location of the facility. ing. Then, as will be described in detail later, when a request for any piece of music is made from any terminal device T, the related information server CS searches the related information database CSB for related information corresponding to the request, and The request is transmitted to the terminal device T via the network NW.

  On the other hand, one of the terminal devices T receives a playlist including a song corresponding to the designation from the playlist server PS via the network NW based on the designation of the song by the user, and receives the song data of the song as a song. Received from the content server MS via the network NW. In addition to these, the terminal device T receives related information related to the music from the related information server CS via the network NW. Then, the terminal device T reproduces the received music data based on the received playlist, and reproduces the received related information in accordance with the reproduction. The processing in each terminal device T will be described in detail later.

  Next, the configuration and the like of the related information server CS and the terminal device T according to the embodiment will be specifically described with reference to FIGS.

  First, as shown in FIG. 3A, the related information database CSB includes a music related information table TB1 which is a related information body, and a POI cooperation related information table TB2. The music related information table TB1 and the POI cooperation related information table TB2 will be described later in detail.

  On the other hand, as shown in FIG. 3A, the related information server CS includes a processing unit 5 including a CPU, a ROM (Read Only Memory) and a RAM (Random Access Memory), an interface 6, a pointing device such as a mouse, and a keyboard. And the like, and a display 8 made up of a liquid crystal display or the like. The processing unit 5 includes a music specifying unit 1, a timing specifying unit 2, and a relation specifying unit 4. At this time, each of the music specifying unit 1, the timing specifying unit 2, and the related specifying unit 4 may be realized by a hardware logic circuit such as a CPU constituting the processing unit 5, or according to the embodiment. The processing unit 5 may read out and execute a program corresponding to a flowchart described later corresponding to the music reproduction process, and may be realized in software. The music specifying unit 1 corresponds to an example of the information specifying unit 1 according to the embodiment, and the timing specifying unit 2 corresponds to an example of the timing specifying unit 2 according to the example. In addition, the relationship specifying unit 4 corresponds to an example of “related information specifying unit” according to the present application, and the processing unit 5 corresponds to an example of “language detection unit” according to the present application.

  In the above configuration, the interface 6 controls transmission / reception of data between the processing unit 5 and the related information server CS via the network NW under the control of the processing unit 5. Further, when an operation for designating the processing content or the like in the related information server CS is executed in the operation unit 7, the operation unit 7 generates an operation signal corresponding to the operation and outputs the operation signal to the processing unit 5. Thereby, the music specifying unit 1 of the processing unit 5 specifies the music requested from any of the terminal devices T. On the other hand, the relation specifying unit 4 is configured to display related information related to the music specified by the music specifying unit 1 before or after the music is played, or a part of the music (intro, interlude, or outro). Specify in correspondence with. This related information includes POI information as point information related to the reproduced music. The association between the related information and the POI information in this case is described in the POI cooperation related information table TB2 as described later. Then, the timing specifying unit 2 specifies the reproduction timing of the related information and POI information specified by the related specifying unit 4 in correspondence with any one of the intro of the music. Thereafter, the processing unit 5 transmits the identified related information and POI information to the terminal device T that plays the music related to the related information via the interface 6. Information necessary for a series of processes in the related information server CS is displayed on the display 8 and notified to a user of the related information server CS (for example, an administrator of the music reproduction system SS).

  On the other hand, as shown in FIG. 3B, each terminal device T includes a control unit 3 including a CPU, a ROM, a RAM, and the like, an interface 10, and an HDD (Hard Disc Drive) or an SSD (Solid State Drive), for example. The recording unit 11 includes an operation unit 12 including operation buttons or a touch panel, a display 13 including a liquid crystal display, and a speaker 14. The control unit 3 includes a synchronization control unit 30, decoders 31 and 34, a music player 32, a TTS (Text to Speech) unit 33, and a related information player 35. At this time, each of the synchronization control unit 30, the decoders 31 and 34, the music player 32, the TTS unit 33, and the related information player 35 is realized by a hardware logic circuit such as a CPU constituting the control unit 3. Alternatively, it may be realized in software by causing the control unit 3 to read out and execute a program corresponding to a flowchart described later corresponding to the music reproduction process according to the embodiment. The control unit 3 corresponds to an example of the control unit 3 according to the embodiment and an example of the “detection unit” according to the present application, and the display 13 corresponds to an example of the “notification unit” according to the present application.

  In the above configuration, when a music piece that is desired to be reproduced in the terminal device T is designated by an operation in the operation unit 12, a play list transmission request including the requested music piece is sent via the interface 10 and the network NW. A playlist corresponding to this is transmitted (returned) from the playlist server PS. Next, the control unit 3 transmits the music data and the related information transmission request corresponding to the transmitted playlist to the music content server MS and the related information server CS via the interface 10 and the network NW, respectively. When the music data and the related information are respectively transmitted from the music content server MS and the related information server CS, the synchronization control unit 30 first counts the reproduction time in the music data. Further, the music data is output to the decoder 31. As a result, the decoder 31 decodes the music data, performs a necessary reproduction process by the music player 32 in response to, for example, a reproduction start operation in the operation unit 12, and emits the sound as the music from the speaker 14. On the other hand, in parallel with these, the synchronization control unit 30 outputs the received related information to the TTS unit 33 in accordance with the reproduction time of the counted music. Then, the TTS unit 33 converts the text part included in the related information into sound (that is, reads out) and outputs the sound part to the decoder 34 in, for example, the MP3 (MPEG1 Audio Layer 3) format. Accordingly, the decoder 34 decodes the voiced data, performs necessary reproduction processing by the related information player 35, and emits sound from the speaker 14. At this time, the control unit 3 records the reproduction history data including the related information ID for identifying the actually reproduced related information in the recording unit 11 in a nonvolatile manner. If the related information includes the POI information to be displayed on the display 13, the POI information is displayed on the display 13 together with, for example, a map by the control unit 3. Note that the map data corresponding to the map in this case may be, for example, data recorded in advance in the recording unit 11 or may be acquired from a map server (not shown) via the network NW. The received music data and related information may be temporarily recorded in the recording unit 11 in preparation for the next reproduction process.

  Next, the configuration of the music database MSB according to the embodiment and the music related information table TB1 and the POI cooperation related information table TB2 in the related information database CSB will be specifically described with reference to FIG.

  First, as illustrated in FIG. 4A, in the music database MSB, music data of a music identified by the music ID 50 is recorded in association with the music ID 50 for identifying each music from other music. A URL (Uniform Resource Locator) indicating the position on the network NW is recorded as the content ID 51. The content ID 51 in this case is the URL when the music data is stored in a server or the like (not shown) on the network NW. Further, when the music data is recorded in, for example, the music database MSB itself, the content ID 51 is data indicating the recording position of the music data in the music database MSB.

  Next, as illustrated in FIG. 4B, in the music related information table TB1 according to the embodiment, the music ID 50 and related information ID 60 for identifying each related information from other related information are associated with each other. Are recorded. The music ID 50 includes the music name 51 of the music, the artist name 52 indicating the name or name of the artist performing the music, and the music as the music information of the music identified by the music ID 50. An album name 53 of the album and Western / Japanese music data 54 indicating whether the music is Western music or Japanese music are recorded in association with each other. In contrast, the related information ID 60 includes a type 61, a data source type 62, a format 63, an expiration date 64, a registration date 65, an advertisement 66, a suitable time zone 67, a suitable weather 68, a suitable mood 69, and the related information. The content 70 that is the substance of the related information identified by the ID 60 is recorded in association with each other.

  At this time, the type 61 is data indicating what type of information the related information identified by the related information ID 60 is. Specifically, for example, when the related information is related information related to a song, the type 61 is described as “1”, and when the related information is related information related to an artist who plays the music, the type 61 is “2”. ”And the related information is related information posted by a fan in a predetermined SNS (Social Network Service), the type 61 is described as“ 3 ”, and the related information is a language other than Japanese. The category 61 is described as “4” in the case where the related information is related to the meaning in the case of having the lyrics.

  Next, the data origin type 62 is data indicating the origin of the related information identified by the related information ID 60. Specifically, for example, when the source of the related information is a record company that provides music, the data source type 62 is described as “1”, and when the source of the related information is a music office, the data source type 62 is described as “2”, and when the source of the related information is a music publisher, the data source type 62 is described as “3”, and the source of the related information is the record company, music office, and music publisher The data origin type 62 is described as “4” when the person is a predetermined music person other than the company, and the data origin type 62 is described as “5” when the source of the related information is the artist himself. When the source of the related information is a general person via the SNS or the like, the data source type 62 is described as “6”.

Next, the format 63 is data indicating the format (style) of the related information identified by the related information ID 60. Specifically, for example, when the relevant information is output as audio information in the MP3 format, the format 63 is described as “MP3”, and when the relevant information is image information, the format 63 is described as “jpg” or the like. When the related information is text information, the format 63 is described as “txt” or the like.

  Next, the expiration date 64 is data indicating the expiration date of the related information identified by the related information ID 60 (the end of the period supplied to the terminal device T as the related information). Specifically, for example, when the relevant information is future information (for example, appearance information on a TV program), the relevant information is valid (that is, meaningful for the user) until the date and time described as the expiration date 64. Therefore, a specific time limit is described as the valid time limit 64, and the validity / invalidity as the related information is determined in the processing unit 5.

  Next, the registration date 65 is data indicating the date when the related information identified by the related information ID 60 is registered (recorded) in the related information database CSB. Then, on the time axis based on the registration unit 65, whether the relevant information is old relevant information before a preset threshold period from now or new relevant information within the threshold period, Determination is made in the processing unit 5. In the following description, the old related information is referred to as “past (large)” related information, and the new related information is referred to as “past (small)” related information.

  Next, the advertisement 66 is data indicating whether or not the related information identified by the related information ID 60 includes advertisement contents such as a store related to the music, a release of (other) new works, and a live performance. . If the advertisement is included, a preset advertisement flag is set as the advertisement 66. In this case, the processing unit 5 transmits the related information in which the advertisement flag is set to the terminal device T corresponding to the client serving as the advertisement with priority over other related information.

  Next, the suitable time zone 67 is data indicating the time zone of the day when the related information identified by the related information ID 60 is preferably reproduced. Specifically, for example, when it is preferable that the related information is reproduced all day, the adaptation time zone 67 is described as “1”, and it is preferable that the related information is reproduced in the morning time zone. In this case, the adaptation time zone 67 is described as “2”, and when it is preferable that the relevant information is reproduced in the daytime time zone, the adaptation time zone 67 is described as “3”, and the relevant information is displayed at night. When it is preferable to play back in the time zone, the adaptation time zone 67 is described as “4”.

  Next, the suitable weather 68 is data indicating the weather in which the related information identified by the related information ID 60 is preferably reproduced. Specifically, for example, when it is preferable that the relevant information is reproduced in any weather, the suitable weather 68 is described as “1”, and is preferably reproduced when the relevant information is clear. If the relevant weather 68 is described as “2” and the relevant information is preferably reproduced when it is cloudy, the relevant weather 68 is described as “3” and is reproduced when the relevant information is rainy. If it is preferable that the relevant weather 68 is described as “4”, the relevant weather 68 is described as “5”.

  Finally, the fit mood 69 is data indicating a user's state in which related information identified by the related information ID 60 is preferably reproduced. Specifically, for example, when it is suitable for a user in a normal state that the related information is reproduced, the fit mood 69 is described as “1”, and the related information is reproduced when the user is fine. The fitness mood 69 is described as “2”, and when the relevant information is preferably reproduced when the user feels tired, the fitness mood 69 is described as “3”. In the case where it is preferable that the relevant information is reproduced when the user is drowsy, the fit mood 69 is described as “4”, and the relevant information is preferably reproduced when the user is sad. In this case, the fitness mood 69 is described as “5”.

  The content of the music related information table TB1 illustrated in FIG. 4B is referred to by the processing unit 5 when the necessary related information is transmitted from the related information server CS to the terminal device T, and is actually transmitted. Information is identified.

  Next, as illustrated in FIG. 4C, the POI cooperation related information table TB <b> 2 according to the embodiment includes a point or facility related to the related information identified by the related information ID 60 in association with the related information ID 60. Latitude data 75 and longitude data 76 indicating the position of are recorded. The latitude data 75 and the longitude data 76 are transmitted to the terminal device T as a part of the related information, so that the location or the facility whose position is indicated by the latitude data 75 and the longitude data 76 can be simultaneously determined in the terminal device T. The POI information related to the related information being transmitted can be displayed on the display 13 together with the map, for example.

  Next, the music reproduction process according to the embodiment centering on the terminal device T and the related information server CS will be specifically described with reference to FIGS.

  As shown in the corresponding flowchart in FIG. 5, when a playlist including a song to be reproduced in any one of the terminal devices T is first requested by an operation in the operation unit 12, the control unit 3 of the terminal device T A playlist request indicating a playlist request is transmitted to the playlist server PS together with, for example, a playlist ID for identifying the playlist (step S1). Next, when the playlist server PS receives the playlist request (step S15), as the information on the music included in the requested playlist, the data indicating the music name for each music, the name of the artist, A playlist including the data indicating the name, the data indicating the name of the album, and the music analysis data is searched in the playlist information database PSB, and the searched playlist is returned to the original terminal device T (step S16). .

  Thereafter, the playlist server PS determines whether or not to end the music playback process according to the embodiment, for example, when the power switch is turned off (step S17), and when the music playback process ends (step S17). S17; YES) The music reproduction process is terminated as it is, and when the music reproduction process is continued (step S17; NO), the process returns to step S15 to wait for a new playlist request.

  Next, the control unit 3 of the terminal device T that has received the playlist (step S2) next reproduces related information indicated by the music analysis data (for example, the timing of intro, interlude or outro of music, or , Before or after playing the music). Further, the control unit 3 sends a request for music data (including the music ID 50) of the music included in the received playlist and a request for related information related to the music to the music content server MS and the related information server CS, respectively. Transmit (step S3 and step S4). In step S4, the control unit 3 adds the reproduction history data (including the related information ID 60) recorded in the recording unit 11 in addition to the data indicating the song name, album name, and artist name of the song. And status data indicating the status of the user using the terminal device T (more specifically, for example, location data indicating the location of the user (that is, the location of the terminal device T), preference data indicating the preference of the user) Or mood data indicating the mood of the user) is included in the request for the related information and transmitted. At this time, for example, position data detected by, for example, GPS (Global Positioning System) provided in the terminal device T can be used as the position data. The preference data and mood data may be, for example, preference data and mood data indicating the preference and mood, which are input in advance by the user. Other examples of the situation data acquisition method include, for example, a user's facial expression captured using a camera (not shown), a detection / acquisition method based on a change in the facial expression, and the user's voice. Detection / acquisition method.

  Next, for example, when the music content server MS waiting for transmission of the music data request after the power switch is turned on receives the music data request (step S20), the requested music data is received. The data is searched in the music database MSB using the music ID 50, and the searched music data is returned to the original terminal device T (step S21). Thereby, the control part 3 of the said terminal device T receives the said transmitted music data (step S5), for example, it records on the recording part 11 temporarily. After that, the music content server MS determines whether or not to end the music playback process according to the embodiment, for example, when the power switch is turned off (step S22). (Step S22; YES) If the music reproduction process is terminated as it is and the music reproduction process is continued (Step S22; NO), the process returns to Step S20 and waits for a request for new music data.

  On the other hand, for example, the related specifying unit 4 and the timing specifying unit 2 of the related information server CS waiting for transmission of the related information request after the power switch is turned on receive the related information request ( In step S25), the requested related information (including corresponding POI information) is searched in the related information database CSB, and the searched related information is returned to the original terminal device T (step S26). Thereby, the control unit 3 of the terminal device T receives the transmitted related information (step S6), and temporarily records it in the recording unit 11, for example. After that, the related information server CS determines whether or not to end the music reproduction process according to the embodiment by turning off the power switch, for example (step S27). (Step S27; YES) If the music reproduction process is terminated as it is and the music reproduction process is continued (Step S27; NO), the process returns to Step S25 and waits for a request for new related information.

  Here, step S26 in the related information server CS will be described more specifically.

(A) In the first example, that is, in step S26, the music identification unit 1 of the related information server CS receives the music by the received music information, artist name, and album name included in the received related information request (step S25). Identify. Then, the relation specifying unit 4 searches the music related information table TB1 in the related information database CSB using the data indicating the music name, artist name, and album name as keys. At that time, the relation specifying unit 4 searches for related information to be transmitted to the terminal device T based on the following priorities.

  More specifically, the relationship specifying unit 4 sets “priority 1” as related information that has not been reproduced in the past on the terminal device T operated by the user based on the reproduction history data included in the request for related information. Is preferentially selected and related information that has been reproduced once in the terminal device T is excluded and related information is searched.

  Next, as the “priority 2”, the relation identifying unit 4 displays the relevant information corresponding to the situation and attributes of the user indicated by the situation data included in the request for the relevant information, for example, the fit mood 69 and the fit time zone. Search with reference to 67.

  Next, the relation specifying unit 4 as “priority 3” is based on the data indicating the music name, album name, and artist name included in the request for related information, and related information associated with the music ID 50 that matches the data. The related information identified by ID 60 is searched. Examples of the related information include information indicating the past release year, the producer / lyricist / composer, and the like.

  Next, as the “priority level 4”, the relation specifying unit 4 uses the data indicating the artist name included in the request for the related information, and displays the related information of the artist on the time axis. The information is classified into the past (small) related information and the future related information, and related information belonging to them is searched. More specifically, as related information on the above (large) artists, for example, “Person who played an active part in the XX age”, “From XX”, Member information, Debut year, Performance (for example, song “▲▲” hit) Etc.) Relevant information indicating each can be considered. In addition, related information on the past (small) artists, such as “Entertainment News Festival last week”, “Announced in XX Festival”, “Announced XX ○”, “Announced □□”, “Band reorganized” Related information indicating "." Furthermore, as the related information of the future artist, for example, related information such as “Performance in Japan for the month” and “Appearance on TV next week” can be mentioned.

  Next, as the “priority level 5”, the relation specifying unit 4 includes, for example, related information such as the voice of the fan, its attribute, or information sympathized by many fans based on the information obtained by the SNS and its attribute. It is done.

  Finally, as the “priority 6”, when the related music piece is Western music, the related specifying unit 4 searches for information on the meaning and explanation of the lyrics.

As other priorities and their order, for example,
・ Order of related information (sorted by music, album or artist)
-Order of registration date and time (for example, rearranged in the latest order. See registration date 65 in FIG. 4B)
Priority order of source type as related information (eg priority 1; information from the artist himself → priority 2; information from the general public → priority 3; information from the music publisher → priority 4; music) (Information from the office → Priority 5; Information from the record company, etc. See the data origin type 62 in FIG. 4B.)
・ Posted information priority order via SNS (eg priority 1; information from people of the same gender → priority 2; information from people of the same age → priority 3; from people in the same residence area) Information, etc.)
・ In order of priority of the type of posted content via SNS (for example, priority 1; appearance program information → priority 2; event information → priority 3; artist information → priority 4; music information → priority 5; (Album information → priority 6; producer information → priority 7; songwriter information → priority 8; composer information, etc.)
・ In order of priority of post contents via SNS (eg, priority 1; user voice itself → priority 2; text data, etc.)
・ The order of popularity of posted contents via SNS, etc. can be mentioned.

(A) Second Example As another example of the related information search in step S26, the relationship specifying unit 4 determines, for example, “the type of related information according to the content reproduction history (hereinafter referred to as Example I). "Determining the type of related information according to the user's situation (hereinafter referred to as Example II)", "determining the type of related information according to the contents of the web search in the terminal device T (hereinafter referred to as "Referred to as example III)" or "determining the type of related information according to the registration information of the application for ticket purchase, SNS, etc., and the music recorded in the recording unit 11 of the terminal device T (hereinafter referred to as example IV) ) "May be used to search for related information.

  At this time, specifically in the case of Example I above, for example, if the number of times of reproduction of content such as music in the terminal device T is greater than a preset threshold, type A related information is searched and the content is reproduced. If the number of times is less than the threshold, a method of searching related information of another type B can be considered. Next, in the case of Example II above, specifically, related information according to the position data, schedule, date and time, time zone, season, event, situation, weather, mood, age or sex of the user who uses the terminal device T A method may be considered in which the type of data is determined and searched. Next, in the case of Example III, specifically, when a history of searching the web for information on content such as music to be played back on the terminal device T is recorded in the terminal device T, It is possible to search for more related information. Finally, in the case of Example IV, specifically, when a “favorite” artist is registered in the ticket purchase application, SNS, or the like, it cooperates with the music information of the music recorded in the terminal device T. Thus, when searching for the registered artist, there can be considered a method of searching for sales ticket release information, information on arrival in Japan, and the like as related information according to the embodiment.

(C) Third example Further, as yet another example of the related information search in step S26, the related specifying unit 4 and the timing specifying unit 2 prioritize the related information for each part of the intro, interlude and outro in the music. The degree can be set and the related information can be searched. The “intro” includes the time before the music is played, in addition to the intro immediately after the music playback is started. At this time, the case where the related information is reproduced before the reproduction of the music is performed, for example, when the corresponding music analysis data is acquired from the playlist server PS and referred to, and there is almost no intro as the composition of the music, The song itself starts when the song starts. The “outro” includes the time after the music is played, in addition to the outro just before the music play ends. At this time, the case where the related information is reproduced after the reproduction of the music is started includes, for example, a case where there is almost no outro as a composition of the music as a result of referring to the music analysis data.

  In other words, as related information that is played back in parallel with the intro of the music, related information as an explanation of why this music is to be played (recommended) to the user before the lyrics part starts, and why this music is recommended. Relevant information is searched for by listening to the explanation of the event and knowing the reason. And as for the priority in this case, as an example 1, it can be considered that “user status and attribute” is priority 1 and “music information and attribute” is priority 2. The user situation and attributes in this case are the user situation, position (location), and attribute. As specific related information corresponding to priority 1 in Example 1 above, the user drives Karuizawa. As related information, there is related information such as “Karuizawa visited often when artist (artist name) came to Japan”. In addition, specific related information corresponding to priority 2 in Example 1 above corresponds to the music information and attributes of priority 2 and is a work of × (year of artist (name)) × year □ week number Related information such as “△ ○ (song name) that became 1”. As an example 2, it is conceivable that “user status or attribute” is given priority 1 and “music description or attribute” is given priority 2. In this case, the user status and attributes include the user's schedule (for example, “commuting”) / date / time (for example, “morning”, “night”, etc.) / Season (for example, “early summer” or “early autumn”). / Event (eg “Graduation season” etc.) / Situation (eg “Driving” etc.) / Weather (eg “Rainy day” etc.) / Mood (eg “Sad mood” etc.) Specific related information that corresponds to priority 1 in Example 2 includes: “This week will start. This is a song that raises the tension.” “Thank you for your hard work all day. This is a song that cools down.” Related information such as "Month XX day is the date of XX (artist name)". In addition, as specific related information corresponding to priority 2 in Example 2 above, “XX (artist name) x year work of △ ○ ( Related information such as “Song name)”.

  Furthermore, as another example of the related information reproduced in parallel with the intro of the music, in order to promote interest to the user, a relatively new (ie, the past (small)) related information (such as entertainment news) is used. Who is this artist in the first place when it comes to information or an artist you meet for the first time? Relevant information to resolve the question is searched. As an example of the priority in this case, “Artist information (past (small))” may be set as priority 1, and “Artist information (past (large))” may be set as priority 2. In addition, specific related information corresponding to the above priority 1 includes “XX has been discovered ○ (artist name)”, “XX festivals” in addition to the above artist information (past (small)) Related information such as “I appeared (name of artist)”. In addition, as specific related information corresponding to the above priority 2, in accordance with the artist information (past (large)), “XX (artist name) is a person who has been active in the × generation, 4 Related information such as “I was a break in a band with a triangle”.

  On the other hand, as related information to be reproduced in parallel with the interlude of the music, related information of content supplemented after the user finishes listening to the first of the music and grasps the atmosphere of the music is searched. In this case, if the music is other than Western music, the related information is searched with the fan's voice and its attribute as the priority 1, and as a result, for example, “XX (Fan A) 's post is. Related information such as “A song of memories that I often listened to before the game”. Also, if the music is Western music, the meaning and attribute of the lyrics will be given priority as priority 1, and more specifically, "This song is a song that sang a man looking at a ship at the port" And the priority 2 is given priority as in the case of the fan voice and attributes other than the above-mentioned Western music. Specifically, it is a post by Mr. XX (Fan A). Related information such as “the song of the memory I was listening to”.

  Finally, as related information that is played in parallel with the music outro, when the user has almost listened to the music and got interested, it can be related to the future of the artist, for example, in the television broadcast program promotion. The related information of the content is searched. In this case, for example, the event information and attributes are given priority as priority 1, and specifically, “XX (artist name) is scheduled to come to Japan in XX month! Related information such as “XX (artist name) will appear in a TV program of XX month and day”.

  In addition, as an example of related information searched under the common theme for the above intro, interlude, and outro, as related information for music pre-play, “Karuizawa is often visited when XX (singer name) visits Japan. Related information. In addition, related information for the intro includes “related to“ X (Year of the XX) x ”(song name)”, and related information for interludes is “This song is for people looking at ships at the port” The related information is "Singed song". Furthermore, as related information for outro, there is related information such as “A message from XX fan Xxx, this song is a memorable song that I often listened to before club activities,” As related information after music playback, related information “XX special feature is scheduled to be broadcast on TV on July 20th next month” can be mentioned.

  Next, when various related information is transmitted as a result of the search by the related information server CS described above (step S6), the control unit 3 of the terminal device T confirms the operation in the operation unit 12, for example. Then, it is determined whether or not to start playing the music (step S7). When the start of reproduction has not been instructed yet in the determination in step S7 (step S7; NO), the control unit 3 waits for the instruction. On the other hand, when the reproduction of the music is started in the determination in step S7 (step S7; YES), the control unit 3 performs the reproduction of the received music data using the decoder 31 and the music player 32 (see step S5). In parallel with (step S8), it is monitored (see step S6) whether or not the reproduction timing of each related information has arrived (step S9). In this case, for example, when related information for an intro of a music is received, the start of the intro is monitored, and when related information for an interlude of a music is received, the arrival of the interlude is monitored. Become. When the reproduction timing has not arrived in the monitoring of step S9 (step S9; NO), the control unit 3 continues to monitor, while when the reproduction timing has arrived (step S9; YES), the control unit 3 Reproduction is performed using the TTS unit 33, the decoder 34, and the related information player 35 of the related information to be reproduced at the arrival reproduction timing (step S10). Thereafter, the control unit 3 determines whether or not the reproduction of all the related information received has been completed (step S11), and if there is related information that has not been completed (step S11; NO), The process proceeds to the monitoring in step S9 in order to start reproduction of related information that has not been reproduced. On the other hand, if the reproduction of all the related information is completed in the determination of step S11 (step S11; YES), since the reproduction of the music itself is also completed at this time (see step S8), the control unit 3 Next, for example, it is determined whether or not the music playback process according to the embodiment is to be ended by turning off the power switch or the like (step S12). When the music playback process is to be ended (step S12; YES) ) When the music reproduction process is finished as it is, and when the music reproduction process is continued (step S12; NO), the process returns to step S1 to make a new music request.

  When the music reproduction process according to the embodiment described above is performed, as illustrated in FIG. 6A, in parallel with the reproduction of the music, for example, before the reproduction, intro, interlude, outro, and after the reproduction, The contents of the related information retrieved corresponding to each part (content 70; see FIG. 4B) are voiced and read out. When the POI information is included in the related information, the control unit 3 displays the map MP related to the POI information on the display 13 of the terminal device T as illustrated in FIG. 6B. The related information 80 to the related information 83 as illustrated in FIG. 6B are displayed as characters in a manner indicating the point corresponding to the POI information.

  At this time, if it is configured to notify the guide information for guiding to the point or facility indicated by each POI information, it is possible to provide more useful information for the user. More specifically, for example, when driving Karuizawa, the music of XXXXX (singer name) is played, and in response, “Karuizawa is XXXXXX coming to Japan. It is assumed that related information such as “I visited often when I did it” and “It is a work of XXX year of XXXXX is △ ○ (song name)” is being played. At that time, a map as shown in FIG. 6B and related information 80 etc. are displayed on the display 13. For example, the distance from a point or facility related to XXX to the current position of the vehicle is shown. It is configured to play back as a voice guide, such as "There is a French bread shop that XXXXX has eaten often" as new related information when it is within a predetermined distance. It is preferable to do this.

  As described above, according to the operation according to the embodiment, the related information related to the music to be reproduced is specified in correspondence with the portion of the music (intro etc.), and the reproduction timing of the related information is determined. Specify the corresponding part. Then, along with the reproduction of the music, the related information is controlled to be reproduced at the specified reproduction timing. Therefore, since the related information related to the music is reproduced along with the reproduction of the music at the reproduction timing corresponding to the part of the music, the user can be more interested in the music. Moreover, various related information corresponding to the music can be provided to the user. More specifically, for example, it is possible to increase the user's music knowledge by playing back information related to music, albums, and artists. Furthermore, when listening to the same artist or the same music, different related information is played back. It can keep users from getting bored. Furthermore, by reproducing the related information together with the reproduced music, it is possible to generate interest in the music even if the music is unknown to the user.

  Further, since the related information is specified according to the priority set for the related information, the related information can be specified by a simple process.

  In addition, the music portion is an intro, interlude or outro of the music, and a plurality of different related information related to the music can be either pre-playback or post-playback or its intro, interlude or outro. Therefore, by reproducing the related information using the identification result, a wide variety of related information can be provided to the user, and the user can be more interested in the music.

  Furthermore, even if the intro playback time is shorter than or less than the preset intro threshold time, the related information including the introduction of the music corresponding to the intro is played back at the timing before the music playback. By doing so, even if the music has a short or almost no intro, the user's interest in the music can be aroused.

  Further, even when the reproduction time of the outro is shorter than or less than the preset outro threshold time, the related information including the introduction of the music corresponding to the outro is controlled to be reproduced at the timing after the reproduction of the music. Thus, even if the music has short or almost no outro, the user's interest in the music can be aroused.

  Furthermore, if the song is in lyrics other than Japanese, if the related information, which is a translation in Japanese or a commentary in Japanese, is played, the song can be played even if the song in lyrics other than Japanese is played. The user can be more interested in and various related information corresponding to the music can be provided to the user in an easily understandable manner.

  Furthermore, when the related information is reproduced, the POI information corresponding to the related information is displayed, so that the user's interest in the music related to the related information can be further aroused, and the useful relationship corresponding to the music is also displayed. For example, information can be easily provided to a moving user.

  Further, by displaying further guidance information for guiding to a point or facility related to the related information, more useful information can be provided to a moving user, for example.

  In the above-described embodiment, the related information that has been reproduced together with the music is excluded and other related information is specified. However, in addition to this, the priority related to the reproduction of the related information that has been reproduced with the music is given. The information may be specified so as to be lowered relative to the priority of other related information (that is, unreproduced related information).

  Also, in the above-described embodiment, when a plurality of related information is played back simultaneously, when the related information is played back simultaneously (mixed) with music, a plurality of pieces of related information are overlapped or somewhat like text flowing in a moving image. You may comprise so that it may play simultaneously, shifting time. In this case, the TTS unit 33 is configured to read out (speech) each related information by using, for example, synthesized speech having no overlapping frequency so that the sounds of the related information reproduced simultaneously can be heard. Is preferred. In this case, a plurality of different characters may be used for each of the plurality of related information.

  Further, in addition to the configuration of the above-described embodiment, whether or not the user is interested in the music being played back is detected, and related information is detected when it is detected that the user is interested. May be specified in correspondence with the outro of the music, and the related information may be controlled to be reproduced at the reproduction timing within the outro. In this case, detection of whether or not the user is interested may be, for example, a detection method based on a facial expression captured using the camera or a change thereof, or a detection method based on voice recognition. According to such a configuration, since the related information is reproduced at the last part for the user who is interested in the reproduced music, the impression of the music can be fixed to the user.

  Furthermore, in the above-described embodiment, the embodiment is applied to the case where music is reproduced and listened to. However, for example, an image or a moving image is reproduced as reproduction information, and related information related thereto is also reproduced. In this case, the embodiment may be applied.

  Furthermore, a program corresponding to the flowchart shown in FIG. 5 is recorded on a recording medium such as an optical disk or a hard disk, or obtained via a network such as the Internet, and read out to a general-purpose microcomputer or the like. It is possible to cause the microcomputer or the like to function as the processing unit 5 or the control unit 3 according to the embodiment.

1 Target identification means (music identification part)
2 Timing identification means (timing identification part)
3 Control means (control unit)
4 related identification unit S playback control device SS music playback system T, T1, T2, Tn terminal device MS music content server PS playlist server MSB music database PSB playlist related information database CS related information server CSB related information database TB1 music related information Table TB2 POI linkage related information table

Claims (1)

An information specifying means for specifying reproduction information to be reproduced;
Timing specifying means for specifying any timing before or after reproduction of the reproduction information or during reproduction as reproduction timing of related information related to the specified reproduction information;
Control means for controlling the related information to be played at the specified playback timing together with the playback of the specified playback information;
A playback control apparatus comprising: