WO2017094328A1

WO2017094328A1 - Information processing device, information processing method, and program

Info

Publication number: WO2017094328A1
Application number: PCT/JP2016/077514
Authority: WO
Inventors: 律子金野; 幸由廣瀬; 進太郎増井
Original assignee: ソニー株式会社
Priority date: 2015-11-30
Filing date: 2016-09-16
Publication date: 2017-06-08

Abstract

[Problem] To provide an information processing device, an information processing method, and a program that are novel and improved, and that can provide notification of a section that a user had feelings about while appreciating music. [Solution] An information processing device comprising: an information acquisition unit that acquires notification information with respect to a section of second music data, said second music data being related to first music data, said notification information being generated on the basis of a first user's feeling information while playing back the first music data; and a notification information output unit that outputs the notification information to a notification unit such that at least one of the first user and the second user is notified of the notification information in association with the section while playing back the second music data.

Description

Information processing apparatus, information processing method, and program

The present disclosure relates to an information processing apparatus, an information processing method, and a program.

In recent years, a so-called music sharing service for sharing music information between users via the Internet has been proposed. In such a music sharing service, each user is provided with an opportunity to meet a new song by introducing songs to each other.

In addition, an information processing apparatus that generates a user preference vector of a user based on content meta information corresponding to the content used by the user and introduces other users based on the user preference vector has been proposed (for example, Patent Documents). 1).

JP 2009-157899 A

However, the information processing apparatus described in Patent Document 1 does not notify the user what part of the music the other user actually moved.

Therefore, the present disclosure proposes a new and improved information processing apparatus, information processing method, and program capable of notifying a part that a user feels when listening to music.

According to this disclosure,
An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data, generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
Notification for outputting the notification information to the notification unit so that the notification information is notified to at least one of the first user and the second user in association with the portion at the time of reproduction of the second music data. An information processing apparatus having an information output unit is provided.

In addition, according to the present disclosure,
Obtaining notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A processor outputs the notification information to a notification unit so that the notification information is notified to the first user or the second user in association with the portion when the second music data is reproduced; ,
An information processing method is provided.

According to the present disclosure, the computer is
An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A notification information output unit that outputs the notification information to the notification unit so that the notification information is notified to the first user or the second user in association with the portion at the time of reproduction of the second music data; , A program is provided to function as.

As described above, according to the present disclosure, it is possible to notify the part that the user feels when listening to music.

Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

1 is a schematic diagram of an information processing system according to an embodiment of the present disclosure. 4 is a conceptual diagram illustrating an example of a service provided in an information processing system according to an embodiment of the present disclosure. FIG. 4 is a conceptual diagram illustrating an example of a service provided in an information processing system according to an embodiment of the present disclosure. FIG. 4 is a conceptual diagram illustrating an example of a service provided in an information processing system according to an embodiment of the present disclosure. FIG. It is a block diagram which shows the outline of a function structure of the server (1st information processing apparatus) which concerns on this embodiment. It is a table | surface regarding the sensitivity information used by the recommended user determination part of the server shown in FIG. It is a table | surface regarding the sensitivity information used by the recommended user determination part of the server shown in FIG. It is a table | surface regarding the sensitivity information used by the recommended user determination part of the server shown in FIG. It is an example of the data used in the preference information generation part of the server shown in FIG. It is an example of the data used in the preference information generation part of the server shown in FIG. It is an example of the data used in the preference information generation part of the server shown in FIG. It is an example of the data used in the preference information generation part of the server shown in FIG. It is an example of the data used in the preference information generation part of the server shown in FIG. It is a block diagram showing an outline of functional composition of a user terminal (second information processing terminal) concerning an embodiment of this indication. It is a screen transition figure of the user interface of the user terminal concerning an embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. It is an example of the user interface screen of the user terminal which concerns on embodiment of this indication. 5 is a sequence diagram illustrating an example of an operation of an information processing system according to an embodiment of the present disclosure. FIG. 5 is a sequence diagram illustrating an example of an operation of an information processing system according to an embodiment of the present disclosure. FIG. 5 is a sequence diagram illustrating an example of an operation of an information processing system according to an embodiment of the present disclosure. FIG. It is another example of the information used by the recommended user determination part of the server shown in FIG. It is another example of the information used by the recommended user determination part of the server shown in FIG. It is another example of the information used by the recommended user determination part of the server shown in FIG. It is another example of the data used in the preference information generation part of the server shown in FIG. It is another example of the data used in the preference information generation part of the server shown in FIG. The display of the preference information which concerns on the modification of this indication is shown. The display of the preference information which concerns on the modification of this indication is shown. The display of the preference information which concerns on the modification of this indication is shown. The display of the preference information which concerns on the modification of this indication is shown. The display of the preference information which concerns on the modification of this indication is shown. It is a schematic diagram which shows edit of the music data by the edit music data generation part with which the user terminal which concerns on the modification of this indication is provided. It is a block diagram which shows the hardware constitutions of the server shown in FIG. It is a block diagram which shows the hardware constitutions of the user terminal shown in FIG.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol. Further, in the present specification and drawings, similar components are distinguished by attaching different alphabets after the same reference numerals. However, when there is no need to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numerals are given.

The description will be made in the following order.
1. 1. Appearance example of information processing system Server configuration example (first information processing apparatus)
3. Configuration example of user terminal (second information processing apparatus)
4). 4. User interface example of user terminal 5. Example of operation of information processing system Modification 7 7. Server hardware configuration example 8. Hardware configuration example of user terminal Computer program

<1. Appearance example of information processing system>
First, a schematic configuration of an information processing system 1000 according to an embodiment of the present disclosure will be described with reference to FIGS.

FIG. 1 is a schematic diagram of an information processing system 1000 according to an embodiment of the present disclosure. An information processing system 1000 illustrated in FIG. 1 includes a server 100 and a plurality of user terminals 200, which are communicably connected via a network 300.

The server 100 is an example of a first information processing terminal according to the present disclosure. The server 100 collects information about the user's sensitivity to music (hereinafter also simply referred to as “sensitivity information”) from the user terminal 200, and the sensitivity information or the information Is transmitted to the other user terminal 200.

Here, in the present disclosure, “sensitivity to music” refers to the movement of the viewer's (user's) emotion that occurs during playback of music data, so-called “pitch”. Such emotional movements can be detected based on, for example, changes in the user's biometric information during music data playback. The biological information is not particularly limited, for example, heart rate, body temperature, sweating, blood pressure, sweating, pulse, breathing, blink, eye movement, staring time, pupil size, blood pressure, brain wave, body movement, posture, Examples thereof include skin temperature and skin electrical resistance. Such changes in biological information can be detected by, for example, an input unit 226 described later, or other sensors such as a heart rate monitor, a blood pressure monitor, an electroencephalograph, a pulse meter, a thermometer, an acceleration sensor, a gyro sensor, or a geomagnetic sensor. . And the said information detected by the input part 226 or the sensor can be utilized as sensitivity information.

Further, in the present disclosure, “music data” refers to data including music information. Therefore, the music data includes not only data including only sound information but also moving image data including images such as still images and moving images. The music data may further include other information such as information on lighting of the light emitting element, occurrence of vibration, operation of other applications, and the like. Further, in the present disclosure, the “music data portion” is a concept including not only a part of music data but also all.

The user terminal 200 is an example of a second information processing apparatus according to the present disclosure. The user terminal 200 is an electronic device that can reproduce music data, such as a smartphone, a mobile phone, a tablet, a media player, a desktop computer, and a laptop computer. Each user terminal 200 collects the sensitivity information of the user to be used and transmits it to the server 100. In addition, each user terminal 200 receives sensitivity information of other users or information based thereon from the server 100, and notifies each user of these information.

Also, the user terminal 200 is configured to be able to communicate with other user terminals 200 via or without the server 100. Thereby, the user who operates the user terminal 200 can perform conversation and information exchange with other users, for example, by chat, messenger, or the like.

The network 300 is a wired or wireless transmission path for information transmitted from a device connected to the network 300. For example, the network 300 may include a public line network such as the Internet, a telephone line network, a satellite communication network, various types of LANs (Local Area Network) including Ethernet (registered trademark), WAN (Wide Area Network), and the like. Further, the network 300 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).

The information processing system 1000 as described above can provide, for example, the services shown in FIGS. 2 to 4 to the user who owns the user terminal 200. 2 to 4 are conceptual diagrams illustrating examples of services provided in the information processing system 1000 according to the embodiment of the present disclosure. The information processing system 1000 provides services such as “recommended user display” shown in FIG. 2, “preference information display” shown in FIG. 3, and “reproduction of notification information” shown in FIG.

(Recommended user display)
FIG. 2 is an example of a service that recommends a user to another user using sensitivity information. As shown in FIG. 2, when music data 400 is reproduced on each user terminal 200, the user terminal 200 moves the emotions of user A, user B, and user C (hereinafter also referred to as “sensitivity points”) 401 A, 401 B. , 401C occurrence and occurrence position are detected in association with each part of the music data. Information about the detected sensitivity point is transmitted from each user terminal 200 to the server 100 as sensitivity information.

The server 100 compares these pieces of sensitivity information and determines which user to introduce (recommend) to the user A. For example, in FIG. 2, a portion 410 that is A melody, a portion 420 that is B melody, and a portion 430 that is chorus are reproduced in the music data 400. In this case, the sensitivity point 401 A of the user A and the sensitivity point 401 B of the user B overlap at the initial stage of the portion 410. On the other hand, the sensitivity point 401 A of the user A and the sensitivity point 401 C of the user C overlap in the initial part of the part 410 and in the middle of the part 420. As described above, the sensitivity information for the part of the first music data of the user A (first user) and the sensitivity information for the part of the second music data of the user C (second user) are related. Therefore, the server 100 determines that the user C who has generated the sensitivity point 401C having more overlap with the sensitivity point 401A should be introduced to the user A. Then, information about the user C is transmitted from the server 100 to the user terminal 200 of the user A, and the same information is displayed on the user terminal 200.

As a result, a user can use the information processing system 1000 to find a user who is more sensitive to music. And exchange between users with close sensibility to music is possible. That is, in the present disclosure, it is possible to provide a new and improved information processing apparatus, information processing system, information processing method, and program capable of presenting a user with a close sensitivity to music to a certain user.

Note that the processing in the information processing apparatus proposed in Patent Document 1 does not consider how the user actually felt the content used by the user. Therefore, the information processing apparatus described in Patent Document 1 does not necessarily introduce users with close sensibilities.

(Replay of notification information)
FIG. 3 is an example of a service for notifying the user of notification information based on the sensitivity information of other users. First, the music data 400 is reproduced on the user terminal 200 possessed by the user C, and the sensitivity point 401C corresponding to this is detected. Information on the detected sensitivity points is transmitted from the user terminal 200 of the user C to the server 100 as sensitivity information.

The server 100 generates notification information 403 based on the received sensitivity information and transmits it to the user terminal 200 of the user A. The user terminal 200 of the user A who has received the notification information 403 presents the notification information 403 to the user A along with the reproduction of the music when the music data 400 is reproduced. In the illustrated embodiment, the notification information 403 is sound information (sound effects).

Thereby, the user A can know the part (so-called “knocked” part) in which the emotion of the user C moves in the music along with the reproduction of the music data 400. Therefore, the user A can feel the sensitivity of the music of the user C in detail and close to the user C, and can feel sympathy with the user C. As a result, even when the user is listening to music alone, the user can feel as if he / she is listening to music together with other users as in the case of participating in a live venue. In other words, the present disclosure can provide a new and improved information processing apparatus, information processing method, and program capable of notifying a part where an emotion has moved during appreciation of music.

Note that the information processing apparatus described in Patent Document 1 does not notify the user what part of the music the other user actually moved.

(Display of preference information)
FIG. 4 shows an example of a service that represents a user together with preference information based on sensitivity information. In the user information image 500 shown in FIG. 4, the user image 501 of the user himself / herself is displayed, and the mood images 503 A, 503 B, and 503 C of the user are arranged around the user image 501.

Such preference information

503A, 503B, and 503C is generated based on sensitivity information obtained when the user reproduces music data, and is displayed in different colors according to the mood of each preference information. The mood image 503A indicates preference information that is, for example, “Europhoric” and is displayed in red (dot pattern in the figure). The mood image 503B indicates, for example, that it is happy (Happy) and is displayed in green (hatching including a broken line in the drawing). The preference information 503C indicates, for example, that it is fun (Joyful) and is displayed in yellow (in the drawing, a pattern including a hexagon). Such a user information image 500 is displayed not only on the user terminal 200 of the user for the

mood images

503A, 503B, and 503C but also on the user terminals 200 of other users. Here, the mood in the present specification is an atmosphere that appears at the time of reproduction of a musical piece related to music data or a portion thereof, and includes, for example, a musical tone, a musical idea, a mood, and a mood. Such moods include, for example, “Euphoric”, “Happy”, “Joyful”, “Mild”, “Sad”, “Solenn” as described below. ) "," Bright "," Healing "," Fresh ", and" Elegant ". Such a kind of mood can be estimated based on the feature amount of music. Further, the mood of the music can be analyzed by a mood analysis unit described later.

Thus, the user who contacts the user information image 500 can clearly determine what preference the user displayed in the user information image 500 has for music. Also, the user preference information displayed in the user information image 500 is based on the fact that the user's emotions actually moved when music data was reproduced. Therefore, such preference information simply represents the user's actual preference more accurately than information on preference based on the genre of music or the playback history. That is, according to the present disclosure, it is possible to provide a new and improved information processing apparatus, information processing method, and program capable of displaying preference information that reflects a user's sensitivity to music.

Note that the reason for introduction proposed in Patent Document 1 is generated based on content meta information to the last, and does not take into account how the user actually felt the content. Therefore, the information processing apparatus of Patent Document 1 cannot sufficiently indicate the user's preference to be introduced as the reason for introduction.

<2. Server configuration example (first information processing apparatus)>
Next, the configuration of the server 100 according to the present embodiment will be described with reference to FIGS.

FIG. 5 is a block diagram illustrating an outline of a functional configuration of the server 100 according to the present embodiment. 5, the server 100 includes a receiving unit 102, a user information database 104, a music information database 106, a recommended user determining unit 108, a preference information generating unit 110, a notification information generating unit 112, and a transmission. Part 114.

(Receiver)
The receiving unit 102 is connected to the network 300 and can receive information from an electronic device such as the user terminal 200 via the network 300. Specifically, the receiving unit 102 is stored in the user terminal 200 from the user terminal 200, such as sensitivity information, user information, reproduction history, owned music information, and the like regarding the user who owns the user terminal 200. Receives meta information and mood information of music data.

When receiving the user information and sensitivity information of the user having the user terminal, the receiving unit 102 inputs the user information and sensitivity information to the user information database 104. Further, when receiving the meta information and mood information of the music data, the receiving unit 102 inputs the music information to the music information database 106.

(User information database)
The user information database 104 constitutes a storage unit together with the music information database 106. The user information database 104 stores information on a user who owns the user terminal 200. As such user information, user ID information such as user ID, user name, user image, information related to the user's favorite user, music data reproduction history, song ID of music data held, sensitivity information, preference information, Sound effect information etc. are mentioned.

(Music information database)
The music information database 106 records information related to music data. Examples of information related to music data include meta information such as song ID, song name, artist information, album information, cover image, genre, and mood information of each music data.

(Recommended user decision section)
The recommended user determination unit 108 determines a user to be recommended (presented) to a certain user based on the relevance of sensitivity information between users. In other words, the recommended user determination unit 108 functions as a user specifying unit that compares the information including the sensitivity information and specifies the first user associated with the sensitivity information related to the sensitivity information about the second user. . In the present embodiment, the recommended user determining unit 108 determines a recommended user by calculating the product of the relative frequencies of the sensitivity points among the users, for example, as described in FIGS. 6 to 8 are tables relating to sensitivity information used by the recommended user determination unit 108 of the server 100 shown in FIG.

The recommended user determination unit 108 first acquires the sensitivity points for the music data A1 of each user from the user information database, and obtains data as shown in Table 601. Table 601 shows the number of sensitivity points (the number of sensitivity points) for each portion of certain music data for the users X1, X2, and X3.

Here, the user who is a candidate for recommendation is, for example, a user who holds at least some of the songs A1 to An of the songs held by the user who receives the recommendation user's presentation. The music data for the music pieces A1 to An used for determining the recommended user is music data in which sensitivity information is generated by a method described later for the user who receives the recommendation user's presentation. In addition, for such music data, it is preferable that sensibility information is generated for all users who are candidates when determining recommended users.

In the present embodiment, the sensitivity points are generated based on the user's body movement with respect to each part of the music data. Furthermore, the number of sensibility points is a value obtained by integrating the frequency of body movements at the time of reproduction of music data for each piece of music data.

Further, in the illustrated embodiment, the music data portion is a section obtained by dividing the music data phrase into a plurality of phrases, more specifically, a start period, a middle period, and an end period. In addition, it is not limited to the aspect of illustration, The said phrase may be sufficient as the said part, the division obtained by dividing | segmenting a strain or this may be sufficient, and a measure may be sufficient as it. However, in view of the fact that the user's emotional movement occurs with respect to a certain unit of music data, for example, a phrase, the music data part is a section obtained by dividing each phrase of music data into a plurality of parts. Preferably there is.

Next, as shown in FIG. 7, the recommended user determining unit 108 calculates the relative frequency in the music data of the number of sensitivity points described in the table 601 for each user, and calculates the relative frequency information as shown in the table 603. obtain.

Next, the recommended user determination unit 108 multiplies the relative frequency of the sensitivity points shown in FIG. 7 between the users for each piece of music data, and obtains the product of the relative frequencies of the sensitivity points between the users as shown in FIG. . Then, the sum (sum) of the products for each part is obtained as the degree of sensitivity relatedness between users in the music piece A1. For example, considering a case where one of the users X2 and X3 is recommended to the user X1, the user X2 having a larger sum of the products of the relative frequencies has a higher sensitivity relationship with the user X1 than the user X3. become. Also get. For example, considering the case where one of the users X1 and X3 is recommended to the user X2, the user X1 having a larger sum of the products of the relative frequencies has a higher sensitivity relationship with the user X2 than the user X3. become.

The recommended user determination unit 108 performs the above calculation for the music pieces A2 to An, and adds up the sum of the products of the parts for the music pieces A1 to An to obtain the degree of sensitivity related between users. Then, the recommended user determination unit 108 selects a user having a relatively high sensitivity relevance with the user who receives the recommendation user from the candidate users and determines it as a recommended user. Note that a plurality of recommended users may be determined.

The recommended user determination unit 108 transmits the user information about the determined recommended user to the user terminal 200 of the user who receives the recommendation user's presentation via the transmission unit 230. Alternatively, the recommended user determination unit 108 may input information about the determined recommended user into the user information database 104. In this case, in response to a request from the user terminal 200 or periodically, user information on the determined recommended user is transmitted to the user terminal 200 of the user who receives the recommendation user's presentation.

(Preference information generator)
The preference information generation unit 110 generates information related to the user's preference for music, that is, preference information. The preference information generation unit 110 generates preference information based on the user's sensitivity information regarding the mood included in the music data. In the present embodiment, preference information is generated not only based on the user's sensitivity information, but also based on the mood of music in the music data and the music held by the user. Further, there may be one or more pieces of music used for generating the sensitivity information. Furthermore, the mood included in each musical piece may be one or plural. For example, the preference information includes user's sensitivity information for the first mood included in the first song, and user's sensitivity information for the second mood different from the second mood included in the second song, Can be obtained based on. Here, the first music piece and the second music piece may be the same or different music pieces.

Hereinafter, based on FIGS. 9 to 13, a specific example of the generation process of preference information in the preference information generation unit 110 will be described. 9 to 13 are examples of data used in the preference information generation unit 110 of the server 100 shown in FIG. In the illustrated embodiment, the type of mood and the number of users are limited to simplify the description. In this embodiment, the relative frequency of the number of sensibility points for each mood and the relative frequency of appearance for each mood are calculated, and preference information is obtained by averaging these.

First, the preference information generation unit 110 reads, from the user information database 104, the song ID of the song held by the user, that is, the list of songs held and the sensitivity information for each song of the user for each user. On the other hand, the preference information generation unit 110 reads the meta information including the mood information of the music corresponding to the music ID from the music information database 106.

Next, the preference information generation unit 110, based on the list of songs held by the user and the mood information of the songs, as shown in the table 607 of FIG. Is accumulated. Here, the mood shown in FIG. 9 is a mood included in each part of the music held by each user. Such a piece of music may be a phrase, a strain, a segment obtained by dividing these, or a measure.

Next, as shown in the table 609 in FIG. 10, the preference information generation unit 110 calculates the relative frequency of appearance of each mood included in the music held for each user.

Next, the preference information generation unit 110, based on the list of songs held by the user and the sensitivity information about each song, as shown in Table 611 in FIG. 11, the sensitivity for each mood of the song held for each user. Accumulate points.

Next, as shown in Table 613 in FIG. 12, the preference information generation unit 110 calculates the relative frequency of the number of sensibility points for each mood of the music held for each user.

The relative frequency of the number of sensibility points and the relative frequency of appearance of the mood obtained above are averaged for each user and mood to obtain user preference information as shown in FIG. Since such user preference information is generated based on the user's sensibility information, compared to the case where the user's preference information is simply generated from the information of the music or the reproduction history held, there is an emotion to the actual user's music. The moving facts are reflected more accurately.

For example, in FIG. 10, the relative frequency for each mood of the music held by the user X1 is 0.39. However, as shown in FIG. 13, when the sensitivity information is reflected, the preference information of the user X1 is “Nori” is 0.59. In FIG. 10, the relative frequency for each mood of music held by the user X2 is 0.37 for “severe” and 0.26 for “sad”. However, as shown in FIG. 13, when the sensitivity information is reflected, the preference information of the user X2 is 0.26, which is the same for both “severe” and “sad”. In FIG. 10, the relative frequencies of the music pieces held by the user X3 for each mood are 0.31 for “Nori nori”, 0.23 for “strict” and 0.19 for “fun”. However, as shown in FIG. 13, when the sensitivity information is reflected, the preference information of the user X3 is 0.29 for “Nori”, 0.18 for “Strict”, and 0.20 for “Fun”. Therefore, the preference of the user X3 is reversed for “serious” and “fun”.

The preference information generation unit 110 stores the preference information generated in this way in the user information database 104. Alternatively, the preference information generation unit 110 transmits the preference information to the user terminal 200 via the transmission unit 114.

(Notification information generator)
The notification information generation unit 112 generates notification information. Here, the notification information is information indicating a method for notifying the sensibility information of the user or another user together with the reproduction of the music when the music data is reproduced on the user terminal 200. The notification information is generated based on the sensitivity information for the music data of the user. Further, the music data (second music data) reproduced together with the notification information may be the same as or different from the music data (first music data) used to generate the sensitivity information. Also good. However, the second music data and the first music data are related. For example, both the first music data and the second music data may be data related to the same music piece. In such a case, although the music pieces included in the first music data and the second music data are the same, the file format is such as stored in another storage device, or mp3 file and mp4 file. There are different cases. Further, for example, the first music data may be data related to the first music, and the second music data may be data related to the second music including a portion related to (similar to) a part of the first music. Good. Related parts include parts having the same or similar melodies, rhythms, and moods.

The target user is, for example, a user specified by the user terminal 200 that receives the notification information, a recommended user determined by the recommended user determining unit 108, a specific limited user, for example, a favorite user or a favorite user It can be a user belonging to a group or an arbitrarily determined user. Further, the notification information may be generated based on the sensitivity information of one user, or may be generated based on the sensitivity information of a plurality of users. These items can be changed by, for example, an instruction from the user terminal 200 that receives the notification information.

Further, the notification means in the user terminal 200 can be, for example, sound such as sound effects, vibration such as vibration, light emission by an LED lamp, and display of images, characters, and the like. These notification means are appropriately selected in the user terminal 200.

Therefore, the notification information can include sound information related to sound such as sound effects, vibration information related to vibration, light emission information related to light emission, and image display information related to image display. Hereinafter, the function of the notification information generation unit 112 will be described with respect to generation of notification information, particularly sound information and image display information.

The notification information generation unit 112 acquires user information including sensitivity information, user images, and preference information about music data that is a target of the target user from the user information database 104. Further, the notification information generating unit 112 acquires metadata of the target music data from the music information database 106.

The notification information generation unit 112 generates sound information based on user information including metadata and metadata. Specifically, the notification information generation unit 112 outputs a sound (sound effect) to the portion of the music data corresponding to the user's sensitivity information, that is, the portion where the sensitivity points are detected, during reproduction of the music data. Create sound information. The music data portion can be a phrase unit, a measure unit, or a divided segment unit. Moreover, it is preferable that the time for the sound effect to occur is before or after the unit division so as not to disturb the music appreciation.

Further, the notification information generation unit 112 selects a sound effect to be used for sound information from a plurality of kinds of sound effects prepared in advance, for example. The sound effect is not particularly limited, and can be, for example, an electronic sound, a sound that can occur in nature, or a simulated sound or an edited sound thereof. Sounds that can be generated in nature include, for example, shouts such as “Bravo”, voices such as cheers, sounds from human body movements such as applause and footsteps, sounds derived from biological information such as instrument sounds and heart sounds, whistle, cracker sounds, etc. , Recording of audio from the audience at live venues, concert venues, etc.

Further, the notification information generation unit 112 may select a sound effect based on user information or meta information of music data. The notification information generation unit 112 may change the character of the voice or the wording of the shout based on, for example, the gender and age of the target user included in the user information. Moreover, the notification information production | generation part 112 may set a sound effect based on sound effect information, when sound effect information is contained in user information. Here, the sound effect information includes sound effect designation information for designating which sound effect should be selected and unique sound effect data relating to the user-specific sound effect. In particular, when a user-specific sound effect is used as the sound effect, the personality of the target user is reflected in the sound effect. Further, the notification information generation unit 112 may select a sound effect based on mood information included in the target music data.

Further, when there are a plurality of target users, the notification information generation unit 112 may change the volume of the sound effect and the type of the sound effect according to the number of users.

The notification information generation unit 112 may also set sound effects in accordance with output devices such as speakers and earphones provided in the user terminal 200. In addition, the notification information generation unit 112 may set a virtual position where the sound effect occurs using a sound image localization technique. Further, the notification information generation unit 112 may set sound effects according to the environment around the user terminal 200.

Further, the notification information generation unit 112 generates image display information for image display based on user information including sensitivity information and meta information of music data. The image display information includes information regarding the displayed notification image and information regarding the method of displaying the notification image.

The notification image is not particularly limited, and may be any image such as a polygon, a star polygon, an ellipse, a circle, a fan-shaped geometric figure, and an image containing user information, other figures showing emotional movement, animation, etc. Can be. Among these, when the notification image is an image including user information, the user who owns the user terminal 200 can confirm the user whose emotion has moved during the reproduction of the music data. An image including such user information is convenient because the target user can be identified particularly when there are a plurality of target users. The image including user information is configured to include, for example, a user image included in the user information and user preference information. Further, when the notification image is an animation, the animation may include a figure indicating an amount according to the sensitivity information of the user whose sensitivity information is detected, for example, an amount according to a change in the biological information of the user. Thus, by changing the figure according to the sensitivity information, the user who owns the terminal 200 can grasp the degree of emotional movement (pitch) with respect to the user's music from which the sensitivity information is detected.

The display method of the notification image can be any method indicating the target user's emotion moved at which position in the music data. As such a method, for example, a method of displaying a notification image for a certain period of time near the time when a sensitivity point of music data is detected, a sensitivity point along the time axis of a progress bar image of music data displayed on the display unit There is a method of displaying a notification image in a portion where is detected.

Note that the notification information generation unit 112 can also generate notification information for light emission information and vibration information according to the above method.

The notification information generation unit 112 transmits the generated notification information to the user terminal 200 via the transmission unit 114. The notification information may be transmitted periodically or may be transmitted every time the notification information is generated. Further, the transmission method may be changed according to the setting by the user terminal 200. Moreover, the user terminal 200 of a transmission destination can be at least one of a user (first user) involved in acquisition of sensitivity information and another user (second user). In other words, the notification information can be notified to at least one of the first user and the second user.

(Transmitter)
The transmission unit 114 is connected to the network 300 and can transmit information to an electronic device such as the user terminal 200 via the network 300. Specifically, the transmission unit 114 is generated in the user terminal 200 by the preference information generated by the preference information generation unit 110, the user information of the recommended user specified by the recommended user determination unit 108, and the notification information generation unit 112. Notification information can be sent. Further, various information stored in the user information database 104 and the music information database 106 can be transmitted to the user terminal 200 in response to a request from the user terminal 200.

<3. Configuration example of user terminal (second information processing apparatus)>
Next, the configuration of the user terminal 200 according to the present embodiment will be described with reference to FIG.

FIG. 14 is a block diagram illustrating an outline of a functional configuration of the user terminal 200 according to the present embodiment. As illustrated in FIG. 14, the user terminal 200 includes a reception unit 202, an output control unit 204, an output unit 206, a music playback unit 214, a sensitivity information generation unit 216, a mood analysis unit 218, and a storage unit 220. An input unit 226, a position information detection unit 228, and a transmission unit 230.

(Receiver)
The receiving unit 202 is connected to the network 300, and can receive information from electronic devices such as the server 100 and other user terminals 200 via the network 300. Specifically, the receiving unit 202 receives user information such as preference information about the recommended user and other users (first user) and notification information from the server 100. Therefore, the reception unit 202 functions as an information acquisition unit. The receiving unit 202 can receive other users' messages from other user terminals 200. The receiving unit 202 inputs the received information to each component of the user terminal 200, for example, the storage unit 220 and the output control unit 204.

(Output control unit)
The output control unit 204 controls output of information in the output unit 206 described later. Specifically, the output control unit 204 inputs / outputs (inputs) information to the output unit 206 and instructs the output unit 206 to output the information. The output control unit 204 is, for example, a display control unit that controls image display on the display unit 208 of the output unit 206, a sound output control unit that controls sound output of the speaker 210, and a vibration generation control that controls the vibration generation unit. It functions as a part. The output control unit 204 also presents the user information to the display unit 208 that presents the user information of the recommended user (first user) so that the user (second user) who owns the user terminal 200 can recognize. It is an example of an information output part. Note that the output control unit 204 as a presentation information output unit can control the output unit 206 as well as output user information to the output unit 206. Furthermore, the output control unit 204 is an example of a preference information output unit that outputs preference information to the display unit 208 that displays preference information. Note that the output control unit 204 as the preference information output unit not only outputs preference information to the output unit 206 but can also control the output unit 206.

More specifically, the output control unit 204 generates and updates a user interface screen and causes the display unit 208 to display it. The generation and update of the user interface screen are triggered by, for example, an input by the user at the input unit 226, a request from each unit in the user terminal 200, or reception of information from the server 100 or another user terminal 200. The configuration of the user interface screen will be described later.

Further, the output control unit 204 is externally connected to the speaker 210 or the sound effect sound adapted to the user interface or the audio of the music data decoded by the music reproduction unit 214 according to the contents of the input trigger. The speaker 210 and the external audio output device are controlled so as to be output from an external audio output device such as an earphone or an external speaker (both not shown).

Further, the output control unit 204 controls the vibration generating unit 212 to generate vibration or the LED lamp (not shown) to emit light according to the contents of the input trigger.

Further, the output control unit 204 performs control so that the output unit 206 outputs the notification information acquired from the server 100 via the receiving unit 202. Accordingly, the output control unit 204 is a notification information output unit that outputs notification information to the output unit (notification unit) 206 so that the notification information is notified to the user in association with the music data part when the music data is reproduced. It is an example.

The output control unit 204 as the notification information output unit can control the output unit 206 as well as output the notification information to the output unit 206. More specifically, the output control unit 204 as the notification information output unit determines and changes the notification information notification method, and outputs instruction information about the determination and change to the output unit 206 together with the notification information. The output unit 206 is controlled. Here, the output control unit 204 includes information related to the user who has received the notification information, music data (first music data) related to the acquisition of sensitivity information, and music data (second music data) reproduced together with the notification information. ), The method of notification by the output unit (notification unit) 206 can be changed according to at least one of the information regarding at least one. Here, the change of the notification method is not only the change of the notification means such as sound, light, vibration or display, but also the degree of output in the notification even in the case of the same notification means (for example, volume, light quantity, vibration amount, display information) Change of information in the notification (for example, change of sound effect, change of light blinking method, change of vibration method, image to be displayed, change of character). For example, when the notification by the output unit (notification unit) 206 is performed by outputting sound in the second music data portion corresponding to the user's sensitivity information in accordance with the reproduction of the music data, the notification method change is The output sound (sound information) can be changed or the output sound volume can be changed. Further, when functioning as a notification control unit, the output control unit 204 can determine a notification method by the output unit according to the type of music of the music data to be played. For example, the notification method can be determined according to the genre or mood of the music in the reproduction data.

Further, the output control unit 204 may determine a notification method by the output unit 206 according to the number of pieces of notification information acquired for the music data. For example, the output control unit 204 may control the display unit 206 to limit the notification information displayed on the display unit 206 when the acquired notification information exceeds a certain number. In this case, for example, on a normal playback screen (player 710 described later), only an icon that indicates the presence of a plurality of notification information is displayed along the progress bar 713, while when the progress bar 713 is enlarged, a notification is displayed. The display unit 206 may be controlled so that details of the information are displayed.

Further, the output control unit 204 may change the volume of the sound effect and the type of the sound effect according to the number of users who are the target of notification. For example, the output control unit 204 can change the notification method so that the number of users to be notified can be associated. For example, when the number of people is 10 or less, the sound effect is quiet, and when the number of people is 11 to 100, the sound effect is medium and the sound is medium. In the case of 101 people or more, it can be set as a loud sound effect of “GAYAGAWA”. Thereby, the user who received the notification can grasp how much other users are interested in the music to be appreciated.

Also, the output control unit 204 can determine a notification method by the output unit 206 according to the surrounding environment of the user terminal 200 when the music data is reproduced. For example, the type of sound effect can be changed depending on whether the surrounding environment is relatively quiet or relatively noisy.

Further, the output control unit 204 can change the notification method in accordance with an instruction from a user who owns the user terminal 200. For example, the notification information can be set not to be notified in response to a user instruction. In this case, the user can select the type of notification information not to be notified (sound effect, notification image, etc.). In addition, the user can appropriately select a user to be notified.

Also, the output control unit 204 can change the notification method in accordance with an instruction from a user who is a notification target. For example, the output control unit 204 can control the output unit 206 so as to output a sound effect and a notification image specified by a user who is a notification target.

(Output part)
The output unit 206 outputs information in response to a control instruction from the output control unit 204. The output unit 206 includes a display unit 208, a speaker 210, and a vibration generation unit 212. The output unit 206 is an example of a presentation unit that presents a recommended user so that a user who owns the user terminal 200 can recognize. Further, the output unit 206 also functions as a notification unit that notifies the notification information described above.

(Display section)
The display unit 208 includes a display, and displays an image such as a still image and / or a moving image in accordance with a control instruction from the output control unit 204.

(Speaker)
The speaker 210 is a device for generating sound waves. The speaker 210 generates sound according to a control instruction from the output control unit 204.

(Vibration generator)
The vibration generating unit 212 is configured by a device that can generate vibration by a motor or the like. The vibration generation unit 212 generates a vibration in response to a control instruction from the output control unit 204 and causes the user terminal 200 to vibrate.

(Music player)
The music playback unit 214 includes a decoder, acquires music data from the music database 224 provided in the storage unit 220, and decodes the music data. Then, the music playback unit 214 outputs the decrypted music data as information including sound via the output control unit 204 and the output unit 206.
The music playback unit 214 further inputs progress information about the progress of music during playback of music data to the sensibility information generation unit 216.

(Kansei information generator)
The sensibility information generation unit 216 detects a user's emotional movement (sensitivity point) with respect to the music data, and generates sensibility information. Specifically, when the music progress information is input from the music playback unit 214, the sensitivity information generation unit 216 detects the sensitivity points input from the input unit 226 and associates the sensitivity points with the time axis of the music data. . Next, the sensibility information generation unit 216 collects sensibility points associated with the time axis through music data, and generates sensibility information.

In the present embodiment, the sensitivity information generation unit 216 uses the music data portion as the time axis of the music data. The music data portion can be classified as described above. Such information on the music data portion is generated by analysis of the music data by the mood analysis unit 218 and can be acquired by the sensitivity information generation unit 216.

In the present embodiment, the sensitivity information is generated based on the user's body movement with respect to each part of the music data. Sensitivity information includes body motion information calculated based on the frequency of body motion of the user for each part of the music data. More specifically, the body motion information is calculated by integrating the frequency of the user's body motion for each part of the music data for each part. Body movement is an index that can be easily expressed as a movement of emotion when a user appreciates music and can be measured relatively objectively. Therefore, by using the body motion information related to such body motion as part of the sensitivity information, the accuracy of the sensitivity information is improved.

(Mood Analysis Department)
The mood analysis unit 218 analyzes the music data and obtains mood information regarding the music data. Specifically, the mood analysis unit 218 first acquires music data stored in the music database 224 of the storage unit 220. Next, the mood analysis unit 218 obtains time-pitch data by analyzing the waveform of the music obtained from the music data into two axes of energy for each time and pitch. Here, the pitch is analyzed into 12 pitches (doremi) per octave. For example, the mood analysis unit 218 divides the music data into portions corresponding to music for one second along the time axis, and extracts energy for each frequency band corresponding to each of the 12 scales of one octave.

Next, the mood analysis unit 218 analyzes feature quantities such as beat structure, chord progression, key, and music structure according to the music theory based on the information obtained by the analysis. The mood analysis unit 218 estimates the mood of each piece of music included in the music data based on the obtained feature amount. Such moods include, for example, “Euphoric”, “Happy”, “Joyful”, “Mild”, “Sad”, “Solen”, “Solem” It can be classified into multiple types such as “Bright”, “Healing”, “Fresh”, and “Elegant”. Then, the mood analysis unit 218 determines a value corresponding to the feature amount of the portion of the music data for each classified mood. Next, the mood analysis unit 218 can estimate the mood having the highest value according to the feature amount among the plurality of classified moods as the mood of the target portion. A plurality of moods can be assigned to each part. In this case, according to the value corresponding to the feature amount, for example, a plurality of moods are determined in descending order of the value corresponding to the feature amount. Further, such estimation may be performed based on, for example, a pattern table indicating a relationship between a feature amount and mood prepared in advance. The above analysis can be performed, for example, by adopting a twelve sound analysis technique. Then, the mood analysis unit 218 generates mood information indicating the correspondence between the mood and each part of the music data. Note that the present disclosure is not limited to the above-described mode, and the mood analysis unit 218 generates mood information based on music recognition information such as CDDB (Compact Data DataBase) and Music ID included in the meta information of the music data. May be. Such music recognition information may also be obtained from an external database.

As described above, the mood analysis unit 218 provides not only mood information but also various analysis data for music data. The mood analysis unit 218 can also classify music data into appropriate parts based on the various analysis data.

The mood analysis unit 218 inputs analysis information including the obtained mood information to the music database 224 and transmits it to the server 100 via the transmission unit 230.

(Memory part)
The storage unit 220 stores various information necessary for controlling the user terminal 200. The storage unit 220 includes a user information storage unit 222 and a music database 224.

The user information storage unit 222 stores information regarding the user who owns the user terminal 200. Examples of such information relating to the user include communication history with other users or groups in addition to the information stored in the user information database 104 described above.

The music database 224 stores music data of the music held by the user and information related to the music data, for example, meta information such as music ID, music name, artist information, album information, cover image, genre, and mood information of each music data. .

(Input section)
The input unit 226 is a device configured to be able to input information from a user or another device. In the present embodiment, the input unit 226 includes a touch panel. The input unit 226 receives, for example, various instructions from the user and information related to emotional movement of the user's music. As described above, in the present embodiment, the emotional movement of the user with respect to the music is detected as a body movement during reproduction of the music data. Specifically, in the present embodiment, body movement is detected by a user input such as a user tapping a predetermined part of the touch panel. Note that the present disclosure is not limited to the illustrated embodiment, and changes in biological information including body movements as emotional movements of the user's music include a heart rate monitor, a sphygmomanometer, an electroencephalograph, a pulse meter, a thermometer, an acceleration sensor, It can also be automatically detected by a biological information detection unit such as a gyro sensor or a geomagnetic sensor.

(Position information detector)
The position information detection unit 228 is a device configured to be able to detect the position information of the user terminal, for example, a GPS (Global Positioning System). The position information detection unit 228 acquires and inputs the detected position information of the user terminal 200 to the storage unit 220 and transmits it to the server 100 and other user terminals 200 via the transmission unit 230 as necessary. .

(Transmitter)
The transmission unit 230 is connected to the network 300, and can transmit information to the electronic device such as the server 100 or another user terminal 200 via the network 300. Specifically, the transmission unit 230 sends information related to the user, such as sensitivity information, user information, reproduction history, and stored music information, of the user who owns the user terminal 200 to the server 100 and music stored in the user terminal 200. Send meta information and mood information of data. In addition, a message to another user input by the input unit 226 is transmitted to the other user terminal 200.

<4. User interface example of user terminal>
Heretofore, the configuration example of the user terminal 200 according to the present embodiment has been described. Next, an example of a user interface of the user terminal 200 according to the present embodiment will be described with reference to FIGS. FIG. 15 is a screen transition diagram of the user interface of the user terminal 200 according to the embodiment of the present disclosure, and FIGS. 16 to 22 are examples of the user interface screen of the user terminal 200 according to the embodiment of the present disclosure.

As shown in FIG. 15, the user interface screen of the user terminal 200 according to the present embodiment includes a main menu 700 as the first hierarchy, a player 710, a library 720, a recommendation 730, a contact 740, and a setting 750 as the second hierarchy. And a song 760, a user profile 770, a timeline 781, a group profile 782, a chat 783, and a my profile 784 as a third hierarchy. These user interface screens are generated by the output control unit 204 and displayed on the display unit 208.

The main menu 700 shown in FIG. 16 is a screen displayed when the user terminal 200 is activated. Above the main menu 700, a user information image 500 of the user who owns the user terminal 200 is displayed.

In the user information image 500, a user image 501 having a circular outer shape is displayed, and an image (mood image) 503 related to the mood based on preference information about the user is displayed so as to surround the user image 501. The display format of the user image 501 and the preference information 503 is the same as that shown in FIG. As shown in FIG. 4, a plurality of

mood images

503A, 503B, and 503C in the present embodiment are displayed in different colors around the user image 501. In addition, the

mood images

503A, 503B, and 503C are images that are arranged along the edge of the user image 501 and form a ring in this embodiment. The

mood images

503A, 503B, and 503C include a plurality of different colors, and such colors represent different moods. Such mood images 503A to 503C represent, for example, three of the user preference information having the largest numerical values in the above-described calculation. Thereby, the user who owns the user terminal 200 can objectively recognize his / her preference.

It should be noted that the mood image is not limited to the illustrated mode, and the mood image is selected from those shown in FIG. FIG. 17 is a diagram illustrating an example of a mood image of a user according to the present embodiment. Each of the mood images 503A to 503J shown in FIG. 17 is color-coded (differentiated by hatching in the figure) and shows different preferences. More specifically, the mood image 503A is “Euphoric”, the mood image 503B is “Happy”, the mood image 503C is “Joyful”, and the mood image 503D is “Mild”. , Mood image 503E is “Sad”, mood image 503F is “Solen”, mood image 503G is “Bright”, and mood image 503H is “Healing”. The mood image 503I indicates “Fresh”, and the mood image 503J indicates “Elegant”.

Also, on the right side of the user image 501 of the user information image 500, a user name 505 and favorite information 507 are displayed.

Also, below the user information image 500 of the main menu 700, a player button 701, a library button 702, a recommendation button 703, a contact button 704, and a setting button 705 are arranged. When the user taps the touch panel on these images, the user interface screen changes to the player 710, the library 720, the recommendation 730, the contact 740, and the setting 750, respectively.

A player 710 shown in FIG. 18 is a screen displayed when music data is reproduced. A music information image 711 of music data is displayed in the upper center of the player 710, and an operation button 712 is disposed below the music information image 711. By pressing the operation button 712, an operation related to reproduction of music data can be performed. Further, when the music information image 711 is pressed, the user interface screen changes to a song 760 that is a screen for displaying information related to the music.

Further, a progress bar 713 indicating the progress of the music is arranged below the operation button 712. Along with the progress bar 713, the user's sensitivity point 716 and the user information image 500 as sensitivity information of other users. It is shown. Images and arrangement positions of the sensitivity point 716 and the user information image 500 are generated based on the notification information.

Therefore, the user can visually recognize the part where the emotion of another user has moved (knocked), and compares his / her sensitivity point 716 with the user information image 500 as sensitivity information of the other user. Thus, it is possible to recognize the sympathy part between the user and other users. In addition, since preference information is described in the user information image 500, the user compares the preference information with his / her preference, and examines the compatibility of his / her sensibility with his / her own music. be able to.

Further, a sensitivity input button 714 is arranged on the right side of the operation button 712. When the user presses the sensitivity input button 714 in accordance with the reproduction of the music data, body movement information for configuring the sensitivity information is input to the input unit 226.

In addition, a moving bubble animation 715 is displayed around the music information image 711. The animation 715 is generated based on the notification information and is displayed based on its own sensitivity information. For example, in the animation 715, more bubbles are displayed in a portion where the sum of the sensitivity points of the self is large or in a large musical piece. With such an animation 715, the user can recognize the sensitivity to his / her music again, and can raise his / her mood.

Further, a comment 717 is further displayed together with the user information image 500 below the progress bar 713 and the user information image 500 along the progress bar 713. In the comment 717, a comment on the music performed by another user is displayed.

Note that when each user information image 500 described in the player 710 is pressed, the user interface screen changes to the user profile 770 of the user corresponding to the user information image 500. In addition, when each user information image 500 described in the player 710 is pressed according to the setting, the user interface screen shifts to a timeline 781 that displays the music viewed by the user corresponding to the user information image 500 in time series. .

Next, music data held by the user is displayed in the library 720. When the user selects music data as appropriate, the user interface screen is shifted to the player 710 and the music data can be reproduced. Alternatively, the user interface screen can transition to the song 760 and browse music information about the music data.

Next, a recommendation 730 shown in FIG. 19 is a screen that displays the recommended users determined by the recommended user determination unit 108. The recommendation 730 includes a user tab 731, a group tab 732, a near-by tab 733, and a search button 734.

When the user presses the user tab 731, the user information images 500 of recommended users determined by the recommended user determining unit 108 are listed according to the degree of recommendation. In each user information image 500, a user image 501A and preference information 503 are displayed. Thereby, the user possessing the user terminal 200 can sufficiently determine not only the degree of recommendation of the recommended user but also the preference for music. When the user information screen displayed by pressing the user tab 731 is pressed, the user interface screen changes to a user profile 770 that displays a corresponding recommended user.

Further, when the user presses the group tab 732, groups recommended to the user are listed. Such a group is selected from the group to which the recommended user determined by the recommended user determination unit 108 belongs, and the group whose characteristics of the music or artist posted in the chat in the group are close to the user's preference information. . In addition, when an image regarding a group that appears by pressing the group tab 732 is pressed, the user interface screen changes to a group profile 782 that displays the corresponding group.

Further, when the user presses the near buy tab 733, among the user's favorite users and the users in the group in which the user is participating, users existing in the vicinity of the user are listed. In addition, when an image about a user that appears by pressing the near-by tab 733 is pressed, the user interface screen changes to a chat 783 that allows chatting with the corresponding user. As a result, for example, when a user is participating in a live performance, the user can know other users in the vicinity of the live venue and can communicate with the other users or meet directly. Become.

Also, in the recommendation 730, a search button 734 arranged in the information from the user tab 731, the group tab 732, and the near-by tab 733 is displayed. When the user presses the search button 734, the user interface screen changes to a screen for searching for another user or group.

The contact 740 shown in FIG. 20 is a screen for the user who owns the user terminal 200 to contact other users. The contact 740 includes a user tab 741, a favorite tab 742, a group tab 743, and a search button 744.

When the user presses the user tab 741, other users that the user has contacted before are listed according to the time series or frequency of the contact history. When the user tab 741 is pressed and an image about another user appearing is pressed, the user interface screen transitions to a chat 783 that allows chatting with the corresponding user.

When the user presses the favorites tab 742, user information images 500 of favorite users registered in the user's favorites are listed. In each user information image 500, a user image 501A and preference information 503 are displayed. In addition, when the user information image 500 that appears by pressing the favorite tab 742 is pressed, the user interface screen is changed to a chat 783 that allows chat with the corresponding user.

When the user presses the group tab 743, groups in which the user is participating are listed. Further, when an image regarding a group that appears by pressing the group tab 743 is pressed, the user interface screen changes to the group profile 782 of the corresponding group.

In the contact 740, a search button 744 arranged in the information from the user tab 741, the favorite tab 742, and the group tab 743 is displayed. When the user presses the search button 744, the user interface screen changes to a screen for searching for another user or group.

The setting 750 is a screen for performing various settings of the user terminal 200 and the server 100. In the setting 750, for example, a user profile or user-specific notification information is set by user input. Also, in the setting 750, for example, in the notification information acquired by the user terminal 200, whether the origin of the sensitivity information that is the source of the notification information should be a single user, a plurality of users, a favorite, Or all users should be selected.

The song 760 shown in FIG. 21 is a screen that displays information related to music data and comments of each user regarding the music related to the music data. A song information image 761 of music data is displayed on the upper part of the song 760, and an operation button 762 is arranged beside it. By pressing the operation button 762, an operation relating to the reproduction of music data can be performed.

Also, below the music information image 761 of the song 760, a user image 501 of the user who owns the user terminal 200 and preference information surrounding the user image 501 are displayed together with a comment 763. The comment 763 is a comment on the music posted by the user who owns the user terminal 200. A reply button 765 is disposed below the comment 763. When the user presses the reply button 765, a response comment to the comment 763 can be input.

Also, below the user image 501 and the comment 763, a comment 764 for the music is displayed together with a user image 501A of another user who posted the comment 764 and a mood image 503 arranged around the user image 501A. A reply button 765 is arranged below the comment 764. When the user presses the reply button 765, a response comment can be input to the adjacent comment 764.

A user profile 770 shown in FIG. 22 is a screen that displays information about users other than the user who owns the user terminal 200. In the upper center of the user profile 770, a user image 501A of the target user and a mood image 503 arranged around the user image 501 are displayed. A user name 505A and favorite information 507A are displayed below the user image 501A. The number of favorite users added by the target user is described in the favorite information 507A.

Also, a favorite addition button 771 and a message transmission button 772 are displayed below the user name 505A and favorite information 507A. When the favorite addition button 771 is pressed, the target user is added to the favorite user of the user who owns the user terminal 200. When message transmission button 772 is pressed, the user interface screen shifts to chat 783. As a result, a message can be transmitted to the target user.

Further, below the favorite addition button 771 and the message transmission button 772, a feed tab 773, a song tab 774, a group tab 775, and a favorite tab 776 are arranged in the horizontal direction.

When the feed tab 773 is pressed, an action history 777 of a user to be displayed, such as a music appreciation history, a favorite user addition history, a group participation history, and the like are displayed. When the song tab 774 is pressed, music data possessed by the target user is listed. When the group tab 775 is pressed, groups in which the target user is participating are listed. When the favorite tab 776 is pressed, favorite users of the target users are listed.

Also, when the image about the displayed user is pressed when the feed tab 773 or the favorite tab 776 is pressed, the user profile 770 of the corresponding user is displayed. In addition, when the image for the displayed group is pressed when the feed tab 773 or the group tab 775 is pressed, the group profile 782 of the corresponding group is displayed. Further, when the image for the displayed music data is pressed when the feed tab 773 or the song tab 774 is pressed, the song 760 for the corresponding music data is displayed.

A timeline 781 shown in FIG. 15 is a screen for listing songs that a favorite user has watched. When the user image displayed on the timeline 781 is pressed, the user interface screen changes to the user profile 770. When an image related to music data displayed on the timeline 781 is pressed, the user interface screen transitions to a song 760 indicating the corresponding music data.

The group profile 782 is a screen that displays information about the group. Here, a group is a structural unit that is usually configured by a plurality of users and formed with a predetermined purpose. The predetermined purpose includes, for example, exchanges about favorite artists, genres, songs, and the like.

The group profile 782 displays information on members (users) participating in the group and information posted by the members, for example, comments and music information. When an image about a member displayed in the group profile 782 is pressed, the user interface screen transitions to a user profile 770 of the corresponding user or a chat 783 with the corresponding user depending on the setting. When an image about posted music information displayed in the group profile 782 is pressed, the user interface screen transitions to a song 760 displaying the corresponding music information.

In the group profile 782, buttons for the user to join and leave the group are arranged as appropriate.

Chat 783 is a screen for performing chat, that is, sending and receiving messages between users. In chat 783, a message transmitted by each user is displayed together with an image of each user.

My profile 784 is a screen that displays information about the user who owns the user terminal 200. In the my profile 784, information related to the user who owns the user terminal 200 is displayed in a format corresponding to the user profile 770. A user who owns the user terminal 200 can grasp how his / her information is disclosed to other users by referring to the my profile 784.

In the above, an example of the user interface screen has been described. However, the user interface screen used in the user terminal 200 is not limited to the illustrated mode, and screens can be added or omitted as appropriate. Moreover, in each screen mentioned above, the structure regarding each button or information may be added or abbreviate | omitted as needed. Further, the user interface screen may be set so that transition between screens is performed in addition to the above description.

<5. Operation example of information processing system>
Next, an operation flow of the information processing system 1000 described above will be described. 23 to 25 are sequence diagrams illustrating an example of the operation of the information processing system 1000 according to the embodiment of the present disclosure. In the figure, each of the user terminals 200A and 200B is a terminal that is arbitrarily selected from the user terminals 200 described above, and thus has the same configuration as the user terminal 200. Further, the description will be made assuming that the owner of the user terminal 200A is the first user and the owner of the user terminal 200B is the second user. Hereinafter, the operation flow of the information processing system 1000 will be described separately for display of recommended users, display of preference information, and reproduction of notification information.

(Recommended user display)
As shown in FIG. 23, first, the user terminal 200A generates sensitivity information of the first user who owns the user terminal 200A for each music data (S801). Specifically, sensitivity points are input from the input unit 226 in accordance with the music of the music data that is played back and output by the music playback unit 214, the output control unit 204, and the output unit 206. The sensitivity points are input by tapping the sensitivity input button 714 by the first user in the player 710 on the user interface screen described above. Next, the sensitivity information generation unit 216 generates sensitivity information by associating each input sensitivity point with the time axis of the music data.

Next, the user terminal 200A transmits the generated sensitivity information to the server 100 via the transmission unit 230 (S803).

On the other hand, the user terminal 200B also generates sensitivity information of the second user (S805). Next, the user terminal 200B transmits the sensitivity information of the second user to the server 100 (S807). The server 100 acquires sensitivity information of each user including the first user and the second user (S809).

Next, in the recommended user determination unit 108, the server 100 determines a user to be presented to the second user as a recommended user from the plurality of users who have acquired the sensitivity information (S811). The specific procedure for determining recommended users is as described above, and the determination is made based on the relevance of the sensitivity information of each user to the music data portion. In the following description, it is assumed that the recommended user is the first user. Note that there may be a plurality of recommended users.

Next, the server 100 transmits the user information of the first user as the recommended user to the user terminal 200B (S813), and the user terminal 200B acquires the user information of the first user (S815).

Next, the output control unit 204 of the user terminal 200B controls the display unit 208 to display the user information of the first user, and the display unit 208 displays the user information (S817). As a result, the second user can recognize the user information of the first user, and can browse in the present embodiment. Such display of user information is performed, for example, by displaying the user information of the first user in the above-described recommendation 730 on the user interface screen.

(Display of preference information)
Next, a method for displaying preference information will be described. As shown in FIG. 24, first, the user terminal 200A analyzes the mood information of music data in the mood analysis unit 218 (S821). Next, the user terminal 200A generates sensitivity information of the first user who owns the user terminal 200A for each music data (S823). The user terminal 200A transmits the mood information and sensitivity information obtained through the transmission unit 230 to the server 100 (S825). The server 100 acquires mood information and sensitivity information (S827).

Next, the preference information generation unit 110 of the server 100 generates the first user's preference information based on the mood information and the sensitivity information (S829). The server 100 transmits the user information stored in the user information database 104 together with the generated preference information to the user terminal 200B (S831).

The user terminal 200B receives the first user's preference information and user information (S833). Next, the output control unit 204 of the user terminal 200B controls the display unit 208 so as to display the received first user preference information and user information, and the display unit displays the first user preference information and the user information. Display information. Such display of user information and preference information can be performed, for example, by the method described above as shown in FIG.

(Replay of notification information)
Next, a method for reproducing the notification information will be described.
As shown in FIG. 25, first, the user terminal 200A generates sensitivity information of the first user who owns the user terminal 200A for certain music data (S841). Next, the user terminal 200A transmits the generated sensitivity information to the server 100 via the transmission unit 230 (S843). The server 100 acquires the sensitivity information of the first user (S845).

Next, the notification information generation unit 112 of the server 100 generates notification information based on the sensitivity information regarding the music data and the meta information of the music data stored in the music information database 106 (S847). The server 100 transmits the generated notification information to the user terminal 200B via the transmission unit 114 (S849). The user terminal 200B receives the notification information (S851).

Next, when the second user operates the user terminal 200B and the music data is reproduced on the user terminal 200B, the notification information is reproduced in accordance with the progress of the music in the music data (S853). The notification information is reproduced as shown in FIG. 3, for example. Specifically, the notification information is reproduced so that the sound effect 403C is generated at the portion where the sensitivity point 401C of the user C as the first user is generated. Further, for example, as shown in FIG. 18, along the progress bar 713, the user information image 500 is displayed at a position where a sensitivity point is generated by each user. In addition, along with the progress bar 713, own sensitivity points 716 are displayed as notification information.

<6. Modification>
The embodiment of the present disclosure has been described above. Hereinafter, some modified examples of the embodiment of the present disclosure will be described. In addition, each modification demonstrated below may be applied to the said embodiment of this invention independently, and may be applied to the said embodiment of this invention in combination. Each modification may be applied instead of the configuration described in the above-described embodiment of the present disclosure, or may be additionally applied to the configuration described in the above-described embodiment of the present disclosure.

[First Modification]
In the above-described embodiment, the recommended user determining unit 108 uses the product of the sensitivity points for each part of the music between the users as an index of the sensitivity relationship between the users. However, the present disclosure is not limited to this, Sensitivity information for a part of the user's music data only needs to be used for evaluation of the relevance of sensitivity between users. 26 to 28 are other examples of information used by the recommended user determining unit 108 of the server shown in FIG.

For example, the sensitivity relationship between users may be evaluated based on mood information of music data held by the users. For example, the sensitivity points for each mood of music held in FIG. 11 are generated based on the mood information of the music data held by the user and the sensitivity points for each part of the user's music data. Then, as shown in FIG. 26, the product of the relative frequency of the integrated value of the sensitivity points for each mood of the music shown in FIG. 12 is calculated between the users, and this sum is an index of the sensitivity relationship between the users. It can be.

Further, for example, evaluation of the relevance of sensibility between users may be performed based on user preference information. The preference information as shown in FIG. 13 has a value related to preference for each mood. As shown in FIG. 27, the sum total obtained by multiplying the value related to the preference for each mood for each mood can be calculated between users, and this sum can be used as an index of the relevance of sensitivity between users. If such total (fitness) is a value greater than or equal to a certain value, or is relatively large within a certain range compared to other users, the recommended user determination unit 108 determines such suitability. Can be determined as a recommended user.

When the product is calculated for each mood as described above, the recommended user determination unit 108 can determine the recommended user even when no sensitivity information is generated for music data that is common among users. is there. That is, in the present disclosure, the recommended user may be determined based on the sensitivity information of each user, and does not necessarily need to be based on the sensitivity information about the common music data.

Further, for example, the recommended user may be determined based on the reproduction history of the music data of the user who receives the recommendation of the recommended user. For example, in the music data playback history, the sensitivity point in the sensitivity information of each music data may be multiplied by a coefficient corresponding to the playback frequency of each music data. Further, the coefficient may simply increase as the reproduction frequency increases. In addition to this, the coefficient may be set in consideration of an elapsed time after the music data is reproduced. For example, even if the reproduction frequency is the same, the coefficient can be reduced as the elapsed time from the reproduction of the music data is longer. In such a case, the user terminal 200 has a reproduction history database that stores a user's reproduction history, and the reproduction history is transmitted to the server 100 as appropriate.

[Second Modification]
In the embodiment described above, the preference information generation unit 110 generates the preference information based on the sensitivity information for the mood of the user's music and the mood of the music held by the user, but the present disclosure is not limited thereto. What is necessary is just to generate preference information based on the user's sensibility information for one or more moods included in the music and the mood of the music. 29 and 30 show another example of data used in the preference information generation unit 110 of the server 100 shown in FIG.

For example, the preference information generation unit 110 may generate preference information based only on the sensitivity information for the mood of the user's music.

Also, for example, the preference information generation unit 110 may generate preference information based on the sensitivity information about the mood of the user's music, the mood of the music held by the user, and the reproduction history reproduced by the user. For example, the preference information generation unit 110 accumulates the number of moods in all the reproduced music pieces as shown in the table 621 in FIG. 28 based on the reproduction history of the music pieces, and performs all the reproductions as shown in the table 623 in FIG. Calculate the relative frequency of the number of moods in the music. Next, the preference information generation unit 110 averages each relative frequency in the table 623 in FIG. 29, the table 613 in FIG. 12, and the table 609 in FIG. 10 for each user and mood, and the user preference information as shown in FIG. obtain.

Note that the preference information generation unit 110 may multiply the mood by a predetermined coefficient for each piece of music in accordance with the frequency of reproduction of the music in the process of accumulating the number of moods of all played music. That is, the music may be weighted according to the frequency of music playback. The coefficient can be the same as the coefficient at the time of determining the recommended user described above.

Further, the preference information generation unit 110 may generate a plurality of preference information based on different information. In this case, at least one of the preference information is generated based on the user's sensibility information and the mood of the music for one or more moods included in the music.

[Third Modification]
In the above-described embodiment, the user information image 500 has been described on the assumption that the user image 501 having a circular outer shape is displayed and the mood image 503 about the user is displayed so as to surround the user image 501. Is not limited to this. 31 to 35 show the display of mood images according to the modified example of the present disclosure.

For example, the user image may be a polygon, for example, a polygon having 3 to 12 corners, particularly a quadrangle, and an annular mood image may be displayed along the outer periphery thereof. For example, the number of mood images to be displayed is not particularly limited.

Further, as shown in FIGS. 31 and 32, the mood images 513A to 513C and 523A to 523C may be configured by arranging a plurality of color bands representing the mood. In this case, for example, as shown in FIGS. 31 and 32, the mood images 513A to 513C and 523A to 523C can be displayed as the background of the user image 501. The mood image may be displayed as vertical stripes as shown in FIGS. 31 and 32, may be displayed as horizontal stripes, or may be displayed as stripes having a predetermined angle from the horizontal line. .

Also, as shown in FIG. 31, the output control unit 204 may control the display unit 208 so that the mood images 513A to 513C are displayed evenly regardless of the user's preference. In this case, for example, the output control unit 204 is configured such that the mood image (first mood) 513B related to the preference information with higher user preference is from the mood images (second mood) 513A and 513C related to other preference information. Alternatively, the display unit 208 may be controlled so as to be displayed close to the user image 501.

Also, as shown in FIG. 32, the output control unit 204 indicates that the mood image 523A related to the preference information (second mood) with higher user preference is the other preference information (first mood, third mood). The display unit 208 may be controlled so as to be displayed larger than the mood image related to the mood. In this case, the output control unit 204, for example, based on the relationship between the value about the first mood calculated by the preference information generation unit 110 and the value about the second mood, the image about the first mood The ratio of the area of the image for the second mood to the area of can be determined. More specifically, the areas of the mood images 513A to 513C can be determined according to the value for each mood calculated by the preference information generation unit 110.

The output control unit 204 includes a reference point and displays user preference information. An image related to the first mood having a higher user preference than the second mood among the music moods is displayed. You may control the display part 208 so that it may be displayed nearer to a reference | standard part rather than the image regarding a 2nd mood. Here, the reference portion is a point, a line, or a part having a certain area on the screen of the display unit 208 set to display the mood image. Such a reference portion can be, for example, a display part of the user image 501.

For example, as shown in FIG. 33 and FIG. 34, the output control unit 204 uses the mood images 533A to 533I and 533A to 533I as the reference part, and the mood with higher user preference is the reference. You may control the display part 208 so that it may display near a part. Even in this case, the output control unit 204 controls the display unit 208 so that a mood image related to preference information having higher user preference is displayed larger than a mood image related to other preference information. Also good.

When a plurality of preference information is displayed, as shown in FIG. 35, the output control unit 204 displays

mood images

563, 573, and 583 related to a plurality of preference information based on different information. The display unit 208 may be controlled. For example, in FIG. 35,

mood images

563, 573, and 583 are superimposed and displayed so as to form concentric circles. For example, the mood image 563 described at the center in the figure is based on the sensitivity information for the mood of the user's music. Further, the mood image 573 arranged along the outer periphery of the preference information 563 is based on the mood of the music held by the user. Furthermore, the mood image 583 arranged along the outer periphery of the mood image 573 is based on the reproduction history reproduced by the user. The preference information for the

mood images

563, 573, and 583 is generated by the above-described preference information generation unit 110.

[Fourth Modification]
The user terminal 200 may include an edited music data generation unit that generates edited music data obtained by editing the music data based on the music data. For example, the edited music data generation unit can edit music data based on sensitivity information about the user's music data. FIG. 36 is a schematic diagram illustrating editing of music data by the edited music data generation unit included in the user terminal according to the modified example of the present disclosure.

36, when the music data 400 is reproduced, it is assumed that the sensitivity points 401 are generated for the

subsections

411, 421, and 431 in the portion 410, the portion 420, and the portion 430 of the music data 400. In such a case, the edited music data generation unit extracts and combines the

subsections

411, 421, and 431 where the sensitivity points 401 are generated, and generates new edited music data 400A. Since such edited music data 400A is extracted from the portion where the user's sensitivity point 401 is generated, the user can view only the favorite portion of the music data 400 with the edited music data 400A.

[Fifth Modification]
In the above-described embodiment, it has been described that a sensitivity point is detected by pressing the sensitivity input button 714 on the user terminal 200, but the present disclosure is not limited thereto. For example, the user terminal 200 may include a biological information detection unit that can detect a change in the biological information of the user. As such a biological information detection unit, a device corresponding to the biological information to be detected is appropriately selected. For example, the biological information detection unit is a heart rate monitor, a blood pressure monitor, an electroencephalograph, a pulse meter, a thermometer, an acceleration sensor, a gyro sensor, or a geomagnetic sensor.

Among these, the acceleration sensor, the gyro sensor, and the geomagnetic sensor can be used, for example, for detecting body movement and body position, depending on the configuration. For example, when the biological information detection unit is an acceleration sensor, if the biological information detection unit is configured to be attached to the vicinity of the user's head, neck, and trunk, it is possible to detect the user's movement in accordance with the reproduction of music data. is there.

In such a case, the body movement can be detected by comparing the tempo of the music that each part of the music data has with the period of the amplitude in the user's movement. For example, the sensitivity point is detected when the correlation between the tempo of the music and the period of the amplitude is a certain level or more.

[Sixth Modification]
In the above-described embodiment, the user terminal 200 has been described as including the mood analysis unit 218. However, the present disclosure is not limited to this, and the user terminal 200 does not include the mood analysis unit. The server 100 may have a mood analysis unit. In such a case, it is not necessary to perform mood analysis of music data for each user terminal 200. Further, by performing the mood analysis of music data collectively in the server 100, it is possible to prevent the mood analysis of overlapping music data.

When the server 100 has a mood analysis unit, the server 100 may have a music database for storing music data, or the server 100 acquires music data for performing mood analysis from an external music database. May be.

[Seventh Modification]
In the above-described embodiment, the server 100 has been described as including the preference information generation unit 110. However, the present disclosure is not limited to this, and the user terminal 200 may include a preference information generation unit. In such a case, for example, preference information generated in the user terminal 200 is appropriately transmitted to the user information database 104 of the server 100.

<7. Server hardware configuration example>
Next, the hardware configuration of the server 100 described above will be described. FIG. 37 is a block diagram showing a hardware configuration of the server 100 shown in FIG. The server 100 includes a CPU 120, a ROM 122, a RAM 124, a storage device 126, and a communication device 128.

The CPU 120 is a processor that functions as an arithmetic processing unit and a control unit, and controls the overall operation in the server 100 or a part of the operation in the server 100 according to various programs recorded in the ROM 122, the RAM 124, and the storage device 126. The ROM 122 stores programs used by the CPU 120, calculation parameters, and the like. The RAM 124 primarily stores programs used by the CPU 120, parameters that change as appropriate during execution of the programs, and the like. The CPU 120, the ROM 122, and the RAM 124 are connected to each other by a host bus constituted by an internal bus such as a CPU bus.

The storage device 126 is a device for data storage configured as an example of a storage unit such as stored in the user information database 104 and the music information database 106. The storage device 126 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device. The storage device 126 stores programs executed by the CPU 120, various data, various data acquired from the outside, and the like.

The communication device 128 is a communication interface configured with, for example, a communication device for connecting to the network 300. The communication device 128 is, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB). The communication device 128 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet or other communication devices.

Heretofore, an example of a hardware configuration capable of realizing the function of the server 100 according to an embodiment of the present disclosure has been shown. Each component described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Moreover, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out the present embodiment.

Through the above-described cooperation between the hardware and software of the server 100, for example, the receiving unit 102, the user information database 104, the music information database 106, the recommended user determining unit 108, the preference information generating unit 110, the notification information generating unit 112, and The function of the transmission unit 114 is realized.

<8. Hardware configuration of user terminal>
Next, a hardware configuration example of the user terminal 200 will be described. FIG. 38 is a block diagram showing a hardware configuration of the user terminal 200 shown in FIG.

First, the user terminal 200 will be described. As shown in FIG. 38, the user terminal 200 includes a CPU 240, a ROM 242, a RAM 244, a display device 246, a speaker 210, an input device 248, a storage device 250, a communication device 252, and a vibration device 254. Have. The configurations of the CPU 240, the ROM 242, the RAM 244, and the storage device 250 can be the same as the configurations of the CPU 120, the ROM 122, the RAM 124, and the storage device 126 described above, and thus the description thereof is omitted. The speaker 210 has been described above.

The display device 246 is a device that can visually notify the acquired information to the user. The display device 246 constitutes the display unit 208. The display device 246 can be, for example, a CRT display device, a liquid crystal display device, a plasma display device, an EL display device, and a lamp. Further, in the illustrated embodiment, the display device 246 is configured to be incorporated in the user terminal 200, but is not limited thereto, and the display device may exist outside the user terminal 200.

The input device 248 is an operation means operated by the user such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever. The input device 248 may be, for example, remote control means (so-called remote control) using infrared rays or other radio waves, or an external connection device such as a mobile phone or a PDA that supports the operation of the user terminal 200. There may be. Furthermore, the input device 248 is configured by, for example, an input control circuit that generates an input signal based on information input by the user using the above-described operation means and outputs the input signal to the CPU 240. The user of the user terminal 200 can input various data and instruct processing operations to the user terminal 200 by operating the input device 248.

In addition to the configuration of the communication device 128 described above, the communication device 252 includes a communication device for connecting to a wired and / or wireless wide area network (WAN) as necessary.

The vibration device 254 is a device for generating vibration that constitutes the vibration generating unit 212. The vibration device 254 can generate vibration by, for example, rotation of a motor having an eccentric mass.

By the cooperation of the hardware and software of the user terminal 200 described above, for example, the receiving unit 202, the output control unit 204, the output unit 206, the music playback unit 214, the sensitivity information generation unit 216, the mood analysis unit 218, the storage unit 220, Functions of the input unit 226, the position information detection unit 228, and the transmission unit 230 are realized.

<9. Computer program>
A computer program for causing the hardware of each device on the information processing system 1000 described above, or the hardware such as the CPU 120, the ROM 122, the RAM 124, and the storage device 126 built in the server 100 to perform the functions of each device described above. Can also be created. In particular, when the server 100 downloads and installs a computer program, the receiving unit 102, the user information database 104, the music information database 106, the recommended user determining unit 108, the preference information generating unit 110, the notification information generating unit 112, and the server 100 are downloaded. Functions such as the transmission unit 114 may be implemented. A storage medium storing the computer program is also provided.

Further, for example, a computer program for causing hardware such as the CPU 220, the ROM 222, the RAM 224, and the storage device 250 built in the user terminal 200 to perform the functions of each device described above can be created. In particular, when the user terminal 200 downloads and installs a computer program, the receiving unit 202, the output control unit 204, the output unit 206, the music playback unit 214, the sensitivity information generation unit 216, the mood analysis unit 218, the storage Functions such as unit 220, input unit 226, position information detection unit 228, and transmission unit 230 may be implemented. A storage medium storing the computer program is also provided.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data, generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
Notification for outputting the notification information to the notification unit so that the notification information is notified to at least one of the first user and the second user in association with the portion at the time of reproduction of the second music data. An information processing apparatus having an information output unit.
(2)
The information processing apparatus according to (1), wherein the notification by the notification unit is performed by sound, vibration, light, or display.
(3)
The notification by the notification unit is performed by outputting a sound in the portion of the second music data corresponding to the sensitivity information of the first user in accordance with the reproduction of the first music data, (1) or The information processing apparatus according to (2).
(4)
The information processing apparatus according to any one of (1) to (3), wherein the first music data and the second music data are data related to the same music piece.
(5)
The first music data is data relating to a first music piece, and the second music data is data relating to a second music piece including a portion related to a part of the first music piece. ). The information processing apparatus according to any one of
(6)
The notification unit includes a display unit,
The notification by the notification unit is performed by displaying a notification image at a position corresponding to the sensitivity information along the time axis of the progress bar image of the second music data displayed on the display unit. The information processing apparatus according to any one of 1) to (3).
(7)
The information processing apparatus according to (6), wherein the notification image includes user information regarding the first user, and the user information includes preference information for music of the first user.
(8)
The notification information output unit according to any one of (1) to (7), wherein a notification method by the notification unit is changed according to an instruction from the first user or the second user. Information processing device.
(9)
The notification information output unit includes at least one of information on at least one of the first user and the second user, and information on at least one of the first music data and the second music data. The information processing apparatus according to any one of (1) to (8), wherein a notification method by the notification unit is changed according to any of them.
(10)
The notification by the notification unit is performed by outputting a sound in the part of the second music data corresponding to the sensitivity information of the first user in accordance with the reproduction of the first music data,
The information processing apparatus according to (9), wherein changing the notification method is changing the output sound.
(11)
The information processing apparatus according to (9) or (10), wherein the notification information output unit determines a notification method by the notification unit according to a type of music of the second music data to be reproduced. .
(12)
The notification information output unit determines a notification method by the notification unit according to an ambient environment of the information processing apparatus when the second music data is played back. (9) to (11) The information processing apparatus according to any one of claims.
(13)
The notification information output unit determines the notification method by the notification unit according to the number of the notification information acquired for the first music data, according to any one of (9) to (12), The information processing apparatus described.
(14)
The sensibility information is based on at least one of a change in the biological information of the first user when the first music data is reproduced and a body movement of the first user when the first music data is reproduced. The information processing apparatus according to any one of (1) to (13), generated by
(15)
The information processing apparatus according to (14), wherein the sensitivity information includes body motion information calculated based on a frequency of body motion of the first user for each portion of the first music data.
(16)
The information processing apparatus according to (15), wherein the body motion information is calculated by integrating the frequency of the user's body motion for each portion of the first music data for each portion.
(17)
The body movement is detected by comparing the tempo of the music that each part of the first music data has with the period of amplitude in the movement of the first user, (14) to (16) The information processing apparatus according to any one of the above.
(18)
The information processing apparatus according to any one of (14) to (16), wherein the body movement is detected based on an input of the first user.
(19)
The information processing apparatus according to any one of (1) to (18), wherein the notification information output unit controls the notification unit to display an animation based on the notification information.
(20)
The notification information output unit controls the notification unit to display the animation including a diagram showing an amount corresponding to a change in the biological information of the first user at the time of reproduction of the first music data. The information processing apparatus according to (19).
(21)
Obtaining notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A processor outputs the notification information to a notification unit so that the notification information is notified to the first user or the second user in association with the portion when the second music data is reproduced; ,
An information processing method.
(22)
Computer
An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A notification information output unit that outputs the notification information to the notification unit so that the notification information is notified to the first user or the second user in association with the portion at the time of reproduction of the second music data; , A program to make it function as.

DESCRIPTION OF SYMBOLS 100 Server 102 Reception part 104 User information database 106 Music information database 108 Recommended user determination part 110 Preference information generation part 112 Notification information generation part 114 Transmission part 200, 200A, 200B User terminal 202 Reception part 204 Output control part 206 Output part 208 Display Unit 210 speaker 212 vibration generation unit 214 music reproduction unit 216 sensitivity information generation unit 218 mood analysis unit 220 storage unit 222 user information storage unit 224 music database 226 input unit 228 position information detection unit 230 transmission unit 300 network 1000 information processing system

Claims

An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data, generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
Notification for outputting the notification information to the notification unit so that the notification information is notified to at least one of the first user and the second user in association with the portion at the time of reproduction of the second music data. An information processing apparatus having an information output unit.
The information processing apparatus according to claim 1, wherein the notification by the notification unit is performed by sound, vibration, light, or display.
The notification by the notification unit is performed by outputting a sound in a part of the second music data corresponding to the sensitivity information of the first user in accordance with the reproduction of the first music data. Information processing device.
The information processing apparatus according to claim 1, wherein the first music data and the second music data are data relating to the same music piece.
The first music data is data relating to a first music piece, and the second music data is data relating to a second music piece including a portion related to a part of the first music piece. Information processing device.
The notification unit includes a display unit,
The notification by the notification unit is performed by displaying a notification image at a position corresponding to the sensitivity information along a time axis of a progress bar image of the second music data displayed on the display unit. The information processing apparatus according to 1.
The information processing apparatus according to claim 6, wherein the notification image includes user information related to the first user, and the user information includes preference information for the music of the first user.
The notification information output unit includes at least one of information on at least one of the first user and the second user, and information on at least one of the first music data and the second music data. The information processing apparatus according to claim 1, wherein a notification method by the notification unit is changed according to any one of them.
The notification by the notification unit is performed by outputting a sound in the part of the second music data corresponding to the sensitivity information of the first user in accordance with the reproduction of the first music data,
The information processing apparatus according to claim 8, wherein changing the notification method is changing the output sound.
The information processing apparatus according to claim 8, wherein the notification information output unit determines a notification method by the notification unit according to a type of music of the second music data to be reproduced.
The information processing apparatus according to claim 8, wherein the notification information output unit determines a notification method by the notification unit according to a surrounding environment of the information processing apparatus when the second music data is reproduced. .
The information processing apparatus according to claim 8, wherein the notification information output unit determines a notification method by the notification unit according to the number of pieces of the notification information acquired for the first music data.
The sensibility information is based on at least one of a change in the biological information of the first user when the first music data is reproduced and a body movement of the first user when the first music data is reproduced. The information processing apparatus according to claim 1, wherein the information processing apparatus is generated.
The information processing apparatus according to claim 13, wherein the sensitivity information includes body motion information calculated based on a frequency of body motion of the first user with respect to each portion of the first music data.
The information processing according to claim 13, wherein the body movement is detected by comparing a tempo of a music included in each part of the first music data and an amplitude period in the movement of the first user. apparatus.
The information processing apparatus according to claim 13, wherein the body movement is detected based on an input of the first user.
The information processing apparatus according to claim 1, wherein the notification information output unit controls the notification unit to display an animation based on the notification information.
The notification information output unit controls the notification unit to display the animation including a diagram showing an amount corresponding to a change in the biological information of the first user at the time of reproduction of the first music data. The information processing apparatus according to claim 17.
Obtaining notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A processor outputs the notification information to a notification unit so that the notification information is notified to the first user or the second user in association with the portion when the second music data is reproduced; ,
An information processing method.
Computer
An information acquisition unit for acquiring notification information for a part of the second music data related to the first music data generated based on the sensitivity information of the first user at the time of reproduction of the first music data;
A notification information output unit that outputs the notification information to the notification unit so that the notification information is notified to the first user or the second user in association with the portion at the time of reproduction of the second music data; , A program to make it function as.