JP6232304B2 - A viewing system for singing videos that determines the display priority in consideration of the viewer's evaluation - Google Patents

Description

  The present invention relates to a singing video browsing system that allows a server to store singing video data created along with karaoke singing in a karaoke apparatus and allows a viewer to browse a singing video based on this singing video data.

  When singing with a karaoke device installed in a karaoke room, etc., the singing voice from the microphone and the singing video from the camera are acquired as singing video data, and the video publishing server connected via the communication line There is known a service that allows a user who has accessed this server to view a song video by uploading.

  In such a service, a function for presenting singing moving image data in accordance with the hobbies and preferences of a user who desires to browse from a large number of registered singing moving image data is required. For example, Patent Document 1 associates video content data corresponding to singing video data, evaluation information from other users with respect to this video content data, and evaluation information about the singing of the singer who created the video content data. A technique is disclosed in which a table is stored, and moving image content data corresponding to a search request based on specific moving image evaluation information and singing evaluation information is searched from the stored table.

JP 2011-75708 A

  The evaluation information for singing video data (video content data) is the subjective evaluation of other users who watched the video (“cute”, “cool”, “similar”, etc.), and is consistent with the viewer ’s rating. Not exclusively. For this reason, even if the viewer sets and searches conditions that match his / her hobbies and preferences, the desired video content data is not always extracted.

  Moreover, the evaluation information with respect to the song of the singer who created the song moving image data is an average value of the past scoring results of the singer, and the singing level based on the scoring results is set as a condition. Thus, since the singing level becomes a search condition, even if the viewer searches using his / her hobbies and preferences as keywords, the desired singing video data is not necessarily extracted.

  Furthermore, it is troublesome to set evaluation information for singing video data, which is a search condition, and evaluation information for the singing of the singer who created the singing video data for each search. Although it is possible to store the selected search condition, it is difficult to cope with changes in hobbies and preferences of the user who desires to view the song video data.

  This invention is made | formed in view of such a situation, The main objective is to show easily the song moving image data suitable for a viewer's hobby and preference with respect to the said viewer.

  In order to achieve the above-mentioned object, the present invention stores song video data created along with karaoke singing in a karaoke apparatus in a server, and browses a song video based on the singing video data to a viewer through a browsing terminal. A singing video browsing system that acquires feature information by feature analysis of a singer who performed the karaoke singing, and stores the acquired feature information in the server in a state associated with target singing video data A singing video that is operated when the singing video is evaluated by the viewing terminal, and a singing video evaluation unit that generates evaluation information of the singing video, and a singing video that is the basis of the singing video based on the evaluation information Evaluation information acquisition means for storing the identification information of the data in the server in a state in which the identification information of the data is associated with the identification information of the viewer who uses the browsing terminal; Taste information acquisition means for taking statistics of the feature information for the singing video data associated with the identification information of the viewer and acquiring preference information for each of the viewers, and the singing video by the browsing terminal Is selected with reference to the preference information associated with the identification information of the viewer who uses the viewing terminal, and the singing video data having a high degree of similarity to the preference information is given priority over the singing video data having a low degree of similarity It is characterized by having priority display means for increasing the degree of display so as to allow browsing.

  According to the present invention, when the viewer evaluates the singing video using the singing video evaluation means, the feature information of the singing video is reflected in the preference information of the viewer. Then, when the viewer selects a song video by the viewing terminal, the feature information of the song video data is referred to, and the song video data of the feature information having a high degree of similarity to the browser preference information is preferentially presented.

  For example, when the viewer likes the singing video data, the preference information reflecting the viewer's latest hobbies and preferences is acquired simply by operating the nice button on the screen. Then, a recommended singing video based on the preference information can be presented to the viewer. Further, when evaluating the singing moving image data, there is no need to select from a plurality of items, and it is not necessary to select evaluation information that is a condition for searching the singing moving image data.

  In the above-described browsing system, it is preferable that the feature information includes evaluation value data about a pitch, stability, expressive power, rhythm, and singing skill, which are evaluation items of the singing based on the singing moving image data. In this structure, the song moving image data which is performing the user's favorite song can be preferentially presented.

  In the browsing system described above, it is preferable that the feature information includes the number of people photographed as subjects of the singing moving image data and the digitized data of the amount of movement of the people. In this configuration, the priority of presentation can be set in consideration of the number of singers and the movement of the singer in the singing video.

  In the above browsing system, it is preferable that the feature information includes age and sex information based on a date of birth registered in advance for a singer photographed as a subject of the singing video data. In this configuration, the priority of presentation can be set in consideration of the singer's age group and gender in the song video.

  In the above browsing system, it is preferable that the preference information is acquired based on the feature information of a predetermined period or a predetermined number of items from a new date. With this configuration, it is easy to cope with changes in the tastes and preferences of the viewer.

  According to the present invention, in a singing video browsing system that allows a viewer to browse a singing video based on singing video data through a browsing terminal, the singing video data suitable for his / her hobbies and preferences is simply presented to the viewer. it can.

It is a conceptual diagram explaining schematic structure of a karaoke system. It is a block diagram explaining the structure of a karaoke apparatus. It is a figure explaining an example of the scoring result displayed on a monitor. It is a block diagram explaining the structure of a karaoke main body. It is a block diagram explaining the structure of a user terminal. It is a figure explaining the selection image displayed on the display part of a browsing terminal. It is a figure explaining the viewing-and-listening image displayed on the display part of a browsing terminal. It is a block diagram explaining the structure of a host apparatus (server). It is a conceptual diagram explaining the content of user attribute data. It is a conceptual diagram explaining the content of user preference information. It is a conceptual diagram explaining the content of singer characteristic information. It is a conceptual diagram explaining the content of singer information. It is a conceptual diagram explaining the content of scoring information. It is a conceptual diagram explaining the content of video information. It is a conceptual diagram explaining the statistical value of user preference information. It is a flowchart explaining operation | movement. It is a figure which illustrates the update process of a priority order typically.

  Hereinafter, embodiments of the present invention will be described. The karaoke system shown in FIG. 1 has a host device 1 (server), a karaoke device 2, and a user terminal 3. And these are connected via the transmission line 4 so that communication is possible. The host device 1 stores a large amount of singing moving image data (a set of singing recording data and video recording data, which will be described later) that is the basis of the singing moving image, and browsing moving image data processed into a data format suitable for browsing. Yes. Then, in response to a browsing request from the browsing terminal (the user terminal 3 or a remote control device 26 described later), the host device 1 reproduces the corresponding browsing moving image data and causes the viewer to browse the song video.

  Hereinafter, each apparatus which comprises a karaoke system is demonstrated. For convenience, the karaoke device 2 and the user terminal 3 will be described, and then the host device 1 will be described.

  As shown in FIG. 1, the karaoke apparatus 2 is installed in each karaoke room RM of the karaoke shop KB. And as shown in FIG. 2, it has the karaoke main body 21, the speaker 22, the monitor 23, the microphone 24, the video camera 25, and the remote control device 26.

  The karaoke main body 21 performs various controls related to karaoke, such as performance control of selected karaoke music, display control of lyrics and background video, processing of a microphone signal input through the microphone 24, and scoring processing of karaoke singing in a scoring game. Part. The karaoke main body 21 will be described in detail later. The speaker 22 is connected to the karaoke main body 21 and emits sound based on an analog signal from the karaoke main body 21. The monitor 23 is also connected to the karaoke main body 21 and displays video on the screen based on the video signal from the karaoke main body 21.

  Note that the scoring result in the scoring game can also be notified via the monitor 23. FIG. 3 is a diagram for explaining an example of a scoring result displayed on the monitor 23. As shown in the figure, the monitor 23 displays an overall score and an evaluation value for each evaluation item as a basis. Specifically, evaluation values for evaluation items including a total score, pitch, stability, expressive power, rhythm, long tone, vibrato, and vocal range are displayed.

  Here, the evaluation item and evaluation value of the singing in the scoring game will be described. These evaluation items are determined in advance. When a scoring game is selected, the karaoke main body 21 analyzes the microphone signal from the microphone 24 (specifically, the singing signal after digital conversion), and calculates an evaluation value. For this reason, the karaoke main body 21 (the karaoke apparatus 2) functions as a feature information acquisition unit along with the execution of the scoring game.

  The pitch is the distance between the reference pitch and the singing pitch, and is expressed as an accuracy rate. Stability is the degree of stability of the pitch, and there are multiple stages between trembling and straight.

  Expressive power is the ability to perform singing expressions, and is evaluated based on the details of intonation, sneezing, fisting, and fall. Intonation is a technique of singing with the loudness of the voice, and the level is divided into multiple stages. Scribbing is a technology that smoothly raises the pitch from a low pitch to the original pitch. Fist is a decorative melody that moves the sound finely in the basic melody. Fall is a technique for smoothly sliding down from the original pitch toward a lower pitch. For fisting, fisting, and fall, the number of detections is displayed, and the number of detections for each item is reflected in the level of inflection.

  Rhythm is to maintain a constant tempo according to the music, and “tame” slower than the standard and “run” faster than the standard are divided into a plurality of stages. The long tone is a sound of the same pitch for a long time with a single breath, and the level of skill is divided into a plurality of stages. Vibrato is to swing the pitch up and down, and the level of skill is divided into multiple stages. Vibrato also displays the type (vibrato type) and the total number of seconds. The vibrato type is classified into a box type, an ascending type, a descending type, an expanded type, a reduced type, and a non-vibrato according to the pattern of amplitude change with time. Further, the box shape is divided into three types A to C. The vocal range is a range of pitches uttered by the singer and is expressed in a keyboard format. Of these evaluation items, long tone and vibrato correspond to the evaluation items for singing skill.

  The total score is a scoring value obtained by combining the evaluation values of the items. For example, singing is performed every time the karaoke apparatus 2 set in the scoring mode performs karaoke music, and the total score is calculated.

  As shown in FIG. 2, the microphone 24 is connected to the karaoke main body 21, and converts a user's voice or the like into a microphone signal and inputs the microphone signal to the karaoke main body 21. This microphone signal is appropriately adjusted by the karaoke main body 21 and mixed with the karaoke performance sound or the like. The video camera 25 shoots the karaoke room RM and generates a video signal. The video camera 25 is also connected to the karaoke main body 21, and the generated video signal is input to the karaoke main body 21. This video signal is used when creating song moving image data that is the basis of a song moving image.

  The remote control device 26 includes a short-range wireless communication unit capable of bidirectional communication for transmitting and receiving information to and from the karaoke main body 21 and is operated when a karaoke song is reserved. When reserving karaoke music, the remote control device 26 transmits an operation signal including a music ID for identifying the music to be played. And the karaoke main body 21 manages the karaoke music selected by the user in a queue.

  In addition, the remote control device 26 of the present embodiment includes a display unit (described later) with a touch panel, and can be used for user authentication or as a browsing terminal. At that time, the remote control device 26 transmits operation information corresponding to the operation by the user to the host device 1 via the neighboring router device RT and the transmission path 4.

  Next, the karaoke main body 21 will be described in detail. As shown in FIG. 4, the karaoke main body 21 includes a main body side control unit 31, a main body side communication unit 32, a main body side storage unit 33, a sound source unit 34, an acoustic processing unit 35, a display processing unit 36, A video input unit 37 and an operation unit 38 are provided. These units are connected to a communicable state via the bus BS.

  The main body side control unit 31 is a central part of control in the karaoke main body 21, and includes a CPU 31a and a memory 31b. The CPU 31a executes various controls according to the operation program stored in the memory 31b. For example, an operation input process for receiving an operation from the operation unit 38 or a sequencer process that operates as a sequencer is performed. The memory 31b is a storage element that stores a program to be executed by the CPU 31a and temporarily stores various types of information when the program is executed.

  The main body side communication unit 32 provides an interface for connecting the karaoke main body 21 to the transmission path 4 via the router device RT. Therefore, the main body side communication unit 32 transmits and receives information to and from the router device RT. The operation of the main body side communication unit 32 is controlled by the main body side control unit 31.

  The main body storage unit 33 is a large-capacity storage device that stores various types of data, and includes a hard disk drive or the like. The main body storage unit 33 includes, for example, a music data storage area 33a, a scoring program storage area 33b, a scoring information storage area 33c, a song recording data storage area 33d, and a video recording data storage area 33e.

  In the music data storage area 33a, music data for playing the karaoke music designated by the remote control device 26 is stored. The music data includes MIDI data, lyrics data, and reference data. MIDI data is automatic performance data (karaoke performance data) for automatically playing a sound source of an electronic musical instrument, and is composed of time-series note information. The note information is composed of various commands for controlling, for example, the timing of sound generation and mute, key pressing force, pitch, and playback pitch. The lyric data is character string data for displaying the lyrics telop in the karaoke music on the monitor 23. The reference data is used when scoring a karaoke song by a user, and is composed of time-series pitch information representing the pitch of a vocal.

  A scoring program is stored in the scoring program storage area 33b. This scoring program is read by the main body side control unit 31 and executed as appropriate. By executing this scoring program, a scoring game for karaoke singing is performed.

  In the scoring game, the singing signal corresponding to the user's singing sound is compared with the reference data. For example, the pitch information of the singing signal at the same timing and the pitch information of the reference data are sequentially compared in time series, and pitch difference information is acquired. Based on this difference information, the pitch is evaluated as good or bad (that is, the above-mentioned pitch). The rhythm (timing) is evaluated by detecting the time difference between the frequency change of the singing signal and the frequency change of the reference data, and the inflection is evaluated by comparing the maximum sound and the minimum sound for each sector.

  Moreover, stability is evaluated based on the frequency change of a song signal. In other words, whether the pitch is straight (constant) or prone to tremble is detected, and the stability is higher as the pitch is straighter. Based on the frequency of the singing signal, the presence / absence of squeak, fist, and fall is detected, and the periodicity is detected with respect to the frequency of the singing signal. Based on this periodicity, the presence / absence, length, and skill of vibrato are detected. Is determined. Further, the skill of the long tone is determined based on the stability of the singing pitch.

  The evaluation result of each item is temporarily stored in the work area of the memory 31b, and is stored in the scoring information storage area 33c together with the total score and the like when the scoring process is completed. The singing recording data storage area 33d stores singing recording data obtained by converting the microphone signal from the microphone 24 into digital data, and the video recording data storage area 33e is created based on the video signal from the video camera 25. Video recording data is stored. The evaluation result and the total score stored in the scoring information storage area 33c, the song recording data stored in the song recording data storage area 33d, and the video recording data stored in the video recording data storage area 33e are stored in the host device. 1 is transmitted and stored.

  Next, the sound source unit 34 will be described. The sound source unit 34 is a part that generates a karaoke performance sound signal based on MIDI data. When the main body side control unit 31 performs sequencer processing, the sound source unit 34 processes waveform data according to MIDI data and outputs the processed musical sound signal to the acoustic processing unit 35.

  The sound processing unit 35 is a part that performs processing of the karaoke performance sound signal and processing of the microphone signal generated by the microphone 24. For example, in performance control of karaoke music, the sound processing unit 35 performs analog conversion on the musical sound signal output from the sound source unit 34 to generate a karaoke performance sound signal. Further, when a microphone signal from the singing microphone 24 is input, a singing signal is generated by appropriately adjusting. This singing signal is mixed with the karaoke performance sound signal and output to the speaker 22 as a sound emission signal. In addition, the sound processing unit 35 digitally converts the generated song signal to generate song recording data, and stores the song recording data in the song recording data storage area 33d. The digitally converted singing signal is compared with reference data or analyzed and evaluated when the scoring program is executed.

  The display processing unit 36 performs display control of a background video or the like during karaoke performance. At the time of karaoke performance, background video data is input to the display processing unit 36, and the background video data is decoded. The background video data is stored in the main body storage unit 33, for example. Then, the display processing unit 36 combines the lyrics telop with the video signal of the background video generated by the decoding, and outputs the combined video signal to the monitor 23. At that time, the display processing unit 36 synthesizes the lyrics telop based on the lyrics data output by the sequencer processing in the main body side control unit 31. Also, the display color of the lyrics telop is changed according to the color change command output by the sequencer processing. As a result, the composite video in which the lyrics telop is superimposed on the background video is displayed on the monitor 23, and the display color of the lyrics telop is changed in accordance with the progress of the karaoke music.

  The video input unit 37 is a part that captures a video signal from the video camera 25, and is configured by, for example, an interface circuit. The input video signal is converted into image data for each frame and stored in the video recording data storage area 33e as video recording data.

  The operation unit 38 includes a panel switch, a remote control receiving circuit, and the like, and outputs an operation signal corresponding to the operation of the panel switch and the remote control device 26 to the main body side control unit 31. The main body side control unit 31 detects an operation signal by performing an operation input process, and executes a corresponding process. Note that the panel switch and the remote control device 26 include various key switches (not shown) for selecting an operation.

  Next, the user terminal 3 will be described. The user terminal 3 is a communication terminal operated by a karaoke user, and includes a personal computer 3A, a tablet computer 3B, a mobile phone 3C, and the like as shown in FIG. This user terminal 3 functions as a browsing terminal for browsing a song moving image, like the remote control device 26.

  As illustrated in FIG. 5, the user terminal 3 includes a terminal-side control unit 41, a terminal-side communication unit 42, a terminal-side storage unit 43, a display unit 44, and an input unit 45.

  The terminal-side control unit 41 is a central part of control in the user terminal 3, and includes a CPU 41a and a memory 41b. The CPU 41a executes various controls according to the operation program stored in the memory 41b. The memory 41b is a storage element that stores a program to be executed by the CPU 41a and temporarily stores various types of information when the program is executed. The terminal side communication unit 42 provides an interface for connecting the user terminal 3 to the transmission path 4. The terminal-side storage unit 43 is a storage device that stores various types of information, and includes a nonvolatile memory, a hard disk drive, and the like.

  The display unit 44 and the input unit 45 are parts that provide a user interface. The display unit 44 is a part that displays various menus and browsing moving images, and is composed of, for example, a liquid crystal display device or a cathode ray tube. The input unit 45 is a part that captures an operation performed by a user as operation information, and includes, for example, a keyboard, a mouse, and a touch panel. In the tablet computer 3B and the remote control device 26 that require portability, a liquid crystal display panel with a touch panel in which the display unit 44 and the input unit 45 are integrated is preferably used.

  As described above, the user terminal 3 and the remote control device 26 are also used as a browsing terminal for browsing a song moving image. When used as a browsing terminal, the display unit 44 displays a selection image for selecting a song video and a viewing image for viewing the selected song video.

  FIG. 6 shows an example of a selection image displayed on the display unit 44. In the example shown in the figure, the thumbnail images of the singing moving images are arranged in a matrix of 2 rows × 4 columns. In the present embodiment, the higher the degree of recommendation to the viewer is, the higher the display priority is set, and the thumbnail image is displayed at a position that is easily perceived by the viewer. In this example, the display priority is set higher in the upper stage than in the lower stage, and the display priority is set higher in the left end than the right end.

  For this reason, the thumbnail image is displayed at the upper left corner of the singing moving image α having the highest degree of recommendation. And about the song animation (beta) with the second highest recommendation degree, the thumbnail image is displayed 2nd from the upper left. For the song video γ having the third highest recommendation level, the thumbnail image is displayed third from the left on the upper stage. Such prioritized display of thumbnail images is performed by display control information (my page information described later) from the host device 1. Therefore, the host device 1 corresponds to priority display means.

  When the viewer selects a favorite thumbnail image and performs an operation such as clicking, the display on the display unit 44 is switched to the viewing image of the song video corresponding to the selected thumbnail image. FIG. 7 shows an example of a viewing image displayed on the display unit 44. In the example shown in the figure, a moving image display area 44b for displaying a singing moving image occupies most of the image display range. A title and various button images are displayed around the moving image display area 44b. For example, a nice button 44c, a favorite button 44d, and a return button 44e are displayed in order from the left side in an area below the moving image display area 44b.

  The nice button 44c is a button image operated when the viewer highly evaluates the singing moving image. Information indicating that the operation has been performed is received by the host device 1 by operating the nice button 44c. Then, the host device 1 recognizes that the viewer has highly evaluated the song video. Therefore, the operation information for the nice button 44c corresponds to evaluation information indicating that the singing moving image has been evaluated.

  The favorite button 44d is a button image that is operated when the viewer likes the song moving image and registers it in his / her favorite list. Therefore, the operation information for the favorite button 44d also corresponds to evaluation information indicating that the singing moving image has been evaluated. The return button 44e is a button image operated when returning from the viewing image to the list image.

  The browsing terminal (user terminal 3, remote control device 26) that outputs operation information for the nice button 44c and the favorite button 44d corresponds to the evaluation information acquisition means together with the host device 1 that receives the operation information and performs predetermined processing. To do. Moreover, the nice button 44c and the favorite button 44d operated by the viewer correspond to singing video evaluation means operated by the viewer when the viewer evaluates the singing video.

  Next, the host device 1 will be described. The host device 1 functions as a server and accumulates and manages various information such as customer information and history information. As illustrated in FIG. 8, the host device 1 includes a host-side control unit 11, a host-side communication unit 12, and a host-side storage unit 13.

  The host-side control unit 11 is a central part of control in the host device 1 and includes a CPU 11a and a memory 11b. The CPU 11a executes various controls according to the operation program stored in the memory 11b. The memory 11b is a storage element that stores a program to be executed by the CPU 11a and temporarily stores various types of information when the program is executed.

  The host-side communication unit 12 provides an interface for connecting the host device 1 to the transmission path 4. Thereby, various information can be transmitted / received between the host apparatus 1 and the karaoke apparatus 2 and between the host apparatus 1 and the user terminal 3. For example, various information such as singing history and scoring results of karaoke songs, singing moving image data (a set of singing recording data and video recording data), and browsing moving image data can be transmitted and received.

  The host-side storage unit 13 is a storage device that stores a large amount of information, and is configured by, for example, a hard disk drive. And the partial area | region of the host side memory | storage part 13 is used as the user information storage area 13a and the song moving image information storage area 13d.

  The user information storage area 13a is an area for storing information about the user, a user attribute information storage area 13b for storing user attribute information, and a user preference information storage for storing user preference information. A region 13c is provided. The singing video information storage area 13d is an area for storing information related to the singing video, the singing recording data storage area 13e for storing the singing recording data transmitted from the karaoke apparatus 2, and the video recording data transmitted from the karaoke apparatus 2. A video recording data storage area 13f for storing video, a video data storage area for browsing 13g for storing video data for browsing, and a singer characteristic for storing singer characteristic information obtained by analyzing the characteristics of the singers of the singing video data An information storage area 13h is provided.

  Examples of user attribute information stored in the user attribute information storage area 13b include user ID, address, telephone number, date of birth, sex, and occupation, as shown in FIG. Among these, the user ID is identification information for identifying the user and is given to each user.

  The user preference information stored in the user preference information storage area 13c is information indicating the preference of the viewer (user) with respect to the song video. For example, as shown in FIG. 10, the user preference information includes a moving image ID. Here, the moving image ID is identification information for identifying the moving image data for browsing, and is assigned to each singing moving image. The moving image ID included in the user preference information corresponds to the singing moving image highly rated by the viewer. In the present embodiment, the moving image ID of the singing moving image in which the nice button 44c is operated and the moving image ID of the singing moving image in which the favorite button 44d is operated are stored as user preference information.

  In the present embodiment, a moving image ID acquired from the present to a predetermined period (for example, one month) or a moving image ID from the latest to a predetermined number (for example, 100) is a user preference information storage area. 13c. This is because the latest preference of the viewer is reflected in the user preference information.

  Further, as shown in the figure, the user preference information includes statistical value information. This statistical value information is obtained by taking statistics of singer characteristic information described later with respect to the singing moving image specified by the moving image ID in the user preference information storage area 13c. For convenience, this statistical value information will be described after the singer characteristic information. Then, the statistical processing of the singer characteristic information is performed by the host device 1. For this reason, the host device 1 corresponds to preference information acquisition means.

  Since the singing recording data stored in the singing recording data storage area 13e and the video recording data stored in the video recording data storage area 13f have been described above, description thereof will be omitted here. The browsing moving image data stored in the browsing moving image data storage area 13g is moving image data in a format (for example, WMV format or MP4 format) suitable for browsing on the browsing terminal, and includes a moving image ID, a song ID, a user ID, and the like. Are stored in a state associated with various types of information. The browsing moving image data is generated by the host device 1 along with the uploading of the singing moving image data from the karaoke device 2.

  The singer characteristic information stored in the singer characteristic information storage area 13h is information obtained by analyzing the characteristics of the singer in the singing video data. As shown in FIG. 11, the singer characteristic information of the present embodiment includes date and time information, singer information, scoring information, and video information, which are stored in a state in which they are associated with the video ID. Has been. Hereinafter, each information will be described.

  The date and time information is information on the date and time when the karaoke singing based on the singing moving image data was performed. For example, the time stamp of the singing recording data or the video recording data created by the karaoke apparatus 2 is used. The date / time information may be information on the date / time when the host device 1 created the moving image data for browsing. And the karaoke apparatus 2 and the host apparatus 1 which set date information correspond to a characteristic information acquisition means.

  The singer information is information for specifying the singer of the singing video. As shown in FIG. 12, the singer information of the present embodiment is configured by user identification information. As shown in the figure, a plurality of pieces of user identification information can be stored in order from the first user identification information. This is to cope with singing by a plurality of people. For example, if it is a singing animation of a duet song, the identification information of two people who performed a duet song is memorize | stored as identification information of a 1st user, and identification information of a 2nd user. Moreover, if it is the song animation of the chorus by a group, the identification information of all the members who belong to the same group will be memorize | stored sequentially from a 1st user. And this singer information is referred in order to recognize the number of singers, sex, and age about a corresponding song animation.

  The scoring information is an evaluation result in the scoring game in the karaoke song that is the basis of the singing video data, and the content is the same as that described in FIG. That is, as shown in FIG. 13, this scoring information is composed of a music ID, pitch, stability, rhythm, expressive power (inflection, shawl, fist, fall), vibrato, long tone, score, and the like. The scoring information is transmitted from the karaoke apparatus 2 to the host apparatus 1 together with the singing moving image data (singing recording data, video recording data).

  The video information is information regarding a person photographed as the subject of the singing video. For example, as shown in FIG. 14, the video information includes items such as a movement level, the number of people, gender, and age. The movement level is composed of numerical data indicating the amount of movement of the singer who is the subject, that is, a level value indicating the magnitude of the movement step by step. This motion level can be acquired, for example, by extracting a person from the video recording data with a wire frame and measuring the amount of motion of the extracted wire frame on the image. The number of persons indicates the number of photographed persons, and can be acquired by the singer information described above and the number of extracted wire frames. The gender indicates the gender of the photographed person and can be acquired based on the singer information described above. Regarding gender, in the case of mixed sex, data indicating both men and women is recorded. The age indicates the age of the photographed person and can be acquired based on the singer information (birth date) described above. In addition, regarding the age, in the case of a plurality of users, data indicating the average age, the first user, the representative, the oldest, etc. is recorded.

  Next, statistical value information included in the user preference information will be described. This statistical value information is obtained by taking the statistics of the singer characteristic information described above for the singing video (the singing video specified by the video ID of the user preference information) highly evaluated by the target viewer. Created for each (user). The statistical value information of this embodiment is composed of scoring statistical information shown in FIG. 15 (a) and singer statistical information shown in FIG. 15 (b).

  As shown in FIG. 15 (a), the statistic value information of the scoring system is similar to the scoring information, each of pitch, stability, expressive power (intonation), rhythm, long tone, and vibrato (skilledness, type). It consists of evaluation items. And it calculates by acquiring each evaluation value in the song moving image which the viewer evaluated highly, and taking statistics for every evaluation value. For example, the calculation is performed by performing arithmetic average processing or weighted average processing in which the latest evaluation value is increased in weight. Note that the vibrato type is obtained by comparing the number of times belonging to the singing moving image highly evaluated by the nice button 44c or the like for each type, and sorting in the descending order of the number of times.

  Thus, it can be said that the statistic value information of the scoring system obtained represents the preference of the target viewer with respect to the karaoke song. In the example shown in FIG. 15 (a), the pitch A is slightly higher than the pitch, the stability is a little straight, the expressive power is slightly higher, the rhythm side is slightly higher, the long tone and the vibrato are slightly above the standard, and the vibrato is the box A type. It turns out that it is a visitor's liking.

  As shown in FIG. 15B, the statistic information of the singer system is composed of items of movement, number of people, sex, and age. This statistical value information is also calculated by obtaining video information in a song moving image highly evaluated by the viewer and taking statistics for each item. In the example shown in FIG. 15B, it can be seen that the movement is less, the song is sung by a small number of people such as one person, and the singing video of a young female is the viewer's preference.

  The statistical value information is used when determining the display priority of thumbnail images in the selected image described in FIG. That is, the host device 1 (priority display means) refers to the statistical value information, and for the evaluation value of each evaluation item, the singing video data having a high degree of similarity with the statistical value information is compared to the singing video data having a low degree of similarity. Increase the priority so that it can be viewed. In the example of FIG. 6, the song video α is the closest to the viewer's preference, the song video β is displayed as the second, and the song video γ is displayed as the third. Thereby, since the thumbnail image of the singing moving image close to the viewer's preference is displayed at a position that can be easily perceived by the viewer, it is possible to easily present the singing moving image data suitable for the user's hobbies and preferences.

  Hereinafter, the operation of the karaoke system will be described focusing on the creation of singing moving image data, the evaluation of the singing moving image by the viewer, and the priority display of thumbnail images by the host device 1. FIG. 16 is a flowchart for explaining operations of the karaoke device 2, the browsing terminal (user terminal 3, remote control device 26), and host device 1.

  First, in the karaoke apparatus 2, it is monitored whether or not the video recording mode for recording a singing video is set (S11). Here, if the moving image recording mode is set, the karaoke apparatus 2 records the singing moving image (S12). That is, the microphone signal from the microphone 24 is input to the karaoke main body 21, and the karaoke main body 21 converts the microphone signal into digital data to generate song recording data, which is stored in the song recording data storage area 33d. A video signal from the video camera 25 is input to the karaoke main body 21, and the karaoke main body 21 converts the video signal into image data for each frame and stores it as video recording data in the video recording data storage area 33e.

  Moreover, the karaoke apparatus 2 executes the scoring program on condition that the moving image recording mode is set, and performs scoring on the target karaoke song (S13). Thereby, an evaluation value is acquired for each evaluation item described in FIG. 3, and a total score is calculated. The scoring results (evaluation values and overall scores) are stored in the scoring information storage area 33c described with reference to FIG.

  Next, the singer (the user who recorded the singing video) instructs the karaoke device 2 to view the singing video (S14). Thereby, the karaoke apparatus 2 reproduces the recorded song recording data and the video recording data on the monitor 23, the speaker 22 or the like, and allows the singer to view the song moving image. Here, when the singing moving image watched is not satisfactory (S15), the singer determines whether or not to re-shoot (S16). Here, when it is determined that re-shooting is performed, the singer operates the remote control device 26 to notify the karaoke main body 21 to that effect. Thereby, it transfers to step S12 and a song animation is recorded again. If it is determined that re-shooting is not performed, the singer operates the remote control device 26 to notify the karaoke main body 21 to that effect. Thereby, the moving image recording mode is canceled (S17), and the process proceeds to step S11.

  When the singing moving image that is viewed is satisfied (S15), the singer operates the remote control device 26 to notify the karaoke main body 21 to that effect. Thereby, the karaoke apparatus 2 transmits the various data required for creation of a song animation to the host apparatus 1 (S18). In this embodiment, various data such as song recording data, video recording data, and scoring information are transmitted in a state associated with the user ID. Then, the host device 1 stores various data transmitted from the karaoke device 2 in a predetermined storage area (S31).

  Next, the operation of the browsing terminal (user terminal 3, remote control device 26) will be described. In the browsing terminal, when a viewer (a user who browses a song video) desires to browse a song video, the user logs in to the host device 1 and requests display of the viewer's My Page (S21). Accompanying this display request, authentication information is transmitted from the viewing terminal to the host device 1. In the host device 1, on the condition that the authentication information is correct, my page information for displaying the viewer's my page is transmitted to the browsing terminal (S32).

  This my page information includes information on a selection image (see FIG. 6) for selecting a song moving image. For this reason, the selected image is displayed on the viewing terminal by opening My Page. Here, at the first login, the nice button 44c is not operated once. For this reason, the selection image at the time of the first login is such that popular videos that have been highly evaluated by many viewers are displayed in order of popularity.

  Then, when the viewer plays a favorite singing movie and operates the nice button 44c or the like (S22), nice operation information and the like are transmitted to the host device 1 (S23). As described above, the nice operation information or the like corresponds to the evaluation information of the singing moving image, and includes information for specifying the moving image ID. As information for specifying the moving image ID, for example, the moving image ID may be transmitted, or a combination of the coordinate information of the nice button 44c and the nice operation information may be transmitted.

  The host device 1 that has received the nice operation information and the like performs the recommended moving image ranking update process (S33). In this order update process, the host device 1 records the video ID in the user preference data, and corresponds to the video ID for a predetermined period (for example, one month before that day) or a predetermined number (for example, the latest 100). The singer information, scoring information, and video information are imported, and the statistical information is updated.

  As shown in FIG. 17 (a), the scoring system statistical value information is composed of evaluation items of pitch, stability, expressive power (intonation), rhythm, long tone, and vibrato (goodness, type). Yes. Then, as shown by the dotted line graph in the figure, each evaluation value in the singing moving image highly evaluated by the viewer is acquired. Further, by taking statistics for each evaluation value, statistical value information is calculated as shown by a solid line graph in the figure. Further, the vibrato types are obtained by comparing the number of selected times for each type and sorting the types in descending order of the number of times of selection as indicated by arrows in the figure.

  As shown in FIG. 17 (b), as for the statistic information of the singer system, as shown by the dotted lines in the figure, the singing video that the viewer highly evaluated for each item of movement, number of people, sex, and age. Information is acquired. Then, by taking statistics for each item, statistical value information is calculated as indicated by a solid line in the figure.

  Then, as shown in FIG. 16, the host device 1 performs the rank update process in step S33 each time nice operation information is transmitted from the viewing terminal until the viewing terminal logs out (S24). Thereby, singer information, scoring information, and video information about the singing moving image highly evaluated by the viewer are sequentially captured, and statistical information that matches the viewer's preference is acquired. As a result, when the viewer displays the my page, the singing video close to the viewer's preference is displayed with high priority. That is, the song moving image data of the singer characteristic information having a high degree of similarity with the viewer's preference information is preferentially displayed.

  As is clear from the above description, in the karaoke system of the present embodiment, when a viewer evaluates a song video by operating the nice button 44c or the like, singer characteristic information (singer information, scoring information, video of the song video) Information) is reflected in the browser's preference information. Then, when the viewer selects a song video by the browsing terminal, the singer feature information of the singing movie data is referred to, and the singer movie information of the singer feature information having a high degree of similarity to the viewer preference information is used as the recommended video. Displayed with priority. Further, when evaluating the singing moving image data, there is no need to select from a plurality of items, and it is not necessary to select evaluation information that is a condition for searching the singing moving image data. As a result, it is possible to simply present to the viewer singing video data that matches his / her hobbies and preferences.

  And since the singer characteristic information includes evaluation value data about the pitch, stability, expressive power, rhythm, singing technique, which are the evaluation items of the singing that is the basis of the singing video data, Singing video data that is singing can be preferentially displayed. In addition, since the singer characteristic information includes the number of people photographed as subjects of the singing video data and the numerical data of the amount of movement of the people, the number of singers and the movement of the singer are considered. Display priority can be set. Furthermore, since the singer characteristic information includes information on age and gender based on the date of birth registered in advance for the singer photographed as the subject of the singing video data, the singer's age group and gender Display priority can be set.

  Furthermore, since the user preference information is acquired based on a predetermined period or a predetermined number of singer characteristics information from the newest date, it is easy to cope with changes in the tastes and preferences of the viewer.

  The above description of the embodiment is for facilitating the understanding of the present invention, and does not limit the present invention. The present invention can be changed and improved without departing from the gist thereof, and the present invention includes equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Host apparatus (server), 2 ... Karaoke apparatus, 3 ... User terminal, 3A ... Personal computer, 3B ... Tablet computer, 3C ... Mobile telephone, 4 ... Transmission path, 11 ... Host side control part, 11a ... CPU, 11b ... Memory, 12 ... Host side communication section, 13 ... Host side storage section, 13a ... User information storage area, 13b ... User attribute information storage area, 13c ... User preference information storage area, 13d ... Singing video information storage area , 13e ... Singing recording data storage area, 13f ... Video recording data storage area, 13g ... Browsing moving picture data storage area, 13h ... Singer characteristic information storage area, 21 ... Karaoke body, 22 ... Speaker, 23 ... Monitor, 24 ... Microphone, 25 ... Video camera, 26 ... Remote control device, 31 ... Main body side control unit, 31a ... CPU, 31b ... Memory, 32 ... Body side communication unit 33 ... Body side storage unit 33a ... Music data storage area 33b ... Scoring program storage area 33c ... Scoring information storage area 33d ... Song recording data storage area 33e ... Video recording data storage area 34 ... Sound source unit, 35 ... Sound processing unit, 36 ... Display processing unit, 37 ... Video input unit, 38 ... Operation unit, 41 ... Terminal side control unit, 41a ... CPU, 41b ... Memory, 42 ... Terminal side communication unit, 43 Terminal side storage unit 44 ... Display unit 44b Video display area 44c Nice button 44d Favorite button 44e Return button 45 Input unit KB Karaoke room RM Karaoke room BS Bus

Claims (5)

A singing video browsing system for storing singing video data created with karaoke singing in a karaoke device in a server, and allowing a viewer to browse a singing video based on the singing video data through a browsing terminal,
Characteristic information acquisition means for acquiring characteristic information by characteristic analysis of a singer who performed the karaoke singing, and storing the acquired characteristic information in the server in a state associated with the target singing video data;
Operated at the time of evaluation of the singing video by the browsing terminal, singing video evaluation means for generating evaluation information of the singing video,
Based on the evaluation information, evaluation information acquisition means for storing the identification information of the singing moving image data serving as the basis of the singing moving image in the server in a state in which the identification information is associated with the identification information of the viewer who uses the browsing terminal;
Preference information acquisition means for taking statistics of the feature information for the song video data associated with the identification information of the viewer, and acquiring preference information for each viewer;
At the time of selection of the singing video by the browsing terminal, reference is made to preference information associated with identification information of a viewer who uses the browsing terminal, and singing video data having a high degree of similarity with the preference information is obtained. A singing video browsing system, characterized by comprising priority display means for displaying the video so that the priority is higher than that of the low singing video data.   The said characteristic information contains the evaluation value data about the pitch, stability, expressive power, rhythm, and singing skill which are the evaluation items of the song used as the basis of the said song animation data. Singing video browsing system.   The singing video browsing system according to claim 1, wherein the feature information includes the number of people photographed as subjects of the singing video data and the digitized data of the movement amount of the people. .   The said feature information contains the information of age and sex based on the date of birth registered beforehand about the singer image | photographed as a to-be-photographed object of the said song animation data, The any one of Claim 1 to 3 characterized by the above-mentioned. A viewing system for singing videos as described in the paragraph.   5. The singing video browsing system according to claim 1, wherein the preference information is acquired based on the feature information of a predetermined period or a predetermined number of items from a newest date.

Images