JP5198400B2 - Video content search apparatus and video content search method - Google Patents

Description

  The present invention relates to a moving image content search apparatus and a moving image content search method for searching for specific moving image content data from a plurality of moving image content data stored in a storage device.

  Video data and audio data obtained by imaging and collecting a user during karaoke singing can be uploaded from a karaoke terminal device installed in a karaoke store to a central device, and can be viewed on a video browsing site as video content related to singing A karaoke system that has been made public has been put to practical use. In addition, the viewer evaluates the published video content, and the evaluation result is published together with the video content. However, the conventional video browsing site basically only publishes the user's singing appearance as video content so that it can be browsed, and higher entertainment is required.

On the other hand, Patent Document 1 discloses a system in which a content or a content provider thereof is evaluated by a user and a critic, and the evaluation result is reflected in a popularity chart to bring vitality to the entire site. Yes.
Patent Document 2 discloses a technique in which a user's singing voice is recorded prior to the use of karaoke, and one person can enjoy chorus even during karaoke performance.

JP 2002-189793 A JP 2004-53736 A

  By the way, the inventor of the present application has devised a karaoke system capable of creating and publishing a combination of a plurality of moving image contents and improving entertainment. There has been no technology for searching for video content suitable for creating the content based on the created singer's evaluation of the song. For this reason, there has been a problem that it is not possible to effectively search for the moving image content that the user wants as the material of the content. For example, when the video content is searched based on the evaluation result for the video content, the video content created by the user who has a high evaluation for the video content but a low singing technique may be searched. More specifically, even if the user has a low singing technique, if the appearance is evaluated, the moving image content may be highly evaluated and appear at the top of the search result list.

  The present invention has been made in view of such circumstances, and is configured to search for video content based on the evaluation of the video content itself and the evaluation of the singer who created the video content, It is an object of the present invention to provide a moving image content search apparatus and a moving image content search method capable of searching for a moving image content suitable for creating a content combining a plurality of song moving image contents.

  The moving image content search device according to the present invention includes moving image content data related to singing by a plurality of karaoke users, user identification information for identifying a karaoke user who performed the singing, and evaluation contents for the moving image content data. In a video content search apparatus that stores evaluation information in association with each other and searches for specific video content data from a plurality of stored video content data, user identification information and karaoke corresponding to the user identification information A table that associates singing evaluation information including evaluation contents for the user's singing, a receiving unit that receives a search request for moving image content data using specific moving image evaluation information and singing evaluation information as search conditions, and the receiving unit; When a search request is received, specific video evaluation information and singing related to the search request Valence information and in accordance with the table, characterized in that it comprises a retrieval means for retrieving video content data.

  The moving image content search device according to the present invention is based on the evaluation contents for each of a plurality of different songs performed by a karaoke user, means for receiving user identification information for identifying the karaoke user, and the received plurality of evaluation contents. And means for calculating singing evaluation information of the karaoke user corresponding to the user identification information.

  The moving image content search device according to the present invention includes means for publicly displaying stored moving image content data, a plurality of evaluation contents for the released moving image content data, and moving image content identification information for identifying the moving image content data And means for calculating the video evaluation information of the video content data corresponding to the video content identification information, based on a plurality of evaluation contents for each received video content data.

  The video content search apparatus according to the present invention includes content data obtained by combining a plurality of video content data searched by the search unit, or one video content data and other video content data searched by the search unit. And generating means for generating content data combining the above and means for publishing the content data generated by the generating means in a viewable manner.

  The moving image content search method according to the present invention includes moving image content data relating to singing by a plurality of karaoke users, user identification information for identifying the karaoke user who performed the singing, and evaluation contents for the moving image content data. In a video content search method for searching for specific video content data from a plurality of video content data stored in the storage device from a storage device in which evaluation information is associated and stored, the user identification information and the user identification Prepare a table associating singing evaluation information including evaluation contents for singing of a karaoke user corresponding to information, receive a search request for moving image content data using specific moving image evaluation information and singing evaluation information as search conditions, and search When a request is received, specific video evaluation information and singing related to the search request Valence information and in accordance with the table, characterized in that to search for video content data.

  In the present invention, the moving image content is searched using the moving image evaluation information including the evaluation content for the moving image content data and the singing evaluation information including the evaluation content for the karaoke user's song as search keys.

  In the present invention, the singing evaluation information of each karaoke user is calculated based on the evaluation contents for each of a plurality of songs performed by the karaoke user.

  In the present invention, the moving image content data is disclosed so as to be viewable, a plurality of evaluation contents for the moving image content are received, and moving image evaluation information is calculated based on the plurality of evaluation contents.

  In the present invention, content is generated by combining the searched video content data.

  ADVANTAGE OF THE INVENTION According to this invention, the moving image content suitable for creation of the content which combined the moving image content of the some song can be searched.

It is explanatory drawing which shows typically the example of 1 structure of the karaoke system which concerns on embodiment of this invention. It is a block diagram which shows one structural example of a central apparatus. It is explanatory drawing which shows notionally an example of the record layout of user information DB. It is explanatory drawing which shows notionally an example of the record layout of music DB. It is explanatory drawing which shows an example of the record layout of animation DB notionally. It is explanatory drawing which shows notionally an example of the record layout of hybrid moving image DB. It is a block diagram which shows the example of 1 structure of a karaoke terminal device. It is explanatory drawing which showed notionally the production | generation and publication method of a hybrid moving image content. It is the schematic diagram which showed an example of the user screen which displayed the moving image content as the thumbnail. It is the schematic diagram which showed an example of the user screen containing the setting screen for performing various settings which concern on moving image content. It is the schematic diagram which showed an example of the user screen which displayed as a thumbnail the moving image content by which public setting and karaoke delivery setting were carried out. It is the schematic diagram which showed an example of the exhibition screen where the moving image content was exhibited. It is the schematic diagram which showed an example of the public screen on which the enlarged reproduction screen was displayed. It is the schematic diagram which showed an example of the public screen on which the enlarged reproduction screen was displayed. It is the schematic diagram which showed an example of the user screen which displayed the thumbnail image of the moving image content registered by the hybrid moving image material. It is the schematic diagram which showed an example of the user screen which displayed the hybrid moving image content as the thumbnail. It is the schematic diagram which showed an example of the user screen containing the setting screen for performing the various setting which concerns on a hybrid moving image content. It is the schematic diagram which showed an example of the public screen which displayed as a thumbnail the hybrid moving image content set publicly. It is the schematic diagram which showed an example of the public screen on which the expansion reproduction | regeneration screen of the hybrid moving image content was displayed. It is the schematic diagram which showed an example of the public screen on which the expansion reproduction | regeneration screen of the hybrid moving image content was displayed. It is a flowchart which shows the process sequence of the control part which concerns on the production | generation and registration of the moving image content which concerns on a song. It is a flowchart which shows the process sequence of the control part which concerns on the production | generation and registration of the moving image content which concerns on a song. It is a flowchart which shows the process sequence of the control part which concerns on the public setting of a moving image content, and a karaoke delivery setting. It is a flowchart which shows the process sequence of the control part which concerns on calculation and registration of moving image evaluation information. It is a flowchart which shows the process sequence of the control part which concerns on calculation and registration of song evaluation information. It is a flowchart which shows the process sequence of the control part which concerns on disclosure of a moving image content. It is a flowchart which shows the process sequence of the control part which concerns on the production | generation and registration of a hybrid moving image content. It is a flowchart which shows the process sequence of the control part which concerns on the production | generation and registration of a hybrid moving image content. It is a flowchart which shows the process sequence of the control part which concerns on the public setting of a hybrid moving image content. It is a flowchart which shows the process sequence of the control part which concerns on publicity of a hybrid moving image content.

  The karaoke system according to the present embodiment uses a video content including video data and audio data obtained by capturing and collecting images of a user singing at a karaoke store, and provides new entertainment on a video browsing site. More specifically, it is possible to create and publish a hybrid video content in which a plurality of video content related to the singing of oneself or another person is combined, and improve the entertainment of karaoke. In particular, the present invention can effectively search for video content suitable as a material for the hybrid video content based on the evaluation of the video content itself and the evaluation of the singer who created the video content. It is to make.

Hereinafter, the present invention will be described in detail with reference to the drawings illustrating embodiments thereof.
FIG. 1 is an explanatory diagram schematically showing a configuration example of a karaoke system according to an embodiment of the present invention. The karaoke system according to the present embodiment distributes karaoke information, and at the same time, performs a video content search method according to the present invention, a central device (video content search device) 1 that generates, manages, and publishes mixed video content, A karaoke terminal device 4 installed in each karaoke store 2 and connected to the central device 1 via the communication network N1, and one or more user terminal devices 6 connected to the central device 1 via the communication network N2. With.

  The communication network N1 is a dedicated communication line for transmitting and receiving karaoke information and information related to the hybrid video content between the central device 1 and the karaoke terminal device 4, and is an optical fiber communication network, an ADSL line, a public telephone line. Etc., and a hard disk built-in type router 31 is connected. The type of communication line is not limited to this as long as information can be transmitted and received between the central apparatus 1 and the karaoke terminal apparatus 4, and may be a non-dedicated line.

  The router 31 is mainly installed in each karaoke store 2, and the hard disk built in the router 31 stores the karaoke information distributed from the central device 1 and the moving image data and sound that are the material of the mixed moving image content. Temporarily store data. The router 31 has a function of sharing or backing up karaoke information by relaying karaoke information, moving image data and audio data between each store and the central device 1.

  One karaoke terminal device 4 is normally installed in each private room 21 of the karaoke store 2, and is connected to a router 31 installed in the karaoke store 2 via a wired LAN (Local Area Network) cable 32. Each private room 21 is provided with one or a plurality of remote operation devices 5 for remotely operating the karaoke terminal device 4. The remote control device 5 is used for user login to the karaoke system, karaoke song selection, and operations related to hybrid video content.

The remote control device 5 is a board type provided with a liquid crystal panel having a pen touch sensor, and the karaoke store 2 in the same private room 21 is linked by infrared communication. Note that a dedicated application may be executed on the mobile phone to function as the remote operation device 5. In addition, the karaoke store 2 is provided with an access point 33 connected to the wired LAN cable 32, and the remote control device 5 provided in each private room 21 provides information on various operations via the access point 33. Are transmitted / received to / from the karaoke terminal device 4 in the same private room 21 that is associated.
In addition, although wired LAN cable 32 was illustrated as a communication line which connects between the karaoke terminal apparatuses 4, you may comprise so that it may mutually connect by wireless LAN, another wired or wireless communication. Moreover, although the example which installs the access point 33 was demonstrated, you may comprise so that an operation signal may be directly transmitted / received between the karaoke terminal device 4 and the remote control device 5. FIG.

  The user terminal device 6 is a communication device capable of transmitting / receiving information to / from the central device 1, for example, a personal computer 6a, a mobile phone terminal 6b, a PDA (Personal Digital Assistant) 6c, and the like, and uses the karaoke store 2. This is for the user to access the central apparatus 1 and use the video browsing site related to the hybrid video content.

  FIG. 2 is a block diagram illustrating a configuration example of the central apparatus 1. The central device 1 includes a control unit 10 that controls the operation of each component of the central device 1, for example, a CPU (Central Processing Unit). The control unit 10 includes a ROM (Read Only Memory) 11 via a bus. A RAM (Random Access Memory) 12, an internal storage device 13, an external storage device 14, a first communication unit 15, a second communication unit 16, and a clock unit 17 are connected.

  The control unit 10 reads out the computer program recorded in the RAM 12 and the internal storage device 13 to the RAM 12 and executes it to execute the moving image content search method and the content data generation method according to the present embodiment, that is, a hybrid described later. Processing related to generation and release of moving image content data is executed. Moreover, the control part 10 performs the process which concerns on the web server which displays a moving image browsing site on a user terminal device.

  The ROM 11 is a non-volatile memory such as a mask ROM or EEPROM that stores a control program necessary for the operation of the computer.

  The RAM 12 is a volatile memory such as a DRAM or SRAM that temporarily stores various data generated when the arithmetic processing of the control unit 10 is executed.

  The external storage device 14 is a DVD (Digital Versatile Disc) -ROM, BD (Blu-ray Disc), or CD (Compact Disc) in which a computer program for causing a computer to function as a central device according to the present invention is recorded in a computer-readable manner. An optical disk drive that reads a computer program and other various data from a recording medium such as a ROM. The optical disk drive is an example of the external storage device 14, and the external storage device 14 may be configured by a device that reads and writes data from a magnetic disk such as a hard disk and a flexible disk, a magneto-optical disk, and a semiconductor memory.

The internal storage device 13 is a hard disk, a nonvolatile semiconductor memory, or the like that stores a computer program for causing a computer to function as the central device 1.
The internal storage device 13 includes a user information DB (Data Base) 13a for storing information related to the user of the karaoke system, a music DB 13b for storing music data (karaoke music data), etc., and moving image content data of a song created by the user. For example, a moving image DB 13c for storing singing mixed moving image content data created by the user, and the like. Details of the various databases will be described later.
Furthermore, the internal storage device 13 stores image components for creating a user screen, a public screen, and the like of the moving image posting site.

  The first communication unit 15 is an interface for transmitting and receiving karaoke information, singing video data and audio data, and other data relating to various services to and from the karaoke terminal device 4 connected via the communication network N1. The transmission / reception of various information by the first communication unit 15 is controlled by the control unit 10.

  The second communication unit 16 is an interface that transmits and receives moving image data and audio data related to the mixed moving image content and other data related to various services to and from the user terminal device 6 connected via the communication network N2. Transmission and reception of various information by the second communication unit 16 is controlled by the control unit 10. When the physical layers of the communication networks N1 and N2 are common, the first and second communication units 15 and 16 may be configured with the same hardware.

  The clock unit 17 is a circuit that counts the date and time and gives a timing result to the control unit 10 in response to a request from the control unit 10. The clock unit 17 manages the date and time when the user singing at the karaoke store 2 is imaged, the storage period of moving image data obtained by imaging, and the like.

  In addition, although the example which implement | achieves the central apparatus 1 using one computer was demonstrated, it cannot be overemphasized that you may carry out a distributed process using a some computer.

FIG. 3 is an explanatory diagram conceptually showing an example of the record layout of the user information DB 13a. The table (file) of the user information DB 13a includes a plurality of columns (fields), for example, a "user ID" column, a "password" column, a "nickname" column, a "user information" column, a "singing evaluation information" column, It is composed of a “video” column, a “my hybrid video” column, a “my hybrid video material” column, and the like, and each row (record) stores information corresponding to each column.
The “user ID” column stores a user ID for identifying each of a plurality of users who use the karaoke system according to the present embodiment, for example, an e-mail address of the user. The user ID is information required when the user logs in to the karaoke system and uses various services related to the hybrid video.
The “password” column stores password information necessary for logging in to the karaoke system. The password information consists of a plurality of alphanumeric character strings.
The “nickname” column stores the nickname of the user. The nickname is a temporary name of the user on the video posting site, and is used by the users of the karaoke system to identify each other. Further, it is used to display the hybrid video content that is open to each user and the creator of the video content that is the material of the hybrid video content.
The “user information” column stores information such as the user's gender and birthplace.
The “singing evaluation information” column stores singing evaluation information indicating the evaluation of the user's singing. The singing evaluation information is, for example, an average value of scoring results obtained using a so-called karaoke scoring function of the karaoke terminal device 4. Further, as will be described later, not only the scoring results but also other information may be added. The “national singer” and “million singer” shown in FIG. 3 are conceptual categories corresponding to the numerical values of the singing evaluation information, and are used when the contents of the singing evaluation information are disclosed to the user. .
The “My Movie” column stores a movie ID for specifying the movie content created by the user, as will be described later.
The “my hybrid video” column stores a hybrid video ID for specifying the hybrid video created by the user.
The “My hybrid video material” column stores a video ID for specifying the video content registered as a material for the user to create the hybrid video content.

FIG. 4 is an explanatory diagram conceptually showing an example of the record layout of the music DB 13b. The table of the song DB 13b includes a plurality of columns, for example, a “song ID” column that stores a song ID for identifying a song, a “song name” column that stores a song name of the song, and a “singer” that stores a singer name of the song. The “name” column, a “music data” column for storing music data including accompaniment data of the music, and the like. The song data stores, for example, accompaniment data (karaoke song data), lyrics data, and main melody data. The structure of the music data is not particularly limited, and the accompaniment data, the lyrics data, and the main melody data may be configured as a single music file, or may be configured as separate files and managed in association with each file. May be.
The accompaniment data is, for example, MIDI (Musical Instrument Digital Interface) data, which specifies data on / off of sound, pitch data specifying pitch, volume data (velocity) specifying volume, instrument control data, sound Is composed of timbre data for designating a musical instrument that outputs a sound, time data (delta time) for designating a time interval of each sound reproduced in time series.
The main melody data indicates the melody of the sound to be sung in accordance with the accompaniment, that is, the data indicating the on / off of the sound that constitutes the main melody, the pitch data, the volume data, and the time interval of each sound of the main melody that is played back in time series Time data.

FIG. 5 is an explanatory diagram conceptually illustrating an example of a record layout of the moving image DB 13c. The table of the moving image DB 13c includes a plurality of columns, for example, a “moving image ID” column, a “singer” column, a “song ID” column, a “moving image content” column, a “shooting date / time” column, a “play count” column, ”Column,“ Retention period ”column,“ Karaoke distribution ”column,“ Comment ”column,“ Partner recruitment ”column,“ Video evaluation information ”column, etc., and information corresponding to each column is stored. .
The “moving image ID” column stores a moving image ID for identifying moving image content.
The “singer” column stores the user ID of the singer who created the video content associated with the video ID.
The “music ID” column stores a music ID for identifying the music used when creating the moving image content associated with the moving image ID.
The “video content” column stores video content data that independently includes video data obtained by capturing the image of the user singing at the karaoke store 2 and audio data obtained by collecting the singing voice. To do. The moving image content data is, for example, a flv format file. Needless to say, it is sufficient that at least a pair of moving image data and audio data are linked, and the moving image content data may be composed of a plurality of files, for example, a moving image data file and an audio data file. good. Also, the file format of the moving image content data is not particularly limited.
The “shooting date and time” column stores the date and time when the moving image related to the moving image content was captured.
The “number of playback times” column stores the number of playback times of the video content on the video posting site.
The “open / disallowed” column stores data indicating whether or not to release the moving image content on the moving image posting site.
The “storage period” column stores data indicating a period during which the central apparatus 1 stores and discloses moving image content.
The “Karaoke distribution” column stores data indicating whether or not the moving image content can be distributed to the karaoke terminal device 4 as a mixed moving image content material.
The “comment” column stores comments on the moving image content.
The “partner recruitment” column stores data indicating whether or not to publish video content in a “partner recruitment” column, which will be described later on the video posting site, in order to encourage generation of hybrid video content using video content.
The “moving image evaluation information” column stores evaluations for moving image content. The evaluation is, for example, a third party comment on the moving image content. In addition, the evaluation includes voting results for items such as “cute”, “cool”, “similar”, “delicious”, “astringent”, “interesting”, and “can cry”.

FIG. 6 is an explanatory diagram conceptually showing an example of a record layout of the hybrid video DB 13d. The table of the hybrid video DB 13d includes a plurality of columns, for example, a “mixed video ID” column, a “singer” column, a “partner” column, a “music ID” column, a “mixed video content” column, a “shooting date / time” column, “ The column is composed of a “number of times of reproduction” column, a “disclosure availability” column, a “storage period” column, a “comment” column, an “evaluation” column, and the like, and stores information corresponding to each column.
The “mixed moving image ID” column stores a mixed moving image ID for identifying the mixed moving image content.
The “singer” column stores data for identifying the user who created the hybrid video content.
The “partner” column stores data for identifying the user who created the moving image content that is the material of the mixed moving image content.
The “music ID” column stores a music ID for identifying a music used for creating the hybrid video content.
The “mixed moving image content” column stores two sets of moving image content data. That is, the moving image data and audio data constituting each of the two sets of moving image content data are stored.
The “shooting date and time” column stores data indicating the date and time when the moving image related to the mixed moving image content is captured.
The “number of times played” column stores the number of times the mixed moving image content data is played on the moving image posting site.
The “open / disallowed” column stores data indicating whether or not to release the mixed moving image content on the moving image posting site.
The “storage period” column stores data indicating a period during which the central apparatus 1 stores and discloses the hybrid video content.
The “comment” column stores comments on the hybrid video content.
The “moving picture evaluation information” column stores the evaluation of the hybrid moving picture content.

  FIG. 7 is a block diagram illustrating a configuration example of the karaoke terminal device 4. The karaoke terminal device 4 includes a control unit 40 that controls the operation of each component of the karaoke terminal device 4. The control unit 40 includes a ROM 41, a RAM 42, a storage device 43, and a communication unit 44 via a bus. The receiver 45, the video encoder 46a, the video control circuit 46b, the video decoder 46c, the scoring unit 47, the audio encoder 48a, the sound source 48b, and the audio decoder 48c are connected. A video mixer 46d is connected to the video control circuit 46b and the video decoder 46c, and an audio mixer 48d is connected to the sound source 48b and the audio decoder 48c. Furthermore, the karaoke terminal device 4 includes a video input terminal, a video output terminal, an audio input terminal, and an audio output terminal (not shown), and each terminal includes an imaging device 46e, a video display device 46f, a microphone 48e, and a speaker. 48f is connected. The video display device 46f is, for example, a CRT (Cathode-ray Tube), a liquid crystal display, a plasma display, an organic EL display, or the like.

  The control unit 40 reads out the computer program recorded in the ROM 41 and the storage device 43 to the RAM 42 and executes the computer program, thereby executing processing related to generation, management, and release of hybrid moving image content data, which will be described later. Function as 4.

  The ROM 41 is a non-volatile memory such as a mask ROM or EEPROM that stores a control program necessary for the operation of the computer.

  The RAM 42 is a volatile memory such as a DRAM or SRAM that temporarily stores various data generated when the arithmetic processing of the control unit 40 is executed.

  The storage device 43 is a hard disk, a nonvolatile semiconductor memory, or the like that stores a computer program for causing a computer to function as the karaoke terminal device 4. The storage device 43 stores a karaoke terminal music DB 43a. The karaoke terminal music DB 43a stores music data and the like distributed from the central device 1, and the basic configuration is the same as that of the music DB 13b.

  The communication unit 44 is an interface that transmits and receives karaoke information, information related to the hybrid video content, and other data related to various services with the karaoke terminal device 4 connected via the communication network N1. Transmission / reception of various types of information is controlled by the control unit 40.

  The receiving unit 45 is a circuit that performs infrared communication with the remote operation device 5 so as to link the karaoke terminal device 4 and the remote operation device 5.

  The video encoder 46a is a circuit that compresses and encodes video data output from the imaging device 46e and input through the video input terminal. The compressed and encoded video data is temporarily written in the RAM 42 or the storage device 43. . The compression encoding format is, for example, MPEG (Moving Picture Experts Group), but is not particularly limited thereto.

  The video control circuit 46b reads various information related to the video from the RAM 42 or the storage device 43 in accordance with a control command from the control unit 40, generates video data representing various videos, and supplies the video data to the video mixer 46d. Execute the process. For example, when reproducing karaoke song data, the video control circuit 46b supplies video data representing the lyrics to the video mixer 46d based on the lyrics data included in the song data provided from the control unit 40. In addition, the video control circuit 46b gives video data representing a menu screen, scoring result display screen, etc. relating to karaoke entertainment to the video mixer 46d.

  The video decoder 46c reads and decodes video data, for example, predetermined background video data displayed at the time of karaoke singing, from the RAM 42 or the storage device 43 in accordance with the control command of the control unit 40, and the decoded video data 46d. To give. The background video data is, for example, MPEG format data.

  The video mixer 46d synthesizes all or any two of the videos given from the video control circuit 46b, the video decoder 46c, and the imaging device 46e, and outputs the video data obtained by the synthesis to the video display device 46f. To do. The video display device 46f displays a video related to the video data output from the video mixer 46d.

  The scoring unit 47 acquires audio data output from the microphone 48e and input through the audio input terminal, reads out music data from the storage device 43, and sings based on the audio data and main melody data included in the music data. By comparing the pitch, volume, rhythm, etc. in the voice and the main melody, the singing is scored sequentially in real time in real time, and the scored result is written in the RAM 42.

  The audio encoder 48a acquires audio data output from the microphone 48e and input through an audio input terminal, and compresses and encodes the acquired audio data. The compression encoding format is, for example, MP3, AAC (Advanced Audio Coding), AC3 (Audio Code number 3), etc., but is not particularly limited thereto.

  The sound source 48b is a MIDI sound source that creates sound data that reproduces musical instrument sounds based on accompaniment data included in music data read from the RAM 42 or the storage device 43, for example, MIDI data, in accordance with a control command of the control unit 40. The audio data thus obtained is given to the audio mixer 48d.

  The audio decoder 48c decodes the audio data read from the RAM 42 or the storage device 43 according to the control command of the control unit 40, and gives the audio data obtained by decoding to the audio mixer 48d.

  The audio mixer 48d synthesizes audio related to the audio data provided from the sound source 48b and the audio decoder 48c, and outputs the audio data obtained by the synthesis to the speaker 48f through the audio output terminal. The speaker 48f emits sound related to the sound data output from the sound mixer 48d.

  In addition, although the example which comprises the karaoke terminal device 4 as an exclusive machine was demonstrated, you may comprise the karaoke terminal device 4 using a general purpose computer and the computer of a home video game. In this case, a part of the hardware circuit constituting the karaoke terminal device 4, for example, the scoring unit 47 may be processed by software.

  Next, an overall flow of generation and release of the hybrid video content will be described, and then specific processing procedures of the control units 10 and 40 of the central device 1 and the karaoke terminal device 4 will be described.

  FIG. 8 is an explanatory diagram conceptually showing a method for generating and publishing mixed moving image content. Note that a user who uses a service related to a hybrid video needs to access the karaoke system in advance and perform user registration before using the service. When a user registration request is received from the user terminal device 6 or the remote operation device 5 via the communication network N2, the control unit 10 of the central device 1 causes the user terminal device 6 or the remote operation device 5 to display a user registration screen. The e-mail address, password, nickname, gender, birthplace, etc. corresponding to the login ID are accepted, and the received various information is registered in the user information DB 13a as described above. Hereinafter, it is assumed that the user logs in to the karaoke system and performs various operations unless otherwise specified.

<1. Singing, Imaging, Sound Collection>
First, one user logs in to the karaoke system using the remote control device 5 of the karaoke terminal device 4 installed in the private room 21 of the karaoke store 2 and selects a desired karaoke song. The karaoke terminal device 4 reproduces the selected music data, collects the user's singing performed while the music data is being reproduced, with the microphone 48e, and captures the image of the user singing. Image is taken at 46e.

<2. Post>
After singing, the user selects whether to upload, that is, upload, moving image data and audio data related to the singing obtained by imaging and sound collection to the central device 1. When the karaoke terminal device 4 is instructed to upload, the karaoke terminal device 4 transmits the moving image data and voice data relating to the song to the central device 1 together with the user ID and music ID of the logged-in user. The central device 1 receives the user ID, music ID, video data, and audio data transmitted from the karaoke terminal device 4, generates video content data that independently includes the received video data and audio data, It registers with moving image DB13c in association with music ID. Note that generating moving image content data includes not only processing for creating new data including moving image data and audio data, but also processing for associating moving image data and audio data. Also, the moving image ID unique to the moving image content data, the received user ID, and the like are associated and registered in the user information DB 13a.

<3. Movie release / Karaoke distribution settings>
Next, the one user who has finished karaoke logs in to the video posting site of the karaoke system using the user terminal device 6 or the remote control device 5. Hereinafter, the login to the video posting site is described as being performed using the user terminal device 6. When the login is successful, a user screen dedicated to the user is displayed on the display unit of the user terminal device 6. In addition, although it is normal to log in to a movie posting site using the user terminal device 6 outside the karaoke store 2, the login may be performed using the remote control device 5 in the karaoke store 2.

  FIG. 9 is a schematic diagram showing an example of a user screen 7 on which moving image contents are displayed as thumbnails. The user screen 7 includes a user information display unit 71 displayed on the left side of the screen. The user information display unit 71 displays information such as the nickname of the logged-in user, for example, “Mr. XXX”, the profile image of the user, the national ranking of the karaoke scoring results, and the highest scoring score. Further, on the upper side of the user information display unit 71, a “To Public Screen” button 70 is arranged. The “To Public Screen” button 70 is a button for transitioning to the public screen 8 (see FIG. 12) in which the moving image content and the mixed moving image content uploaded or generated by each user are disclosed. Further, a hyperlink character string 72 for switching display contents on the user screen 7 is arranged on the upper right side of the user information display unit 71. Specifically, the hyperlink character string “my video” that transitions the video content uploaded by the logged-in user to the screen displaying thumbnails, and the screen that displays the mixed video content created by the logged-in user themselves as thumbnails The hyperlink character string “My hybrid video material”, the hyperlink character string “My hybrid video material” that transitions to the thumbnail display screen of the video content registered as material for creating the hybrid video content is displayed in a horizontal row Has been. In FIG. 9, the hyperlink character string “my video” is selected. Further, a moving image content display unit 73 is arranged below the hyperlink character string. The video content display unit 73 displays a thumbnail image 73a showing the content of the video content uploaded by the user, the song title and singer name 73b of the song used when singing the video content, and various settings relating to the video content. A “setting” button 73c for performing, a “deleting” button 73d for deleting moving image content, a setting content display portion 73e, and the like are included. The setting content display unit 73e displays whether or not the moving image content can be disclosed, whether or not the moving image content can be distributed to the karaoke terminal device 4 as a mixed moving image material, and the like.

  Here, when the user operates the “setting” button 73 c, a setting screen for performing various settings related to the moving image content is displayed on the display unit of the user terminal device 6.

  FIG. 10 is a schematic diagram illustrating an example of a user screen 7 including a setting screen for performing various settings related to moving image content. The setting screen includes a user information display unit 71 and a moving image content information display unit 74 that shows details of moving image content to be subjected to various settings, and a setting content input unit 75. The setting content input unit 75 includes a radio button 75a for selecting whether or not to release moving image content, a radio button 75b for setting a storage period for moving image content, a radio button 75c for selecting whether or not karaoke distribution is possible, and a moving image. A text input field 75d for inputting the user's own comment on the content, and selection of whether or not to publish the video content in the “partner recruitment” column to be described later in order to encourage the video content to be used as the material of the hybrid video content Including a radio button 75e.

  The user inputs various setting contents to the setting contents input unit 75. The user terminal device 6 transmits data indicating various settings for the moving image content to the central device 1. The central device 1 receives the data transmitted from the user terminal device 6, and registers various setting contents in the “open / disallowed” column, the “karaoke distribution” column, and the like of the moving image DB 13c.

  FIG. 11 is a schematic diagram illustrating an example of a user screen 7 that displays thumbnails of moving image content that has been set to be public and karaoke distributed. In particular, when karaoke distribution is enabled, a mixed material registration icon 73 f is displayed on the thumbnail image 73 a displayed on the moving image content display unit 73. The mixed material registration icon 73f is a button for selecting the moving image content as a mixed moving image content material.

<4. Video evaluation collection>
Here, when the user logs in to the video posting site of the karaoke system using the user terminal device 6 and operates the “go to public screen” button 70, the central device 1 displays the public screen on the display unit of the karaoke terminal device 4. 8 is displayed.

FIG. 12 is a schematic diagram illustrating an example of a public screen 8 on which video content is disclosed. The public screen 8 includes a “go to user screen” button 80, a “partner recruitment” field 81, a “recommended video” field 82, a “recommended mixed video” field 83, a video playback screen 84, and a search condition input unit 9. ing. The “to user screen” button 80 is a button for transitioning to the user screen 7.
In the “partner recruitment” column 81, a thumbnail image 81a of a video content that is set to be posted in the “partner recruitment” column is displayed. A composite material registration icon 81b is displayed on the thumbnail image 81a, for example, in the lower left corner of the thumbnail image 81a. On the right side of the thumbnail image 81a, a song name and a singer name 81c relating to the moving image content are displayed. In the “partner recruitment” column 81, the thumbnail image 81a of the moving image content is displayed regardless of the evaluation level, so that the possibility of being used for the mixed moving image content is increased. Therefore, a user who desires to use the content as a hybrid video content should set the video content of his / her own so that it is posted in the “partner recruitment” column.
In the “recommended moving image” column 82, thumbnail images 82a of moving image content highly evaluated by each user are displayed. In addition, a mixed material registration icon 82b is displayed on the thumbnail image 82a of the moving image content permitted to be delivered by karaoke. Further, below the thumbnail image 82a, the title of the song, the name of the singer, and the nickname of the user who created the moving image content are displayed.
The “recommended hybrid video” column 83 will be described later.
The video playback screen 84 has a screen 84a that displays a video obtained by playing back video data included in the video content, and a song title display that displays a song name and a singer name related to the video content under the screen 84a. An operation unit 84c including an operation button for instructing reproduction, pause, cueing, a time code slider, a volume adjustment slider, and the like is provided.

The search condition input unit 9 is for searching for moving image content or mixed moving image content. A singer name / song name selection menu 91a, a singer name or a song name for specifying whether to search by a singer name or a song name. It includes a text input field 91b for input and a search button 91c for executing a search for moving image content by singer name or song name.
The search condition input unit 9 also includes a video evaluation menu 92a for selecting the content of the video evaluation for the video content, a singing evaluation menu 92b for selecting the level of singing evaluation for the user who created the video content, and the video evaluation. And a search button 92c for executing a search of the moving image content by singing evaluation. When the movie evaluation menu 92b is operated, items such as “cute”, “cool”, “similar”, “delicious”, “astringent”, “interesting”, “can cry” are displayed on the menu, and the user can select any of the items. It is possible to specify whether to search for video content with an emphasis on the evaluation of. When the singing evaluation menu 92b is operated, the "national singer", "million singer", "breaking singer", "expected new singer", "street live singer", "karaoke king", " The item “Karaoke Fan” is displayed, and the user can select the singing level of the user who created the moving image content. Then, after selecting the video evaluation and the singing evaluation, the user operates the search button 92c to request the central apparatus 1 to search for the video content using the selected video evaluation and singing evaluation as a search key. Can do. As a result, a thumbnail image of the searched moving image content is displayed on the public screen 8.

  Furthermore, the user can enlarge the screen 84a and reproduce the moving image content by operating, for example, clicking the screen 84a.

  13 and 14 are schematic views showing an example of the public screen 8 on which the enlarged reproduction screen 87 is displayed. The enlarged playback screen 87 has a screen on which video content is played back, and at the bottom of the screen is a song name display section, operation buttons for instructing playback, pause, cueing, etc., a time code slider, volume control An operation unit 87b including a slider and the like is disposed. The public screen 8 also includes a music-related video content display unit 87c that displays video content created using the same music as the video content being played back, and an evaluation for evaluating the video content being played back. An input unit 87d, a music-related hybrid video content display unit 87e that displays a hybrid video content created using the same music as the video content being played back, and a comment display unit that displays comments about the video content being played back 87f, a text field 87g for inputting a comment, a user information display section 87h displaying the user who generated each moving image content constituting the moving image content being reproduced, and the like are displayed.

  The evaluation input unit 87d includes a “cute” button, a “cool” button, a “look-alike” button, a “delicious” button, a “sucky” button, an “interesting” button, a “crying” button, and the like. The user can evaluate the moving image content by operating one of the buttons. When the evaluation input unit 87d is operated by the user, the user terminal device 6 transmits the evaluation content to the central device 1 in accordance with the operated button of the evaluation input unit 87d. The central device 1 receives the evaluation content transmitted from the user terminal device 6 and stores it in the moving image DB 13c.

<5. Singing evaluation collection>
At the karaoke store 2, the karaoke terminal device 4 scores the singer's singing using the karaoke scoring function, and transmits the singer's user ID and the scoring result to the central device 1. The user ID is acquired and stored in the remote operation device 5 by the karaoke terminal device 4 when the singer logs in to the karaoke system. The central device receives the user ID and the scoring result transmitted from the karaoke store 2, calculates the song evaluation information based on the received scoring result, and associates the calculated song evaluation information with the user ID. And stored in the user information DB 13a.

<6. Mixed material registration>
On the other hand, as shown in FIG. 8, another user whose nickname is “Mr. XX” logged in to the video posting site of the karaoke system using the user terminal device 6 and operated the “go to public screen” button 70. In this case, the central device 1 displays the public screen 8 on the display unit of the karaoke terminal device 4.

  The user inputs a search condition to the search condition input unit 9, and the video content suitable as the material of the hybrid video content is evaluated based on the evaluation on the video content and the evaluation on the singing of the singer who created the video content. You can search. More specifically, the user operates the video evaluation menu 92b to select one of the evaluation items “cute”, “cool”, “similar”, “delicious”, “sirty”, “interesting”, “crying”. Select. Further, by operating the singing evaluation menu 92b, items "national singer", "million singer", "breaking singer", "expected new singer", "street live singer", which indicate the level of evaluation for the singing, Select either “Karaoke King” or “Karaoke Fan”. Then, a desired moving image content can be searched by operating the search button 92c.

The user can instruct reproduction of the moving image content by operating the thumbnail images 81a and 82a of the moving image content desired to be viewed from among the searched thumbnail images of the moving image content, for example, by clicking with the mouse. The central device 1 transmits the moving image content and the music data linked to the moving image content to the user terminal device 6, and the user terminal device 6 includes the moving image data included in the moving image content transmitted from the central device 1, and Audio data and music data are reproduced in parallel and displayed on the moving image reproduction screen 84. By reproducing the moving image content and the music data in parallel, it is possible to reproduce the state of the user singing at the karaoke store.
Further, the user selects the mixed material registration icons 81b and 82b displayed on the thumbnail images 81a and 82a of the desired moving image content as the mixed moving image content material, thereby registering the moving image content as the mixed moving image content material. be able to. When the hybrid material registration icon is selected, the central device 1 associates the video ID of the video content selected as the composite material with “My hybrid video material” in the user information DB 13a in association with the user ID of the logged-in user. In the "" column.

  FIG. 15 is a schematic diagram showing an example of a user screen 7 displaying a thumbnail image 76 of the moving image content registered with the mixed moving image material. When the hyperlink character string “my hybrid material video” is operated on the user screen 7, a thumbnail image 76 of the video content registered as the hybrid material is displayed as shown in FIG.

<7. Karaoke distribution>
Then, the other user who has completed the mixed material registration, that is, the user whose nickname is “Mr. XX”, uses the remote control device 5 of the karaoke terminal device 4 installed in the private room 21 of the karaoke store 2 to use the karaoke system. Log in to select music related to the video content of the mixed material. The central device 1 transmits music data and audio data included in the moving image content of the hybrid material to the karaoke terminal device 4.

<8. Singing, Imaging, Sound Collection>
The karaoke terminal device 4 receives the music data and audio data transmitted from the central device 1 and reproduces the received music data and audio data in parallel. Since the audio data is audio related to the mixed video material, when the user sings here, the song is in a state of being double-sung, and the user enjoys double-singing with the user who is not on the spot. And enjoy the creation of mixed video content. Then, the karaoke terminal device 4 collects the user's singing performed while the music data and audio data are being reproduced with the microphone 48e, and images the appearance of the user singing with the imaging device 46e. To do.

<9. Post>
After singing, the singer selects whether to upload, that is, upload, video data and audio data related to the singing obtained by imaging and collecting sound to the central device 1. When the karaoke terminal device 4 is instructed to upload, the karaoke terminal device 4 transmits the moving image data and audio data related to the song to the central device 1 together with the user ID and the music ID. The central device 1 generates mixed moving image content data including moving image data and audio data, and moving image data and audio data selected as a mixed material, and receives the generated mixed moving image content data as a user ID and a song ID. And the like are registered in the hybrid video DB 13d. Also, the hybrid video ID unique to the hybrid video content data, the received user ID, and the like are associated and registered in the user information DB 13a.

<10. Mixed video release>
Next, the other user who has finished karaoke accesses the central device 1 using the user terminal device 6 and logs in to the video posting site. When the login is successful, a user screen 7 dedicated to one user is displayed on the display unit of the user terminal device 6. When the hyperlink character string “my hybrid video” is operated on the user screen 7, a thumbnail image of the hybrid video content created by the other user is displayed.

  FIG. 16 is a schematic diagram illustrating an example of a user screen 7 on which the mixed moving image content is displayed as a thumbnail. As shown in FIG. 16, a hybrid video content display unit 77 is displayed on the user screen 7. The hybrid video content display unit 77 includes a thumbnail image 77a showing the content of the hybrid video content uploaded and created by the user, and the song title and singer name 77b used when singing the hybrid video content. A “setting” button 77c for performing various settings relating to the hybrid video content, a “delete” button 77d for deleting the hybrid video content, a setting content display unit 77e, and a user who created the video content that is the material of the hybrid video content The profile image 77f is included. The setting content display section 77e displays whether or not the hybrid video content can be released.

  Here, when the user operates the “setting” button 77 c, a setting screen for performing various settings related to the hybrid video content is displayed on the display unit of the user terminal device 6.

  FIG. 17 is a schematic diagram illustrating an example of a user screen 7 including a setting screen for performing various settings related to the hybrid video content. The setting screen includes, together with the user information display unit 71, a mixed moving image content information display unit 78 indicating the content of the mixed moving image content to be subjected to various settings, and a setting content input unit 79. The setting content input unit 79 is a radio button 79a for selecting whether or not to release the hybrid video content, a radio button 79b for setting the storage period of the hybrid video content, and a text input for inputting its own comment on the hybrid video content. The field 79c and the like are included.

  FIG. 18 is a schematic diagram illustrating an example of a public screen 8 that displays thumbnails of the hybrid video content that has been publicly set. In the “recommended mixed movie” column 83, a thumbnail image 83a of the mixed movie content that has been configured is displayed. Here, the user can instruct playback of the mixed video content by operating the thumbnail image 83a of the mixed video content desired to be viewed, for example, by clicking with a mouse. And the music data are transmitted to the user terminal device 6, and the user terminal device 6 reproduces in parallel the two sets of video data and audio data and music data included in the hybrid video content transmitted from the central device 1. That is, a moving image and sound as if two users are performing a double song are reproduced. In addition, the user can enlarge and play the hybrid video content by displaying an enlargement playback button (not shown), and display more detailed information.

  FIG. 19 and FIG. 20 are schematic diagrams showing an example of the public screen 8 on which the enlarged playback screen of the hybrid video content is displayed. The hybrid video enlargement playback screen 86 has a screen portion 86a on which one video content constituting the hybrid video content is played back and a screen portion 86a on which the other video content is played side by side. A search condition input unit 85 for searching for moving image content or mixed moving image content is arranged above 86a, and below the screen portion 86a is used for instructing a song name display unit, playback, pause, cueing, and the like. An operation unit 86c including an operation button, a time code slider, a volume control slider, and the like is disposed. In addition, a tone adjustment target selection unit 86d for selecting a volume adjustment target is provided in order to selectively adjust the volume of the two moving image contents. The public screen 8 also includes a music-related video content display unit 86e that displays video content created using the same music as the hybrid video content, an evaluation input unit 86f for evaluating the hybrid video content, and a hybrid video. A comment display section 86g for displaying a comment on the content, a text field 86h for inputting a comment, a user information display section 86i for displaying a user who generated each moving picture content constituting the mixed moving picture content, and a tag attached to the mixed moving picture content A tag display unit 86j for displaying information, a music information display unit 86k for displaying information on music used to create the hybrid video content, and the like are displayed.

  Further, when the user operates the screen portion 86a of the hybrid video enlargement playback screen 86, for example, by clicking with the mouse, as shown in FIG. 13, only one video content displayed on the screen portion 86a is enlarged. Then, an enlarged reproduction screen 87 to be reproduced can be displayed.

  Next, a processing procedure of the control units 10 and 40 related to generation and release of the hybrid video content will be described. In the following processing, the main part of the processing content will be described on the assumption that the user is logged in to the karaoke system.

FIGS. 21 and 22 are flowcharts showing the processing procedure of the control units 10 and 40 related to the generation and registration of moving image content related to singing. The user can select a song that he / she wants to sing at the karaoke store 2 by using the remote operation device 5, and the control unit 40 of the karaoke terminal device 4 accepts the song by the remote operation device 5 (step S <b> 11). The music request data including the music ID related to the music is transmitted to the central apparatus 1 via the communication unit 44 (step S12). The control unit 40 temporarily stores the music ID accepted in step S11.
Note that if the music data is previously transmitted from the central device 1 to the karaoke terminal device 4 and already registered in the karaoke terminal music DB 43a, the music request data is not transmitted to the central device, and the music data is read from the storage device 43. good. The same applies to the case where the hard disk of the router 31 is stored.

  The control unit 10 of the central device 1 receives the music request data transmitted from the karaoke terminal device 4 via the first communication unit 15 (step S13), and the music corresponding to the music ID included in the received music data. Data is read from the music DB 13b of the internal storage device 13, and the read music data is transmitted to the karaoke terminal device 4 that is the music request source via the second communication unit 16 (step S14).

The control unit 40 of the karaoke terminal device 4 receives the music data transmitted from the central device 1 via the communication unit 44 (step S15), and reproduces the received music data (step S16). Next, the control unit 40 inputs a moving image of the song performed while reproducing the music data (step S17), and inputs the voice data of the song (step S18).
Note that the moving image data output from the imaging device 46e and input to the karaoke terminal device 4 is compression encoded by the video encoder 46a and written to the RAM 42. The moving image data is input to the video mixer 46d. The video mixer 46d superimposes the text image of the lyrics given from the video control circuit on the video related to the video data, and the video data related to the video on which the lyrics are superimposed is output to the video display device 46f. The Therefore, the user's own singing appearance is displayed on the video display device 46f. For this reason, the user can sing while confirming the content of the captured moving image.
The voice data output from the microphone 48e and input to the karaoke terminal device 4 is compression-coded by the voice encoder 48a and written in the RAM 42. The audio data is input to the audio mixer 48d. The sound mixer 48d synthesizes the sound related to the sound data input from the microphone 48e and the sound of the music given from the sound source, and outputs the sound data obtained by the synthesis to the microphone 48e.

  Next, the control unit 40 determines whether or not to end the reproduction of the music data (step S19). Note that the reproduction is ended when the music data has been reproduced to the end, when the remote operation device 5 is instructed to stop the reproduction, or the like. When it determines with not complete | finishing reproduction | regeneration (step S19: NO), the control part 40 returns a process to step S16. When it determines with complete | finishing reproduction | regeneration (step S19: YES), the control part 40 monitors the operation state of the remote control apparatus 5, and determines whether the input moving image and the moving image data and audio | voice data of an image | video are uploaded. (Step S20). When it determines with not uploading (step S20: NO), the control part 40 complete | finishes a process.

  When it determines with uploading (step S20: YES), the control part 40 transmits the user ID, music ID, moving image data, and audio | voice data which RAM42 memorize | stored to the central apparatus 1 via the communication part 44 (step S20: YES). Step S21). The user ID temporarily stored in the RAM 42 is input when the user logs in to the karaoke system.

  The control unit 10 of the central device 1 receives the user ID, music ID, moving image data, and audio data transmitted from the karaoke terminal device 4 via the first communication unit 15 (step S22). Then, the control unit 10 generates moving image content data independently including the received moving image data and audio data, registers the generated moving image content data in the moving image DB 13c together with the received user ID, music ID, and the like. The moving image ID issued at the time of registration in the moving image DB 13c is registered in the user information DB 13a (step S23), and the process ends.

  FIG. 23 is a flowchart illustrating a processing procedure of the control unit 10 related to the video content disclosure setting and the karaoke distribution setting. The control part 10 of the central apparatus 1 displays the user screen 7 on the display part of the user terminal device 6 as shown in FIG. 9 (step S31). More specifically, the control unit 10 transmits image data for displaying the user screen 7 and user information of the logged-in user to the user terminal device 6. The user screen 7 is constructed based on the screen data and the user information transmitted from, and is displayed on the display unit. Hereinafter, the contents of the process of displaying various screens on the display unit of the user terminal device 6 from the central device 1 are the same, and hence the description thereof is omitted.

  Next, the control unit 10 specifies a moving image uploaded to the central apparatus 1 based on my moving image, that is, the logged-in user ID (step S32). Specifically, my moving image is specified by reading out the moving image ID registered in the “my moving image” column of the user information DB 13a in association with the user ID of the logged-in user.

  Then, the control unit 10 causes the user screen 7 to display a list of thumbnail images 73a of my moving images, a “setting” button 73c for performing settings relating to the moving images, information on the moving images, and the like (step S33).

  Next, the control unit 10 determines whether or not the “setting” button 73c has been operated (step S34). Specifically, when data indicating that the “setting” button 73c corresponding to a specific video is operated is transmitted from the user terminal device 6 to the central device 1, the control unit 10 of the central device 1 The data transmitted from the terminal device 6 is received, and based on the data, it is determined whether or not the “setting” button 73c has been operated.

  When it determines with the "setting" button 73c having been operated (step S34: YES), the control part 10 displays a setting screen on the display part of the user terminal device 6 (step S35). And the control part 10 receives a public setting and a karaoke delivery setting (step S36). Specifically, the control unit 10 receives disclosure permission / inhibition information, karaoke distribution permission information, and the like transmitted from the user terminal device 6 to the central device 1 via the second communication unit 16. Then, the control unit 10 registers the disclosure availability information, karaoke delivery availability information, and the like received in step S36 in the moving image DB 13c (step S37).

  After finishing the process of step S37, or when it determines with the "setting" button 73c not being operated by step S34 (step S34: NO), the control part 10 specifies the moving image data in which karaoke delivery is permitted. Then, the mixed material registration icon 73f is displayed on the thumbnail image 73a of the moving image permitted to be delivered by karaoke (step S38).

  Next, the control unit 10 determines whether or not the hybrid material registration icon 73f has been operated (step S39). Specifically, the composite material designation information indicating that the composite material registration icon 73f corresponding to the specific video is operated is transmitted from the user terminal device 6 to the central device 1, and the control unit 10 of the central device 1 The hybrid material designation information transmitted from the user terminal device 6 is received via the second communication unit 16.

  When it determines with the hybrid material registration icon 73f not being operated (step S39: NO), the control part 10 complete | finishes a process. When it is determined that the mixed material registration icon 73f has been operated (step S39: YES), the control unit 10 registers the moving image selected as the mixed material in the user information DB 13a, that is, the moving image ID of the moving image is stored in the user information DB 13a. It is registered in the “My hybrid video material” column (step S40), and the process is completed.

  FIG. 24 is a flowchart illustrating a processing procedure of the control unit 10 related to calculation and registration of moving image evaluation information. As shown in FIG. 12, the control unit 10 of the central apparatus 1 displays the public screen 8 on the display unit of the user terminal device 6 (step S51). Then, the control unit 10 identifies a moving image permitted to be released among the moving images uploaded from all users (step S52). Then, the control unit 10 releases the thumbnail images 81a and 82a of the moving images permitted to be released and the information of the moving images (step S53).

  Next, the control unit 10 determines whether or not there is an instruction to reproduce the moving image content (step S54). If it is determined that there is a reproduction instruction (step S54: YES), the control unit 10 transmits at least moving image content and music data to the user terminal device 6, and the moving image data and audio included in the moving image content are transmitted to the user terminal device 6. Data and music data are reproduced in parallel (step S55).

  Next, the control unit 10 determines whether there is an instruction to display the details of the moving image content (step S56). When it is determined that there is an instruction for detailed display (step S56: YES), the control unit 10 displays various information such as moving image content and music data, moving image ID of the moving image content, moving image evaluation information, comments, and the like at the user terminal. As shown in FIG. 13, the moving image data, the audio data, and the music data are processed in parallel so that the moving image related to the moving image data is displayed larger than the moving image displayed in step S55. (Step S57). Moreover, the control part 10 displays the display screen 8 on the display part of the user terminal device 6 as shown in FIG. 14 with the evaluation input part 87d for receiving the evaluation with respect to a moving image content (step S58). Note that the display unit of the user terminal device 6 displays various types of information such as video evaluation information and comments at the current time of the video content.

  The user terminal device 6 receives the evaluation details for the reproduced video content in a state where the details of the video content are displayed, and transmits the received evaluation content and the video ID corresponding to the video content to the central device 1. Specifically, as shown in FIG. 14, the control unit 10 of the central device 1 is “cute”, “cool”, “similar”, “delicious”, “astringent”, “interesting”, “crying”, etc. The button on which the character is displayed is displayed on the display unit of the user terminal device 6 as the evaluation input unit 87d. When any one of the buttons is operated, the user terminal device 6 transmits the evaluation content corresponding to the operated button and the moving image ID corresponding to the moving image content to be evaluated to the central device 1.

  The control unit 10 of the central apparatus 1 receives the evaluation content and the moving image ID for the moving image content (step S59). And the control part 10 reads the moving image evaluation information corresponding to received moving image ID from moving image DB13c, and calculates new moving image evaluation information based on the read moving image evaluation information and the received evaluation content (step S60). ). For example, the video evaluation information is the number of times the corresponding evaluation content is transmitted from the user terminal device 6 to the central device 1 for each item such as “cute”, “cool”, and in this case, every time the evaluation content is received. The process of adding 1 to the corresponding number of times is executed. More specifically, when the evaluation content corresponding to the item “cute” has been transmitted 100 times in the past from the user terminal device 6 to the central device 1, the item “cute” is associated 100 times. ing. When the central device 1 receives the evaluation content corresponding to the “cute” item newly transmitted from the user terminal device 6, add 1 to 100 times and add 101 times to the “cute” item. Associate. Note that the above-described calculation method of the moving image evaluation information is an example.

  Then, the control unit 10 registers the moving image evaluation information calculated in step S60 in the moving image DB 13c in association with the moving image ID received in step S59 (step S61), and ends the process.

  FIG. 25 is a flowchart illustrating a processing procedure of the control units 10 and 40 related to calculation and registration of singing evaluation information. The control parts 10 and 40 perform the process which concerns on selection of the music in the karaoke store 2, or transmission / reception of music data by step S71-76 similarly to step S11-step S16 shown in FIG.

  Subsequently, the control part 40 of the karaoke terminal device 4 inputs the sound of the singing performed while reproducing music data (step S77). And the control part 40 gives the input audio | voice data to the scoring part 47, and grades with respect to the song which concerns on this audio | voice data (step S78). Next, the control unit 40 transmits the user ID temporarily stored in the RAM 42 and the scoring result to the central apparatus 1 via the communication unit 44 (step S79). The user ID temporarily stored in the RAM 42 is input when the user logs in to the karaoke system.

  The control unit 10 of the central device 1 receives the user ID and the scoring result transmitted from the karaoke terminal device 4 via the first communication unit 15 (step S80). And the control part 10 is read from user information DB13a corresponding to the received user ID, and calculates new song evaluation information based on the read song evaluation information, the received scoring result, etc. (step S81). The singing evaluation information is, for example, an average value of a plurality of scoring results received in the past. Also, the singing evaluation information may be calculated in a composite manner using other information. For example, the central device 1 takes into account information such as the number of uses of the karaoke store 2 by the user corresponding to the user ID, the number of times of singing, the difficulty level of the song sung, and whether or not it is the latest song. Singing evaluation information may be calculated.

  Then, the control unit 10 registers the singing evaluation information calculated in step S81 in the user information DB 13a in association with the user ID received in step S80 (step S82), and ends the process.

  FIG. 26 is a flowchart illustrating a processing procedure of the control unit 10 related to the release of moving image content. As shown in FIG. 12, the control unit 10 of the central apparatus 1 displays the public screen 8 on the display unit of the user terminal device 6 (step S91). Then, the control unit 10 identifies a moving image permitted to be released from among the moving images uploaded from all users (step S92). Then, the control unit 10 publishes the thumbnail images 81a and 82a of the moving images permitted to be released and information on the moving images in a list display format (step S93).

  Next, the control unit 10 identifies moving image data for which karaoke distribution is permitted, and displays the mixed material registration icons 81b and 82b on the thumbnail images 81a and 82a of the moving image for which karaoke distribution is permitted (step S94). .

  Next, the control unit 10 receives a search request including video evaluation information and song evaluation information as search conditions (step S95), and searches for specific video content based on the received video evaluation information and song evaluation information ( Step S96). The thumbnail images 81a and 82a of the moving image content specified by the search and permitted to be released and the information of the moving image content are disclosed in a list notation format.

  Next, the control unit 10 determines whether or not the mixed material registration icons 81b and 82b have been operated (step S97). When it is determined that the mixed material registration icons 81b and 82b have been operated (step S97: YES), the control unit 10 registers the moving image selected as the mixed material in the user information DB 13a, that is, the moving image ID of the moving image is registered in the user information DB 13a. Are registered in the “My mixed video material” column (step S98).

  After the process of step S98 is completed, or when it is determined in step S97 that the mixed material registration icons 81b and 82b have not been operated (step S97: NO), the control unit 10 determines whether or not there has been a playback operation for moving image content data. Is determined (step S99). When it determines with there being no reproduction | regeneration operation (step S99: NO), the control part 10 finishes a process.

  When it is determined that there has been a playback operation (step S99: YES), the control unit 10 reads the video content data to be played back from the video DB 13c, and reads the music data associated with the video content from the music DB 13b, The moving image data, audio data, and music data included in the read moving image content data are reproduced in parallel (step S100), and the process ends.

  27 and 28 are flowcharts showing the processing procedure of the control units 10 and 40 related to the generation and registration of the hybrid video content. The control unit 40 of the karaoke terminal device 4 accepts music by the remote operation device 5 (step S111), and receives the music request data including the user ID and the music ID related to the received music via the communication unit 44. 1 (step S112).

The control unit 10 of the central device 1 receives the music request data transmitted from the karaoke terminal device 4 via the first communication unit 15 (step S113), and the user ID and the music ID included in the received music request data. The audio data of the hybrid video material corresponding to is selected (step S114). That is, the control unit 10 identifies the moving image content registered as the mixed moving image material from the moving image ID registered in the “my mixed moving image material” column in association with the user ID, and the registered moving image content. Are identified with the same music ID as the received music ID.
And the control part 10 transmits the specified music data and audio | voice data to the karaoke terminal device 4 via the 1st communication part 15 (step S115). In step S115, the example in which only the audio data constituting the moving image content data is transmitted has been described. However, the moving image content data including the moving image data and the audio data may be transmitted.

  The control unit 40 of the karaoke terminal device 4 receives the music data and audio data transmitted from the central device 1 via the communication unit 44 (step S116). And the control part 40 reproduces | regenerates the received music data and audio | voice data in parallel (step S117). Specifically, the control unit 40 provides music data to the sound source 48b and provides audio data to the audio decoder. The sound source 48b gives the accompaniment sound related to the music data to the audio mixer 48d, and the audio decoder 48c decodes the audio data, and gives the decoded audio data to the audio mixer 48d. The audio mixer 48d synthesizes the accompaniment sound and the sound given from the sound source 48b and the audio decoder 48c, respectively, and outputs the audio data obtained by the synthesis to the speaker 48f. Therefore, the sound related to the mixed moving image material is reproduced from the speaker 48f in accordance with the accompaniment of karaoke.

Next, the control unit 40 inputs a moving image of the song performed while reproducing the music data (step S118), and inputs the voice of the song (step S119).
The audio data output from the microphone 48e is input to the audio mixer 48d, and the audio mixer 48d combines and synthesizes the karaoke accompaniment sound, the audio related to the mixed material moving image, and the audio input to the microphone 48e. The audio data obtained in this way is output to the speaker. Therefore, in accordance with the accompaniment of karaoke, two users are in a state of singing duet.

  Next, the control unit 40 determines whether or not to end the reproduction of the music data (step S120). When it determines with not complete | finishing reproduction | regeneration (step S120: NO), the control part 40 returns a process to step S117. When it determines with complete | finishing reproduction | regeneration (step S120: YES), the control part 40 monitors the operation state of the remote control device 5, and determines whether the input moving image data and audio | voice data are uploaded (step S121). ). When it determines with not uploading (step S121: NO), the control part 40 finishes a process.

  When it determines with uploading (step S121: YES), the control part 40 transmits user ID, music ID, moving image data, and audio | voice data to the central apparatus 1 via the communication part 44 (step S122).

  The control unit 10 of the central device 1 receives the user ID, music ID, moving image data, and audio data transmitted from the karaoke terminal device 4 by the first communication unit 15 (step S123). And the control part 10 produces | generates the hybrid moving image content data containing the received moving image data and audio | speech data, and the moving image data and audio | speech data selected as a hybrid material, The user who received the produced | generated mixed moving image content data It is registered in the hybrid video DB 13d together with the ID, music ID, etc., and the hybrid video ID issued at the time of registration in the hybrid video DB 13d is registered in the user information DB 13a (step S124), and the process is terminated.

  FIG. 29 is a flowchart illustrating a processing procedure of the control unit 10 relating to the setting for releasing the mixed video content. As shown in FIG. 16, the control unit 10 of the central device 1 displays the user screen 7 on the display unit of the user terminal device 6 (step S131).

  Next, the control unit 10 specifies my hybrid video, that is, a hybrid video created by the logged-in user (step S132). Specifically, my moving image is specified by reading out the mixed moving image ID registered in the “my mixed moving image” column of the user information DB 13a in association with the user ID of the logged-in user.

  Then, the control unit 10 displays a list of my mixed moving image content thumbnail image 77a, a “setting” button 77c for performing settings related to the mixed moving image, and the mixed moving image content information on the user screen 7 (step S133). .

  Next, the control unit 10 determines whether or not the “setting” button 77c has been operated (step S134). Specifically, data indicating that the “setting” button 77c corresponding to the specific video is operated is transmitted from the user terminal device 6 to the central device 1, and the control unit 10 of the central device 1 6 is received, and based on the data, it is determined whether or not the “set” button 77c has been operated.

  If it is determined that the “setting” button 77c has not been operated (step S134: NO), the control unit 10 ends the process. When it is determined that the “setting” button 77c has been operated (step S134: YES), the control unit 10 displays the mixed moving image content information display unit 78 and the setting content input unit 79 on the setting screen as shown in FIG. The information is displayed on the display unit of the device 6 (step S135). Then, the control unit 10 accepts the public setting (step S136). Specifically, the disclosure permission / prohibition information input to the user terminal device 6 and transmitted to the central device 1 is received via the second communication unit 16. Then, the control unit 10 registers the disclosure availability information, karaoke distribution availability information, and the like received in step S136 in the moving image DB 13c (step S137), and ends the process.

  FIG. 30 is a flowchart showing a processing procedure of the control unit 10 related to the release of the hybrid video content. The control unit 10 of the central device 1 displays the public screen 8 on the display unit of the user terminal device 6 (step S151). Then, the control unit 10 identifies a hybrid video that is permitted to be released from the hybrid video content generated by all users (step S152). Then, the control unit 10 publishes the thumbnail image 83a of the mixed moving image content permitted to be released and information on the moving image in a list display format (step S153).

  Next, the control unit 10 determines whether or not there has been a reproduction operation of the hybrid moving image content (step S154). If it is determined that there is a playback operation (step S154: YES), the control unit 10 transmits the hybrid video content and the music data to the user terminal device 6, and the two sets of videos included in the hybrid video content in the user terminal device Data, audio data, and music data are reproduced in parallel (step S155). And the control part 10 receives the volume adjustment of each moving image which makes a group (step S156), and changes the volume of each moving image separately (step S157).

  After the process of step S157 is completed, or when it is determined that there is no playback operation of the mixed video content (step S154: NO), the control unit 10 determines whether there is a playback operation of one of the videos in the set. (Step S158). When it determines with there being no reproduction | regeneration operation of one moving image (step S158: NO), the control part 10 complete | finishes a process. When it is determined that one of the moving image playback operations has been performed (step S158: YES), the control unit 10 plays back the moving image data and audio data, and music data included in the moving image content related to the one moving image in parallel ( Step S159), the process ends.

  In the moving image content search apparatus and the moving image content search method according to the embodiment configured as described above, creation and release of hybrid moving image content combining a plurality of video data and audio data related to the singing of the person or others is performed. Can be made and entertainment can be improved. In addition, it is possible to search for a video content suitable for creation of a hybrid video content using the evaluation of the video content itself and the evaluation of the singer who created the video content as a search condition.

  Furthermore, since one video content can be selected as a material of the hybrid video content from a plurality of video content registered in the video DB of the central device and the composite video content can be created, the video content can be created. The degree of freedom is high and the entertainment is improved.

  Furthermore, the video content created by one user is published on the video browsing site, and other users can select the video content as the material of the hybrid video content from the published video browsing site. Compared to the case where hybrid video content is created using only the video content created by the user, the degree of freedom in creating video content is high and the entertainment is improved.

  Furthermore, since it is possible to select whether or not to publish video content to a video posting site and whether or not to distribute karaoke video content, it is desirable to publish video content but avoid karaoke distribution. Can respond to various needs for

  Furthermore, the volume of the audio data of each moving image content constituting the mixed moving image content can be changed individually. Therefore, the entertainment when viewing the content data is improved.

In the embodiment, the example in which the hybrid video content is generated on the central device side has been described. However, the hybrid video content may be generated on the karaoke terminal device side and transmitted to the central device. A specific processing procedure is as follows.
In step S115 in FIG. 27, the control unit of the central device transmits the music data and the moving image data and audio data relating to the moving image selected in step S114 to the karaoke terminal device via the first communication unit.
In step S116, the control unit of the karaoke terminal apparatus receives music data, moving image data, and audio data transmitted from the central apparatus. Hereinafter, when the process shown in step S117 to step S121 in FIG. 28 is executed and it is determined to upload in step S121, instead of the process in steps S122 to 124 shown in FIG. The following processing is executed. That is, the control unit of the karaoke terminal device generates hybrid moving image content data including the moving image data and audio data related to the moving image and audio input in steps S118 and 119 and the moving image data and audio data received in step S116. The generated mixed video content data, music ID, and user ID are transmitted to the central device via the communication unit.
The central device receives the hybrid video content data, the song ID, and the user ID transmitted from the karaoke terminal device, registers the received hybrid video content data, the user ID, and the song ID in the hybrid video DB 13d in association with each other, and performs processing. Finish. Other processes are the same as those in the above-described embodiment.

  Moreover, although the example which produces | generates the hybrid video content which combines two video content was demonstrated, you may produce | generate a hybrid video content combining 3 or more video content. Further, the method for arranging moving images related to a plurality of moving image contents is not particularly limited. Also, audio data included in a plurality of moving image contents may be reproduced in parallel, but may be selectively reproduced.

  Furthermore, although the moving image has been described as the material of the mixed content formed by combining the video and audio of the singing, the video may be a video or a still image that is switched in chronological order in a slide show format.

  Furthermore, as the video content that is the material of the hybrid video content, the video content that the user is singing is used, but the video content prepared in advance is stored in the internal storage device of the central device, You may make it produce | generate a hybrid moving image content using this moving image content.

  Furthermore, although the configuration in which the user selects the video content that is the basis of the hybrid video content has been illustrated, the central device may randomly select and distribute to the karaoke terminal device.

(Modification 1)
The karaoke system which concerns on the modification 1 calculates based on the scoring result performed by the user in the same private room 21, and the other one or several users in the same private room 21 perform scoring with respect to a user's song. The video content is searched by the singing evaluation information. As described above, the karaoke system according to Modification 1 is different from the embodiment only in the singing scoring method and the singing evaluation information calculation method, that is, the processing contents of steps S77 to S81 shown in FIG. The above differences will be mainly described.

  In the following description, it is assumed that a plurality of users in the same private room 21 are logged in to the karaoke system. The control unit 40 of the karaoke terminal device 4 finishes the reproduction of the music data, instead of inputting the voice data and scoring, and then singing the singing result from each user in the same private room 21 logged in to the karaoke system. The remote control device 5 sequentially accepts them. And the control part 40 transmits the received scoring result and the user ID of the user who performed the singing to the central apparatus 1, when reception of the scoring result of a song is complete | finished. Note that an average value of the accepted scoring results may be calculated, and the calculated average value may be transmitted to the central apparatus 1.

  The control unit 10 of the central device receives the scoring result and user ID transmitted from the karaoke terminal device 4. And the control part 10 reads song evaluation information from user information DB13a corresponding to received user ID, and calculates new song evaluation information based on the read song evaluation information, the received scoring result, etc.

In the karaoke system according to the first modification configured as described above, the singing evaluation information is calculated based on the scoring result for the singing performed by the user. Then, the moving image content can be searched using the singing evaluation information as a search key. The singing evaluation information is information based on a sensual singing evaluation that cannot be performed by mechanical scoring by the scoring unit 47, and a user who searches for video content is not a mechanical singing evaluation but a human sensual evaluation. Since the singing evaluation information performed based on the evaluation criteria is used as a search key, in the first modification, the singing evaluation criteria approximate each other, and the search accuracy of the moving image content can be improved.
In addition, both the scoring result by the user in the same private room 21 and the scoring result by the scoring unit 47 are transmitted from the karaoke terminal device 4 to the central device 1, and the singing evaluation information is calculated based on each scoring result. You may do it.
Moreover, you may comprise so that either one may be employ | adopted selectively and song evaluation information may be calculated. For example, when the difference between the scoring result by the scoring unit 47 and the scoring result by the user in the same private room 21 is greater than or equal to a predetermined value, the scoring result by the scoring unit 47 is adopted to ensure objectivity, and less than the predetermined value In some cases, the scoring results by the user may be adopted.
Further, the singing evaluation information may be calculated by weighting each scoring result. For example, when the difference between the scoring result by the scoring unit 47 and the scoring result by the user in the same private room 21 is greater than or equal to a predetermined value, the weighting factor for the scoring result by the scoring unit 47 is larger than the weighting factor for the scoring result by the user. In this case, when the objectivity is ensured and it is less than the predetermined value, the weighting coefficient for the scoring result by the scoring unit 47 may be smaller or equal to the weighting coefficient for the scoring result by the user.
When comprised in this way, it also becomes possible to maintain the objectivity of singing evaluation.

(Modification 2)
The karaoke system according to the modified example 2 has a function in which users all over the country sing the same music at the same time and compete for the scoring results for the singing (hereinafter referred to as a singing battle function). It is comprised so that song evaluation information may be calculated based on the scoring result obtained when using. As described above, the karaoke system according to the modified example 2 differs from the embodiment only in the singing scoring method and the singing evaluation information calculation method, and therefore, the differences will be mainly described below.

The user can select a song for the singing battle function using the remote operation device 5, and the control unit 40 of the karaoke terminal device 4 receives the song data for the singing battle function received using the remote operation device 5. The music request data for requesting is transmitted to the central apparatus 1.
The control unit 10 of the central device 1 receives the music request data transmitted from the karaoke terminal device 4 and transmits the music data indicated by the received music request data to the karaoke terminal device 4 that is the music request source at a predetermined time. To do.

  The control unit 40 of the karaoke terminal device 4 receives the music data transmitted from the central device 1 and reproduces the received music data. Next, the control unit 40 inputs the voice of the singing performed while reproducing the music data, gives the input voice data to the scoring unit 47, and sequentially scores the singing related to the voice data in real time. To do. Next, the control unit 40 sequentially transmits the user ID temporarily stored in the RAM 42 and the scoring result to the central apparatus 1. The central device 1 receives the scoring results of all users who are using the singing battle function, calculates the ranking of each user's singing level based on the received scoring results, and each user uses the calculation results. To the existing karaoke terminal. The karaoke terminal device displays the order transmitted from the central device 1 on the video display device 46f. The user can sing while confirming the ranking of the singing level based on the scoring result in real time.

  When the reproduction of the music data is finished, the control unit 10 of the central device 1 calculates the singing evaluation information based on the singing scoring result performed using the singing battle function, and the calculated singing evaluation information is used by the user. Register in the information DB 13a.

In the karaoke system according to the modified example 2 configured as described above, the singing evaluation information is calculated based on the scoring result for the singing performed using the singing battle function. Then, the moving image content can be searched using the singing evaluation information as a search key.
When a user sings using the singing battle function, since the user usually performs singing using the maximum singing technique, the user's singing evaluation can be performed more accurately than when singing performed normally. Information can be calculated. In addition, when a user creates video content, it is often the case that a user sings using the maximum singing technology, as in the case of singing using the singing battle function. The singing evaluation information based on the result has good compatibility with the search key of the moving image content, and can improve the search accuracy of the moving image content.

(Modification 3)
The karaoke system according to Modification 3 is a function in which two users in the same private room 21 simultaneously sing the same music in a competitive manner and compete for winning or losing based on the scoring results for the song (hereinafter referred to as an individual singing battle function). ) And is configured to calculate singing evaluation information based on a scoring result or a winning / losing result obtained when the anti-personal singing battle function is used. As described above, the karaoke system according to the modified example 3 is different from the embodiment only in the singing scoring method and the singing evaluation information calculating method, and therefore, the differences will be mainly described below.

  In the following description, it is assumed that a plurality of users in the same private room 21 are logged in to the karaoke system. When the karaoke terminal device accepts music, the remote control device 5 accepts selection of whether or not to use the personal singing battle function, and when the personal singing battle function is used, two people who are further opponents The user's selection is accepted.

  Two microphones 48e are connected to the karaoke terminal device 4, and when the personal singing battle function is selected, the voices of the singing of the user who is the opponent are input from the two microphones. And the control part 40 gives each input audio | voice data to the scoring part 47, respectively performs the grading with respect to the song which concerns on this audio | voice data, and displays the scoring result with respect to each user's song on the video display apparatus 46f. The user can sing while conscious of his / her scoring result and the scoring result of his / her opponent.

  The control unit 40 that has finished reproducing the music data compares the scoring results for each user's singing, determines the winning or losing of the singing battle, and gives the scoring result, the battle result indicating the winning or losing, and the user ID to the central device 1. Send.

  The grading result, the battle result, and the user ID transmitted from the karaoke terminal device 4 are received, and singing evaluation information for the user's song is calculated based on the received grading result and the battle result. For example, what is necessary is just to calculate so that song evaluation information may become high, so that the winning rate of the said competition result is high.

In the karaoke system according to the third modification configured as described above, the search accuracy of the moving image content can be improved as in the second modification.
Needless to say, the singing evaluation information may be calculated by combining the scoring methods described in the embodiment and the first to third modifications.

  The embodiment disclosed this time is to be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the meanings described above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

DESCRIPTION OF SYMBOLS 1 Central apparatus 2 Karaoke store 4 Karaoke terminal apparatus 5 Remote operation apparatus 6 User terminal apparatus 10, 40 Control part 12, 42 RAM
13 Internal storage device 13a User information DB
13b Music DB
13c Movie DB
13d hybrid video DB
14 external storage device 15 first communication unit 16 second communication unit 43 storage device 44 communication unit 46a video encoder 46b video control circuit 46c video decoder 46d video mixer 46e imaging device 46f video display device 47 scoring unit 48a audio encoder 48b sound source 48c audio Decoder 48d Audio mixer 48e Microphone 48f Speaker N1, N2 Communication network

Claims (5)

Video content data relating to the singing of each of a plurality of karaoke users, user identification information for identifying the karaoke user who performed the singing, and video evaluation information including evaluation contents for the video content data are stored in association with each other. In a video content search device for searching for specific video content data from a plurality of stored video content data,
A table in which user identification information and singing evaluation information including evaluation contents for singing of a karaoke user corresponding to the user identification information are associated with each other;
Receiving means for receiving a search request for video content data using specific video evaluation information and singing evaluation information as search conditions;
Searching means for searching for moving picture content data based on specific moving picture evaluation information and singing evaluation information related to the searching request and the table when the receiving request is received by the receiving means Content search device. Means for receiving evaluation contents for each of a plurality of different songs performed by a karaoke user, and user identification information for identifying the karaoke user;
The moving image content search apparatus according to claim 1, further comprising: means for calculating singing evaluation information of a karaoke user corresponding to the user identification information based on a plurality of received evaluation contents. Means for publishing the stored video content data in a viewable manner;
Means for receiving a plurality of evaluation contents for the published video content data and video content identification information for identifying the video content data;
A means for calculating moving image evaluation information of moving image content data corresponding to the moving image content identification information based on a plurality of evaluation contents for each received moving image content data. The moving image content search device described. Generation means for generating content data combining a plurality of video content data searched by the search means, or content data combining one video content data searched by the search means and other video content data When,
The moving image content search device according to any one of claims 1 to 3, further comprising: means for publishing the content data generated by the generation unit so as to be viewable. Storage device that stores video content data related to singing of each of a plurality of karaoke users, user identification information for identifying the karaoke user who performed the singing, and video evaluation information including evaluation contents for the video content data in association with each other From the video content search method for searching for specific video content data from the plurality of video content data stored in the storage device,
Preparing a table in which user identification information and singing evaluation information including evaluation contents for singing of a karaoke user corresponding to the user identification information are associated;
Receiving a search request for video content data using specific video evaluation information and singing evaluation information as search conditions,
When a search request is received, video content data is searched based on specific video evaluation information and singing evaluation information related to the search request and the table.

Images