JP5422593B2 - Video information distribution system - Google Patents

Description

  The present invention relates to a moving image information distribution system that distributes moving image information to a plurality of communication terminal devices via a predetermined communication line, and in particular, display control with a sense of unity in a co-starring moving image in which a plurality of moving images are combined and output synchronously. It is related with the improvement for realizing.

  A moving image information distribution system that distributes moving image information to a plurality of communication terminal devices via a predetermined communication line is known, and further development is expected as the core of the content business with recent improvements in communication technology. . In such a moving image information distribution system, a plurality of pieces of moving image information posted (uploaded) from a predetermined communication terminal device in a so-called moving image posting site is usually stored in a predetermined database, and the moving image posting is performed by an arbitrary communication terminal device. Access through the site is possible. Thereby, the moving image information posted by the predetermined communication terminal device can be browsed by any communication terminal device.

  In the moving image information distribution system, there may be a mode in which moving image information shot and posted by the imaging device is distributed as it is, but the moving image information is subjected to predetermined image processing, and various video effects such as comments and effects. The system of the aspect to which is applied is put into practical use, and the possibility of further display technology is being sought. In relation to such a technique, a technique has been proposed in which editing is performed to combine an effect image with an image photographed by an imaging device. For example, this is the image processing apparatus described in Patent Document 1. According to this technique, a plurality of users can interact with each other by accepting editing corresponding to each of the plurality of display means and applying the editing information input corresponding to one display means to the other display means. In addition, it is possible to realize a process of editing an image while obstructing, cooperating, or interfering with each other, and to enhance the interest of the image editing operation.

JP 2005-151265 A

  By the way, the present applicant has incorporated a karaoke apparatus as a communication terminal apparatus in the moving picture information distribution system, and outputs video information captured by the imaging apparatus and audio input by the audio input apparatus when outputting a predetermined performance song by the karaoke apparatus. A technology that accepts and allows browsing of information has been devised and put into practical use. In addition, regarding this technique, a co-star video (collaboration) that can be viewed by not only the karaoke device but also a communication terminal device such as a personal computer by editing a plurality of video information associated with a common performance piece. Video) service.

  Here, when the video effect is applied to each piece of moving picture information related to the combination of the co-starring moving picture information when the co-starring moving picture information is output, in the conventional technology, one piece of moving picture information related to the combination of the co-starring moving picture information Since the video effect applied to the video is not necessarily applied to the other moving image information, there is a problem that the viewer tends to give a biased impression without a sense of unity. Further, in the moving picture information distribution system managed and operated by the applicant, a plurality of pieces of moving picture information posted later with respect to one piece of moving picture information posted earlier can each constitute the co-starring moving picture information. In this case, setting the video effect every time the combination of the co-starring video information is determined is complicated for the previous poster and is not suitable for practical use. However, the conventional image processing technique is not related to the synchronous distribution of a plurality of moving image information, and such a problem cannot be solved depending on the technique. That is, in the current situation, a moving image information distribution system that realizes display control with a unified feeling in a co-starring moving image in which a plurality of moving images are combined and output is not yet developed.

  The present invention has been made in the background of the above circumstances, and the purpose of the present invention is to provide a moving picture information distribution system that realizes display control with a sense of unity in a co-starring moving picture that is output in combination with a plurality of moving pictures. Is to provide.

  In order to achieve such an object, the gist of the present invention is a moving image information distribution system that distributes moving image information to a plurality of communication terminal devices via a predetermined communication line, from the communication terminal device. A video database for storing posted information and a video information post corresponding to any of a plurality of predetermined music data are received from the communication terminal device via the communication line, and the posted video information Is combined with the corresponding music data and is stored in the video database, and the co-star video information is edited by combining a pair of video information associated with the common music data received by the posting reception control means. And editing the co-star video information that is stored in the video database in association with the common music data. A moving image that distributes the moving image information and the co-starring moving image information related to the distribution request stored in the moving image database to the communication terminal device in response to a distribution request from the communication terminal device via the control unit and the communication line Selection from among a plurality of predetermined video effects and a video output control means for synchronously outputting a pair of video information related to the combination of the distribution control means and the co-starring video information distributed by the video distribution control means Video effect setting means for setting at least one video effect corresponding to each of the moving picture information, and the video effect setting means set by the video effect setting means when the pair of moving picture information is synchronously output by the moving picture output control means. The video effect is applied to the corresponding video information, and the video effect is reflected in the other video information related to the combination with the video information. Or other video effects control means for applying a video effect, it is characterized in that it comprises.

  In this way, a moving image database that stores information posted from the communication terminal device, and moving image information corresponding to any of a plurality of pieces of predetermined music data from the communication terminal device via the communication line. A posting reception control means for storing the posted video information in association with the corresponding music data and storing it in the video database, and a pair associated with the common music data received by the posting reception control means The co-star video editing control means for editing the co-star video information by combining the video information and storing the edited co-star video information in the video database in association with the common music data, and the communication line In response to the distribution request from the communication terminal device, the moving image information and the distribution request stored in the moving image database are stored. Video output control means for delivering the co-star video information to the communication terminal device, and video output control means for synchronously outputting a pair of video information related to the combination of the co-star video information delivered by the video delivery control means, Video effect setting means for setting at least one video effect selected from a plurality of predetermined video effects corresponding to each of the moving picture information, and synchronization of the pair of moving picture information by the moving picture output control means At the time of output, the video effect set by the video effect setting means is applied to the corresponding video information, and the same or other video effect that reflects the video effect on the other video information related to the combination with the video information is applied. Since the video effect control means to be applied is provided, the synchronous output of a pair of video information related to the combination of the co-star video information is performed. , It is possible to reflect the applied video effect to one of the video information without requiring a complicated operation to the other video information. That is, it is possible to provide a moving image information distribution system that realizes display control with a sense of unity in a co-starring moving image that is output in combination with a plurality of moving images.

  Here, it is preferable that the co-star video editing control unit combines the first video information previously posted by the post acceptance control unit with the second video information posted later. The video effect control means is set corresponding to the first video information by the video effect setting means when the pair of video information is synchronously output by the video output control means. The same video effect is applied to the first video information, and the same or other video effect that reflects the video effect is applied to the second video information relating to the combination with the first video information. is there. In this way, when synchronized output of a pair of video information related to the combination of the co-star video information, the video effect applied to the video information posted earlier can be reflected in the video information posted later, In particular, in a mode in which a plurality of pieces of moving image information posted later with respect to one piece of moving image information posted earlier constitutes the co-starring moving image information, a video effect is set each time a combination of the co-starring moving image information is determined Unnecessary display control with a sense of unity can be realized. In addition, since the video effect related to the co-star movie is determined corresponding to the previously posted movie information, a secondary effect that the posting of the movie information as a base can be promoted can be expected.

  Preferably, the apparatus further comprises a user database that stores attribute information of a user who is a posting subject of the moving picture information in association with the user, and the video effect control means includes the moving picture output control means. When the pair of moving image information is synchronously output, the image effect set by the image effect setting means is applied to the corresponding moving image information, and the image effect is applied to the other moving image information related to the combination with the moving image information. The video effect that is reflected and determined based on the attribute information of the user who is the posting subject of the other video information is applied. In this way, when synchronously outputting a pair of video information related to a combination of co-starring video information, the video effect applied to one video information is determined based on attribute information such as the gender of the user who is the posting subject. It can be reflected in the other video information, and it is possible to realize display control with a sense of unity while visually making the gender distinct.

  Preferably, the audio input device and the imaging device are provided, and the audio input by the audio input device in parallel to output a performance song corresponding to the music data selected from a large number of music data. A karaoke device that amplifies and outputs the karaoke device as the communication terminal device, and the moving image distribution control means receives the moving image information related to the distribution request stored in the moving image database in response to the distribution request from the karaoke device. The karaoke apparatus synchronizes with the output of the moving picture information by the moving picture output control means and the moving picture output control means for controlling the output of the moving picture information distributed by the moving picture distribution control means. Synchronized performance control means for outputting performance music corresponding to the music data associated with the video information, and performance music by the synchronous performance control means A performance recording control means for recording video information photographed by the imaging device and audio information input by the voice input device at the time of output, and the posting acceptance control means is the performance recording control means. The video information and the audio information recorded by the step are received and stored in the video database in association with the identification information of the music data corresponding to the performance music output by the synchronous performance control means, and the co-star video editing The control means edits the co-star video information by combining a plurality of video information associated with the common music data, which is received by the posting reception control means, and the edited co-star video information is used as identification information of the music data. It is associated and stored in the moving image database. In this way, it is possible to realize display control with a sense of unity in the co-starring moving image in which a plurality of moving images recorded or posted by the karaoke apparatus are combined and output in synchronization.

  Preferably, the video data is provided with a user database that stores music data that has been played in the past by the karaoke device in association with the user, the user who is the posting subject of the video information, and the video The effect control means applies the video effect set by the video effect setting means to the corresponding video information when the video output control means synchronously outputs the pair of video information, and combines it with the video information. A video effect that reflects the video effect on the other video information and applies a video effect that is determined based on music data that a user who has posted the other video information in the past has performed by the karaoke device. It is. In this way, when synchronized output of a pair of video information related to the combination of co-star video information, the video effect applied to one video information is based on the performance music that the user who has contributed in the past has performed. Therefore, it is possible to realize the display control with a sense of unity while visually recognizing the past performance result of the user by the karaoke apparatus.

  Preferably, each piece of music data is associated with at least one genre in advance, and the video effect control means is configured to output the pair of moving picture information synchronously by the moving picture output control means. The video effect set by the video effect setting means is applied to the corresponding video information, and the video effect is reflected in the other video information related to the combination with the video information and the other video information is posted. A video effect determined based on the genre of music data that a user has performed with the karaoke device in the past is applied. In this way, when synchronized output of a pair of video information related to the combination of co-star video information, the video effect applied to one video information is based on the performance music that the user who has contributed in the past has performed. Therefore, it is possible to realize display control with a sense of unity while visually recognizing the user's performance tendency by the karaoke apparatus.

  Preferably, in correspondence with the audio information included in each pair of moving image information related to the combination of the co-starring moving image information, for each moving image information based on the common music data from a predetermined relationship. Performance evaluation control means for performing performance evaluation of audio information is provided, and the video effect control means, when the pair of moving picture information is synchronously output by the moving picture output control means, the pair of moving picture information by the performance evaluation control means. The mode of the video effect applied to each moving picture information is changed based on the performance evaluation result corresponding to each. In this way, the performance evaluation result by the karaoke device can be obtained by controlling the video effect based on the performance evaluation result corresponding to each video information when synchronously outputting a pair of video information related to the combination of the co-starring video information. It is possible to realize display control with a sense of unity while visually conscious.

It is a figure explaining the structure of the video information delivery system which is one Example of this invention. It is a figure which illustrates the structure of the server apparatus with which the video information delivery system of FIG. 1 was equipped. It is a figure which illustrates the structure of the personal computer which is a communication terminal device with which the video information delivery system of FIG. 1 was equipped. It is a figure which illustrates the structure of the karaoke apparatus which is a communication terminal device with which the video information delivery system of FIG. 1 was equipped. FIG. 5 is a functional block diagram illustrating a main part of a control function provided in the CPU of the server device of FIG. 2, the CPU of the personal computer of FIG. 3, or the CPU of the karaoke device of FIG. 4. It is a figure which illustrates the video information image | photographed with the video camera at the time of the output of the performance music by the karaoke apparatus of FIG. FIG. 7 is a diagram for explaining how the video information of FIG. 6 is used as a background video in the synchronous performance control related to the co-star video by the karaoke apparatus of FIG. 4. It is a figure which shows an example of the co-starring image | video displayed on communication terminal devices, such as a personal computer shown in FIG. It is a figure which shows the image | video which applied the frame which imitated the leaf of the plant which is an example of a video effect to the 1st performance image shown in FIG. In the co-star video shown in FIG. 8, it is a figure which illustrates a mode that the video effect set corresponding to one moving image information is reflected in the other moving image information. In the co-starring video related to the combination of the first performance video and the other third performance video shown in FIG. 6, the video effect set corresponding to one video information is reflected in the other video information. It is a figure illustrated. In the co-starring video related to the combination of the first performance video and the other third performance video shown in FIG. 6, the video effect set corresponding to one video information is reflected in the other video information. It is a figure which shows another example. FIG. 9 is a diagram showing another example of how the video effect set corresponding to one moving image information is reflected in the other moving image information in the co-star video shown in FIG. 8. In the co-starring video related to the combination of the first performance video and the other third performance video shown in FIG. 6, it is applied to each video information based on the performance evaluation result corresponding to each of the pair of video information. It is a figure which illustrates a mode that a video effect operate | moves interlockingly. In the video effect shown in FIG. 14, it is a figure explaining a mode that the fragmented image | video of the heart mark displayed in each moving image information rises according to a performance evaluation result. In the co-star video related to the combination of the first performance video and the other third performance video shown in FIG. 6, the video effect set corresponding to one video information is reflected in the other video information. It is a figure which shows an example. It is a flowchart explaining the principal part of the 1st moving image contribution control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of the 2nd moving image contribution control by CPU of the karaoke apparatus of FIG. It is a flowchart explaining the principal part of the collaboration performance animation contribution control in the control shown in FIG. It is a flowchart explaining the principal part of the animation posting acceptance control by CPU of the server apparatus of FIG. 5 is a flowchart for explaining a main part of video effect setting control by the CPU of the karaoke apparatus of FIG. 4 or the CPU of the PC of FIG. 3. 3 is a flowchart illustrating a main part of moving image distribution / video effect control by a CPU of the server apparatus of FIG. 2.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating the configuration of a moving image information distribution system 10 according to an embodiment of the present invention. As shown in FIG. 1, a moving image information distribution system 10 of this embodiment includes a server device (center device) 12 operated by an information distribution service provider and a plurality of (two in FIG. A personal computer 14 (to be referred to as a PC 14 hereinafter), a plurality of (two are illustrated in FIG. 1) mobile phones 16 that are also communication terminal devices, and a predetermined communication line 18. , And is configured. The communication line 18 is connected to the Internet such as a WWW (World Wide Web) constituted by, for example, a public telephone line, an ADSL line, or an optical fiber line. The server device 12 and the PC 14 are both By being connected to the communication line 18, information can be communicated with each other via the communication line 18. The mobile phone 16 is connected to the communication line 18 via the relay base station 20 so that information can be communicated between the server device 12 and the mobile phone 16.

  Moreover, the moving image information distribution system 10 of the present embodiment includes a karaoke system 30 using a karaoke device. For example, as shown in FIG. 1, each of a plurality of private rooms 34a, 34b, 34c,... In a store 32 such as a karaoke box, a snack, an inn, etc. Karaoke units 36a, 36b, 36c,... (Hereinafter simply referred to as karaoke units 36 unless otherwise distinguished) are installed. The plurality of karaoke apparatuses 36 are connected to the communication line 18 via the router 44, and the server apparatus 12 and the like connected to the communication line 18 as described above are connected to each other via the communication line 18. Communication of information is possible. That is, the karaoke device 36 corresponds to a communication terminal device that is connected to the communication line 18 and communicates information with the server device 12 in the same manner as the PC 14 and the mobile phone 16.

  In the karaoke system 30 included in the moving picture information distribution system 10, the server device 12 stores the digital contents (Digital Contents) such as karaoke information (music data), background video information, information between songs, and the basics of input / output management. It functions as a server that performs general control, periodically distributes content to the karaoke device 36 via the communication line 18, and transmits a predetermined function control program in response to a request from the karaoke device 36. . The karaoke system 30 includes a plurality of electronic quick sample devices 38a, 38b, 38c,... (Hereinafter simply referred to as an electronic quick sample device 38 unless otherwise distinguished). 1 to several electronic quick sample devices 38 are rented for each user (group) and are used as remote control devices for the karaoke device 36 in each private room 34 as will be described later. ing. A LAN 40 for connecting the plurality of karaoke devices 36 to each other is laid in the store 32, and an input to the karaoke device 36 from the electronic quick sample device 38 is made via a predetermined access point 42 and the LAN 40. This is performed by LAN communication or the like.

  FIG. 2 is a diagram illustrating a configuration of the server device 12. This server device 12 is a so-called Neumann type that performs signal processing in accordance with a program stored in advance in a ROM 54 that is a read-only memory while using a temporary storage function of a RAM 56 that is a read / write memory by a CPU 52 that is a central processing unit. The computer is a server that performs various controls such as file management, input / output control, management of access via the communication line 18 and communication control via the communication line 18. Further, as shown in FIG. 2, for example, a video display device 58 such as a TFT (Thin Film Transistor Liquid Crystal) or a PDP (Plasma Display Panel), and a video display control for controlling the video display by the video display device 58. A video board (graphics board) 60, which is a device, an input device 62 such as a keyboard, an input interface 64 for processing input by the input device 62, and the CPU 52 and the like for connecting to the communication line 18 A modem 66 is provided.

  The server device 12 includes a moving image database (video effect database) 68, a user database 70, and a music database 72 as databases for storing various types of information related to the moving image information distribution system 10 and the karaoke system 30. Various databases are provided. The contents stored in the moving image database 68, the user database 70, and the music database 72 will be described later together with the description of various control functions shown in FIG. As shown in FIG. 2, in this embodiment, the moving image database 68, the user database 70, and the music database 72 are described in different storage devices. However, these databases are stored in the same storage device. It may be provided. Further, the video effect database to be described later may be provided in a different storage device separated from the moving image database 68. The moving image database 68, the user database 70, and the music database 72 are provided in individual server devices, and the plurality of server devices are connected to each other to execute the control of this embodiment described below. It may be.

  FIG. 3 is a diagram illustrating the configuration of the PC 14. The PC 14 is a so-called Neumann computer that performs signal processing in accordance with a program stored in advance in a ROM 76 that is a read-only memory while using a temporary storage function of a RAM 78 that is a read / write memory by a CPU 74 that is a central processing unit. There are home personal computers generally called desktop personal computers or notebook personal computers. Also, as shown in FIG. 3, a video display device 80 such as TFT or PDP that functions as a video display unit, and a video board 82 that is a video display control device for controlling display of video by the video display device 80, , An input device 88 such as a keyboard 84 and a mouse 86, an input interface 88 for processing input by these input devices, a modem 90 for connecting the CPU 74 and the like to the communication line 18, and a hard disk 92 as a storage device And is configured. The PC 14 is functionally equipped with a general application such as a browser (WWW browser) that displays information of a so-called WWW (World Wide Web) website and can perform various inputs according to the website. Is.

  FIG. 4 is a block diagram illustrating the configuration of the karaoke apparatus 36. As shown in FIG. 4, the karaoke device 36 includes a video display device 100 such as a TFT or PDP, a video output control unit 102 such as a video board that controls display of video by the video display device 100, and video information. A decoder 104, a video mixer 106, a synthesizer 108 as a sound source, a microphone 110 as an audio input device, an A / D converter 112 for converting audio input from the microphone 110 into a digital signal, and an amplifier mixer 114 A speaker 116, an operation panel 118, an input / output interface 120 that processes input signals from the operation panel 118, a video camera 122 that is an imaging device, a CPU 124 that is a central processing unit, and a read-only memory ROM 126, and a read / write memory as needed A RAM 128, a hard disk 130 as a storage device, a modem 132, a LAN port 134, and a remote control receiving unit 136 for receiving a remote control signal from an input device such as the electronic quick sample device 38 or the remote control device 98; It is prepared for.

  The video output control unit 102 functions as a character video output device that outputs a character video (telop) such as a lyric character video generated by the CPU 124, and also displays for controlling various video displays by the video display device 100. It is a control device. The video information decoder 104 is a background video playback device that plays back (decodes) a predetermined background video based on background video information stored in the hard disk 130 when a user sings while referring to lyrics. . The background video information is, for example, MPEG (Moving Picture Experts Group) format data, and the background video reproduced by the video information decoder 104 based on the MPEG data is sent to the video mixer 106. The video mixer 106 synthesizes the character video generated by the CPU 124 and output from the video output control unit 102 with the background video reproduced by the video information decoder 104 to the video display device 100. This is a video composition device to be displayed.

  The synthesizer 108 is a sound source that generates a music signal such as a musical instrument performance signal based on performance information of a karaoke performance song read from the hard disk 130 and sent. The performance information is, for example, data in MIDI (Musical Instrument Digital Interface) format, and the music signal generated by the synthesizer 108 based on the MIDI data is converted into an analog signal and sent to the amplifier mixer 114. The amplifier mixer 114 mixes the transmitted music signal and the singing voice of the user (player) input via the microphone 110, and those signals are electrically amplified and output from the speaker 116. The The A / D converter 112 converts voice information as an analog signal input from the microphone 110 as a voice input device into a digital signal and supplies the digital signal to the CPU 124 and the like.

  The operation panel 118 allows the user of the karaoke device 36 to select a karaoke performance song that the user wants to sing, adjust the pitch of the performance song, adjust the volume balance between the performance and the song, and perform other operations such as echo and volume. , An input device provided with operation buttons (switches) or knobs for performing various adjustments such as tone. The karaoke device 36 is provided with a remote control device 98 that functions as an input device for remotely executing a part of the functions of the operation panel 118, and the remote control receiving unit 136 is connected to the remote control device 98. A remote control signal to be transmitted is received and supplied to the CPU 124. In addition, the association (sticking) process between the karaoke device 36 and the electronic quick sample device 38 is also performed via the remote control receiving unit 136, and thus the electronic quick sample device associated with the karaoke device 36. Similarly, 38 functions as an input device. In the present embodiment, an input device such as the remote control device 98 provided in the karaoke device 36 or the electronic quick sample device 38 subjected to the association processing also constitutes a part of the karaoke device 36. The following will be described.

  The video camera 122 includes an imaging element such as a CCD (charge coupled device) and a lens, for example, so-called digital video that detects an image incident from the lens by the CCD and acquires the image as electronic information (image data). A camera that can shoot at least moving images (moving images that change over time), but can be configured to shoot still images (still photos) as needed Good. Video information photographed by the video camera 122 is supplied to the CPU 124 and the like via an interface such as a video terminal (not shown). For example, AVI (Audio-Video Interleaved) format, MPEG (Moving Picture Experts Group) format, FLV (FLV) Flash video) is stored in the RAM 54 or the like as a video file. The video camera 112 is not necessarily provided as a part of the karaoke device 36. For example, the video camera 112 is provided in a separate video camera or the mobile phone 16 fixed at a predetermined position in the private room 34. A mode is also conceivable in which an image captured by the image capturing apparatus or the like is input to the karaoke apparatus 36 via a predetermined interface.

  The CPU 124 is a so-called microcomputer that processes and controls electronic information based on a predetermined program stored in the ROM 126 while using the temporary storage function of the RAM 128, and executes various controls related to the karaoke device 36. To do. That is, when a predetermined karaoke performance song is selected by the electronic quick sample device 38, the remote control device 98, etc., the song selection reservation control for registering the selected karaoke performance song in the reserved song table provided in the RAM 128, Music data read control for reading performance information and lyrics information (music data) of the karaoke performance music selected from the hard disk 130 in the RAM 128 according to the performance order of the reserved music table, and as the performance of the karaoke performance music progresses Performance output control for transmitting performance information from the RAM 128 to the synthesizer 108, and a lyric character image generated based on the lyric information developed in the RAM 128 and transmitted to the video output control unit 102 during the performance output control In the output control and the performance output control, the video information deco Background image output control for controlling the background image 104 to reproduce a predetermined background image, inter-song information for outputting inter-song information such as new music information, music selection ranking, store advertisement, etc. while karaoke performance is not performed, that is, between songs In addition to basic control such as output control and information communication control with the server device 12 via the communication line 18, various controls such as synchronous performance control and performance recording control of this embodiment described later are performed. Run.

  The modem 132 is a device for connecting the karaoke device 36 to the communication line 18, converts a digital signal output from the CPU 124 into an analog signal and sends it to the communication line 18. The analog signal transmitted via the digital signal is converted into a digital signal and supplied to the CPU 124. In addition, the aspect by which any karaoke apparatus 36 is provided with the function of the said router 44 among the several karaoke apparatuses 36 with which the said store 32 was equipped, and is connected to the said communication line 18 as a master commander, In that case, The modem 132 is required for the karaoke device 36 that functions as the master commander, but is not necessarily provided for other karaoke devices 36 that communicate information with the server device 12 via the master commander. Not necessary.

  The LAN port 134 is a connector for connecting the karaoke device 36 to another device such as another karaoke device 36 or an electronic quick sample device 38 via the LAN 40, and the karaoke device 36 is By being connected via the LAN 40, information can be transmitted and received with other devices such as the other karaoke device 36 and the electronic quick sample device 38. For example, the music selection input from the electronic quick sample device 38 received via the access point 42 is received and stored in a reserved music table provided in the RAM 128, or the karaoke device 36 via the access point 42. Thus, mutual exchange of information between the karaoke device 36 and the electronic quick sample device 38 is executed via radio waves, such as transmitting predetermined information to the electronic quick sample device 38.

  The hard disk 130 is provided with various databases including a music database 138 (see FIG. 5) for storing a large number of music data (karaoke data) for outputting karaoke performance music. The music database 138 stores a large number (for example, tens of thousands of music data) of music data (karaoke data) corresponding to performance music that can be output by the karaoke device 36. The music data is based on performance information such as MIDI data for generating a performance sound of a predetermined instrument by the synthesizer 108, lyrics information for generating a lyrics character image (lyric telop), and the lyrics information. It includes lyrics color change information for sequentially changing the color of the generated lyric character video in accordance with the progress of the performance, and is identified by a music selection number unique to each performance song that is a content ID. The above song data includes the song title, artist name (singer name), date of announcement, album information (album entered at the time of sale), theme song information (theme song of anime and drama, etc.) Information on the anime or drama, etc.), the number of corresponding video information stored in the video database 68, key information, genre, song flag information such as A melody and B melody, lyrics and music composition Information indicating whether the song is duet music or not, and information such as music tone are stored in association with each other.

  The music database 72 provided in the server device 12 stores music data to be distributed to the karaoke device 36 provided in the karaoke system 30, and newly created music data is stored in the music database. 72. Of a plurality of karaoke devices 36 provided in a store 32 such as a karaoke box, a predetermined karaoke device 36, for example, the karaoke device 36a is connected to the communication line 18 via the modem 132, and the plurality of karaoke devices 36a. New music data and the like are distributed from the music database 72 of the server device 12 via the communication line 18 as needed so that new music can be played by the device 36 and is sent to the music database 138 of the hard disk 130 and the like. Remembered. In addition, communication is performed via the LAN 40 between the karaoke device 36 a that has acquired the information from the server device 12 and the other karaoke devices 36, and is stored in the hard disk 130 of each karaoke device 36. Information is shared, and the contents of the music database 138 and the like are equivalent.

  The moving image database 68 provided in the server device 12 includes a plurality of pieces of moving image information (videos) posted from the karaoke device 36 serving as a communication terminal device, the PC 14, the mobile phone 16, or the like, that is, uploaded via the communication line 18. Information). This moving image information is, for example, a moving image file (video file) in AVI (Audio-Video Interleaved) format, MPEG (Moving Picture Experts Group) format, FLV (Flash Video) format, etc., for example, a predetermined identification defined in the order of posting The number (content ID) is stored in the moving image database 68 as an index. The moving image information may include a so-called flip animation in which a plurality of still images are switched and displayed at a predetermined time interval, or a still image portion in which the video is temporarily stopped. Also, in the moving image database 68, the poster's identification information (user ID), the poster's name (nickname), the posting time (posting date), and the video set (input) by the contributor before and after the posting Title, contributor's comment, deletion password, playback count, post comment count, vote result from viewer (number of votes), corresponding performance song identification information (music selection number), song title, artist name, and performance Information such as evaluation results (scoring results) is stored in association with the moving image information for each moving image information.

  The moving image database 68 preferably includes a plurality of moving image information for applying a predetermined video effect (effect) to the moving image information when the moving image information stored in the moving image database 68 is output (reproduced). It includes a video effect database that stores video effect information. This video effect is, for example, for realizing a video effect in which a star image or a heart mark or the like jumps over a still image or a moving image corresponding to a frame displayed as an outer frame of a moving image to be applied, or a moving image to be applied. Still images or videos, filters for realizing video effects such as changing the video to be applied to sepia or monochrome (black and white), changing the contrast or brightness, and changing the video to be applied like an illustration To achieve image effects such as making a video effect such as making it look like a line drawing style or changing it like a mosaic, or making snow or flowers fall on the video to be applied, or wind or rain Video or filter, a still image or video for placing a stamp or a balloon on the video to be applied, a pen on the video to be applied Drawing means for enabling arbitrary drawing with an airbrush, filter for realizing a video effect that transforms the video to be applied as if viewed with a fisheye lens or wide-angle lens, and shooting the video to be applied with an instant camera Various modes are conceivable, such as a filter for realizing such a video effect and a filter for realizing a video effect that enables the background of a moving image to be applied to be changed to an arbitrary still image or moving image.

  Further, the user database 70 provided in the server device 12 stores information on the user of the moving picture information distribution system 10 of the present embodiment. For example, using each user's identification information (user ID) as an index, a password for using the video information distribution system 10, a name of the poster (nickname), date of birth, sex, address, e-mail address, telephone number , Information about blood types, constellations, avatars (humanoid images corresponding to users), questions and answers for forgotten passwords, video information browsing history, video information bookmarks, video information posted in the past Posting history, posting history of co-starring movie information posted in the past, and attribute information such as song age are stored in association with each user for each user. The song age is virtual age information indicating how much age (how many years) the user's preference of the music piece corresponds to, and the target user uses the karaoke device 16 It is a value determined based on a performance song that has been selected (played) in the past. Preferably, a performance song previously selected (played) by the target user is used as a reference for calculation, and the user's karaoke performance It is a value derived from the viewpoint of how much age the tendency corresponds to. In the present embodiment, a mode in which the moving image database 68 and the user database 70 are provided as separate databases will be described. However, they may be configured as a single database, for example, As information corresponding to each user stored in the user database 70, moving picture information posted by the user or co-starring moving picture information described later may be stored.

  The user database 70 stores information related to the karaoke system 30 of each user. For example, the store visit history, which is information on the store 32 corresponding to the karaoke device 36 used by each user in the past (the store 32 where the karaoke device 36 is installed), and each user in the karaoke performance by the karaoke device 36 is eighteenth. Information related to a performance song registered as a song (a performance song set so that a song selection input can be performed by a simple operation), a song selection history (in the karaoke device 36) that each user has previously selected in a karaoke performance by the karaoke device 36 Information on the performance music as a history of performance music selected in the past), information on evaluation results of performance evaluations performed in the past by each user in the karaoke performance by the karaoke device 36, and each user on the karaoke device 36 ( Request voting (input request) for newly input songs in the karaoke system 30) Information related to the performance music to be recorded, information about other users that each user has registered as friends, image information including each user's face photo, each user is described regarding a predetermined performance music, etc. The reviews entered and the points in the karaoke system 30 given to each user are stored in association with the identification information (user ID) of the user for each user. Yes. Preferably, in the music selection history that each user has selected in the karaoke performance by the karaoke device 36 in the past, the genre is classified based on the number of music played (the user sings the genre of the performance music well. A classification result obtained by ranking whether or not there is a genre is stored in the user database 70 for each user. In addition, in a present Example, the identification information and password which are common in the said moving image information delivery system 10 and the karaoke system 30 are used, and the information of each user regarding these moving image information delivery system 10 and the karaoke system 30 is shared. Although an aspect of storing in the database 70 will be described, an individual user database (customer database) may be provided corresponding to each of the moving image information distribution system 10 and the karaoke system 30, and those moving images may be provided. Individual identification information and a password may be set corresponding to each of the information distribution system 10 and the karaoke system 30.

  FIG. 5 is a functional block diagram illustrating a main part of control functions provided in the CPU 52 of the server device 12, the CPU 74 of the PC 14, or the CPU 124 of the karaoke device 36. In the example shown in FIG. 5, post acceptance control means 152, moving picture distribution control means 158, co-starring moving picture editing control means 164, and video effect control means 174 (performance evaluation control means 176) are sent to the CPU 52 of the server device 12 for performance. Recording control means 150, search control means 154, distribution request control means 156, video output control means 160, synchronous performance control means 162, and video effect setting means 170 are sent to CPU 124 of karaoke apparatus 36 by distribution request control means 166, video The output control means 168 and the video effect setting means 172 are respectively functionally provided in the CPU 74 of the PC 14. The distribution request control unit 166, the moving image output control unit 168, and the video effect setting unit 172 are preferably provided in the CPU of the mobile phone 16. The search control means 154, the distribution request control means 156, the moving image output control means 160, etc. are provided in the karaoke apparatus 36 (corresponding to each other) and constitute part of the electronic quick sample apparatus 38. A CPU may be provided.

  The moving picture information distribution system 10 according to the present embodiment accepts posting of moving picture information from each user by various control functions shown in FIG. 5, and posts acceptance control for distributing the posted moving picture information via the communication line 18. And video distribution control. In addition, regarding the posting acceptance control, the first posting acceptance control (first moving image posting control) and the second posting acceptance control (second moving image posting control) having different aspects are selectively executed. Has been. That is, in the first posting acceptance control, the posting (uploading) of moving image information from a communication terminal device such as the karaoke device 36 is received via the communication line 18, and the posted moving image information is stored in the moving image database 68. Perform accumulation processing. On the other hand, in the second posting acceptance control, for the moving picture information already accumulated in the moving picture database 68, the posting of moving picture information to be combined related to the co-starring moving picture (collaboration moving picture) is accepted, and the posted moving picture The information is stored in the moving image database 68 and is edited in combination with the co-starring moving image information. Hereinafter, the operation of each control function in each of the first posting acceptance control and the second posting acceptance control will be described individually.

  First, regarding the operations of the performance recording control means 150, the posting acceptance control means 152, the distribution request control means 156 and 166, and the moving picture distribution control means 158, which are common in the first posting acceptance control and the second posting acceptance control. explain. The performance recording control means 150 records video information captured by the video camera 122 as an imaging device and audio information input by the microphone 110 as an audio input device when the performance music is output by the karaoke device 36. . Preferably, the video information captured by the video camera 122 and the audio information input by the microphone 110 as an audio input device and converted into a digital signal by the A / D converter 112 are, for example, AVI format, MPEG It is integrated in a file format such as a format or FLV format and recorded as moving image information (moving image file) including video information and audio information. FIG. 6 exemplifies a first performance image 180 which is moving image information captured by the video camera 122 when the performance karaoke device 36 outputs the performance tune recorded by the performance recording control means 150. Each control unit shown in FIG. 5 may record, transmit / receive, or store video information and audio information as individual information (file), but in the present embodiment, they are integrated. A mode of recording, transmission / reception, storage, and the like as a moving image file will be described. That is, unless otherwise specified in the following description, the moving image information in the present embodiment includes video information and audio information corresponding to audio output at the time of reproduction.

  The posting acceptance control means 152 accepts posting of moving image information from a communication terminal device such as the karaoke device 36 via the communication line 18 and stores the posted moving image information in the moving image database 68. Preferably, posting of moving picture information (moving picture file) corresponding to video information and audio information recorded by the performance recording control means 150 when the karaoke apparatus 36 outputs a predetermined performance piece is accepted, and the target performance piece is played. It is stored in the moving image database 68 in association with the music selection number, which is the identification information of the (musical performance output when recording the video information and audio information), the identification information (user ID) of the user who is the subject of the posting, and the like.

  The distribution request control means 156 and 166 transmit a distribution request for predetermined moving image information stored in the moving image database 68 to the server device 12 via the communication line 18. The distribution request by such distribution request control means 156, 166 is, for example, accessed to a WWW website (so-called video posting site) managed by an information distribution service provider that operates the video information distribution system 10 to obtain video information. This is performed by selecting or inputting identification information (content ID). In other words, the distribution request control means 156, 166 can preferably display information on the WWW website that can be browsed via the communication line 18, and can perform various inputs according to the WWW website. This corresponds to one function in the WWW browser.

  When there is a distribution request from the communication terminal device such as the PC 14, the mobile phone 16, or the karaoke apparatus 36 by the distribution request control means 156, 166, the video distribution control means 158 responds to the distribution request. The moving image information related to the distribution request stored in the moving image database 68 is distributed to the requesting communication terminal device via the communication line 18. The moving image information distributed to each communication terminal device by the moving image distribution control unit 158 is displayed on the display unit (video display device) of the communication terminal device by the moving image output control units 160 and 168 described later.

  Next, the performance recording control means 150, the posting acceptance control means 152, the search control means 154, the distribution request control means 156, the moving picture distribution control means 158, the moving picture output control means 160, and the synchronous performance control means in the second posting acceptance control. The operations of 162 and the co-starring movie editing control means 164 will be described. The search control means 154 searches for a single or a plurality of performance songs that satisfy a predetermined condition from the large number of performance songs that can be output by the karaoke apparatus 36. For example, out of a large number of performance songs (music data) stored in the music database 138, based on conditions indicated by characters or character strings input via the electronic quick sample device 38, the remote control device 98, etc. Then, a song name search process for searching for one or a plurality of performance songs is executed. For example, performance music (music data) having a song name that at least partially matches the input character or character string is extracted from a large number of performance music stored in the music database 138. Preferably, characters or character strings input through the electronic quick sample device 38, the remote control device 98, etc., with respect to artist names (singer names) related to a large number of performance songs stored in the music database 138. The singer name search process for searching for one or more artist names is executed based on the condition indicated by. For example, an artist name that at least partially matches the input character or character string is extracted from artist names as attribute information of a number of performance songs stored in the song database 138.

  Further, the search control means 154 searches for a plurality of pieces of moving picture information satisfying a predetermined condition from a plurality of pieces of moving picture information stored in the moving picture database 68. Preferably, one or a plurality of pieces of moving picture information associated with the performance music searched by the music name search process are extracted from the plurality of moving picture information stored in the moving picture database 68. Preferably, one or more pieces of moving picture information associated with a performance song having the artist name searched by the singer name searching process as attribute information are extracted from the plurality of moving picture information stored in the moving picture database 68. . Preferably, one or more pieces of moving image information are searched based on a character or a character string input via the electronic quick sample device 38, the remote control device 98, or the like. For example, one or more pieces of moving picture information associated with the names (nicknames) of posters that at least partially match the input characters or character strings are extracted from the plurality of pieces of moving picture information stored in the moving picture database 68.

  The moving image output control unit 160 controls the output of the moving image information distributed by the moving image distribution control unit 158. That is, the moving image information downloaded from the server 12 via the communication line 18 is reproduced and displayed on the video display device 100. Here, in the karaoke apparatus 36, the video information decoder 104 may function as the moving image output control means 160. Further, the synchronous performance control means 162 outputs a performance tune associated with the moving picture information in synchronization with the output of the moving picture information by the moving picture output control means 160. For example, when the moving image output control means 160 outputs (reproduces) the target moving image information, the musical composition associated with the moving image information (the musical composition corresponding to the music selection number associated with the moving image database 68) ) Is read from the music database 138, and karaoke performance control corresponding to the music data is started in synchronization with (simultaneously) the output of the moving image information. The moving image information associated with the predetermined performance music is recorded by recording the video information taken by the video camera 122 when the performance recording control means 150 outputs the performance music, and is synchronized with the output of the video information. By performing karaoke performance control of the corresponding performance song, it is possible to realize a co-performance performance (collaboration performance) as if singing simultaneously with the singer of the video information.

  Preferably, the moving image output control means 160 outputs audio information included in the moving picture information when outputting the moving picture information associated with the performance music in synchronization with the output of the performance music by the synchronous performance control means 162. Is non-output or muted. In other words, only the video information is output in the video information including audio information. Note that the audio information does not necessarily have to be output, and the audio information of the corresponding video information may be output. The synchronized performance control means 162 is preferably synchronized with the moving image output when the performance information associated with the moving image information is output in synchronization with the output of the moving image information by the moving image output control means 160. Information is displayed on the video display device 100 as a background video in karaoke performance. For example, a performance tune associated with the first performance video 180 in synchronization with the output of the first performance video 180 shown in FIG. 6 described above (a performance tune output when recording the first performance video 180). In the case of outputting, as shown in FIG. 7, the lyrics character image 182 generated on the front side of the first performance image 180 reproduced by the moving image output control means 160 based on the lyrics information of the performance music to be output. Are combined by the video mixer 106 and displayed on the video display device 100. When the synchronized performance control means 162 outputs the performance song associated with the moving picture information in synchronization with the output of the moving picture information by the moving picture output control means 160, the lyric character video of the performance music is displayed. Instead, only the moving image information may be displayed on the video display device 100.

  The performance recording control unit 150 is an imaging device that performs synchronous performance control in which the synchronized performance control unit 162 outputs a performance tune associated with the moving image information in synchronization with the output of the moving image information by the moving image output control unit 160. Video information captured by the video camera 122 and audio information input by the microphone 110 which is an audio input device are recorded. Preferably, moving image information captured by the video camera 122 and audio information input by the microphone 110 as an audio input device and converted into a digital signal by the A / D converter 112 are, for example, AVI format, MPEG It is integrated in a file format such as a format or FLV format and recorded as moving image information (moving image file) including video information and audio information.

  The posting acceptance control means 152 accepts posting of moving picture information corresponding to the video information and audio information recorded by the performance recording control means 150 when the predetermined performance tune is output by the synchronous performance control means 162 and is targeted. Associate with identification information of performance music (performance music output by synchronized performance control means 162), identification information (user ID) of user who is the main subject of posting, and identification information (content ID) of moving picture information related to co-star performance And stored in the moving image database 68.

  The co-star video editing control unit 164 edits the co-star video information by combining a plurality of video information received by the posting reception control unit 152, and stores the edited co-star video information in the video database 68. Preferably, the co-star video information is edited by combining a plurality of pieces of video information associated with a common musical piece accepted by the posting acceptance control means 152, and the edited co-star video information is used as identification information for the musical piece. It is stored in the moving image database 68 in association with (content ID). This co-starring movie information is information for outputting (preferably a pair) of movie information related to the above combination in synchronization (simultaneously), and preferably each of the movie database 68 individually ( It corresponds to combination information for reading a plurality of pieces of moving image information related to the stored combination (as independent moving image files) and synchronously outputting the moving image information as a co-star video. Preferably, the attribute information of the co-starring video information includes the identification information (music selection number) of the target performance song, the song title of the performance song, the artist name, the performance time, and the contributor of each video information related to the combination. Co-starring video information for which identification information (user ID), name of each contributor (nickname), comment of each contributor, title of co-starring video, performance evaluation result (scoring result) corresponding to each video information, etc. It is associated and stored in the moving image database 68. In other words, the co-starring video editing control means 164 preferably has a second post posted later on the first performance video 180 which is the first video information previously posted by the posting acceptance control means 152. The co-starring moving picture information is edited by combining the second performance video 184 (see FIG. 8 and the like) that is the moving picture information.

  In response to a distribution request from a communication terminal device such as the PC 14 or the mobile phone 16 via the communication line 18, the moving image distribution control means 158 is a co-starred moving image related to the distribution request stored in the moving image database 68. Information is distributed to the communication terminal device. Preferably, a plurality of video information to be combined with the co-star video information is read from the video database 68 before and after the distribution of the co-star video information, and the communication terminal that is the distribution request source together with the co-star video information Deliver to the device. A plurality of pieces of moving image information related to the co-starring moving image information distributed by the moving image distribution control unit 158 is displayed on the display unit (video display device) of the communication terminal device by the moving image output control units 160 and 168 provided in each communication terminal device. Is displayed.

  The moving image output control unit 168 controls the output of the moving image information distributed by the moving image distribution control unit 158. That is, the moving image information downloaded from the server 12 via the communication line 18 is reproduced and displayed on the video display device 80. Here, the moving image output control means 168 provided in the CPU 74 of the PC 14 preferably allows the moving image information distributed by the moving image distribution control means 158 to be output (reproduced) on a WWW browser, For example, various moving image playback software (plug-in) such as an MPEG decoder or a flash player is appropriately used depending on the format of the moving image file.

  FIG. 8 is a diagram illustrating an example of the co-star video 186 displayed on the communication terminal device such as the PC 14 or the mobile phone 16. In this co-star video 186, the first performance video 180 shown in FIG. 6 described above and the video output control means 160 and the synchronous performance control means 162 were executed in synchronization with the output of the first performance video 180. In this example, the second performance video 184 recorded by the performance recording control means 150 is output synchronously (simultaneously) on a predetermined WWW website when a karaoke performance is output. The WWW website shown in FIG. 8 corresponds to, for example, a so-called moving image posting site managed by an information distribution service provider that operates the moving image information distribution system 10. It can be viewed on a communication terminal device such as a mobile phone 16. On this WWW website, the names and artist names of common performance songs related to the output co-star video are displayed, and a play / stop button 188, a cue button 190, a playback position determination knob 192, and a volume setting knob. 194 and a display switching button 196 for switching between full-screen display and same-size display on the display screen are displayed, and various operations relating to the output of the co-star video can be performed by each button or knob. In addition, a non-display button 198 is displayed corresponding to each piece of moving image information, and by pressing the non-display button 198, one of the two pieces of moving image information related to the co-star video can be hidden. ing.

  When the WWW website shown in FIG. 8 is displayed on the WWW browser in the communication terminal device such as the PC 14, the mobile phone 16, and the karaoke device 36, playback / stop on the WWW website is performed by the operation unit of each communication terminal device. When an operation such as pressing the button 188 is performed, output of the co-star video 186, that is, synchronous output of the first performance video 180 and the second performance video 184 is started. In the output of the co-star video 186, the first performance video 180 and the second performance video 184 are reproduced in synchronization with each other and are included in the first performance video 180 and the second performance video 184, respectively. Audio information is also output in synchronization. Regarding the output of the audio information, the audio information corresponding to the first performance video 180 is output from the left speaker, while the audio information corresponding to the second performance video 184 is output from the right speaker. Control may be performed, or the audio information may be synthesized and output in stereo. In this way, a plurality of video information related to the combination of the co-star video information and the audio information thereof are output in synchronism, so that the co-star video (collaboration video as if the performers of each video information are playing simultaneously) ) Can be output.

  The video effect setting means 170 and 172 shown in FIG. 5 stores at least one video effect selected from a plurality of video effects predetermined in the video effect database included in the video database 68 in the video database 68. Set in correspondence with each stored moving image information. The video effect control unit 174 performs control to apply the video effect set corresponding to the moving image information when the moving image output control units 160 and 168 output (reproduce) the moving image information. That is, display control is performed such that the video effect is additionally displayed on a part of the moving image corresponding to the moving image information to be applied, and a predetermined filter is applied to the moving image information to be applied. The video effect mutual application control described in detail below is preferably executed when the co-star video is output on the PC 14 or the like when the co-star video is distributed. In posting acceptance control, when the karaoke device 36 outputs the moving image information of the first contributor, and performing the performance or recording related to the second moving image information while viewing the moving image information, It may be executed in such a manner that the moving image information is reflected on the second moving image information in real time. Further, the video effect control means 174 includes performance evaluation control means 176 for performing performance evaluation of audio information included in each of a pair of moving picture information related to the combination of the co-starring moving picture information with respect to the display control. The control of the video effect setting means 170 and 172 and the video effect control means 174 (performance evaluation control means 176) will be described below with reference to FIGS.

  Preferably, the video effect setting means 170 and 172 set the video effect for the moving picture information related to the output when the moving picture output control means 160 and 168 outputs the moving picture information stored in the moving picture database 68. To do. For example, before and after the output (playback) of the target video information on a WWW browser or the like, a plurality of video effects predetermined in the video effect database can be obtained by a predetermined input operation via the WWW browser or the like. At least one video effect selected from among them is set corresponding to the moving image information to be the target. Here, the video effect determined in the video effect database may be determined to be applied continuously from the start of output of the target video information to the end of output, but the target video information Application start timing or application end timing may be set within the reproduction time. In such an aspect, the video effect setting means 170 and 172 preferably apply the video effect application start timing within the playback time of the target moving picture information through a predetermined input operation via the WWW browser or the like. Set the application end timing. If the video effect is a speech balloon, the relative position of the speech balloon in the entire target video information (the entire screen corresponding to the video) is set, or text information or freedraw (free It is also possible to perform control such as accepting writing by drawing. The setting of the video effect by the video effect setting means 170 and 172 may be executed only by the poster of the target video information, or any user (for example, the video by the PC 14). It may be made executable by (browser). Furthermore, in the first video posting control or the second video posting control, it is possible to set the video effect only when the video information is posted from the karaoke device 16 (upload to the server device 12). It may be.

  The video effect control unit 174 applies the video effect set in the video database 68 corresponding to the video information when the video information is output (reproduced) by the video output control units 160 and 168. For example, when the video effect is a still image or a moving image, display control is performed to synthesize the still image or the moving image on the front layer of the moving image information to be applied. Further, when the video effect is a predetermined filter, image processing for applying the filter to the moving image information related to the output is performed. In addition, when a video effect application start timing or application end timing is set, application of the video effect starts at the application start timing within the playback time of the moving image information to be applied, and at the application end timing The application of the video effect is terminated. When the relative position of the video effect in the entire moving image information to be applied is set, the video effect is applied to the relative position. Further, when free draw or the like is additionally stored, the free draw or the like is also displayed along with the applied video effect. FIG. 9 is a diagram illustrating an image obtained by applying a frame 200 imitating a plant leaf, which is an example of the image effect, to the first performance image 180 illustrated in FIG. 6. As shown in FIG. 9, the video effect control means 174, for example, displays a still image corresponding to the video effect stored in the video effect database, that is, a partial video imitating a plant leaf in the example shown in FIG. The image effect is obtained by reading out the image information provided in the shape (frame shape) and the other part being transparent, and synthesizing it on the front side of the target moving image information (moving image displayed on the image display device). Apply.

  The video effect control means 174 corresponds to the video effect set by the video effect setting means 170 and 172 when the video output control means 160 and 168 outputs the pair of moving picture information synchronously, that is, when a co-star video is output. The same or another video effect that reflects the video effect is applied to the other video information related to the combination with the video information as well as the video information. FIG. 10 is a diagram exemplifying how the video effect set corresponding to one video information is reflected in the other video information in the co-star video 186 shown in FIG. In the example shown in FIG. 10, when the frame 200 illustrated using FIG. 9 is applied corresponding to the first performance video 180 related to the combination of the co-starring videos 186, the frame 200 is reflected. The frame 202 which is the video effect to be applied is shown applied to the second performance video 184. This frame 202 may be the same video effect as the frame 200 applied to the first performance video 180, or may be another video effect such as a frame of a different color from the frame 202. In other words, the video effect control means 174 is a co-star video in combination with the first performance video 180, even if no video effect is set corresponding to the second performance video 184 in the video database 68. When output as 186, the frame 202 reflecting the frame 200, which is the video effect set corresponding to the first performance video 180, is applied to the second performance video 184. Further, even when some video effect is set in the second performance video 184, when it is output as the co-star video 186 in combination with the first performance video 180, the first performance video 184 is displayed. The frame 202 reflecting the frame 200 that is the video effect set corresponding to the video 180 may be applied to the second performance video 184 with priority (alternative). As shown in FIG. 10, in the co-star video 186 to which the video effect is applied, the non-display button 198 or the like displayed in the co-star video 186 to which the video effect is not applied is preferably deleted (the following description) The same).

  Preferably, the video effect control means 174 is posted first among the pair of video information when the video output control means 160, 168 outputs the pair of video information synchronously, that is, when the co-star video is output. The same or other video effects that reflect the video effects set by the video effect setting means 170 and 172 corresponding to the video information are reflected in the video information posted later. That is, in the above-described co-star video 186 shown in FIG. 8, the first performance video 180 corresponds to the video information posted first, that is, the first video information, and the second performance video 184 is posted later. In order to correspond to the moving image information, that is, the second moving image information, as described above with reference to FIG. 10, no video effect is set in the moving image database 68 corresponding to the second performance image 184. When the first performance video 180 is output as a co-star video 186 in combination with the first performance video 180, a frame 202 reflecting the frame 200 that is a video effect set corresponding to the first performance video 180 is displayed. This is applied to the second performance image 184.

  The video effect control means 174 is preferably set by the video effect setting means 170 and 172 when the video output control means 160 and 168 outputs the pair of video information synchronously, that is, when the co-starring video is output. The video effect is applied to the corresponding video information, and the video effect is reflected in the other video information related to the combination with the video information and based on the gender of the user who is the posting subject of the other video information. Apply the determined video effect. FIG. 11 shows how the video effect set corresponding to one video information is reflected in the other video information in the co-star video 206 related to the combination of the first performance video 180 and the third performance video 204. FIG. Here, the third performance video 204 is video information posted after the first performance video 180, and corresponds to second video information. The case where the poster of the first performance video 180 is a male and the poster of the third performance video 204 is a female will be described. In the example shown in FIG. 11, as a video effect that reflects the frame 200 corresponding to the first performance video 180 and is determined based on the woman who is the gender of the poster of the third performance video 204, A frame 208 in which a partial image simulating a pattern is provided in a rectangular shape (frame shape) and the remaining portion is transparent is applied to the third performance image 204. For example, when the contributor of the second performance video 184 related to the combination is a man like the co-star video 186, the video effect control means 174, as shown in FIG. A frame 202 that is the same as or different from the frame 200 applied to 180 and is similar to a plant leaf is applied to the second performance image 184, while the third performance related to the combination as the co-performance image 206 is applied. When the contributor of the performance video 204 is a woman, as shown in FIG. 11, it corresponds to a frame (the same type of video effect) as in the frame 200 applied to the first performance video 180. A frame 208 that is a video effect and imitates a floral pattern common to the concept of plants is applied to the third performance video 204.

  FIG. 12 shows that in the co-starring video 206 related to the combination of the first performance video 180 and the third performance video 204, the video effect set corresponding to one video information is reflected in the other video information. It is a figure which shows an example. In the example shown in FIG. 12, an image effect 210 in which autumn leaves fall corresponding to the first performance image 180 is set, and the image effect 210 is set by the image effect control means 174. This is applied to the performance image 180. In addition, corresponding to the third performance image 204, the image effect that reflects the image effect 210 and that is determined based on the woman who is the gender of the poster of the third performance image 204, dances the heart. 212 is applied to the third performance image 204. The video effect 210 in which the autumn leaves fall and the video effect 212 in which the heart dances are different, while the partial images that move relatively within the moving image are different between the autumn leaves and the heart, while the partial image moves relatively within the moving image to be applied. This is common in that it is a video effect. As described above with reference to FIGS. 11 and 12, in other words, the video effect control unit 174, when the video output control units 160 and 168 synchronously output the pair of video information, When the video effect applied to the information is applied to the other video information, the video effect applied to the other video information is changed based on the gender of the user who is the posting subject of the other video information. Select different video effects for women).

  In order to realize the control as described above, in the video effect database included in the moving image database 68, preferably, a sex (convenient gender of the video effect itself) is determined corresponding to each video effect. ing. Preferably, for a plurality of video effects stored in the video effect database, a pair of video effects are defined in advance, reflecting the video effect applied to one video information and gender. The video effect determined based on the video is determined uniformly. For example, the frame 200 (corresponding to a male) and the frame 208 (corresponding to a female) are taken as a pair of video effects, and the video effect 210 (corresponding to a male) and the video effect 212 (corresponding to a female) are combined. A pair of men and women is stored in the video effect database. Alternatively, the sexes are defined according to the video effects stored in the video effect database, and are grouped for each video effect type, such as a frame group or a fall video group, for example. The video effect control unit 174 applies the video effect applied to one video information to the other video information when the video output control units 160 and 168 synchronously output the pair of video information. A video effect corresponding to the gender of the user who is the main subject of posting the video information of the other and applying a video effect randomly determined from video effects belonging to the same group to the other video information It may be.

  The video effect control means 174 preferably corresponds to the video effect set by the video effect setting means 170 and 172 when the pair of moving picture information is synchronously output by the moving picture output control means 160 and 168. Applied to the moving image information, and the user who is the subject of posting the other moving image information in the past reflects the video effect on the other moving image information related to the combination with the moving image information. A video effect determined based on the music data performed is applied. More preferably, the video effect determined based on the genre of the music data that the user who is the main subject of the other video information performed by the karaoke device 36 in the past is applied.

  FIG. 13 is a diagram showing another example of how the video effect set corresponding to one video information is reflected in the other video information in the co-star video 186 shown in FIG. In the example shown in FIG. 13, when the frame 200 illustrated using FIG. 9 is applied corresponding to the first performance video 180 related to the combination of the co-starring videos 186, the frame 200 is reflected. This shows a state in which the frame 214 which is the video effect to be applied is applied to the second performance video 184. The frame 214 is a video effect corresponding to the genre “techno”, but is common to the frame 200 in that the type is a frame. When the contributor of the second performance video 184 performed in the past with the karaoke device 36 is “techno” in the genre of music data, that is, the user database corresponding to the contributor. In the case where the genre with the largest number of music selections in the past stored in 70 is “Techno”, the first performance video 180 related to the combination of the co-starring videos 186 includes the frame 200 illustrated using FIG. 9. When applied, the frame 214 reflecting the frame 200 and determined based on the genre “techno” is applied to the second performance video 184. In order to realize the control as described above, in the video effect database included in the moving image database 68, preferably, at least one genre (a convenient genre of the video effect itself) is determined corresponding to each video effect. It has been. That is, a video effect that reflects one video effect and is determined based on the genre can be selected.

  The performance evaluation control means 176 shown in FIG. 5 corresponds to the audio information included in each of the pair of moving image information relating to the combination of the co-starring moving image information, based on the common music data from a predetermined relationship. Performance evaluation of the audio information is performed for each video information. For example, the audio information included in each video information and the performance information (MIDI data) of performance music corresponding to the common music data read from the music database 138, that is, the audio information (singing), are compared in time series. In addition, scoring is performed on the basis of a relative shift between a basic pitch such as a melody and a pitch extracted from voice information included in each moving picture information, an absolute volume of the voice, or the like. This scoring is preferably executed periodically at predetermined intervals (for example, every time a certain time elapses) from the start to the end of the performance of the target performance piece. In addition, as a mode of this scoring, for example, scoring may be performed numerically, such as how many points out of a thousand points, or acceptable (evaluation is equal to or higher than a predetermined threshold) or impossible (evaluation is not possible). It may be as simple as determining which one falls below a predetermined threshold value). The performance evaluation by the performance evaluation control unit 176 does not necessarily have to be performed in real time when the video effect control unit 174 applies or controls the display of the video effect, and the performance performed prior to such control is not necessarily performed. The evaluation result may be stored, and the performance evaluation result may be read out and used in the application or display control of the video effect.

  The video effect control means 174 preferably corresponds to each of the pair of moving picture information by the performance evaluation control means 176 when the pair of moving picture information is synchronously output by the moving picture output control means 160 and 168. The aspect of the video effect applied to each moving picture information is changed based on the performance evaluation result to be performed. More preferably, with respect to the video effect in a form that operates relative to the moving image information to be applied, each video is based on the performance evaluation result corresponding to each of the pair of moving image information by the performance evaluation control means 176. Control the behavior of the effect. For example, in the co-star video 206 as shown in FIG. 12 described above, the number of partial videos (video effects) in each of the video effects 210 and 212 applied to each video information based on the performance evaluation result corresponding to each video information. In 210, the number of autumn leaves is increased, and in the video effect 212, the number of heart marks is increased or decreased. Preferably, the higher the performance evaluation result, the greater the number of partial images. Or, with respect to the video effect that snow falls in the moving image information to be applied, while the performance evaluation result is lower, the snow is blown, while when the performance evaluation result is equal to or greater than a predetermined threshold, the snow is stopped and cleared. Is also possible.

  The video effect control means 174 preferably corresponds to each of the pair of moving picture information by the performance evaluation control means 176 when the pair of moving picture information is synchronously output by the moving picture output control means 160 and 168. Based on the performance evaluation result, the video effect applied to each piece of moving picture information is controlled to operate in conjunction with each other. FIGS. 14 and 15 show the moving picture information based on the performance evaluation result corresponding to each of the pair of moving picture information in the co-starring picture 206 related to the combination of the first performance picture 180 and the third performance picture 204. It is a figure which illustrates a mode that the video effect applied to is operate | moving in conjunction. In such an example, as shown in FIG. 14, the first performance image 180 and the third performance image 204 are divided into heart-segmented images 216a and 216b (hereinafter simply referred to as a fragmented image 216 unless otherwise distinguished). ) Are displayed, and on the basis of the performance evaluation result corresponding to each moving image information, the fragmented video 216 rises toward the center (the paired moving image information side), and the fragmented image 216 corresponding to both pieces of moving image information. Illustrates the video effect that completes the heart mark by completely getting up. FIG. 15 shows a state in which a fragmented image 216a corresponding to the first performance image 180 is completely raised while a fragmented image 216b corresponding to the third performance image 204 is not completely awakened. By such control, it is as if the video information is based on the performance evaluation results corresponding to the first performance video 180 and the third performance video 204, which are a pair of video information related to the combination of the co-star videos 206, respectively. It is possible to achieve a video effect that works together to form a single image.

  Further, the video effect control means 174 preferably has a well-known luminance for a partial video in a moving image to be applied when the moving image output control means 160 and 168 outputs the pair of moving image information synchronously. And a motion effect (fantasy effect) that follows the video effect based on the analysis result is displayed in conjunction with the pair of moving image information. FIG. 16 shows that in the co-starred video 206 related to the combination of the first performance video 180 and the third performance video 204, the video effect set corresponding to one video information is reflected in the other video information. It is a figure which shows another example. In the example shown in FIG. 16, in correspondence with the first performance image 180, an image in which star marks are scattered following the user's hand shaking (moving the arm part relatively) in the moving image. When the effect 218 is applied, a mode is shown in which the video effect 218 is spread to the third performance video 204 side related to the combination of the co-starring videos 206. With this control, when the synchronized output of the co-star video 206 is controlled, an organic sense of unity can be given to the first performance video 180 and the third performance video 204 related to the combination of the co-star videos 206.

  FIG. 17 is a flowchart for explaining a main part of the first moving image posting control by the CPU 124 of the karaoke apparatus 36, which is repeatedly executed at a predetermined cycle.

  First, in step (hereinafter, step is omitted) SA1, recording of video information taken by the video camera 122 and audio information inputted by the microphone 110 at the time of performance video shooting, that is, output of a performance tune by the karaoke device 36. It is determined whether or not has been started. If the determination at SA1 is negative, the routine is terminated accordingly. If the determination at SA1 is affirmative, at SA2, the music data to be subjected to performance video shooting is stored in the music database 138. Karaoke performance control based on the music data is started. Next, in SA3, recording processing of video information photographed by the video camera 122 and audio information inputted by the microphone 110 is executed.

  Next, in SA4, it is determined whether or not the karaoke performance is over. When the determination at SA4 is negative, the processing after SA3 is executed again. When the determination at SA4 is positive, the video information and audio information recorded at SA3 are handled at SA5. It is determined whether or not the moving image to be viewed is to be performed. When the determination at SA5 is negative, the processing after SA8 is executed. When the determination at SA5 is positive, at SA6, the video information and audio information recorded at SA3 are handled. The moving image is reproduced by the video information decoder 104 or the like and displayed on the video display device 100.

  Next, in SA7, it is determined whether or not the reproduction of the moving image corresponding to the video information and audio information recorded in SA3 has ended. When the determination at SA7 is negative, the processing after SA6 is executed again. When the determination at SA7 is affirmative, the video information and audio information recorded at SA3 are handled at SA8. It is determined whether or not video information to be posted is to be posted. If the determination at SA8 is negative, the routine is terminated accordingly. If the determination at SA8 is affirmative, at SA9, the routine corresponds to the video information and audio information recorded at SA3. The video information is uploaded to the host device, that is, the server device 12 in association with the identification information (user ID) of the user who is the posting subject and the identification information (music selection number) of the performance song output at SA2. This routine is terminated.

  FIG. 18 is a flowchart for explaining a main part of the second moving image posting control by the CPU 124 of the karaoke apparatus 36, and is repeatedly executed at a predetermined cycle.

  First, in SB1, it is determined whether or not a search process for collaborative video search, that is, posting of co-star video information is started. If the determination of SB1 is negative, the routine is terminated accordingly. If the determination of SB1 is affirmative, in SB2, the song title, singer name, On the basis of the name (nickname) of the user who will be the co-starring partner, a single or a plurality of pieces of moving image information (collaboration partner candidates) satisfying the conditions are searched from the plurality of moving image information stored in the moving image database 68. Next, in SB3, the video display device 100 can select thumbnails of users (moving image information) recruiting co-starring partners (collaboration partners) corresponding to the moving image information searched in SB2. Is displayed.

  Next, in SB4, it is determined whether or not an operation for selecting any of the thumbnails displayed in SB3 has been performed by the electronic quick sample device 38 or the like. When the determination at SB4 is negative, the processing after SB3 is executed again. When the determination at SB4 is affirmative, at SB5, the video information (performance video) corresponding to the selected thumbnail is displayed. Is downloaded from the server device 12. Next, in SB6, it is determined whether or not the video downloaded in SB5 is to be viewed. If the determination at SB6 is negative, the processing from SB9 is executed. If the determination at SB6 is affirmative, at SB7, the video of the co-starring performance partner downloaded at SB5 is the video. It is reproduced by the information decoder 104 and displayed on the video display device 100. Next, in SB8, it is determined whether or not the reproduction of the co-starring partner's moving image has ended. When the determination at SB8 is negative, the processing after SB7 is executed again. However, when the determination at SB8 is affirmative, at SB9, the recording of the video related to the collaboration performance video, that is, the co-star video information ( It is determined whether or not (shooting) is started. If the determination at SB9 is negative, the processes after SB6 are executed again. However, if the determination at SB9 is affirmative, the collaboration performance moving image posting process shown in FIG. 19 is executed at SBS. Thereafter, this routine is terminated.

  FIG. 19 is a flowchart for explaining a main part of the collaboration performance moving image posting control in the control shown in FIG. First, in SBS 1, the video information decoder 104 or the like starts reproduction of the video of the partner of the co-starring performance (collaboration partner), and the karaoke of the performance song associated with the video, that is, the common performance song related to the co-star video information The performance starts. Next, in the SBS 2, recording processing of video information photographed by the video camera 122 and audio information input by the microphone 110 is executed. Next, in SBS3, it is determined whether or not the karaoke performance is over. When the determination of SBS3 is denied, the processing after SBS2 is executed again. However, when the determination of SBS3 is affirmed, recording is performed at SBS4 with the collaborative video, that is, the moving image of the co-starring partner and SBS2. It is determined whether or not the synchronized output video with the moving image is viewed. If the determination of SBS4 is denied, the processing from SBS7 is executed. If the determination of SBS4 is affirmed, it is recorded in SBS5 in the collaboration video, that is, the co-starring partner's video and SBS2. The video output synchronized with the moving image is reproduced by the video information decoder 104 and displayed on the video display device 100.

  Next, in SBS6, it is determined whether or not the reproduction of the collaboration video has been completed. When the determination of SBS6 is denied, the processing after SBS5 is executed again. However, when the determination of SBS6 is affirmed, a moving image recorded (captured) at SBS2 is posted at SBS7. It is determined whether or not. If the determination of SBS7 is negative, the routine is terminated accordingly. If the determination of SBS7 is affirmative, SBS8 corresponds to the video information and audio information recorded in SBS2. The server in which the video is associated with the identification information (user ID) of the user who is the posting subject, the identification information of the video information that is the co-starring partner, and the identification information (music selection number) of the performance song output at SBS1 The data is uploaded to the apparatus 12 and returned to the main routine shown in FIG.

  FIG. 20 is a flowchart for explaining a main part of the moving image posting acceptance control by the CPU 52 of the server device 12, and is repeatedly executed at a predetermined cycle.

  First, in SC1, it is determined whether or not predetermined moving image information (moving image file) has been uploaded via the communication line 18 from a communication terminal device such as the karaoke device 36 or the like. If the determination at SC1 is negative, the routine is terminated accordingly. If the determination at SC1 is affirmative, at SC2, the uploaded video information is identified as the posting subject. The information is stored in the moving image database 68 in association with information (user ID), identification information (music selection number), etc. Next, in SC3, it is determined whether or not the uploaded moving image information is moving image information to be a combination target related to the collaboration moving image, that is, the co-starring moving image information. If the determination at SC3 is negative, this routine is terminated. If the determination at SC3 is affirmative, at SC4, the uploaded video information and the video information that is its co-starring partner are displayed. Based on this, the collaborative video, that is, the co-starring video information as the combination information for outputting the videos synchronously is edited, the identification information of each video information related to the combination, the identification of the user who is the posting subject of each video information After being stored in the moving image database 68 in association with information (user ID), common performance music identification information (music selection number), etc., this routine is terminated.

  FIG. 21 is a flowchart for explaining a main part of the video effect setting control by the CPU 124 of the karaoke apparatus 36 or the CPU 74 of the PC 14 and is repeatedly executed at a predetermined cycle.

  First, in SD1, a predetermined moving image or co-starring moving image is distributed by the electronic quick sample apparatus 38, the mouse 86, etc. on the WWW website (moving image posting site) for browsing moving image information stored in the moving image database 68. It is determined whether or not an operation for requesting has been performed. If the determination at SD1 is negative, the routine is terminated accordingly. If the determination at SD1 is affirmative, a distribution request for a moving image or a co-starring moving image related to the operation is issued at SD2. 18 to the server device 12. Next, in SD3, on the video display device 100 via the video information decoder 104 based on the video information or the co-starring video information related to the delivery request delivered from the server device 12 via the communication line 18. Alternatively, a moving image or a co-starring moving image is displayed on the video display device 80 via the video board 82 or the like. Next, in SD4, an operation for setting a predetermined video effect is performed by the electronic quick sample apparatus 38, the mouse 86, etc. on the WWW website for browsing the moving picture information stored in the moving picture database 68. It is determined whether or not. When the determination of SD4 is negative, the processing after SD6 is executed, but when the determination of SD4 is affirmative, in SD5, the video effect related to the operation corresponding to the output moving image. Whether or not the output of the moving image or the co-starring moving image ends (reproduction end) in SD6 after the information for setting the video is associated with the moving image information and transmitted to the server device 12 via the communication line 18. Is judged. When the determination at SD6 is negative, the processing after SD4 is executed again. When the determination at SD6 is affirmative, the routine is terminated.

  FIG. 22 is a flowchart for explaining a main part of the moving image distribution / video effect control by the CPU 52 of the server device 12, and is repeatedly executed at a predetermined cycle.

  First, in SE1, it is determined whether there is a request for distribution of predetermined moving image information (moving image file) or co-starring moving image information from the communication terminal device such as the PC 14, the mobile phone 16, and the karaoke device 36 via the communication line 18. Is done. If the determination at SE1 is negative, the routine is terminated accordingly. If the determination at SE1 is affirmative, at SE2, the video information requested for distribution is changed to collaboration video, that is, co-star video information. It is determined whether or not the video information is a target of such combination. When the determination of SE2 is negative, in SE3, the moving image information related to the distribution request stored in the moving image database 68 in response to the distribution request from the communication terminal device via the communication line 18 Is distributed to the requesting communication terminal device, this routine is terminated. However, if the determination in SE2 is affirmative, processing from SE4 onward is executed.

  In SE4, in the effect mutual application mode, that is, in the output of the co-star movie, it is determined whether or not the video effect (effect) set corresponding to one movie is reflected in the other movie. If the determination in SE4 is negative, in SE5, the moving image information related to the distribution request stored in the moving image database 68 in response to the distribution request from the communication terminal device via the communication line 18 And the co-starring video information is distributed to the requesting communication terminal device, the routine is terminated. If the determination in SE4 is affirmative, the communication via the communication line 18 is performed in SE6. In response to the distribution request from the terminal device, the moving image information and the co-starring moving image information related to the distribution request stored in the moving image database 68 are distributed to the requesting communication terminal device, and 1 relating to the combination of the co-starring moving image information Synchronous output of the video information of the pair is started.

  Next, in SE7, the characteristic portion in each of the pair of moving images in the co-starring moving image related to the output, that is, a predetermined partial image is analyzed by an image analysis method based on well-known luminance or the like. Next, in SE8, it is determined whether or not it is a performance evaluation timing corresponding to a predetermined section. If the determination at SE8 is negative, the processing from SE7 onward is executed again. If the determination at SE8 is affirmative, at SE9, a pair of moving image information relating to the combination of the co-starring moving image information. Corresponding to the audio information included in each of them, performance evaluation of the audio information is executed for each moving image information based on common music data from a predetermined relationship. Next, in SE10, the video effect set corresponding to the previously posted video information of the pair of video information related to the combination of the co-starring video information is applied to the video information, and the video effect is The process of applying the same or other video effects that are determined based on the gender of the poster of the video information that has been reflected and later posted, the genre of the performance song selected in the past, etc. The information for displaying the video effect is distributed to the communication terminal device via the communication line 18. When the applied video effect is a motion effect, the operation of the video effect is controlled based on the analysis result of SE7.

  Next, in SE11, based on the performance evaluation result corresponding to each of the pair of moving image information performed in SE9, processing for changing the mode of the video effect applied to each moving image information is performed, and the video Information for displaying the effect is distributed to the communication terminal device via the communication line 18. Next, in SE12, it is determined whether or not the performance has ended, that is, the synchronous output of a pair of moving image information relating to the combination of the co-starring moving image information has ended. If the determination in SE12 is negative, the processing from SE7 onward is executed again. If the determination in SE12 is positive, in SE13, a pair of moving image information relating to the combination of the co-starring moving image information. The synchronous output is terminated, and this routine is terminated accordingly.

  17 to 22, SA3 and SBS2 are operations of the performance recording control means 150, SC1 to SC4 are operations of the posting acceptance control means 152, and SB2 is operations of the search control means 154. , SB5 is the operation of the distribution request control unit 156, SE3, SE5, and SE6 are the operation of the moving image distribution control unit 158, SA6, SB7, SBS1, and SBS5 are the operation of the moving image output control unit 160, SBS1 Is the operation of the synchronized performance control means 162, SC4 is the operation of the co-starring video editing control means 164, SD1 is the operation of the distribution request control means 156, 166, and SD3 is the operation of the video output control means 160, 168. SD4 and SD5 are the operations of the video effect setting means 170 and 172, and SE7 to SE12 are the video effect control. The operation of the stage 174, the SE9 operation of the performance evaluation control unit 176, respectively corresponding.

  Thus, according to the present embodiment, the video database 68 storing information posted from the communication terminal device such as the karaoke device 36 and the communication terminal device through the communication line 18 are predetermined. Post acceptance control means 152 (SC1 to SC4) for accepting posting of moving picture information corresponding to any of a plurality of music data and storing the posted moving picture information in the moving picture database 68 in association with the corresponding music data; Editing the co-star video information by combining a pair of video information associated with the common music data accepted by the posting acceptance control means 152, and associating the edited co-star video information with the common music data Co-starring video editing control means 164 (SC4) to be stored in the video database 68, and the communication line 18 before In response to a distribution request from the communication terminal device, moving image distribution control means 158 (SE3, SE5, and SE6) distributes the moving image information and the co-starring moving image information related to the distribution request stored in the moving image database 68 to the communication terminal device. ) And video output control means 160, 168 (SA6, SB7, SBS1, SBS5, and SD3) that synchronously output a pair of video information related to the combination of the co-starring video information distributed by the video distribution control means 158 Video effect setting means 170, 172 (SD4 and SD5) for setting at least one video effect selected from a plurality of predetermined video effects corresponding to each of the video information, and the video output control When the means 160 and 168 synchronously output the pair of moving image information, the video effect setting means 170 and 17 The video effect control means 174 for applying the same or other video effect that reflects the video effect to the other video information related to the combination with the video information, while applying the video effect set by the above to the corresponding video information SE7 to SE12) are provided, so that when a pair of moving image information related to the combination of co-starring moving image information is synchronously output, the video effect applied to one moving image information is reflected in the other moving image information. be able to. That is, it is possible to provide the moving picture information distribution system 10 that realizes display control with a unified feeling in a co-starring moving picture that is output in combination with a plurality of moving pictures.

  In addition, the co-star video editing control unit 164 edits the co-star video information by combining the second video information posted later with the first video information previously posted by the posting acceptance control unit 152. The video effect control means 174 corresponds to the first video information by the video effect setting means 170 and 172 when the video output control means 160 and 168 synchronously output the pair of video information. The video effect set in this way is applied to the first video information, and the same or other video effect that reflects the video effect is applied to the second video information related to the combination with the first video information. Therefore, when synchronized output of a pair of video information related to a combination of co-starring video information, the video effect applied to the previously posted video information will be posted later. In particular, in a mode in which a plurality of pieces of video information posted later with respect to one piece of video information previously posted constitutes the co-star video information, It is possible to realize display control with a sense of unity without having to set a video effect each time it is determined.

  The video database includes a user database 70 that stores the gender of the user who is the posting subject of the video information in association with the user, and the video effect control unit 174 includes the video output control units 160 and 168. At the time of synchronous output of the pair of moving image information, the video effect set by the video effect setting means 172 is applied to the corresponding moving image information, and the video effect is applied to the other moving image information related to the combination with the moving image information. And the video effect determined based on the gender of the user who is the main subject of the video information of the other person is applied. Therefore, when synchronously outputting a pair of video information related to the combination of the co-star video information The video effect applied to one video information can be reflected in the other video information based on the gender of the user who is the contributor. While visually is aware of another it is possible to realize a display control that is unity.

  The microphone 110 is an audio input device and the video camera 122 is an imaging device. The microphone 110 simultaneously outputs a musical piece corresponding to music data selected from a large number of music data. A karaoke device 36 that amplifies and outputs input audio is provided as the communication terminal device, and the moving image distribution control means 158 is stored in the moving image database 68 in response to a distribution request from the karaoke device 36. The video information related to the distribution request is distributed to the karaoke device 36, and the karaoke device 36 controls the video output control means 160 (SA6, SB7) for controlling the output of the video information distributed by the video distribution control means 158. , SBS1, and SBS5) and the moving image information by the moving image output control means 160 Synchronized performance control means 162 (SBS1) for outputting a performance song corresponding to the music data associated with the moving picture information in synchronization with the output, and shooting by the video camera 122 at the time of the output of the performance music by the synchronous performance control means 162 Performance recording control means 150 (SA3 and SBS2) for recording the recorded video information and the audio information input by the microphone 110, and the posting acceptance control means 152 includes the performance recording control means 150. The video information and the audio information recorded in the above are received and stored in the moving image database 68 in association with the identification information of the music data corresponding to the performance music output by the synchronous performance control means 162. The moving image editing control unit 164 receives the posting acceptance control unit 152. Editing the co-star video information by combining a plurality of video information associated with common music data, and storing the edited co-star video information in the video database 68 in association with the music data identification information Therefore, it is possible to realize display control with a sense of unity in a co-starring moving image in which a plurality of moving images recorded or posted by the karaoke device 36 are combined and output in synchronization.

  The video effect control includes a user database 70 that stores music data that a user who is a posting subject of the moving image information performed in the past by the karaoke device 36 in association with the user. The means 174 applies the video effect set by the video effect setting means 170 and 172 to the corresponding video information when the video output control means 160 and 168 synchronously output the pair of video information, and the video The video effect is reflected in the other video information related to the combination with the information, and is determined based on the music data that the user who is the posting subject of the other video information performed by the karaoke device 36 in the past. Since the video effect is applied, when one pair of moving image information related to the combination of the co-starring moving image information is synchronously output, The video effect applied to the information can be reflected in the other video information based on the performance music played by the user who is the posting subject in the past, and the past performance result of the user by the karaoke device 36 can be visually Display control with a sense of unity can be realized.

  In addition, the music data is associated with at least one genre in advance, and the video effect control unit 174 performs the video output control unit 160, 168 when the pair of video information is synchronously output. The video effect set by the video effect setting means 172 is applied to the corresponding video information, and the video effect is reflected in the other video information related to the combination with the video information and the other video information is posted. Since a certain user applies a video effect determined based on the genre of music data that has been performed by the karaoke device 36 in the past, synchronous output of a pair of moving image information related to a combination of co-starring moving image information At the time, the video effect applied to the video information of one side is based on the performance music that the user who has contributed in the past played. Can be reflected in the other video information, it is possible to realize a display control that is unity while visually is aware of the performance tendency of the user by the karaoke apparatus 36.

  In addition, corresponding to the audio information included in each of the pair of moving image information related to the combination of the co-starring moving image information, the performance of the audio information is performed for each moving image information based on the common music data from a predetermined relationship. Performance evaluation control means 176 (SE9) for performing the evaluation is provided, and the video effect control means 174 performs the performance evaluation control means 176 by the performance evaluation control means 176 when the video output control means 160 and 168 synchronously output the pair of video information. Since the mode of the video effect applied to each video information is changed based on the performance evaluation result corresponding to each pair of video information, the synchronous output of the pair of video information related to the combination of the co-starring video information At this time, by controlling the video effect based on the performance evaluation result corresponding to each moving picture information, the performance evaluation result by the karaoke device 36 is visually confirmed. It is possible to realize a certain sense of unity display control while identification.

  The preferred embodiments of the present invention have been described in detail with reference to the drawings. However, the present invention is not limited to these embodiments, and may be implemented in other modes.

  For example, in the above-described embodiment, the post acceptance control unit 152, the video distribution control unit 158, the co-starring video editing control unit 164, and the video effect control unit 174 are connected to the CPU 52 of the server device 12 by the performance recording control unit 150, The search control means 154, the distribution request control means 156, the moving picture output control means 160, the synchronous performance control means 162, and the video effect setting means 170 are sent to the CPU 124 of the karaoke apparatus 36 by the distribution request control means 166 and the moving picture output control means 168. The video effect setting means 172 is functionally provided in the CPU 74 of the PC 14, but the present invention is not limited to this. For example, the control related to the search control means 154 is performed. In the configuration executed substantially on the server device 12 side, the search control means 154 is Serial and so it may be those provided in the CPU52 of the server device 12, device provided with a respective control functions shown in FIG. 5 may be appropriately changed depending on the configuration of the system.

  For example, in the above-described embodiment, the co-starring moving image editing control unit 164 is functionally provided in the CPU 52 of the server device 12, and a plurality of moving images uploaded from a communication terminal device such as the karaoke device 36. The co-star video information is edited by combining the information, and the edited co-star video information is stored in the video database 68. For example, the karaoke device 36 uses the video information that is the target of the combination related to the co-star video information. At the stage when the recording of the (performance video) is completed, the CPU 124 of the karaoke device 36 edits the co-star video information that combines the video information and the video information that is the co-starring partner, and the edited co-star video information is used as the server device. 12 to be stored in the moving image database 68 There. That is, the co-starring moving image editing control means 164 may be substantially functionally provided in the CPU 124 of the karaoke apparatus 36.

  In the above-described embodiment, the video effect control means 174 is functionally provided in the CPU 52 of the server device 12 and generates a video effect corresponding to the output of the moving image or the co-starring moving image by the communication terminal device. And is distributed to the target communication terminal device. For example, a video effect database is provided on the communication terminal device side such as the PC 14 or the karaoke device 36, and the command is received from the server device 12 side. A mode in which the video effect is generated by the CPU of the communication terminal device such as the PC 14 or the karaoke device 36 is also conceivable. That is, the performance evaluation control means 176 and the video effect control means 174 may be provided on the communication terminal device side such as the PC 14 or the karaoke device 36.

  In the above-described embodiment, the co-star video editing control unit 164 reads the video information related to the combination stored as independent video information in the video database 68 and synchronously outputs the video information as a co-star video. The video database is a combination of a plurality of pieces of video information relating to the combination, and creating a piece of co-star video information as a single video information (video file). 68 may be stored. That is, the co-star video information edited by the co-star video editing control means 164 may be combination information for synchronously outputting a plurality of video information as a co-star video, or a plurality of video information related to the combination is synthesized. It may be the moving image information itself as a result. In addition, in a mode in which a plurality of pieces of video information related to the combination are combined to create a single co-star video information, a video file equivalent to a pair of video information related to the combination, a contributor of each video information, a post A file for displaying information such as date and time and contributor's video together with the co-star movie is formed, and recorded or distributed as co-star video information defining the combination. Furthermore, in the aspect of creating a single co-star video information, a plurality of video information that is the basis of the creation may be deleted from the video database 68 when the co-star video information is created. Good.

  In the above-described embodiment, the co-starring moving image editing control means 164 is synchronized with the output of moving picture information as a co-starring partner by the moving picture output control means 160 provided in the karaoke apparatus 36. The video information recorded at the time of the output of the musical piece by 162 is edited with the video information that is combined with the video information that is the co-starring partner. For example, a plurality of video information uploaded from the PC 14 is combined and co-starred. The video information may be edited. That is, not only the moving image information recorded at the time of the karaoke performance by the karaoke device 36 but also the moving image information (moving image file) recorded by the web camera or the microphone provided in the PC 14 is the editing target of the co-starring moving image information of the present invention. It can be.

  Further, the mode of the mutual application control of the video effect by the video effect control unit 174 in the synchronous output of the pair of video information by the video output control units 160 and 168 is not limited to the one described in the above embodiment. Needless to say. For example, when the application start timing or application end timing is set for the video effect corresponding to one video information when the pair of video information is synchronously output, the application start timing or application end timing is set as the other video information. It is also possible to reflect the image effect corresponding to the above. That is, control may be performed so that a predetermined video effect is output from the application start timing to the application end timing also in the other moving image information. In addition, mutual application control of video effects by the video effect control means 174 may be applied to co-star video information that is output in combination with three or more video information, and the three related to the combination of the co-star video information. A mode in which video effects are mutually reflected in each of two or more pieces of moving image information is also conceivable. When the video effect corresponding to one video information of the pair of video information is a filter that processes the video information like an illustration, the same video effect is applied to the other video information, When a video effect including text is applied to one video information of the pair of video information, the same or other video effect including the text is applied to the other video information. As described above, various modes other than those described in the above embodiments can be considered.

  Although not particularly mentioned in the above-described embodiment, the moving image information distribution system 10 receives posting of a comment by a communication terminal device such as the PC 14 via the communication line 18, and the moving image distribution control unit 158. When distributing the moving image information related to the video information or the co-starring moving image information, control may be performed such that a plurality of comments posted in the past are synchronously distributed with respect to the moving image information or the co-starring moving image information. That is, the moving picture information distribution system of the present invention is configured by adding various interactive functions to the above-described embodiment.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

  10: Movie information distribution system, 14: Personal computer (communication terminal device), 16: Mobile phone (communication terminal device), 18: Communication line, 36: Karaoke device (communication terminal device), 68: Movie database (video effect database) ), 70: User database, 110: Microphone (audio input device), 122: Video camera (imaging device), 150: Performance recording control means, 152: Posting reception control means, 158: Video distribution control means, 160, 168 : Moving image output control means, 162: synchronous performance control means, 164: co-starring moving picture editing control means, 170, 172: video effect setting means, 174: video effect control means, 176: performance evaluation control means, 180: first performance Video (first moving picture information), 184: second performance video (second moving picture information), 200, 202, 20 , 214: frame (video effect), 204: third playing video (second moving picture information), 210,212,218: video effects, 216: halves image (video effect)

Claims (5)

A video information distribution system that distributes video information to a plurality of communication terminal devices via a predetermined communication line,
A moving image database for storing information posted from the communication terminal device;
Accepting posting of moving image information corresponding to any of a plurality of predetermined music data from the communication terminal device via the communication line, and associating the posted moving image information with corresponding music data, the moving image database Posting acceptance control means to be stored in
The moving image information is edited by combining a pair of moving image information associated with the common music data, which is received by the posting reception control means, and the edited moving image information is associated with the common music data. Co-star movie editing control means stored in the database;
In response to a distribution request from the communication terminal device via the communication line, moving image distribution control means for distributing the moving image information and the co-starring moving image information related to the distribution request stored in the moving image database to the communication terminal device; ,
Video output control means for synchronously outputting a pair of video information related to the combination of the co-starring video information distributed by the video distribution control means;
Video effect setting means for setting at least one video effect selected from a plurality of predetermined video effects corresponding to each of the moving image information;
When synchronously outputting the pair of moving image information by the moving image output control unit, the video effect set by the video effect setting unit is applied to the corresponding moving image information, and the other moving image information related to the combination with the moving image information And a video effect control means for applying the same or other video effect that reflects the video effect to the video information distribution system. The co-star video editing control unit edits the co-star video information by combining the second video information posted later to the first video information posted first by the posting acceptance control unit. ,
The video effect control means outputs the video effect set corresponding to the first moving picture information by the video effect setting means when the pair of moving picture information is synchronously output by the moving picture output control means. The moving image according to claim 1, wherein the moving image information is applied to the second moving image information related to the combination with the first moving image information, and the same or other image effect that reflects the image effect is applied. Information distribution system. Comprising a user database for storing attribute information of a user who is a posting subject of the video information in association with the user;
The video effect control unit applies the video effect set by the video effect setting unit to the corresponding video information when the video output control unit synchronously outputs the pair of video information, and The video effect that reflects the video effect on the other video information related to the combination and that is determined based on the attribute information of the user who is the posting subject of the other video information is applied. The video information distribution system described. A voice input device and an imaging device are provided, and in parallel with outputting performance music corresponding to music data selected from a large number of music data, the voice input by the voice input device is amplified and output. A karaoke device is provided as the communication terminal device,
The moving image distribution control means distributes the moving image information related to the distribution request stored in the moving image database to the karaoke device in response to the distribution request from the karaoke device,
The karaoke device
Video output control means for controlling the output of the video information distributed by the video distribution control means;
Synchronous performance control means for outputting performance music corresponding to music data associated with the video information in synchronization with the output of the video information by the video output control means;
Performance recording control means for recording video information photographed by the imaging device and sound information inputted by the voice input device when the performance music is outputted by the synchronous performance control means, and
The posting acceptance control means accepts posting of video information and audio information recorded by the performance recording control means, and associates the moving image with the identification information of music data corresponding to the performance music output by the synchronous performance control means. Which is stored in the database
The co-star video editing control unit edits the co-star video information by combining a plurality of video information associated with common music data, which is received by the posting reception control unit, and the edited co-star video information is used as the music data. The moving image information distribution system according to claim 1, wherein the moving image information is stored in the moving image database in association with the identification information. Corresponding to the audio information included in each of the pair of moving image information related to the combination of the co-starring moving image information, performance evaluation of the audio information is performed for each moving image information based on the common music data from a predetermined relationship. With performance evaluation control means to perform,
The video effect control means is configured to output each moving picture information based on performance evaluation results corresponding to each of the pair of moving picture information by the performance evaluation controlling means when the moving picture output control means synchronously outputs the pair of moving picture information. The moving picture information distribution system according to claim 4, wherein the mode of the video effect applied to is changed.