JP2020017870A - Information processing apparatus, moving image distribution method, and moving image distribution program - Google Patents

Abstract

To provide an information processing apparatus, a moving image distribution method and a moving image distribution program capable of giving a boost to a viewer and a moving image itself during distribution of the moving image of a user who performs singing or the like.SOLUTION: A server receives a tip input as a display instruction of a tip effect image 60 for decorating a song moving image from a portable terminal of a viewing user, superimposes the tip effect image 60 on a song moving image at a superimposition timing T after receiving the tip input, and distributes the song moving image on which the tip effect image 60 is superimposed, to the portable terminal.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing device, a moving image distribution method, and a moving image distribution program.

  In recent years, online services such as websites (Web pages, Web services), online games, and application software (hereinafter referred to as “apps”) distributed to information processing devices such as mobile terminals via a computer network have become widespread. I have.

  As one of the online services, there is a moving image posting site that allows a user to post a moving image taken by the user himself and to allow other users to view the moving image. On this video posting site, users also post performance videos such as singing videos. In some cases, the video posting site is provided with a function for the viewing user who has viewed the posted video to perform some kind of evaluation (judgment) on the video.

  Here, Patent Literature 1 discloses a karaoke performance apparatus that changes a singer's image as a determination result with respect to the singer's singing ability. In this karaoke performance apparatus, a viewer who watches a singer's singing inputs a result of singer's singing ability determination, and adds a specific image to the singer's video according to the result of the determination. Patent Document 1 discloses that, as an addition of an image to a singer's image according to the determination result, a crown is put on the head of the singer's image, that is, the singer's face in the case of a determination result that the singing ability is good. In the case of a judgment result that the singing ability is bad, the image signal from the camera is changed so that a peke mark is displayed on the image of the singer's face, or the image of the singer's face explodes or is severely deformed. Modulation is disclosed.

JP-A-6-250683

  The karaoke device disclosed in Patent Literature 1 uses a counter to count the determination signal indicating the determination result at the end of the singing by the singer, and changes the image of the singer according to the counting result. It does not excite the audience during singing by the singer.

  The present invention has been made in view of such circumstances, and provides an information processing apparatus, a moving image distribution method, and a moving image distribution method that can excite a viewer or a moving image itself during distribution of a moving image of a user performing singing or the like. The purpose is to provide the program.

  In order to solve the above problems, an information processing apparatus, a moving image distribution method, and a moving image distribution program of the present invention employ the following means.

  In order to solve the above problems, an “information processing device” according to an aspect of the present invention is an information processing device that distributes a moving image to a terminal device so that the viewing user can view the moving image, and the terminal device of the viewing user. Receiving means for receiving a display instruction of a decoration image for decorating the moving image being distributed from the receiving apparatus; superimposing means for superimposing the decoration image on the moving image after the receiving means receives the display instruction; Distribution means for distributing the selected moving image to the terminal device.

  In order to solve the above problems, a “moving image distribution method” according to an aspect of the present invention includes a first step of distributing a moving image to a terminal device so that a viewing user can view the moving image, and a method of distributing the moving image from the terminal device of the viewing user. A second step of receiving a display instruction of a decoration image for decorating the moving image therein; a third step of superimposing the decoration image on the moving image after receiving the display instruction; and the moving image on which the decoration image is superimposed. And a fourth step of delivering to the terminal device.

  In order to solve the above-described problems, a “moving image distribution program” according to an aspect of the present invention includes a computer provided in an information processing device that distributes a moving image to a terminal device so that the viewing user can view the terminal. Receiving means for receiving a display instruction of a decoration image for decorating the moving image being distributed from the device, superimposing means for superimposing the decoration image on the moving image after the receiving means has received the display instruction, and It functions as distribution means for distributing the superimposed moving image to the terminal device.

  Various technical limitations may be added to the “information processing device” as exemplified below. Further, a technical limitation having the same effect may be added to the processing steps executed by the “moving image distribution method” and the function of the “moving image distribution program”.

  The superimposing means superimposes the decorative image on the moving image at a predetermined timing of the moving image.

  A plurality of the timings are provided in the moving image, and the superimposing unit superimposes the decorative image according to the display instruction on the moving image at the next timing after receiving the display instruction.

  The moving image is a moving image that is recorded while music is being played, and a plurality of the timings are provided according to the music.

  The maximum number of the decorative images that can be superimposed on the moving image at the same timing is set in advance, and the superimposing unit superimposes the decorative images on the moving image in the order in which the display instructions are received so as not to exceed the maximum number. I do.

  The superimposing unit superimposes all the decorative images on the moving image at the predetermined timing when there is the decorative image that has received the display instruction but is not superimposed on the moving image at a predetermined timing immediately before the end of the moving image. I do.

  The decoration image is set with points, and the design differs according to the points.

  An acquisition unit is provided for acquiring an image of a scene in which the decorative image is relatively large in the moving image from the moving image.

  ADVANTAGE OF THE INVENTION According to this invention, there exists an effect that a viewer and a moving image itself can be excited during distribution of the moving image of the user who sings.

1 is a configuration diagram of a karaoke system according to a first embodiment of the present invention. FIG. 2 is a block diagram illustrating an electrical configuration of the server according to the first embodiment of the present invention. FIG. 2 is a block diagram illustrating an electrical configuration of the mobile terminal according to the first embodiment of the present invention. It is a figure showing the screen display of a personal digital assistant at the time of imaging a singing animation concerning a 1st embodiment of the present invention. It is a figure showing a screen display of a portable terminal at the time of watching a singing animation concerning a 1st embodiment of the present invention. It is a figure showing a screen display at the time of performing selection of a money-saving effect picture concerning a 1st embodiment of the present invention. It is a figure which shows the singing moving image on which the money-feeding effect image concerning 1st Embodiment of this invention was superimposed. It is a schematic diagram which shows the superimposition timing of a money-feeding effect image according to the first embodiment of the present invention. FIG. 3 is a functional block diagram relating to a money-feeding effect function according to the first embodiment of the present invention. It is a flow chart which shows a flow of a money-delivery effect processing concerning a 1st embodiment of the present invention. It is a schematic diagram which shows the superimposition timing of a money-feeding effect image according to the second embodiment of the present invention. It is a flow chart which shows a flow of a money-feeding effect processing concerning a 2nd embodiment of the present invention. It is a figure showing a money-feeding effect image concerning other embodiments of the present invention.

  Hereinafter, an embodiment of an information processing device, a moving image distribution method, and a moving image distribution program according to the present invention will be described with reference to the drawings.

[1. First Embodiment]
Hereinafter, a first embodiment of the present invention will be described.

  In the present embodiment, the performer records his or her performance as a moving image using a portable terminal and transmits the moving image to a server to upload the moving image to a moving image posting site. The video (posted video) uploaded to the video posting site can be viewed via a mobile terminal. In the present embodiment, the performance is singing, the performer is a singing user, and the video uploaded to the video posting site is a singing video. A user who watches a singing video uploaded to the video posting site is referred to as a viewing user.

[1-1. Karaoke system configuration]
FIG. 1 is a schematic configuration diagram of a karaoke system 1 according to the present embodiment. The karaoke system 1 includes a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A and 3B), and a server 4.

  The communication line 2 forms a computer network and is, for example, a wide-area communication line provided by an electric power company.

  The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, a tablet terminal, or a notebook computer, and is used for a user to use an online service. The mobile terminal 3 includes a touch panel display 3a for displaying an image, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone terminal 3e to which an earphone (not shown) is connected. Prepare. Note that shooting here refers to a state in which the camera 3d functions and the subject is displayed on the touch panel display 3a regardless of the presence or absence of recording. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor receives various input operations performed using an indicator such as a finger, a stylus, or a pen. In the following description, the touch panel display 3a is also referred to as a screen 3a.

  The server 4 is an information processing device that provides an online service to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, the singing user uploads the singing video to the video posting site by transmitting the singing video (singing video data) from the mobile terminal 3A to the server 4. Then, the viewing user accesses the video posting site using the mobile terminal 3B and views the singing video. The singing user can also view the singing video uploaded by himself / herself by accessing the video posting site using the mobile terminal 3A. In addition, the user of the mobile terminal 3B can be a singing user and upload a singing video to a video posting site.

[1-2. Server configuration]
FIG. 2 is a block diagram illustrating an electrical configuration of the server 4 according to the present embodiment.

  The server 4 according to the present embodiment includes a CPU (Central Processing Unit) 20, which is a main control unit that controls the entire operation of the server 4, a ROM (Read Only Memory) 22, in which various programs and various data are stored in advance, and the CPU 20. A RAM (Random Access Memory) 24 used as a work area when executing various programs and the like, and an HDD (Hard Disk Drive) 26 as a storage unit for storing various programs and various data are provided.

  The HDD 26 stores singing moving image data transmitted from the mobile terminal 3A, that is, singing moving image data uploaded to a moving image posting site, song data indicating songs that can be sung by a singing user, and the like. The storage means is not limited to the HDD 26, and may be another storage medium such as a semiconductor memory such as a flash memory.

  Further, the server 4 includes an operation input unit 28 which includes a keyboard and a mouse and receives input of various operations, a monitor 30 which displays various images, for example, a liquid crystal display device, and the mobile terminal 3 via the communication line 2. An external interface 32 is connected to another information processing device or the like, and transmits and receives various data to and from the other information processing device or the like.

  The CPU 20, the ROM 22, the RAM 24, the HDD 26, the operation input unit 28, the monitor 30, and the external interface 32 are electrically connected to each other via a system bus 34. Accordingly, the CPU 20 accesses the ROM 22, the RAM 24, and the HDD 26, grasps the operation state of the operation input unit 28, displays an image on the monitor 30, and exchanges various data with other information processing devices via the external interface 32. Transmission and reception can be performed.

[1-3. Electrical configuration of mobile terminal]
FIG. 3 is a functional block diagram illustrating an electrical configuration of the mobile terminal 3.

  The mobile terminal 3 includes a main control unit 40, a main storage unit 42, an auxiliary storage unit 44, a communication unit 46, and operation buttons 48 in addition to the configuration shown in FIG.

  The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), or the like, and controls the entire operation of the mobile terminal 3.

  The main storage unit 42 includes, for example, a RAM and a dynamic random access memory (DRAM), and is used as a work area when the main control unit 40 executes processing based on various programs.

  The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images and programs used for processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 include, for example, an OS (Operating System) for realizing basic functions of the mobile terminal 3, a driver for controlling various hardware, e-mail and web browsing, and various other types. It is a program for realizing the function. In addition, an application (hereinafter, referred to as a “video posting / viewing application”) for capturing and posting a singing video and viewing a video posting site is stored in the auxiliary storage unit 44 in advance.

  The communication unit 46 is, for example, an NIC (Network Interface Controller), and has a function of connecting to the communication line 2. In addition, the communication unit 46 has a function of connecting to a wireless LAN (Local Area Network) and a function of connecting to a wireless WAN (Wide Area Network) instead of or together with the NIC. A function to enable wireless communication, infrared communication, and the like may be provided.

  The operation buttons 48 are provided on a side surface of the mobile terminal 3, and are a power button for starting or stopping the mobile terminal 3, a volume adjustment button for sound output from the speaker 3 b, and the like.

  The main control unit 40, main storage unit 42, auxiliary storage unit 44, communication unit 46, operation button 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone terminal 3e are interconnected via a system bus 49. Is electrically connected to Therefore, the main control unit 40 accesses the main storage unit 42 and the auxiliary storage unit 44, displays an image on the touch panel display 3a, grasps an operation state of the user on the touch panel display 3a and the operation buttons 48, and outputs a sound to the microphone 3c. Input, output of sound from an earphone connected to the speaker 3b or the earphone terminal 3e, control of the camera 3d, and access to various communication networks and other information processing devices via the communication unit 46 can be performed.

[1-4. Shooting of singing video by singing user]
A case where a singing user shoots a singing moving image using the mobile terminal 3A will be described.

  When photographing a singing moving image, the singing user activates the moving image posting / viewing application on the mobile terminal 3A. When the video posting / viewing application starts, the mobile terminal 3A accesses the server 4 that stores a plurality of music data. Then, the singing user arbitrarily selects a song for singing himself from the video posting / viewing application, and downloads song data from the server 4 to the mobile terminal 3A. Then, the singing user plays the song by playing the song at an arbitrary timing using the video posting / viewing application. The video posting / viewing application starts playing the music and starts shooting a video by the camera 3d. That is, the singing moving image is a moving image captured by the mobile terminal 3A while music is being reproduced from the mobile terminal 3A.

  The song data is also associated with lyrics data. When the song data is downloaded from the server 4 to the mobile terminal 3A, the associated lyrics data is also downloaded to the mobile terminal 3A. In the following description, it is assumed that song data also includes lyrics data.

  FIG. 4 is an example of a display state (hereinafter, referred to as “screen display”) on the screen 3a of the mobile terminal 3A when shooting a singing moving image.

  As shown in FIG. 4, the screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 indicating the lyrics of the song sung by the user, a pitch image 54 indicating the pitch of the song, and a progress bar 56 indicating the progress of shooting.

  The lyrics image 52 and the pitch image 54 are updated as the music progresses. In the present embodiment, as an example, the lyrics image 52 and the pitch image 54 are updated by several phrases and displayed in the lyrics display area 50A. The update timing of the lyrics image 52 and the pitch image 54 may be the same or different.

  As an example, the lyrics image 52 displays the lyrics in a plurality of stages (two stages in the example of FIG. 4), and the color of the lyrics in the upper stage changes with the progress of the music so that the singing user can grasp the lyrics to be currently sung. It changes from the left end to the right end. When the color of the lyrics in the upper row reaches the right end, the lyrics in the lower row rise and are displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row again changes from the left end as the music progresses Change to the right end.

  In the pitch image 54, for example, a plurality of pitch bars 54A are displayed in a stepwise manner in the left-right direction according to the strength of the pitch. Then, the color of the pitch bar 54A changes from the left end to the right end and the pointer 54B moves from the left end to the right end in accordance with the progress of the music so that the singing user can grasp the pitch of the lyrics to be currently sung. When the color of the pitch bar 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

  As an example, the progress bar 56 has a length from the left end to the right end indicating the length of the entire music. When the reproduction of the music starts, the pointer 56A indicating the reproduction position of the music moves from the left end to the right end, and when the pointer 56A reaches the right end, the music ends. The progress bar 56 through which the pointer 56A has passed is displayed thicker than the position before the progress.

  Recording of the singing moving image is started a predetermined time (for example, 10 seconds) after a singing user selects a song and clicks a recording start button (not shown) displayed on the screen 3a. The start and end of the recording of the moving image may coincide with the start and end of the music, but the present invention is not limited to this, and the recording of the moving image may start a predetermined time before the start of the music (for example, 5 seconds before). The recording of the moving image may end after a predetermined time (for example, after 5 seconds) of the end of the music.

  The singing user connects the earphone to the earphone terminal 3e, listens to the reproduced music using the earphone, and sings along with the music. The mobile terminal 3A photographs the singing user with the camera 3d and records the singing user's singing with the microphone 3c. That is, the microphone 3c does not acquire the sound of the music to be reproduced. Then, the mobile terminal 3A records the singing voice of the singing user acquired by the microphone 3c, and uses the singing voice as singing data.

  The singing data may be obtained by extracting a frequency band of a human voice by a filtering process. By this filtering process, noise caused by the surrounding environment of the singing user is removed from the singing data, so that the singing voice of the singing user to be recorded becomes clearer.

  Then, the moving picture posting / viewing application combines the music data and the singing data with the recording data to make the singing moving picture data transmittable to the server 4. As an example, the user can select one of the following two types as the timing of transmitting the singing video data to the server 4, that is, the timing of uploading the singing video data to the video posting site.

  One is live distribution in which a singing user uploads singing video data to a video posting site in real time while singing. In the live distribution, the viewing user watches the singing by the singing user in real time. The other is non-live distribution in which a singing user uploads singing video data to a video posting site at an arbitrary timing after the singing of the music is completed.

  When performing the live distribution, the singing user performs settings for performing the live distribution before recording the singing moving image, and uploads the singing moving image data to the moving image posting site when the recording of the moving image is started. In the case of live distribution, the singing video data may be uploaded to a video posting site without being stored in the mobile terminal 3A.

  In addition, as a setting when performing live distribution, a first live distribution setting that enables a viewing user to view the singing video in live distribution, and a second live distribution that enables the viewing user to view the singing video even after live distribution. Any singing user of the setting can be set. That is, in the first live distribution setting, when the live distribution ends, the singing moving image data is deleted from the server 4, and the viewing user cannot view the singing moving image distributed live after the live distribution ends. On the other hand, in the second live distribution, since the server 4 continues to store the singing video data even after the live distribution ends, the viewing user can view the singing video as non-live distribution even after the live distribution ends.

  When performing non-live distribution, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user uploads the singing video to the video posting site at an arbitrary timing by operating the video posting / viewing application.

[1-5. Watching singing videos by viewers]
A case where a viewing user views a singing video using the mobile terminal 3B will be described.

  When viewing the singing video, the viewing user activates a video posting / viewing application on the mobile terminal 3B. When the video posting / viewing application is activated, the mobile terminal 3B accesses the server 4 storing a plurality of singing video data, that is, a video posting site. Then, the viewing user selects a singing video to be viewed via the video posting / viewing application and displays the singing video on the screen 3a. The method of distributing the singing video to the portable terminal 3B by the server 4 is, for example, streaming distribution.

  FIG. 5 is an example of a screen display of the portable terminal 3B when viewing a singing video, and shows a screen display when live distribution is being performed.

  On the screen 3a, a singing moving image is displayed, and a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E are provided. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed so as to be superimposed on the singing video.

  In the singing user display area 50C, the user name of the singing user who posted the singing video, an indication of whether or not it is a live distribution, and the name of the song being sung are displayed.

  The lyrics of the singing video are displayed in the lyrics display area 50D. The displayed lyrics are, for example, a plurality of phrases, and the color of the lyrics changes from the left end to the right end as the music progresses. The lyrics display area 50D may display lyrics in a plurality of levels, for example. In this case, when the color of the lyrics in the upper row reaches the right end, the lyrics in the lower row rise and are displayed in the upper row, and new lyrics are displayed in the lower row. Changes from the left end to the right end.

  In the comment input display area 50E, a comment input field is displayed, and a comment of a viewing user who is watching the singing video is displayed together with a user name. Note that, as an example, each time a comment is input from a viewing user, the comment is additionally displayed at the top of the comment input display area 50E, and the comment that has been displayed falls down. Then, when the comment cannot be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area. The comment not displayed in 3a is displayed.

  Further, on the screen 3a, operation icons 58A to 58D for the viewing user to perform various operations are displayed.

  The operation icon 58A is an icon that is clicked when the viewing user agrees with the singing video being viewed by the viewing user, and the total number of clicks of the operation icon 58A for the singing video is displayed above the operation icon 58A. You.

  The operation icon 58B is an icon that is clicked when the viewing user applies for a battle (hereinafter referred to as “battle singing”) with the singing user who is live-distributing the singing video displayed on the screen 3a. Competitive singing simultaneously displays a plurality of singing videos (first singing video and second singing video) by different singing users on the screen 3a of the mobile terminal 3B used by the viewing user, and alternately sings songs having the same singing video. It is. That is, the viewing user who clicks the operation icon 58B becomes a singing user who performs a competitive song.

  The operation icon 58C is an icon that is clicked when the viewing user performs various settings for the video posting / viewing application.

  The operation icon 58D is an icon that is clicked by the viewing user when the decorative image is superimposed on the singing moving image displayed on the screen 3a. The amount of the decorative image according to the present embodiment is determined according to its type, and the viewing user can purchase it by charging. Then, the viewing user clicks the operation icon 58D to superimpose the decoration image on the singing video being viewed by the user. The singing user of the singing video on which the decoration image is superimposed receives money corresponding to the superimposed decoration image from the operator of the video posting site. That is, the superimposition (display instruction) of the decorative image on the singing video by the viewing user corresponds to a so-called money change for the singing user.

[1-6. Investment effect function]
The video posting / viewing application according to the present embodiment displays the investment effect image after receiving a display instruction of a decoration image (hereinafter, referred to as a “finance effect image”) for decorating the singing animation being distributed from the viewing user's mobile terminal 3B. It has a money-feeding effect function that is superimposed on a singing video. Note that the money change effect function performs a process of superimposing the money change effect image on the singing moving image displayed on the screen 3a after the operation icon 58D displayed on the screen 3a of the mobile terminal 3B used by the viewing user is clicked. . That is, since the viewing user decorates the singing video by superimposing the money-feeding effect image on the singing video that he / she sympathizes with, the money-saving effect function excites the viewer and the singing video itself during the distribution of the singing video. Can be. Note that the money-feeding effect function is a function executed by the server 4 in response to a display instruction from a viewing user via a video posting / viewing application.

[1-6-1. Investment effect image]
FIG. 6 is a screen display of the mobile terminal 3B that transits when the viewing user clicks the operation icon 58D, in which a plurality of different money-feeding effect images 60 selectable by the viewing user are displayed. Points are set in the money-feeding effect image 60, and the design is different depending on the points. The viewing user selects one of the plurality of money-in-effect images 60 displayed on the screen, which can be acquired at the owned point. Note that different designs refer to different shapes, colors, directions, and the like, for example.

  As an example, the points are charged for each point, the viewing user purchases the points, and the types of selectable money-in-effect images 60 increase or decrease according to the points owned. When the viewing effect user selects the money-feeding effect image 60, the points owned by the viewing user decrease according to the points of the money-saving effect image 60 selected. In addition, the points may be increased not only by charging but also by using other online services.

  The money-feeding effect image 60 illustrated in FIG. 6 is four types of spotlight images simulating a spotlight and extending in different directions, and four types of combined spotlight images each having a different color by combining a plurality of spotlight images. By setting the money-feeding effect image 60 to an image imitating a spotlight, the viewer can feel as if he or she is participating in a concert or the like. Note that the money-feeding effect image 60 is not limited to the example of FIG. 6 and may be another image.

  The time of superimposition on the singing moving image, in other words, the time of display on the screen 3a (hereinafter referred to as “display time”) is predetermined in the money-feeding effect image 60, and the display time differs depending on the money-making effect image 60. Is also good. For example, the display time of the 5p investment effect image 60 shown in FIG. 6 is 0.3 seconds, and the display time of the 20p investment effect image 60 is 0.5 seconds. Since the money-feeding effect image 60 shown in FIG. 6 is an image of a spotlight, as an example, the money-changing effect image 60 dynamically changes within the display time so that the light extends downward from the top of the screen 3a. You may.

  Further, the selection of the money-saving effect image 60 itself corresponds to a display instruction of the money-saving effect image 60 on the singing moving image. In the following description, the display instruction (selection) of the money-feeding effect image 60 by the viewing user via the mobile terminal 3B is referred to as money-feeding input as described above.

  The money input can be performed using the video posting / viewing application regardless of the live or non-live distributed singing video. In addition, since the investment input is performed during the distribution of the singing video, the viewing user can input the investment at that time when he / she sympathizes with the user, and the viewing user can execute the effect-added singing video in real time by the input of the investment performed by the user. Can be watched on

  FIG. 7 shows a singing video (hereinafter, referred to as “effect superimposed singing video”) on which the divestment effect image 60 is superimposed when the merging spotlight image is selected by the viewing user as the monetary effect image 60 and a monetary input is performed. .). The effect superimposed singing moving image is stored in the server 4 and distributed via the moving image posting site so that not only the viewing user who made the money input but also other viewing users can view.

  The effect superimposed singing moving image has, for example, a layer structure, and the money-feeding effect image 60 is a layer different from the singing moving image (hereinafter, referred to as “effect layer”). The effect layer is synchronized with the singing video, and a new money effect image 60 is added according to the money input by the viewing user. Since the effect superimposed singing video has a layer structure in this way, even if the effect superimposed singing video is the effect superimposed singing video, the superimposition of the money-feeding effect image 60 is canceled by changing the setting of the video posting / viewing application, and the singing is performed. You can watch videos.

[1-6-2. Timing of superimposition of money-in effect image]
The money change effect function according to the present embodiment converts the money change effect image 60 into a singing moving image at a predetermined timing of the singing moving image (hereinafter, referred to as “superposition timing”) after receiving a money changing input from the portable terminal 3B of the viewing user. Superimpose. The singing moving image is a moving image photographed while the music is being reproduced as described above, and a plurality of superimposition timings are discretely provided according to the music. That is, the song moving image is associated with the music data for which the superimposition timing is set, and the money-sending effect function superimposes the money-sending effect image 60 on the song moving image based on the music data for which the superimposition timing is set.

  FIG. 8 is a schematic diagram showing the superimposition timing of the money-feeding effect image 60. In FIG. 8, T indicates a superimposition timing, and P indicates a period during the superposition timing T (hereinafter, referred to as a “non-superimposition period”).

  The superimposition timing T is a timing considered to be appropriate to excite the singing video, and differs for each music. For example, the superposition timing T is determined by a tempo, a pitch, a beat sound, a guide melody, a bar, a melody, a melody, a rhythm, and the like of the music. . The determination of the superimposition timing T may be determined manually, for example, or may be determined automatically by analyzing the music by a predetermined algorithm. Further, the superimposition timing T may be set near the last part of the music irrespective of the tempo of the music. In the example of FIG. 8, the superimposition timing T is determined based on the musical interval of the music, and a position where the musical interval is relatively high is set as the superimposition timing T.

  The non-superimposition period P is a period during which the money-feeding effect image 60 is not superimposed on the singing video, and is determined according to the determination of the superimposition timing T. In the example of FIG. 8, the non-overlapping period P1 is before the superimposition timing T1, the non-overlapping period P2 is between the superposition timings T1 and T2, and the non-overlapping period P3 is after the superposition timing T2.

  Then, the money-feeding effect function according to the present embodiment superimposes the money-feeding effect image 60 corresponding to the money-feeding input on the singing moving image at the next superimposition timing T after receiving the money-feeding input. More specifically, with reference to FIG. 8, the money effect image 60 corresponding to the money input performed in the non-superimposition period P1 is superimposed on the singing video at the superimposition timing T1, and the money input effect performed in the non-superimposition period P2 is performed. Is superimposed on the singing video at the superimposition timing T2, and the investment effect image 60 corresponding to the money input performed during the non-superposition period P3 is superimposed on the singing video at the next superimposition timing T.

  More specifically, the server 4 stores the money input information indicating the contents of the money input received in the non-overlapping period P in a money input storage area provided in the RAM 24 or the HDD 26, and displays the money effect image indicated by the money input information. 60 is set to be superimposed on the singing video at the next superimposition timing T. That is, as the number of money input received in the non-superimposition period P increases, the money effect image 60 superimposed at the next superimposition timing T becomes more colorful. The money input information that has been superimposed on the singing video is deleted from the money input storage area. The money input information includes the name of the user who made the money input, the money effect image 60, points, and the timing (time from the start of the singing video) of the money input.

  When there are a plurality of money-delivery inputs received in one non-superimposition period P, a plurality of money-feeding effect images 60 corresponding to the received money-feed inputs are all superimposed and displayed at the next superimposition timing T. For this reason, in the case where there are a plurality of the same money-feeding effect images 60, it is difficult for the viewing user to recognize each of them when they are overlapped. Therefore, when there are a plurality of the same money effect images 60 among the money effect images 60 to be superimposed on the singing video at the superimposition timing T, the money effect effect is displayed by shifting the display angle of one money effect image 60. Is also good. For example, when two money-sending effect images 60 of one spotlight from the top to the bottom are input as money-sending inputs, the money-sending effect function sets one money-sending effect image 60 diagonally right from the top or diagonally left from the top. Is displayed on the screen 3a as the money-feeding effect image 60 heading for.

  The present invention is not limited to this, and when there are a plurality of money-sending effect images 60 to be superimposed at the superimposition timing T, the time at which the money-sending effect images 60 are superimposed on the singing video is shifted by a small time (for example, 0.1 seconds). May be. In this case, the superimposition timing T has a certain time width (for example, 5 seconds).

  In addition, the maximum number of money throwing effect images 60 that can be superimposed at the superimposing timing T is determined in advance, and if the number of money throwing effect images 60 that are superimposed at the next superimposing timing T exceeds the maximum number, the superimposing timing T after the next time is repeated. Then, the investment effect image 60 may be superimposed on the singing video.

  In addition, the money-feeding effect function according to the present embodiment does not limit the money-feeding input that can be performed by one viewing user, and the money-feeding input can be performed a plurality of times for one singing video as long as the viewing user has a point. In addition, even in one non-overlapping period P, a plurality of money input can be made.

  As described above, the investment effect function according to the present embodiment superimposes the investment effect image 60 on the singing video at the superimposition timing T that is appropriate for enlivening the singing video, so that the viewer and the singing during the distribution of the singing video can be realized. You can excite the video itself.

[1-6-3. Image cropping function]
The video posting / viewing application cuts (copies) a scene in the singing video where the investment effect image 60 is relatively large from the singing video, thereby acquiring an image of the scene (hereinafter, referred to as an “image cutting function”). May be provided. Thus, the viewing user can easily post the exciting scene in the singing video to another service or the like.

  The image cutout function cuts out, for example, a singing moving image for a predetermined period including the superimposition timing T in which the number of the money-saving effect images 60 superimposed is the largest, or an image corresponding to the superimposition timing T as a still image. The image (moving image or still image) cut by the image cutting function is transmitted to the mobile terminal 3B and stored in the auxiliary storage unit 44 as an example, but is not limited thereto, and the SNS ( Social Networking Service).

[1-7. Function block of money-in effect
FIG. 9 is a functional block diagram related to the money-feeding effect function according to the present embodiment. The CPU 20 included in the server 4 includes a money input accepting unit 70, a money effect superimposing unit 72, a moving image distribution unit 74, and an image cutting unit 76. The processing executed by each function of the server 4 is realized by a program stored in the HDD 26.

  The investment input receiving unit 70 receives a display instruction (input of investment) of the investment effect image 60 decorating the singing video from the portable terminal 3B of the viewing user to which the singing video is distributed.

  The money change effect superimposing section 72 superimposes the money change effect image 60 on the singing video after the money change input receiving section 70 receives the money change input. The money-feeding effect superimposing unit 72 according to the present embodiment superimposes the money-feeding effect image 60 corresponding to the money-feeding input on the singing video at the next superimposition timing T after the money-feeding input is received.

  The moving image distribution unit 74 distributes the singing moving image uploaded to the moving image posting site to the mobile terminal 3B used by the viewing user. When the money-sending effect image 60 is superimposed on the singing moving image, the moving image distribution unit 74 distributes the effect-superimposed singing moving image to the mobile terminal 3B.

  The image clipping unit 76 acquires a scene in which the money-feeding effect image 60 is relatively large in the singing moving image from the singing moving image, and obtains a still image of the scene or a moving image including the scene.

[1-8. Flowchart of video distribution processing]
FIG. 10 is a flowchart illustrating the flow of the money-feeding effect process according to the present embodiment, which is executed by the CPU 20 included in the server 4. A program for executing the money-feeding effect process according to the present embodiment is stored in a predetermined area of the HDD 26 in advance.

  First, in step S100, the moving image distribution unit 74 distributes a singing moving image to the mobile terminal 3B used by the viewing user.

  In the next step S102, the investment input accepting unit 70 determines whether or not an investment input from the portable terminal 3B has been received. If the determination is affirmative, the process proceeds to step S104, and if the determination is negative, the process proceeds to step S106.

  In step S104, the money input information indicating the contents of the received money input is stored by the money input receiving unit 70 in the money input storage area of the HDD 26 (or the RAM 24).

  In step S106, the investment effect superimposition unit 72 determines whether the progress of the singing video has reached the next superimposition timing T. If the determination is affirmative, the process proceeds to step S108; if the negative determination is made, the process proceeds to step S114. I do.

  In step S108, the investment effect superimposition unit 72 determines whether or not investment input information is stored (stored) in the investment input storage area. If the determination is affirmative, the process proceeds to step S110; if the determination is negative, step S114 is performed. Move to.

  In step S110, the investment effect superimposition unit 72 superimposes the investment effect image 60 indicated by the investment input information stored in the investment input storage area on the singing video.

  In the next step S112, the money-feeding effect superimposing section 72 deletes the money-supplying input information already superimposed from the money-supplying input storage area.

  In the next step S114, the moving image distribution unit 74 determines whether or not the distribution of the singing moving image has ended. If the determination is negative, the process returns to step S102, whereas if the determination is affirmative, the money-delivery effect process ends.

  As described above, the server 4 accepts a divestment input, which is a display instruction of the divestment effect image 60 for decorating the singing video being distributed from the viewing user's mobile terminal 3B, and at the superimposition timing T after the diluting input is received. The money-feeding effect image 60 is superimposed on the singing motion picture, and the singing motion picture on which the money-feeding effect image 60 is superimposed is delivered to the mobile terminal 3B.

  As a result, the singing video that the audience has gained sympathy with is decorated with the investment effect image 60, so that the audience and the singing video itself are excited during the distribution of the singing video.

[2. Second Embodiment]
Hereinafter, a second embodiment of the present invention will be described.

  The configurations of the karaoke system 1, the mobile terminal 3, and the server 4 according to the present embodiment are the same as the configurations of the karaoke system 1, the mobile terminal 3, and the server 4 according to the first embodiment, and a description thereof will be omitted.

[2-1. Timing of superimposition of money-in effect image]
The money change effect function according to the present embodiment superimposes the money change effect image 60 corresponding to the money change input on the singing video without receiving a considerable time delay from the time the money change input is received. . In the money changing effect function according to the present embodiment, the maximum number of money changing effect images 60 that can be superimposed on the singing video at the same timing (hereinafter, referred to as “maximum number of superimposed”) is set in advance. Then, the money-feeding effect function (money effect superimposing section 72) superimposes the money-feeding effect image 60 on the singing video in the order of receiving money-feeding input so as not to exceed the maximum number of superimpositions.

  FIG. 11 is a schematic diagram illustrating the superimposition timing of the money-feeding effect image 60 according to the present embodiment. FIG. 11A is a schematic diagram of the money input storage area 80 according to the present embodiment. The money input storage area 80 stores money input information in a time series in which money input is received. Note that the number at the end of the “money input information” in FIG. 11 (A) indicates the order of money input.

  FIG. 11B schematically shows the money-feeding effect image 60 in which the horizontal axis represents time passage and the vertical axis is superimposed, and the numbers in FIG. 11B are shown in FIG. 11A. This corresponds to the order in which money input is accepted. As an example, in FIG. 11, the maximum number of superimpositions is 4, and the display time of the money input information 3, 4, 5, 6 is about half the time of the money input information 1, 2, 7.

  As illustrated in FIG. 11B, the money-feeding effect images 60 are superimposed on the singing moving image in the order of receiving money-feeding input up to the maximum number of superimpositions (money-feeding effect images 60-1 to 60-4). Then, when a certain investment effect image 60 ends and the number of superimpositions of the investment effect image 60 on the singing moving image becomes less than the maximum number of superimpositions, the next investment effect image 60 (the investment effect images 60-5 to 60-). The superposition of 7) is performed in the order in which the money input is accepted. That is, the money-feeding effect function according to the present embodiment superimposes the money-feeding effect image 60 on the singing video by first-in first-out (FIFO) so as not to exceed the maximum number of superimpositions, similarly to so-called queuing.

  In the example of FIG. 11B, since the display time of the money-feeding effect image 60-3 is shorter than the display time of the money-feeding effect image 60-2, the money-feeding effect image 60- comes before the money-feeding effect image 60-2. The superimposition of 3 ends. Therefore, the superimposition of the money-feeding effect image 60-5 is started before the superimposition of the money-feeding effect image 60-2 ends.

  As described above, the investment effect function according to the present embodiment superimposes the investment effect image 60 on the singing video so as not to exceed the maximum number of superimposition. Thereby, the investment effect function excites the viewing user and the singing video itself during the distribution of the singing video while preventing the singing video from being filled with a large amount of the investment effect image 60 and preventing the viewing user from being able to visually recognize the singing video itself. be able to.

  In addition, at a predetermined timing immediately before the end of the singing video, the investment effect superimposing unit 72 according to the present embodiment receives the input of the investment but does not superimpose the investment effect on the singing video (hereinafter, the “unsuperimposed investment effect image”). ) Exist, all the non-superimposed investment effect images are superimposed on the singing video at a predetermined timing. The predetermined timing is, for example, 10 seconds before the end of the singing video.

  Thus, the money-making effect function can superimpose all money-making effect images 60 corresponding to the received money-making input on the singing motion picture, and can excite the singing motion picture at the end of the singing motion picture.

  The present invention is not limited to this, and even if there is an unsuperimposed investment effect image immediately before the end of the singing video, the singing video is terminated without superimposing the unsuperimposed investment effect image on the singing video at a predetermined timing as described above. May be.

[2-2. Flowchart of video distribution processing]
FIG. 12 is a flowchart illustrating a flow of the money-feeding effect process according to the present embodiment, which is executed by the CPU 20 included in the server 4. A program for executing the money-feeding effect process according to the present embodiment is stored in a predetermined area of the HDD 26 in advance.

  First, in step S200, the moving image distribution unit 74 distributes a singing moving image to the mobile terminal 3B used by the viewing user.

  In the next step S202, the investment input accepting unit 70 determines whether or not an investment input from the mobile terminal 3B has been received. If the determination is affirmative, the process proceeds to step S204, and if the determination is negative, the process proceeds to step S206. .

  In step S204, the money input information indicating the contents of the received money input is stored in the money input storage area 80 of the HDD 26 (or the RAM 24).

  In step S206, the money-feeding effect superimposing section 72 determines whether or not money-feeding input information is stored (stored) in the money-feeding input storage area 80. If the answer is affirmative, the process proceeds to step S208; if the answer is negative, the process proceeds to step S208. The process moves to S214.

  In step S208, the money-feeding effect superimposition unit 72 determines whether or not the money-feeding effect image 60 superimposed on the singing video at the current timing is less than the maximum number of superimpositions. If it is determined, the process returns to step S202.

  In step S210, the money-feeding effect superimposing unit 72 superimposes the money-feeding effect image 60 on the singing moving image in the order of receiving money-feeding inputs.

  In the next step S212, the money-feeding effect superimposing unit 72 deletes the money-supplying input information already superimposed from the money-supplying input storage area 80.

  In the next step S214, the video distribution unit 74 determines whether or not the distribution of the singing video has been completed. If the determination is negative, the process returns to step S202, whereas if the determination is affirmative, the money-delivery effect process ends.

[3. Other Embodiments]
As described above, the present invention has been described using the above embodiments, but the technical scope of the present invention is not limited to the ranges described in the above embodiments. Various changes or improvements can be made to each of the above embodiments without departing from the spirit of the invention, and embodiments with the changes or improvements are also included in the technical scope of the present invention. Further, the above embodiments may be appropriately combined.

  For example, in the first embodiment, a mode in which the viewing user selects the money-feeding effect image 60 to be superimposed on the singing video has been described, but the present invention is not limited to this. For example, the viewer user inputs points without selecting the money effect image 60 by himself / herself when making money input, and the money effect effect is based on the money effect image corresponding to the total of the points received up to the superimposition timing T. 60 may be superimposed on the singing video. Then, for example, the money-feeding effect image 60 to be superimposed at the next superimposition timing T1 changes in accordance with the total of the points input in the non-superimposition period P1, and the next money injection effect image 60 changes in accordance with the total of the points input in the non-superimposition period P2. The money-feeding effect image 60 superimposed at the superimposition timing T2 changes. In addition, the points to be added are not only points by one viewing user, but points input by a plurality of viewing users.

  With reference to FIG. 13, a description will be given of a change in the money-feeding effect image 60 according to points. For example, when five points are input during a certain non-superimposition period P, at the next superimposition timing T, the money-feeding effect image 60 shown in FIG. When the number of points input in a certain non-superimposition period P is 10, at the next superimposition timing T, the money-feeding effect image 60 shown in FIG. Similarly, when the number of points is 15, the money effect image 60 shown in FIG. 13C is superimposed, and when the number of points is 20, the money effect image 60 shown in FIG. 13D is superimposed. When the number of points is 25, the money-feeding effect image 60 shown in FIG. In the example of FIG. 13, the shape of the money-feeding effect image 60 differs according to the point so that the larger the sum of the points becomes, the more colorful the money-making effect image 60 changes according to the point. May be.

  Further, in each of the above-described embodiments, the performance has been described as singing, and the moving image uploaded to the moving image posting site has been described as the singing moving image. However, the present invention is not limited to this. For example, the performance may be other than singing such that the performance is dance and the video uploaded to the video posting site is a dance video.

  Further, the flow of the investment effect processing described in each of the above embodiments is also an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed without departing from the spirit of the present invention. May be.

3B mobile terminal (terminal device)
4 server (information processing device)
60 Investment effect image (decorative image)
70 Money input receiving unit (receiving means)
72 Investment effect superimposition section (superimposition means)
74 Video distribution unit (distribution means)
76 Image cropping section (acquisition means)
T superposition timing (predetermined timing)

Claims (10)

An information processing apparatus that distributes a moving image to a terminal device so that a viewing user can view the moving image,
A receiving unit that receives a display instruction of a decoration image for decorating the moving image being distributed from the terminal device of the viewing user;
Superimposing means for superimposing the decorative image on the moving image after the receiving means has received the display instruction,
Distribution means for distributing the moving image on which the decoration image is superimposed to the terminal device;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the superimposing unit superimposes the decoration image on the moving image at a predetermined timing of the moving image. A plurality of the timings are provided in the moving image,
The information processing apparatus according to claim 2, wherein the superimposing unit superimposes the decoration image according to the display instruction on the moving image at the next timing after receiving the display instruction. The video is a video that is recorded while music is played,
The information processing apparatus according to claim 2, wherein a plurality of the timings are provided in accordance with the music. The maximum number of the decoration images that can be superimposed on the moving image at the same timing is set in advance,
The information processing apparatus according to claim 1, wherein the superimposing unit superimposes the decoration image on the moving image in an order in which the display instructions are received so as not to exceed the maximum number.   The superimposing means superimposes all of the decorative images on the moving image at the predetermined timing when the display instruction is received but the decorative image is not superimposed on the moving image at a predetermined timing immediately before the end of the moving image. The information processing apparatus according to claim 5, wherein:   The information processing apparatus according to claim 1, wherein points are set in the decoration image, and designs differ according to the points.   The information processing apparatus according to claim 1, further comprising an acquisition unit configured to acquire, from the moving image, an image of a scene in which the decorative image is relatively large in the moving image. A first step of distributing a moving image to a terminal device so that a viewing user can view the moving image;
A second step of receiving from the terminal device of the viewing user an instruction to display a decoration image for decorating the moving image being distributed,
A third step of superimposing the decoration image on the moving image after receiving the display instruction;
A fourth step of delivering the moving image on which the decoration image is superimposed to the terminal device;
A video distribution method having A computer provided in an information processing device that distributes a moving image to a terminal device so that a viewing user can view the computer,
A receiving unit that receives a display instruction of a decoration image for decorating the moving image being distributed from the terminal device of the viewing user;
Superimposing means for superimposing the decorative image on the moving image after the receiving means receives the display instruction,
Distribution means for distributing the moving image on which the decorative image is superimposed to the terminal device,
A video distribution program to make it function.

Images