JP7337366B2 - Video distribution system, program, and computer-readable storage medium - Google Patents

Description

Application of Article 30, Paragraph 2 of the Patent Law 1. Website publication date: March 15, 2019 2. Website address: <https://mirrativtmbr. tumblr. com/post/183468470938/ We have started a limited test of the new function Emo Kara>3. Publisher: Mirativ Co., Ltd. 4. Contents of disclosed invention: Mirativ Co., Ltd. has disclosed the technology related to the video distribution system of the present application on the website of Mirativ Co., Ltd., which is published at the website address above.

TECHNICAL FIELD The present invention relates to a video distribution system, a program, and a computer-readable storage medium, and more particularly, to a video distribution system having a terminal device owned by a user and a server computer capable of communication, and distributing a video to the terminal device. A distribution system, a program, and a computer-readable storage medium.

In recent years, karaoke is widely used regardless of age group or gender, and users perform karaoke while watching images displayed on a predetermined screen. For such karaoke-related technology, for example, the technology disclosed in Patent Document 1 and Patent Document 2 can be referred to.

JP 2018-146768 A JP 2015-161848 A

By the way, karaoke is usually used by a plurality of users at the same place such as a karaoke box or a predetermined store.

However, these days, there is a demand for a plurality of users to enjoy karaoke while sharing videos corresponding to songs distributed in real time in different places, such as enjoying karaoke while staying at home. .

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and aims to provide a video distribution system, a program, and a computer-readable storage medium capable of providing videos corresponding to songs.

In order to achieve the above object, a video distribution system according to the present invention includes a terminal device possessed by a user and a server computer configured to be able to communicate with the terminal device. A video distribution system for distributing, wherein the server computer includes a reading unit that reads a song, an avatar video control unit that controls an action video of an avatar object corresponding to the song read by the reading unit, and the avatar a lyric storage unit for pre-associating and storing relationships between expressions of objects and lyrics; and a distributing unit for distributing moving images of avatar objects whose actions are controlled by the avatar moving image control unit. Along with reading the lyrics, the avatar moving image control unit controls the relationship between the expression of the avatar object and the lyrics, which are stored in association with each other in advance by the lyrics storage unit. controlling an animation of facial expressions, and controlling an animation of facial expressions of an avatar object corresponding to the one lyric read a plurality of times when the one lyric is read a plurality of times by the reading unit; Characterized by
In order to achieve the above object, another video distribution system according to the present invention includes a terminal device owned by a user, and a server computer configured to communicate with the terminal device. A video distribution system for distributing videos together with songs, wherein the server computer includes a reading unit that reads songs, and an avatar video control unit that controls videos of actions of avatar objects corresponding to the songs read by the reading unit. a distribution unit that distributes the animation of the avatar object whose action is controlled by the avatar animation control unit; a gift storage unit that stores a gift to be provided to the avatar object; and a gift stored in the gift storage unit. and a gift providing unit for providing the avatar object with a gift, wherein the avatar animation control unit controls the avatar animation when the gift provided by the gift providing unit changes the action and/or facial expression of the avatar object. It is characterized by further changing the animation of the action and/or facial expression of the object.

According to the present invention, with the above configuration, it is possible to provide moving images corresponding to the music, such as controlling the moving images of the actions of the avatar object corresponding to the loaded music and distributing them to the terminal device. can.

In order to achieve the above object, a program according to the present invention includes terminal devices possessed by a plurality of users, and a server computer configured to be capable of communicating with the terminal devices through a network communication line. A computer of a video distribution system for distributing video together with a song comprises a reading unit that reads a song, an avatar video control unit that controls an action video of an avatar object corresponding to the song read by the reading unit, and the avatar object. and a distribution unit that distributes a video of the avatar object whose action is controlled by the avatar video control unit. Along with reading, the avatar moving image control unit generates a moving image of the facial expression of the avatar object corresponding to the read lyrics based on the relationship between the facial expressions of the avatar object and the lyrics stored in advance in association with the lyrics storage unit. and when the number of times the one lyric is read by the reading unit is a plurality of times, the moving image of the facial expression of the avatar object corresponding to the one lyric read a plurality of times is controlled. characterized by
In order to achieve the above object, another program according to the present invention includes terminal devices possessed by a plurality of users, and a server computer configured to communicate with the terminal devices through a network communication line, a computer of a video distribution system for distributing a video together with a song to the terminal device, a reading unit for reading a song, and an avatar associated with the song read by the reading unit. Avatar video control unit for controlling video of action of object; Distribution unit for delivering video of avatar object whose action is controlled by said avatar video control unit; Gift storage unit for storing gift to be provided to said avatar object and a gift providing unit for providing the avatar object with the gift stored in the gift storage unit, and the avatar animation control unit determines that the gift provided by the gift providing unit is the action of the avatar object and/or Alternatively, when the facial expression is changed, the action and/or facial expression animation of the avatar object is further changed.

To achieve the above object, a computer-readable storage medium according to the present invention is characterized by storing the program according to the above characteristics .

According to the present invention, it is possible to provide moving images corresponding to songs.

1 is a block diagram showing an overview of the overall configuration of a video delivery system according to an embodiment of the present invention; FIG. It is a block diagram which shows the structure of the terminal device of the moving image delivery system. It is a figure for demonstrating the display of the terminal device of the moving image delivery system. It is a block diagram which shows the structure of the server computer of the moving image delivery system. It is another block diagram which shows the structure of the server computer of the moving image delivery system. It is a block diagram which shows the structure of the memory|storage part of the server computer of the moving image delivery system. It is a flowchart for demonstrating the delivery method of the moving image by the same moving image delivery system. FIG. 8 is a flowchart following FIG. 7 for explaining a method of distributing moving images by the moving image distribution system; FIG. FIG. 8 is another flowchart following FIG. 7 for explaining the moving image distribution method by the same moving image distribution system; FIG. FIG. 8 is still another flowchart following FIG. 7 for explaining the method of distributing moving images by the moving image distribution system; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing an overview of the overall configuration of a video delivery system according to an embodiment of the present invention, FIG. 2 is a block diagram showing the configuration of a terminal device of the video delivery system, and FIG. 3 is the video delivery system. 4 is a block diagram showing the configuration of the server computer of the video distribution system, FIG. 5 is another block diagram showing the configuration of the server computer of the video distribution system, FIG. 6 is a block diagram showing the structure of the storage unit of the server computer of the moving picture delivery system.

An overview of the moving image distribution system 1 of the present invention will be described with reference to these drawings. The moving image distribution system 1 has terminal devices 10 owned by a plurality of users and a server computer 30. It is a system that distributes videos and lyrics along with songs to 10. The lyrics are distributed in the form of superimposed subtitles 12b, and users can use the video distribution system 1 to perform karaoke.

The terminal device 10 has an operation unit 11 , a display unit 12 , an output unit 13 , and a sound collection unit 14 , and the user operates the operation unit 11 to transmit predetermined information to the server computer 30 . can be done. The display unit 12 can display the video and lyrics (superimposed subtitles 12b) of the avatar object 12a distributed from the server computer 30 along with the background 12c (in FIG. 3, the background 12c of the screen is a mountain). there). The operation unit 11 and the display unit 12 are composed of touch panels.

The output unit 13 is also capable of outputting music distributed from the server computer 30 in correspondence with the animation and lyrics of the avatar object 12a. The output unit 13 can be configured by incorporating a predetermined speaker in the terminal device 10 .

The sound collecting unit 14 has a function of collecting sound, and can be configured by incorporating a predetermined microphone in the terminal device 10 .

That is, the user can listen to the song output by the output unit 13 and sing the selected song while watching the moving image of the avatar object 12a displayed on the display unit 12 and the lyrics (superimposed subtitles 12b). A user's singing voice can be collected by the sound collection unit 14 .

Also, the terminal device 10 can input the user's singing voice collected by the sound collector 14 of the other terminal device 10 via the server computer 30 and output it from the output unit 14 . As a result, the user can enjoy karaoke by listening to other users' singing voices while being in another place.

Note that the terminal device 10 can be a mobile terminal device, and the mobile terminal device includes a mobile phone, a tablet terminal, a smart phone, and the like. A terminal device 10 can be connected to a network communication line NT via a base station and a control station.

The server computer 30 is configured to be able to communicate with the terminal device 10 through the network communication line NT. The server computer 30 has a general configuration as a computer, and includes a central processing unit (CPU) 30b, a storage device (memory, hard disk) 30c, and input devices (keyboard, mouse , touch panel) 30d, a display device (CRT, liquid crystal display) 30e, and the like. The storage device 30c functions as a computer-readable storage medium.

The server computer 30 has functional units of an input unit 31, a storage unit 32, a reading unit 33, a gift providing unit 34, a judgment unit 35, an avatar animation control unit 36, an effect control unit 37, and a distribution unit 38. there is

The input unit 31 can input predetermined information transmitted via the operation unit 11 of the terminal device 10 . Also, the input unit 31 can input the user's singing voice collected via the sound collecting unit 14 of the terminal device 10 .

The storage unit 32 includes a music storage unit 32a, an avatar basic action storage unit 32a', a song tempo storage unit 32b, a lyric storage unit 32c, a gift storage unit 32d, a tone storage unit 32e, a volume storage unit 32f, and an effect storage unit 32g. have.

The music storage unit 32a can pre-associate and store songs in music and subtitles 12b of lyrics.

The avatar basic action storage unit 32a' can store basic actions and basic facial expressions of the avatar object 12a.

Here, the action refers to the movement of the body of the avatar object 12a, including movement of the limbs, movement of the waist, and the like. A facial expression refers to a facial expression of the avatar object 12a, and includes a happy facial expression, a surprised facial expression, a sad facial expression, and the like.

Further, the basic action refers to the basic action of the avatar object 12a. A predetermined action taken. The basic actions may include an initial basic action at the beginning of the song, an intermediate basic action in the middle of the song, and an ending basic action at the end of the song.

Also, the basic facial expression refers to the basic facial expression of the avatar object 12a. It refers to a given facial expression. The basic expressions can include an initial basic expression at the beginning of the song, an intermediate basic expression in the middle of the song, and an end basic expression at the end of the song.

The song tempo storage unit 32b can store the relationship between the action of the avatar object 12a and the tempo of the song in advance. Here, the tempo of a song is based on the length of the sound in each scale such as ``do'', ``re'', ``mi'', and so on. Including cases where the length is short and cases where the length of the note is longer than the slow tempo. If the tempo of the song is fast, the relationship between the action and the tempo of the song can be stored so that the action of the avatar object 12a will be faster. Also, if the tempo of the song is slow, the relationship between the action and the tempo of the song can be stored so that the action of the avatar object 12a slows down.

The lyric storage unit 32c can pre-associate and store the relationship between the expression of the avatar object 12a and the lyric. For example, in the case of lyrics expressing a happy feeling or a happy feeling, the facial expression of the avatar object 12a is changed so that the facial expression of the avatar object 12a is changed to the happy facial expression or the happy facial expression stored in the lyrics storage unit 32c. and lyrics.

The gift storage unit 32d can store various gifts to be provided to the avatar object 12a.
More specifically, the gift storage unit 32d can pre-associate and store the relationships between the actions and facial expressions of the avatar object 12a and various gifts. Here, a gift means a gift, and for example, a user can provide a gift to encourage another user who is singing a song well. The gift types include flowers, money, and the like.

That is, for example, an image of a flower or a twist is displayed on the display unit 12, or electronic money, virtual currency, or the like that can be used on the system is given to the user who is singing. When a flower, a twist, or the like is provided as a gift, the action and expression of the avatar object 12a are stored in the gift storage section 32d based on the basic action and basic expression stored in the avatar basic action storage section 32a'. The relationship between the actions and facial expressions of the avatar object 12a and various gifts can be stored so that the actions and facial expressions are changed to express joy and fun. The gift storage unit 32d can also store in advance the relationship between the actions and facial expressions of the avatar object 12a and the amount of gifts.

The tone storage unit 32e can pre-associate and store the relationship between the tone of the song and the action of the avatar object 12a. Here, the tone of a song is based on the pitch of the sound, and includes, for example, higher tone in detail and low tone in detail than low tone. The relationship between the action and the tone of the song can be stored such that if the tone of the song is high, the action of the avatar object 12a is louder. Also, the relationship between the action and the tone of the music can be stored so that when the tone of the music is low, the action of the avatar object 12a becomes small.

The volume storage unit 32f can pre-associate and store the relationship between the volume of the music and the action of the avatar object 12a. Here, the volume of the song is based on the loudness of the sound, and includes, for example, high volume and low volume. The relationship between the action and the volume of the music can be stored so that when the volume of the music is loud, the action of the avatar object 12a is loud. Also, the relationship between the action and the volume of the music can be stored so that when the volume of the music is low, the action of the avatar object 12a is reduced.

The effect storage unit 32g can pre-store effects in moving images. More specifically, the effect storage unit 32g can pre-associate and store the relationship between the effect in the moving image and various gifts. For example, the presentation in the video can be "fireworks", and the type of gift associated with "fireworks" can be "won a lottery ticket".

The reading unit 33 has a function of reading the tempo, tone, and volume of music selected by the user from the music storage unit 32a. Also, the reading unit 33 can read the lyrics of the music selected by the user from the music storage unit 32a. Note that the tempo, tone, volume, and lyrics of these songs may be read from the user's actual singing voice or performance by the reading unit 33 using predetermined sound recognition software or the like.

The gift providing unit 34 can provide the gift stored in the gift storage unit 32d to the avatar object 12a on the screen through a predetermined operation by the user of the operation unit 11 of the terminal device 10. FIG. Note that the gift providing unit 34 can provide different types of gifts for each of the terminal devices 10 in response to operations performed by a plurality of users.

The determination unit 35 can determine whether or not a gift has been provided by the gift providing unit 34 . More specifically, the determination unit 35 can determine whether the gift provision by the gift provision unit 34 has been performed within the predetermined control time t during which the action and facial expression of the avatar object 12a are changed. The determination unit 35 determines whether the relationship between the action and expression of the avatar object 12a controlled by the avatar animation control unit 36 and the gift provided by the gift provision unit 34 for the action and expression is determined by the gift storage unit. 32e (for example, the action and facial expression of the avatar object 12a controlled by the avatar moving image control unit 36 can be determined whether or not it is stored in advance). When the gift providing unit 34 provides a twist as a gift for the avatar object 12a and the facial expression, the judgment unit 35 pre-associates the action and facial expression representing the joy of the avatar object 12a with the twist in the gift storage unit 32e. stored or not).

The avatar moving image control unit 36 performs control so that the moving image of the action of the avatar object 12a is changed from the basic action stored in the avatar basic action storage unit 32a' in correspondence with the music read by the reading unit 33. be able to.

That is, the avatar moving image control unit 36 corresponds to the tempo of the song read by the reading unit 33 based on the relationship between the action of the avatar object 12a and the tempo of the song stored in advance in association with the song tempo storage unit 32b. can be controlled to change the animation of the action of the avatar object 12a from the basic action stored in the avatar basic action storage section 32a' to the action stored in the song tempo storage section 32b.

In addition, the avatar animation control unit 36 responds to the tone of the song read by the reading unit 33 based on the relationship between the tone of the song stored in advance in association with the tone storage unit 32e and the action of the avatar object 12a. It is possible to perform control so that the animation of the action of the avatar object 12a is changed from the basic action stored in the avatar basic action storage section 32a' to the action stored in the tone storage section 32e.

Furthermore, the avatar animation control unit 36 responds to the volume of the song read by the reading unit 33 based on the relationship between the volume of the song pre-associated and stored by the volume storage unit 32f and the action of the avatar object 12a. Control can be performed to change the moving image of the action of the avatar object 12a from the basic action stored in the avatar basic action storage section 32a' to the action stored in the volume storage section 32f.

In addition, the avatar animation control unit 36 changes the facial expression animation of the avatar object 12a from the basic expression stored in the avatar basic motion storage unit 32a' in correspondence with the lyrics read by the reading unit 33. can also be controlled.

That is, the avatar animation control unit 36 selects the avatar object 12a corresponding to the lyrics read by the reading unit 33 based on the relationship between the expression of the avatar object 12a and the lyrics stored in advance in association with the lyrics storage unit 32c. can be controlled to change the moving image of the facial expression from the basic facial expression stored in the avatar basic action storage unit 32a' to the facial expression stored in the lyric storage unit 32c. Note that when the reading unit 33 reads one lyric a plurality of times, the avatar moving image control unit 36 generates a moving image of the facial expression of the avatar object 12a corresponding to the lyric read a plurality of times. It is also possible to perform control so that the basic facial expression stored in the action storage section 32a' is changed to the facial expression stored in the lyric storage section 32c.

Further, when the determination unit 35 determines that the gift is provided within the predetermined control time t during which the action and facial expression of the avatar object 12a are changed, the avatar animation control unit 36 controls the avatar object 12a. can be controlled to further change the animation of the actions and facial expressions of the gift storage unit 32d to the actions and facial expressions stored in the gift storage unit 32d.

Furthermore, when the determination unit 35 determines that the relationships between the actions and facial expressions of the avatar object 12a and various gifts are pre-associated and stored, the avatar animation control unit 36 determines that the actions and expressions of the avatar object 12a are stored in advance. It is possible to perform control so as to change the moving image of facial expression from the basic action and facial expression stored in the avatar basic action storage unit 32a' to the action and facial expression stored in the gift storage unit 32d.

Furthermore, the avatar animation control unit 36 determines the amount of the gift provided by the gift providing unit 34 based on the relationship between the amount of gift and the action and expression of the avatar object 12a pre-associated and stored in the gift storage unit 32d. (For example, the number of twists provided The more , the more joyful actions and facial expressions).

As described above, the avatar animation control unit 36 changes the action and expression from the basic action and basic expression within a predetermined control time t, and after the control time t has passed is controlled to return the changed action or facial expression to the original action or facial expression. That is, "when the gift is provided by the gift providing unit 34 within the predetermined control time t in which the action and expression of the avatar object 12a are changed" means "when the gift is provided by the gift providing unit 34. When the avatar animation control unit 36 controls the action and facial expression of the avatar object 12a to be changed." are superimposed on each other.

The production control unit 37 can control the production in moving images. More specifically, the effect control unit 37 controls the effect of the moving image corresponding to the gift provided by the gift providing unit 34 based on the relation between the effect in the moving image pre-associated and stored by the effect storage unit 32g and various gifts. can be controlled. In addition, the effect control unit 37 controls the effect of the moving image corresponding to the amount of the gift provided by the gift providing unit 34 based on the relationship between the effect in the moving image and the amount of the gift, which is stored in association with the gift storage unit 32d in advance. Can be controlled (e.g., the more twists provided, the brighter the fireworks display).

The distribution unit 38 can simultaneously distribute the moving image of the avatar object 12a whose action and expression are controlled by the avatar moving image control unit 36 to a plurality of terminal devices 10 in real time together with the corresponding music and lyrics.

Further, the distribution unit 38 can output different control signals to the terminal devices 10 of a plurality of users to distribute different screens to the terminal devices 10 of a plurality of users. For example, the distribution unit 38 may output different control signals to the terminal devices 10 of a plurality of users in response to different gifts of the terminal devices 10, and distribute different screens to the terminal devices 10 of a plurality of users. can be done.

Furthermore, the distribution unit 38 can simultaneously transmit the user's singing voice collected via the sound collection unit 14 of one terminal device 10 to the other terminal devices 10 in real time (live distribution). . At this time, for example, if the moving image of the avatar object 12a shows that the avatar object 12a is holding a microphone and singing, the user who watches the distributed moving image on another terminal device 10 can see the avatar object 12a as if it were singing. can feel like they are singing in real time. Also, when the moving images of the actions and facial expressions of the avatar object 12a are changed in real time, the actions and facial expressions of the avatar object 12a can be felt more realistically.

It should be noted that the start and end of video distribution by the distribution unit 38 can be performed by the user operating the operation unit 11 of the terminal device 10 as required.

Here, each functional unit of the server computer 30 described above can function by executing a predetermined program 100 .

That is, the program 100 includes the computer of the moving image distribution system 1, more specifically, the server computer 30, an input unit 31, a storage unit 32, a reading unit 33, a gift providing unit 34, a judgment unit 35, an avatar-moving image control unit 36, and effect control. It can function as a unit 37 and a distribution unit 38 . The program 100 is stored in the storage device 30c of the server computer 30, and each user can access the server computer 30 through the network communication line NT, download the program 100 to the terminal device 10, and execute it.

Next, a method for distributing moving images by the moving image distribution system 1 of the present invention will be described in detail based on the flow charts of FIGS. 7 to 10. FIG.

First, in step S10, the user operates the operation section 11 of the terminal device 10 as required to select predetermined music from the music storage section 32a of the server computer 30. FIG.

Next, in step S20, the distribution unit 38 starts distributing videos, songs, and lyrics to a plurality of terminal devices 10, and the sound collection unit 14 collects the user's singing voice. Distribution of the collected singing voice of the user to other terminal devices 10 is started. The distribution by the distribution unit 38 is performed to a plurality of terminal devices 10 simultaneously in real time.

Next, in step S30, the reading unit 33 reads the tempo, tone, volume, and lyrics of the selected music. And, in correspondence with the lyrics, the moving images of the actions and facial expressions of the avatar object 12a are controlled so as to be changed from the basic actions and basic facial expressions stored in the avatar basic motion storage unit 32a'.

Subsequently, in step S50, the determination unit 35 determines whether or not the gift providing unit 35 has provided a gift. When the determination unit 35 determines that a gift has been provided, the process proceeds to step S60, where the avatar animation control unit 36 stores the action and facial expression of the avatar object in accordance with the type and amount of the gift in the avatar basic motion storage unit. The basic actions and expressions stored in the 32a' are changed to the actions and expressions stored in the gift storage unit 32d, and the production control unit 37 adds production to the animation corresponding to the type and amount of the gift. to control.

Here, a more detailed description of the method of controlling the moving image in which the determination unit 35 of the avatar-moving image control unit 36 in step S60 is involved is as follows.

That is, in step S61, the judgment unit 35 further judges whether or not the gift is provided by the gift provision unit 34 within a predetermined control time t during which the action and/or facial expression of the avatar object 12a is changed. However, when the determination unit 35 determines that the gift has been provided within the predetermined control time t during which the action and/or facial expression of the avatar object 12a is changed, the process proceeds to step S63 to perform avatar-animation control. The unit 36 controls to further change the animation of the action and facial expression of the avatar object to the action and facial expression stored in the gift storage unit 32d (FIG. 8).

Alternatively, in step S62, the determination unit 35 further determines whether the gift provided by the gift provision unit 34 is pre-stored in association with the gift storage unit 32d. However, when it is determined that the gift storage unit 32d has pre-associated and stored the avatar motion image control unit 36, the process advances to step S63, and the avatar motion image control unit 36 stores the motion images of the avatar object's action and expression in the avatar basic motion storage unit 32a'. The basic actions and facial expressions stored in the gift storage unit 32d are changed to the actions and facial expressions stored in the gift storage unit 32d (FIG. 9). Note that, as shown in FIG. 10, the processes of steps S61 and S62 may be superimposed.

Subsequently, in step S70, the user operates the operation unit 11 as required to terminate the distribution of moving images and the like by the distribution unit 38. FIG.

As described above, according to the moving image distribution system 1 of the present invention, the server computer 30 includes the reading unit 33 for reading a song, and the moving image of the action of the avatar object 12a corresponding to the song read by the reading unit 33. and a distribution unit 38 for distributing the video of the avatar object 12a whose action is controlled by the avatar video control unit 36 to the terminal device 10 together with the corresponding music. Therefore, it is possible to provide a moving image corresponding to the song, such as controlling the moving image of the action of the avatar object 12a corresponding to the loaded song and distributing it to the terminal device 10.例文帳に追加

It goes without saying that the present invention is not limited to the above-described embodiments, and various modifications and applications are possible.

For example, the lyric storage unit 32c stores in advance the relationship between the expression of the avatar object 12a and a lyric group including a plurality of lyric words. Then, when the reading unit 33 reads any of the lyrics included in the group of lyrics, the avatar animation control unit 36 reads the animation of the expression of the avatar object and the lyrics stored in advance in association with the lyrics storage unit 32c. Depending on the relationship with the group, the animation of the expression of the avatar object 12a may be controlled in correspondence with the lyrics group containing the read lyrics. For example, when a lyric group including lyric words associated with joy such as "fun, pleasant, exhilarating" is read, control is performed so that a moving image of facial expressions expressing joy is displayed.

In such a case, when the reading unit 33 reads the lyrics in one group of lyrics a plurality of times, the avatar animation control unit 36 creates an avatar corresponding to the one group of lyrics read in multiple times. - It is also possible to control the moving image of the expression of the object 12a. It is preferable that the plurality of lyrics included in the lyrics group have the same or similar meaning.

In the above-described embodiment, the background 12c of the screen on the display unit 12 of the terminal device 10 is a mountain, but the background 12c of the screen can be changed as appropriate.

That is, for example, the background 12c of the screen can be set for each user, or the background 12c of the screen can be changed according to the action or facial expression of the avatar object 12a or the type of gift.

Furthermore, in the above-described embodiment, the avatar-movie control unit 36 determines that the gift is provided within the predetermined control time t during which the action and expression of the avatar object 12a are changed. When it is determined, the animation of the action and expression of the avatar object 12a is changed.

That is, when the determination unit 35 determines that the gift is provided within the predetermined control time t during which the action and/or facial expression of the avatar object 12a is changed, the avatar animation control unit 36 changes the avatar Changing the animation of the action and/or expression of the object 12a produces the desired technical effect.

Furthermore, in the above-described embodiment, when the determination unit 35 determines that the avatar animation control unit 36 has stored the relationship between the action and facial expression of the avatar object 12a and the gift in association with each other in advance. First, the animation of the action and facial expression of the avatar object 12a is changed, but the desired effect can be obtained by using either one of the action and facial expression of the avatar object 12a.

That is, when the determination unit 35 determines that the relationship between the action and/or facial expression of the avatar object 12a and the gift is pre-associated and stored, the avatar animation control unit 36 determines whether the action of the avatar object 12a is stored. And/or changing the moving image of the facial expression produces the desired technical effect.

Furthermore, the avatar animation control unit 36 performs control so as to change the animation of the action and facial expression of the avatar object 12a in accordance with the amount of gifts provided by the gift providing unit 34. Either one of the action and facial expression of the object 12a produces the desired effect.

That is, if the avatar animation control unit 36 performs control so as to change the animation of the action and/or facial expression of the avatar object 12a in accordance with the amount of gifts provided by the gift providing unit 34, the required The technical effect of

Further, in the above-described embodiment, the avatar video control unit 36 performs control to change the animation of actions and facial expressions from basic actions, basic facial expressions, etc. After changing the animation of the action or facial expression from the basic action or basic facial expression, the control may be performed to further change the changed action or facial expression.

NT: Network communication line 1: Video distribution system 10: Terminal device 11: Operation unit 12: Display unit 12a: Avatar object 12b: Subtitle super 12c: Screen background 13: Output unit 14: Sound collector 30: Server computer 31: Input section 32: Storage section 32a: Music storage section 32a': Avatar basic action storage section 32b: Song tempo storage section 32c: Lyrics storage section 32d: Gift storage section 32e: Tone storage section 32f: Volume storage section 32g: Effect storage section 33: Reading unit 34: Gift providing unit 35: Judging unit 36: Avatar video control unit 37: Effect control unit 38: Distribution unit 100: Program

Claims (13)

A video distribution system for distributing videos together with songs,
a reading unit for reading songs;
an avatar video control unit that controls an action video of the avatar object in correspondence with the song read by the reading unit;
a lyric storage unit for pre-associating and storing the relationship between the expression of the avatar object and the lyric;
a distribution unit that distributes a video of the avatar object whose action is controlled by the avatar video control unit;
has
The reading unit reads the lyrics and
The avatar moving image control unit controls the moving image of the facial expression of the avatar object corresponding to the read lyrics based on the relationship between the facial expression of the avatar object and the lyrics stored in advance in association with the lyrics storage unit. and controlling a moving image of facial expression of an avatar object corresponding to the one lyric read a plurality of times when the one lyric read by the reading unit is read a plurality of times. . a song tempo storage unit for pre-associating and storing the relationship between the action of the avatar object and the tempo of the song;
The reading unit reads the tempo of the song and
The avatar moving image control unit controls the action of the avatar object corresponding to the tempo of the read song based on the relationship between the action of the avatar object and the tempo of the song stored in advance in association with the song tempo storage unit. 2. The moving image distribution system according to claim 1, wherein the moving image of the moving image is controlled. The lyrics storage unit pre-stores a relationship between the expression of the avatar object and a group of lyrics including a plurality of lyrics in association with each other, and
The avatar animation control unit controls, when any one of the lyrics included in the lyrics group is read, the lyrics group including a plurality of the lyrics and the animation of the facial expression of the avatar object pre-associated and stored by the lyrics storage unit. 3. The moving image distribution system according to claim 1, wherein the moving image of the expression of the avatar object is controlled in accordance with the group of lyrics including the read lyrics according to the relationship between . The avatar animation control unit, when the number of times of reading lyrics in one lyrics group by the reading unit is a plurality of times, reproduces an animation of the expression of the avatar object corresponding to the one lyrics group read a plurality of times. 4. The moving picture distribution system according to claim 3 , wherein the moving picture distribution system controls A video distribution system for distributing videos together with songs,
a reading unit for reading songs;
an avatar video control unit that controls an action video of the avatar object in correspondence with the song read by the reading unit;
a distribution unit that distributes a video of the avatar object whose action is controlled by the avatar video control unit;
a gift storage unit that stores a gift to be provided to the avatar object;
a gift providing unit that provides the avatar object with the gift stored in the gift storage unit;
has
The avatar animation control unit further changes the animation of the action and/or expression of the avatar object when the gift provision unit changes the action and/or expression of the avatar object. A video distribution system characterized by : The gift storage unit pre-stores a relationship between the action and/or expression of the avatar object and the gift, and stores the action and/or expression of the avatar object controlled by the avatar animation control unit and the action and/or expression. or a judgment unit for judging whether or not the relationship between the facial expression and the gift provided by the gift providing unit is pre-associated and stored by the gift storage unit,
The avatar moving image control unit, when the determination unit determines that the relationship between the action and/or facial expression of the avatar object and the gift is stored in advance in association with the action and/or facial expression of the avatar object. 6. The moving image distribution system according to claim 5 , wherein the moving image of the moving image is changed. a tone storage unit for pre-associating and storing the relationship between the tone of the song and the action of the avatar object;
The reading unit reads the tone of the song and
The avatar moving image control unit controls the action of the avatar object in accordance with the tone of the read song, based on the relationship between the tone of the song and the action of the avatar object stored in advance in association with the tone storage unit. 7. The moving image distribution system according to claim 1 , wherein the moving image of the moving image is controlled. a volume storage unit for pre-associating and storing the relationship between the volume of the song and the action of the avatar object;
The reading unit reads the volume of the song from music ,
The avatar animation control unit controls the action of the avatar object in accordance with the volume of the read song, based on the relationship between the volume of the song and the action of the avatar object, which are pre-associated and stored by the volume storage unit. 8. The moving image delivery system according to claim 1, wherein the moving image of the moving image is controlled. 9. The moving image distribution system according to claim 1, further comprising an effect control unit that controls the effect of the moving image. further having a sound collecting unit for collecting sound,
10. The moving image distribution system according to any one of claims 1 to 9, wherein the distribution unit distributes the voice collected by the sound collection unit in real time. The computer of the video distribution system that distributes the video along with the song,
a reading unit for reading songs;
an avatar video control unit that controls an action video of the avatar object in correspondence with the song read by the reading unit;
a lyric storage unit for pre-associating and storing the relationship between the expression of the avatar object and the lyric;
Functioning as a distribution unit for distributing a video of an avatar object whose action is controlled by the avatar video control unit ,
While the reading unit reads the lyrics,
The avatar moving image control unit controls the moving image of the facial expression of the avatar object corresponding to the read lyrics based on the relationship between the facial expression of the avatar object and the lyrics stored in association in advance by the lyrics storage unit. , when the one lyric is read a plurality of times by the reading unit, the avatar object's facial expression animation is controlled corresponding to the one lyric that has been read a plurality of times. program to do. The computer of the video distribution system that distributes the video along with the song,
a reading unit for reading songs;
an avatar video control unit that controls an action video of the avatar object in correspondence with the song read by the reading unit;
a distribution unit that distributes a video of the avatar object whose action is controlled by the avatar video control unit;
a gift storage unit that stores a gift to be provided to the avatar object;
a gift providing unit that provides the avatar object with the gift stored in the gift storage unit;
function as
The avatar animation control unit further changes the animation of the action and/or expression of the avatar object when the gift provision unit changes the action and/or expression of the avatar object. A program characterized by functioning . A computer-readable storage medium storing the program according to claim 11 or 12 .