JP2021180466A - Moving image distribution device, moving image distribution method, and moving image distribution program - Google Patents

Abstract

To provide a service that facilitates the bi-directional communication between a distributor who distributes moving image contents in a live program and viewers thereof to liven up the moving image contents.SOLUTION: A moving image distribution device 30 comprises: a first acquisition unit 321 that acquires real-time moving image data supplied from a distributor terminal 10; a second acquisition unit 322 that acquires input information including information on a communication image selected through an operation of a viewer terminal 20; a generation unit 34 that generates moving image data for distribution by using data of the communication image for performing a predetermined operation on a display screen and the real-time moving image data; and a distribution unit 38 that distributes the moving image data for distribution.SELECTED DRAWING: Figure 2

Description

The present invention relates to a video distribution device, a video distribution method, and a video distribution program.

In recent years, an environment has been set up in which individuals can easily distribute video content, and viewers can select what they want to see from a large number of video content. When a distributor distributes video content in real time (live broadcasting), for example, the viewer can communicate between the distributor and the viewer by posting a comment, and the distributor responds to the reaction of the viewer. It is possible for viewers to enjoy the realism of live broadcasting.

Patent Document 1 proposes a technique for communicating between a distributor and a viewer by means other than comments. For example, Patent Document 1 discloses a technique in which a viewer puts an object (virtual item) into a virtual space. For example, in Patent Document 1, the server includes a distribution unit that distributes data in a virtual space in which an object operated by a distributor terminal exists to a viewer terminal and a distributor terminal, and a virtual item to be input into the virtual space. It includes a reception unit that receives input input from the distributor terminal and / or the viewer terminal, and the distribution unit distributes the data of the virtual item controlled by the virtual item control unit together with the data of the virtual space, and Regarding the effect when the virtual item to be thrown has the outer shape of the character, there is a description that "the character itself is interesting to fall from above". (For example, paragraph [0110] of Patent Document 1)
In addition, "there may be an upper limit on the number of virtual items that can be input in the broadcast of one program. Also, even after the maximum number of virtual items have been input, a certain period of time has passed or a specific condition is applied. By satisfying, virtual items that can be reintroduced may be filled. " (For example, paragraph [0094] of Patent Document 1)
There is also a description that "the user management unit 2g also records the history of virtual items thrown into the virtual space used by each live content and information such as the type of the item." (For example, paragraph [0029] of Patent Document 1)
Further, as an example of controlling a virtual item, it is described that the input of a virtual item may be prohibited. (For example, paragraph [0995] of Patent Document 1)

Japanese Unexamined Patent Publication No. 2020-17244

A distributor who distributes video content by live broadcasting can advance the content according to the real-time reaction of the viewer. However, for example, it is difficult for a viewer who is viewing the content on a smartphone to immediately input a comment on the content, and it is difficult to communicate between the viewer and the distributor at a good tempo. ..

Therefore, an "emotion" service is being considered as a means of communicating between a viewer and a distributor. Emotion is a means for facilitating communication between a viewer and a distributor by inputting an image expressing the viewer's emotions and intentions into characters and colors on a content display screen. For example, while watching a video content, the viewer selects an emotional image that expresses his / her intention or emotion from a plurality of emotion images presented in the area around the content display screen, thereby displaying the content display screen. It is possible to put an emotion image inside. Therefore, the viewer can immediately convey his / her intention and feelings to the distributor regarding the content of the video content that is being broadcast live.

On the other hand, when the emotion image is put into the display screen of the video content and controlled to stay for a certain period of time, many emotion images are put into the display screen, which makes the video content difficult to see. As a result, there is a possibility that the video content will be rather lively.

The present invention has been made in view of the above circumstances, and is a video distribution device that facilitates two-way communication between a distributor who distributes video content by live broadcasting and its viewer, and provides a service for enlivening the video content. , A video distribution method, and a video distribution program.

The video distribution device according to the first aspect of the present invention acquires input information including information of a communication image selected by operating the viewer terminal and a first acquisition unit that acquires real-time video data supplied from the distributor terminal. The second acquisition unit, the generation unit that generates the video data for distribution using the data of the communication image that performs a predetermined operation on the display screen, and the real-time video data, and the video data for distribution are distributed. It has a distribution unit.

The video distribution device according to the second aspect of the present invention is the video distribution device according to the first aspect, in which the generation unit operates the viewer terminal for each of the real-time video data delivered to the viewer terminal. A charge amount is assigned to each, and when the charge amount consumed by displaying the communication image is less than the current value of the charge amount assigned to the viewer, the charge amount is assigned to the viewer. Further, a charge amount management unit that consumes the charge amount and generates display information for displaying the communication image is further provided, and the generation unit uses the display information and the real-time moving image data to generate the distribution moving image data. Generate.

In the video distribution device according to the third aspect of the present invention, in the video distribution device according to the second aspect, the charge amount management unit responds to the passage of time so that the charge amount recovers from zero to the maximum value after a predetermined time elapses. The value of the charge amount is increased.
The moving image distribution device according to the fourth aspect of the present invention is the moving image distribution device according to the second aspect, in which the input information is the length of time that the viewer terminal is operated or the pressure on the screen when the viewer terminal is operated. The charge amount management unit consumes a numerical value corresponding to the time length or the pressure information from the charge amount, including the information of the above and the identification information of the selected communication image, and the time length or the said. The display information including the pressure information is generated, and the generation unit changes the operation or size of the communication image according to the time length or the pressure.

The moving image distribution device according to the fifth aspect of the present invention is the moving image distribution device according to the first aspect, in which the input information includes the identification information of the selected communication image, and in the generation unit, the communication image is the viewer. The distribution moving image data is generated so as to perform an operation corresponding to the identification information when displayed on the terminal.
The video distribution device according to the sixth aspect of the present invention is the video distribution device according to the second to fourth aspects, and the charge amount management unit uses the input information in the period from the start to the end of the real-time video data distribution. Based on this, the input history of the communication image is managed.

The video distribution device according to the seventh aspect of the present invention further includes a third acquisition unit for acquiring input information supplied from the distributor terminal in the video distribution device according to the first aspect, and the generation unit is the distributor. For distribution, the communication images displayed on the viewer terminal are collectively deleted, the communication images are prohibited from being input, or the communication images to be input are thinned out, based on the input information from the terminal. It is possible to generate video data.

The video distribution method according to the eighth aspect of the present invention acquires input information including information of a communication image selected by operating the viewer terminal and a first acquisition step of acquiring real-time video data supplied from the distributor terminal. The second acquisition step, the generation step of generating the video data for distribution using the data of the communication image that performs a predetermined operation on the display screen, and the real-time video data, and the video data for distribution are distributed. It has a delivery step.

In the video distribution program according to the ninth aspect of the present invention, the computer is input including the first acquisition means for acquiring real-time video data supplied from the distributor terminal and the information of the communication image selected by the operation of the viewer terminal. A second acquisition means for acquiring information, a generation means for generating distribution video data using the communication image data performing a predetermined operation on a display screen, and the real-time video data, and the distribution video data. As a delivery means to deliver, and to function as a delivery means.

According to the present invention, a video distribution device, a video distribution method, and a video distribution program that facilitate two-way communication between a distributor who distributes image content by live broadcasting and the viewer thereof and provide a service for enlivening the video content. Can be provided.

FIG. 1 is a diagram showing a schematic configuration of a video content distribution system including the video distribution device of the embodiment. FIG. 2 is a block diagram schematically showing a configuration example of the moving image distribution device of the first embodiment. FIG. 3 is a diagram schematically showing a display example of the content delivered in real time on the viewer terminal. FIG. 4 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. FIG. 5 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. FIG. 6 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. FIG. 7 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. FIG. 8 is a diagram schematically showing a display example of an emotion image input on a part of the display screen of the viewer terminal. FIG. 9 is a diagram schematically showing an example of an emotion image displayed on a part of the display screen of the viewer terminal. FIG. 10 is a diagram schematically showing another display example of the content delivered in real time on the viewer terminal. FIG. 11 is a flowchart for explaining an example of a moving image distribution method in the moving image distribution device of the first embodiment. FIG. 12A is a diagram for explaining an example of operation of a viewer terminal that displays content delivered in real time. FIG. 12B is a diagram showing a part of a display example of the viewer terminal shown in FIG. 12A. FIG. 13 is a block diagram schematically showing a configuration example of the moving image distribution device according to the third embodiment.

Hereinafter, the video content distribution system, the video distribution method, and the video distribution program of the embodiment will be described in detail with reference to the drawings.
FIG. 1 is a diagram showing a schematic configuration of a video content distribution system including the video distribution device of the embodiment.

The video distribution system includes a distributor terminal 10 and a video distribution device 30. The video distribution device 30 may be communicably connected to the distributor terminal 10 and the viewer terminal 20 via a network. Although three viewer terminals 20 are shown in FIG. 1, the number of viewer terminals 20 is not limited to the number shown, and may be zero.

The distributor terminal 10 is an electronic device such as a computer that can be connected to a video source such as a video camera, for example, a TV receiver (including an Internet TV), a PC (Personal Computer), a mobile terminal (for example, a tablet, a smartphone, etc.). Laptops, feature phones, portable game machines, digital music players, electronic book readers, etc.), VR (Virtual Reality) terminals, AR (Augmented Reality) terminals, etc., but are not limited to these. The distributor terminal 10 includes, for example, at least one processor and a storage unit in which a program executed by the processor is stored, and various functions can be realized by software or by combining software and hardware. It is configured in.

The viewer terminal 20 is an electronic device such as a computer, and is, for example, a TV receiver (including an Internet TV), a PC (Personal Computer), a mobile terminal (for example, a tablet, a smartphone, a laptop, a feature phone, a portable game). Machines, digital music players, electronic book readers, etc.), VR (Virtual Reality) terminals, AR (Augmented Reality) terminals, etc., but are not limited to these.

The viewer terminal 20 includes, for example, at least one processor and a memory in which a program executed by the processor is recorded, and various functions can be realized by software or by combining software and hardware. It is configured.

The viewer terminal 20 can receive content data such as video data and real-time video list data from the video distribution device 30 and present the content to the viewer by a display means or an acoustic means (not shown).

FIG. 2 is a block diagram schematically showing a configuration example of the moving image distribution device of the first embodiment.
The moving image distribution device 30 includes a reception unit 32 including a first acquisition unit 321 and a second acquisition unit 322, a generation unit 34, a distribution unit 38, and a distribution control unit 35.

The moving image distribution device 30 may include, for example, a processor that executes a program that realizes the function of the above configuration and a memory that stores the program. The processor is typically a CPU (Central Processing Unit) and / or a GPU (Graphics Processing Unit), but may be a microcomputer, an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), or the like. .. In addition, the memory temporarily stores a program executed by the processor and data used by the processor in order to realize the operation of the moving image distribution device.

Further, the moving image distribution device 30 may further include a communication unit that can be connected to a network and a data storage unit (not shown) for accumulating a large amount of data. The data storage unit may be built in the moving image distribution device 30 or may be externally attached to the moving image distribution device 30. The data storage unit may include, for example, a non-volatile storage medium such as an HDD (Hard Disk Drive) or SSD (Solid State Drive).

The receiving unit 32 can communicate with the distributor terminal 10 and the viewer terminal 20 via the network, and may include the first acquisition unit 321 and the second acquisition unit 322. For example, the receiving unit 32 receives moving image data from the distributor terminal 10 or receives a distribution request from the viewer terminal 20. The receiving unit 32 transmits the distribution request received from the viewer terminal 20 to the distribution control unit 35 and the generation unit 34. The distribution request from the viewer terminal 20 may include the identification information of the viewer or the viewer terminal 20 and the identification information of the moving image content.

The first acquisition unit 321 can receive real-time moving image data sequentially transmitted from the distributor terminal 10 via the network. Specifically, the first acquisition unit 321 receives the moving image data for real-time distribution from the distributor terminal 10. The first acquisition unit 321 transmits the received moving image data to the generation unit 34.

The second acquisition unit 322 can receive the input information corresponding to the moving image content from the viewer terminal 20. Specifically, the input information received by the second acquisition unit 322 from the viewer terminal 20 is the identification information of the video content being viewed, the comment input by the viewer, or the emotion image to be input to the content display screen ( Communication image) Information about the EM (identification information, etc.) and operation information of the viewer terminal 20 by the viewer (operation time length, pressure during operation, etc.) may be included. The second acquisition unit 322 transmits the received input information to the generation unit 34.

The emotion image EM is an image for expressing the emotions and intentions of the viewer by characters, colors, etc., and is input to the content display screen based on the operation of the viewer, and is between the viewer and the distributor. It is a means to facilitate communication in.

The distribution control unit 35 controls the operation of real-time distribution of image data. The distribution control unit 35 receives the distribution request from the viewer terminal 20 from the reception unit 32, and controls the distribution unit 38 so that the image data is distributed to the viewer terminal 20. Further, the distribution control unit 35 includes, for example, a clock (not shown), compares the time information obtained from the clock with the time frame assigned to the real-time distribution of the image data, and manages the start and end of the real-time distribution of the image data. You may. Further, the distribution control unit 35 starts distribution of the video content in real time when the video data for distribution is received, and starts distribution of the video content when the video data for distribution ends. And may manage termination.

The generation unit 34 includes a charge amount management unit 36. The charge amount management unit 36 receives a distribution request from the viewer terminal 20 from the reception unit 32, and receives input information from the viewer terminal 20 from the second acquisition unit 322.

The charge amount management unit 36 identifies the viewer or the viewer terminal 20 based on the acquired distribution request, and charges each viewer (or each viewer terminal 20) for each of the video contents distributed in real time. Allocate the amount. When the charge amount management unit 36 manages the charge amount for each viewer, the charge amount is managed by using the viewer identification information (user name, password, member level, etc.) registered in advance. It can be carried out. The viewer identification information may be stored in the storage unit of the moving image distribution device 30, or may be managed by an external server of the moving image distribution device 30.

The maximum value of the charge amount assigned to each viewer may differ depending on the membership level of the viewer. For example, the charge amount management unit 36 can manage the charge amount so that the maximum value of the charge amount is larger than that of the general member for the premium member whose level is higher than that of the general member.

The charge amount management unit 36 manages the charge amount consumed by the emotion image EM input from the viewer terminal 20 based on the distribution request and the input information from the viewer terminal 20. The charge amount management unit 36 consumes, for example, the charge amount corresponding to the input emotion image EM for each moving image content viewed by the viewer from the charge amount assigned to each viewer. The amount of charge consumed by inputting the emotion image EM into the moving image content may be the same or different. When the charge amount consumed for each emotion image EM is different, for example, the identification information of the emotion image EM and the charge amount consumed are associated and stored in the storage unit.

Further, the charge amount management unit EM increases the value of the charge amount according to the passage of time so that the charge amount recovers from zero to the maximum value after the lapse of a predetermined time. As another aspect of recovering the charge amount, the charge amount management unit EM does not need to recover the charge amount from zero to the maximum value, for example, when the charge amount is recovered to a value smaller than the maximum value. Recovery may be stopped once. Further, even during the recovery of the charge amount, the viewer can input the emotion image EM into the moving image content as long as the consumption amount by the emotion image EM is exceeded.

The charge amount management unit 36 allocates to each viewer when the current value of the charge amount assigned to each viewer is equal to or greater than the value corresponding to the emotion image EM in each of the contents delivered in real time. Display information for displaying the emotion image EM is generated by consuming the charged amount.

When the current value of the charge amount assigned to each viewer is less than the value corresponding to the emotion image in each of the contents delivered in real time, the charge amount management unit 36 is, for example, insufficient in the charge amount. Generate display information to indicate what you are doing.

Further, the charge amount management unit 36 manages the input history of the emotion image EM for each of the distributed video contents in the period from the start to the end of the distribution based on the input information from the viewer terminal 20. can do. For example, the charge amount management unit 36 counts the number of inputs for each emotion image EM for each of the distributed contents, displays a graph showing the number of inputs in descending order of the number of inputs, and corresponds to the vicinity of the graph. It is possible to generate display information for displaying the emotion image EM to be displayed as an index. The history management of the emotion image EM input to the moving image content will be described later with reference to the drawings.

The generation unit 34 receives real-time moving image data from the first acquisition unit 321 and receives input information by the viewer from the second acquisition unit 322. The generation unit 34 can generate the moving image data for distribution so that the comment and the emotion image EM based on the input information input from the viewer terminal 20, for example, are superimposed on the real-time moving image data. The generation unit 34 may synthesize a comment and an emotion image EM with the real-time moving image data by using a known technique such as alpha blending or picture-in-picture. Further, the generation unit 34 may generate the moving image data for distribution so that the viewer terminal 20 can synthesize the comment and the emotion image EM with the real-time moving image data. The generation unit 34 transmits the generated video data for distribution to the distribution unit 38.

The generation unit 34 may, for example, resize a part or all of the screen of the reproduced video of the real-time moving image data, trim a part of the screen and combine it with the input information, or the reproduced video of the real-time moving image data. It may be combined with the evaluation information so that a part of the screen of is exposed and the rest is hidden. Further, the generation unit 34 generates a plurality of distribution video data having different images to be displayed in order to enable distribution by switching a plurality of distribution video data in response to a distribution request from the viewer terminal. It may be transmitted to 38.

Further, when the generation unit 34 displays the emotion image EM on the viewer terminal 20 based on the display information generated by the charge amount management unit 36, the generation unit 34 determines that the emotion image EM is displayed according to the type of the emotion image EM, as will be described later. Emotion video data for distribution can be generated so that the image performs a predetermined operation on the display screen. The generation unit 34 can transmit 38 distribution video data including the generated emotion video data for distribution to the distribution unit.

The distributed moving image data, the data for displaying the comment, and the distribution emotion moving image data can be combined and displayed on the viewer terminal 20. The distribution unit 38 may distribute the distribution video data, the data for displaying the comment, and the distribution emotion video data to the viewer terminal after the generation unit 34 synthesizes the distribution video data in advance.

In addition, the generation unit 34 arranges a transparent obstacle that is not visible to the viewer on the display screen, and guides the emotion image EM to the outside of the screen or the surrounding area so as not to interfere with the viewing of the video content. Can be done.

The distribution unit 38 is communicably connected to the network, receives distribution video data from the generation unit 34, and distributes it to the viewer terminal 20 that has received the distribution request. The distribution unit 38 controls, for example, the distribution destination of the video data for distribution by the distribution control unit 35.
The distribution unit 38 may immediately discard the distributed moving image data for distribution, but may buffer it for a predetermined period to enable replay or slow motion reproduction, for example.

Hereinafter, an example of the operation of the moving image distribution device 30 will be specifically described with reference to an example of the display screen of the moving image content on the viewer terminal 20.
FIG. 3 is a diagram schematically showing a display example of the content delivered in real time on the viewer terminal. Here, an example of content display when the viewer terminal 20 is a personal computer is shown.

In the display example of FIG. 3, the first area 100 including the portion where the moving image content is displayed and the second area 110 for presenting the list of the emotion image EM to the viewer are displayed side by side on the computer screen. There is.

The first area 100 includes a portion where video content is displayed, a portion where operation buttons, a time bar, and the like are displayed, and an input field for a viewer to input a comment.

Various emotion image EMs are input to the moving image contents. Here, an example in which a plurality of types of emotion image EMs are input is shown. These emotion image EMs are, for example, a motion of falling from the top of the screen to the bottom of the screen, a motion of growing from the bottom of the screen, a motion of being thrown into the screen, a motion of rolling from either the left or right at the bottom of the screen, an image. The movement is to emphasize the emotions and intentions of the viewer expressed by the emotion image EM, such as blinking movements, bursting or exploding images, and bouncing movements like elastic bodies. ..

For the operation of the emotion image EM, for example, in the generation unit 34 of the moving image distribution device 30, physical calculations such as movement, collision, fluid, etc. of what is obtained from classical mechanical rules (mass, velocity, friction, wind), etc. are performed. Can be determined by For example, the generation unit 34 calculates the operation of the emotion image EM based on the physical law by using the values such as mass, weight, elastic modulus, surface friction coefficient, and hardness set for each of the emotion image EM. Can be done.

The generation unit 34 can generate distribution moving image data so that the emotion image EM is guided to the outside of the display area or gradually disappears after the emotion image EM stays in the screen for a predetermined time. The generation unit 34 may adjust a predetermined time until the emotion image EM is not displayed on the screen based on the number of emotion image EMs input to the content moving image per unit time.

Further, when the number of emotion image EMs input to the moving image content per unit time exceeds a predetermined threshold value, the generation unit 34 may thin out the emotion image EMs and display them. As described above, by adjusting the time and the number of times the emotion image EM is displayed, the viewer is not hindered from viewing the video content. The generation unit 34 can control, for example, the number of emotion image EMs input per fixed number of seconds and the number of emotion image EMs staying on the display screen of the viewer terminal 20.

In addition, the generation unit 34 arranges a transparent obstacle that is not visible to the viewer on the display screen, and guides the emotion image EM to the outside or the surrounding area of the screen so as not to interfere with the viewing of the video content. be able to. For example, the generation unit 34 may arrange a transparent object on the screen as an obstacle of the emotion image EM so that the bottom portion on which the emotion image EM falls is inclined with respect to the horizontal. As a result, for example, the emotion image EM that has fallen from the top to the bottom of the screen can be guided out of the screen by rolling or sliding down on a transparent object arranged at the bottom.

Further, for example, the generation unit 34 may arrange a transparent object in the center of the screen as an obstacle of the emotion image EM. As a result, for example, the emotion image EM falling from the top to the bottom of the screen and the emotion image EM thrown into the screen do not cross the center of the screen, and the emotion image EM extending from the bottom of the screen toward the top reaches the center of the screen. There will be no such thing. Therefore, the emotion image EM does not prevent the viewer from viewing the video content.

FIG. 4 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. Here, the second region 110 shown in FIG. 3 is schematically shown.
The second area 110 includes a charge display area 112 for displaying the charge amount, an emotion list display area 114 for displaying a list of emotion image EMs, and a history display area 116 for displaying an input history of emotion image EMs.

A plurality of emotion image EMs are arranged side by side in the emotion list display area 114. The viewer can select, for example, by clicking the emotion image EM to be input in the emotion list display area 114. The viewer terminal may be provided with a sensor that detects that the viewer has touched the display screen. In that case, the viewer uses a finger, a touch pen, or the like to input the emotion image EM to be input in the emotion list display area 114. It is possible to select by contact. The identification information of the emotion image EM selected by the viewer is transmitted to the moving image distribution device 30 as input information.

5 to 7 are diagrams schematically showing a part of a display example of the content delivered in real time on the viewer terminal. 5 to 7 schematically show a plurality of display examples of the charge display area 112 shown in FIG.

The charge display area 112 is arranged above the emotion list display area 114 (upper side in the vertical direction on the display screen). In the charge display area 112, an icon ICN set for each viewer, a user name, and a graph BR visually showing the charge amount are displayed.

The graph BR is a bar graph extending in the horizontal direction on the display screen of the viewer terminal. When the charge amount is 100%, the maximum length is reached, and the graph length is displayed so as to change according to the charge amount. The charge amount is managed by the charge amount management unit 36 for each viewer for each of the contents distributed in real time. The consumption amount of the charge amount is set for each emotion image EM, and the viewer can input the emotion image EM into the moving image content by using the assigned charge amount.

For example, when a viewer having a charge amount of 500 for the content being viewed inputs an emotion image EM that consumes the charge amount of 100, the remaining charge amount of the viewer becomes 400, and the graph BR shows. The horizontal length is shortened by the amount of charge (100) consumed.

The maximum value of the charge amount may differ depending on the user level of the viewer. For example, in the display example shown in FIG. 5, the user level of the viewer is high, and the maximum value of the charge amount is 1,500. In the display example shown in FIG. 6, the user level of the viewer is low, and the maximum value of the charge amount is 500.

FIG. 7 shows a display example of the charge display area 112 when the charge amount becomes zero. The charge amount is managed by the charge amount management unit 36 so as to recover from the 0% state to 100% after a lapse of a predetermined time. When the charge amount is lower than the value at which the emotion image EM can be input, for example, the emotion image EM cannot be selected (inactive display), and a display such as "Please wait until recovery" is displayed near the graph BR. May be done.

FIG. 8 is a diagram schematically showing a part of a display example of the content delivered in real time on the viewer terminal. Here, a display example of the history display area 116 shown in FIG. 4 is schematically shown.

The history display area 116 is arranged below the emotion list display area 114 (lower side in the vertical direction on the display screen). In the history display area 116, the histories of the emotion image EMs that have been input up to the present time in the video content being viewed by the viewer are arranged side by side in descending order of the number of inputs.

In the example shown in FIG. 8, in the history display area 116, a graph G1-G5 corresponding to the number of inputs and an emotion image EM corresponding to each of the graphs G1-G5 are displayed. The graphs G1-G5 are bar graphs extending in the horizontal direction on the display screen, and the horizontal length of the graphs G1-G5 is set according to the number of input emotion image EMs. The graphs G1-G5 are arranged side by side in the horizontal direction on the display screen.

In this example, the number of input of emotion image EM increases in the order of "grass", "donmai", "I see", "congratulations", and "W". For example, the emotion image EM of "grass" having the largest number of inputs is displayed in the vicinity of the corresponding graph G1.

FIG. 9 is a diagram schematically showing an example of an emotion image displayed on a part of the display screen of the viewer terminal.
In this example, a part of the first region 100 is shown, and an emotion image EM with characters such as "Otsu", "I see", "Cute", "Grass", "W", and "Like", and Emotion image EM with a heart-shaped figure is put into the moving image content.

In these emotion image EMs, colors, shapes, and movements are set so as to express the emotions and intentions of the viewer. For example, an emotional image EM with the letters "grass" can be set to mimic the movement of grass growing from the ground. For example, the emotion image EM with a heart-shaped figure can be set to be input from the upper side in the vertical direction of the display screen and to fall down while drifting in the screen fluffy. For example, the emotion image EM using the letter "W" may be set to bounce or vibrate in the display screen in order to indicate that the viewer is laughing.

The operation of the plurality of emotion image EMs input to the content can be set by physical calculation in the generation unit 34, for example, and when the operation at the time of input is completed, the emotion images EM are stacked on the bottom of the screen by gravity. Since the emotion image EM is displayed so as to be guided to the outside of the screen or gradually disappear after staying in the screen for a predetermined time, the screen is filled with the emotion image EM and the video content is viewed. Is not disturbed.

Although the display example of the viewer terminal 20 based on the video data for distribution supplied from the video distribution device 30 has been described with reference to FIGS. 3 to 9, the display example on the viewer terminal 20 is not limited to this. ..
FIG. 10 is a diagram schematically showing another display example of the content delivered in real time on the viewer terminal. Here, a display example when the viewer terminal 20 is a mobile terminal such as a smartphone or a tablet terminal is schematically shown.

In the display example of FIG. 10, the third area 200 including the portion where the moving image content is displayed and the fourth area 210 presenting the list of the emotion image EM to the viewer are displayed side by side on the screen of the mobile terminal, for example. Has been done.

The third area 200 is a modification of the display form of the first area 100 shown in FIG. 3, and the part where the moving image content is displayed, the part where the operation buttons, the time bar, and the like are displayed, and the viewer. It includes an input button for inputting comments.

The fourth area 210 is a modification of the display form of the second area 110 shown in FIG. 3, and the fourth area 210 displays a charge display area 212 for displaying the charge amount and a list of emotion image EMs. It includes an emotion list display area 214 and a history display area 216 for displaying the input history of the emotion image EM.

Since the display elements included in the third area 200 and the fourth area 210 are the same as the display example when the viewer terminal 20 is a personal computer, the description thereof is omitted here.

A mobile terminal such as a smartphone or a tablet terminal has a sensor that detects a position where the viewer touches on the display screen, and the viewer can use any of the emotion image EMs presented in the emotion list display area 214. The emotion image EM to be input to the moving image content can be selected by selecting the image with a finger or a touch pen.

FIG. 11 is a flowchart for explaining an example of a moving image distribution method in the moving image distribution device of the first embodiment.
In the video distribution device 30, the first acquisition unit 321 acquires real-time video data supplied from the distributor terminal 10 (step S1).

The second acquisition unit 322 acquires input information including information of the emotion image (communication image) EM selected by the viewer operating the viewer terminal 20 (step S2). The input information supplied from the viewer terminal 20 may include the information of the comment input by the viewer.

Subsequently, the generation unit 34 receives real-time moving image data from the first acquisition unit 321 and input information from the second acquisition unit 322. Further, the generation unit 34 can receive the distribution request from the viewer terminal 20 via the reception unit 32.

The generation unit 34 can specify the viewer or the viewer terminal 20 and the moving image content that the viewer is viewing by the distribution request from the viewer terminal 20 and the input information. Further, the generation unit 34 can specify the emotion image EM input to the moving image content visually recognized by the viewer based on the identification information of the emotion image EM included in the input information. The generation unit 34 uses the display information generated by the charge amount management unit 36 to generate distribution emotion video data that performs a predetermined operation on the display screen of the viewer terminal 20, and the distribution emotion video data and real time. Video data for distribution can be generated using the video data (step S3).

The distribution unit 38 receives the distribution video data from the generation unit 34, and distributes the distribution video data to the viewer terminal 20 that has received the distribution request under the control of the distribution control unit 35 (step S4).

As described above, according to the video distribution device, the video distribution method, and the video distribution program of the present embodiment, two-way communication between the distributor who distributes the video content by live broadcasting and the viewer thereof is facilitated, and the video content is produced. It is possible to provide exciting services.

Next, the video distribution device, the video distribution method, and the video distribution program of the second embodiment will be described in detail with reference to the drawings.
In the following description, the same reference numerals will be given to the same configurations as those of the first embodiment described above, and the description thereof will be omitted.

In the moving image distribution device of the present embodiment, the operation of the charge amount management unit 36 is different from that of the first embodiment described above.
In the present embodiment, in the operation of selecting and inputting the emotion image EM while the viewer is watching the live video content, for example, the time of the operation of moving the cursor to the emotion image EM and pressing and holding the mouse for a long time. The pressure generated on the display screen by the operation of touching the length or the emotion image EM with a fingertip or a touch pen is supplied from the viewer terminal 20 to the moving image distribution device 30 as input information. The pressure information generated on the display screen by the operation of the viewer may be the value of the pressure detected by the pressure sensor in the viewer terminal 20, and the viewer fingertips the display screen of the viewer terminal 20. It may be the value of the contact area at the time of contact with. The charge amount management unit 36 may be configured to be able to calculate the value of the pressure at the time of operation based on the value of the contact area at the time of operation supplied from the viewer terminal 20.

FIG. 12A is a diagram for explaining an example of operation of a viewer terminal that displays content delivered in real time.
Here, a case where the emotion image EM with the characters "Wakotsu" is selected from the list of the emotion image EMs displayed in the second area 110 (or the fourth area 210) of the display screen of the viewer terminal 20 is selected. This will be described as an example.

The viewer can adjust the amount of charge consumed by the selected emotion image EM according to the length of time for the operation of clicking the mouse or touching the screen and the pressure generated on the screen during the operation.

The charge amount management unit 36 of the video distribution device 30 is based on the information on the operation time length and the pressure at the time of operation included in the input information from the viewer terminal 20, and the second region 110 (or the second region 110) in the viewer terminal 20. The display state of the 4 areas 210) can be changed. For example, when the viewer moves the cursor on the emotion image EM with the characters "Wakotsu" and clicks the mouse (or touches with a fingertip or a touch pen), the emotion image EM with the characters "Wakotsu" is selected. On the selected emotion image EM, a circular (or arcuate) bar graph showing the amount of charge consumed and the level of the amount of charge consumed is displayed.

FIG. 12A shows how the charge amount consumed by the selected emotion image EM changes in four stages. When the operation time length included in the input information or the pressure at the time of operation is equal to or less than the first threshold value, the charge amount management unit 36 consumes a charge amount of "100" and an emotion image with the characters "Wakotsu". Display information can be generated so that "100" is displayed in the vicinity of the EM and a circular bar graph surrounding the emotion image EM is displayed.

In the charge amount management unit 36, when the operation time length included in the input information or the pressure at the time of operation becomes larger than the first threshold value, the charge amount consumed exceeds "100" according to the operation time length or the pressure value. Can be a value. The charge amount management unit 36 sets the initial value of the charge amount to be consumed to "100", and sets the maximum value to "500" when the operation time length or the pressure exceeds the second threshold value (> first threshold value). It may be set to continuously change from the initial value to the maximum value depending on the operation time length or the pressure value, and a plurality of threshold values are provided between the first threshold value and the second threshold value. Each time the operation time length or the pressure value exceeds the threshold value, the charge amount consumed stepwise (discontinuously) increases (for example, "100", "200", ... "500", which increases discontinuously. ) May be set.

The charge amount management unit 36 changes the numerical value of the consumption charge amount displayed in the vicinity of the emotion image EM in the second region 110 (or the fourth region 210) according to the charge amount to be consumed, and also changes the numerical value of the consumption charge amount to be displayed in the vicinity of the emotion image EM. Display information can be generated to change the length of the arcuate bar graph displayed along the circle surrounding.

Further, the charge amount management unit 36 displays display information so as to change the size of the emotion image EM selected in the second region 110 (or the fourth region 210) according to the value of the charge amount consumed. It may be generated. In the example shown in FIG. 12A, as the amount of charge consumed increases, the selected emotion image EM is also displayed larger.
The generation unit 34 can generate video data for distribution based on the display information generated by the charge amount management unit 36, and the magnitude (or operation time length or pressure) of the charge amount of the emotion image EM. The size and operation of the emotion image EM can be changed according to the value of) and input to the moving image content.

Note that FIG. 12A shows a display example when the emotion image EM with the characters “Wakotsu” is selected, but the same applies even when another emotion image EM is selected.

FIG. 12B is a diagram showing a part of a display example of the viewer terminal shown in FIG. 12A.
Here, only the consumption charge amount displayed on the emotion image EM selected by the viewer and the image of the circular or arcuate graph are shown. The viewer can select other emotion image EMs other than the characters of "Wakotsu", and the charge amount management unit 36 can also select other emotion image EMs for the length of operation time or operation by the viewer. The amount of charge consumed can be adjusted according to the pressure of.

The moving image distribution device 30 of the present embodiment is the same as the above-mentioned first embodiment except for the above.

That is, according to the video distribution device, the video distribution method, and the video distribution program of the present embodiment, a service that facilitates two-way communication between the distributor who distributes the video content by live broadcasting and the viewer thereof, and excites the video content. Can be provided.

Next, the video distribution device, the video distribution method, and the video distribution program of the third embodiment will be described in detail with reference to the drawings.
FIG. 13 is a block diagram schematically showing a configuration example of the moving image distribution device according to the third embodiment.
In the moving image distribution device 30 of the present embodiment, the receiving unit 32 further includes a third acquisition unit 323.

The third acquisition unit 323 acquires the input information supplied from the distributor terminal 10. The input information from the distributor terminal 10 is, for example, information requesting batch deletion of emotion image EM input to video content being broadcast live, information requesting prohibition of input of emotion image EM, and input emotion image. Information requesting adjustment of the transparency of the EM, information requesting adjustment of the staying time on the display screen of the viewer terminal 20 of the input emotion image EM, and a predetermined operation on the display screen of the viewer terminal 20. Information requesting the input of the emotion image for the distributor to be performed and information requesting the thinning of the input emotion image EM may be included. The third acquisition unit 323 supplies the input information from the distributor terminal 10 to the generation unit 34.

The generation unit 34 can generate video data for distribution based on the input information supplied from the third acquisition unit 323.

When the generation unit 34 receives the information requesting the batch deletion of the emotion image EM as input information, for example, the emotion image EM input to the corresponding video content is blown off by the wind or the bomb explodes on the display screen. Image data for distribution can be generated so as to be blown out.

Further, when the generation unit 34 receives the information requesting the prohibition of input of the emotion image EM as input information, for example, the generation unit 34 displays an image indicating the prohibition of input of the emotion image EM as a part of the moving image content and the second area. Image data for distribution can be generated so that the emotion image EM cannot be selected (inactive state) in 110 (or the fourth area 210).

Further, when the generation unit 34 receives the information requesting the adjustment of the transparency of the input emotion image EM as input information, for example, the transparency (for example, when the emotion image EM is displayed on the display screen of the viewer terminal 20). The transmittance) can be adjusted to the requested value and displayed.

Further, when the generation unit 34 receives as input information information requesting adjustment of the staying time on the display screen of the viewer terminal 20 of the input emotion image EM, for example, the emotion image EM is the viewer terminal 20. The time spent on the display screen can be adjusted as requested to stay on the display screen shorter or longer.

Further, the generation unit 34 can also receive as input information information requesting the input of the distributor's emotion image that performs a predetermined operation on the display screen of the viewer terminal 20. For example, the distributor can input the emotion image for the distributor of the bomb that blows off the emotion in the screen by the explosion into the video content, and the generation unit 34 inputs the emotion image for the distributor into the video content. It is possible to perform a predetermined operation.

Further, when the generation unit 34 receives the information requesting the thinning of the input emotion image EM as the input information, the image data for distribution is such that some of the emotion image EMs input to the moving image content are randomly thinned. It is possible to generate image data for distribution so as to shorten the time from when the input emotion image EM is displayed on the display screen of the viewer terminal 20 until it disappears.
The moving image distribution device 30 of the present embodiment is the same as the above-mentioned first embodiment except for the above.

That is, according to the video distribution device, the video distribution method, and the video distribution program of the present embodiment, a service that facilitates two-way communication between the distributor who distributes the video content by live broadcasting and the viewer thereof, and excites the video content. Can be provided.

The present invention is not limited to the above embodiment, and can be variously modified at the implementation stage without departing from the gist thereof. In addition, each embodiment may be carried out in combination as appropriate, in which case the combined effect can be obtained. Further, the above-described embodiment includes various inventions, and various inventions can be extracted by a combination selected from a plurality of disclosed constituent requirements. For example, even if some constituent elements are deleted from all the constituent elements shown in the embodiment, if the problem can be solved and the effect is obtained, the configuration in which the constituent elements are deleted can be extracted as an invention.

10 ... Distributor terminal, 20 ... Viewer terminal, 30 ... Video distribution device, 32 ... Receiver unit, 34 ... Generation unit, 35 ... Distribution control unit, 36 ... Charge amount management unit, 38 ... Distribution unit, 100 ... First Area, 110 ... 2nd area, 112, 212 ... Charge display area, 114, 214 ... Emotion list display area, 116, 216 ... History display area, 200 ... 3rd area, 210 ... 4th area,
321 ... 1st acquisition unit, 322 ... 2nd acquisition unit, 323 ... 3rd acquisition unit, EM ... emotion image (communication image), G1-G5, BR ... graph

The video distribution device according to the first aspect of the present invention includes a first acquisition unit that acquires real-time video data supplied from a distributor terminal, information on a communication image selected by operating the viewer terminal, and the viewer terminal. The second acquisition unit that acquires the input information including the time length of the operation or the information of the pressure on the screen when the viewer terminal is operated, and the real-time video data delivered to the viewer terminal, respectively. The charge amount is allocated to each viewer who operates the viewer terminal, and the charge amount consumed by displaying the communication image is less than the current value of the charge amount assigned to the viewer. Occasionally, the communication image is displayed by consuming a numerical value corresponding to the time length or the pressure information from the charge amount assigned to the viewer, and display information including the time length or the pressure information. The communication image is displayed in a predetermined size based on the display information or performs a predetermined operation on the viewer terminal by using the charge amount management unit for generating the data and the real-time moving image data and the communication image data. The video data for distribution generated so as to be displayed, or the communication image is displayed in a predetermined size based on the display information on the viewer terminal, or a predetermined operation is performed based on the display information. Also provided with a distribution unit that distributes distribution video data to the viewer terminal, which enables the viewer terminal to synthesize the communication image and the real-time video data.

The video distribution device according to the second aspect of the present invention acquires input information including information of a communication image selected by operating the viewer terminal and a first acquisition unit that acquires real-time video data supplied from the distributor terminal. When the second acquisition unit, the third acquisition unit that acquires the input information supplied from the distributor terminal, and the input information from the viewer terminal include information requesting the input of the communication image for the distributor. For distribution, the communication image and the communication image for the distributor are generated so as to perform a predetermined operation on the viewer terminal using the real-time video data, the communication image, and the data of the communication image for the distributor. A distribution unit that distributes video data or distribution video data that enables the viewer terminal to synthesize the communication image, the real-time video data, and the communication image for the distributor, and a distribution unit that distributes the distribution video data to the viewer terminal. To prepare for .

The moving image distribution device according to the third aspect of the present invention is the moving image distribution device according to the first aspect, in which the charge amount management unit responds to the passage of time so that the charge amount recovers from zero to the maximum value after a predetermined time elapses. The value of the charge amount is increased.
In the moving image distribution device according to the fourth aspect of the present invention, in the moving image distribution device according to the first aspect or the second aspect, the input information supplied from the viewer terminal includes the identification information of the selected communication image, and is described above. Further, a generation unit for generating the moving image data for distribution is provided so as to perform an operation corresponding to the identification information when the communication image is displayed on the viewer terminal .

The video distribution device according to the fifth aspect of the present invention is the video distribution device according to the first aspect, in which the charge amount management unit performs the communication based on the input information during the period from the start to the end of the distribution of the real-time video data. Manage the image input history .
The moving image distribution device according to the sixth aspect of the present invention is the moving image distribution device according to the second aspect, in which the input information from the distributor terminal is a batch deletion of the communication image displayed on the viewer terminal, the communication. It may include request information for prohibiting input of an image, adjusting the transparency of the input communication image, adjusting the staying time of the input communication image on the display screen, or thinning out the input communication image. , The distribution unit distributes the distribution moving image data based on the request information included in the input information from the distributor terminal .

The video distribution method according to the seventh aspect of the present invention includes a first acquisition step of acquiring real-time video data supplied from the distributor terminal, input information including information of a communication image selected by operating the viewer terminal, and input information. The second acquisition step of acquiring the information on the time length at which the viewer terminal is operated or the pressure information on the screen when the viewer terminal is operated, and the real-time moving image data delivered to the viewer terminal, respectively. The charge amount is allocated to each viewer who operates the viewer terminal, and the charge amount consumed by displaying the communication image is less than the current value of the charge amount assigned to the viewer. Occasionally, the communication image is displayed by consuming a numerical value corresponding to the time length or the pressure information from the charge amount assigned to the viewer, and display information including the time length or the pressure information. The communication image is displayed in a predetermined size based on the display information on the viewer terminal using the real-time moving image data and the communication image data, or is displayed so as to perform a predetermined operation. The video data for distribution generated so as to be performed, or the communication image is displayed in a predetermined size based on the display information on the viewer terminal, or is displayed so as to perform a predetermined operation based on the display information. In addition, the viewer terminal includes a distribution step of distributing the video data for distribution that enables the communication image and the real-time video data to be synthesized to the viewer terminal .

In the video distribution method according to the eighth aspect of the present invention, the first acquisition step of acquiring real-time video data supplied from the distributor terminal and the input information including the information of the communication image selected by the operation of the viewer terminal are acquired. When the second acquisition step, the third acquisition step of acquiring the input information supplied from the distributor terminal, and the input information from the viewer terminal include the information requesting the input of the communication image for the distributor. For distribution, the communication image and the communication image for the distributor are generated so as to perform a predetermined operation on the viewer terminal using the real-time video data, the communication image, and the data of the communication image for the distributor. A distribution step of distributing video data or distribution video data that enables the viewer terminal to synthesize the communication image, the real-time video data, and the distributor communication image, and a distribution step. To prepare for .

The moving image distribution program according to the ninth aspect of the present invention causes a computer to execute the moving image distribution method according to the seventh or eighth aspect .
The recording medium according to the tenth aspect of the present invention is a computer-readable recording medium in which the moving image distribution program according to the ninth aspect is recorded on the computer.

The video distribution device according to the second aspect of the present invention is the video distribution device according to the first aspect, in which the charge amount management unit responds to the passage of time so that the charge amount recovers from zero to the maximum value after a predetermined time has elapsed. The value of the charge amount is increased.
In the video distribution device according to the third aspect of the present invention, in the video distribution device according to the first aspect , the input information supplied from the viewer terminal includes the identification information of the selected communication image, and the communication image is the said. Further, a generation unit for generating the video data for distribution is provided so as to perform an operation corresponding to the identification information when displayed on the viewer terminal.

The video distribution device according to the fourth aspect of the present invention is the video distribution device according to the first aspect, and the charge amount management unit has the communication based on the input information during the period from the start to the end of the distribution of the real-time video data. Manage the image input history.

The video distribution method according to the fifth aspect of the present invention includes a first acquisition step of acquiring real-time video data supplied from the distributor terminal, input information including information of a communication image selected by operating the viewer terminal, and input information. The second acquisition step of acquiring the information on the time length at which the viewer terminal is operated or the pressure information on the screen when the viewer terminal is operated, and the real-time moving image data delivered to the viewer terminal, respectively. The charge amount is allocated to each viewer who operates the viewer terminal, and the charge amount consumed by displaying the communication image is less than the current value of the charge amount assigned to the viewer. Occasionally, the communication image is displayed by consuming a numerical value corresponding to the time length or the pressure information from the charge amount assigned to the viewer, and display information including the time length or the pressure information. The communication image is displayed in a predetermined size based on the display information on the viewer terminal using the real-time moving image data and the communication image data, or is displayed so as to perform a predetermined operation. The video data for distribution generated so as to be performed, or the communication image is displayed in a predetermined size based on the display information on the viewer terminal, or is displayed so as to perform a predetermined operation based on the display information. In addition, the viewer terminal includes a distribution step of distributing the video data for distribution that enables the communication image and the real-time video data to be synthesized to the viewer terminal.

The moving image distribution program according to the sixth aspect of the present invention causes a computer to execute the moving image distribution method according to the fifth aspect.

Claims (9)

The first acquisition unit that acquires real-time video data supplied from the distributor terminal,
A second acquisition unit that acquires input information including information on the communication image selected by operating the viewer terminal, and
A generation unit that generates video data for distribution using the communication image data that performs a predetermined operation on the display screen and the real-time video data.
A video distribution device including a distribution unit that distributes the video data for distribution. The generation unit allocates a charge amount to each viewer who operates the viewer terminal for each of the real-time video data delivered to the viewer terminal, and the charge amount consumed by displaying the communication image. Is less than the current value of the charge amount assigned to the viewer, the charge amount assigned to the viewer is consumed to generate display information for displaying the communication image. With more management department
The moving image distribution device according to claim 1, wherein the generation unit generates the distribution moving image data by using the display information and the real-time moving image data. The moving image distribution device according to claim 2, wherein the charge amount management unit increases the value of the charge amount according to the passage of time so that the charge amount recovers from zero to the maximum value after the lapse of a predetermined time. The input information includes information on the length of time that the viewer terminal is operated or the pressure on the screen when the viewer terminal is operated, and the identification information of the selected communication image.
The charge amount management unit consumes a numerical value corresponding to the information of the time length or the pressure from the charge amount, and generates the display information including the information of the time length or the pressure.
The moving image distribution device according to claim 2, wherein the generation unit changes the operation or size of the communication image according to the time length or the pressure. The input information includes the identification information of the selected communication image.
The video distribution device according to claim 1, wherein the generation unit generates video data for distribution so as to perform an operation corresponding to the identification information when the communication image is displayed on the viewer terminal. The one according to any one of claims 2 to 4, wherein the charge amount management unit manages the input history of the communication image based on the input information in the period from the start to the end of the distribution of the real-time video data. Video distribution device. Further, a third acquisition unit for acquiring input information supplied from the distributor terminal is provided.
Based on the input information from the distributor terminal, the generation unit collectively erases the communication image displayed on the viewer terminal, prohibits input of the communication image, and determines the transparency of the input communication image. Adjusting, adjusting the staying time of the input communication image on the display screen, inputting the communication image for a distributor performing a predetermined operation on the display screen, or thinning out the input communication image. The moving image distribution device according to claim 1, wherein the moving image data for distribution can be generated. The first acquisition step to acquire real-time video data supplied from the distributor terminal,
The second acquisition step of acquiring the input information including the information of the communication image selected by the operation of the viewer terminal, and
A generation step of generating video data for distribution using the communication image data that performs a predetermined operation on the display screen and the real-time video data.
A video distribution method comprising the distribution step of distributing the video data for distribution. Computer,
The first acquisition means for acquiring real-time video data supplied from the distributor terminal,
A second acquisition means for acquiring input information including information of the communication image selected by operating the viewer terminal, and
A generation means for generating video data for distribution using the communication image data that performs a predetermined operation on a display screen and the real-time video data.
A video distribution program that functions as a distribution means for distributing the video data for distribution.

Images