JP2024018464A - Distribution system - Google Patents

Abstract

To allow a distributor which distributes a distribution video to properly confirm the state of a viewer.SOLUTION: A distribution system includes a distribution apparatus, a plurality of viewing apparatuses and a monitor unit which are connected over a network. The distribution apparatus includes distribution video transmission means which transmits a distribution video to be distributed. The viewing apparatus includes distribution video receiving means which receives the distribution video and camera video transmission means which transmits a camera video captured by a camera. The monitor unit includes receiving means which receives the camera video transmitted from the viewing apparatus, determination means which determines a degree of excitement of a viewer who views the distribution video on the viewing apparatus, and monitor video forming means which forms a monitor video by using the camera video transmitted from the viewing apparatus on the basis of the degree of excitement of the viewer viewing the distribution video on the viewing apparatus, the degree of excitement being determined by the determination means.SELECTED DRAWING: Figure 1

Description

The present invention relates to a distribution system that includes a distribution device that distributes distribution video and a viewing device that can view the distributed distribution video.

Currently, various videos such as movies and concerts are being distributed using the Internet. Even in karaoke boxes where you can enjoy karaoke, there are systems that allow you to enjoy not only karaoke but also various distributed videos.

Patent Document 1 describes a content specification process in which the number of viewers specified in the purchase information is obtained by referring to purchase information of content information specified by a user in a store configured with a plurality of rooms, and a content specification process. A content playback system is disclosed that is capable of executing a notification process for notifying the number of viewers obtained in , and a content playback process for playing back content information specified by a user. According to the content playback system of Patent Document 1, it is possible to perform appropriate charging according to the number of people viewing the content.

JP2020-201441A

In an actual concert at a concert venue, the artist listens to the reactions of the audience while performing, thereby making it possible for the audience and the artist to get even more excited. However, as described in Patent Document 1, video distribution of movies, concerts, etc. is a one-way transmission from the distributor to the viewer. You can't understand emotions. In this way, conventionally, the distributor side has not been able to ask the reactions of the viewers who view the distributed video.

In addition, the audience experiencing an actual concert may become even more excited due to the excitement of the surrounding audience, but with video streaming, it was difficult to get a feel for the state and atmosphere of the surrounding audience.

The present invention has been developed in consideration of the actual situation of video distribution, and by displaying excited viewers, the distributor can sense the state and atmosphere of the viewers, or the viewer can One of the aims is to create an even more exciting atmosphere by having people compete in terms of how excited they are.

Therefore, the distribution system according to the present invention employs the following configuration.
A distribution system in which a distribution device, a plurality of viewing devices, and a monitor unit are connected via a network,
The distribution device includes a distribution video transmission means for transmitting distribution video to be distributed,
The viewing device includes:
a distributed video receiving means for receiving the distributed video;
A camera image transmitting means for transmitting a camera image taken by the camera,
The monitor section includes:
Receiving means for receiving camera images transmitted from the viewing device;
determining means for determining the degree of excitement of viewers viewing the distributed video on the viewing device;
a monitor image forming means for forming a monitor image using the camera image transmitted from the viewing device based on the degree of excitement of viewers viewing the distributed video on the viewing device as determined by the determining device; Prepared.

Furthermore, in the distribution system according to the present invention,
The monitor section displays a monitor image on a display section installed on at least one of the distribution device side and the viewing device side.

Furthermore, in the distribution system according to the present invention,
The monitor image forming means determines the camera image to be displayed on the monitor image based on the degree of excitement.

Furthermore, in the distribution system according to the present invention,
The monitor image forming means determines the arrangement of camera images displayed on the monitor image based on the degree of excitement.

Furthermore, in the distribution system according to the present invention,
The determining means uses at least one of the listener's movement included in the camera image, the listener's voice sent along with the camera image, and operation information based on the listener's operation to determine the degree of excitement of the listener. judge.

Furthermore, in the distribution system according to the present invention,
The monitor image forming means displays an index indicating the degree of excitement among viewers in association with the displayed camera image.

According to the distribution system according to the present invention, based on the degree of excitement of the viewing audience, by displaying a monitor image formed using camera images transmitted from each viewing device, the distributor side can It is possible to get a sense of the situation and atmosphere of the event, or it is possible for the viewer to have the viewers compete to see how excited they are.

Diagram showing the configuration of the distribution system of this embodiment Block diagram showing the configuration of the karaoke system of this embodiment Flow diagram showing monitor processing of this embodiment Diagram for explaining the layout of camera images of this embodiment Diagram for explaining the layout of camera images in other embodiments Diagram for explaining the layout of camera images in other embodiments Diagram showing the configuration of a distribution system according to another embodiment

FIG. 1 is a diagram showing the configuration of a distribution system according to this embodiment. In this embodiment, the system configuration assumes distribution by a distributor. The distributor side is provided with a distribution device 9, a camera 91, a monitor section 8, and a monitor 81. The distributor uses the distribution device 9 to transmit the video captured by the camera 91 as a distribution video to the Internet. The distributed video transmitted to the Internet is distributed to private homes, karaoke boxes, and mobile terminals 7, and viewed by users (viewers).

In this embodiment, the viewer can view the program using a viewing device such as a personal computer 6 installed in a private home, a karaoke device 2 installed in a karaoke box, or a mobile terminal 7.

A personal computer 6 installed in a private home is communicatively connected to the Internet via communication equipment such as a router 63. The user can view the distributed video distributed to the personal computer 6 on the monitor 61. Furthermore, a camera 62 is connected to the personal computer 6, so that it is possible to take pictures of the viewer.

Currently, it is possible to view various distributed videos such as concerts, events, movies, etc. at karaoke boxes. The karaoke device 2 is communicatively connected to the Internet via communication equipment such as a router 63. The viewer can view the distributed video distributed to the karaoke device 2 using the monitor 41. Furthermore, a camera 44 is connected to the karaoke apparatus 2, so that it is possible to take pictures of the viewers.

The mobile terminal 7 is a smartphone, a tablet, or the like owned by the user, and is communicatively connected to the Internet by communicating with communication equipment such as a wireless base station 71, for example. The viewer can view the distributed video using the screen provided on the mobile terminal 7. Furthermore, using the camera provided on the mobile terminal 7, it is possible to photograph the viewer viewing the video.

The details of the karaoke device 2, which is one of the viewing devices for viewing, will be described below. FIG. 2 is a block diagram showing the configuration of the karaoke system of this embodiment. The karaoke system in this embodiment includes a karaoke device 2 (sometimes referred to as a commander) and a remote control device 1. The karaoke device 2 and the remote control device 1 are communicably connected to form a network using a LAN 100 and an access point 130.

A karaoke device 2 installed in a store such as a karaoke box includes a sound control section 25 as a performance section for playing music. The karaoke apparatus 2 also includes an operation section 21 that receives various inputs from the user. The karaoke apparatus 2 includes an operation processing section 22 that interprets input from the operation section 21 and transmits the input to the CPU 30. The karaoke device 2 also includes a hard disk 32 as a storage section that stores various information. The karaoke apparatus 2 includes a LAN communication section 24a as a communication means that connects to the LAN 100 and joins the network. The karaoke device 2 of this embodiment also includes a wireless LAN communication unit 24b, and can perform wireless network connection using the wireless LAN communication unit 24b instead of wired network connection using the LAN communication unit 24a. is also possible.

The karaoke apparatus 2 also includes a video playback means for displaying lyrics video and background video on the monitor 41. This video playback means includes a video playback unit 29 that plays back video based on video information, a video RAM 28 that temporarily stores video to be played, and a video that superimposes lyrics subtitles on the played video, adds video effects, etc. It is configured to include a control section 31.

Furthermore, in this karaoke apparatus 2, various information can be displayed on a touch panel monitor 33 in addition to the monitor 41 connected to the outside. The touch panel monitor 33 includes a display section 35 that displays video information input from the video control section 31, and a touch panel 34 that outputs the touch input position to the operation processing section 22, which are superimposed. The touch panel monitor 33 is arranged on the front surface of the casing of the karaoke apparatus 2, and functions as an input section like the operation section 21 of the karaoke apparatus 2 or the touch panel monitor 11 of the remote control device 1. By selecting a song on the touch panel monitor 33, the user can perform various operations on the karaoke device 2, such as making a reservation directly to the karaoke device 2.

Furthermore, the karaoke apparatus 2 is configured with a control section including a CPU 30 for controlling each component in an integrated manner, and a memory 27 for temporarily storing information necessary for executing various programs.

With such a configuration, the karaoke device 2 executes various processes, and the main functions of the karaoke device 2 include music reservation processing, music playback processing, distributed video playback processing, and the like. The music reservation process is a process for designating and reserving music based on user specifications, and is executed in cooperation with the remote control device 1. The reservation information formed by the music selection process of the remote control device 1 is transmitted to the karaoke device 2. The karaoke device 2 registers the received reservation information in the reservation table in the memory 27. The music reproduction process is a process for reproducing a reserved music, and is a process in which a music performance process and a lyrics display process are executed in synchronization.

The music performance process is a process of causing the sound control unit 25 to perform a performance based on the performance information included in the music information. The music played by the sound control section 25 is emitted from the speaker 42 together with the singing voice input from the microphones 43a and 43b. The lyrics display process is a process that assists in singing by displaying the lyrics information included in the song information on the monitor 41. A background video display process may be performed in which a background video is superimposed and displayed on the lyrics displayed in this lyrics display process.

On the other hand, the remote control device 1 is capable of performing a song selection process of searching for songs based on instructions from the user and transmitting reservation information to the karaoke device 2 for the songs for which playback has been instructed. Further, the remote control device 1 can receive various information from the karaoke device 2 or a server device 5 connected to the Internet, and can execute various processes. In this embodiment, an operation unit 17 and a touch panel monitor 11 are provided as a user interface for receiving various instructions from a user. The touch panel monitor 11 includes a display section 11a and a touch panel 11b, and displays various interfaces on the display section 11a, and is capable of accepting touch input from a user.

Furthermore, the remote control device 1 includes a memory 14 as a storage unit for storing a database required for music selection processing, various programs, and various information generated with program execution, and a memory 14 for controlling these components in an integrated manner. It is configured with a remote control side control section. The remote control side control section includes a CPU 15, a video control section 13 that forms an image to be displayed on the touch panel monitor 11, a video RAM 12 that temporarily stores video information to be displayed, and a computer that interprets input from the touch panel monitor 11 or the operation section 17. It includes an operation processing section 18 that transmits the information to the CPU 15.

The remote control device 1 is connected to the network constituted by the LAN 100 by being wirelessly connected to the access point 130 by the wireless LAN communication unit 16. Note that each remote control device 1 is associated with a specific karaoke device 2 in advance. Various commands output from the remote control device 1 are received by the associated karaoke device 2.

With such a configuration of the remote control device 1, various inputs from the user are accepted from the touch panel monitor 11 or the operation unit 17, and video information is provided to the karaoke device 2 by displaying various information on the touch panel monitor 11. It is possible to perform various processing such as song selection processing to send reservation information to be output to the user.

Further, as described in FIG. 1, the camera 44 is connected to the video control section 31 of the karaoke apparatus 2 of this embodiment. The camera 44 is arranged to be able to photograph the viewer viewing the monitor 41, and the camera image photographed by the camera 44 can be transmitted to the Internet via the LAN 100.

By the way, it is difficult for distributors who distribute video to check what viewers think of the video they are distributing and how they react to it. In particular, in live streaming where the viewers are not in front of the broadcaster, it is impossible to capture the reactions of the viewers, and it is difficult to reflect the reactions of the viewers in the distribution. Therefore, there is a possibility that there will be a gap in consciousness between the distributor and the viewers, resulting in a decline in viewership ratings and a drop in the popularity of the distributor.

The present invention has been developed in consideration of such a situation, and one purpose of the present invention is to appropriately convey the reactions of viewers to a distributor. At that time, the viewer's level of excitement is used to appropriately display the camera footage taken by the viewer.

FIG. 3 is a flow diagram showing the monitor processing of this embodiment. As described above, various viewing devices are equipped with cameras, and are capable of photographing viewers viewing distributed video. In this embodiment, it is possible to check the camera image taken by the camera on the distribution device side on the monitor 81 on the distributor side. When there are a large number of viewers, it is difficult to display all camera images on the monitor 81 and it is difficult for the distributor to check the reactions of the viewers. We have come up with some ideas.

The monitor process is a process for displaying a monitor video on a monitor 81 provided on the distributor side, and is a process executed by the monitor unit 8. The monitor unit 8 receives camera images from cameras connected to viewing devices such as the personal computer 6, the karaoke device 2, and the mobile terminal 7 while the distribution device 9 is distributing the distribution video. The monitor unit 8 works in conjunction with the distribution device 9 in order to coordinate distribution and camera images. The monitor unit 8 and the distribution device 9 are computers that have stored programs for executing distribution processing and monitoring processing to be described later. Further, the monitor unit 8 and the distribution device 9 may be integrated.

When the distribution device 9 starts distributing the distribution video (S101: Yes), the monitor unit 8 receives the camera video from each viewing device that is being distributed (S102). Then, based on the received camera video, the degree of excitement of each viewing device is determined (S103). In this embodiment, the degree of excitement is determined using the movement of the person in the camera image. To determine the movement of a person, for example, a skeletal model is recognized from a camera image, and the parts of the person are determined. It is also conceivable to use the movement of the skeletal model as the movement of the person. Alternatively, changes in camera images may be simply used as the movement of the person.

The degree of excitement is determined to be greater as the movement of the person is greater. On the distributor's side, it is conceivable that their motivation for broadcasting will increase by confirming that the viewers are excited. Therefore, in this embodiment, camera images of viewers with a high degree of excitement are actively used.

After determining the degree of excitement based on the camera image, the layout of the camera image is determined based on the degree of excitement (S104). FIG. 4 is a diagram for explaining the layout of camera images according to this embodiment. A plurality of camera images 81a to 81s are laid out and arranged on the monitor image displayed on the monitor 81 (S105).

In this embodiment, camera images 81a to 81s are arranged according to the degree of excitement of each camera image determined in S103. Specifically, based on the order of excitement level, the camera image 81a having the highest degree of excitement is placed at the maximum size in the center of the monitor image, and the camera image 81b having the second highest degree of excitement is placed in the center of the monitor image. The camera image 81c, which is placed on the left side of the image and has the third highest degree of excitement, is placed on the right side of the monitor image. Furthermore, the camera images 81d to 81s of the 4th to 19th places are arranged in small sizes at the top and bottom of the screen. Note that in this embodiment, camera images ranked 20th or lower are not displayed as monitor images.

Further, in this embodiment, the degree of excitement is displayed at the upper left of the camera image 81a. As an index of the degree of excitement, not only the ranking but also the degree of excitement may be displayed numerically. In addition, identification information such as the listener's name and nickname, and the name of the area where the listener is listening may be displayed on the camera video.

In this way, the monitor unit 8 displays the layout of the camera images 81a to 81k with the highest degree of excitement on the monitor 81, so that the distributor can monitor the state of the listeners, especially the state of the listeners who are excited by the distribution. This makes it possible to broadcast while listening to the content. Therefore, the distributor's motivation for distribution increases.

The display of the monitor video on the monitor 81 based on the camera video (S102 to S105) continues while updating the layout at appropriate timing until the distribution ends (S106: Yes). After the distribution is completed, in this embodiment, the result of the degree of excitement is displayed on the monitor 81 (S107). As a result of the degree of excitement, the ranking of the total degree of excitement during the distribution period, the user name, camera images taken during the distribution period, etc. are displayed.

Although the distribution system of this embodiment has been described above, it is not limited to the embodiment described above, and various modifications can be adopted. A modified example will be explained below.

[Modification 1]
As described with reference to FIG. 4, in the embodiment described above, the position of the camera image is changed based on the ranking of the degree of excitement. In particular, by increasing the size of the camera images of high-ranking listeners, it is possible to draw the distributor's attention to the excited listeners. In addition, since the center position is easier to see, videos with a high level of excitement are displayed larger near the center, making it possible to draw the attention of excited listeners to the broadcaster.

The layout of camera images is not limited to this format, and various formats can be adopted. 5 and 6 are diagrams for explaining the layout of camera images in other embodiments. In the layout shown in FIG. 5, the center position of each camera image 81a to 81l is a fixed position, and the size thereof is changed according to the order of the degree of excitement. By increasing the size of the camera images 81a to 81l that rank high in the degree of excitement, it is possible to make the excited listeners stand out. Note that camera images below a predetermined rank (in this example, 13th or below) are not displayed. Furthermore, the size of the video may be changed depending on the difference or ratio of the degree of excitement.

In the layout shown in FIG. 6, the sizes of the camera images 81a to 81l are the same, and the degree of overlapping of the camera images 81a to 81l is changed depending on the order of the degree of excitement. By arranging the camera images 81a to 81l, which rank high in the degree of excitement, on the front side, it is possible to make the listeners who are excited stand out. In this example as well, camera images below a predetermined rank are not displayed. Furthermore, in this example, the first-ranked image is placed in the center, and the images are arranged in a spiral manner as they spread outward counterclockwise.

In addition to the layout of the embodiment described above, two layouts have been described above, but the layouts of these camera images 81a to 81s can also be used in combination.

[Modification 2]
In the embodiment described above, the degree of excitement of the listener is determined based on the camera image, but the degree of excitement of the listener can also be determined based on the following form.

a) Judgment based on the listener's audio If the listener gets excited watching the distributed video, they may cheer by vocalizing their support in addition to their physical actions. In the viewing device, the degree of excitement may be determined based on the collected voices of the listener. When using audio, it may be determined that the louder the volume, the higher the excitement level. Furthermore, in the case of determination assuming that the sound is cheering, it may be determined that the higher the pitch, the higher the excitement level. Furthermore, the degree of excitement may be determined using a point-adding method based on positive comments using voice recognition technology.

b) Determination based on operations performed by the listener In the distribution system, it may be possible to input comments regarding viewing from the viewing terminal. The input comments are displayed on the viewer's screen, and can be shared among the viewers. In such a distribution system, the degree of excitement among viewers may be determined based on comments input by viewers.

For example, it is possible to determine the degree of excitement based on the number of comments from listeners. The more comments a listener makes, the higher the level of excitement is determined. It is also conceivable to determine the degree of excitement according to the number of characters in the comment. Note that not only comments supporting the listener but also negative comments may be input. Taking such cases into consideration, it is conceivable that negative comments are not reflected in the excitement level, or are judged as negative evaluations.

As operations on the listener side, it is possible to consider a distribution system that allows not only inputting comments but also inputting icons and pictograms. Input operations for such icons, pictograms, etc. may be used to determine the degree of excitement.

Furthermore, some distribution systems allow users to donate money as a form of support for the distributor. The listener can donate money (or points) to the distributor by specifying an amount (or points) and tipping by operating the viewing device. In such a distribution system, the degree of excitement among the viewers may be determined based on the amount of coins the viewers donate. In this case, the degree of excitement is determined based on, for example, the number of coins tipped or the amount of coins tipped.

c) Listener's biometric information In addition to the above-mentioned format, it is also possible to use the audience's biometric information to determine the degree of excitement. Currently, wearable terminals such as wristwatches are used to acquire various biological information such as pulse, blood pressure, body temperature, and blood sugar level. Such a terminal may be associated with a viewing device and the degree of excitement of the audience may be determined based on biometric information acquired from the audience. For example, the higher the pulse rate or the higher the body temperature, the higher the degree of excitement may be determined.

d) Multiple viewers When viewing a distributed video, it may be viewed by one person on a single viewing device, or viewed by multiple people. When viewing with multiple people, determine the level of excitement for each viewer and average it based on the number of viewers, or use the highest (or lowest) level of excitement among multiple viewers. is possible.

The determination of various degrees of excitement has been described above, but it is also possible to use a combination of determination based on camera images and determination based on the forms a to d described above, as appropriate. Note that in the above-described embodiment, the degree of excitement is determined by the monitor unit 8, but it can also be determined by the viewing terminal. It becomes possible to reduce the processing load on the monitor section 8.

[Modification 3]
FIG. 7 is a diagram showing the configuration of a distribution system according to another embodiment. In the embodiment described above, the monitor section 8 was installed on the distributor side, and the viewer's camera image was checked on the monitor 81. In addition to this configuration, the monitor section 8 may be placed on the viewer's side.

As shown in FIG. 7, for example, in a private home, a monitor unit 8 and a monitor 81 installed in the monitor unit 8 are installed. In such a configuration, the monitor video described in FIG. 4 can be viewed by the listener. While watching the distributed video, the viewer can visually check the monitor video on which the camera video is laid out on the monitor 81.

With this format, viewers can see who is getting excited, and it is also possible for viewers to compete for excitement among themselves. Furthermore, by operating the functions of the monitor unit 8 on the personal computer 6 in a private home, the distributed video and the monitor video formed by the camera video may be displayed together on the monitor 81. The same applies to the karaoke device 2 installed in the karaoke box. Further, in the mobile terminal 7, the mobile terminal 7 may execute a program having the function of the monitor unit 8, and display the distributed video and the monitor video together.

[Modification 4]
As described with reference to FIG. 1, in the embodiment described above, it is assumed that the distributor uses the camera 91 to perform live distribution. Various types of live distribution are possible, such as concerts, events, and karaoke. Note that the number of cameras 91 is not limited to one, and it is also possible to switch between a plurality of cameras and distribute the video, or to combine and distribute video images from a plurality of cameras.

In addition, the distributed video to be distributed is not limited to the form of live distribution as described above, but it is also possible to use already recorded content such as movies, dramas, concerts, etc. Even with such content, it is possible to check the situation of the distributor, such as what kind of scenes are popular.

1: Remote control device 27: Memory 2: Karaoke device 28: Video RAM
5: Server device 29: Video playback section 6: Personal computer 30: CPU
7: Mobile terminal 31: Video control section 8: Monitor section 32: Hard disk 9: Distribution device 33: Touch panel monitor 11: Touch panel monitor 34: Touch panel 11a: Display section 35: Display section 11b: Touch panel 41: Monitor 12: Video RAM 42 : Speaker 13: Video control section 43a: Microphone 14: Memory 43b: Microphone 15: CPU 44: Camera 16: Wireless LAN communication section 61: Monitor 17: Operation section 62: Camera 18: Operation processing section 63: Router 21: Operation section 71: Wireless base station 22: Operation processing unit 81: Monitor 24a: LAN communication unit 81a to 81s: Camera image 24b: Wireless LAN communication unit 91: Camera 25: Sound control unit 130: Access point

Claims (6)

A distribution system in which a distribution device, a plurality of viewing devices, and a monitor unit are connected via a network,
The distribution device includes a distribution video transmission means for transmitting distribution video to be distributed,
The viewing device includes:
a distributed video receiving means for receiving the distributed video;
A camera image transmitting means for transmitting a camera image taken by the camera,
The monitor section includes:
Receiving means for receiving camera images transmitted from the viewing device;
determining means for determining the degree of excitement of viewers viewing the distributed video on the viewing device;
monitor image forming means for forming a monitor image using the camera image transmitted from the viewing device based on the degree of excitement of viewers viewing the distributed video on the viewing device as determined by the determining device; equipped delivery system. The distribution system according to claim 1, wherein the monitor unit displays a monitor video on a display unit installed on at least one of the distribution device side and the viewing device side. The distribution system according to claim 1, wherein the monitor image forming means determines the camera image to be displayed on the monitor image based on the degree of excitement. The distribution system according to claim 1, wherein the monitor image forming means determines the arrangement of camera images displayed on the monitor image based on the degree of excitement. The determining means uses at least one of the listener's movement included in the camera image, the listener's voice sent along with the camera image, and operation information based on the listener's operation to determine the degree of excitement of the listener. The distribution system according to claim 1. The distribution system according to claim 1, wherein the monitor image forming means displays an index indicating the degree of excitement among viewers in association with the displayed camera image.