JP2023124782A - Performance video display program - Google Patents

Abstract

To provide means that displays a distributed performance video with a rich sense of presence and, even if information allowing identification of a performer appearing in the video is not provided, allows an audience to supply the performer with a profit such as "wrapped offering".SOLUTION: A performance video display program of the present invention enables execution of: a performance video reception step in which a display device 3 can receive, from a server 2, a performance video shot by one or more performers A performing in a stage TS; a display step in which a head-mounted display 34 can display a display video including a part or the whole of the performance video; and a profit supply step in which, when a designated portion designated from the display video D is one of one or more performers A, a profit can be supplied to the performer A corresponding to the designated portion.SELECTED DRAWING: Figure 1

Description

The present invention relates to an entertainment video display program.

There are performances that provide entertainment to audiences, exemplified by theatrical performances, live music, dance performances, and sports games. Traditionally, in performances, spectators at the performance venue gave performers, athletes, etc. ``ohineri'' (also known as ``omijiri'', ``paper twist'', ``goshugi'', ``throwing money'', etc.). ing. The audience can convey to the performers, athletes, etc., their feelings of gratitude for the impression obtained at the performance by handing over the "ohineri." In addition, performers, athletes, etc. who have been handed the "ohineri" can feel the excitement and gratitude of the audience through the "ohineri". Then, performers, athletes, etc. who have received the "Ohineri" can increase their engagement, which is their relationship with the audience.

With regard to handing over "Ohineri", Patent Document 1 discloses an obtaining means for obtaining input information including at least one of information about the player's favor and impression by spectators who have watched the player's game, and Disclosed is a server device comprising: evaluation means for evaluating acquired input information for each player; and provision means for providing the evaluation information evaluated by the evaluation means to the outside. Japanese Patent Laid-Open No. 2004-100000 describes, as input information, information that is input via an input screen that is displayed on a PC or a mobile terminal when a button displayed for each player is pressed.

The invention of Patent Literature 1 can evaluate the impression received by spectators, evaluate the degree of influence of the player, etc., and send it to the outside, while appropriately collecting "twisting" for the sports player or team.

JP 2017-174134 A

By the way, with respect to performances, images of performances are distributed to various display devices used by spectators. By distributing the video of the show, the audience can enjoy the show at a place different from the venue of the show. In addition, by distributing the video of the performance, the organizer of the performance can bring the enjoyment of watching the performance to a large number of spectators without being restricted by the capacity of the venue, the cost of the performance, safety, hygiene, etc. can provide.

There is a demand for distribution of video of a performance, for example, a distribution capable of displaying images with a rich sense of presence, such as when watching a performance at a performance hall. Although the invention of Patent Literature 1 can suitably collect "O-Hineri" from spectators watching a sports game, there is still room for further improvement in terms of performing distribution that can display performance images with a rich sense of presence. .

In addition, in the invention of Patent Document 1, input information related to "one-piece" is input via a button displayed for each player. Here, in sports, information that can identify a player is usually provided for the purpose of helping a referee or the like to smoothly make a ruling regarding the sport. Such information includes, for example, uniform numbers, player names, designs, etc., including items worn by players such as uniforms and trunks, and courtsides where players are located. The spectator can use the information that can identify the players to identify the players, and input the input information related to the "one-turn" via the button displayed for each player.

With respect to performances, there are performances held on stages exemplified by theatrical performances, live music, and dance performances. When enjoying performances on stage, unlike watching sports, information that enables identification of performers corresponding to athletes is not necessarily provided. This can make it difficult for the audience enjoying the performance on stage to identify the performers.

Therefore, when the invention of Patent Document 1 is used to give an "ohineri" to a performer performing a performance on a stage, if the audience is impressed by the performer's performance, the audience will And/or there may be a risk that the button corresponding to the performer cannot be identified and the "Oneri" cannot be passed through the button displayed for each performer.

Therefore, the invention of Patent Literature 1 provides benefits to the performer, such as giving the performer an ``ohineri'', if the performer does not provide information that can be used to identify the performer, when the video of the performance performed on the stage is distributed. There is room for further improvement in that it is possible to provide

The present invention has been made to solve the problems of the prior art as described above, and displays a video of a distributed performance with a sense of realism, and identifies a performer in the video. The purpose is to provide a means by which the audience can give benefits such as "O-Hineri" to the performer even if possible information is not provided.

As a result of intensive studies to solve the above problems, the inventors of the present invention received from an external device a performance video in which one or more performers performing on stage were shot, and displayed video including part or all of the performance video. is displayed on the head-mounted display, and if the specified part specified from the displayed image is one of one or more performers, the above problem can be solved by enabling the performer corresponding to the specified part to be given a profit. We have found that it is possible, and have completed the present invention. Specifically, the present invention provides the following.

An invention according to a first feature includes a performance image receiving step that enables a display device to receive performance images of one or more performers performing on stage from an external device, and part or all of the performance images. a display step capable of displaying a display image on a head-mounted display; and when a specified portion specified from the display image is one of the one or more performers, a benefit can be given to the performer corresponding to the specified portion. To provide an entertainment video display program capable of executing a profit giving step.

According to the first aspect of the invention, a display image including part or all of the entertainment image received from an external device is displayed on the head mounted display. Head-mounted displays are known to be capable of providing a wider field of view in a smaller device such as a stationary display. Also, it is known that the wider the field of view of the displayed image, the higher the sense of realism. Therefore, by displaying the display image on the head-mounted display, the delivered performance image is displayed with a rich presence.

Then, according to the invention according to the first feature, the audience designates a designated portion corresponding to one or more performers from the display image displayed on the head-mounted display, and gives the designated performer a "twist." ” and other benefits can be granted. Since the benefit is given through the procedure of specifying the specified part corresponding to one of the performers from the displayed display image, the audience will not be able to identify the performer even if the information is not provided. To accurately designate a performer to whom a benefit is to be given, and to surely provide the specified performer with a benefit such as ``a twist''.

Therefore, according to the invention according to the first characteristic, the image of the distributed performance is displayed with a sense of realism, and even if the performer shown in the image is not provided with information that can identify the performer, Even if there is, it is possible to provide a means by which the audience can give benefits such as "twists" to the performer.

The invention according to a second feature is the invention according to the first feature, wherein the display device further executes a position determination step capable of determining whether the position of the head mounted display is included in a predetermined range. and the displaying step provides a program capable of controlling display of the display image depending on whether the position is included in the predetermined range.

A display image displayed on a head-mounted display may interfere with the viewer's view of the real world. Therefore, there is a demand for support so that spectators can view images displayed on a head-mounted display safely.

According to the second aspect of the invention, the display of the display image can be controlled depending on whether the position of the head mounted display is included in the predetermined range. As a result, it is possible to control to display the display image on the head-mounted display only when the audience is in a safe place such as indoors. In addition, it is possible to control the head mounted display so that the display image is not displayed when the spectator is in a place where there is a concern that the audience cannot view it safely.

Therefore, according to the invention according to the second feature, it is possible to display the delivered video of the performance with a sense of realism, to support the audience so that they can view the video of the performance safely, and to allow the audience to "twist" the performance. ”, etc., to the performer.

Therefore, according to the invention according to the second characteristic, the image of the distributed performance is displayed with a sense of realism, and even if the performer shown in the image is not provided with information that can identify the performer, Even if there is, it is possible to provide a means by which the audience can give benefits such as "twists" to the performer.

The invention according to a third feature is the invention according to the first or second feature, wherein the display device includes a speed determination step capable of determining whether the movement speed of the head mounted display is within a specific range. is further executed, and the display step provides a program capable of controlling display of the display image depending on whether the moving speed is included in the specific range.

As described above, the displayed video displayed on the head-mounted display can interfere with the audience's view of the real world. Therefore, when the audience walks while viewing the displayed image, there is a risk of tripping over and/or colliding with furniture or the like.

According to the third aspect of the invention, the display of the display image can be controlled depending on whether the movement speed of the head mounted display is within a specific range. As a result, it is possible to control the head-mounted display to display the display image only when the audience is not walking or the like.

Therefore, according to the invention according to the third feature, it is possible to display the delivered video of the performance with a sense of realism, to support the spectators so that they can safely view the video of the performance, and to allow the spectators to "twist". ”, etc., to the performer.

Therefore, according to the invention according to the third characteristic, the image of the distributed performance is displayed with a sense of realism, and the performer appearing in the image is displayed even when the information that can identify the performer is not provided. Even if there is, it is possible to provide a means by which the audience can give benefits such as "twists" to the performer.

According to the present invention, the video of the distributed performance is displayed with a sense of realism, and even if the performer shown in the video is not provided with information that can identify the performer, the audience will be able to " It is possible to provide a means capable of providing the performer with a benefit such as "Okineri".

FIG. 1 is a block diagram showing the hardware configuration and software configuration of an entertainment video distribution system S of this embodiment. FIG. 2 is an example of the performance table 221. As shown in FIG. FIG. 3 is an example of the performance video table 321. As shown in FIG. FIG. 4 is a flow chart showing an example of a preferred flow of distribution processing executed by the server 2. As shown in FIG. FIG. 5 is a flow chart showing a preferred flow of display processing executed by the display device 3. As shown in FIG. FIG. 6 is a flowchart following FIG. FIG. 7 is a schematic plan view showing an example of a performance venue T in which the photographing device 1 having an omnidirectional camera is installed. FIG. 8 is a schematic diagram showing an example of how the audience designates the performer A using the display image D. As shown in FIG.

Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings.

<Box office video distribution system S>
FIG. 1 is a block diagram showing the hardware configuration and software configuration of an entertainment video distribution system S of this embodiment. An example of a preferred configuration of the entertainment video distribution system S of this embodiment will be described below with reference to FIG.

The box office video distribution system S includes a photographing device 1, a server 2, and a display device 3 connectable to the server 2 via a network N. FIG.

[Imaging device 1]
The photographing device 1 can photograph one or more performers A (for example, the first performer A1 and the second performer A2 in FIG. 7, etc.) performing on the stage TS of the performance venue T. The photographing device 1 is not particularly limited, and may be a conventional camera or the like.

The number of imaging devices 1 is not particularly limited. The number of imaging devices 1 is preferably two or more. Thereby, two or more photographing devices 1 can photograph the stage TS from a plurality of viewpoints. Then, the server 2 can distribute a stereoscopic image based on images taken from a plurality of viewpoints. Therefore, on the display device 3, the video of the performance can be displayed more realistically.

The image capturing device 1 preferably includes an omnidirectional camera capable of capturing images in substantially all directions in the horizontal direction. As a result, the display device 3 can display the display image D on a head-mounted display, which will be described later, using performance images of the surroundings of the stage TS in addition to all of the stage TS performed by one or more performers A.

The type of omnidirectional camera is not particularly limited. The omnidirectional camera preferably includes two or more cameras. Thereby, the photographing device 1 can photograph the stage TS from a plurality of viewpoints. Then, the server 2 can distribute a stereoscopic image based on images taken from a plurality of viewpoints. Therefore, on the display device 3, the video of the performance can be displayed more realistically.

The omnidirectional camera preferably includes two or more cameras capable of photographing in different directions. In a camera capable of photographing a wide horizontal angle of view, such as a fisheye lens, as the horizontal angle of view widens, image distortion may increase near the periphery of the photographing range. An omnidirectional camera includes two or more cameras capable of photographing in different directions, so that the horizontal angle of view of each camera can be narrower than in the case of photographing in all directions with one camera. As a result, the omnidirectional camera can reduce image distortion near the periphery of the imaging range.

The number of cameras included in the omnidirectional camera is preferably four or more. As a result, the omnidirectional camera can usually be configured with a camera using a wide-angle lens having a horizontal angle of view of 60° or more and 100° or less. Therefore, an omnidirectional camera containing 4 or more cameras may have less distortion near the periphery of the field of view than an omnidirectional camera containing 3 or less cameras, which requires a fisheye lens with a wider horizontal angle of view than a wide-angle lens.

[Performance venue T]
It is preferable that the performance hall T where the omnidirectional camera included in the photographing device 1 is installed does not have spectator seats permanently installed.

When an omnidirectional camera is installed in a performance venue T with audience seats, the appearance of the audience using the audience seats may be included in the performance video. As a result, the audience enjoying the performance using the display device 3 can be prevented from watching the performer A performing on the stage TS.

In addition, if an omnidirectional camera is installed in the performance hall T where the audience seats are installed and the performance during the performance is filmed with the audience, there is a risk that the performance and photography cannot be performed due to sanitary reasons such as measures against infectious diseases. can be. In addition, when an omnidirectional camera is installed in a performance hall T with spectator seats and the performance during the performance is filmed with the audience, in addition to the burden associated with the permanent installation of the spectator seats, The cost, safety, hygiene, etc. brought about by spectators' use of the entertainment puts a heavy burden on the organizer of the show, which can hinder filming.

Since an omnidirectional camera is installed at the performance venue T where there are no permanent seats, there is a risk that the performance and filming will not be performed due to the above reasons, etc., and a risk that the filming will be hindered due to various burdens related to the permanent installation of the audience seats. and can be reduced. As a result, the performance video distribution system S more reliably distributes the performance video, and the audience can more reliably give profit to the performer A through the display of the distributed performance video.

In addition, since the omnidirectional camera is installed in the performance venue T where the audience seats are not permanently installed, the photographing device 1 can photograph the performance without waiting for the entrance and exit of the audience. As a result, the performance video distribution system S can shoot and distribute more performance videos in the same time than when an omnidirectional camera is installed in the performance hall T with audience seats.

The appearance of the performance venue T is not particularly limited. The appearance of the performance hall T may be, for example, the appearance of a modern building incorporating a Momoyama-style design. Minamiza Theater in Kyoto City can be mentioned as a performance venue with a similar appearance. The audience can also enjoy the appearance of the performance venue T because the appearance of the performance venue T is a modern architectural appearance that incorporates the design of the Momoyama style.

[Server 2]
The server 2 includes a server control section 21 , a server storage section 22 and a server communication section 23 .

[Server control unit 21]
The server control unit 21 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

The server control unit 21 cooperates with the server storage unit 22 and/or the server communication unit 23 as necessary, and can implement the distribution unit 211, profit allocation unit 212, etc., which are software components of the server 2. .

[Server storage unit 22]
The server storage unit 22 is a device in which data and/or files are stored, and has a data storage unit such as a hard disk, a semiconductor memory, a recording medium, and a memory card. The server storage unit 22 enables connection via the network N with storage devices or storage systems such as NAS (Network Attached Storage), SAN (Storage Area Network), cloud storage, file servers and/or distributed file systems. May have a mechanism.

The server storage unit 22 stores a control program executed by a microcomputer, an entertainment table 221, registered spectator information regarding means for giving benefits to each spectator using the display device 3, and the like.

(Entertainment table 221)
The performance table 221 stores performance information including performance videos and information on one or more performers.

The performance video is not particularly limited as long as it is a video of one or more performers A performing on the stage TS of the performance venue T. The format of the performance video is not particularly limited, and various conventional formats used for video data may be used. The promotional video preferably includes audio associated with the video. As a result, the server 2 can distribute entertainment video including audio. The promotional video preferably includes subtitles relating to the video. As a result, the server 2 can distribute entertainment videos including subtitles.

It is preferable that the entertainment video includes information that enables stereoscopic video to be displayed. As a result, a stereoscopic image can be displayed on a head-mounted display, which will be described later. Therefore, on the display device 3, the video of the performance can be displayed more realistically.

The performance video includes information that can realize virtual reality (also referred to as VR), augmented reality (also referred to as AR), and/or mixed reality (also referred to as MR). is preferred. The information includes, for example, information capable of displaying an image according to the orientation of the head-mounted display, information capable of displaying an image according to the position of the audience in the virtual space, and the like.

The performance video preferably includes video captured by the imaging device 1 , and more preferably includes video captured by the omnidirectional camera of the imaging device 1 . Since the performance video is a video shot by an omnidirectional camera, in addition to all of the stage TS performed by one or more performers A, the surroundings of the stage TS (for example, the inside of the performance hall T, etc.) were also shot. The display image D can be displayed using the performance image. When the performance image includes information capable of displaying a stereoscopic image, the performance image preferably includes images captured by a plurality of photographing devices 1 and/or images captured by a plurality of cameras included in the photographing device 1. Thereby, the display device 3 can display a stereoscopic image using images captured by a plurality of imaging devices 1 .

The entertainment video including the video shot by the shooting device 1 is not particularly limited. It may also include footage edited using, or may include real-time footage of the show.

It is preferable that the performance video includes a video that has been edited using an external video editing means or the like from the video captured by the imaging device 1 . As a result, the server 2 can distribute not only the captured video, but also the video that has been edited to enhance the sense of reality. Such editing includes, for example, digital editing for synthesizing the stage equipment with the performance video, editing for synthesizing the digital video with the performance video, editing for synthesizing performer A with the performance video, and the like.

The performance footage preferably includes real-time footage of the performance. As a result, the spectators can enjoy performances with a sense of presence in time through the distributed real-time video.

With respect to real-time video, video distribution in which the timing at which the video is captured and the timing at which the video is displayed are substantially the same is also referred to as live distribution. The promotional footage preferably includes live-distributed promotional footage.

The time difference between the timing at which the video is shot and the timing at which the video is distributed is preferably 5 minutes or less, more preferably 3 minutes or less, and 2 minutes or less. is more preferred. As a result, the display device 3 can distribute the performance video in a manner that gives a more realistic feeling of being in a live performance.

In live distribution, it is preferable that there is a predetermined time difference between the timing at which the video is captured and the timing at which the video is distributed. As a result, it is possible to prevent a video that is not appropriate to be distributed from being distributed even though it is a live distribution. The predetermined time difference is preferably 15 seconds or longer, more preferably 30 seconds or longer, and even more preferably 1 minute or longer. As a result, the display device 3 can further prevent distribution of video that is inappropriate for distribution.

The performance is not particularly limited as long as one or more performers A perform on the stage TS of the performance venue T. Performances may include, for example, one or more of plays, comedy performances such as skits, live music, and the like. Performances may also include sports games. In a performance that is a sports match, the performer A corresponds to a player, a staff member, or the like.

The entertainment preferably includes theatrical performances. A play can be performed by a large number of actors A. In a play, there are cases where each of the many performers A is difficult to identify because the performers A do not wear elements that can identify the performers A, such as musical instruments. obtain. When the performance includes a play, it can be difficult to designate, in particular, nameless supporting characters who play crowds, etc., by character names, costumes, and the like. Even if it is difficult for the audience to specify the actor A to whom profits are to be given based on the name of the role, the costume, etc., the audience can easily identify such actors A from the displayed video. can be specified.

It is preferable that the performance table 221 can store information of various videos including a person corresponding to the performer A and information of one or more performers instead of the performance videos. Examples of such various images include movies, dramas, news, moving image contents, and the like. In the various images described above, there may be a case where the persons included in the images do not wear clothes or the like that allow the persons to be easily identified. Therefore, since the performance table 221 can store various images instead of performance images, the audience can easily designate such persons from the displayed images.

In the following description, it is assumed that the performance video is a performance video. Similarly, when the performance video is any of the above-described videos, the performance video distribution system S designates a person corresponding to the distribution and performer A, and distributes the profit. can be given.

The entertainment information preferably includes correspondence information regarding the correspondence between the performer A and the video. By including the corresponding information in the performance information, the corresponding information can be distributed to the display device 3 .

The performance information preferably includes information about the profit (also referred to as a "twist") corresponding to the performer A. The profit can be given to the corresponding performer A by including the profit-related information in the performance information.

It is preferable that the performance table 221 can store a performance ID that can identify performance information and performance information identified by the performance ID in association with each other. Thereby, the server 2 can store and/or acquire the information of the performance using the performance ID.

It is preferable that the performance table 221 can store the performance in association with the network identification information that can identify the performance video on the network N. FIG. As a result, the server 2 can distribute the performance video corresponding to the identification information on the network. In addition, the spectator can recommend the entertainment video that he or she has been impressed with to a friend or the like using the identification information on the network. Furthermore, the show organizer and/or performer A can use the identification information on the network to advertise the show video.

The identification information on the network is not particularly limited, and includes, for example, a URL (Uniform Resource Locator), a URI (Uniform Resource Identifier), etc. associated with the performance video.

FIG. 2 is an example of the performance table 221. As shown in FIG. The performance identified by the performance ID “P0001” in the performance table 221 shown in FIG. 2 contains the following information:
A "performance video" in which the first performer A1 standing on the stage TS and the second performer A2 standing on a balcony having stairs provided on the stage TS are photographed;
"First performer information" having "corresponding information" indicating the portion corresponding to the first performer A1 in the performance video and profit "200,000 yen" given to the first performer A1, and
"Second performer information" having "corresponding information" indicating the part corresponding to the second performer A2 in the performance video and the profit "120,000 yen" given to the second performer A2;
"Performer Information", including

Since the performance stored in the performance table 221 contains the above-mentioned information, the server 2 distributes the performance video, and designates the part corresponding to the first performer A1 and/or the second performer A2 in the performance video. Each one can be granted a corresponding benefit when it's done.

[Server communication unit 23]
The server communication unit 23 is not particularly limited as long as it connects the server 2 to the network N and enables communication with the display device 3 and the like. Devices compatible with Wi-Fi (Wireless Fidelity), short-range wireless devices compatible with the Bluetooth (registered trademark) standard, etc., network cards compatible with the Ethernet standard, and the like.

[Display device 3]
The display device 3 includes a display device control section 31 , a display device storage section 32 , a display device communication section 33 , a head mounted display 34 and a display device input section 35 . Although not an essential aspect, the display device 3 further includes a position acquisition unit 36 capable of acquiring the position of the head mounted display 34 and/or a speed acquisition unit 37 capable of acquiring the moving speed of the head mounted display 34. is preferred.

If the display device 3 can display the display image D, which is at least part or all of the entertainment image received from the server 2, on a head mounted display 34 including a head mounted display (also referred to as HMD) , is not particularly limited.

The display device 3 may be configured integrally with the head mounted display 34 or may be configured separately. Above all, it is preferable that the display device 3 is configured integrally with the head mounted display 34 . This can prevent the audience from feeling the trouble of connecting the head mounted display 34 and the display device 3 configured separately from the head mounted display 34 .

[Display device control unit 31]
The display device control unit 31 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

The display device control unit 31 cooperates with the display device storage unit 32, the display device communication unit 33, the head mounted display 34, and/or the display device input unit 35, etc., as necessary, and is a software component of the display device 3. A performance image receiving unit 311, a profit giving unit 312, a position determining unit 313, a speed determining unit 314, an image display unit 315, and the like can be realized.

[Display device storage unit 32]
The display device storage unit 32 is a device in which data and/or files are stored, and has a data storage unit such as a hard disk, a semiconductor memory, a recording medium, and a memory card. The display device storage unit 32 can be connected to a storage device or storage system such as NAS (Network Attached Storage), SAN (Storage Area Network), cloud storage, file server and/or distributed file system via network N. You may have a mechanism to do.

The display device storage unit 32 stores a control program executed by the microcomputer, an entertainment image table 321, and the like.

(Entertainment video table 321)
The performance video table 321 stores performance videos received from the server 2 and in which one or more performers A performing on the stage TS of the performance hall T are photographed. The performance video may be the same as the performance video stored in the performance table 221 .

The performance video is preferably stored in association with correspondence information regarding the correspondence between the performer A and the video. By storing the performance video in association with the correspondence information, the display device 3 can determine the performer A corresponding to the specified part specified using the correspondence information. Thereby, the display device 3 can improve the accuracy with which the performer A is identified. In addition, the display device 3 can identify the performer A by relatively simple processing using the correspondence information without performing processing with a relatively large processing load such as recognizing the performer A one by one using an image recognition technology or the like. .

When the head-mounted display 34 and the display device 3 are configured integrally, storing the performance video in association with the above correspondence information can bring about the effect that the display device 3 can be made lightweight. . As described above, the performance video is stored in association with the above correspondence information, so that the display device 3 can perform relatively simple processing using the correspondence information without performing processing with a relatively large processing load. A can be identified. Therefore, the display device 3 configured integrally with the head-mounted display 34 can have a relatively small processing capacity and a lightweight configuration. This allows spectators to use the head-mounted display 34 even more easily.

It is preferable that the performance video table 321 can store the performance video ID that can identify the performance video and the performance video identified by the performance video ID in association with each other. Thereby, the display device 3 can store and/or acquire the performance video or the like using the performance video ID.

FIG. 3 is an example of the performance video table 321. As shown in FIG. The box office video ID "V0001" in the box office video table 321 shown in FIG. 3 is associated with the following information:
A "performance video" in which the first performer A1 standing on the stage TS and the second performer A2 standing on a balcony having stairs provided on the stage TS are photographed;
"first corresponding information" indicating the portion corresponding to the first performer A1 in the performance video; and
"Second correspondence information" indicating the portion corresponding to the second performer A2 in the performance video;
"Correspondence Information", including

Since the performance stored in the performance video table 321 includes the performance video, the display device 3 can display the performance video on the head mounted display 34 . In addition, since the performance stored in the performance video table 321 includes the correspondence information, the display device 3 uses the correspondence information to display the part corresponding to the first performer A1 and/or the second performer A2 in the performance video. easily identifiable.

[Display device communication unit 33]
The display device communication unit 33 is not particularly limited as long as it connects the display device 3 to the network N and enables communication with the server 2 or the like. devices compatible with Wi-Fi (Wireless Fidelity), short-range wireless devices compatible with the Bluetooth (registered trademark) standard, etc., and network cards compatible with the Ethernet standard.

[Head mounted display 34]
The head-mounted display 34 is not particularly limited as long as it can display the display image D of the performance image, and may be a conventional head-mounted display. In general, head-mounted displays are known to be capable of providing a wider field of view with smaller devices such as stationary displays. Also, it is known that the wider the field of view of the displayed image, the higher the sense of realism. Therefore, since the display device 3 includes the head-mounted display 34, the display image D can be displayed on the head-mounted display 34 with a sense of realism.

As described above, the head mounted display 34 may be configured integrally with other members of the display device 3 or may be configured separately. Moreover, it is preferable that the head mounted display 34 can display a stereoscopic image. Accordingly, the head-mounted display 34 can display the display image D in a realistic stereoscopic image mode.

[Display device input unit 35]
The display device input unit 35 is not particularly limited as long as the performer A included in the display image D can be specified. The display device input unit 35 may have one or more of a keyboard exemplified by a wearable keyboard, a pointing device corresponding to the head mounted display 34, and the like. It is preferable that the display device input unit 35 can designate the display magnification and the angle of view of the display image D. FIG. As a result, the audience using the display device 3 (hereinafter also simply referred to as the "audience") can reduce the display image D to facilitate searching for the portion including the performer A. Further, this makes it easier for the audience to designate a portion including the performer A by enlarging the display image D. FIG.

[Position Acquisition Unit 36]
The position acquisition unit 36 is not particularly limited as long as it can acquire the position of the head mounted display 34 . The position acquisition unit 36 is, for example, a conventional GPS receiver capable of acquiring the position of the head-mounted display 34 using GPS, or a radio wave from a radio wave source installed in a place where spectators can safely view the performance video. It may include a radio wave receiver or the like that can receive and identify whether the head-mounted display 34 is within a safe viewable range close to the sign. By including the position acquisition unit 36 , the display device 3 can perform control according to the position of the head mounted display 34 .

[Speed acquisition unit 37]
The speed acquisition unit 37 is not particularly limited as long as it can acquire the moving speed of the head mounted display 34 . The speed acquisition unit 37 may include, for example, a conventional speed sensor, an acceleration sensor, or the like capable of acquiring the moving speed of the head-mounted display 34 . Also, the speed acquisition unit 37 may be capable of acquiring the moving speed of the head mounted display 34 using GPS, for example. By including the speed acquisition unit 37 , the display device 3 can perform control according to the moving speed of the head mounted display 34 .

[Orientation acquisition unit]
If the performance video contains information that can display VR, AR, and/or MR, the display device 3 preferably includes an orientation acquisition unit (not shown) that can acquire the orientation of the head-mounted display 34 . Thereby, the display device 3 can perform control for displaying VR, AR, and/or MR according to the orientation of the head-mounted display 34 . The orientation acquisition unit is not particularly limited, and may be, for example, a sensor or the like that is configured integrally with the VR-compatible head-mounted display 34 and capable of detecting the orientation.

[Profit]
Benefits that can be granted to the designated performer A are not particularly limited. The profit may be a currency redeemable for various legal tenders, or may be redeemable for any money or goods included in a specified group of objects, exemplified by reward points or the like.

Benefits may include information evaluating a designated Actor A, exemplified by the number of votes in a popularity poll. Thereby, the performer A can feel the evaluation from the audience through the information for evaluating the performer A.

Benefits may include information that facilitates the grantability of certain rights granted to performer A, exemplified by rights to appear in particular shows and/or particular films. As a result, the designated performer A can feel the evaluation from the audience through the granting of predetermined rights. Also, if the predetermined right is the right to appear, the audience can further enjoy entertainment and/or images in which the designated performer A appears.

[Network N]
The type of network N is not particularly limited as long as it enables communication between the server 2 and the display device 3. For example, a personal area network, a local area network, an intranet, an extranet, the Internet, a Wi-Fi network, a mobile A telephone network or a network obtained by combining a plurality of these networks can be used.

[Main flow chart of distribution processing]
FIG. 4 is a flow chart showing an example of a preferred flow of distribution processing executed by the server 2. As shown in FIG. An example of a preferred flow of distribution processing executed by the server 2 will be described below with reference to FIG.

[Registration determination step]
Although not an essential aspect, the server 2 can execute a registration determination step of determining whether the spectator using the display device 3 is a registered spectator who has registered the registered spectator information regarding the means for giving profits to the server 2. preferable. As a result, the server 2 can provide means for giving benefits to registered spectators who have registered registered spectator information and who can more reliably give benefits. The registration determination step is not particularly limited, and may be, for example, a method of determining whether or not the spectator is a registered spectator using information on spectators received from the display device 3 (for example, a registered spectator ID and password that can identify a registered spectator). .

First, the server 2 executes distribution steps (steps S1 to S3) for distributing the performance video. Thereby, the server 2 can distribute the performance video to the display device 3 in accordance with the distribution command from the display device 3 .

[Step S1: Determining whether a delivery command has been received]
The server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to execute the distribution unit 211, and performs processing for determining whether or not a distribution command for instructing distribution of performance video is received from the display device 3 or the like. (Step S1). If received, the server control unit 21 shifts the process to step S2. If not received, the server control unit 21 shifts the process to step S4.

Although it is not an essential aspect, the process of determining whether or not a distribution command has been received is performed by transmitting to the display device 3 a command to display an entertainment video selection screen on which an entertainment video to be distributed can be selected from a plurality of entertainment videos, It is preferable to include a process of receiving a delivery command for the performance video selected from the delivery destinations on the performance video selection screen. As a result, the spectator can easily select the performance video that the audience wants to view from among the plurality of performance videos and give an instruction to distribute the performance video.

[Step S2: Acquire performance video]
The server control unit 21 cooperates with the server storage unit 22 to execute the distribution unit 211, and performs a process of acquiring performance images and the like from the performance table 221 (step S2). The server control unit 21 shifts the process to step S3.

If the performance information stored in the performance table 221 includes correspondence information relating to the correspondence between the performer A and the video, the processing in step S2 preferably includes processing for acquiring the correspondence information. As a result, the server 2 can distribute the correspondence information in addition to the performance video.

[Step S3: Distribute performance video]
The server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to execute the distribution unit 211, and distributes the performance video or the like acquired in step S2 to the transmission source of the distribution command received in step S1. (step S3). The server control unit 21 shifts the process to step S4.

Video distribution in which the timing at which the video is captured and the timing at which the video is distributed are substantially the same is also referred to as live distribution. It is preferable that the process of distributing the performance video or the like includes the process of live distribution of the performance video. As a result, the server 2 can deliver the performance video in a live delivery mode that gives a sense of realism.

The time difference between the timing at which the video is shot and the timing at which the video is distributed in live distribution is preferably 5 minutes or less, more preferably 3 minutes or less, and even more preferably 2 minutes or less. As a result, the display device 3 can distribute the performance video in a manner that gives a more realistic feeling of being in a live performance.

In live distribution, it is preferable that there is a predetermined time difference between the timing at which the video is captured and the timing at which the video is distributed. As a result, it is possible to prevent a video that is not appropriate to be distributed from being distributed even though it is a live distribution. The predetermined time difference is preferably 15 seconds or longer, more preferably 30 seconds or longer, and even more preferably 1 minute or longer. As a result, the display device 3 can further prevent distribution of video that is inappropriate for distribution.

Subsequently, the server 2 converts the profits received from the display device 3 into profits in a specific currency, and executes a profit allocation step (steps S4 to S6) to allocate the converted profits to each of the one or more performers A. do.

As a result, the server 2 allocates to each of the one or more performers A the profit after conversion corresponding to the profit received from the display device 3 . Therefore, the performance video distribution system S allows the audience to give the performer A a benefit such as a "twist" with respect to the performer A appearing in the distributed performance video.

[Step S4: Determining Whether Profit Has Been Received]
The server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to execute the profit allocation unit 212, and performs processing for determining whether profit has been received from the display device 3 or the like (step S4). If received, the server control unit 21 shifts the process to step S5. If not, the server control unit 21 shifts the process to step S1 and repeats the processes from step S1 to step S6.

The benefit to be received is not particularly limited as long as it includes information that can identify the performer A to whom the benefit is given. The benefit to be received may be information including one or more of information relating to a portion including the specified performer A in the video displayed on the display device 3 and information with which the performer A can be identified.

If the profit to be received does not contain information that can identify performer A, the process of determining whether the profit has been received includes the process of identifying performer A to whom the profit is given by using information that can identify performer A. is preferred. The process of identifying the performer A is not particularly limited, and may be, for example, a process of identifying the performer A using correspondence information, a process of identifying the performer A using various types of image recognition, or the like.

Although not an essential aspect, the benefits received preferably include information about the size of the benefits. Since the received profit includes information about the amount of profit, the audience can give the performer A a profit according to the degree of impression.

[Step S5: Convert profit]
The server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to execute the profit allocation unit 212 to convert the profit received in step S4 into profit in a specific currency (step S5). . The server control unit 21 shifts the process to step S6.

The process of converting into profits in a specific currency is not particularly limited.

Converting the profit in a particular currency may include converting the received profit into a predetermined amount of the particular currency. As a result, the audience can give profits to the performer A by a simple operation of designating the performer A without specifying the amount of profit to be given one by one.

The processing of converting into profit in a specific currency may include processing of converting information on the degree of impression, such as the number of times performer A is designated and/or the length of time for which performer A is designated, into a specific currency. good. As a result, the audience can give a desired amount of profit to the performer A depending on the number of times the performer A is designated and/or the length of time during which the performer A is designated.

A specific currency is not particularly limited. The specific currency may be a currency that can be exchanged with various legal currencies, or a currency that can be exchanged for any money or goods included in a designated group of objects, exemplified by privilege points or the like.

The Convert Received Profit to Profit in a Specific Currency process converts the received profit to a specific currency profit for a specified Actor A, exemplified by the number of votes in a popular vote. A process of converting into information to be evaluated may be included. Thereby, the performer A can feel the evaluation from the audience through the information for evaluating the performer A.

Although not an essential aspect, the process of converting the received profit into profit in a specific currency consists of delivering video, image, audio, and/or text relating to the designated performer A to the source of the profit received in step S4. may include processing to Thereby, the audience can confirm that the designated performer A will be given a benefit through the distributed video, image, sound, and/or text. In addition, the audience can enjoy watching the delivered videos, images, sounds, and/or texts.

[Step S6: Allocate Converted Profit]
The server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to execute the profit allocation unit 212, and allocates the profit converted in step S5 to the performer A corresponding to the profit received in step S4. (Step S6). The server control unit 21 shifts the process to step S1 and repeats the processes from step S1 to step S6.

Although not an essential aspect, the process of allocating the converted profit may include the process of awarding the spectator a predetermined profit for the designated performer A. FIG. As the predetermined benefits, for example, items related to the specified performer A, points given to spectators in the specified performer A's fan club, and the like can be mentioned. As a result, the audience can not only convey impressions, etc., but also enjoy predetermined benefits related to the performer A.

[Purchase screen providing step]
Although not an essential aspect, the server control unit 21 cooperates with the server storage unit 22 and the server communication unit 23 to provide a purchase screen for instructing the display device 3 to display a purchase screen on which products related to the show can be purchased. Steps (not shown) are preferably executable. As a result, the audience can purchase the product in real time after viewing the distributed performance video. Therefore, the audience can convey the excitement and the like obtained from the performance to performers A and other people involved in the performance not only by giving profits, but also by purchasing products related to the performance. Further, since the server control unit 21 can execute the purchase screen providing step, it is possible to build a billing model that can increase the profitability of performances such as plays. And the profitability provided by the built billing model can be the basis for permeating entertainment such as plays as a culture.

The display mode of the purchase screen is not particularly limited. The display mode of the purchase screen preferably includes a mode of displaying the purchase screen as VR, AR, and/or MR. As a result, it is possible to prevent the display of purchase screens other than VR, AR, and/or MR from impairing the sense of realism when the audience views the entertainment video. It can be expected that the audience's willingness to purchase will increase by preventing the loss of the sense of presence.

Merchandise related to the purchase screen providing step is not particularly limited. As products related to the purchase screen providing step, for example, part or all of the performance video, booklets related to the performance and / or performer A, photographs, various goods such as accessories, digital data related to the performance and / or performer A, and portrait of performer A rights related to commercial use of

2. Description of the Related Art Conventionally, photographs of one scene of a performance such as a play are sold. Regarding such photographs, it is preferable that the product includes digital data that can display an image obtained by clipping a part of the performance video. This allows spectators to purchase digital data capable of displaying images corresponding to the photographs described above. By making such digital data available for purchase, it is possible to reduce the burden on the spectators regarding storage of photographs, storage of photographs, hygiene considerations, and the like.

The product preferably includes digital data that can be used as a trading card among the digital data related to the show. This allows spectators to enjoy exchanging and/or viewing trading cards related to the show.

The timing at which the purchase screen providing step can be executed is not particularly limited. The timing may be, for example, timing including one or more timings such as before distribution, during distribution, and after distribution.

If the product includes text indicating the flow of the performance, the timing preferably includes timing before distribution. As a result, the audience can enjoy the performance video after grasping the flow of the performance from the text.

In the case where the product includes digital data that can display text and/or images indicating the flow of the performance among the digital data related to the performance, the timing preferably includes timing before distribution. As a result, the spectators can enjoy the performance video after grasping the flow of the performance from the product concerned.

When the product includes various goods, the timing preferably includes timing before distribution. As a result, the audience can enjoy the performance video while cheering on the performer A using various goods.

When the product includes various goods, the timing preferably includes timing after distribution. As a result, spectators can enjoy various goods as souvenirs of the show.

When the product includes digital data that can display an image obtained by clipping a part of the performance video out of the digital data related to the performance, the timing preferably includes timing before and/or after distribution. This allows the audience to enjoy viewing the image before and/or after distribution. As such an image, for example, an image obtained by clipping a portion corresponding to a famous scene from a performance video can be used.

When the product includes digital data that can be used as a trading card among digital data related to a show, the timing preferably includes timing before and/or after distribution. This allows spectators to enjoy exchanging and/or viewing the trading cards before and/or after distribution.

If the product contains digital data, the purchase screen instructed to be displayed in the purchase screen providing step indicates that the digital data can be purchased in association with a non-fungible token (also referred to as "non-fungible token", "NFT"). It is preferable that the screen This allows administrators of server 2 and/or organizers of shows and the like to directly sell digital data associated with NFTs before and/or after distribution. This also allows spectators to indicate their rights to the digital data through NFTs associated with the digital data.

Furthermore, with this, the purchaser who purchased the digital data associated with the NFT can use the digital data based on the rights indicated by the NFT in various media, such as movies, television broadcasts, and on-demand distribution. can announce. In addition, a purchaser who purchases digital data associated with an NFT can produce, distribute, and/or sell advertising images and advertising videos using the digital data based on the rights indicated by the NFT. .

There are no particular restrictions on the means by which digital data can be purchased by associating it with NFTs. Methods related to conventional non-fungible token transactions, such as methods of demonstrating the legitimacy of ownership using blockchain technology, etc. means including

If the purchase screen is a screen that makes it possible to purchase digital data in association with NFT, the digital data associated with NFT is used as digital data and / or trading cards that can display a cut-out image of a part of the performance video. It preferably contains possible digital data.

This allows the spectator to indicate rights (e.g., the right to sell the image and/or trading card to other companies) related to the trading of the image and/or trading card by the associated NFT.

[Network identification information distribution step]
Although it is not an essential mode, the server 2 distributes network identification information that can identify the performance video on the network N to various devices such as the display device 3 and terminals used by the organizer of the performance and/or the performer A. It is preferable to be able to perform a network identification information delivery step (not shown). As a result, the spectator can use the distributed network identification information to recommend the performance video that he/she has been impressed with to his or her friends. Also, the organizer of the show and/or performer A can advertise the show video using the distributed network identification information.

[Audience video reception step]
Although it is not an essential aspect, if the performance video includes real-time video related to the performance, the server 2 executes an audience video reception step (not shown) for receiving the real-time audience video in which the spectator is captured from the display device 3. Preferably possible. Thereby, the server 2 can distribute the audience video to the performer A and the like. Therefore, the audience can perform two-way video communication with performer A and the like. By performing two-way video communication, the audience can enjoy real-time interaction with performers A and the like. Audience members may also reward Actor A in real-time interactions.

[Main flowchart of display processing]
FIG. 5 is a flow chart showing a preferred flow of display processing executed by the display device 3. As shown in FIG. FIG. 6 is a flowchart following FIG. An example of a preferred flow of display processing executed by the display device 3 through the execution of the performance image display program will be described below with reference to FIGS. 5 and 6. FIG.

[Spectator information transmission step]
Although it is not an essential mode, if the server 2 can execute the registration determination step, the display device 3 transmits the spectator information to the server, which is information about the spectator and can be used to determine whether the spectator is a registered spectator. 2, a spectator information transmission step (not shown) can be performed. Accordingly, the server 2 can determine whether the spectator is a registered spectator using the spectator information.

First, the display device 3 executes the performance video receiving step (steps S11 to S14) of receiving the performance video. Thereby, the display device 3 can receive the performance video.

[Step S11: Determining whether distribution instruction is received]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the performance image reception unit 311, and receives a distribution instruction from the audience using the display device 3 to instruct the distribution of the performance image. A process of determining whether or not it has been received is performed (step S11). If received, the display device control section 31 shifts the process to step S12. If not received, the display device control section 31 shifts the process to step S13.

It is preferable that the process of determining whether or not a distribution instruction has been received includes a process of determining whether or not a distribution instruction for instructing distribution of the specified performance video specified by the spectator has been received. As a result, the spectator can instruct distribution of the designated performance video via the display device 3 .

[Step S12: Transmit distribution command]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device communication unit 33 to execute the performance video reception unit 311, and transmits to the server 2 a distribution instruction based on the distribution instruction received in step S11. (step S12). The display device control unit 31 shifts the process to step S13.

[Step S13: Determining Whether Performance Video Has Been Received]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device communication unit 33 to execute the performance image reception unit 311, and performs processing for determining whether or not the performance image has been received from the server 2 (step S13). . If received, the display device control section 31 shifts the process to step S14. If not received, the display device control section 31 shifts the process to step S15.

[Step S14: Store performance video]
The display device control unit 31 cooperates with the display device storage unit 32 to execute the performance video reception unit 311, and stores the performance video received in step S13 in the performance video table 321 (step S14). The display device control unit 31 shifts the process to step S15.

Subsequently, the display device 3 executes image display steps (steps S15 to S18 and step S22) for displaying at least part of the performance image on the head mounted display 34 . Thereby, the display device 3 can display the performance image.

[Step S15: Determining whether a display instruction has been received]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the video display unit 315, and receives a display instruction from the audience using the display device 3 to display the performance video. A process is performed to determine whether or not it has been completed (step S15). If received, the display device control section 31 shifts the process to step S16 (shown in FIG. 6). If not, the display device control unit 31 shifts the process to step S11 and repeats the process from step S11 to step S22.

The display image D displayed on the head-mounted display 34 may prevent the audience from seeing the real world. Therefore, when viewing the display image D displayed on the head-mounted display 34, there is a demand for support so that the audience can view the image safely.

Although not an essential aspect, it is preferable that the display device 3 can execute a position determination step (step S16) capable of determining whether the position of the head mounted display 34 is included in a predetermined range. Thereby, the display of the display image D can be controlled according to whether the position of the head mounted display 34 is included in the predetermined range. As a result, it is possible to control the display image D to be displayed on the head-mounted display 34 only when the audience is in a safe place such as indoors. In addition, it is possible to control the display image D not to be displayed on the head-mounted display 34 when the spectator is in a place where it is feared that the audience cannot view it safely.

[Step S16: Determining Whether the Position is Included in a Predetermined Range]
The display device control unit 31 cooperates with the display device storage unit 32 and the position acquisition unit 36 to execute the position determination unit 313 to determine whether the position of the head mounted display 34 is within a predetermined range ( step S16, position determination step). If it is determined that the position is within the predetermined range, the display device control section 31 shifts the process to step S17. If it is not determined that the position is included in the predetermined range, the display device control section 31 shifts the process to step S11 (shown in FIG. 5) and repeats the processes from step S11 to step S22.

The predetermined range is not particularly limited as long as it is a range that allows spectators to safely view the display image D displayed on the head-mounted display 34 . The predetermined range may be, for example, a range including one or more of a range relating to the spectator's home/room, etc., and a range relating to a building/room provided for viewing the performance video.

The position determination step determines whether the position of the head-mounted display 34 is included in a range where it is feared that spectators cannot view safely, and if it is determined that the position is included in the range, the process proceeds to step S11 A process of moving the process to step S17 when it is not determined that the position is included in the range may be included. As a result, the display device 3 displays the display image D on the head-mounted display 34 when the position of the head-mounted display 34 is included in a range where it is feared that spectators cannot view safely, such as roads and mountains. You can control not to display it.

Regarding safe viewing by spectators, as described above, display image D displayed on head-mounted display 34 may prevent spectators from viewing the real world. Therefore, if the audience walks while viewing the display image D, there is a risk of tripping over and/or bumping into furniture or the like.

Although not an essential aspect, it is preferable that the display device 3 can execute a speed determination step (step S17) capable of determining whether the movement speed of the head mounted display 34 is within a specific range. Thereby, the display of the display image D can be controlled according to whether the movement speed of the head mounted display 34 is within a specific range. As a result, the display image D can be controlled to be displayed on the head-mounted display 34 only when the audience is not walking.

[Step S17: Determining whether the movement speed is within a specific range]
The display device control unit 31 cooperates with the display device storage unit 32 and the speed acquisition unit 37 to execute the speed determination unit 314 to determine whether the moving speed of the head mounted display 34 is within a specific range. (Step S17, speed determination step). If it is determined that the moving speed is within the specific range, the display device control section 31 shifts the process to step S18. If it is not determined that the moving speed is within the specific range, the display device control unit 31 shifts the process to step S11 (shown in FIG. 5) and repeats the processes from step S11 to step S22.

The specific range is not particularly limited as long as it is within a moving speed range that allows spectators to view safely. The specified range may be, for example, a range of speeds of movement when the spectator is substantially stationary.

In the speed determination step, it is determined whether the moving speed of the head mounted display 34 is included in a range where it is feared that spectators cannot view safely. If it is not determined that the movement speed is included in the range, the processing may be moved to step S18. As a result, when the moving speed of the head-mounted display 34 is included in the range where there is concern that spectators cannot view safely, exemplified by the speed range while walking and the speed range while running, the display device 3 Control can be performed so that the display image D is not displayed on the head-mounted display 34 .

[Step S18: Display Display Image]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the image display unit 315, and displays the display image D of the performance image received in step S13 on the head mounted display 34. (step S18, display step). The display device control unit 31 shifts the process to step S19.

If the performance image received in step S13 includes a stereoscopic image, the display step preferably includes processing for displaying the display image D, which is a stereoscopic image, on the head-mounted display . Thereby, the display device 3 can display the video of the performance with a more realistic feeling.

If the performance video received in step S13 includes information capable of displaying VR, AR, and/or MR, the display step displays the display video D on the head-mounted display 34 in VR, AR, and/or MR. It is preferable to include possible treatments. As a result, the display device 3 can provide the audience with a virtual reality space (also referred to as a metaverse area) corresponding to the performance hall T. FIG. Therefore, the audience can enjoy a realistic viewing experience in the virtual reality space.

It is preferable that the processing further cooperates with the orientation acquisition unit and includes a procedure that can change the range and/or orientation of the performance image displayed as the display image D in accordance with the orientation of the head-mounted display 34. .

Further, the processing includes, for example, a procedure for changing the range and/or direction of the display image D displayed in the performance image according to the operation of the audience and/or the orientation of the head-mounted display 34, or the operation of the audience. Accordingly, it is preferable to include a procedure for changing the viewpoint regarding the range displayed as the display image D of the performance image, and the like.

The display device 3, when the specified portion specified from the display image D being displayed on the head-mounted display 34 in the performance image is one of the one or more performers A, provides the performer A corresponding to the specified portion with a profit. The grantable profit granting step (from step S19 to step S21) is executed. As a result, the display device 3 can give the specified performer A a benefit.

Actor A may move in display image D. As a result, the audience may find it difficult to specify the moving performer A from the displayed image D. FIG. It is preferable that the display step can display an image capable of designating one or more performers A at a position different from the display image D. FIG. As a result, even if the performer A moves in the display image D, the audience can easily specify the performer A using the image. As a result, the audience can designate performer A by, for example, clicking an image exemplified by a photograph of performer A, and give profit such as a tip to the designated performer A.

[Step S19: Determining Whether Specified Part Has Been Specified]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the profit provision unit 312, and determines whether or not the specified portion is specified from the display image D displayed in step S18. (step S19). If designated, the display device control section 31 shifts the process to step S20. If not specified, the display device control section 31 shifts the process to step S22.

In the case where the display step is capable of displaying an image that allows one or more performers A to be specified, it is preferable that the processing in step S19 can determine that the specified part has been specified when the image is specified. Thereby, the display device 3 can determine the designation of the performer A using the image.

Preferably, the benefit giving step includes a process (step S20) for determining whether the specified part is any of the performers A. This prevents the server 2 from executing the process of determining whether the specified part is any of the performers A. FIG. As a result, even when the number of display devices 3 to which the server 2 distributes the performance video is large, the server 2 can be prevented from being subjected to an excessive processing load due to the determination process.

[Step S20: Determining whether the specified part is any of the performers]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the profit giving unit 312, and determines whether the specified portion specified in step S19 is any of the performers A. Processing is performed (step S20). If the specified part is any of the performers A, the display device control section 31 shifts the process to step S21. If the specified part does not correspond to any of the performers A, the display device control section 31 shifts the processing to step S22.

The process of determining whether the specified part is one of the performers A is not particularly limited. A process for determining the performer A who will perform, or the like may be used.

If the specified part is any of the images that can specify one or more performers A, the process of determining whether the specified part is any of the performers A can determine the performer A using the image corresponding to the specified part. is preferably As a result, even if the performer A moves in the display image D, the audience can specify the performer A using the image.

If the display step includes the process of displaying the display image D on the head-mounted display 34 in VR, AR, and/or MR modes, the process of determining whether the specified portion is any of the performers A is exemplified by a finger or the like. It is preferable to include a procedure for determining whether the specified part is any of the performers A by the part of the body of the spectator that is being played and/or the body movement using the pointing means or the like worn by the spectator on the fingers or the like. This allows the audience to designate performer A through intuitive bodily motions exemplified by pointing at performer A. As a result, the presence of the audience can be further enriched.

[Step S21: Give profits to corresponding performers]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the profit giving unit 312, and gives a profit to the performer A corresponding to the specified portion specified in step S19. (step S21). The display device control unit 31 shifts the process to step S22.

It is preferable that the process of giving the benefit includes the process of specifying the corresponding performer A and transmitting to the server 2 the performer specifying information (also referred to as “the benefit transmitted by the display device 3 ”) to which the corresponding performer A can be given a benefit. As a result, the server 2 can give benefits to the performer A using the transmitted performer identification information.

The performer specifying information is not particularly limited as long as it includes information that can specify the performer A to whom the benefit is given. The performer identification information may be information including one or more of information relating to a portion including the designated performer A in the image displayed on the display device 3 and information with which the performer A can be identified.

If the performer identification information does not include information that can identify performer A, the process of determining whether or not benefits have been received includes identifying performer A using information that can identify performer A to whom benefits are given. is preferred. The process of identifying the performer A is not particularly limited, and may be, for example, a process of identifying the performer A using correspondence information, a process of identifying the performer A using various types of image recognition, or the like.

Although not an essential aspect, the performer identification information preferably includes information regarding the amount of profit. Since the performer specifying information includes information about the amount of profit, the audience can give the performer A a profit according to the degree of impression.

The benefit to be granted is not particularly limited. The benefit to be granted may be the benefit in a currency that can be exchanged for various legal currencies, or the benefit in a currency that can be redeemed for any money or goods included in a specified group of objects, exemplified by reward points, etc. good.

The benefits awarded may include information evaluating the designated Actor A, exemplified by the number of votes in a popularity poll. Thereby, the designated performer A can feel the evaluation from the audience through the information for evaluating the performer A.

Benefits granted may include information that increases the likelihood that Actor A will be granted a given right for a given right, exemplified by, for example, the right to appear in a particular performance and/or a particular film. Such information includes, for example, information supporting the granting of predetermined rights to the performer A, information evaluating the performer A, and the like. As a result, the designated performer A can feel the evaluation from the audience through the predetermined rights. Also, if the predetermined right is the right to appear, the audience can further enjoy entertainment and/or images in which the designated performer A appears.

Although not an essential aspect, the process of awarding the benefit to the corresponding actor A may include the process of displaying video, image, audio, and/or text relating to the designated actor A. Thereby, the audience can confirm that the designated performer A will be given a benefit through the displayed video, image, sound, and/or text. Also, the audience can enjoy viewing the displayed videos, images, sounds, and/or texts.

Although it is not an essential aspect, the process of awarding a benefit to the corresponding performer A may include the process of awarding a predetermined benefit for the designated performer A to the audience. Examples of the predetermined profit include items related to the designated performer A, points in the designated performer A's fan club, and the like. As a result, the audience can not only convey impressions, etc., but also enjoy predetermined benefits related to the performer A.

[Step S22: Determining Whether to End Display]
The display device control unit 31 cooperates with the display device storage unit 32 and the display device input unit 35 to execute the image display unit 315, and performs processing for determining whether to end the display on the head mounted display 34 (step S22). ). If the display is finished, the display device control section 31 shifts the process to step S11 and repeats the process from step S11 to step S22. If the display is not finished, the display device control section 31 shifts the process to step S16 and repeats the process from step S16 to step S22.

[Purchase screen display step]
Although not an essential aspect, the display device control unit 31 cooperates with the display device storage unit 32, the display device communication unit 33, the head mounted display 34, and the display device input unit 35 to provide the head mounted display 34 with performance-related information. Preferably, a purchase screen display step (not shown) is executable to command display of a purchase screen on which the product can be purchased. As a result, the audience can not only receive benefits, but also can convey the impressions and the like obtained from the performance to performers A and other people involved in the performance by purchasing products related to the performance.

The purchase screen display step preferably includes processing for receiving the purchase screen transmitted from the server 2 . As a result, spectators can purchase merchandise related to the show through the server 2 .

The display mode of the purchase screen is not particularly limited. The display mode of the purchase screen preferably includes a mode in which the purchase screen is displayed as VR, AR, and/or MR (hereinafter also simply referred to as "purchase screen display mode such as VR"). As a result, it is possible to prevent the display of purchase screens other than VR, AR, and/or MR from impairing the sense of realism when the audience views the entertainment video. It can be expected that the audience's willingness to purchase will increase by preventing the loss of the sense of presence.

The procedure for designating the product that the spectator wishes to purchase is not particularly limited. The procedure for specifying the product that the spectator wishes to purchase is, for example, a procedure for specifying the product that the spectator wishes to purchase by voice, a procedure for specifying the product that the spectator wishes to purchase by input through the display device input unit 35, etc. Including above. If the procedure for specifying the product that the spectator wishes to purchase includes the procedure for specifying by voice, the spectator's sense of presence can be further enriched. Therefore, it can be expected that the audience's willingness to buy will be enhanced.

When the display step includes processing to display in a purchase screen display mode such as VR, the procedure includes physical actions using a part of the spectator's body exemplified by fingers etc. and / or instructions worn by spectators on their fingers etc. It is preferable to include a procedure in which the spectator can specify the product that the spectator wishes to purchase by means of physical action using means or the like. This allows the audience to specify the product they wish to purchase by means of intuitive bodily movements exemplified by the gesture of pointing at performer A. As a result, the presence of the audience can be further enriched. Therefore, it can be expected that the audience's willingness to buy will be enhanced.

Merchandise that can be purchased in the purchase screen display step is not particularly limited, and may be the same as the merchandise related to the purchase screen providing step described above.

[Spectator video transmission step]
Although it is not an essential aspect, if the performance video includes real-time video related to the performance, the display device 3 executes a spectator video transmission step (not shown) for transmitting the real-time spectator video in which the spectator is filmed to the server 2. Preferably possible. As a result, the audience can enjoy real-time interaction with performers A and the like. Audience members may also reward Actor A in real-time interactions.

[Display condition specification step]
Although not an essential aspect, if the performance video is captured by an omnidirectional camera, the display device 3 can specify the display magnification and the angle of view of the display video D to be displayed on the head-mounted display 34 from the performance video. It is preferable to execute a display condition designation step (not shown). By the display device 3 executing the display condition specifying step, the spectator can select an arbitrary part from the performance image of the entire stage TS and the surroundings of the stage TS at a desired display magnification and/or angle of view. can be displayed.

Therefore, by executing the display condition specifying step by the display device 3, even if the performer A to be the object of benefit provision is at a place away from the omnidirectional camera and/or away from the stage TS, the audience can specify the performer A to whom the benefit is to be given without making a mistake, and can surely give the specified performer A the benefit. In addition, this allows the audience to enjoy the show by displaying the display image D at their preferred display magnification and angle of view customized to their liking.

The means for specifying the display magnification and the angle of view is not particularly limited, and may be, for example, a means including specifying the display magnification and the angle of view according to the input made via the display device input section 35 .

By the display device 3 executing the display processing of the flow described above, the audience can display the display image D among the performance images received from the server 2 on the head mounted display 34 of the display device 3 . As a result, the delivered video of the performance is displayed with a rich presence.

Then, the display device 3 executes the display processing of the flow described above, whereby the spectator designates a designated portion corresponding to one or more performers A from the display image D being displayed on the head mounted display 34, Benefits such as "twist" can be given to the specified performer A. Since the benefit is given through the procedure of designating the designated portion corresponding to one of the performers A from the displayed display image D, the audience will not be provided with information that allows the performer A to be identified. However, it is possible to designate the performer A to whom the benefit is to be given without making a mistake, and to reliably provide the specified performer A with benefits such as "twist".

Therefore, even if the display device 3 executes the display processing of the above-described flow, even if information that can identify the performer A is not provided for the performer A appearing in the distributed performance video, The audience can give the performer A a benefit such as a "twist".

<Usage example of box office video distribution system S>
Next, a usage example of the entertainment video distribution system S according to this embodiment will be described.

[Shooting the box office video]
The filming staff, etc. requested by the organizer of the show use the photographing device 1 (the first photographing device 1a and the second photographing device 1b in FIG. ), one or more performers A performing on the stage TS of the performance hall T are photographed. The shooting staff or the like edits the shot video and stores the performance video including the shot video in the server 2.例文帳に追加

FIG. 7 is a schematic plan view showing an example of a performance venue T in which a first imaging device 1a and a second imaging device 1b having omnidirectional cameras are installed. In the example shown in FIG. 7, the first imaging device 1a and the second imaging device 1b having omnidirectional cameras are installed outside the stage TS and inside the performance venue T. As shown in FIG. As a result, the photographing device 1 can photograph the performance venue T including the surroundings of the stage TS in addition to the first performer A1 and the second performer A2 performing on the stage TS of the performance venue T. Since the number of photographing devices 1 is two or more, the photographing device 1 can photograph a stereoscopic image.

[Distinguish that you are a registered spectator]
A spectator using the display device 3 transmits information about the spectator to the server 2 . The server 2 uses the transmitted information to determine whether or not the spectator is a registered spectator who has registered the registered spectator information related to the means for giving benefits.

[Instructs distribution of performance video]
A spectator using the display device 3 instructs the server 2 to distribute the performance video via the display device 3 . The server 2 distributes the performance video to the display device 3 in the form of live distribution and/or recorded distribution. The display device 3 receives the distributed performance video and stores it in the performance video table 321 .

[Distinguish the position and movement speed of the head-mounted display]
The display device 3 acquires the position of the head-mounted display 34 and determines whether the spectator is within a predetermined range exemplified by a safe place such as his/her home. In addition, the display device 3 acquires the moving speed of the head mounted display 34 and determines whether or not the audience is in a state of being able to view safely, such as when the audience is substantially stationary. By determining the position and movement speed of the head-mounted display 34, the display device 3 can assist the spectators in safely viewing the video of the performance.

[Instruct to display the performance video]
A spectator using the display device 3 instructs display of the distributed performance video via the display device 3 . The display device 3 displays at least part of the performance image on the head mounted display 34 in the form of a stereoscopic image or the like.

[Specify performer A to whom benefits will be granted]
A spectator using the display device 3 designates the performer A to whom profit is to be given by designating a portion corresponding to the performer A from the display image D displayed on the head-mounted display 34 . The display device 3 transmits to the server 2 performer specifying information that can specify the performer A corresponding to the specified part and give a profit.

FIG. 8 is a schematic diagram showing an example of how the audience designates the performer A using the display image D. As shown in FIG. In the example shown in FIG. 8, the display image D is superimposed on the scenery of the real world and displayed on the head-mounted display 34 . In the example shown in FIG. 8, the display image D is part of a performance image of a first performer A1 standing on the stage TS and a second performer A2 standing on a balcony having stairs provided on the stage TS. In the example shown in FIG. 8, the head-mounted display 34 displays a specified portion display area F indicating a portion specified by the display device input section 35. FIG.

Since the display image D is superimposed on the scenery of the real world and displayed on the head-mounted display 34, the audience can enjoy the display image D displayed with a rich presence.

In addition, since the display image D is superimposed on the scenery of the real world and displayed on the head-mounted display 34, even when the audience is viewing the display image D through the head-mounted display 34, it is possible to see the real world. can see the world. As a result, it is possible to further assist the spectators in viewing the displayed image D safely.

Furthermore, since the display image D can be displayed on the head-mounted display 34 in the form of a stereoscopic image, the audience can enjoy the display image D displayed with a more realistic feeling.

The spectator using the display device 3 uses the display device input section 35 to move the specified portion display area F to specify the specified portion corresponding to the first performer A1. As a result, even when the first performer A1 and the second performer A2 cannot be identified due to their costumes, etc., the display device 3 can identify the performer A corresponding to the specified portion and display the performer specifying information that can give benefits. Can be sent to server 2.

[Benefits given to designated performer A]
The server 2 receives the performer specifying information and gives the performer A specified by the performer specifying information a profit converted into a profit in a specific currency.

[Finish display]
A spectator using the display device 3 gives an instruction to end the display of the performance image via the display device input unit 35 . The display device 3 terminates the display of the performance image.

According to the performance video distribution system S of the present embodiment, the audience can display the display video D of the performance video received from the external device on the head mounted display 34 of the display device 3 .

Then, according to the performance video distribution system S of the present embodiment, the spectator specifies a specified portion corresponding to one or more performers A from the display video D being displayed on the head-mounted display 34, and Benefits such as "twist" can be given to performer A. Since the benefit is given through the procedure of designating the designated portion corresponding to one of the performers A from the displayed display image D, the audience will not be provided with information that allows the performer A to be identified. However, it is possible to specify the performer A to whom the benefit is to be given without making a mistake, and to surely give the specified performer A the benefit such as "twist".

Therefore, according to the performance video distribution system S of the present embodiment, even if the performer A appearing in the distributed performance video is not provided with information that can identify the performer A, the audience can Benefits such as "twist" can be given to the performer A.

It should be noted that within the scope of the idea of the present invention, those skilled in the art can conceive of various modifications and modifications, and it is understood that these modifications and modifications also fall within the scope of the present invention. For example, additions, deletions, or design changes of components, or additions, omissions, or changes in conditions of the above-described embodiments by those skilled in the art are also subject to the gist of the present invention. is included in the scope of the present invention as long as it has

S box office video distribution system 1 shooting device 2 server 21 server control unit 211 distribution unit 212 profit allocation unit 22 server storage unit 221 box office table 23 server communication unit 3 display device 31 display device control unit 311 box office video reception unit 312 profit giving unit 313 Position determining unit 314 Speed determining unit 315 Video display unit 32 Display device storage unit 321 Performance video table 33 Display device communication unit 34 Head mounted display 35 Display device input unit 36 Position acquisition unit 37 Speed acquisition unit A Performer A1 First performer A2 Second 2 Performer D Display image F Specified partial display area N Network T Performance venue TS Stage

Claims (3)

to the display device,
a performance image receiving step capable of receiving performance images of one or more performers performing on stage from an external device;
a display step capable of displaying a display image including part or all of the entertainment image on a head-mounted display;
a benefit giving step capable of giving a benefit to the performer corresponding to the specified portion when the specified portion specified from the displayed image is one of the one or more performers;
A box office video display program that can be executed. on the display device,
It is possible to further execute a position determination step capable of determining whether the position of the head mounted display is included in a predetermined range,
The display step can control display of the display image depending on whether the position is included in the predetermined range.
2. A performance image display program according to claim 1. on the display device,
It is possible to further execute a speed determination step capable of determining whether the moving speed of the head mounted display is within a specific range,
The display step can control display of the display image depending on whether the movement speed is included in the specific range.
3. A performance image display program according to claim 1 or 2.