JP2023182937A - Reaction management device and program - Google Patents

Abstract

To reflect the reaction of viewers in a shooting studio.SOLUTION: A reaction management device can communicate with an operation terminal used by a viewer who views video and a presentation device installed in a shooting studio where the video is recorded. The reaction management device includes a reaction receiving unit that receives reaction information representing a reaction by the viewer from the operation terminal, and a presentation control unit that transmits a control signal for presenting the reaction to the presentation device based on the reaction information.SELECTED DRAWING: Figure 3

Description

The present invention relates to a reaction management device and program.

2. Description of the Related Art Conventionally, public program recording has been carried out in which viewers are placed in a filming studio to record a video program. In recent years, program production methods have also been used in which viewers view programs from remote locations using online conferencing tools.

On the other hand, there is a program production method in which viewers participate in the program using interactive broadcasting technology using a television connected to the Internet. For example, Patent Document 1 discloses that voting information input by viewers at viewer terminals is aggregated via the Internet, and the aggregate results are reflected in broadcast images, thereby realizing a viewer-participation program with a rich sense of realism. An interactive broadcast viewing system is disclosed.

Patent No. 4340398

However, when a viewer views a program from a remote location, the filming studio cannot grasp the viewer's reaction in real time. As a result, it may not be possible to bring out the full performance of the performers, resulting in a video program that lacks excitement.

In view of the above-mentioned technical problems, one aspect of the present invention aims to reflect the reactions of viewers in a shooting studio.

In order to solve the above problems, a reaction management device according to one aspect of the present invention is a reaction management device that can communicate with an operation terminal used by a viewer who views a video and a presentation device installed in a shooting studio where the video is recorded. A reaction receiving unit that receives reaction information representing a reaction by a viewer from an operation terminal, and a presentation control unit that transmits a control signal for presenting a reaction to a presentation device based on the reaction information. Be prepared.

According to one aspect of the present invention, reactions of viewers can be reflected in the shooting studio.

FIG. 1 is a block diagram showing an example of the overall configuration of a program production system. FIG. 2 is a block diagram showing an example of the hardware configuration of a computer. FIG. 1 is a block diagram showing an example of a functional configuration of a program production system. It is a flowchart which shows an example of the processing procedure of a program presentation method. FIG. 3 is a conceptual diagram showing an example of an operation screen.

Embodiments of the present invention will be described below with reference to the accompanying drawings. Note that, in this specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals and redundant explanation will be omitted.

[overview]
Conventionally, at the production site of television programs broadcast via TV radio waves or video content distributed via communication networks (hereinafter collectively referred to as "video programs"), large numbers of viewers are placed in the filming studio. A public program recording was being conducted to record a video program. When recording public programs, the audience's reactions serve as a barometer for knowing the audience's reactions in advance. Additionally, the audience's reaction lifts the mood of the performers, which has the effect of bringing out better performances and enlivening the overall atmosphere of the filming studio.

However, due to changes in the social situation due to the spread of infectious diseases, for example, it may become difficult to record public programs. Programs that are produced without viewers in the filming studio are unable to feel the presence of the viewers, and often leave the impression of being less exciting than in the past. For this reason, a program production method is used in which a program is viewed in a simulated manner from a remote location using an online conference tool or the like. Note that, as a known online conference tool, for example, there is a technique disclosed in Reference Document 1.

[Reference 1] Zoom Video Communications Inc, "Video conference, cloud telephony, webinar, chat, virtual event | Zoom", [online], [Retrieved May 11, 2020], Internet <URL: https:/ /zoom.us/＞

The program production method of viewing a program from a remote location also has the advantage that even viewers who have difficulty viewing the program from a filming studio due to various circumstances can participate in viewing the program. Various circumstances include, for example, severe illness or injury, or living far away.

In addition, a survey-style program participation method using a predetermined button on the remote controller of a television receiver (for example, the "d button") or Hybrid Cast is often used for viewer participation programs. (For example, see Reference 2). In addition, remote controller buttons, Hybrid Cast, and the like are also used in questionnaires to improve the quality of video programs (for example, see Reference 3). These methods have become effective means for program producers to grasp viewer opinions macroscopically.

[Reference document 2] Japanese Patent Application Publication No. 2003-009127 [Reference document 3] Japanese Patent Application Publication No. 2014-217024

Viewing methods that use online conferencing tools require viewers to keep their faces visible through their terminal cameras for long periods of time during recording and broadcasting. For example, if viewers participate from their homes, they will watch while dealing with various events that occur inside their homes. Therefore, it is difficult for viewers to concentrate on watching the program, which may cause stress. Due to these circumstances, many viewers are reluctant to use online conference tools for viewing.

On the other hand, many viewers feel that the questionnaire-based program participation method has a low sense of participation because they are made to feel that their opinion is just one of many. Also. When information input by a viewer's button operations or the like is uploaded to studio equipment via the Internet, for example, transmission delays are unavoidable. Therefore, it is difficult to reflect the reactions of viewers on studio equipment in accordance with the timing of program progress.

In one embodiment of the present invention, reactions by the viewer are received from an operation terminal used by the viewer viewing the video, and the reaction by the viewer is presented from a presentation device installed in a shooting studio. Therefore, according to an embodiment of the present invention, the reactions of viewers can be reflected in the shooting studio. This makes it possible for producers and performers of video programs to understand the reactions of remote viewers and utilize them in program production.

[Embodiment]
One embodiment of the present invention is a program production system that presents reactions by viewers who view a video program in a filming studio that records the video program. The program production system in this embodiment transmits a video program from a program production facility where a shooting studio is installed to a viewing facility where viewers are present via the Internet or the like. At the viewing facility, viewers view video programs and obtain reactions from the viewers. At the program production facility, viewers' reactions are presented using a presentation device installed in the filming studio based on the reaction information acquired at the viewing facility.

Since the program production system in this embodiment transmits reaction information via a communication network such as the Internet, delays may occur. Therefore, in the case of a production in which a deviation due to a delay is not tolerated, the program production system in this embodiment collects reaction information in advance through a rehearsal or the like and stores it in association with the progress status of the rehearsal. Thereafter, during the actual broadcast, the viewer's reactions are presented using a presentation device in synchronization with the progress of the program, based on the reaction information collected in advance.

<Overall configuration of program production system>
First, the overall configuration of the program production system in this embodiment will be explained with reference to FIG. 1. FIG. 1 is a block diagram showing an example of the overall configuration of a program production system according to this embodiment.

As shown in FIG. 1, the program production system 1 in this embodiment includes a reaction management device 10, a presentation device 11, a program production device 12, a video transmission device 13, an operation terminal 21, and a receiver 22. The reaction management device 10, the presentation device 11, the program production device 12, the video transmission device 13, the operation terminal 21, and the receiver 22 are connected to enable data communication via a communication network N1 such as a LAN (Local Area Network) or the Internet. ing.

The reaction management device 10, the presentation device 11, the program production device 12, and the video transmission device 13 are installed in the program production facility E1. The program production facility E1 is a facility that has equipment for producing video programs that are distributed or broadcast via the communication network N1 or broadcast waves N2. The program production facility E1 is, for example, a television station.

A photography studio E2 is installed in the program production facility E1. The photography studio E2 is provided with at least a floor. On the floor, a set of props or small props is provided depending on the content of the video program. Performers of the video program perform various performances on the floor.

The photography studio E2 may be provided with viewing seats. The bleachers will be located in positions where the entire floor can be viewed. For example, when recording a public program, viewers watch the video program recorded on the floor from the audience seats.

There are two cameras C1 and C2 in the program production facility E1. The camera C1 is a camera for photographing video materials used in program production. Note that the camera C1 may exist outside the program production facility E1 as long as it can communicate with each device within the program production facility E1 via a wired or wireless communication line.

Camera C2 is a camera for photographing the interior of photography studio E2. The camera C2 is installed at a predetermined position in the photography studio E2 so that at least the presentation device 11 is included in the angle of view.

Hereinafter, the video captured by the camera C1 will be referred to as a "studio video." Further, the video captured by camera C2 is referred to as an "overhead video".

If the camera C1 is fixedly installed so that the presentation device 11 is included in the angle of view, the camera C2 may not be present. In this case, the video captured by camera C1 is used as both a studio video and an overhead video.

The operating terminal 21 and the receiver 22 are installed in the viewing facility E3. The viewing facility E3 is a facility that has equipment for viewing video programs. The viewing facility E3 is, for example, a viewer's residence.

The reaction management device 10 is an information processing device such as a personal computer, a workstation, or a server that manages reaction information representing reactions by viewers. The reaction management device 10 receives reaction information from the operation terminal 21 and transmits a control signal for presenting the reaction by the viewer to the presentation device 11.

The presentation device 11 is an electronic device that presents reactions by viewers. The presentation device 11 receives a control signal from the reaction management device 10, and performs an operation corresponding to the reaction by the viewer according to the control signal.

The operation corresponding to the reaction differs depending on the configuration of the presentation device 11. This operation is performed in a manner that can be perceived by the person present in the photographic studio E2 through visual, auditory, or tactile senses. The persons existing in the shooting studio E2 include, for example, performers who perform on the floor, or producers who are engaged in various tasks in program production.

An example of the presentation device 11 is a lighting fixture that can be operated via a wired or wireless communication line. The lighting equipment has a light source that can emit light in a plurality of colors using, for example, a light-emitting diode (LED). A lighting fixture that can be operated via a communication network is disclosed, for example, in Reference 4 below.

[Reference 4] Signify Japan LLC, "Changing your life with smart lights | Philips Hue", [online], [Searched on May 11, 2020], Internet <URL: https://www.philips -hue.com/ja-jp＞

The presentation device 11 is comprised of a plurality of lighting fixtures that correspond one-on-one with each viewer. According to the control signal based on the reaction information received from the operation terminal 21, the presentation device 11 controls the lighting equipment corresponding to the viewer who uses the operation terminal 21 in a color, brightness, or blinking pattern according to the reaction of the viewer. etc. to emit light.

Other examples of the presentation device 11 are a large display, a speaker array, a drivable studio set, a wearable device worn by a performer or producer, and the like. The presentation device 11 using a large display displays, for example, a screen having a plurality of areas corresponding to each viewer, and displays each area in a display mode according to the reaction of the viewer.

The speaker array presentation device 11 includes, for example, a plurality of speakers corresponding to each viewer, and outputs an audio signal with a sound, volume, etc. according to the reaction of the viewer. The studio set presentation device 11 is, for example, composed of a plurality of sets corresponding to each viewer, and changes its form in response to the viewer's reaction (for example, a character raises his hand, claps, etc.). The presentation device 11, which is a wearable device, vibrates in a pattern and size depending on the viewer's reaction, for example.

The presentation device 11 is installed on the floor or the audience seats in the photography studio E2. However, the installation position of the presentation device 11 is not limited to the floor or the audience seats, but can be installed at any position as long as it is perceivable by the performers on the floor and can be photographed by the camera C2. .

The program production device 12 is equipment that produces video programs using studio video. The program production device 12 is electrically connected to the camera C1 via a wired or wireless communication path, and is configured to be able to acquire studio video. The program production device 12 may include a plurality of devices having various functions used in program production. The program production device 12 may include equipment for broadcasting the produced video program to the viewing facility E3 via the broadcast radio waves N2.

The video transmitting device 13 is an information processing device such as a personal computer, a workstation, or a server that transmits video programs and bird's-eye views. The video transmitting device 13 is electrically connected to the camera C2 via a wired or wireless communication path, and is configured to be able to obtain an overhead video. The video transmitting device 13 transmits the video program acquired from the program production device 12 and the bird's-eye view video acquired from the camera C2 to the viewing facility E3 via the communication network N1.

The operating terminal 21 is an information processing terminal such as a personal computer, a tablet terminal, or a smartphone operated by the viewer. The operating terminal 21 receives a video program and an overhead video from the video transmitting device 13, and displays the video to the viewer.

The receiver 22 is an electronic device such as a television receiver, a set-top box, or a personal computer on which a viewer views a video program. The receiver 22 receives the video program from the program production device 12 via the broadcast wave N2 and displays it to the viewer.

Note that the overall configuration of the program production system 1 shown in FIG. 1 is one example, and there may be various system configuration examples depending on the use and purpose. For example, the reaction management device 10 may be realized by a plurality of computers, or may be realized as a cloud computing service. Further, for example, the program production system 1 may be realized by a stand-alone information processing device that has functions that should be provided by the reaction management device 10, the program production device 12, and the video transmission device 13, respectively.

<Hardware configuration of program production system>
Next, the hardware configuration of the program production system 1 in this embodiment will be explained with reference to FIG. 2.

≪Computer hardware configuration≫
The reaction management device 10, program production device 12, video transmission device 13, and operation terminal 21 in this embodiment are realized by, for example, a computer. FIG. 2 is a block diagram showing an example of the hardware configuration of the computer in this embodiment.

As shown in FIG. 2, the computer 500 in this embodiment includes a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, a RAM (Random Access Memory) 503, an HDD (Hard Disk Drive) 504, It has an input device 505, a display device 506, a communication I/F (Interface) 507, and an external I/F 508. CPU501, ROM502, and RAM503 form what is called a computer. Each piece of hardware in the computer 500 is interconnected via a bus line 509. Note that the input device 505 and the display device 506 may be connected to an external I/F 508 for use.

The CPU 501 is an arithmetic unit that implements control and functions of the entire computer 500 by reading programs and data from a storage device such as the ROM 502 or the HDD 504 onto the RAM 503 and executing processing.

The ROM 502 is an example of a nonvolatile semiconductor memory (storage device) that can retain programs and data even when the power is turned off. The ROM 502 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 501 to execute various programs installed on the HDD 504 . Specifically, the ROM 502 stores data such as boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface) that are executed when the computer 500 is started, OS (Operating System) settings, and network settings. is stored.

The RAM 503 is an example of a volatile semiconductor memory (storage device) whose programs and data are erased when the power is turned off. The RAM 503 is, for example, DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The RAM 503 provides a work area where various programs installed on the HDD 504 are expanded when the CPU 501 executes them.

The HDD 504 is an example of a nonvolatile storage device that stores programs and data. The programs and data stored in the HDD 504 include an OS, which is basic software that controls the entire computer 500, and applications that provide various functions on the OS. Note that, instead of the HDD 504, the computer 500 may use a storage device (for example, SSD: Solid State Drive) that uses flash memory as a storage medium.

The input device 505 is a touch panel used by the user to input various signals, operation keys or buttons, a keyboard or mouse, a microphone used to input sound data such as voice, or the like.

The display device 506 includes a display such as a liquid crystal or organic EL (Electro-Luminescence) that displays a screen, a speaker that outputs sound data such as audio, and the like.

The communication I/F 507 is an interface that connects to a communication network and allows the computer 500 to perform data communication.

External I/F 508 is an interface with an external device. The external device includes a drive device 510 and the like.

The drive device 510 is a device for setting the recording medium 511. The recording medium 511 here includes a medium that records information optically, electrically, or magnetically, such as a CD-ROM, a flexible disk, and a magneto-optical disk. Further, the recording medium 511 may include a semiconductor memory or the like that electrically records information, such as a ROM or a flash memory. Thereby, the computer 500 can read and/or write to the recording medium 511 via the external I/F 508.

Note that the various programs installed on the HDD 504 are, for example, when the distributed recording medium 511 is set in the drive device 510 connected to the external I/F 508, and the various programs recorded on the recording medium 511 are read by the drive device 510. It is installed by Alternatively, various programs to be installed on the HDD 504 may be installed by being downloaded from a network different from the communication network via the communication I/F 507.

<Functional configuration of program production system>
Next, the functional configuration of the program production system in this embodiment will be explained with reference to FIG. 3. FIG. 3 is a block diagram showing an example of the functional configuration of the program production system 1 in this embodiment.

≪Functional configuration of program production equipment≫
As shown in FIG. 3, the program production device 12 in this embodiment includes a video acquisition section 121, a program editing section 122, and a program transmission section 123.

The video acquisition section 121, the program editing section 122, and the program transmission section 123 are realized, for example, by a process in which a program loaded from the HDD 504 onto the RAM 503 shown in FIG. 2 is executed by the CPU 501.

The video acquisition unit 121 acquires studio video from the camera C1.

The program editing section 122 generates a video program based on the studio video acquired by the video acquisition section 121 in response to an operation by a producer or the like. The program editing unit 122 edits the studio video by combining other video materials, inserting subtitles, sound effects, and background music, and generates a video program.

The program transmitter 123 transmits the video program generated by the program editor 122 to the video transmitter 13. Further, the program transmitting section 123 broadcasts the video program generated by the program editing section 122 via the broadcast radio wave N2.

≪Functional configuration of video transmission device≫
As shown in FIG. 3, the video transmission device 13 in this embodiment includes a video acquisition section 131 and a video transmission section 132.

The video acquisition unit 131 and the video transmission unit 132 are realized, for example, by a process in which a program loaded from the HDD 504 onto the RAM 503 shown in FIG. 2 is executed by the CPU 501.

The video acquisition unit 131 receives a video program from the program production device 12. Further, the image acquisition unit 131 acquires an overhead image from the camera C2.

The video transmitting unit 132 transmits the video program and the bird's-eye view video acquired by the video acquiring unit 131, and mode information representing the recording mode of the video program to the operating terminal 21 via the communication network N1. The video program recording mode is one of live broadcast mode, rehearsal mode, and playback mode. The mode information is set in advance by the manufacturer or the like.

The mode information can be included, for example, in an MTE (Media Timed Event) of a video signal representing a video program. MTE is a trigger signal that can be included in MPEG-DASH (Dynamic Adaptive Streaming over HTTP) video.

≪Functional configuration of the operating terminal≫
As shown in FIG. 3, the operating terminal 21 in this embodiment includes a video receiving section 211, a video display section 212, a reaction input section 213, a mode determination section 214, and a reaction transmission section 215.

The video receiving section 211, the mode determining section 214, and the reaction transmitting section 215 are realized, for example, by a process that causes the CPU 501 to execute a program loaded from the HDD 504 onto the RAM 503 shown in FIG. The video display unit 212 is realized, for example, by the display device 506 shown in FIG. 2. The reaction input unit 213 is realized, for example, by the input device 505 shown in FIG. 2.

The video receiving unit 211 receives a video program, an overhead video, and mode information from the video transmitting device 13. The video receiving unit 211 stores a reference time based on the received video program. The reference time is a time that indicates the progress of the video program. An example of the reference time is the start time of a video program. Another example of the reference time is the start time of a corner or project that constitutes a video program. Another example of the reference time is the start time of a program in a music program or entertainment program.

The video display unit 212 displays the video program and overhead video received by the video reception unit 211 on an operation screen displayed on the display device 506 or the like.

The reaction input unit 213 accepts operations by the viewer on the operation screen. The reaction input unit 213 generates reaction information representing a reaction by the viewer based on the received operation. The reaction information includes identification information for identifying the viewer (hereinafter also referred to as "viewer ID") and reaction content information indicating the content of the reaction by the viewer.

The reaction input unit 213 may generate reaction information not based on operations by the viewer. For example, the reaction input unit 213 may generate reaction information based on biological information acquired using a wearable device or the like worn by the viewer. The biological information is, for example, brain waves, pulse, breathing rate, or line of sight. Further, for example, the reaction input unit 213 may generate reaction information based on the emotion recognition result using the viewer's facial image or the voice recognition result using the viewer's utterance.

The mode determining unit 214 determines the recording mode of the video program based on the mode information received by the video receiving unit 211. The mode determination unit 214 calculates the reaction time when the recording mode is the rehearsal mode. The reaction time is the elapsed time from the reference time stored by the video reception unit 211 to the time when the reaction input unit 213 generated reaction information.

The reaction sending unit 215 sends the reaction information generated by the reaction input unit 213 to the reaction management device 10. When the recording mode is the rehearsal mode, the reaction transmitter 215 includes information representing the reaction time in the reaction information and transmits the reaction information to the reaction management device 10 .

≪Functional configuration of receiver≫
As shown in FIG. 3, the receiver 22 in this embodiment includes a program receiving section 221 and a program display section 222.

The program receiving unit 221 receives a video program via the broadcast radio wave N2.

The program display section 222 displays the video program received by the program receiving section 221 on a display device such as a liquid crystal display.

≪Functional configuration of reaction control device≫
As shown in FIG. 3, the reaction management device 10 in this embodiment includes a reaction reception section 101, a storage control section 102, a reaction storage section 103, and a presentation control section 104.

The reaction receiving unit 101, the storage control unit 102, and the presentation control unit 104 are realized, for example, by processing that causes the CPU 501 to execute a program loaded from the HDD 504 onto the RAM 503 shown in FIG. The reaction storage unit 103 is realized using, for example, the HDD 504 shown in FIG. 2.

The reaction receiving unit 101 receives reaction information representing reactions by viewers from the operating terminal 21 .

The storage control unit 102 stores the reaction information in the reaction storage unit 103 when the reaction information received by the reaction receiving unit 101 includes information indicating a reaction time.

The reaction storage unit 103 stores a reaction list in which reaction information is arranged in chronological order.

The presentation control unit 104 transmits a control signal for presenting a reaction based on the reaction information to the presentation device 11. The control signal includes a viewer ID and control content information. The viewer ID is a viewer ID included in the reaction information. The control content information is generated based on the reaction content information included in the reaction information.

The control content information is information representing the content of the operation to be performed by the presentation device 11 in response to a reaction by the viewer. The content of the operation is, for example, information specifying the color, brightness, blinking pattern, etc. in which the lighting equipment emits light.

When the reaction list is stored in the reaction storage unit 103, the presentation control unit 104 sends a control signal to the presentation device 11 based on the reaction information included in the reaction list so that the program progress and the reaction time are synchronized. Send to. On the other hand, when the reaction list is not stored in the reaction storage section 103, the presentation control section 104 immediately transmits a control signal to the presentation device 11 based on the reaction information received by the reaction reception section 101.

Note that, as described above, the reaction list is stored when the recording mode of the video program is rehearsal. Therefore, the time when the reaction list is stored in the reaction storage unit 103 corresponds to the time when the actual broadcast is being performed after the rehearsal has been performed.

≪Functional configuration of presentation device≫
As shown in FIG. 3, the presentation device 11 in this embodiment includes a signal receiving section 111 and one or more reaction presentation sections 112. The number of reaction presentation units 112 is configured to be at least the same as the number of viewers. Each reaction presentation unit 112 is assigned a viewer ID and is associated with each viewer on a one-to-one basis.

The signal receiving unit 111 receives a control signal from the reaction management device 10. The signal receiving unit 111 sends the control content information included in the control signal to the reaction presentation unit 112 to which the viewer ID included in the control signal is assigned.

The reaction presentation section 112 performs an operation for presenting the viewer's reaction according to the control content information received from the signal reception section 111. The action for presenting a reaction is, for example, an action of causing a lighting fixture to emit light in a color, brightness, blinking pattern, etc. specified by the control content information.

<Processing procedure of program production system>
Next, the processing procedure of the program production method executed by the program production system 1 in this embodiment will be explained with reference to FIG. 4. FIG. 4 is a flowchart showing an example of the processing procedure of the program production method in this embodiment.

In step S1, the video acquisition unit 121 included in the program production device 12 acquires studio video from the camera C1. Next, the video acquisition unit 121 sends the acquired studio video to the program editing unit 122.

The program editing section 122 receives studio video from the video acquisition section 121. Next, the program editing unit 122 edits the studio video according to the operations of the producer and the like to generate a video program. Subsequently, the program editing section 122 sends the generated video program to the program transmitting section 123.

The program transmitting section 123 receives the video program from the program editing section 122. Subsequently, the program transmitter 123 transmits the received video program to the video transmitter 13.

In the video transmission device 13 , a video acquisition unit 131 receives a video program from the program production device 12 . Next, the image acquisition unit 131 acquires an overhead image from the camera C2. Subsequently, the video acquisition unit 131 sends the acquired video program and bird's-eye view video to the video transmission unit 132.

The video transmitter 132 receives the video program and the bird's-eye view video from the video acquirer 131. Next, the video transmitter 132 transmits the video program, the bird's-eye view video, and the preset mode information to the operating terminal 21 via the communication network N1.

In step S2, the video receiving unit 211 included in the operating terminal 21 receives the video program, the bird's-eye view video, and the mode information from the video transmitting device 13. Next, the video receiving unit 211 stores a reference time based on the received video program. Subsequently, the video receiving section 211 sends the video program and the bird's-eye view video to the video display section 212. Further, the video receiving section 211 sends mode information to the mode determining section 214.

The video display section 212 receives the video program and the overhead video from the video reception section 211. Next, the video display unit 212 displays the received video program and bird's-eye view video on an operation screen displayed on the display device 506 or the like.

In step S3, the reaction input unit 213 included in the operation terminal 21 receives an operation by the viewer on the operation screen. Next, the reaction input unit 213 generates reaction information based on the received operation. Subsequently, the reaction input section 213 sends the reaction information to the reaction transmission section 215.

≪Operation screen≫
Here, the operation screen in this embodiment will be explained with reference to FIG. 5. FIG. 5 is a conceptual diagram showing an example of an operation screen in this embodiment.

As shown in FIG. 5, the operation screen 1000 in this embodiment includes a video program display area 1010, an overhead video display area 1020, and an operation area 1030.

A video program is displayed in the video program display area 1010. An overhead view image is displayed in the overhead view image display area 1020. Input items for inputting reactions by the viewer are displayed in the operation area 1030.

The operation area 1030 includes a lighting state selection field 1031, a color display field 1032, and a color selection field 1033. The lighting state selection field 1031 displays the current lighting state (on or off) of the lighting fixture associated with the viewer. The color display column 1032 displays the current color of light emitted from the lighting fixture associated with the viewer. The color selection column 1033 displays colors that can be emitted by the lighting equipment.

By operating the lighting state selection field 1031, an operation for switching the lighting state of the lighting fixture is accepted. By selecting a desired color in the color selection field 1033, an operation for changing the emitted light color of the lighting fixture is accepted.

The operation screen 1000 shown in FIG. 5 is an example, and the video program and the bird's-eye view video can be displayed in any manner. For example, the video program and the bird's-eye view video may be displayed in different windows, and the displayed video may be switched by the viewer's operation. Furthermore, the input items displayed in the operation area 1030 differ depending on the configuration of the presentation device 11. The operation area 1030 may have any input items as long as they are operable by the presentation device 11.

The explanation will be returned to FIG. 4. In step S4, the mode determining unit 214 included in the operating terminal 21 receives mode information from the video receiving unit 211. Next, the mode determining unit 214 determines the recording mode of the video program based on the received mode information. If the recording mode is the live broadcast mode, the mode determination unit 214 advances the process to step S5. If the recording mode is the rehearsal mode, the mode determination unit 214 advances the process to step S8. If the recording mode is the playback mode, the mode determination unit 214 advances the process to step S13.

≪When the recording mode is live broadcast mode≫
In step S5, the reaction transmission section 215 included in the operation terminal 21 receives reaction information from the reaction input section 213. Next, the reaction transmitter 215 transmits the received reaction information to the reaction management device 10.

In the reaction management device 10 , the reaction receiving section 101 receives reaction information from the operating terminal 21 . Next, the reaction receiving section 101 sends the received reaction information to the presentation control section 104.

In step S6, the presentation control unit 104 included in the reaction management device 10 receives reaction information from the reaction reception unit 101. Next, the presentation control unit 104 generates a control signal based on the received reaction information. Subsequently, the presentation control unit 104 transmits the generated control signal to the presentation device 11.

In the presentation device 11 , a signal receiving unit 111 receives a control signal from the reaction management device 10 . Next, the signal receiving section 111 sends the control content information included in the control signal to the reaction presentation section 112 corresponding to the viewer ID included in the control signal.

The reaction presenting section 112 receives control content information from the signal receiving section 111. Next, the reaction presentation unit 112 performs an operation for presenting the viewer's reaction based on the received control content information.

In step S7, the presentation control unit 104 included in the reaction management device 10 determines whether the live video program has ended and whether the operation terminal 21 has ended. When the video program has ended or when the operating terminal 21 has ended, the presentation control unit 104 ends the process. When the video program has not ended and when the operation terminal 21 has not ended, the presentation control unit 104 returns the process to step S3.

≪When the recording mode is rehearsal mode≫
In step S8, the mode determining unit 214 included in the operating terminal 21 calculates the elapsed time from the reference time stored by the video receiving unit 211 as the reaction time. Next, the mode determining unit 214 sends the calculated reaction time to the reaction transmitting unit 215.

In step S9, the reaction transmission section 215 included in the operation terminal 21 receives reaction information from the reaction input section 213. Next, the reaction transmitting section 215 receives the reaction time from the mode determining section 214. Subsequently, the reaction transmitter 215 includes information representing the reaction time in the reaction information and transmits the reaction information to the reaction management device 10 .

In the reaction management device 10 , the reaction receiving section 101 receives reaction information from the operating terminal 21 . Next, the reaction receiving section 101 sends the reaction information to the storage control section 102.

In step S<b>10 , the storage control unit 102 included in the reaction management device 10 receives reaction information from the reaction reception unit 101 . Next, the storage control unit 102 stores the received reaction information at the end of the reaction list stored in the reaction storage unit 103. Subsequently, the storage control unit 102 sends the reaction information to the presentation control unit 104.

In step S11, the presentation control unit 104 included in the reaction management device 10 receives reaction information from the storage control unit 102. Next, the presentation control unit 104 generates a control signal based on the received reaction information. Subsequently, the presentation control unit 104 transmits the generated control signal to the presentation device 11.

In the presentation device 11 , a signal receiving unit 111 receives a control signal from the reaction management device 10 . Next, the signal receiving section 111 sends the control content information included in the control signal to the reaction presentation section 112 corresponding to the viewer ID included in the control signal.

The reaction presenting section 112 receives control content information from the signal receiving section 111. Next, the reaction presentation unit 112 performs an operation for presenting the viewer's reaction based on the received control content information.

In step S12, the presentation control unit 104 included in the reaction management device 10 determines whether the rehearsal video program has ended and whether the operation terminal 21 has ended or not. When the video program has ended or when the operation terminal 21 has ended, the presentation control unit 104 advances the process to step S13. When the video program has not ended and when the operation terminal 21 has not ended, the presentation control unit 104 returns the process to step S3.

<<When recording mode is playback mode>>
In step S13, the program transmitter 123 included in the program production device 12 starts the actual broadcast in response to an operation by the producer or the like. Specifically, the program transmitter 123 broadcasts the video program generated by the program editor 122 via the broadcast radio wave N2.

In the viewing facility E3, a program receiving section 221 included in the television receiver 22 receives the video program via the broadcast wave N2. Next, the program receiving section 221 sends the video program to the program display section 222.

The program display section 222 receives the video program from the program reception section 221. Next, the program display unit 222 displays the received video program on a display device such as a liquid crystal display.

In step S14, the presentation control unit 104 included in the reaction management device 10 reads the reaction list from the reaction storage unit 103. Next, the presentation control unit 104 generates a control signal based on the reaction information included in the reaction list. Subsequently, the presentation control unit 104 transmits a control signal to the presentation device 11 so that the program progress and the reaction time are synchronized.

In the presentation device 11 , a signal receiving unit 111 receives a control signal from the reaction management device 10 . Next, the signal receiving section 111 sends the control content information included in the control signal to the reaction presentation section 112 corresponding to the viewer ID included in the control signal.

The reaction presenting section 112 receives control content information from the signal receiving section 111. Next, the reaction presentation unit 112 performs an operation for presenting the viewer's reaction based on the received control content information.

<Effects of embodiment>
The program production system in this embodiment receives reaction information representing reactions by viewers from an operation terminal used by viewers who view a video program, and presents reactions by the viewers from a presentation device installed in a shooting studio. Therefore, according to the program production system of this embodiment, the reactions of viewers can be reflected in the shooting studio.

In particular, the program production system in this embodiment records reaction information representing reactions by viewers viewing a rehearsal in a reaction list in association with reaction times, and in the subsequent actual broadcast, reactions recorded in the reaction list are recorded. Based on the information, the presentation device presents a reaction by the viewer. Therefore, according to the program production system of this embodiment, the viewer's reactions can be presented in synchronization with the progress of the program without being affected by transmission delays when receiving the viewer's reactions.

Furthermore, the program production system in this embodiment presents reactions by each viewer from a presentation device that corresponds one-on-one with each viewer. Furthermore, the program production system according to the present embodiment displays to the viewer an overhead video of the shooting studio in which the presentation device was photographed. Therefore, according to the program production system of this embodiment, viewers can be made aware that their own reactions are reflected in the program production, and the viewer's sense of participation can be improved.

For example, the program production system in this embodiment uses lighting equipment that can emit light in a plurality of colors, and causes the lighting equipment to emit light in a color, brightness, blinking pattern, etc. depending on the viewer's reaction. Therefore, according to the program production system of this embodiment, it is possible to intuitively grasp the viewer's reaction visually.

[Modified example]
In the above embodiment, an example has been described in which the recording mode is one of live broadcast mode, rehearsal mode, and playback mode, and the process for presenting reaction information is switched depending on the recording mode. Here, the processing may be switched according to the performance even within the same program.

For example, the recording mode may be set to rehearsal mode in a scene where delay is not acceptable, and the viewer's reactions may be presented in synchronization with the progress of the program using reaction information collected in advance. On the other hand, in scenes where a delay is acceptable, the recording mode may be set to live broadcast mode, and the viewer's reaction may be immediately presented using reaction information received from the operating terminal.

Scenes in which delays are not tolerated include, for example, the performance of music in a music program, the presentation of a program in an entertainment program, and the like. Scenes where delays are acceptable include sports broadcasts, talk shows, and the like.

In this way, by appropriately using the reaction information collected in advance and the reaction information received from the operation terminal depending on the nature of the production, it is possible to improve the excitement in the shooting studio and the sense of participation of the viewers in a well-balanced manner. becomes possible.

[supplement]
Each function of the embodiments described above can be realized by one or more processing circuits. Here, the term "processing circuit" as used herein refers to a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, or a processor designed to execute each function explained above. This includes devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules.

Although the embodiments of the present invention have been described in detail above, the present invention is not limited to these embodiments, and various modifications or variations can be made within the scope of the gist of the present invention as described in the claims. Changes are possible.

1 Program production system 10 Reaction management device 101 Reaction reception section 102 Storage control section 103 Reaction storage section 104 Presentation control section 11 Presentation device 111 Signal reception section 112 Reaction presentation section 12 Program production device 121 Video acquisition section 122 Program editing section 123 Program transmission Section 13 Video transmission device 131 Video acquisition section 132 Video transmission section 21 Operation terminal 211 Video reception section 212 Video display section 213 Reaction input section 214 Mode judgment section 215 Reaction transmission section 22 Receiver 221 Program reception section 222 Program display section

Claims (8)

A reaction management device capable of communicating with an operating terminal used by a viewer viewing a video and a presentation device installed in a filming studio where the video is recorded,
a reaction receiving unit that receives reaction information representing a reaction by the viewer from the operation terminal;
a presentation control unit that transmits a control signal for presenting the reaction to the presentation device based on the reaction information;
A reaction management device comprising: The reaction management device according to claim 1,
further comprising a storage control unit that stores in a storage unit an elapsed time from a reference time in the video in association with the reaction information;
Reaction control device. The reaction management device according to claim 2,
The presentation control unit includes:
When the reaction information is stored in the storage unit, transmitting the control signal based on the reaction information stored in the storage unit,
when the reaction information is not stored in the storage unit, transmitting the control signal based on the reaction information received by the reaction receiving unit;
Reaction control device. The reaction management device according to claim 1,
The video includes a video captured by the presentation device.
Reaction control device. The reaction management device according to claim 1,
The presentation device presents the reaction so that a person present in the photography studio can perceive it through sight, hearing, or touch.
Reaction control device. The reaction management device according to claim 5,
The presentation device is a lighting device that can emit light in multiple colors,
The presentation control unit causes the lighting device to emit light in a color, brightness, or blinking pattern according to the reaction.
Reaction control device. The reaction management device according to claim 6,
The presentation device includes a plurality of the lighting fixtures in one-to-one correspondence with the viewer.
Reaction control device. A program for causing a computer to function as the reaction management device according to any one of claims 1 to 7.

Images