JP5581437B1 - Video providing system and program - Google Patents

Abstract

The present invention relates to a technique for providing a video to be viewed by a large number of viewers, and more particularly, to provide a video providing system and program for controlling a video to be provided by the participation of viewers.
A video providing system for sharing a video with a large number of viewers uses a network or a public telephone network for guiding trigger information to participate in a video currently provided to a selected viewer. The collaboration server 106 for sending, the content server 105 for correcting the content to be provided with a time delay based on the viewer trigger included in the viewer participation information sent from the viewer, and the correction Projectors 102 and 103 or speakers 104 for providing content are provided, and the viewer is guided to the content to be provided and viewer participation by the guidance is shared with many viewers.
[Selection] Figure 1

Description

  The present invention relates to a technique for providing video viewed by a large number of viewers, and more particularly to a video providing system and program for controlling video provided by the participation of viewers.

  With the progress of information processing technology and computer hardware technology, movies that are shown in movie theaters, cinemas, etc. are also provided as digital contents and are often shown through projectors. In addition to movie theaters and cine-cons, recently, it has become possible to provide content such as movies to personal computer users by streaming the content to personal computers. .

  In such a video processing environment, a conventional movie is provided as a single piece of content that continues until the end of the story, with the director performing the performer according to a defined story and shooting the performer. . By the way, in recent years, when movies and the like are provided as digital contents, it becomes possible to provide more dynamic video as compared to analog video. As such video provision, for example, in Japanese Patent Application Laid-Open No. 2011-124972 (Patent Document 1), when providing digital content via a network, data indicating user preferences is received from a user terminal, A system for providing different content streams for different users is described.

  Japanese Patent Laying-Open No. 2010-088111 (Patent Document 2) describes a stream providing method for providing different videos for each viewer.

  If one user views on a personal computer or the like, it is possible to select content according to the preference of a specific user. However, in the case of content such as a movie that is viewed by a large number of viewers, since a large number of viewings share wave content, the content stream cannot be switched in accordance with individual user preferences. For this reason, the technique described in Patent Literature 1 cannot immediately use content shared by a large number of viewers such as movies to perform stream control in a viewer participation type.

  In addition, it can be said that stream provision technology that provides different images according to individual preferences and selections, such as cine-con, is suitable for providing content with strong personal preferences such as theme parks and games. -It is not suitable for providing viewer-participation-type streams that involve a large number of viewers such as movies shown on cinemas. In addition to the movie, it is not suitable for the purpose of involving all of the viewers while gaining the viewer's sympathy by expanding the content of viewer participation at various events.

JP 2011-124972 A JP 2010-088111 A

  It is an object of the present invention to provide a video providing system and program for controlling the progress of content in a form involving a large number of viewers who view images projected on a screen at a movie theater, a cinema, or various events.

According to the present invention, there is provided a video providing system that allows a large number of viewers to share a video,
Means for sending guidance trigger information for operating a terminal device to participate in a video currently provided for a selected viewer to the selected viewer using a network or a public telephone network;
Means for correcting the content to be provided after the viewer trigger based on the viewer trigger included in the viewer participation information sent from the selected viewer 's terminal ;
An image providing system comprising: output means for providing the modified content to the plurality of viewers can be provided.

  The output means of the present invention is a projector, and the correction can be a change of a scene of a video to be provided. Further, the output means may be a speaker, and the correction may be a change of audio information. Further, the content correction can be provided by superimposing the audio information sent by the selected viewer.

  The modification of the content may be a projection mapping in which time and video are synchronized with the currently provided video and another video is superimposed.

According to the present invention,
A program for supplying video to a large number of viewers.
Sending guidance trigger information for operating a terminal device to participate in a video currently provided to a selected viewer to the selected viewer using a network or a public telephone network;
Extracting a viewer trigger included in viewer participation information sent from the selected viewer;
Determining content to provide a scene that is specified in response to the viewer trigger and that is later in time than the currently provided scene;
Providing the determined content to the multiple viewers ;
Program for executing a can be provided.

  In the present invention, the determination of the content may include a step of determining as a change of a scene, superimposition of audio information sent from a viewer, a change of a video by projection mapping, or a combination thereof.

  ADVANTAGE OF THE INVENTION According to this invention, the video provision system and program which control advancing of a content can be provided in the form which involved many viewers who watch the image projected on a large screen at a movie theater, a cinema, and various events.

The figure which shows embodiment of the image | video provision system 100 of this embodiment. The figure which showed the functional block of the collaboration server 106 of this embodiment. The figure which shows the functional block of the content server 105 of this embodiment. The figure which shows embodiment of the user database which the viewer management part 203 demonstrated in FIG. 2 produces. The figure which shows embodiment of the information used as a trigger registration form in the main stream content 500 of this embodiment, and the scene which should be decoded. The flowchart of the process which the image | video provision system 100 of this embodiment performs. The figure which showed the data structure of the scene used by this embodiment. The figure which shows embodiment of the video content 800 which the video provision system 100 of this embodiment provides.

100: Video providing system 101: Screens 102, 103: Projector 104: Speaker 105: Content server 106: Collaboration server 107: Network (public telephone network)
108: Mobile terminal 201: Interface unit 202: Web server unit 203: Viewer management unit 204: Audio processing server unit 205: Participation information analysis unit 206: Trigger extraction unit 207: Response log database 301: Interface unit 302: Decoder 303: Sequencer 304: Buffer 305: Buffer 306: Decoders 308, 309: Database

  Hereinafter, the present invention will be described with reference to embodiments, but the present invention is not limited to the embodiments described below. FIG. 1 shows an embodiment of a video providing system 100 according to this embodiment. The video providing system 100 shown in FIG. 1 can be installed in a space for viewing by a large number of viewers such as a theater, a cinema, and an event venue. The video providing system 100 projects a video from the projectors 102 and 103 onto the screen 101 on the screen 101 and projects the video on the screen 101 so that a large number of viewers can view the video.

  A speaker 104 is installed in the vicinity of the screen 101, and is used to send sound synchronized with the images projected from the projectors 102 and 103 into the space. Note that the number of speakers 104 shown in FIG. 1 is not limited to two, and corresponds to differences in the size of the space and the sound source to be provided, such as four, six, and eight on the left and right as needed. Can be installed as appropriate. For example, two IVRs are used to generate sound encoded in synchronism with the content projected from the projectors 102 and 103, and the other two are used by the IVR to enable audience participation described later. It can be used to play back received audio data in real time.

  The embodiment shown in FIG. 1 will be described assuming that two projectors 102 and 103 are used for the purpose of explanation. However, if the projector has a configuration capable of dual projection of independent images, two projectors are used. There is no need to use it, and more projectors can be used. The projectors 102 and 103 are used, for example, to change the video according to the information sent by the viewer by performing projection mapping on the video from the projector 102.

  The video providing system 100 further includes a content server 105 and a collaboration server 106. The content server 105 has a function of controlling content to be projected by the projectors 102 and 103 and a content decoding sequence. The collaboration server 106 has functions of a web server and a voice processing (IVR) server. The collaboration server 106 includes user information sent by the viewer from a mobile terminal 108 such as a mobile phone, a smart phone, and a tablet terminal from a viewer who shares video in the space via the network or the public telephone network 107, Process viewer participation information, audio information, etc. The network 107 will be described below as including one or both of voice communication and data communication using a public telephone network in addition to communication using a wired / wireless TCP / IP protocol.

  The collaboration server 106 has a function of correcting the video decoding order of the content server 105 in response to a response from the viewer and generating additional audio information from the speaker 104. In addition, although the content server 105 and the collaboration server 106 are shown in FIG. 1 as being separated from each other, this embodiment is described as a separated server for the purpose of clarifying the functional configuration. As long as the capability of the information processing apparatus is sufficient, a plurality of functions can be mounted on a single server apparatus without using a separate configuration.

FIG. 2 is a diagram showing functional blocks of the collaboration server 106 of this embodiment. As shown in FIG. 2, the collaboration server 106 includes an interface unit 201, a web server unit 202, and a voice processing server unit 204. The web server unit 202 is sent via user information sent by the viewer via the network 107 via the HTTP protocol, or via a dedicated application (hereinafter simply referred to as a smartphone application) that functions on a smartphone or the like. It has a function of receiving viewer participation information and registering user information, terminal type used, participation mode and other information in the viewer management unit 203.
The viewer participation information includes a viewer trigger that can be configured as a keyword, a command, or the like for the viewer to modify the content. In the case of a voice call, the viewer participation information includes the viewer's voice call information.

  The audio processing server unit 204 has a so-called IVR function. When the viewer participation information is audio information, the audio processing server unit 204 sends the audio information as participation information to the participation information analysis unit 205. In a specific embodiment, the voice information of the received voice call is directly sent to the content server 105, generated from the speaker 104, and superimposed on the decoded digital content voice information, as if the voice call was sent. The voice call is fed back to the viewers present in the space as if the participants were in the content from the beginning.

  The viewer management unit 203 collects information such as the user ID of the viewer sent via the network 107 in advance, a password, a terminal form, and a participation mode as necessary, and registers them in a user database (not shown). It has a function to do. In addition, when the web server unit 202 and the voice processing server unit 204 receive participation information, the web server unit 202 and the audio processing server unit 204 have a function of causing the participation information analysis unit 205 to execute processing corresponding to the participation mode of the viewer.

  Further, the collaboration server 106 includes a participation information analysis unit 205 and a trigger extraction unit 206 that analyze the viewer participation information sent from the viewer. The participation information analysis unit 205 determines whether the participation information sent from the viewer is audio information or a command from a smartphone application, and decodes the viewer participation information according to the participation form of the viewer. Then, it is determined whether or not a trigger trigger set in advance in the viewer participation information is included in the trigger extraction unit 206 according to the viewer participation mode.

  If no viewer trigger is included, no special command is issued to the content server 105. If it is determined that the viewer participation information includes a preset viewer trigger, a command is sent to the content server 105, and the decoding order of the digital content decoded by the content server 105 is switched. Or separate the video part and audio part of digital content, decode only the video part, replace that part with other audio information, perform projection mapping, or superimpose with other audio information Therefore, viewer participation on video and audio is possible.

  Further, the collaboration server 106 manages a response log database 207. The response log database not only shows the show but also shows the participation history of viewers in the same video or event in the past, associating it with user information, user attributes, show time, show area, etc. Register the status of. Examples of the viewer participation state include scene selection, type of audio information, type of command from the smartphone application, and the collaboration server 106 accumulates these as response logs.

  In the aspect of the present invention, the collaboration server 106 analyzes the response log, selects a scene or video that many participants sympathize with in the screening or event, learns the content, and displays it on the content server 105. Can be made. Furthermore, the response information accumulated in the response log database 207 can be used as big data for subsequent content creation.

  FIG. 3 shows functional blocks of the content server 105 of this embodiment. The content server 105 receives the viewer trigger from the collaboration server 106 and, if present, the audio signal received by the IVR. The content server 105 includes an interface unit 301 for processing these signals, a decoder 302, a content sequencer 303, and a trigger buffer 305.

  The function will be described below from the upstream processing unit that has received the participation information from the viewer. The trigger buffer 305 has a function of buffering the viewer trigger included in the participation information. The scene means a time-series video that provides a certain meaning or attribute in the mainstream content, which is composed of a plurality of scenes, a plurality of GOPs (Group of Picture), and the like.

The content server 105 reads in advance from the option database 309 content for providing a video that enables viewer participation to be decoded as the next scene in response to the viewer trigger in the viewer participation information. It has a function to let you. The content server 105 reads main stream content for providing video from the content database 308 and stores it in the content buffer 304. The main stream content stored in the content buffer 304 is sent to the decoder 302 in response to a command from the content sequencer 303 and can be projected from the projector 102.

  Further, the content server 105 determines the viewer trigger in the trigger buffer 305 and provides the viewer with options so that the content buffer 304 can read the content for providing subsequent video. The playback sequence table in which the scene sequence for the content sequencer 303 to read is registered is corrected according to the viewer trigger. Further, if necessary, the content buffer 304 separates the read video portion information and audio information portion of the scene, and performs processing for correcting the content of the scene so that only the video portion or the audio portion is reproduced. .

  In order to provide this function, the content server 105 determines an identification value that specifies optional content specified by the content of the viewer trigger and the content of the corresponding induction trigger using, for example, a lookup table. To do. Thereafter, the optional content specified by the identification value is read into the content buffer using the determined identification value.

  The content sequencer 303 refers to the playback order table, supplies scenes or content to the decoder 302 in ascending order of playback order, and starts decoding. The decoder 302 decodes the sent scene sequence using an H264, MPEG4, other high-definition compatible, 4K-compatible, 8K-compatible, or 3D-compatible decoding method, and an appropriate video driver such as VGA, SVGA, or XGA. The video image is supplied to the projector 102 via.

  In addition, the content server 105 corresponds to the viewer trigger, and when the viewer trigger instructs, for example, projection mapping, the content server 105 corresponds to the corresponding scene in the playback order table of the scene for performing projection mapping. The content for projection mapping is read in synchronism with the reproduction, and the content for projection mapping is sent to the decoder 306 to enable the synchronized projection mapping from the projector 103.

  FIG. 4 shows an embodiment of a user database created by the viewer management unit 203 described in FIG. In the user database, user information that uniquely identifies the user, user network information, telephone number, access type, etc. are registered. It is possible to register reaction information for registering whether or not a positive reaction has been shown.

  The collaboration server 106 first receives user information and the like from the viewer and registers them in the user database shown in FIG. After that, when the trigger timing embedded in the mainstream content arrives, the viewer to be joined is determined using attribute information set in advance for the viewer to be joined randomly or for the trigger. Then, the collaboration server 106 sends information set as a trigger to the determined viewer.

  The viewer is guided by the trigger information and sends participation information to the collaboration server 106 from a GUI such as a smartphone application button or scroll bar. In another embodiment, the viewer can receive the incoming call by the IVR function of the collaboration server 106 and send the participation information from the viewer by sending a voice call to the collaboration server 106.

  The collaboration server 106 receives participation information from the viewer and performs the above-described processing, thereby enabling viewer participation in the form of audio / video, audio / video, video, projection mapping, and the like.

  FIG. 5 shows an embodiment of information used as a trigger registration form and a scene to be decoded in the mainstream content 500 of the present embodiment. Mainstream content consists of multiple scene sequences, and each scene has header information or meta information attached, and the order of the scene, its trigger attribute, time, corresponding option and content identification value, etc. are registered. Has been. A trigger point is set at a specific time position in the scene, and different option contents can be called according to the set trigger point position.

  In addition, a single trigger point can be set for a scene, or multiple trigger points can be set. Depending on the time position of whether or not the viewer responds, the optional content to be called is changed. Can be set. Furthermore, in this embodiment, when performing decoding, it is possible to set whether to decode both the video and audio portions, only the video portion, or only the audio portion. In the case of this embodiment, it is possible to further diversify the manner of participation of the viewer, such as giving completely different video according to the participation information of the viewer or providing completely different audio information even with the same video. .

  FIG. 6 is a flowchart of processing executed by the video providing system 100 according to the present embodiment. The process of FIG. 6 starts from step S600, and when a trigger point in the mainstream content is reached in step S601, a viewer is determined and a guidance trigger in an appropriate format is sent to the viewer. In step S602, it is determined whether or not there is a viewer trigger included in the participation information sent from the viewer in the trigger buffer.

  If there is no viewer trigger (no), it is determined whether or not a timeout has occurred in step S605. If no timeout has occurred (no), the process branches to step S602 to further confirm the presence or absence of the viewer trigger. On the other hand, if the timeout expires in step S605 (yes), it is determined that the trigger has been unsuccessful, for example, because the viewer is sleeping, standing in the toilet, or not knowing at all. The process branches to S606, and the provision of the video is continued until the end of the main stream content in the main stream content sequence.

  On the other hand, if there is a viewer trigger in step S602 (yes), option content corresponding to the media attribute and content of the viewer trigger is retrieved from the option database 309 and read into the content buffer 304 in step S603. In step S604, the content server 105 sets the playback sequence by correcting the playback order in the playback order table. Thereafter, in step S606, the content sequencer 303 reads the scene to be reproduced next, sends it to the decoder 302, performs decoding in the designated order, and sends a video signal to the projector in step S607 to reproduce the video. Is possible. At this time, according to the viewer participation information, a single viewer participation is given to all viewers in the space by superimposing the video projected as audio information or video information to the viewer. Can be shared.

  In step S608, a viewer trigger such as another keyword or command is further searched in the viewer participation information. In step S609, it is determined whether there is information requesting a scene change as a viewer trigger. If the information is present (yes), the process branches to step S604, the sequence is changed, and viewer participation is enabled. On the other hand, if there is no such information in step S609 (no), the process branches to step S606, the scene is not changed, and the video decoding is continued.

  By using the above processing, it is possible to guide the viewer to the progress of the video and produce it as if the viewer had previously appeared in a movie etc. It is possible to share this feeling with all viewers.

  FIG. 7 is a diagram showing a data structure of a scene used in this embodiment. A scene can include header information 701 and scene contents 702 defined as a plurality of frame sequences. In the header information 701, a timer time of a trigger point, a trigger type, a scene number, and the like can be set as meta information. The duration of the scene defined by the scene content 702 defines the viewer participation interval. By synchronously superimposing option / content in the form of audio / video during the time length, it is possible to perform scene change, audio change, video modulation by projection mapping, and the like.

  FIG. 8 shows an embodiment of video content 800 provided by the video providing system 100 of the present embodiment. The video content 801 is an embodiment in which viewer participation is possible by changing audio as option information or performing projection mapping without changing the scene sequence of the mainstream content 500. It can be used to provide content such as video and music at specific events and concert venues.

  The video content 802 is an embodiment in which the sequence of the main stream content 500 is replaced by viewer participation. When the viewer participation information is received in the scene A, the content server 105 changes the next scene and changes the main stream content. When another viewer participation information is received in scene B, the next scene is changed to provide a video. Furthermore, in scene C, another viewer participation information is received and the sequence of the scene is corrected. Further, in scene D, the scene sequence is corrected in accordance with the viewer participation information, and this is continued until the end of the video. To do.

  Note that the viewers who can send the viewer participation information during the scenes A to D may be the same or different. The option information may be audio information or video information such as projection mapping.

  For the above, according to the present invention, a video providing system and program for controlling the progress of content in a form involving a large number of viewers who watch images projected on a large screen in movie theaters, cinemas, and various events. Can be provided.

Although the present invention has been described with embodiments, the present invention is not limited to the embodiments shown in the drawings, and other embodiments, additions, changes, deletions, and the like can be conceived by those skilled in the art. It can be changed within the range that can be done, and any embodiment is included in the scope of the present invention as long as the effects of the present invention are exhibited.

Claims (7)

An image providing system for sharing images with a large number of viewers,
Means for sending guidance trigger information for operating a terminal device to participate in a video currently provided for a selected viewer to the selected viewer using a network or a public telephone network;
Means for correcting the content to be provided after the viewer trigger based on the viewer trigger included in the viewer participation information sent from the selected viewer 's terminal ;
An image providing system comprising: output means for providing the modified content to the plurality of viewers .   The video providing system according to claim 1, wherein the output unit is a projector, and the correction is a change in a scene of a video to be provided.   The video providing system according to claim 1, wherein the output unit is a speaker, and the correction is a change of audio information.   The video providing system according to any one of claims 1 to 3, wherein the content correction is performed by superimposing audio information sent by the selected viewer.   5. The video providing system according to claim 1, wherein the content correction is projection mapping in which time and video are synchronized with a currently provided video and another video is superimposed. . A program for supplying video to a large number of viewers.
Sending guidance trigger information for operating a terminal device to participate in a video currently provided to a selected viewer to the selected viewer using a network or a public telephone network;
Extracting a viewer trigger included in viewer participation information sent from the selected viewer;
Determining content to provide a scene that is specified in response to the viewer trigger and that is later in time than the currently provided scene;
Providing the determined content to the multiple viewers ;
A program for running .   The program according to claim 6, comprising determining the content as a scene change, a superimposition of audio information sent from a viewer, a video change by projection mapping, or a combination thereof.