JP2019200538A - VR content reproduction system for following operation input in main processing device in backup processing device - Google Patents

Abstract

To provide a VR content reproduction system capable of smoothly switching a video image in a backup processing device without spending costs on reproducing a video image in a main processing device.SOLUTION: A VR content reproduction system of the present invention comprises a main processing device and a backup processing device. The main processing device includes an operation input unit that outputs an operation signal corresponding to operation input; and a first control unit that outputs follow-up information indicating an operation according to the received operation signal to the backup processing device, and generates a first reproduction signal reflecting the operation according to the operation signal. The backup processing device includes a second control unit that generates a tracking signal for executing the operation indicated by the tracking information on the basis of the tracking information from the main processing device. The second control unit generates a second reproduction signal in which the operation corresponding to the tracking signal is reflected.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a VR content playback system, and more particularly, to a VR content playback system for following an operation input in a main processing device in a backup processing device.

  2. Description of the Related Art Conventionally, there is a VR content playback system that plays back interactive VR content produced using VR (Virtual Reality) technology in a VR theater (see, for example, Patent Document 1). In the VR content playback system, VR content is provided to the viewer via a VR content playback device including a display screen such as a large display that can be viewed by a plurality of viewers in the VR theater and a high-output speaker.

  A navigator (moderator) performs operation input to a processing device such as a personal computer using a keyboard or a controller, and VR content to be reproduced next or a function to be executed (for example, a camera) in response to a dialogue between the navigator and a viewer Change the angle etc.) on the spot.

JP 2017-005287 A

  However, in the conventional VR content playback system, if a trouble such as freezing occurs in the processing device during the VR content screening, and the VR content screening stops, for example, waiting for the freeze to be resolved, It was necessary to restart the processing device. For this reason, troubles cannot be quickly dealt with, and a situation has occurred in which remarkably time is spent resuming the screening of VR content.

  The present invention has been made in view of the above problems, and even if a trouble occurs in a processing apparatus used for reproducing VR content, it is possible to resume screening of VR content without spending a lot of time. An object of the present invention is to provide a VR content reproduction system.

  A VR content playback system according to an aspect of the present invention is provided for a main processing device for managing the presentation of VR content, and for backup of the main processing device that automatically follows an operation input made in the main processing device. A backup content processing system, wherein the main processing device outputs an operation signal corresponding to the operation input, and the operation input unit outputs the operation signal. A first control unit that receives an operation signal, generates tracking information indicating an operation according to the received operation signal based on the received operation signal, and outputs the tracking information to the backup processing device; A first control unit that generates a first reproduction signal for reproducing VR content, reflecting an operation according to the received operation signal; The backup processing device includes a second control unit that receives the tracking information from the main processing device and generates a tracking signal for executing an operation indicated by the tracking information based on the tracking information. In addition, the second control unit generates a second reproduction signal for reproducing the VR content on which the operation corresponding to the tracking signal is reflected based on the tracking signal.

  According to the VR content reproduction system of another aspect of the present invention, the second control unit generates the follow-up signal after a predetermined delay time has elapsed after receiving the follow-up information. .

  According to the VR content playback system of another aspect of the present invention, the first control unit outputs the follow-up information to the backup processing apparatus after a predetermined delay time has elapsed since the follow-up information was generated. It is characterized by doing.

  In the VR content reproduction system according to another aspect of the present invention, the second control unit determines whether or not the input of the generated tracking signal is enabled, and the input of the generated tracking signal is enabled. If it is determined that the generated follow-up signal has not been made, after the predetermined time has elapsed, the generated follow-up signal is re-input to determine whether the re-input of the generated follow-up signal has been validated. Until the determination that the re-input of the follow-up signal has been made effective is made, the re-input of the generated follow-up signal is repeated after the predetermined time has elapsed.

  According to the VR content reproduction system according to another aspect of the present invention, the first control unit determines whether or not a function for operating the video of the VR content is assigned to the operation input, When it is determined that the function is assigned, the tracking information is generated.

  A VR content playback system according to still another aspect of the present invention is a VR content playback system installed in a VR theater venue, and a VR content playback device for playing back VR content, and for playing back the VR content. A main processing device that transmits a first reproduction signal, a backup processing device that transmits a second reproduction signal for reproducing the VR content, and the first and second reproduction signals are input and input, respectively. By switching the output port from which the first and second playback signals are output, either the first playback signal or the second playback signal can be output to the VR content playback device. And the switcher.

  According to the VR content playback system of one aspect of the present invention, even when a trouble occurs in a processing device used for playback of VR content, it is possible to resume the screening of VR content without spending a lot of time. It becomes. In addition, according to the VR content reproduction system according to one aspect of the present invention, it is possible to smoothly switch to the output signal of the backup processing device without spending the cost of reproducing the video of the main processing device.

It is a figure which shows an example of a structure of the VR content reproduction system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows an example of a structure of the tracking system which concerns on the 1st Embodiment of this invention. It is a figure which shows an example of a structure of the VR content reproduction system which concerns on the 2nd Embodiment of this invention. It is a block diagram which shows an example of a structure of the tracking system which concerns on the 2nd Embodiment of this invention. It is a figure for demonstrating the VR content reproduction system which concerns on the 3rd Embodiment of this invention. It is a figure for demonstrating the VR content reproduction system which concerns on the 5th Embodiment of this invention. It is a figure which shows the processing flow in the VR content reproduction system which concerns on the 5th Embodiment of this invention. It is a figure for demonstrating the VR content reproduction system which concerns on the 6th Embodiment of this invention. It is a figure which shows the processing flow in the VR content reproduction system which concerns on the 6th Embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 shows an example of the configuration of a VR content playback system according to the first embodiment of the present invention. FIG. 1 shows a VR content playback system provided in a VR theater, which includes a VR content playback device 1, a switcher 2, and a tracking system 100. As shown in FIG. 1, the tracking system 100 includes a main processing device 110 for managing the presentation of VR content, and a backup processing device 120 provided for backup of the main processing device 110. In the present embodiment, description will be made assuming that the main processing device 110 is used at the start of VR content screening.

  The VR content playback apparatus 1 is installed in a VR theater venue, and includes a display screen such as a large display that can be viewed by a plurality of viewers, and a high-output speaker. The VR content playback apparatus 1 provides VR content to the viewer by outputting to a display screen or a speaker.

  The switcher 2 has a plurality of input ports and output ports. The switcher 2 is configured such that any two of the plurality of input ports are connected to the main processing device 110 and the backup processing device 120, and any of the plurality of output ports is connected to the VR content playback device 1. ing. The switcher 2 receives first and second reproduction signals for reproducing VR content from the main processing device 110 and the backup processing device 120, respectively. The switcher 2 can be switched to an output port from which an input reproduction signal is output in accordance with an operation of the navigator. In the present embodiment, the switcher 2 normally has an input port connected to the main content processing device 110 coupled to an output port connected to the VR content playback device 1 and an input port connected to the backup processing device 120. I / O ports are set to be coupled to other output ports.

  The main processing device 110 and the backup processing device 120 may be information processing devices such as a personal computer operated by a navigator using a controller such as a game pad or an operation input unit such as a keyboard.

  FIG. 2 is a block diagram showing an example of the configuration of the engagement tracking system according to the first embodiment of the present invention. In FIG. 2, a tracking system 100 including a main processing device 110 and a backup processing device 120 is shown. As shown in FIG. 2, the main processing device 110 includes a first operation input unit 111, a first storage unit 112, a first communication unit 113, a first display unit 114, and a first display unit. And a control unit 115. The backup processing device 120 includes a second operation input unit 121, a second storage unit 122, a second communication unit 123, a second display unit 124, and a second control unit 125. .

  The first and second operation input units 111 and 121 can acquire an operation signal based on the operation input from, for example, a keyboard having a plurality of operation keys, a mouse, a controller, a touch panel, a remote controller, or a portable terminal. It can consist of one or more of the possible input interfaces and the like. A function for operating the video of the VR content is assigned to one or more of the operation inputs by the operation keys of the first operation input unit 111 and the second operation input unit 121. When the navigator performs an operation input using the operation key, an operation corresponding to the function assigned to the operation input is executed in the video of the VR content to be reproduced. Here, the operation input may be acquired via the switcher 2.

  The first operation input unit 111 receives various operation inputs from the navigator and outputs an operation signal based on the received operation input to the first control unit 115. Similarly, the second operation input unit 121 receives various operation inputs from the navigator and outputs an operation signal based on the received operation input to the second control unit 125.

  Here, the operation signal based on the operation input is, for example, an operation signal based on an operation input for selecting and reproducing VR content selected from a plurality of VR contents prepared in advance, and displayed on the VR content playback device 1. An operation signal based on an operation input for scrolling the VR content video up, down, left and right, an operation signal based on an operation input for changing the camera angle of the VR content video displayed on the VR content playback apparatus 1, and VR content An operation signal for executing an operation corresponding to a function assigned to the operation input, such as an operation signal based on an operation input for changing the scenario of the VR content displayed on the playback device 1 can be included. Each of the first operation input unit 111 and the second operation input unit 121 generates and outputs an operation signal for each operation input, for example, for each key input on the keyboard or for each button input on the controller. can do.

  The first and second storage units 112 and 122 include various programs such as a program according to the present invention, a program for activating VR content, and operation signals input by the first and second operation input units 111 and 121, for example. Can be stored. The 1st and 2nd memory | storage parts 112 and 122 are comprised by HDD, flash memory, EEPROM, ROM, RAM, or those arbitrary combinations, for example.

  The first communication unit 113 and the second communication unit 123 can be communication interfaces using a wired and / or wireless communication network.

  The first display unit 114 can display various screens and images generated by the first control unit 115 executing various programs. Similarly, the second display unit 124 can display various screens and images generated by the second control unit 125 executing various programs.

  The first and second control units 115 and 125 include a CPU, for example. The first and second control units 115 and 125 can execute the program according to the present invention and other various programs to control each process in the processing apparatus.

  The first control unit 115 outputs a first reproduction signal for reproducing VR content to the switcher 2 via the first communication unit 113. In addition, the second control unit 125 outputs a second reproduction signal for reproducing VR content to the switcher 2 via the second communication unit 123. In the present embodiment, the first reproduction signal output from the first control unit 115 is output to the VR content reproduction apparatus 1 via the switcher 2. Each of the first and second reproduction signals includes a video signal and an audio signal, and may be a digital or analog signal.

  When the first control unit 115 receives an operation signal from the first operation input unit 111, based on the received operation signal, the first control unit 115 reflects the operation corresponding to the operation signal on the video of the VR content to be reproduced. 1 reproduction signal is generated and output. Here, the operation according to the operation signal is, for example, an operation of selecting and playing back VR content from a plurality of VR contents prepared in advance, and moving up and down the video of the VR content displayed on the VR content playback device 1. The operation signal includes an operation of scrolling left and right, an operation of changing the camera angle of the video of the VR content displayed on the VR content playback device 1, and an operation of changing the scenario of the VR content displayed on the VR content playback device 1. An operation corresponding to the function assigned to the underlying operation input can be included.

  As described above, in the VR content playback apparatus according to the first embodiment, a backup processing apparatus is also installed separately from the main processing apparatus mainly used in VR screening. Thereby, according to the VR content playback apparatus according to the first embodiment, for example, when trouble such as freezing occurs in the main processing apparatus, the switcher 2 sends a playback signal to the VR content playback apparatus 1 from the main processing apparatus 110. By switching to the backup processing device 120, it is possible to prevent a situation in which the progress of the screening is significantly delayed. Therefore, according to the VR content reproduction apparatus according to the first embodiment, it is possible to resume the presentation of the VR content without spending a lot of time. In the present embodiment, the configuration using one backup processing device 120 is exemplified, but the present invention is not limited to this, and a configuration using a plurality of backup processing devices 120 may be used. The same applies to the following embodiments.

(Second Embodiment)
In the first embodiment described above, a backup processing device 120 is also installed separately from the main processing device 110 that is mainly used for VR screening in the VR theater, so as to be prepared for troubles. However, unlike a normal video work, a VR content video work changes a story progress degree, a camera angle, and the like by an operation input by a navigator. Therefore, in order to switch to the backup processing device 120 and continue the screening, it is necessary to reproduce the video state of the main processing device 110 immediately before the occurrence of the trouble with the video of the backup processing device 120. Therefore, in the first embodiment, the operator behind the scenes manually operates the backup processing device 120 so as to follow the operation of the main processing device 110 in real time to reproduce the video state of the main processing device 110. Was. Therefore, since it is necessary to arrange an operator who operates the backup processing device 120, there are cases where extra costs such as labor costs are required.

  Hereinafter, the VR content playback system according to the second embodiment of the present invention will be described with reference to FIGS. 3 and 4.

  FIG. 3 shows an example of the configuration of a VR content playback system according to the second embodiment of the present invention. FIG. 3 shows a VR content playback system including a VR content playback device 1, a switcher 2, and a tracking system 200. As shown in FIG. 3, the tracking system 200 includes a main processing device 210 for managing the presentation of VR content, and a backup processing device 220 provided for backup of the main processing device 210.

  In the following embodiment, it is assumed that the main processing device 210 is used at the start of VR content screening, and that the backup processing device 220 follows the operation input in the main processing device 210. Since the basic configuration of the VR content playback apparatus according to the following embodiment is the same as that of the VR content playback apparatus according to the first embodiment, only different parts will be described.

  FIG. 4 is a block diagram showing an example of the configuration of the tracking system according to the first embodiment of the present invention. FIG. 4 shows a tracking system 200 that includes a main processing device 210 and a backup processing device 220. As shown in FIG. 4, the main processing device 210 includes a first operation input unit 211, a first storage unit 212, a first communication unit 213, a first display unit 214, and a first display unit. And a control unit 215. The backup processing device 220 includes a second operation input unit 221, a second storage unit 222, a second communication unit 223, a second display unit 224, and a second control unit 225. . The first and second storage units 212 and 222 can further store follow-up information and follow-up signals generated by first and second control units 215 and 225, which will be described later.

  In the VR content playback device according to the second embodiment, when the first control unit 215 receives an operation signal from the first operation input unit 211, the first control unit 215 responds to the operation signal based on the received operation signal. Follow-up information indicating an operation is generated and output to the backup processing device 220 via the first communication unit 213. The second control unit 225 of the backup processing device 220 receives the tracking information from the main processing device 210 via the second communication unit 223. When the second control unit 225 receives the tracking information, the second control unit 225 generates a tracking signal for executing an operation indicated by the tracking information based on the received tracking information and inputs the tracking signal. The second control unit 225 generates and outputs a second playback signal in which an operation corresponding to the tracking signal is reflected on the video of the VR content to be played based on the tracking signal input by itself.

  As described above, in response to the first control unit 215 receiving the operation signal, the follow-up information is transmitted to the backup processing device 220, whereby the backup processing device 220 performs the operation performed by the main processing device 210. The same operation is performed. Therefore, the backup processing device 220 can generate the second reproduction signal so as to automatically follow the operation input in the main processing device 210.

  Hereinafter, an example of the automatic tracking method in the automatic tracking system according to the second embodiment of the present invention will be described.

  When one of a plurality of VR content activation files displayed on the first display unit 214 of the main processing device 210 is selected by the navigator via the first operation input unit 211, the first operation input unit From 211, an operation signal for selecting and reproducing the VR content from the plurality of VR contents is output to the first control unit 215.

  The first control unit 215 receives the operation signal, generates a first reproduction signal for reproducing the VR content corresponding to the selected activation file based on the received operation signal, and generates a first reproduction signal. 1 to the switcher 2 via the communication unit 213. Furthermore, based on the received operation signal, the first control unit 215 transmits follow-up information indicating an operation corresponding to the received operation signal to the backup processing device 220 via the first communication unit 213. . Here, the follow-up information indicates an operation for selecting and reproducing the same VR content as the VR content selected by the main processing device 210 from a plurality of VR contents.

  The second control unit 225 of the backup processing device 220 receives the tracking information from the main processing device 210 via the second communication unit 223. Based on the received follow-up information, the second control unit 225 performs follow-up for executing an operation indicated by the follow-up information, that is, an operation of selecting and playing back the same VR content as the VR content selected by the main processing device 210. Generate a signal and input it to itself. The second control unit 225 reproduces the same VR content as the VR content selected by the main processing device 210 based on the tracking signal.

  Thereafter, when an operation input for changing, for example, the camera angle of the video of the VR content is performed by the navigator through the first operation input unit 211 as the scenario of the VR content being played back progresses, the first operation input unit 211 Therefore, an operation signal based on the operation input is output to the first control unit 215.

  The first control unit 215 receives this operation signal, generates a first reproduction signal reflecting the change of the camera angle of the video of the VR content based on the received operation signal, and generates a first reproduction signal. The data is output to the switcher 2 via the communication unit 213. Furthermore, based on the received operation signal, the first control unit 215 transmits follow-up information indicating an operation corresponding to the received operation signal to the backup processing device 220 via the first communication unit 213. . Here, the follow-up information indicates an operation for changing the camera angle of the VR content video performed by the main processing device 210.

  The second control unit 225 of the backup processing device 220 receives the tracking information from the main processing device 210 via the second communication unit 223. Based on the received follow-up information, the second control unit 225 executes the operation indicated by the follow-up information, that is, the same camera angle change operation as the change in the camera angle of the VR content video performed by the main processing device 210. A follow-up signal is generated and input to itself. Based on the follow-up signal, the second control unit 225 generates a second reproduction signal that reflects the same camera angle change operation as that of the VR content video performed by the main processing device 210. And output to the switcher 2 via the second communication unit 223.

  According to the VR content reproduction system according to the second embodiment of the present invention, even when a trouble occurs in the main processing device 210, the operation input in the main processing device 210 is automatically followed in the backup processing device 220. Therefore, it is possible to smoothly switch to the video of the backup processing device 220 without spending the cost of reproducing the video of the main processing device 210.

(Third embodiment)
An automatic tracking system according to the third embodiment of the present invention will be described with reference to FIG.

  It usually takes several seconds to several tens of seconds from when the navigator recognizes that the trouble has occurred in the main processing device 210 until it switches to the backup processing device 220 video using the switcher 2. When the backup processing device 220 automatically follows the operation input in the main processing device 210 with almost no delay, the video of the backup processing device 220 causes a trouble in the main processing device 210 while the navigator performs the switching operation. There is a risk of overtaking the current video.

  Therefore, as shown in FIG. 5, after a lapse of a predetermined delay time (for example, 30 seconds) after the backup processing device 220 receives the tracking information from the main processing device 210, The control unit 225 generates and inputs a tracking signal based on the received tracking information. Thereby, it is possible to absorb the time lag required for switching the backup processing device 220 to the video.

  Here, in the above-described embodiment, the configuration is shown in which the follow-up signal is generated after a predetermined delay time has elapsed since the backup processing device 220 received the follow-up information, but the main processing device 210 generates the follow-up information. The tracking information may be transmitted after a predetermined delay time elapses.

(Fourth embodiment)
The VR content playback system according to the fourth embodiment of the present invention will be described below.

  In the fourth embodiment of the present invention, the first control unit 215 may invalidate an operation input during a scenario, for example, during a specific event period, in order to prevent an erroneous operation by the navigator. Further, the second control unit 225 may invalidate the operation input after actually switching to the backup processing device 220. By doing so, in addition to preventing erroneous operations by the navigator, useless processing of the backup processing device 220 can be omitted.

(Fifth embodiment)
A VR content playback system according to the fifth embodiment of the present invention will be described with reference to FIGS. In the case where the operation input is invalidated at the timing when the backup processing device 220 receives the tracking information from the main processing device 210 and generates the tracking signal, the backup processing device 220 performs tracking even if the tracking signal is input. Is not performed, and the synchronization between the main processing device 210 and the backup processing device 220 is shifted.

  Therefore, as shown in FIG. 6, even when the backup processing device 220 receives the tracking information and generates the tracking signal in a state where the operation input is invalidated, the backup processing device 220 Until the input becomes valid, the generated follow-up signal is repeatedly input to itself at a predetermined time interval (for example, 5 seconds).

  Specifically, as shown in the processing flow of FIG. 7, in step S701, the second control unit 225 determines whether or not the input of the follow-up signal is valid when the follow-up signal is input. . If it is determined in step S701 that the input of the tracking signal has been validated, the process ends. If it is determined in step S701 that the input of the tracking signal is not valid, the second control unit 225 re-inputs the generated tracking signal after a predetermined time in step S702. Thereafter, in step S703, the second control unit 225 determines again whether or not the input of the follow-up signal has been validated. If it is determined in step S703 that the input of the tracking signal has been validated, the process ends. When it is determined in step S703 that the input of the tracking signal is not valid, the process returns to step S702, and the second control unit 225 re-inputs the generated tracking signal after a predetermined time has elapsed.

  In this way, it is possible to prevent the above-described synchronization shift by repeatedly inputting the generated follow-up signal at a predetermined time interval until the operation input is validated.

(Sixth embodiment)
The VR content playback system according to the sixth embodiment of the present invention will be described with reference to FIGS.

  If all operation inputs to the main processing device 210 are transmitted as follow-up information, a communication load is applied, which may lead to an erroneous operation of the main processing device 210 and the backup processing device 220 and a reduction in screening quality.

  Therefore, as shown in FIG. 8, the first control unit 215 uses the first operation input unit 211 to perform an operation input to which a function for operating the VR content video is assigned in a scenario in which the VR content is in progress. The tracking information is generated and output only when the action is performed, and the tracking information is not generated when the operation input to which the function for operating the video of the VR content is not assigned is made. .

  Specifically, as shown in the processing flow of FIG. 9, in step S901, the first control unit 215 is assigned a function for operating the video of the VR content for the operation input made by the navigator. Determine whether or not. If it is determined in step S901 that a function is assigned, tracking information is generated in step S902. If it is determined in step S901 that no function is assigned, the process ends without generating tracking information in step S903.

  As described above, by generating follow-up information for only the operation input to which the function for operating the VR content video is assigned in the operation input by the navigator and outputting it to the backup processing device 220, unnecessary communication is performed. The state of the video of the main processing device 210 can be accurately reflected in the video of the backup processing device 220 without applying a load.

(Seventh embodiment)
Operation information and tracking information stored in the first and second storage units 212 and 222 may be reset before or after the VR content is screened.

Claims (6)

VR content comprising: a main processing device for managing the presentation of VR content; and a backup processing device provided for backup of the main processing device that automatically follows an operation input made in the main processing device A playback system,
The main processing device is:
An operation input unit that outputs an operation signal corresponding to the operation input;
Receiving the operation signal output from the operation input unit, generating tracking information indicating an operation corresponding to the received operation signal based on the received operation signal, and outputting the tracking information to the backup processing device; A first control unit that generates a first reproduction signal for reproducing VR content, which reflects an operation according to the received operation signal;
Including
The backup processing device includes a second control unit that receives the tracking information from the main processing device, and generates a tracking signal for performing an operation indicated by the tracking information based on the tracking information;
The VR content playback characterized in that the second control unit generates a second playback signal for playing back VR content based on the tracking signal and reflecting an operation corresponding to the tracking signal. system.   2. The VR content reproduction system according to claim 1, wherein the second control unit generates the follow-up signal after a lapse of a predetermined delay time after receiving the follow-up information.   2. The VR content reproduction according to claim 1, wherein the first control unit outputs the tracking information to the backup processing apparatus after a predetermined delay time has elapsed since the tracking information was generated. system. The second controller is
Determining whether the input of the generated tracking signal has been validated;
If it is determined that the input of the generated tracking signal is not valid, the generated tracking signal is re-input after a predetermined time, and the re-input of the generated tracking signal is enabled. Determine whether or not
4. The re-input of the generated follow-up signal is repeated after the predetermined time until it is determined that the re-input of the generated follow-up signal has been made effective. The VR content reproduction system according to claim 1. The first controller is
Determining whether or not a function for operating the video of the VR content is assigned to the operation input;
5. The VR content reproduction system according to claim 1, wherein the follow-up information is generated when it is determined that the function is assigned. 6. A VR content playback system installed in a VR theater venue,
A VR content playback device for playing back VR content;
A main processing device for transmitting a first reproduction signal for reproducing the VR content;
A backup processing device for transmitting a second reproduction signal for reproducing the VR content;
The first reproduction signal and the second reproduction signal are input by inputting the first reproduction signal and the second reproduction signal, respectively, and by switching output ports from which the input first and second reproduction signals are output. The switcher configured to be capable of outputting any of the above to the VR content playback device;
A VR content playback system comprising:

Images