JP6695482B1 - Control server, distribution system, control method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform camera allocation suitable for a situation in distribution of a moving image of an avatar in a virtual space. A control server 20 for controlling a virtual camera for photographing a virtual space stores a finite state automaton in which each of a plurality of camera divisions is in a state, and a virtual space situation is a transition condition, and a virtual space. And a control unit 22 that transitions the state of camera division according to the finite state automaton based on the analysis result and controls the virtual camera so that the state of camera division is changed according to the state after transition. . [Selection diagram] Fig. 3

Description

  The present invention relates to a control server, a distribution system, a control method and a program.

  There is known a service that uses virtual reality (VR) technology to distribute a video taken by a virtual camera of a program in a studio in a virtual space. The distributor participates in the program as an avatar in the virtual space. By using a studio in a virtual space, it is possible for a plurality of distributors in remote areas to collaborate on a program. Viewers can also participate in the program as avatars.

Patent No. 4625058

  For programs that have multiple avatars in the virtual space, you can distribute programs that are easy to view by changing the camera split according to the progress of the program, such as a video of all participating avatars and a video of the avatars speaking. it can.

  However, in order to assign a camera suitable for the situation, a staff member who operates a virtual camera in the virtual space is required. When one person or a small number of people broadcast the program live, there is no specialist staff to operate the camera and it is difficult to divide the camera according to the situation.

  Patent Document 1 discloses a technique in which an avatar is caused to automatically act in a virtual space according to a user's instruction or a scenario, and images taken by a plurality of cameras at different positions are switched according to the user's instruction. Japanese Patent Application Laid-Open No. 2004-242242 discloses switching the captured images of the cameras arranged at a plurality of positions in the virtual space, but the switching of the camera requires a user's instruction or a predetermined position and time in the virtual space. It is based on a predetermined scenario and is not automatically switched according to the situation.

  The present invention has been made in view of the above, and an object of the present invention is to automatically perform camera allocation suitable for a situation in distribution of a moving image of a virtual space.

A control server according to one aspect of the present invention is a control server that controls a virtual camera that captures a program in a virtual space, and sets each of a plurality of camera divisions as a state and sets a condition of the virtual space as a transition condition. A storage unit that stores an automaton, an analysis unit that analyzes the state of the virtual space, and based on the analysis result, the state of camera division is changed in accordance with the finite state automaton so that the camera division is changed according to the state after the transition. wherein a control unit for controlling the virtual camera, the transition condition, the Ri condition der regarding speech avatar in the virtual space, change the finite automaton to be applied according to the type of terminal that view the programs.

A distribution system according to one aspect of the present invention is a distribution system that distributes a video image of a program in a virtual space to a terminal, and a distribution server that distributes a video image of a program in the virtual space to a terminal and the virtual space. And a storage unit for storing a finite state automaton in which each of a plurality of camera divisions is in a state and the virtual space situation is a transition condition. An analysis unit that analyzes the situation in the virtual space, and based on the analysis result, transitions the state of camera division according to the finite state automaton, and controls the virtual camera such that the state of camera division is changed according to the state after transition. a control unit, the transition condition, Ri condition der related speech of the avatar in the virtual space, the control server changes the finite automaton to be applied according to the type of the terminal.

  According to the present invention, in distribution of a moving image of a virtual space, it is possible to automatically perform camera allocation suitable for the situation. Specifically, according to the present invention, by controlling the camera allocation using a finite automaton, an effective scenario can be achieved without infinitely increasing the scenarios (camera allocation) according to the behavior of the distributor in the VR content. The effect on the production is demonstrated by narrowing down to.

FIG. 1 is a block diagram showing an example of the overall configuration of the program distribution system of this embodiment. FIG. 2 is a diagram showing a distributor wearing a head mounted display. FIG. 3 is a functional block diagram showing a configuration example of the control server. FIG. 4 is a diagram showing an example of a finite state automaton held by the control server. FIG. 5 is a flowchart showing the flow of control processing of the virtual camera by the control server. FIG. 6 is a diagram showing an example of a studio in the virtual space. FIG. 7 is a diagram showing an example of a screen shot of the entire studio in the virtual space. FIG. 8 is a diagram showing an example of a screen shot of two distributor avatars. FIG. 9 is a diagram showing an example of a screen shot of an image of one of the distributor avatars. FIG. 10 is a diagram showing an example of a screen shot of an image of the other distributor avatar. FIG. 11 is a diagram showing an example of a screen in which the distributor avatar is displayed by dividing the screen. FIG. 12 is a diagram showing an example of a screen in which a distributor avatar is arranged on both sides of a display object.

[System configuration]
A program distribution system according to an embodiment of the present invention will be described below with reference to the drawings.

  The program distribution system according to the present embodiment is a system in which a distributor participates in a program as a distributor avatar in a three-dimensional virtual space, and a video image of a virtual space in which the program progresses is live-distributed. Further, in the program distribution system of this embodiment, a viewer can also participate in a program as a viewer avatar in the same virtual space as the distributor.

  The program distribution system of the present embodiment shown in FIG. 1 includes a distribution server 10, a control server 20, a distributor terminal 30, and a viewer terminal 40. Each device is connected via a network. The distribution server 10 and the control server 20 are devices prepared by a company that provides a moving picture distribution service. The distributor terminal 30 and the viewer terminal 40 are terminals that the distributor and the viewer own or prepare by themselves. From the viewpoint of the business operator, both the distributor and the viewer are users who use the company's services. Of course, the business operator itself may be the distributor. Although FIG. 1 illustrates two distributor terminals 30 and three viewer terminals 40, the number of each device is not limited to this.

  The distribution server 10 receives the voice of the distributor and the motion data of the distributor avatar from the distributor terminal 30 via the network. For example, in the case of a program in which two distributors participate, the voices of the two distributors and the motion data of the distributor avatars are received from the distributor terminals 30 of the two distributors. The distribution server 10 controls the movement of the distributor avatar based on the motion data. The motion data may include facial expressions of the avatar.

  The distribution server 10 distributes to the viewer terminal 40 the audio and the video captured in the virtual space by the virtual camera (the video rendered by the distribution server 10). The distribution server 10 may transmit the data set for rendering the virtual space to the viewer terminal 40, and the viewer terminal 40 may render the virtual space. The distribution server 10 may distribute the video to the distributor terminal 30.

  If the distributor terminal 30 or the viewer terminal 40 is a terminal having a VR function including a head mounted display (HMD) or the like, the distribution server 10 transmits a data set for constructing a virtual space to the terminal. The terminal constructs a virtual space based on the received data set, renders the virtual space based on the line-of-sight direction detected by the HMD, and displays an image on the HMD. The rendering of the virtual space may be performed by the distribution server 10. For example, the distribution server 10 receives the line-of-sight direction from the terminal, distributes the image in which the virtual space is rendered based on the line-of-sight direction received by the distribution server 10 to the terminal, and the terminal projects the received image on the HMD.

  The distribution server 10 may receive the comment from the viewer terminal 40 and superimpose the comment on the video to be distributed.

  Viewers may participate in the program. For example, when the viewer operates the viewer terminal 40 to participate in the program, the distribution server 10 receives from the viewer terminal 40 a notification informing that the viewer will participate in the program. The distribution server 10 arranges a viewer avatar corresponding to the viewer in the virtual space. When the viewer is participating in the program, the distribution server 10 receives the voice of the viewer and the motion data of the viewer avatar from the viewer terminal 40, and controls the movement of the viewer avatar based on the motion data. ..

  The control server 20 is a device that controls a virtual camera that shoots a program in a virtual space. The control server 20 controls the virtual cameras in the virtual space in accordance with the finite state automaton in which the state of the virtual space is the transition condition and the state of the camera division is the state. The control server 20 may change the layout (arrangement of objects) in the virtual space according to the state transition. Details of the control server 20 will be described later. The finite state automaton used in this embodiment is a mathematically abstracted model consisting of a finite number of combinations of states, transitions, and actions. At a certain point in time, only one state can be taken from a finite number of "states", and some state or condition causes a transition from one state to another. The transition from one state to another is called "transition". A finite state automaton is defined by listing the states that can transit from each state and the conditions that trigger the transition.

  The distributor terminal 30 is a terminal used by the distributor to distribute a program. As the distributor terminal 30, any computer device such as a smartphone and a personal computer having a VR function can be used. The distributor terminal 30 includes an HMD 31 worn by the distributor, as shown in FIG. The distributor terminal 30 may include a controller 32 that receives an input from the distributor and operates a distributor avatar arranged in the virtual space. The distributor terminal 30 generates motion data of the distributor avatar based on the distributor's head movement detected by the HMD 31 and the operation by the controller 32.

  The distributor terminal 30 receives the data set for constructing the virtual space from the distribution server 10, constructs the virtual space based on the received data, renders the virtual space, and projects an image on the HMD 31.

  The distributor terminal 30 transmits the voice of the distributor and the motion data of the distributor avatar to the distribution server 10. The distributor advances the program by moving the distributor avatar and talking with other distributors and viewers.

  Note that as the distributor terminal 30, a terminal that does not include the HMD 31 but has a built-in camera or is connected to a camera may be used. In this case, the distributor terminal 30 shoots the distributor with a camera and generates motion data of the distributor avatar from the video of the distributor. The distributor terminal 30 receives and displays a video captured in the virtual space by the virtual camera from the distribution server 10.

  The viewer terminal 40 is a terminal used by the viewer to view the program. As the viewer terminal 40, any computer device such as a smartphone, a tablet terminal, a television system, a personal computer, or the like can be used as long as it is a device having a function of receiving and displaying a video of a program from the distribution server 10. The viewer terminal 40 may transmit the comment input by the viewer to the distribution server 10.

  When the viewer participates in the program as a viewer avatar, the viewer terminal 40 transmits the audio of the viewer and the motion data of the viewer avatar to the distribution server 10.

[Server configuration]
The control server will be described with reference to FIG.

  The control server 20 shown in FIG. 3 includes an analysis unit 21, a control unit 22, and a storage unit 23. The control server 20 has each of a plurality of camera divisions as a state, makes a transition between the states according to the situation of the virtual space, and automatically controls the camera division.

  The analysis unit 21 analyzes the situation of the virtual space. The situation of the virtual space to be analyzed may include the voice of the avatar (voices of the distributor and the viewer). For example, the analysis unit 21 analyzes the uttered avatars, the order of the uttered avatars, the utterance volume, the utterance length, the utterance content, the avatar pose, the number of comments, the number of viewer avatars participating in the program, and the like. ..

  The control unit 22 changes the state of camera division according to the finite state automaton based on the analysis result. When the state is changed, the control unit 22 controls the virtual camera based on the control information of the virtual camera associated with the changed state.

  The control unit 22 controls the virtual camera according to a finite state automaton as shown in FIG. 4, for example. In the example of FIG. 4, there are four camera divided states S1 to S4, and the state held by the control unit 22 transits between the states S1 to S4 according to the conditions A to H. The screen transition using the finite state automaton in FIG. 4 will be described later.

  The storage unit 23 stores a finite state automaton in which each of a plurality of camera divisions is in a state and a virtual space situation is a transition condition, and virtual camera control information for each state.

  The storage unit 23 may store a plurality of types of finite automata. For example, as an example of the finite automaton, a finite automaton that shows the transition of the camera split of one program by the distributor avatar, a finite automaton that shows the transition of the camera split of two programs by the distributor avatar, and a plurality of distributor avatars A variety of things can be considered, such as a finite automaton that shows the transition of camera splits of programs that are discussed by, and a finite automaton that shows the transitions of camera splits of a program that the distributor avatar explains while watching the video or game screen. The storage unit 23 is not limited to the above, and stores a finite state automaton according to a program to be distributed. The finite state automaton may be prepared by the business operator or may be created by the distributor.

  As the control server 20, for example, a general-purpose computer system including a central processing unit (CPU), a memory, a storage, a communication device, an input device, and an output device can be used. In this computer system, the control server 20 is realized by the CPU executing a predetermined program loaded on the memory. This program can be recorded on a computer-readable recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or can be distributed via a network. The distribution server 10 may have the function of the control server 20.

[Camera control processing]
The flow of control processing of the virtual camera by the control server will be described with reference to FIG.

  The distributor selects a finite automaton suitable for the program before distributing the program. Alternatively, the distributor may select a plurality of finite automata for the program, and the viewer may select the finite automaton from among them. For example, in a program in which two distributor avatars participate, a camera-divided finite automaton that focuses on each distributor avatar is prepared separately. You may prepare a finite automaton for each camera that focuses on the entire studio. When viewing a program, the viewer can select a camera-limited finite automaton that more intensively reflects the distributor avatar that he supports. In each finite state automaton, the weight of the transition condition is different for each distributor avatar. The attribute information of the viewer may be collected and the control server 20 may select the finite state automaton based on the attribute information of the viewer. The control server 20 may select a finite automaton to be applied according to the type of the viewer terminal 40 of the delivery destination.

  When the distribution of the program is started, the analysis unit 21 analyzes the situation of the virtual space in step S11. Regarding utterance analysis, weighting may be different for each avatar. For example, the analysis unit 21 gives a greater weight to the utterance of the distributor avatar between the distributor avatar and the viewer avatar. The analysis unit 21 converts the analysis result of the utterance into a score and corrects the score based on the weight. In a finite state automaton, transition conditions based on the score are set.

  In step S12, the control unit 22 determines whether the transition condition from the current state to another state is satisfied based on the analysis result. When the transition condition is not satisfied, the control unit 22 advances the processing to step S14.

  When the transition condition is satisfied, in step S13, the control unit 22 transitions the held state to the previous state that satisfies the transition condition, and controls the virtual camera according to the state after the transition. For example, when the condition A for transitioning from the state S1 to the state S2 is satisfied, the control unit 22 transitions the state to be held to the state S2 and controls the virtual camera so that the camera allocation corresponds to the state S2.

  In step S14, the control unit 22 determines whether the program has ended. If the distribution of the program continues, the process returns to step S11 and the process is repeated.

[Arrangement in virtual space]
A virtual space for shooting a program will be described with reference to FIG.

  The studio in the virtual space shown in FIG. 6 is prepared for distributing a program in which two distributor avatars 100 and 200 are proceeding. Two distributor avatars 100 and 200 are arranged in the studio. Viewer avatars 300A to 300C can also participate in this program. Viewer avatars 300A to 300C are arranged behind distributor avatars 100 and 200.

  Further, in FIG. 6, the display object 400 is arranged in the studio. The display object 400 can be embedded with a comment from a viewer, a still image, a moving image, a game screen, and the like to be displayed. The distributor avatars 100 and 200 may proceed with the program while watching a moving image or the like displayed on the display object 400. Note that FIG. 6 does not show background objects such as floor objects and wall objects in the studio. Objects other than the above may be placed in the studio.

  A virtual camera 500 arranged in the virtual space shoots a studio in the virtual space. The control server 20 controls the virtual camera, and the distribution server 10 distributes the video imaged by the virtual camera.

[Screen transition example]
A transition example of the screen of the program when the finite state automaton shown in FIG. 4 is used as a finite state automaton showing the transition of the camera division of the program will be described with reference to FIGS. 7 to 10.

  The finite state automaton in FIG. 4 is a finite state automaton for dividing a camera for a program in which two distributor avatars are proceeding. In the finite state automaton of FIG. 4, the camera allocation in the state S1 is a camera allocation for shooting the entire studio, the camera allocation in the state S2 is a camera allocation in which the two distributor avatars 100 and 200 are within the frame, and the state S3. The camera split of is the camera split showing the close-up of the distributor avatar 100, and the camera split of the state S4 is the split of the camera showing the close-up of the distributor avatar 200.

  When the program starts, it starts from the state S1. In the state S1, the video imaged by the virtual camera is a video image of the entire studio in the virtual space, as shown in FIG.

  When the condition A is satisfied in the state S1, the state transits to the state S2. The condition A is, for example, a condition that one of the distributor avatars 100 and 200 speaks. The condition A may be set such that the opening music ends, a predetermined time elapses, or the like.

  When the control server 20 detects the utterance of one of the distributor avatars 100 and 200 in the state S1, the control server 20 changes the state to be held from the state S1 to the state S2, and the two distributor avatars 100 and 200 are framed. The position of the virtual camera, the shooting direction, the angle of view, and the like are controlled so as to be within the range. When transitioning to the state S2, as shown in FIG. 8, a video image of two distributor avatars 100 and 200 is obtained. As a part of the device for directing, the position of the object in the virtual space may be ignored when shooting with the virtual camera, and the position of the object may be changed to a position that is easy to see and has an interest, and the shooting screen may be displayed by the virtual camera. For example, two distributor avatars 100 and 200 standing at distant positions are faced close to each other and photographed by a virtual camera. Alternatively, another avatar in the same virtual space, for example, a viewer avatar is arranged at a position surrounding the distributor avatars 100 and 200. When another avatar or a virtual object exists between the two distributor avatars 100 and 200, and the distributor avatars 100 and 200 are hidden, the virtual object or the like which is an obstacle is not displayed.

  In the state S2, the transition to the state S1 is made when the condition B is established, the transition to the state S3 is made when the condition C is established, and the transition to the state S4 is made when the condition E is established.

  The condition C is, for example, a condition that the distributor avatar 100 continues to speak for a predetermined time or longer. The condition E is, for example, that the distributor avatar 200 has continued speaking for a predetermined time or longer. While the two distributor avatars 100 and 200 are having a conversation, the state S2 is set, and when one of the distributor avatars 100 and 200 starts speaking for a predetermined time or longer, the state transitions to the state S3 or the state S4.

  In the state S2, when the control server 20 detects that the distributor avatar 100 has continued speaking for a predetermined period of time or more, the control server 20 changes the state to be held from the state S2 to the state S3, and the distributor avatar 100 is shown up. To control the virtual camera. When transitioning to the state S3, as shown in FIG. 9, a video image of the close-up of the distributor avatar 100 is obtained.

  In addition, when the control server 20 detects that the distributor avatar 200 has continued speaking for a predetermined time or more in the state S2, the control server 20 changes the state to be held from the state S2 to the state S4 and the distributor avatar 200 is up. Control the virtual camera so that it appears. When the state transits to the state S4, as shown in FIG. 10, the image of the close-up of the distributor avatar 200 is obtained.

  In the states S3 and S4, the backgrounds of the distributor avatars 100 and 200 may be separately prepared. For example, a background object is associated with each of the states S3 and S4, and when transitioning to the states S3 and S4, the associated background object is made to appear at a designated place (behind the distributor avatars 100 and 200). .. The background of the distributor avatar 100 and the background of the distributor avatar 200 can be different.

  When the condition H is satisfied in the state S3, the state S4 is entered, and when the condition G is satisfied in the state S4, the state S3 is entered.

  The condition H is, for example, a condition that the distributor avatar 200 speaks. The condition G is, for example, a condition that the distributor avatar 100 speaks. When the other party's distributor avatars 100, 200 speak while the distributor's avatars 100, 200 speak, the virtual camera is controlled to photograph the other party's distributor avatars 100, 200. As the conditions H and G, the movements of the distributor avatars 100 and 200 such as the distributor avatars 100 and 200 nod greatly may be set.

  Further, in the state S3, the transition to the state S2 is made when the condition D is satisfied, and in the state S4, the transition to the state S2 is made when the condition F is satisfied. Conditions D and F are, for example, conditions that the distributor avatars 100 and 200 have not spoken for a predetermined time or longer. Once the conversation between the distributor avatars 100 and 200 is completed, the images are restored to the images of the two distributor avatars 100 and 200. Alternatively, when the corners of the program change, the conditions D and F are set such that one of the distributor avatars 100 and 200 has spoken to advance the program such as “following” and “then next”. Alternatively, the state may be changed to the state S2, and the camera may be divided into two images of the distributor avatars 100 and 200. Alternatively, when the conditions D and F are, for example, that the transition interval between the state S3 and the state S4 is shorter than a predetermined time, and when the images of the up shot of the distributor avatars 100 and 200 are frequently switched, , The broadcaster avatars 100 and 200 may be returned to the camera split.

  The condition B for transitioning from the state S2 to the state S1 is, for example, a condition that both the distributor avatars 100 and 200 have performed a wave motion. Before the program ends, when the distributor avatars 100 and 200 waving their hands and say goodbye to the viewer, the state is transited to the state S1 to distribute the video of the entire studio, and then the program ends. The condition B may be set such that the utterance content of the distributor avatars 100, 200 is a greeting for ending, or the program ending time has come.

  The transition condition is not limited to the above. The excitement in the virtual space may be the transition condition. For example, the conversation of the distributors may be analyzed and the degree of excitement of the conversation may be used as the transition condition, the increasing tendency of the viewer avatars in the virtual space may be used as the transition condition, or only the viewing condition, which is not in the virtual space, may be used. The transition condition may be an increasing tendency of viewers who are watching. Also, the support status of the viewer may be used as the transition condition. For example, the transition conditions may be the statements of the viewers, the number of supporters, the number and content of comments posted, which one is supported, and the like.

In this way, the control server 20 controls the virtual camera based on a finite state automaton that describes state transitions rather than merely conditional branching, so that a more natural and easy-to-see video can be distributed as the program progresses. The effect of the present invention will be described from another aspect. Not only the distributed contents in the VR space but also, for example, in interactive programs and variety programs that are broadcast on television (terrestrial waves, BS broadcasts, etc.), the process of making the viewers interested and creating excitement (scripts, cameras) (Including splits), the pattern is naturally decided, and the skilled directors and switchers perform optimal progress, especially the splitting of the camera. However, when the performer speaks in ad lib, or when the reaction of the audience in the studio gets excited, there are times when the progress is not in the script, and this progress includes camera division.
On the other hand, in recent years, individual video distribution has become popular, and for these video distributions, a distributor avatar is placed in the VR space, or a plurality of distributors appear as avatars in a common virtual space. It also includes conducting dialogues and actions. In this case, the distribution programs and contents can be enriched by proceeding with a highly effective effect (script, camera division, etc.) as described above. However, in the case of individual distribution, it is difficult to arrange a skilled director and switcher in television broadcasting. Therefore, in the present embodiment, a scenario (camera division) for realizing the optimum effect is prepared in advance as a finite automaton, and the camera division is performed by watching the actual speech of the distributor avatar and the excitement of the viewer. Make a transition to the optimum state. As a result, VR moving image distribution and VR moving image content generation can be performed with a high effect of presentation and a high degree of interest, as if the process is being performed by a skilled director or switcher.

  As shown in FIG. 11, the screen may be divided and each divided area may hold a camera division state in which each of the distributor avatars 100 and 200 is displayed.

  Further, as shown in FIG. 12, the distributor avatars 100 and 200 may be set up on both sides of the display object 400 to keep the camera split state in which the display object 400 is displayed. The distributor does not have to move distributor avatars 100, 200 to the side of display object 400. The layout of avatars and objects is linked to the state. That is, the control server 20 stores the layout information indicating the arrangement of the objects in addition to the control information of the virtual camera corresponding to the state. When the state transitions, the control server 20 changes the positions of the distributor avatars 100 and 200 and the display object 400 in addition to the virtual camera according to the designated layout.

  Further, the control server 20 may change the layout according to the type or performance of the terminal to which the program is delivered. For example, when delivering to a terminal with a large screen size such as a personal computer, a normal head-and-body model is placed as a model of the distributor avatars 100 and 200, and when delivering to a terminal with a small screen size such as a mobile terminal. , A small model with a deformed head is placed. Even when watching the same program, a normal head-and-body model image is delivered to the personal computer, and a deformed investment trust model image is delivered to the mobile terminal. Different videos are distributed depending on the terminal used for viewing.

  The control server 20 prepares a finite state automaton for the personal computer and a finite state automaton for the mobile terminal, and in the state of the finite state automaton for the mobile terminal, information for replacing the model of the distributor avatar 100, 200 with the deformed model. Is tied. When viewing from a personal computer, a finite state automaton for a personal computer is selected, and when viewing from a mobile terminal, a finite state automaton for a mobile terminal is selected. Since the layout information for arranging the model of the deformed avatar is linked to each state of the finite state automaton for the mobile terminal, the deformed avatar is displayed when the program is viewed on the mobile terminal. Alternatively, instead of replacing the model, in the finite state automaton for a mobile terminal, the distributor avatars 100 and 200 may be arranged in a more upright manner than in the finite state automaton for a personal computer.

  As described above, the control server 20 of the program distribution system according to the present embodiment stores a finite state automaton in which each of a plurality of camera divisions is in a state and a virtual space situation is a transition condition. The control server 20 analyzes the situation in the virtual space, transitions the camera division state according to the finite state automaton based on the analysis result, and controls the virtual camera so that the camera division is in accordance with the state after the transition. Since the control server 20 controls the virtual camera based on a finite state automaton determined in advance, it is possible to eliminate an unnatural transition of the camera division, so that the camera division suitable for the situation can be performed.

10 ... Delivery server 20 ... Control server 21 ... Analysis unit 22 ... Control unit 23 ... Storage unit 30 ... Distributor terminal 31 ... HMD
32 ... Controller 40 ... Viewer terminal

Claims (6)

A control server for controlling a virtual camera for shooting a program in a virtual space,
A storage unit that stores a finite state automaton in which each of a plurality of camera divisions is in a state and the state of the virtual space is a transition condition,
An analysis unit for analyzing the situation of the virtual space,
Based on the analysis result, the state of camera splitting is transitioned according to the finite state automaton, and a control unit is provided for controlling the virtual camera so that the state of camera splitting is changed according to the state after transition,
The transition condition, Ri condition der related speech of the avatar in the virtual space,
A control server that changes a finite automaton to be applied according to the type of terminal that views the program . The control server according to claim 1, wherein
Arrangement information of objects in the virtual space is associated with the state,
The control unit is a control server that arranges the object according to a state after transition. The control server according to claim 2, wherein
The object is a background object, and the background object captured by the virtual camera is different according to the state. A distribution system for distributing a video image of a program in a virtual space to a terminal,
A distribution server that distributes an image of a program in a virtual space to a terminal, and a control server that controls a virtual camera that captures a program in the virtual space,
The control server is
A storage unit that stores a finite state automaton in which each of a plurality of camera divisions is in a state and the state of the virtual space is a transition condition,
An analysis unit for analyzing the situation of the virtual space,
Based on the analysis result, the state of camera splitting is transitioned according to the finite state automaton, and a control unit is provided for controlling the virtual camera so that the state of camera splitting is changed according to the state after transition,
The transition condition, Ri condition der related speech of the avatar in the virtual space,
The control server is a distribution system that changes a finite automaton to be applied according to the type of the terminal . A control method for controlling a virtual camera for shooting a program in a virtual space, comprising:
Computer
Each of a plurality of camera divisions is in a state, and a finite state automaton whose transition condition is the situation of the virtual space is stored,
Analyzing the situation of the virtual space,
Based on the analysis result, the state of camera division is transited according to the finite state automaton, and the virtual camera is controlled so that the camera division is in accordance with the state after transition,
The transition condition, Ri condition der related speech of the avatar in the virtual space,
A control method for changing a finite state automaton to be applied according to a type of a terminal for viewing the program . A program for operating a computer as a control server for controlling a virtual camera for shooting a program in a virtual space,
A process of storing each of a plurality of camera divisions as a state and storing a finite state automaton whose transition condition is the situation of the virtual space,
A process of analyzing the situation of the virtual space,
Based on the analysis result, transition the state of camera division according to the finite state automaton, and cause the computer to execute a process of controlling the virtual camera so that the camera division is in accordance with the state after transition.
The transition condition, Ri condition der related speech of the avatar in the virtual space,
A program for changing a finite automaton that is applied according to the type of terminal that views the program.

Images