JP2021007213A - Control server, distribution system, method for control, and program - Google Patents

Abstract

To perform a suitable camera blocking according to a situation in distribution of a video taken of an avatar in a virtual space.SOLUTION: A control server 20, which controls a virtual camera for imaging a virtual space, includes: a storage unit 23 for storing a finite automaton using each camera blocking as a state and using the situation of a virtual space as a shift condition; an analysis unit 21 for analyzing the situation of the virtual space; and a controller 22 for shifting the state of the camera blocking according to the finite automaton on the basis of the result of the analysis and controlling the virtual camera so that the camera blocking will correspond to the state after the shift.SELECTED DRAWING: Figure 3

Description

The present invention relates to control servers, distribution systems, control methods and programs.

There is known a service that uses virtual reality (VR) technology to distribute a video of a program in a studio in a virtual space taken by a virtual camera. The distributor participates in the program as an avatar in the virtual space. By using the studio in the virtual space, multiple distributors in remote areas can jointly proceed with the program. Viewers can also participate in the program as avatars.

Patent No. 4625058

For programs with multiple avatars in the virtual space, a program that is easy to see can be delivered by changing the camera allocation according to the progress of the program, such as a video of all participating avatars and a close-up video of the avatar speaking. it can.

However, in order to allocate a camera suitable for the situation, a staff member who operates a virtual camera in the virtual space is required. When the program is delivered live by one person or a small number of people, there is no specialized staff to operate the camera, and there is a problem that it is difficult to allocate the camera according to the situation.

Patent Document 1 discloses a technique in which an avatar is automatically made to act in a virtual space according to a user's instruction or a scenario, and images taken by a plurality of cameras having different positions are switched according to the instruction from the user. Patent Document 1 discloses that the captured images of cameras arranged at a plurality of positions in the virtual space are switched, but the switching of the cameras is performed by a user's instruction or a predetermined position and time in the virtual space. It is based on a predetermined scenario and does not switch automatically depending on the situation.

The present invention has been made in view of the above, and an object of the present invention is to automatically perform appropriate camera allocation according to a situation in the distribution of a moving image of a virtual space.

The control server of one aspect of the present invention is a control server that controls a virtual camera that shoots a virtual space, and stores a finite automaton in which each of a plurality of camera divisions is in a state and the state of the virtual space is a transition condition. Based on the analysis result, the storage unit, the analysis unit that analyzes the state of the virtual space, and the virtual state of the camera allocation are changed according to the finite automaton so that the camera allocation is made according to the state after the transition. It has a control unit that controls a camera.

The distribution system of one aspect of the present invention is a distribution system that distributes a video captured in a virtual space to a terminal, and includes a distribution server that distributes a video captured in the virtual space to the terminal and a virtual camera that captures the virtual space. The control server has a control server to control, and the control server analyzes the situation of the virtual space and a storage unit that stores a finite-state machine with each of a plurality of camera divisions as a state and a transition condition of the situation of the virtual space. It includes an analysis unit and a control unit that shifts the state of camera allocation according to the finite-state machine based on the analysis result and controls the virtual camera so that the camera allocation is made according to the state after the transition.

According to the present invention, in the distribution of a moving image of a virtual space, a suitable camera allocation can be automatically performed according to a situation. Specifically, according to the present invention, by controlling the camera allocation using the finite-state machine, the scenario (camera allocation) does not increase infinitely according to the behavior of the distributor in the VR content, and an effective scenario. The effect on the production is demonstrated by being narrowed down to.

FIG. 1 is a block diagram showing an overall configuration example of the program distribution system of the present embodiment. FIG. 2 is a diagram showing a state in which a distributor wears a head-mounted display. FIG. 3 is a functional block diagram showing a configuration example of the control server. FIG. 4 is a diagram showing an example of a finite automaton held by the control server. FIG. 5 is a flowchart showing the flow of control processing of the virtual camera by the control server. FIG. 6 is a diagram showing an example of a studio in a virtual space. FIG. 7 is a diagram showing an example of a screen in which the entire studio in the virtual space is photographed. FIG. 8 is a diagram showing an example of a screen in which two distributor avatars are photographed. FIG. 9 is a diagram showing a screen example of a close-up shot of one of the distributor avatars. FIG. 10 is a diagram showing a screen example in which the close-up of the other distributor avatar is photographed. FIG. 11 is a diagram showing a screen example in which the screen is divided and the distributor avatar is displayed. FIG. 12 is a diagram showing a screen example in which distributor avatars are arranged on both sides of the display object.

[System configuration]
Hereinafter, the program distribution system according to the embodiment of the present invention will be described with reference to the drawings.

The program distribution system of the present embodiment is a system in which a distributor participates in a program as a distributor avatar in a three-dimensional virtual space, and a video of a virtual space in which the program progresses is lively distributed. Further, in the program distribution system of the present embodiment, the viewer can also participate in the program as a viewer avatar in the same virtual space as the distributor.

The program distribution system of the present embodiment shown in FIG. 1 includes a distribution server 10, a control server 20, a distributor terminal 30, and a viewer terminal 40. Each device is connected via a network. The distribution server 10 and the control server 20 are devices prepared by a business operator that provides a video distribution service. The distributor terminal 30 and the viewer terminal 40 are terminals owned or prepared by the distributor and the viewer, respectively. From the perspective of the business operator, both the distributor and the viewer are users who use the company's services. Of course, the business operator itself may be the distributor. Although FIG. 1 illustrates two distributor terminals 30 and three viewer terminals 40, the number of each device is not limited to this.

The distribution server 10 receives the voice of the distributor and the motion data of the distributor avatar from the distributor terminal 30 via the network. For example, in the case of a program in which two distributors participate, the voice of each of the two distributors and the motion data of the distributor avatar are received from the distributor terminals 30 of each of the two distributors. The distribution server 10 controls the movement of the distributor avatar based on the motion data. The motion data may include the facial expression of the avatar.

The distribution server 10 distributes a video (video rendered by the distribution server 10) obtained by shooting a virtual space with a voice and a virtual camera to the viewer terminal 40. The distribution server 10 may transmit a data set for rendering the virtual space to the viewer terminal 40, and the viewer terminal 40 may render the virtual space. The distribution server 10 may distribute the video to the distributor terminal 30.

If the distributor terminal 30 or the viewer terminal 40 is a terminal having a VR function equipped with a head-mounted display (HMD) or the like, the distribution server 10 transmits a data set for constructing a virtual space to the terminal. The terminal constructs a virtual space based on the received data set, renders the virtual space based on the line-of-sight direction detected by the HMD, and projects an image on the HMD. The distribution server 10 may render the virtual space. For example, the distribution server 10 receives the line-of-sight direction from the terminal, distributes the image obtained by rendering the virtual space based on the line-of-sight direction received by the distribution server 10 to the terminal, and the terminal displays the received image on the HMD.

The distribution server 10 may receive a comment from the viewer terminal 40 and superimpose the comment on the video to be distributed.

Viewers may be involved in the program. For example, when the viewer performs an operation to participate in the program on the viewer terminal 40, the distribution server 10 receives a notification from the viewer terminal 40 notifying that the viewer participates in the program. The distribution server 10 arranges a viewer avatar corresponding to the viewer in the virtual space. When the viewer is participating in the program, the distribution server 10 receives the voice of the viewer and the motion data of the viewer avatar from the viewer terminal 40, and controls the movement of the viewer avatar based on the motion data. ..

The control server 20 is a device that controls a virtual camera that shoots a program in a virtual space. The control server 20 controls the virtual camera in the virtual space according to the finite automaton with the camera allocation as the state and the state of the virtual space as the transition condition. The control server 20 may change the layout (arrangement of objects) in the virtual space according to the transition of the state. The details of the control server 20 will be described later. The finite automaton used in this embodiment is a mathematically abstracted model consisting of a finite number of combinations of states, transitions, and actions. Of the finite number of "states", only one state is taken at a certain time, and some event or condition shifts from one state to another. The transition from one state to another is called "transition". A finite automaton is defined by enumerating the states that can transition from each state and the conditions that trigger the transition.

The distributor terminal 30 is a terminal used by the distributor to distribute a program. As the distributor terminal 30, any computer device such as a smartphone and a personal computer having a VR function can be used. As shown in FIG. 2, the distributor terminal 30 includes an HMD 31 worn by the distributor. The distributor terminal 30 may include a controller 32 for accepting input from the distributor and operating the distributor avatar arranged in the virtual space. The distributor terminal 30 generates motion data of the distributor avatar based on the movement of the distributor's head detected by the HMD 31 and the operation by the controller 32.

The distributor terminal 30 receives a data set for constructing a virtual space from the distribution server 10, constructs the virtual space based on the received data, renders the virtual space, and projects an image on the HMD 31.

The distributor terminal 30 transmits the voice of the distributor and the motion data of the distributor avatar to the distribution server 10. The distributor advances the program by talking with other distributors and viewers while moving the distributor avatar.

As the distributor terminal 30, a terminal that does not have the HMD 31 and has a built-in camera or a camera may be used. In this case, the distributor terminal 30 photographs the distributor with a camera and generates motion data of the distributor avatar from the video captured by the distributor. The distributor terminal 30 receives and displays an image captured in the virtual space by the virtual camera from the distribution server 10.

The viewer terminal 40 is a terminal used by a viewer to watch a program. The viewer terminal 40 can use any computer device such as a smartphone, a tablet terminal, a television system, or a personal computer as long as it is a device having a function of receiving and displaying a video of a program from the distribution server 10. The viewer terminal 40 may transmit the comment input from the viewer to the distribution server 10.

When the viewer participates in the program as a viewer avatar, the viewer terminal 40 transmits the voice of the viewer and the motion data of the viewer avatar to the distribution server 10.

[Server configuration]
The control server will be described with reference to FIG.

The control server 20 shown in FIG. 3 includes an analysis unit 21, a control unit 22, and a storage unit 23. The control server 20 has each of the plurality of camera allocations as a state, transitions between the states according to the situation of the virtual space, and automatically controls the camera allocation.

The analysis unit 21 analyzes the situation in the virtual space. The audio of the avatar (audio of the distributor and the viewer) may be included in the situation of the virtual space to be analyzed. For example, the analysis unit 21 analyzes the avatars spoken, the order of the avatars spoken, the volume of the utterance, the length of the utterance, the content of the utterance, the pose of the avatar, the number of comments, the number of viewer avatars who participated in the program, and the like. ..

Based on the analysis result, the control unit 22 changes the state of camera allocation according to the finite automaton. When the state is changed, the control unit 22 controls the virtual camera based on the control information of the virtual camera associated with the state after the transition.

The control unit 22 controls the virtual camera according to a finite automaton, for example, as shown in FIG. In the example of FIG. 4, it has four camera split states S1 to S4, and the state held by the control unit 22 transitions between the states S1 to S4 according to the conditions A to H. The screen transition using the finite automaton of FIG. 4 will be described later.

The storage unit 23 stores a finite automaton in which each of the plurality of camera divisions is set as a state and a state in the virtual space as a transition condition, and control information of the virtual camera for each state.

The storage unit 23 may store a plurality of types of finite automata. For example, examples of a finite-state machine include a finite-state machine in which the distributor avatar indicates the transition of the camera allocation of one program, a finite-state machine in which the distributor avatar indicates the transition of the camera allocation of two programs, and a plurality of distributor avatars. There are various possibilities, such as a finite-state machine that shows the transition of the camera allocation of the program that is discussed by, and a finite-state machine that shows the transition of the camera allocation of the program that the distributor avatar explains while watching the video or game screen. The storage unit 23 is not limited to the above, and stores a finite automaton according to the program to be distributed. The finite automaton may be prepared by the business operator or may be created by the distributor.

As the control server 20, for example, a general-purpose computer system including a central processing unit (CPU), a memory, a storage, a communication device, an input device, and an output device can be used. In this computer system, the control server 20 is realized by the CPU executing a predetermined program loaded in the memory. This program can be recorded on a computer-readable recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or can be distributed via a network. The distribution server 10 may include the functions of the control server 20.

[Camera control processing]
The flow of the control process of the virtual camera by the control server will be described with reference to FIG.

The distributor selects a finite automaton suitable for the program before distributing the program. Alternatively, the distributor may select a plurality of finite automata for the program, and the viewer may select the finite automaton from among them. For example, in a program in which two distributor avatars participate, a finite camera split automaton that focuses on each distributor avatar is prepared separately. A finite-state machine with a camera split that focuses on the entire studio may be prepared. When watching a program, the viewer can select a finite-state machine with a camera split that more emphasizes the distributor avatar that he / she supports. In each finite automaton, the weight of the transition condition is different for each distributor avatar. The finite automaton may be selected by the control server 20 based on the attribute information of the viewer by collecting the attribute information of the viewer. The control server 20 may select a finite automaton to be applied according to the type of the viewer terminal 40 of the distribution destination.

When the distribution of the program is started, in step S11, the analysis unit 21 analyzes the state of the virtual space. Regarding the analysis of utterances, the weighting may be different for each avatar. For example, the analysis unit 21 gives a larger weight to the utterance of the distributor avatar between the distributor avatar and the viewer avatar. The analysis unit 21 converts the analysis result of the utterance into a score and corrects the score based on the weight. In the finite automaton, transition conditions based on the score are set.

In step S12, the control unit 22 determines whether or not the transition condition from the current state to another state is satisfied based on the analysis result. If the transition condition is not satisfied, the control unit 22 proceeds to step S14.

When the transition condition is satisfied, in step S13, the control unit 22 shifts the held state to the state after the transition condition is satisfied, and controls the virtual camera according to the state after the transition. For example, when the condition A for transitioning from the state S1 to the state S2 is satisfied, the control unit 22 shifts the held state to the state S2 and controls the virtual camera so as to have a camera allocation corresponding to the state S2.

In step S14, the control unit 22 determines whether or not the program has ended. If the distribution of the program continues, the process returns to step S11 and the process is repeated.

[Arrangement in virtual space]
A virtual space for shooting a program will be described with reference to FIG.

The studio in the virtual space shown in FIG. 6 is prepared for distributing a program in which two distributor avatars 100 and 200 are in progress. Two distributor avatars 100 and 200 are placed in the studio. Viewer avatars 300A to 300C can also participate in this program. The viewer avatars 300A to 300C are arranged behind the distributor avatars 100 and 200.

Further, in FIG. 6, the display object 400 is arranged in the studio. The display object 400 can be fitted with comments from viewers, still images, moving images, game screens, and the like. The distributor avatars 100 and 200 may proceed with the program while watching the moving image displayed on the display object 400. Note that FIG. 6 does not show background objects such as studio floor objects and wall objects. Objects other than the above may be placed in the studio.

A virtual camera 500 arranged in the virtual space photographs a studio in the virtual space. The control server 20 controls the virtual camera, and the distribution server 10 distributes the video captured by the virtual camera.

[Screen transition example]
An example of a transition of a program screen when the finite automaton shown in FIG. 4 is used as a finite automaton showing a transition of a program camera allocation will be described with reference to FIGS. 7 to 10.

The finite automaton of FIG. 4 is a camera-split finite automaton for a program in which two distributor avatars proceed. In the finite automaton of FIG. 4, the camera allocation in the state S1 is the camera allocation for shooting the entire studio, the camera allocation in the state S2 is the camera allocation in which the two distributor avatars 100 and 200 fit in the frame, and the camera allocation in the state S3. The camera allocation of is a camera allocation that reflects the up of the distributor avatar 100, and the camera allocation of the state S4 is a camera allocation that reflects the up of the distributor avatar 200.

At the start of the program, it starts from the state S1. In the state S1, the image captured by the virtual camera is an image captured of the entire studio in the virtual space, as shown in FIG. 7.

When the condition A is satisfied in the state S1, the state transitions to the state S2. Condition A is, for example, a condition that one of the distributor avatars 100 and 200 has spoken. As the condition A, it may be set that the opening music has ended, a predetermined time has passed, and the like.

When the control server 20 detects the utterance of any of the distributor avatars 100 and 200 in the state S1, the state to be held is changed from the state S1 to the state S2, and the two distributor avatars 100 and 200 frame. The position, shooting direction, angle of view, etc. of the virtual camera are controlled so that the camera fits inside. When the transition to the state S2 occurs, as shown in FIG. 8, the images of the distributor avatars 100 and 200 are captured. As part of the ingenuity in the production, the position of the object in the virtual space may be ignored when shooting with the virtual camera, and the position of the object may be changed to a position that is easy to see and interesting, and the shooting screen may be created by the virtual camera. For example, two distributor avatars 100 and 200 standing at distant positions face each other close to each other and are photographed by a virtual camera. Alternatively, another avatar in the same virtual space, for example, a viewer avatar is placed at a position surrounding the distributor avatars 100 and 200. If another avatar or virtual object exists between the two distributor avatars 100, 200 and the distributor avatars 100, 200 are hidden, the virtual object or the like that is an obstacle is not displayed.

In the state S2, when the condition B is satisfied, the state transitions to the state S1, when the condition C is satisfied, the transition to the state S3, and when the condition E is satisfied, the transition to the state S4.

Condition C is, for example, a condition that the distributor avatar 100 continues to speak for a predetermined time or longer. The condition E is, for example, a condition that the distributor avatar 200 continues to speak for a predetermined time or longer. While the two distributor avatars 100 and 200 are talking, the state is set to S2, and when any of the distributor avatars 100 and 200 speaks continuously for a predetermined time or longer, the state transitions to the state S3 or the state S4.

When the control server 20 detects that the distributor avatar 100 has continued to speak for a predetermined time or longer in the state S2, the state to be held is changed from the state S2 to the state S3, and the distributor avatar 100 is captured in close-up. To control the virtual camera. When the state transitions to the state S3, as shown in FIG. 9, the image is obtained by shooting the close-up of the distributor avatar 100.

Further, when the control server 20 detects that the distributor avatar 200 has continued to speak for a predetermined time or longer in the state S2, the state to be held is changed from the state S2 to the state S4, and the distributor avatar 200 is up. Control the virtual camera so that it can be captured. When the transition to the state S4 occurs, as shown in FIG. 10, the image of the close-up of the distributor avatar 200 is obtained.

In the states S3 and S4, the backgrounds of the distributor avatars 100 and 200 may be prepared separately. For example, a background object is associated with each of the states S3 and S4, and when the state S3 and S4 are transitioned, the associated background object appears at a specified location (behind the distributor avatars 100 and 200). .. The background of the distributor avatar 100 and the background of the distributor avatar 200 can be different.

In the state S3, when the condition H is satisfied, the state transitions to the state S4, and in the state S4, when the condition G is satisfied, the transition to the state S3 occurs.

The condition H is, for example, a condition that the distributor avatar 200 has spoken. The condition G is, for example, a condition that the distributor avatar 100 has spoken. If the other party's distributor avatars 100, 200 speak while the distributor avatars 100, 200 are speaking, the virtual camera is controlled to shoot the other party's distributor avatars 100, 200. As conditions H and G, the movements of the distributor avatars 100 and 200, such as the distributor avatars 100 and 200 nodding loudly, may be set.

Further, in the state S3, when the condition D is satisfied, the state transitions to the state S2, and in the state S4, when the condition F is satisfied, the transition to the state S2 occurs. Conditions D and F are, for example, conditions that the distributor avatars 100 and 200 have not spoken for a predetermined time or longer. Once the conversation between the distributor avatars 100 and 200 is completed, the video returns to the video showing the two distributor avatars 100 and 200. Alternatively, when the corner of the program changes, the conditions D and F are set on the condition that one of the distributor avatars 100 and 200 makes an utterance to advance the program such as "following" and "next". The state may be changed to S2, and a camera split may be used to capture two people, the distributor avatars 100 and 200. Alternatively, when the images of the close-ups of the distributor avatars 100 and 200 are frequently switched under the conditions D and F, for example, the transition interval between the states S3 and the state S4 is shorter than the predetermined time. , You may return to the camera split that captures two people, the distributor avatars 100 and 200.

The condition B for transitioning from the state S2 to the state S1 is, for example, a condition that both the distributor avatars 100 and 200 have waved their hands. Before the end of the program, when the distributor avatars 100 and 200 wave their hands to say goodbye to the viewer, the program is terminated after the transition to the state S1 and the distribution of the entire studio image. As the condition B, it may be set that the utterance content of the distributor avatars 100 and 200 is the end greeting, the program end time, and the like.

The transition conditions are not limited to the above. The excitement in the virtual space may be a transition condition. For example, the conversations of the distributors may be analyzed and the degree of excitement of the conversation may be used as a transition condition, the increasing tendency of the viewer avatars in the virtual space may be used as the transition condition, or only viewing although not in the virtual space. The increasing tendency of the number of viewers may be used as a transition condition. In addition, the support status of the viewer may be used as a transition condition. For example, the transition conditions may be the comments of the viewers, the number of cheers, the number and contents of comments posted, and which one is cheering.

In this way, the control server 20 controls the virtual camera based on the finite automaton that describes the transition of the state, not just the conditional branching, so that a more natural and easy-to-see image can be delivered according to the progress of the program. The effects of the present invention will be described from another aspect. Not limited to the content distributed in the VR space, for example, in dialogue programs and variety programs that are broadcast on TV (terrestrial broadcasting, BS broadcasting, etc.), the progress (script, camera) that keeps the viewer interested and creates excitement. The pattern (including split) is naturally decided, and skilled directors and switchers perform the optimum progress, especially camera split. However, if the performer makes an ad-lib remark or the reaction of the audience in the studio is lively, the progress may not be in the script, and this progress includes camera allocation. On the other hand, in recent years, it has become popular to distribute videos individually, and in these video distributions, distributor avatars may be placed in the VR space, or multiple distributors may appear as avatars in a common virtual space. It also includes engaging in dialogue and actions. In this case, it is possible to enhance the distributed programs and contents by performing the progress (script, camera allocation, etc.) with a high effect as described above. However, in the case of individual distribution, it is difficult to assign a skilled director and switcher in television broadcasting. Therefore, in this embodiment, a scenario (camera allocation) for realizing the optimum effect is prepared in advance as a finite automaton, and the camera allocation is performed by observing the actual distributor avatar's remarks and the excitement of the viewer. Transition to the optimum state. As a result, it is possible to distribute VR video and generate VR video content, which have a high production effect and a high degree of interest, as if the progress was made by a skilled director or switcher.

As shown in FIG. 11, the screen may be divided, and the state of the camera allocation for displaying each of the distributor avatars 100 and 200 may be maintained in each of the divided areas.

Further, as shown in FIG. 12, distributor avatars 100 and 200 may be erected on both sides of the display object 400 to maintain the state of the camera split for displaying the display object 400. The distributor does not need to move the distributor avatars 100, 200 to the side of the display object 400. Associate the layout of avatars and objects with the state. That is, the control server 20 stores layout information indicating the arrangement of objects in addition to the control information of the virtual camera corresponding to the state. When the state changes, the control server 20 changes the positions of not only the virtual camera but also the distributor avatars 100 and 200 and the display object 400 according to the specified layout.

Further, the control server 20 may change the layout according to the type or performance of the terminal to which the program is distributed. For example, when delivering to a terminal with a large screen size such as a personal computer, a normal head and body model is arranged as a model of the distributor avatars 100 and 200, and when delivering to a terminal with a small screen size such as a mobile terminal. , Place a model with a small head and body with many deformed heads. Even when watching the same program, a video of a normal head and body model is delivered to a personal computer, and a video of a deformed investment trust model is delivered to a mobile terminal. Different videos are delivered depending on the terminal used for viewing.

The control server 20 prepares a finite-state machine for a personal computer and a finite-state machine for a mobile terminal, and in the state of the finite-state machine for a mobile terminal, information for replacing the model of the distributor avatars 100 and 200 with a deformed model. Is linked. When viewing from a personal computer, a finite-state machine for a personal computer is selected, and when viewing from a mobile terminal, a finite-state machine for a mobile terminal is selected. Since layout information for arranging the deformed avatar model is associated with each state of the finite-state machine for the mobile terminal, the deformed avatar is displayed when the program is viewed on the mobile terminal. Alternatively, instead of replacing the model, the finite automaton for the mobile terminal may be a camera split in which the distributor avatars 100 and 200 are captured more closely than the finite automaton for the personal computer.

As described above, the control server 20 of the program distribution system of the present embodiment stores a finite automaton in which each of the plurality of camera allocations is in a state and the state of the virtual space is a transition condition. The control server 20 analyzes the situation of the virtual space, changes the state of the camera allocation according to the finite automaton based on the analysis result, and controls the virtual camera so that the camera allocation is made according to the state after the transition. Since the control server 20 controls the virtual camera based on a predetermined finite automaton, it is possible to eliminate an unnatural transition of camera allocation, so that appropriate camera allocation can be performed according to the situation.

10 ... Distribution server 20 ... Control server 21 ... Analysis unit 22 ... Control unit 23 ... Storage unit 30 ... Distributor terminal 31 ... HMD
32 ... Controller 40 ... Viewer terminal

Claims (8)

A control server that controls a virtual camera that shoots virtual space.
A storage unit that stores a finite automaton with each of the plurality of camera divisions as a state and the state of the virtual space as a transition condition.
An analysis unit that analyzes the situation in the virtual space,
Based on the analysis result, a control unit that shifts the state of the camera allocation according to the finite automaton and controls the virtual camera so that the camera allocation is made according to the state after the transition.
Control server with. The control server according to claim 1.
The arrangement information of the object in the virtual space is associated with the state.
The control unit is a control server that arranges the object according to the state after the transition. The control server according to claim 2.
The object is a background object, and a control server in which the background object photographed by the virtual camera differs depending on the state. The control server according to any one of claims 1 to 3.
The transition condition is a control server that is a condition related to the utterance of an avatar in the virtual space. It is a distribution system that distributes images of virtual space to terminals.
It has a distribution server that distributes the video of the virtual space to the terminal and a control server that controls the virtual camera that shoots the virtual space.
The control server
A storage unit that stores a finite automaton with each of the plurality of camera divisions as a state and the state of the virtual space as a transition condition.
An analysis unit that analyzes the situation in the virtual space,
Based on the analysis result, a control unit that shifts the state of the camera allocation according to the finite automaton and controls the virtual camera so that the camera allocation is made according to the state after the transition.
Delivery system with. The distribution system according to claim 5.
The control server is a distribution system that changes a finite automaton to be applied according to the type of the terminal. It is a control method that controls a virtual camera that shoots virtual space.
The computer
A finite automaton is stored with each of the multiple camera divisions as a state and the state of the virtual space as a transition condition.
Analyze the situation of the virtual space and
A control method having a control method in which the state of camera allocation is changed according to the finite automaton based on the analysis result, and the virtual camera is controlled so that the camera allocation is made according to the state after the transition. A program that operates a computer as a control server that controls a virtual camera that shoots virtual space.
A process of storing a finite automaton with each of a plurality of camera divisions as a state and a transition condition of the virtual space situation, and
The process of analyzing the situation in the virtual space and
Based on the analysis result, the process of changing the state of the camera allocation according to the finite automaton and controlling the virtual camera so that the camera allocation is made according to the state after the transition.
A program that causes the computer to execute.

Images