JP6320488B1 - Virtual reality providing system, virtual reality providing method, virtual reality providing device, and program - Google Patents

Abstract

A delay period is suppressed by distributing a processing load for rendering content. A terminal device that generates a first content in which an object belonging to a first category among a plurality of objects is rendered based on an instruction based on an operation by a user, and a plurality of objects based on an instruction received from the terminal device. A server device that generates second content obtained by rendering an object belonging to the second category among the objects, and transmits the generated second content to the terminal device. The terminal device includes the first content and the second content. A virtual reality system that synthesizes and generates content. [Selection] Figure 4

Description

  The present invention relates to a virtual reality providing system, a virtual reality providing method, a virtual reality providing support device, a virtual reality providing device, and a program.

  2. Description of the Related Art Conventionally, a game system including a terminal device that accepts a user operation and a server device that provides data for displaying an image on the terminal device when accepted by the terminal device is known (see Patent Document 1). . In this regard, a function provided in a game that is likely to be used by the user by rendering the first web page for the game on the terminal device in response to starting the game in response to the user's operation. While the first web page for the game is displayed, the second web page for the game for providing the determined function is obtained, and the second web page for the obtained game is acquired. A technique for rendering a second web page for a game stored in a cache in a terminal device in accordance with a user instruction to store the page in a cache and use a determined function is known.

International Publication No. 2014/065339

  However, in the above-described game system, image rendering is performed only by the terminal device, and there is a problem in that the processing load assigned to image rendering in the terminal device increases. Further, in the above-described game system, when a function different from the determined function is selected, there is a possibility that the delay period from when the function is selected to when rendering of the image is completed may be long. Furthermore, when providing virtual reality while rendering a three-dimensional image, there is a possibility that the delay period from the input of the user to the completion of rendering of the image becomes even longer.

  The present invention has been made in view of such circumstances, and a virtual reality providing system, a virtual reality providing method, and a virtual reality providing capable of suppressing a delay period by distributing a processing load for rendering content An object is to provide a support device, a virtual reality providing device, and a program.

  According to one aspect of the present invention, a terminal device that generates first content in which an object belonging to a first category among a plurality of objects is rendered based on an instruction based on a user operation, and the instruction received from the terminal apparatus. A server device that generates second content obtained by rendering an object belonging to a second category among the plurality of objects, and transmits the generated second content to the terminal device, the terminal device comprising: The virtual reality providing system generates a content by synthesizing the first content and the second content.

  According to one aspect of the present invention, the delay period can be suppressed by distributing the processing load for rendering content.

It is a lineblock diagram of game system 1 of an embodiment. It is a figure showing typically role assignment in game system 1 of an embodiment. It is an example of the content 300 presented by the terminal device 100. It is a figure for demonstrating the distributed process in the game system. 3 is a block diagram illustrating an example of functional configurations of a terminal device 100 and a game server device 200. FIG. 4 is a flowchart showing a flow of distributed processing in the game system 1. It is a figure which shows an example of the hardware constitutions of the terminal device 100 and the game server apparatus 200.

  Hereinafter, embodiments of a virtual reality providing system, a virtual reality providing method, a virtual reality providing support device, a virtual reality providing device, and a program according to the present invention will be described with reference to the drawings.

<Outline of Embodiment>
The game system of the embodiment provides, for example, a cloud game service. When the cloud game service receives a user operation from the terminal device, the cloud game service transmits an instruction based on the user operation to the game server device via the network, and the game content such as an image is transmitted from the game server device to the network. This is a service that provides game content such as images to the terminal device by transmitting to the terminal device. The game system according to the embodiment generates first image data as first content obtained by rendering an object belonging to a first category among a plurality of objects appearing in a game by a terminal device. On the other hand, in the game system of the embodiment, the game server device generates second image data as second content obtained by rendering an object belonging to the second category among a plurality of objects, and the generated second image data is used as the terminal device. Send to. The terminal device displays the game content by synthesizing the generated first image data and the received second image data.

  The virtual reality providing system of the present invention only needs to provide a virtual reality that stimulates the user's five senses. For example, an image relating to a simulator service may be provided instead of the cloud game service. The simulator service provides, for example, virtual reality for driving a car. Specifically, when the simulator service receives a steering wheel operation of the automobile by the terminal device, the simulator service transmits an instruction based on the steering wheel operation to the simulator server device via the network, and the content such as an image from the simulator server device. This is a service that provides content related to a simulator such as an image to the terminal device by being transmitted to the terminal device via the network.

  Whether the object belongs to the first category or the second category is determined at any time according to a rule set in advance in the game system. The preset rule is, for example, that an object that exists within a predetermined distance from the viewpoint in the game (virtual reality) belongs to the first category, and an object that exists at a position farther than the predetermined distance from a certain object It is a rule set to be an object belonging to two categories. For example, when the “certain object” is a character whose position and posture are updated according to the player's operation, an object within a predetermined distance from the character is determined as an object belonging to the first category, and an object far from the character is a predetermined distance. Are determined as objects belonging to the second category. Note that whether the object belongs to the first category or the second category may be set in advance in the game system.

  In other words, an object belonging to the first category may be an object that is rendered in a short cycle among a plurality of objects. In this case, an object belonging to the second category is rendered in a long cycle among a plurality of objects. Object

  From another viewpoint, the object belonging to the first category may be an object whose status changes in response to an instruction based on the user's operation among the plurality of objects. In this case, the object belonging to the second category includes a plurality of objects. Among these objects, the status does not change in response to the instruction.

  In the following embodiments, an object belonging to the first category is an object belonging to the foreground (hereinafter referred to as a foreground object), and an object belonging to the second category is referred to as an object belonging to the distant view (hereinafter referred to as a distant view object). It will be explained as being.

<Configuration of game system 1>
FIG. 1 is a configuration diagram of a game system 1 according to the embodiment. FIG. 2 is a diagram schematically illustrating the division of roles in the game system 1 of the embodiment. The game system 1 provides, for example, a cloud game service in which a plurality of users participate to advance a game. As shown in FIG. 1, the game system 1 includes, for example, a plurality of terminal devices 100-1 to 100 -N and a game server device 200. N is a natural number of 2 or more. In the following description, the terminal device is described as “terminal device 100” when it is not distinguished from other terminal devices.

  The plurality of terminal devices 100 and the game server device 200 are connected via a network NW. The network NW includes, for example, a wireless base station, a Wi-Fi access point, a communication line, a provider, the Internet, and the like. Note that it is not necessary for all combinations of these components to be able to communicate with each other, and the network NW may partially include a local network.

  The terminal device 100 is a device used by a user (general user). The terminal device 100 is a computer device (communication device) such as a mobile phone such as a smartphone, a tablet terminal, or a personal computer, for example. As shown in FIG. 2, a game program 100a is installed in the terminal device 100. The game program 100a is executed by a CPU (Central Processing Unit) in the terminal device 100, for example.

  The game program 100a accepts an operation by the user, and performs an action process, a correction process, a foreground rendering process, a composition process, a display process, and the like based on an instruction corresponding to the accepted operation. Furthermore, the game program 100a transmits information representing an instruction corresponding to the accepted operation to the game server device 200. The action process is a process for calculating the posture and position (hereinafter, status) of an object based on an instruction. The correction process is a process of correcting the status (processing result) calculated by the action process to the status received from the game server device 200. The foreground rendering process is a process for rendering a foreground object. The combining process is a process of combining the rendered image (hereinafter, foreground rendering image) and the image received from the game server device 200. The display process is a process for displaying a synthesized image (hereinafter, a synthesized image). Note that the game program 100a may execute, in addition to the above processing, processing for outputting sound, processing for vibrating an operation device held by the user, and the like.

  A game control program 200 a is installed in the game server device 200. The game control program 200a is executed by the CPU in the game server device 200, for example. The game control program 200a performs game progress processing, action processing, distant view rendering processing, transmission processing, and the like. The game progress process is a process for performing overall control of the game. The action process is a process for calculating the postures and positions (status) of all objects appearing in the game. In this action process, in addition to changes in posture and position based on instructions for each object, changes in posture and position including effects between objects such as collision between objects are calculated. The correction process is a process of transmitting the status (processing result) calculated by the game control program 200a to the terminal device 100 when the status calculated by the terminal device 100 is different from the status calculated by the game control program 200a. is there. The distant view rendering process is a process of rendering a distant view object. The transmission process is a process of transmitting a rendered image (hereinafter, a distant view rendered image) to the terminal device 100.

  The terminal device 100 includes a terminal-side storage unit 100b that stores object data and status. The game server device 200 includes a server-side storage unit 200b that stores object data and status. The terminal-side storage unit 100b and the server-side storage unit 200b include, for example, an HDD (Hard Disk Drive), a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a ROM (Read Only Memory), or a RAM (Random Access Memory), Alternatively, it is realized by a hybrid storage device using a plurality of these. The terminal-side storage unit 100b and the server-side storage unit 200b store various programs such as firmware and application programs, object data, status data, processing results, and the like. Part or all of the terminal-side storage unit 100b and the server-side storage unit 200b may be realized by an external storage device that can be accessed via various networks. An example of the external storage device is a NAS (Network Attached Storage) device.

  The object data is data representing static properties of the object such as the shape and color of the object. The status is data representing the nature of an object that dynamically changes based on an instruction or the like such as the position and orientation of the object. The object data and status stored in the terminal-side storage unit 100b are synchronized with the object data and status stored in the server-side storage unit 200b while the game is in progress. In the present embodiment, the status stored in the terminal-side storage unit 100b is corrected by the status calculated by the game server device 200.

<Object category>
FIG. 3 shows an example of content 300 presented by the terminal device 100. The content 300 in FIG. 3 includes a character object 310 and background objects 321, 322, 323, and 324. The character object 310 is a person, and is an object (character) whose position and posture are updated according to the operation of the user (player). The background object 321 is an object classified as a background among a plurality of objects. The background object 321 is, for example, an object representing a tree located farther from the character object 310 with a predetermined viewpoint as a reference. The background object 322 is an object representing a road. The background objects 323 and 324 are objects representing trees that are located closer to the character object 310 with a predetermined viewpoint as a reference. In the present embodiment, the character object 310 is an example of a foreground object, and the background objects 321 to 324 are examples of a distant object. The distant view object includes content that covers the surroundings of the character object 310 within a range of 360 degrees, such as the background of the background objects 321 to 324 in addition to the background objects 321 to 324.

  The character object 310 is an example of an object rendered on the terminal device 100. The character object 310 can be read as an object rendered in a short cycle among a plurality of objects. The background objects 321 to 324 are examples of objects that are rendered in the game server device 200. The background objects 321 to 324 can be read as objects that are rendered in a long cycle among a plurality of objects.

  The character object 310 is an example of an object whose status such as posture and position is changed according to an instruction based on a user operation. The character object 310 can be read as an object whose status changes in response to an instruction based on a user operation among a plurality of objects. The background objects 321 to 324 are examples of objects whose statuses such as posture and position do not change according to an instruction based on a user operation. The background objects 321 to 324 can be read as objects whose status does not change in response to an instruction among a plurality of objects.

  Note that an object belonging to the first category can be read as an object belonging to a character in the game, and an object belonging to the second category can be read as an object belonging to the background in the game.

<Distributed processing>
FIG. 4 is a diagram for explaining distributed processing in the game system 1. The terminal device 100 generates a foreground rendered image 400a by performing a rendering process on the foreground object among the objects included in the content 300 in response to accepting a user operation. In addition, the terminal device 100 generates first composition data for assisting composition of the foreground rendering image 400a and other image data. The first composition data includes, for example, foreground depth information 400b and foreground transparency information 400c. The foreground depth information 400b is information representing the distance from a predetermined viewpoint for each pixel included in the foreground rendering image 400a. The foreground depth information 400b is also referred to as a Z value, for example. The foreground transparency information 400c is information representing the degree of transparency from a predetermined viewpoint for each pixel included in the foreground rendering image 400a. The foreground transparency information 400c is also referred to as an α value, for example.

  Based on the user instruction received from the terminal device 100, the game server device 200 performs a rendering process on a distant view object among the objects included in the content 300, thereby generating a distant view rendered image 410a. In addition, the game server device 200 generates second composition data for assisting composition of the distant view rendered image 410a and other image data. The second composition data includes, for example, distant view depth information 410b and distant view transparency information 410c. The distant view depth information 410b is information representing a distance from a predetermined viewpoint for each pixel included in the distant view rendered image 410a. The distant view depth information 410b is also referred to as a Z value, for example. The distant view transparency information 410c is information representing the degree of transparency from a predetermined viewpoint for each pixel included in the distant view rendered image 410a. The distant view transparency information 410c is also referred to as an α value, for example. The game server device 200 transmits the distant view rendered image 410a, the distant view depth information 410b, and the distant view transparency information 410c to the terminal device 100.

  The terminal device 100 performs a composition process in response to the reception of the distant view rendering image 410a, the distant view depth information 410b, and the distant view transparency information 410c from the game server device 200. The terminal device 100 considers the depth and transparency of each object based on a predetermined viewpoint based on the foreground depth information 400b, the foreground transparency information 400c, the distant view depth information 410b, and the distant view transparency information 410c. 400a and the distant view rendered image 410a are combined. As a result, the terminal device 100 generates a composite image 420 including the foreground object and the foreground object.

  For example, the terminal device 100 performs a composition process for each processing cycle in which the content 300 is displayed. The processing period is, for example, 1/60 seconds, but may be any period such as 1/30 seconds. Further, the processing cycle of the terminal device 100 and the processing cycle of the game server device 200 may be different. The terminal device 100 acquires information for identifying the processing cycle from the game server device 200, thereby synthesizing the foreground rendering image 400a and the distant view rendering image 410a having the same processing cycle.

<Switching distributed processing>
Each of the terminal device 100 and the game server device 200 determines an object to be rendered at any time according to a preset rule. Thereby, each of the terminal device 100 and the game server device 200 switches an object to be rendered by distributed processing.

<Functions of game system 1>
FIG. 5 is a block diagram illustrating an example of functional configurations of the terminal device 100 and the game server device 200. The terminal device 100 includes, for example, a terminal-side communication unit 110, a display device 120, a display control unit 130, an operation reception unit 140, a terminal-side action processing unit 150, and a terminal-side storage unit 100b.

  The terminal-side communication unit 110 is a communication interface such as a NIC (Network Interface Card) or a wireless communication module. The display device 120 is a liquid crystal display with a built-in touch panel, for example. The display control unit 130, the operation reception unit 140, and the terminal-side action processing unit 150 are realized, for example, when a processor such as a CPU or a GPU (Graphics Processing Unit) executes a program stored in a program memory. Some or all of these functional units may be realized by hardware such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), or FPGA (Field-Programmable Gate Array). It may be realized by cooperation of software and hardware.

  The display control unit 130 performs a foreground rendering process based on the user operation received by the operation receiving unit 140 and the information received by the terminal-side communication unit 110. The operation reception unit 140 receives an operation on the display device 120 and generates user operation information. The terminal-side action processing unit 150 performs action processing based on the operation information generated by the operation receiving unit 140. The terminal-side action processing unit 150 calculates the status of the object as a result of performing the action process, and updates the status stored in the terminal-side storage unit 100b. The rendering process in the display control unit 130 includes a process for determining an object to be rendered as needed according to a preset rule.

  The game server device 200 includes, for example, a server-side communication unit 210, a game progress control unit 220, an action processing unit 230, a rendering processing unit 240, and a server-side storage unit 200b. The game progress control unit 220, the action processing unit 230, and the rendering processing unit 240 are realized, for example, when a processor such as a CPU or GPU executes a program stored in a program memory. Some or all of these functional units may be realized by hardware such as LSI, ASIC, or FPGA, or may be realized by cooperation of software and hardware. Furthermore, the game server device 200 has some functions of the game progress control unit 220, the action processing unit 230, and the rendering processing unit 240 mounted on another server device, and performs processing while cooperating with the other server device. You may go.

  The server side communication unit 210 is a communication interface such as a NIC or a wireless communication module. The game progress control unit 220 performs a game progress process. The action processing unit 230 performs action processing. The rendering processing unit 240 performs distant view rendering processing. Note that the rendering processing in the rendering processing unit 240 includes processing for determining an object to be rendered at any time according to a preset rule.

<Flow of distributed processing>
FIG. 6 is a flowchart showing the flow of distributed processing in the game system 1. The terminal device 100 and the game server device 200 repeatedly perform the processes described below. First, the terminal device 100 determines whether or not a user operation has been accepted (S100). If the terminal device 100 has not received a user operation, the terminal device 100 ends the processing of this flowchart. When the terminal device 100 receives a user operation, the terminal device 100 performs an action process based on the received operation (S102). Next, the terminal device 100 transmits operation information indicating the received operation and a status as a processing result of the action processing to the game server device 200.

  In response to receiving the operation information and the status from the terminal device 100 (S200), the game server device 200 performs a rendering process for rendering a distant view object (S202). The game server device 200 transmits the distant view rendering image to the terminal device 100 (S204).

  In response to receiving the operation information and status from the terminal device 100 (S200), the game server device 200 performs action processing based on the received operation information in parallel with the processing of S202 and S204 (S206). The game server device 200 determines whether or not the received status is different from the status as a result of performing the action process (S208). If the received status does not differ from the status as a result of performing the action process, the game server device 200 ends the process of this flowchart. If the received status is different from the status as a result of the action processing, the game server device 200 transmits the status as the result of the action processing to the terminal device 100 (S210).

  For example, when a plurality of users are participating in a game, the foreground object (1) operated by the user corresponding to the terminal device 100-1 and the foreground object operated by the user corresponding to the terminal device 100-N (N) may collide with each other in the game. In this case, the game server apparatus 200 determines that the foreground objects have collided in the action process, and performs a predetermined action process for the collision. The predetermined action process is, for example, a process of generating an event that changes the position (status) so that the foreground objects are blown away from the collision position. The game server device 200 transmits the status of the foreground object (1) representing the changed position to the terminal device 100-1, and transmits the status of the foreground object (N) representing the changed position to the terminal device 100-N. Send.

  After S104, the terminal device 100 performs a rendering process for rendering the foreground object (S106). Next, the terminal device 100 performs a synthesis process for synthesizing the foreground rendering image rendered in S106 and the distant view rendering image (S108). The terminal device 100 performs a composition process using the latest distant view rendering image among the distant view rendering images received from the game server device 200. Next, the terminal device 100 displays the content 300 as a result of the composition process on the display device 120 (S110).

  Next, the terminal device 100 determines whether or not the status of the foreground object has been received from the game server device 200 (S112). If the terminal device 100 has not received the status of the foreground object, the terminal device 100 ends the processing of this flowchart. When receiving the status of the foreground object, the terminal device 100 corrects the status of the foreground object by overwriting the status stored in the terminal-side storage unit 100b with the status received from the game server device 200 ( S114).

  According to the game system 1 described above, based on the user's operation, the terminal device 100 that generates the first content in which the object belonging to the first category is rendered, and the instruction received from the terminal device 100, the second A game server device 200 that generates second content in which an object belonging to the category is rendered, and transmits the generated second content to the terminal device 100. The terminal device 100 synthesizes the first content and the second content. The synthesized content 300 can be displayed. According to this game system 1, it is possible to suppress a delay period from the user's operation until the rendering of the content is completed by distributing the processing load for rendering the content.

  That is, according to the game system 1, by rendering an object belonging to the first category by the terminal device 100, the first object is presented rather than rendering and displaying the object belonging to the first category by the game server device 200. The delay time until it can be shortened. In addition, according to the game system 1, the objects belonging to the second category are rendered by the game server device 200, so that the objects belonging to the first and second categories are rendered by the terminal device 100 and displayed first. The delay time until the object is presented can be shortened.

  The game system 1 renders a foreground object by the terminal device 100 by determining an object belonging to the first category as an object belonging to the foreground and determining an object belonging to the second category as an object belonging to the distant view. Can do. Thereby, according to the game system 1, it is possible to shorten the delay time until the foreground object is presented, rather than rendering the foreground object by the game server device 200 and displaying it. For example, when the foreground object is determined to be a character that is moved by the user's operation, the game system 1 can immediately move the character in response to accepting the user's operation.

  In this game system 1, an object belonging to the first category is determined to be an object that is rendered in a short cycle, and an object belonging to the second category is determined to be an object that is rendered in a long cycle, whereby rendering is performed in a short cycle. An object can be rendered by the terminal device 100. Thereby, according to the game system 1, the delay time can be shortened until the object rendered in a short cycle is presented, rather than the object rendered in the short cycle rendered and displayed by the game server device 200. . For example, in the case where a character that is moved by a user's operation is set as an object that is rendered in a short cycle, the game system 1 can immediately move the character in response to receiving the user's operation.

  The game system 1 determines an object belonging to the first category as an object whose status changes in response to an instruction, and determines an object belonging to the second category as an object whose status does not change in response to an instruction. Can be rendered by the terminal device 100. Thereby, according to the game system 1, rather than rendering and displaying an object whose status changes in response to the instruction by the game server apparatus 200, the delay time until the object whose status changes in response to the instruction is presented. Can be shortened.

  According to the game system 1, the first content and the second content are synthesized using the depth information and transparency information generated by the terminal device 100 and the depth information and transparency information generated by the game server device 200. It is possible to appropriately adjust the consistency of depth and transparency between the first content and the second content.

  Furthermore, according to the game system 1, in addition to the instruction based on the user's operation, the first status of the object belonging to the first category calculated based on the instruction is transmitted from the terminal apparatus 100 to the game server apparatus 200, and the game The server device 200 calculates the second status of the object belonging to the first category based on the instruction received from the terminal device 100, and transmits the calculated second status to the terminal device 100. The terminal device 100 When the second status calculated by 200 is different from the first status, the first image data is changed based on the second status. Thereby, according to the game system 1, even if the foreground object is rendered by calculating the status of the foreground object by the terminal device 100, the status of the foreground object rendered due to the influence of other foreground objects is corrected and the foreground object is again displayed. The object can be rendered. As a result, according to the game system 1, it is possible to perform rendering by correcting the status of the foreground object while suppressing the delay time for rendering the foreground object.

  In addition, although the game system 1 mentioned above shall render an image as content, it is not limited to this, You may render an audio | voice.

<Hardware configuration>
FIG. 7 is a diagram illustrating an example of a hardware configuration of the terminal device 100 and the game server device 200. This figure shows an example in which the terminal device 100 is a personal computer or the like. In the terminal device 100, for example, a CPU 101, a RAM 102, a ROM 103, a secondary storage device 104 such as a flash memory, an interface 105 for operation and display, and a wireless communication module 106 are connected to each other by an internal bus or a dedicated communication line. It has been configured.

  The game server device 200 has a configuration in which, for example, a NIC 201, a CPU 202, a RAM 203, a ROM 204, a secondary storage device 205 such as a flash memory or an HDD, and a drive device 206 are connected to each other via an internal bus or a dedicated communication line. Yes. The drive device 206 is loaded with a portable storage medium such as an optical disk. A program stored in a secondary storage device 205 or a portable storage medium attached to the drive device 206 is expanded in the RAM 203 by a DMA controller (not shown) or the like and executed by the CPU 202, whereby the game server device 200 A functional part is realized.

  As mentioned above, although the form for implementing this invention was demonstrated using embodiment, this invention is not limited to such embodiment at all, In the range which does not deviate from the summary of this invention, various deformation | transformation and substitution Can be added.

DESCRIPTION OF SYMBOLS 1 ... Game system, 100 ... Terminal device, 100a ... Game program, 100b ... Terminal side memory | storage part, 110 ... Terminal side communication part, 120 ... Display device, 130 ... Display control part, 140 ... Operation reception part, 150 ... Terminal side Action processing unit 200 ... Game server device 200a ... Game control program 200b ... Server side storage unit 210 ... Server side communication unit 220 ... Game progress control unit 230 ... Action processing unit 240 ... Rendering processing unit 310 ... character object, 321-324 ... background object, 400a ... foreground rendering image, 400b ... foreground depth information, 400c ... foreground transparency information, 410a ... foreground rendering image, 410b ... foreground depth information, 410c ... foreground transparency information, 420 ... composition image

Claims (17)

Based on an instruction based on a user operation, a first status including the position and orientation of a first object belonging to the first category among a plurality of objects is calculated, and the first object is rendered based on the first status A terminal device for generating the first content and transmitting the instruction to the server device ;
Based on the instruction received from the terminal device, the second content obtained by rendering the second object belonging to the second category among the plurality of objects is generated, and the generated second content is transmitted to the terminal device. calculates the second status, including the position and orientation of said first object, the calculated the second status and a said server device to transmit to said terminal device,
The terminal device generates the content by combining the first content and the second content, and when the first status and the second status are different, the terminal device replaces the first status with the first status . Generating the first content in which the first object is rendered based on two statuses;
Virtual reality system. Based on an instruction based on a user operation, a first status including the position and orientation of a first object belonging to the first category among a plurality of objects is calculated, and the first object is rendered based on the first status A terminal device that generates first content and transmits the instruction and the first status to a server device ;
Based on the instruction received from the terminal device, the second content obtained by rendering the second object belonging to the second category among the plurality of objects is generated, and the generated second content is transmitted to the terminal device. the first calculates the second status, including the position and orientation of the object, wherein if the first status and the second status are different, the server device which transmits the calculated the second status to the terminal device And comprising
The terminal device generates the content by combining the first content and the second content, and when receiving the second status from the server device, the terminal device replaces the first status with the second status. Generating the first content in which the first object is rendered based on
Virtual reality system. The server device
Depending on the presence or absence of collision between objects, an action process for calculating the position and orientation of the object is performed, and the second status is calculated in the action process.
The virtual reality providing system according to claim 1 or 2 . The server device
Based on the instructions and the first status received from a plurality of the terminal devices, the second status including the positions and orientations of the plurality of objects corresponding to the plurality of the terminal devices is calculated, and the plurality of the terminals When a plurality of objects corresponding to each of the devices collide, the second status including the postures and positions of the plurality of objects that change due to the collision is calculated.
The virtual reality providing system according to any one of claims 1 to 3 . The objects belonging to the first category include objects belonging to a foreground,
The object belonging to the second category includes an object belonging to a distant view.
The virtual reality providing system according to any one of claims 1 to 4 . The objects belonging to the first category include objects that are rendered in a short cycle among the plurality of objects,
The object belonging to the second category includes an object rendered in a long cycle among the plurality of objects.
The virtual reality providing system according to any one of claims 1 to 4 . The object belonging to the first category includes an object whose status changes with respect to the instruction among the plurality of objects,
The object belonging to the second category includes an object whose status does not change in response to the instruction among the plurality of objects.
The virtual reality providing system according to any one of claims 1 to 4 . Each of the terminal device and the server device determines an object to be rendered based on a preset rule.
The virtual reality providing system according to any one of claims 1 to 7 . The terminal device
Updating the first status information stored in its own storage unit based on the calculated first status,
The server device
If the first status received from the terminal device is different from the second status, the second status information stored in its storage unit is updated and the second status is transmitted to the terminal device. ,
The terminal device
Updating the first status information based on the second status received from the server device, referring to the first status information, determining an object to be rendered based on a preset rule;
The server device
The virtual reality providing system according to any one of claims 1 to 8 , wherein an object to be rendered is determined based on a preset rule with reference to the second status information. The first content and the second content are image content,
The terminal device generates first composition data for assisting composition of the first content and other content,
The server device generates second combining data for assisting the combining of the second content and the first content, and transmits the generated second combining data to the terminal device;
The terminal device synthesizes the first content and the second content based on the first composition data and the second composition data;
The virtual reality providing system according to any one of claims 1 to 9 . The first composition data is information representing a distance from a predetermined viewpoint and a degree of transparency for each pixel included in the first content.
The second composition data is information indicating a distance from the predetermined viewpoint and a degree of transparency for each pixel included in the second content.
The virtual reality providing system according to claim 10 . The terminal device accepts instructions based on user operations,
The terminal device transmits the instruction to a server device;
The terminal device calculates a first status including a position and a posture of a first object belonging to a first category among a plurality of objects, and generates first content obtained by rendering the first object based on the first status And sending the instruction to the server device ,
Based on the instruction received from the terminal device, the server device generates second content obtained by rendering a second object belonging to a second category among the plurality of objects, and the generated second content is the terminal. To the device,
The server apparatus calculates the second status, including the position and orientation of said first object, and sends the calculated the second status to the terminal device,
The terminal device generates the content by combining the first content and the second content;
When the first status is different from the second status, the terminal device generates the first content in which the first object is rendered based on the second status instead of the first status ;
Virtual reality provision method. A reception unit that receives instructions based on user operations;
A computing unit that computes a first status including a position and orientation of a first object belonging to a first category among a plurality of objects based on the instruction received by the receiving unit;
A generating unit configured to generate a first content obtained by rendering the first object based on the first status calculated by the calculating unit ;
The second content to render the second object belonging to the second category of instructions said plurality of based on the object, and the receiving unit for receiving a second status, including the position and orientation of said first object from the server device When,
A combining unit that generates the content by combining the first content generated by the generating unit and the second content received by the receiving unit ;
The generating unit, when the first status and the second status is different, in place of the first status, generating the first content obtained by rendering the first object based on the second status,
A virtual reality providing device. On the computer,
Accept instructions based on user operations,
Based on the received instruction, the first status including the position and orientation of the first object belonging to the first category among the plurality of objects is calculated,
Generating a first content in which the first object is rendered based on the first status ;
Based on the instruction, a second content obtained by rendering a second object belonging to a second category among the plurality of objects is received from a server device,
A second status, including the position and orientation of said first object is received from the server apparatus,
Combining the generated first content and the received second content to generate content;
When the first status is different from the second status, the first content in which the first object is rendered based on the second status is generated instead of the first status .
program. The terminal device accepts instructions based on user operations,
The terminal device transmits the instruction to a server device;
The terminal device calculates a first status including a position and a posture of a first object belonging to a first category among a plurality of objects, and generates first content obtained by rendering the first object based on the first status And sending the instruction and the first status to the server device ,
Based on the instruction received from the terminal device, the server device generates second content obtained by rendering a second object belonging to a second category among the plurality of objects, and the generated second content is the terminal. To the device,
The server apparatus calculates the second status, including the position and orientation of said first object, and transmitting the second status if said first status and said second status is different to the terminal device,
The terminal device generates the content by combining the first content and the second content;
When the terminal device receives the second status from the server device , the terminal device generates the first content in which the first object is rendered based on the second status instead of the first status .
Virtual reality provision method. A reception unit that receives instructions based on user operations;
A computing unit that computes a first status including a position and orientation of a first object belonging to a first category among a plurality of objects based on the instruction received by the receiving unit;
A generating unit configured to generate a first content obtained by rendering the first object based on the first status calculated by the calculating unit ;
Based on the instruction, the second content obtained by rendering the second object belonging to the second category among the plurality of objects is received from the server device, and the second status including the position and orientation of the object belonging to the first category is received. A receiving unit for receiving from the server device when the first status and the second status are different ;
A combining unit that generates the content by combining the first content generated by the generating unit and the second content received by the receiving unit ;
The generation unit, when receiving the second status from the server apparatus, in place of the first status, generating the first content obtained by rendering the first object based on the second status,
A virtual reality providing device. On the computer,
Accept instructions based on user operations,
Based on the received instruction, the first status including the position and orientation of the first object belonging to the first category among the plurality of objects is calculated,
Generating a first content in which the first object is rendered based on the first status ;
Based on the instruction, a second content obtained by rendering a second object belonging to a second category among the plurality of objects is received from a server device,
Wherein is received from the server apparatus when a second status, including the position and orientation of said first object and said first status and said second status is different,
Combining the generated first content and the received second content to generate content;
When the second status is received from the server device, the first content in which the first object is rendered based on the second status is generated instead of the first status .
program.

Images