JP2002197016A - Three-dimensional space data transmission and display system, three-dimensional space data transmitting method, computer-readable recording medium with recorded program for making computer implement three- dimensional space data transmitting method, three- dimensional space data display method, computer- readable recording medium with recorded program making computer implement three-dimensional space display method, three-dimensional space data transmitting and display method, and computer-readable recording medium with recorded program making computer implement three-dimensional space data transmitting and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem of a conventional invention for transmitting three-dimensional space data that the upper limit of the capacity of three-dimensional space data transmitted per unit time can not be varied according to changes of the congestion state of a communication path for transmitting data, changes of the processing load state of a client device displaying a virtual space, variation in the capacity of a memory, and variation in viewpoint moving speed an sight line rotating speed. SOLUTION: In the three-dimensional space data transmission and display system, a transmit data capacity adjustment part 11 varies the upper limit of the capacity of three-dimensional object data transmitted per unit time from a server to a client device according to the changes of the congestion state of the communication line for transmitting the data, the changes of the processing load state of the client device displaying the virtual space and variation in the capacity of the memory, and the variation in the moving speed of a viewpoint and the rotating speed of a sight line. A three-dimensional object extraction part 13 extracts three-dimensional object data in a range which does not exceeds the upper limit of the data capacity set by the transmit data capacity adjustment part 11.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional spatial data transmission / display system for transmitting three-dimensional spatial data, a three-dimensional spatial data transmitting method, a recording medium therefor, a three-dimensional spatial displaying method, and a recording medium therefor. The present invention relates to a dimensional space data transmission / display method and a recording medium thereof.

[0002]

2. Description of the Related Art As a first prior art, FIG.
FIG. 1 is a functional block diagram of a virtual space information creating device disclosed in Japanese Patent Application Laid-Open No. 10-83462. JP-A-10-
The virtual space information creating device disclosed in Japanese Patent No. 83462
In displaying a virtual space as a viewpoint moves in a virtual space in which a large number of three-dimensional graphic objects are arranged, it is an object to efficiently use a band of a semiconductor memory and a communication path. To solve the same problem, create a space where a viewpoint can exist in the virtual space, select a three-dimensional object under the capacity limitation according to the memory and bandwidth limitation for each passage, and create subspace information. In creating, recording, transmitting, and displaying virtual space information, it is intended to solve the problem by handling virtual space information in units of partial space information. The virtual space information creating apparatus creates (1) virtual space information such that objects existing in the vicinity in a virtual space in which a large number of three-dimensional graphic objects are arranged are set as continuously accessible data. To do. (2) Creating virtual space information by adapting the amount of the collected data to the available memory capacity of the display terminal. (3) It is intended to create virtual space information by adapting the data transfer rate when reading the above-mentioned collected data by communication to the throughput of the display terminal or the bandwidth from the information source to the main storage unit. .

[0003] The virtual space information creation device describes
Solution means for achieving the above object will be described. (1) Solution 1 In a virtual space information creating apparatus for creating virtual space information in which a plurality of three-dimensional objects are arranged, a display 1101 for displaying an editing screen in FIG. 11 and an input 1102 for receiving a user operation Object layout means 1103 for arranging a plurality of three-dimensional objects having shape information and texture information in a virtual space using the display means 1101 and the input means 1102;
Using the display means 1101 and the input means 1102, a path setting means 1105 for setting a path connecting to each other to form a crossroad in the virtual space in which the plurality of three-dimensional objects are arranged; A passage-by-passage object set selecting unit 1107 for selecting a three-dimensional object arranged in the vicinity thereof to create an object set; position information indicating a position in a virtual space for each of the passages; Information and
In the virtual space information creating apparatus including a partial space information generating unit 1108 for generating partial space information including information of a passage to be connected and a storage unit for storing the partial space information, the object set selecting unit for each passage 1107
However, a capacity limiting unit 11071 for selecting a three-dimensional object is provided in order of increasing the distance from the passage and not exceeding a predetermined data capacity. The selection of objects is based on the distance from the reference point.However, instead of drawing at a fixed distance as in the conventional example, the capacity to be handled in advance is determined according to the system conditions such as the memory capacity. Then, the object is selected in order from the shortest one to the capacity limit. This is performed by the passage-by-passage object set selecting unit 1107 incorporating the capacity limiting unit 11071. For example, when obtaining an object set based on a passage, the passage-specific object set selection unit 1107 obtains the distance from the center point of the passage to the center point of all objects, and sorts them in ascending order. Objects are selected for each passage in order from the one with the shortest distance so as not to exceed the data capacity limited by the capacity limiting unit 11071.

(2) Solution 2 In the virtual space information creating apparatus shown in FIG. 12, the path-specific object set selecting means 1107 equally divides a communication path from a starting point to an ending point into a plurality of sections by dividing the communication path into fixed intervals. And a band limiting unit 11073 that selects a three-dimensional object within a range that does not exceed a predetermined data capacity in ascending order of distance from the section for each of the sections. A streamer 11074 that combines the object sets of the respective sections in accordance with the arrangement of the sections in the passage. The section is selected as variable in accordance with the density of neighboring objects in the section. In each section of the divided passage, a three-dimensional object is selected in order from a smaller distance from each section within a range not exceeding a data capacity limited in advance according to the bandwidth.

Conventional example 2. As a second prior art, FIG.
3 is a flowchart of a processing procedure of a high-speed display method of three-dimensional spatial data disclosed in Japanese Patent Application Laid-Open No. 05-266213.
The purpose of the high-speed display method is to provide a method of displaying an arbitrary designated portion of a large amount of spatial data over a wide area at a high speed while minimizing deterioration of a generated image. Minimally necessary data is dynamically provided when a viewpoint is given by means of hierarchical simplification that approximates an object with a complicated three-dimensional shape with a specified level of accuracy and spatial data management. Is selected. When a viewpoint is given, dynamic selection of a segmented area required for display and a simplified model thereof is performed, thereby preventing deterioration of a generated three-dimensional image and effectively reducing the number of images to be drawn, thereby achieving high-speed display. It is intended to realize.

The first object of the high-speed display method is to provide a three-dimensional spatial image high-speed display method for displaying a large amount of spatial data at a high speed while maintaining the appearance. (2) A second object is to provide a three-dimensional spatial image high-speed display method for displaying a large amount of spatial data at high speed by optimizing the entire display data amount while minimizing deterioration of a generated image.

In the high-speed display method, a plurality of simplified models are created for each object existing in the three-dimensional space data with different approximation accuracy, hierarchized and managed, and the degree of detail is changed according to the distance from the viewpoint. Is determined, and a simplified model of the approximation accuracy at the level of detail is displayed. It has been suggested that the surface material be hierarchized according to the level of detail. For example, a hierarchical technique is disclosed in which texture mapping is performed at a detail level of 3, a simple pattern is used at a detail level of 2, and only a representative color is used at a detail level of 1. By devising a method of expressing the shape of the three-dimensional object and a method of managing the entire data, when a viewpoint is given, the minimum necessary data is dynamically selected. The basic idea is as follows. First, given original data is the most detailed data, near objects are displayed in more detail, and far objects are displayed more coarsely by simplifying the original data hierarchically according to the distance. The parameters for hierarchical simplification include (a) the number of distance segments (equal to the number of simplification levels), (b) boundary values in distance segments,
(C) There is a value that controls the degree of simplification of the shape. Generally, (a) depends on the size of the data set to be displayed and the memory capacity for holding the data set, and (b) occupies the value of (a) and the statistical properties and data related to the size of the objects in the display data set. Depending on the size of the three-dimensional space, (c) is determined based on the value of (b) and the size determined by the display resolution when the object is displayed on the display screen. This is done automatically by approximating the shape with the specified precision. Specific procedures include (a) creation of hierarchical simplified data and area division management, (b) dynamic data selection using area division management when a viewpoint is given, and (c) display of necessary data. It consists of three. In view of the trade-off between the degree of deterioration of the generated image and the speed of the display speed, it is intended to realize the display of an optimal three-dimensional image and the effective simplification of a three-dimensional object having a complicated shape.
When performing dynamic display control so that the display speed is constant, the assignment of the simplification level of the distance section is changed without adaptively changing the threshold value of the distance. That is, when the display speed is specified to a certain value and the viewpoint is moved, the display data may be slower than the specified value due to a change in the display data (when the display data amount increases). In this case, the next movement is automatically controlled so that level 0 is level 1, level 1 is level 2, and level 2 is omitted, thereby enhancing the degree of simplification as a whole and reducing the amount of display data. suppress. The opposite is true if it gets faster. In this manner, when the viewpoint moves, a simplified model of each object is determined according to the moving speed.

Conventional example 3. As a third prior art, FIG.
1 is a functional block diagram of a virtual space display device disclosed in Japanese Patent Application Laid-Open No. H11-313255. The virtual space display device aims to improve the display speed of a moving object. Generates three types of polygon data with different densities corresponding to three stages of object moving speed-high, medium, and low from the shape information read from the external storage device for the object (car) in the virtual space And keep it. When an object (vehicle) arranged in the virtual space is displayed, if the moving speed of the object (vehicle) is slow, dense polygon data with a high density is rendered and displayed. If the moving speed of the object is medium, polygon data with medium density is rendered and displayed. If the moving speed of the object is high, the polygon data with a small density is rendered and displayed.

An object of the virtual space display device is to provide a virtual space display device capable of improving the display speed of a moving object. Solution means of the virtual space display device for achieving the above object will be described. In the virtual space display device, from a plurality of polygon data having different densities with respect to the shape of the object,
A selection unit 323 for selecting predetermined polygon data according to the speed of the object and a rendering unit 3025 for displaying (rendering) the selected polygon data are provided. When the speed of the object is low, polygon data having a high density is selected. When the speed of the object is high, polygon data having a low density is selected. When the object is moving in the virtual space, the rendering speed is improved by increasing or decreasing the density of the polygon data and increasing or decreasing the polygon data size according to the moving speed of the object. Means for calculating load information when rendering the selected polygon data is further provided, and the selecting means 23 selects polygon data in consideration of the load information. -Increase or decrease the polygon data size according to the rotation speed of the object. In other words, when the rotating object is rotating at high speed, small polygon data with small data size is displayed, and when rotating at low speed, large polygon data with large data size is displayed. By doing so, the rendering speed can be improved and effective rendering can be performed. Considering the moving speed of the viewpoint when walking through the virtual space, the density of the polygon data is changed corresponding to the relative speed of the object with respect to the moving speed of the viewpoint of the operator in the virtual space.

Conventional example 4. As a fourth prior art, FIG.
2 is a flowchart of a video display method of a user participation type system disclosed in Japanese Patent Application Laid-Open No. 9-212679.
The operation will be described. First, the virtual space is divided into partial areas (step 411). Next, the relationship between the distance (inter-region distance) between the partial area where the alter ego is present and the partial area where the alter ego is present and the detail level of the display is determined (step 412). The display details of all users of the virtual space included in the same partial area are the same, and become lower as other alter egos move away from one's alter ego. In step 413, the distance between the other alter ego and the partial area to which the alter ego belongs is calculated. In step 414, the detail level of the display is determined based on the inter-region distance obtained in step 413. In step 415, the alter ego is displayed with the determined detail level. The level of detail here means gaze, facial expression,
It can be interpreted as the variety of expressions created using nonverbal information such as gestures. Therefore, the smaller the degree of detail, the smaller the amount of non-verbal information to be provided for avatar display, and the lower the calculation load for display.

Conventional Example 5 As a fifth prior art, FIG.
3 is a flowchart of a three-dimensional virtual space display method disclosed in Japanese Patent Application Laid-Open No. 10-40423. The distance from the viewpoint of the terminal user in the virtual space to the partner existing in the virtual space is obtained (S501), and a plurality of interpersonal distance zones are set according to the distance from the viewpoint (S502). Corresponding to the person's image of the other person in the distance band, for example, the person image in the interpersonal distance zone close to the viewpoint is detailed enough to understand its expression, and the person image in the interpersonal distance band far from the viewpoint is It is displayed small and coarse (S503). Japanese Patent Application Laid-Open No. 7-288791 also does not show a specific configuration, but describes an apparatus having the same concept.

Conventional Example 6 As a sixth prior art, FIG.
Is a flowchart of a texture-based three-dimensional space display method disclosed in Japanese Patent Application Laid-Open No. 2000-187740, and FIG. 18 is a functional block diagram of a texture-based three-dimensional space display device. In FIG. 17, there is provided a resource field for registering previously extracted texture data, and a high-speed display rendering field for storing selected data in the registered data, and a mechanism for displaying texture data. Calculating the amount of memory required for rendering determined by the number of objects, and comparing the total sum of the amount of memory required for rendering with the capacity of the rendering field for high-speed display. When the rendering field is small, a combination of the segmentation display target area and the object display detail in the area is extracted in the order of the priority of the predetermined QoS control rule, and the rendering is performed based on the priority. Recalculating the required memory amount, and And comparing the capacity of the rendering field for high-speed display with the capacity of the rendering field for high-speed display. A method of displaying a three-dimensional space by writing data into a rendering field for high-speed display based on the above-mentioned method is shown. In FIG. 18, the required memory amount determined by the number of objects in the set area is calculated, and when the calculated required memory amount exceeds the capacity of the rendering field, the priority determined by the display target area and the number of objects in this area is calculated. A three-dimensional spatial display device is described in which the degree of detail or the number of objects in a target area is reduced to fit within a rendering field capacity based on a QoS control rule in which an order is determined. In addition, JP
Japanese Patent Application Publication No. 00-215324 also describes a similar three-dimensional space display device and three-dimensional space display method.

Conventional Example 7 As a seventh related art, FIG.
1 is a functional block diagram of a three-dimensional shape communication system disclosed in JP-A-9-282249. FIG.
5 is a flowchart showing a main operation procedure of the three-dimensional shape generation device. When the three-dimensional shape generation device 710 receives a shape request based on the three-dimensional shape request, the shape detail level determination unit 714 determines the shape detail level from a predetermined value based on the size of the described data, coordinate accuracy, and the like. . Next, the display capability determination unit 715 queries the display capability declaration unit 724 of the mobile terminal, and
Information such as a type of 0, a hardware type used for graphic display, whether a dedicated mechanism for three-dimensional display is provided, and a texture display capability is obtained. Then, the basic display capability of the requesting terminal is determined. Subsequently, the current load state of the requesting terminal is checked by asking the display capability declaration unit 724 of the mobile terminal, and the line state of the communication line is grasped by measuring the question response time. Thus, the current display capability is calculated. Next, based on the display capability determined by the display capability determining unit 715, the shape reducing unit 712 reduces and forms the shape description to a degree of shape detail corresponding to the received display capability. For example, when the display capability determining unit 15 obtains that the texture processing capability is low, the texture image is reduced and converted into small image data. When the user terminal 720 has a low floating-point arithmetic capability, the shape reducing unit 712 reduces the effective precision of the coordinates after the decimal point. When the load is high or when the processing capacity of the polygon is low, the shape of the object is replaced with a simpler shape such as only the outer shape.

Conventional Example 8 As an eighth conventional technique, Japanese Unexamined Patent Application Publication No. 9-237354 discloses that data of a three-dimensional shape is transferred for each element such as a polygon (or voxel). Then, on the receiving side, a three-dimensional shape data sequential transfer display method in which an image is developed and displayed for each received element is disclosed. Three-dimensional shape data composed of a plurality of elements representing the shape is sequentially transmitted for each element,
The elements are displayed sequentially from the received elements.
Therefore, during transmission, a part of the three-dimensional shape to be displayed is displayed, and when the transmission is completed, all of the three-dimensional shape to be displayed is displayed. In addition, the elements are sequentially transmitted and displayed in ascending order of the area attribute among the elements. At the stage during transmission, the three-dimensional shape to be displayed is displayed in a rough state.

Conventional Example 9 As a ninth conventional technique, Japanese Patent Application Laid-Open No. 9-128563 discloses a three-dimensional graphic which can reduce the deterioration of the expression accuracy of three-dimensional graphic data even when the load on the network is deteriorated and the data transfer capability is reduced. A data transfer method is disclosed. In the three-dimensional graphic data transfer method, polygon data of a predetermined number of groups is transmitted from a group having a high importance according to a load state of a communication unit. Polygon data for a predetermined number of groups is transmitted from a group having a high degree of importance according to the load state of the communication means, and sorting (rearranging) is performed based on the degree of importance of each polygon group to determine a transfer order. As the parameters for determining the importance, the area of the polygon group, whether or not a polygon characterizing the three-dimensional graphic data is included, and whether or not the polygon can be seen from the field of view at the time of display output are used. Next, the state of the network is checked, and the number of polygon groups to be transferred is determined and transferred based on the load status of the network. The group information of each group is transferred, and the polygon data is transferred. The group information and the polygon data of each of these groups are repeatedly transferred, and when the transfer is completed for all the polygon groups of the number determined according to the load status of the network, the process ends. in this way,
According to the load status of the communication means, polygon data for a predetermined number of groups is transmitted from a group having a higher importance, so that a polygon group having a higher importance has a higher priority than a polygon group having a lower importance. Irrespective of the degree of importance, it is possible to display and output a three-dimensional figure with higher expression accuracy than in the case of transmitting polygon data.

Conventional Example 10 As a tenth prior art, Japanese Patent Application Laid-Open No. 2000-82155 discloses a technique of changing the degree of detail of a model used for drawing an object according to the distance from the viewpoint of the object and the size of the object.
A dimension drawing system is disclosed. In the three-dimensional drawing system, it is determined whether or not the total drawing data amount exceeds the real-time processable data amount based on the degree of detail of the model used when drawing the object in the visible region. If it is determined that the total drawing data amount is exceeded, the total drawing data amount is changed in accordance with a predetermined rule for gradually decreasing the drawing data amount. In this technique, basic rules for determining the degree of detail are (1) a more detailed model is used for an object closer to the viewpoint, and (2) a more detailed model is used for an object having a larger size.

[0017]

In recent years, with the spread of satellite photography, the display quality has been improved by mapping the satellite photography as a texture to a three-dimensional CG model.
It has become possible to reduce the load of creating dimensional content. In such a situation, a large amount of a three-dimensional CG model in which a photograph such as a satellite photograph is mapped as a texture is used for a narrow-band communication channel or a communication channel in which the available bandwidth changes momentarily due to congestion. Terminals (users) to terminals with small main storage capacity and auxiliary storage capacity
In order to transmit and display such that an operation and utilization that does not cause the user to feel stress in response to the on-demand request of the above, the above-described related art has the following problems.

A technique for changing (re-setting) the total amount of data of an object transmitted from the server to the client in accordance with the communication speed of the communication path which changes every moment, and the same transmission in accordance with the degree of change in the communication speed. No technique is disclosed for determining the degree to which the total data amount is changed and determining the upper limit value of the total transmission amount, or for maintaining the display switching frame rate at a client terminal constant. In addition, the transmission schedule such as the transmission order is adjusted according to the dynamically set priority so that the transmission total does not exceed the upper limit of the total transmission amount of the object data that is changed according to the communication speed that changes every moment. There is no disclosure of a technique for resetting the settings according to the setting change and streaming distribution of the objects in accordance with the transmission schedule.

The present invention has been made to solve such a problem, and has the following objects. A large amount of a three-dimensional CG model obtained by mapping a photograph such as a satellite photograph as a texture is transferred through a narrow-band communication path or a communication path in which the available bandwidth changes momentarily due to congestion, with a small main storage capacity and auxiliary capacity. An object of the present invention is to efficiently transmit data to a terminal having a storage capacity in response to an on-demand request of the terminal (user).

[0020]

According to the present invention, a server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server via a predetermined communication path and transmitted from the server. And a client device for receiving and displaying the obtained three-dimensional object data, the communication path is a communication path whose available transmission speed changes according to the congestion state of the communication path. Yes, the server device monitors the congestion status of the communication path, calculates the degree of change in the available transmission speed that changes according to the congestion status, and transmits the calculated transmission speed to the client device per predetermined unit time. Do 3
A transmission data capacity adjustment unit is provided which sets the upper limit of the data capacity to be selected as the dimensional object data according to the calculated degree of change.

Also, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a predetermined communication path,
A client device for receiving and displaying the three-dimensional object data transmitted from the server device, wherein the client device registers and stores the three-dimensional object data transmitted from the server device. The server device calculates the degree of change in the storage capacity of the memory of the client device,
A transmission data capacity adjustment unit is provided which sets an upper limit value of a data capacity to be selected as three-dimensional object data to be transmitted per predetermined unit time to the client device according to the calculated degree of change. .

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a predetermined communication path,
And a client device for receiving and displaying the three-dimensional object data transmitted from the server device, wherein the client device includes a client device for receiving and displaying the three-dimensional object data. The predetermined processing capacity changes according to the load status of the processing executed by the client device, and the server device monitors the processing load status of the client device, The degree of change in the predetermined processing capacity is calculated, and the upper limit of the data capacity to be selected as three-dimensional object data to be transmitted to the client device per predetermined unit time is set in accordance with the calculated degree of change. A transmission data capacity adjusting unit to be set is provided.

Also, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a predetermined communication path,
In a three-dimensional spatial data transmission and display system including a client device for receiving and displaying the three-dimensional object data transmitted from the server device, the client device indicates information indicating a moving speed of a viewpoint and a rotation speed of a line of sight. And at least one viewpoint gaze information is notified to the server device, and the server device uses the viewpoint gaze information notified from the client device to determine a degree of a viewpoint movement speed change and a gaze direction. The degree of change of the rotation speed and / or the degree of change of the rotational speed is calculated, and the upper limit value of the data capacity to be selected as the three-dimensional object data to be transmitted per predetermined unit time to the client device is calculated. A transmission data capacity adjustment unit that is set according to the degree of change is provided.

Further, the three-dimensional object data according to the present invention has priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. It receives at least one of the viewpoint gaze information of the information indicating the movement speed of the viewpoint and the information indicating the rotation speed of the gaze from the client device, and exists in a new field of view based on the received viewpoint gaze information. A priority setting unit configured to set the priority information for three-dimensional object data and three-dimensional object data already existing in the field of view in accordance with a purpose of displaying three-dimensional space data set in advance; According to the available transmission speed of the path and the priority information of the three-dimensional object data set by the priority setting unit, the three-dimensional object Object data, and sets the client device in the order of the priority set by the priority setting unit so as not to exceed the upper limit of the data capacity set by the transmission data capacity adjustment unit. When the three-dimensional object data to be transmitted is selected and the upper limit value is changed by the transmission data capacity adjustment unit, the degree of detail of the three-dimensional object data set before changing the upper limit value is reset and changed. The three-dimensional object data to be transmitted to the client device in descending order of the priority set by the priority setting unit from the three-dimensional object data having the detailed level information set again so as not to exceed the set upper limit value. A three-dimensional object extracting unit for reselecting the object, and a three-dimensional object selected by the three-dimensional object extracting unit. Than Kutodeta, early in the order of appearance, which is displayed on the client device 3
The transmission schedule of the three-dimensional object data is set so that at least one of the three-dimensional object data and the three-dimensional object data close to the viewpoint position is transmitted to the client device earlier. When the upper limit value is changed by the capacity adjusting unit, the scheduling unit resets the three-dimensional object data selected by the three-dimensional object extracting unit to a transmission schedule to be transmitted to the client device; The three-dimensional object data is transmitted to the client device in accordance with the transmission schedule set by the transmission unit. When the upper limit value is changed by the transmission data capacity adjustment unit, the transmission unit reset by the scheduling unit Switch to schedule, the three-dimensional object data, comprising the streaming transmission unit that transmits to the client device.

The priority setting unit according to the present invention calculates one of a degree of change of a viewpoint and a degree of change of a line of sight using the received viewpoint line of sight information, The above 3 according to the calculated degree of change
The priority information of the three-dimensional object data is reset, and the three-dimensional object extracting unit resets the detail information according to the priority information of the three-dimensional object data reset by the priority setting unit. The three-dimensional objects to be transmitted to the client device in the descending order of the priority set again by the priority setting unit from the three-dimensional object data having the detail level of the reset data so as not to exceed the upper limit value. The feature is to select data again.

Further, the three-dimensional object data according to the present invention has at least polygon data indicating a shape of an object and texture data which is image data to be mapped to the polygon data. When transmitting the three-dimensional object data, the polygon data is transmitted as retransmission guarantee data so as to be surely received by the client device. Even when the texture data is not received by the client device, the 3D virtual data is transmitted. It is transmitted as best-effort guarantee data that can display a space.

Further, the three-dimensional object data according to the present invention has at least polygon data indicating a shape of an object and texture data which is image data to be mapped to the polygon data. The polygon data included in the three-dimensional object data is stored in the same packet and transmitted, and the texture data included in one three-dimensional object data is divided into a plurality of packets and stored and transmitted. It is characterized in that the texture data can be mapped in the client device without retransmission due to a packet loss on the way.

Also, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a predetermined communication path,
The three-dimensional object data transmitted from the server device is received, a three-dimensional virtual space is generated using the received three-dimensional object data, and the generated three-dimensional virtual space is generated at a predetermined frame rate (display). A client device for displaying at a screen switching speed), wherein the client device stores scene configuration information for storing a plurality of three-dimensional object data constituting the three-dimensional virtual space as scene configuration information. A database, a request unit for outputting a request for transmitting three-dimensional object data to the server device, and receiving the three-dimensional object data transmitted from the server device, and transmitting the received three-dimensional object data to a three-dimensional virtual space. A receiving unit for requesting additional processing, and a three-dimensional object from the receiving unit. Receiving a request for additional processing for adding object data to the three-dimensional virtual space, and adding a scene configuration management unit for adding the three-dimensional object data to the scene configuration information database as the scene configuration information; A display management unit that indicates the degree of detail of the dimensional object data; and a three-dimensional virtual space that can be viewed from the viewpoint based on the scene configuration information stored in the scene configuration information database according to the level of detail specified by the display management unit. The rendering unit that renders at the predetermined frame rate, the requesting unit, the receiving unit, the scene configuration management unit, the display management unit, and a processing status of the rendering unit are monitored. Will keep the rendering by the above specified frame rate. To, with the allocation of processing time to each unit, characterized in that a task adjustment unit for adjusting the respective units of the processing time.

Further, the task adjusting unit according to the present invention, when the processing time by the receiving unit exceeds the processing time allocated to the receiving unit, so that the predetermined designated frame rate cannot be maintained, The processing time is reallocated to the receiving unit, a receiving rate at which the processing of the receiving unit is completed within the reallocated processing time is determined, and the three-dimensional object data is transmitted at the determined receiving rate. It is characterized by requesting the server device to change the transmission rate.

Further, the task adjusting unit according to the present invention cannot maintain the specified frame rate because the processing time of the rendering unit exceeds the processing time allocated to the rendering unit. When the three-dimensional object data to be added to the scene configuration information database by the scene configuration management unit includes three-dimensional object data that is not currently displayed, at least a part of the three-dimensional object data that is currently not displayed is displayed. It is characterized by temporarily suspending addition of the three-dimensional object data to the scene configuration information database and instructing the scene configuration management unit to reduce the processing time.

Further, the task adjusting section according to the present invention, when the processing time by the rendering section exceeds the processing time allocated to the rendering section and the predetermined designated frame rate cannot be maintained, Display on the client device to the display management unit 3
Instructing to reset the degree of detail of the three-dimensional object data, shortening the processing time of the rendering unit, and requesting the server device to change the transmission rate of the three-dimensional object data. I do.

Further, the scene configuration management unit according to the present invention, based on the processing time allocated to the scene configuration management unit by the task adjustment unit and the processing capability of the client device, sets the scene configuration per predetermined unit interval. The upper limit of the data capacity of the three-dimensional object data to be added to the information database is determined, and when the processing time of the scene configuration management unit is reallocated by the task adjustment unit, the data is added per the predetermined unit interval. The additional upper limit value of the data capacity of the three-dimensional object data is reset based on the processing time reassigned to the scene configuration management unit and the processing capability of the client device.

Further, at least one of the display management unit and the task adjustment unit according to the present invention is provided with at least one of a speed upper limit of a viewpoint moving speed and a line of sight rotation speed. The above-mentioned predetermined designated frame rate is adjusted by adjusting and setting the speed upper limit value.

Further, the display management unit according to the present invention comprises:
By adjusting and setting at least one of the upper speed limit of the viewpoint moving speed and the upper speed limit of the line-of-sight rotation speed, the task adjusting unit receives the speed from the server device. The instruction is to adjust the reception rate of the three-dimensional object data to be performed.

[0035] The scene configuration management unit according to the present invention is configured such that, when the processing of adding the three-dimensional object data to the scene configuration information database exceeds the processing time allocated by the task adjustment unit, the task adjustment unit. In response to this, at least one of adjusting the data capacity of the three-dimensional object data transmitted per predetermined unit time of the server device and increasing the processing time allocation of the scene configuration management unit is performed. Is instructed.

Further, the display management unit according to the present invention comprises:
The number of three-dimensional object data arriving at the client device per predetermined unit time due to a change in the congestion state of the communication channel when the rendering processing by the rendering unit exceeds the processing time allocated by the task adjusting unit. The display quality control for adjusting the degree of detail of the three-dimensional object data is performed so as to reduce the number of the three-dimensional object data having a high degree of detail in at least one of the cases where the number of the three-dimensional object data decreases. .

[0037] The receiving unit according to the present invention may be configured such that the reception processing of the three-dimensional object data exceeding the processing time allocated to the receiving unit by the task adjusting unit occurs more than a specified number of times during a predetermined time. Then, the task adjusting unit is instructed to increase the processing time of the receiving unit.

The receiving section according to the present invention, after the processing time of the receiving section is reassigned by the task adjusting section, the processing time reassigned to the receiving section by the task adjusting section. If the reception processing of the exceeding three-dimensional object data occurs more than a specified number of times during a certain period of time, if it is determined that the communication speed of the communication path is lower than the assumed communication speed, the request unit And instructs the server device to reduce the transmission rate. If it is determined that the processing time has been exceeded because the data size of the received three-dimensional object data is large, the request unit Is directed to subdivide the three-dimensional object data transmitted to the server device.

The task adjusting unit according to the present invention includes the requesting unit, the receiving unit, the scene configuration managing unit,
When the processing performed by at least one of the display management unit and the rendering unit exceeds the processing time allocated by the task adjustment unit, the processing time of each unit is re-allocated, and the processing time re-allocated. If an adjustment failure that causes more than
If the non-adjustment is determined to be temporary, the predetermined instructed frame rate is temporarily changed,
When it is determined that the adjustment failure is prolonged, the detailed information of the three-dimensional object data transmitted by the server device, the number of three-dimensional object data transmitted by the server device, and It is characterized by giving an instruction to change at least one of the transmission rate of the three-dimensional object data transmitted by the server device.

Further, the client device according to the present invention includes a scene configuration information database storing scene configuration information constituting a three-dimensional virtual space generated using the three-dimensional object data; A request unit for outputting a request for transmitting object data,
A receiving unit that receives the three-dimensional object data transmitted from the streaming transmitting unit of the server device and requests an additional process of adding the received three-dimensional object data to the three-dimensional virtual space; and a three-dimensional object from the receiving unit. A scene configuration management unit that receives a request for an additional process of adding data to a three-dimensional virtual space and adds the three-dimensional object data to the scene configuration information database as the scene configuration information; A display management unit that indicates the level of detail of the object data; and a three-dimensional virtual space that can be viewed from a viewpoint is determined based on the scene configuration information stored in the scene configuration information database in accordance with the level of detail specified by the display management unit. A rendering unit that renders at a predetermined frame rate; The requesting unit, the receiving unit, the scene configuration managing unit, the display managing unit, and the processing status of the rendering unit are monitored, and the rendering process by the rendering unit is performed by the predetermined designated frame. A task adjustment unit is provided for allocating a processing time to each unit so as to maintain the rate, and for adjusting the processing time of each unit.

Further, the task adjustment unit of the client device according to the present invention is executed by the request unit, the reception unit, the scene configuration management unit, the display management unit, and the rendering unit of the client device. The processing time required for a series of processing is monitored for a specified period of time, and an average value of the processing time required for the series of processing is calculated using the monitored result, and the calculated average value is designated as a predetermined value. Requesting the object extraction unit of the server device to adjust the level of detail of an object to be transmitted in order to maintain the frame rate set in the server device, and the object extraction unit of the server device And changing the detail level information of the three-dimensional object data to be transmitted in response to a request from the task adjustment unit.

Further, the task adjusting unit of the client device according to the present invention is executed by the requesting unit, the receiving unit, the scene configuration managing unit, the display managing unit, and the rendering unit of the client device. The processing time required for a series of processing is monitored for a specified period of time, and an average value of the processing time required for the series of processing is calculated using the monitored result, and the calculated average value is designated as a predetermined value. In order to maintain the specified frame rate, the transmission data capacity adjustment unit of the server device requests the transmission data capacity adjustment unit to display the three-dimensional virtual space existing in the three-dimensional virtual space predicted to be displayed on the client device within the predetermined fixed time. From the object data, the data capacity of the data to be selected as the three-dimensional object data to be transmitted per predetermined unit time to the client device. A request to adjust a limit value, wherein the transmission data capacity adjustment unit of the server device changes the setting of the upper limit value in response to a request from the task adjustment unit of the client device. .

The task adjusting unit of the client device according to the present invention adjusts the predetermined designated frame rate to transmit the three-dimensional object to the object extracting unit of the server device. The frequency at which at least one of requesting to adjust the data detail level information and requesting the transmission data capacity adjusting unit of the server device to adjust the upper limit is determined. It is characterized by reduction.

Further, the server device according to the present invention includes:
The processing time of a series of processing executed by the request unit, the receiving unit, the scene configuration management unit, the display management unit, the rendering unit, and the task adjustment unit of the client device, and the transmission of the server device The total of the processing time of a series of processing executed by the data capacity adjusting unit, the priority setting unit, the three-dimensional object extracting unit, the scheduling unit, and the streaming transmitting unit is calculated by the predetermined frame rate. The detail information of the three-dimensional object data to be transmitted is changed in accordance with a change in at least one of the moving speed of the viewpoint and the rotational speed of the line of sight in order to suppress the display screen within the switching interval time. A frame rate maintenance unit that performs the operation.

Further, the frame rate maintenance / management unit according to the present invention includes the request unit, the reception unit, the scene configuration management unit, the display management unit, the rendering unit, and the task adjustment unit of the client device. A processing time of a series of processing to be executed, and a series of processing executed by the transmission data capacity adjusting unit, the priority setting unit, the three-dimensional object extracting unit, the scheduling unit, and the streaming transmitting unit of the server device. In order to suppress the total of the processing time and the processing time within the switching interval time of the display screen realizing the predetermined designated frame rate, the transmission is performed according to the available communication speed that changes depending on the congestion state of the communication path. It is characterized in that the detail level information of the three-dimensional object data to be changed is changed.

A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path, and receives three-dimensional object data transmitted from the server device. Transmitting the three-dimensional object data from the server device to the client device in a three-dimensional spatial data transmission and display system including
In the three-dimensional space data transmission method, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail level information indicating a data detail level. Calculating the available average communication speed of the communication path per predetermined time, monitoring the change in the available communication speed of the communication path, and monitoring the change when the change is detected. Calculating a degree of change in the communication speed based on the determined communication speed and the calculated average communication speed, and a data capacity of three-dimensional object data transmitted from the server device to the client device per predetermined unit time An upper limit value resetting step of setting the upper limit value again according to the degree of change of the communication speed calculated in the calculation step, Before the upper limit value is set again in the upper limit value resetting step, a predetermined amount of three-dimensional object data is set as untransmitted data from the scheduled three-dimensional object data transmitted from the server device to the client device. In addition, the transmission schedule discarding step of discarding the transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data, and viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device are input and input. Based on the viewpoint information, a spatial region entering the field of view by moving the viewpoint for a predetermined period of time is predicted, and the three-dimensional space data included in the predicted spatial region is set according to the purpose of displaying the predetermined three-dimensional spatial data. A priority setting step for setting the above priority information for the dimension object data And data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data from the client device. The details of the three-dimensional object data according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. The three-dimensional object data transmitted from the server device to the client device is determined in order from the higher priority three-dimensional object data to the upper limit value reset in the upper limit value resetting step. A selection step of selecting and displayed on the client device At least one of the three-dimensional object data having the earliest appearance order, the three-dimensional object data close to the viewpoint position, and the three-dimensional object data close to the line of sight.
In order to transmit the dimensional object data to the client device earlier,
A transmission schedule setting step of setting a transmission schedule for transmitting the dimensional object data to the client device; and a transmission schedule setting step of setting the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step in the transmission schedule setting step. Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule.

Also, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, and three-dimensional object data connected to the server device via a communication path and transmitted from the server device A three-dimensional spatial data transmission and display system for transmitting and receiving the three-dimensional object data from the server device to the client device. Has priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of data, and the client device registers and stores the three-dimensional object data transmitted from the server device. The three-dimensional spatial data transmission method includes a memory having a variable capacity. The storage capacity information indicating the storage capacity of the memory is input at a predetermined timing from the client device, and the storage capacity of the memory is stored using the storage capacity information input at the predetermined timing and the storage capacity information input immediately before. A calculating step of calculating a degree of change in capacity;
The upper limit of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time is set again according to the degree of change in the storage capacity of the memory calculated in the calculation step. An upper limit value resetting step, and a predetermined amount of three-dimensional data from three-dimensional object data scheduled to be transmitted from the server device to the client device before the upper limit value is set again in the upper limit value resetting step. A transmission schedule discarding step of discarding the transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data while leaving the dimensional object data as untransmitted data, and a viewpoint indicating the viewpoint and the moving speed of the viewpoint from the client device. Enter the information and enter the information based on the input viewpoint information. Of the three-dimensional object data included in the predicted spatial region according to the purpose of displaying the three-dimensional spatial data set in advance by predicting the spatial region entering the field of view due to the movement of the viewpoint for a certain period of time. A priority setting step of setting the priority information; and a memory for registering and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. Memory capacity information indicating the storage capacity is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, the memory capacity information, , The detail level of the three-dimensional object data is determined, and the priority level is determined. A selection step of selecting three-dimensional object data to be transmitted from the server device to the client device up to the upper limit value reset in the upper limit value reset step in order from the three-dimensional object data; At least one of the three-dimensional object data displayed in the order of appearance, the three-dimensional object data close to the position of the viewpoint, and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step. At the end of the module, transmitting the three-dimensional object data to the client device according to the merged transmission schedule, wherein the transmission schedule set in the transmission schedule setting step is merged. Features.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, and three-dimensional object data connected to the server device via a communication path and transmitted from the server device A three-dimensional spatial data transmission and display system for transmitting and receiving the three-dimensional object data from the server device to the client device. Has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail level of data, and the client device has a predetermined processing capability of receiving and displaying the three-dimensional object data. And the predetermined processing capability depends on the processing load status of the client device. In the three-dimensional spatial data transmission method, the load information indicating the load status of the processing is input from the client device at a predetermined timing, and the load information input at the predetermined timing is input immediately before the load information. A calculating step of calculating the degree of change in the load status of the processing using the load information; and an upper limit of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time The upper limit value resetting step of setting the value again according to the degree of change in the load situation of the process calculated in the calculating step, and the step of setting the upper limit value of the data capacity by the upper limit resetting step Scheduling of transmission from the server device to the client device was performed 3
A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data as untransmitted data from the three-dimensional object data and discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data; And the viewpoint information indicating the moving speed of the viewpoint, and predicts a spatial region entering the field of view by moving the viewpoint for a predetermined fixed time based on the inputted viewpoint information, and sets three-dimensional spatial data set in advance. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area according to the purpose of displaying the data, and data indicating the data processing capability of the client device from the client device. Processing capability information and rendering capability information indicating the rendering processing capability; Memory capacity information indicating the storage capacity of the memory for registering and storing the dimensional object data is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, and The detail level of the three-dimensional object data is determined according to the rendering capability information and the memory capacity information, and the three-dimensional object data having the higher priority is reset in the upper limit resetting step in order from the higher priority. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device up to an upper limit value; Close to object data and line of sight 3
A transmission schedule for setting a transmission schedule for transmitting the three-dimensional object data selected in the selecting step to the client device so that at least one of the three-dimensional object data and the three-dimensional object data is transmitted to the client device as soon as possible. The setting step and the transmission schedule set in the transmission schedule setting step are merged with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. Transmitting the dimensional object data to the client device.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, and three-dimensional object data connected to the server device via a communication path and transmitted from the server device And a client device for receiving and displaying the three-dimensional object data in the three-dimensional spatial data transmission method for transmitting the three-dimensional object data from the server device to the client device. Has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of data, and the client device has information indicating a moving speed of a viewpoint and information indicating a rotating speed of a line of sight. At least one of the viewpoint line-of-sight information is notified to the server device. The original space data transmission method, the viewpoint gaze information is input from the client device at a predetermined timing, and using the viewpoint gaze information input at the predetermined timing and the viewpoint gaze information input immediately before, the viewpoint gaze is input. A calculating step of calculating a degree of change in information;
The upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time is set again according to the degree of change of the viewpoint visual line information calculated in the calculation step. An upper limit value resetting step and a predetermined amount of three-dimensional object data from the scheduled three-dimensional object data transmitted from the server device to the client device before the upper limit value is set again in the upper limit value resetting step. A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data while leaving the object data as untransmitted data, and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device. And enter a predetermined value based on the input viewpoint information. To predict the spatial region coming into view by the movement of a constant time viewpoint, depending on the purpose of displaying a three-dimensional space data set in advance, with respect to the three-dimensional object data included in the spatial domain as described above prediction,
A priority setting step of setting the priority information; and a memory for registering and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. Memory capacity information indicating the capacity is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, the memory capacity information, In accordance with the above, the detail level of the three-dimensional object data is determined, and the server apparatus determines in order from the higher priority three-dimensional object data up to the upper limit value reset by the upper limit value resetting step. Selection for selecting three-dimensional object data to be transmitted to the client device And at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so that the three-dimensional object data selected in the selection step is transmitted earlier to the client device; At the end of the transmission schedule of the transmission data, the transmission schedule set in the transmission schedule setting step is merged,
Transmitting the three-dimensional object data to the client device according to the merged transmission schedule.

In the priority setting step according to the present invention, the degree of change of one of a viewpoint change and a line of sight change is calculated using the received viewpoint sight information, The priority information of the three-dimensional object data is reset according to the calculated degree of change, and the selecting step includes the detailed level information according to the priority information of the three-dimensional object data reset by the priority setting step. So that the priority level reset by the priority setting unit from the three-dimensional object data having the reset detailed information is set so as not to exceed the upper limit of the data capacity. The three-dimensional object data to be transmitted to the client device is sequentially selected again, and the transmission schedule setting step is performed by the selection step Characterized in that to reset the-option sends schedule of the three-dimensional object data is re.

A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path, and receives three-dimensional object data transmitted from the server device. Transmitting the three-dimensional object data from the server device to the client device in a three-dimensional spatial data transmission and display system including
In a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional space data transmission method, the three-dimensional object data is
It has priority information indicating the priority to be transmitted to the client device and detail information indicating the detail of the data.
A computer-readable recording medium that stores a program for causing a computer to execute the three-dimensional space data transmission method calculates an available average communication speed of the communication path per a predetermined time and uses the communication path. Calculating a change in the communication speed based on the monitored communication speed and the calculated average communication speed; and The upper limit of the data capacity of the three-dimensional object data transmitted from the server device to the client device per unit time is set again according to the degree of change in the communication speed calculated in the calculation step. Before setting the upper limit again by the setting step and the upper limit resetting step, From the three-dimensional object data scheduled to be transmitted to the client device, a fixed amount of three-dimensional object data is left as untransmitted data, and the transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data is discarded. A transmission schedule discarding step, and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the three-dimensional space data set in advance, A data process indicating the data processing capability of the client device from the client device; Input of the capability information, the rendering capability information indicating the rendering processing capability, and the memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data, and the priority information set in the priority setting step and the communication path The detailed level of the three-dimensional object data is determined in accordance with the available communication speed, the processing capability information, the rendering capability information, and the memory capacity information. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device up to the upper limit value reset by the upper limit value resetting step; and an earlier appearance order displayed on the client device. 3D object data and 3D object data close to the viewpoint position The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. Merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step, Transmitting the three-dimensional object data to the client device in accordance with the transmission schedule set forth above. Computer readable recording medium recording a ram.

A server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, the three-dimensional object data being connected to the server via a communication path and transmitted from the server. And a client device for receiving and displaying the three-dimensional object data and displaying the three-dimensional object data from the server device to the client device. In a computer-readable recording medium on which a program is recorded, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. , A three-dimensional object transmitted from the server device A computer-readable recording medium including a memory having a variable storage capacity for registering and storing data, and recording a program for causing a computer to execute the three-dimensional spatial data transmission method, uses a storage capacity of the memory from the client device. Calculating the storage capacity information indicated at a predetermined timing, and calculating the degree of change in the storage capacity of the memory using the storage capacity information input at the predetermined timing and the storage capacity information input immediately before Transmitted from the server device to the client device per predetermined unit time.
The upper limit value of the data capacity of the dimensional object data is set again according to the degree of change in the storage capacity of the memory calculated in the calculation step, and the upper limit value is set in the upper limit value reset step and the upper limit value reset step. From the three-dimensional object data scheduled to be transmitted from the server device to the client device before being set again, a certain amount of three-dimensional object data is left as untransmitted data, and other than the certain amount of untransmitted data. A transmission schedule discarding step of discarding the transmission schedule of the three-dimensional object data, and viewpoint information indicating the viewpoint and the moving speed of the viewpoint are input from the client device, and the viewpoint for a predetermined time is determined based on the input viewpoint information. Predicts the spatial area that will come into view due to the movement of A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with the purpose of displaying the three-dimensional space data obtained from the client device; Data processing capability information indicating the processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input, and the priority set in the priority setting step is set. The degree of detail of the three-dimensional object data is determined according to the degree information, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. It is reset in the upper limit reset step in order from the three-dimensional object data. Up to the upper limit value,
A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device;
At least one of the three-dimensional object data, the three-dimensional object data close to the viewpoint and the three-dimensional object data close to the line of sight, is selected by the selection step so as to be transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule for transmitting the obtained three-dimensional object data to the client device; and a transmission schedule setting step at the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. And transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule. .

A server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, the three-dimensional object data being connected to the server via a communication path and transmitted from the server. And a client device for receiving and displaying the three-dimensional object data and displaying the three-dimensional object data from the server device to the client device. In a computer-readable recording medium on which a program is recorded, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. Receives and displays the three-dimensional object data It has a predetermined processing capability, and the predetermined processing capability changes according to a processing load situation in the client device, and is a computer-readable program storing a program for causing a computer to execute the three-dimensional spatial data transmission method. The recording medium inputs load information indicating the load status of the processing from the client device at a predetermined timing, and uses the load information input at the predetermined timing and the load information input immediately before to perform the processing of the processing. A calculating step of calculating the degree of change in the load situation; and a process of calculating the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time in the calculating step The upper limit value resetting step to set again according to the degree of change in the load condition of Before the upper limit of the data capacity is set again by the value resetting step, a predetermined amount of three-dimensional object data is set as untransmitted data from the three-dimensional object data scheduled to be transmitted from the server device to the client device. Leaving a transmission schedule discarding step of discarding the transmission schedule of the three-dimensional object data other than the certain amount of untransmitted data, and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device;
Based on the input viewpoint information, a space region that enters the field of view by moving the viewpoint for a predetermined period of time is predicted, and included in the predicted space region according to the purpose of displaying predetermined three-dimensional space data. Priority setting step of setting the priority information for the three-dimensional object data to be processed; data processing capability information indicating the data processing capability of the client device; rendering capability information indicating the rendering processing capability; Memory capacity information indicating the storage capacity of a memory for registering and storing object data is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, and the rendering According to the capability information and the memory capacity information, the details of the three-dimensional object data are described. 3D object data transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. And selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so as to transmit the three-dimensional object data to the client device earlier, and discarding the transmission schedule in the transmission schedule discarding step I At the end of the transmission schedule of the unsent data, the transmission schedule set in the transmission schedule setting step is merged, and the three-dimensional object data is transmitted to the client device according to the merged transmission schedule. And a transmitting step.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, and three-dimensional object data connected to the server device via a communication path and transmitted from the server device And a client device for receiving and displaying the three-dimensional object data and displaying the three-dimensional object data from the server device to the client device. In a computer-readable recording medium on which a program is recorded, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of data,
The client device notifies the server device of at least one of viewpoint visual line information of information indicating a moving speed of a viewpoint and information indicating a rotational speed of a line of sight, and transmits the three-dimensional space data transmitting method to a computer. The computer-readable recording medium on which the program to be executed is recorded, the viewpoint line-of-sight information input at a predetermined timing from the client device, and the viewpoint line-of-sight information input at the predetermined timing and the viewpoint line-of-sight input immediately before. Calculating the degree of change in the viewpoint line-of-sight information using the information, and transmitting the information from the server device to the client device per predetermined unit time.
The upper limit value of the data capacity of the dimensional object data is set again according to the degree of change in the viewpoint visual line information calculated in the calculation step, and the upper limit value is set again by the upper limit value resetting step. From the three-dimensional object data scheduled to be transmitted from the server device to the client device before the setting, a certain amount of three-dimensional object data is left as untransmitted data, and other than the certain amount of untransmitted data. A transmission schedule discarding step of discarding a transmission schedule of the three-dimensional object data; and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device, and a viewpoint of a predetermined fixed time is input based on the input viewpoint information. Predict the spatial area that comes into view due to movement,
A priority setting step of setting the priority information for the three-dimensional object data included in the predicted space area according to a purpose of displaying the predetermined three-dimensional space data; Data processing capability information indicating the data processing capability of the device, rendering capability information indicating the rendering processing capability, and 3
Memory capacity information indicating the storage capacity of the memory for registering and storing the dimensional object data is input, and the priority information set in the priority setting step, the available communication speed of the communication path, and the processing capacity information The detail level of the three-dimensional object data is determined according to the rendering capability information and the memory capacity information, and the three-dimensional object data is reset in the upper limit value reset step in order from the higher priority three-dimensional object data. A selection step of selecting three-dimensional object data to be transmitted from the server device to the client device up to the upper limit value;
At least one of the three-dimensional object data, the three-dimensional object data close to the viewpoint and the three-dimensional object data close to the line of sight, is selected by the selection step so as to be transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule for transmitting the obtained three-dimensional object data to the client device; and a transmission schedule setting step at the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. And transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule. .

Also, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a predetermined communication path,
The three-dimensional object data transmitted from the server device is received, a three-dimensional virtual space is generated using the received three-dimensional object data, and the generated three-dimensional virtual space is generated at a predetermined frame rate (display). In the three-dimensional spatial data transmission method of the three-dimensional spatial data transmission and display system including the client device for displaying at the screen switching speed), the client device configures the three-dimensional virtual space. A request step of outputting a distribution request of the three-dimensional object data to the server device, comprising a scene configuration information database storing a plurality of three-dimensional object data as scene configuration information; Received, the tertiary of the received 3D object data A receiving step for requesting an additional process to the virtual space, and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information in the scene A scene configuration management step to be added to the configuration information database, a display management step to specify the degree of detail of the three-dimensional object data to be displayed on the client device, and a viewpoint based on the scene configuration information stored in the scene configuration information database. A rendering step of rendering a three-dimensional space scene viewed from the camera at the predetermined frame rate in accordance with the level of detail specified by the display management step; the requesting step; the receiving step; the scene configuration management step; Management steps and While monitoring the processing status with the rendering step, the processing time is allocated to each unit so that the processing time for performing the rendering in the rendering step is maintained at the predetermined frame rate. A task adjusting unit for adjusting the processing time.

The task adjusting step according to the present invention is characterized in that when the processing time in the receiving step exceeds the processing time allocated to the receiving step, the predetermined frame rate cannot be maintained. The processing time is reassigned to the receiving step, a receiving rate at which the processing of the receiving step is completed within the reassigned processing time is determined, and the three-dimensional object data is transmitted at the determined receiving rate. , Requesting the server device to change the transmission rate.

In the task adjusting step according to the present invention, the processing time in the rendering step is as follows:
When the predetermined designated frame rate cannot be maintained because the processing time allocated to the rendering step is exceeded, the detail level of the three-dimensional object data displayed on the client device is set for the display management step. The processing time of the rendering step is shortened, and a request is made to the server apparatus to change the transmission rate of the three-dimensional object data.

Further, the task adjusting step according to the present invention includes a processing time required for a series of processing executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step. It is possible to monitor for a specified period of time, calculate an average value of the processing time required for the series of processes using the monitored result, and maintain the calculated average value at a predetermined specified frame rate. The requesting step, the receiving step, the scene configuration managing step,
The processing time required for each processing executed by the display management step and the rendering step is adjusted.

A server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, the three-dimensional object data being connected to the server via a predetermined communication path and transmitted from the server. Is received, and 3D is received using the received 3D object data.
A client device that generates a three-dimensional virtual space and displays the generated three-dimensional virtual space at a predetermined designated frame rate.
In a computer-readable storage medium storing a program for causing a computer to execute the three-dimensional spatial data display method, the client device may include the three-dimensional space data display method.
A computer-readable recording medium including a scene configuration information database for storing a plurality of three-dimensional object data constituting a three-dimensional virtual space as scene configuration information, and recording a program for causing a computer to execute the three-dimensional space data display method is provided. A requesting step of outputting a distribution request for three-dimensional object data to the server device, and a process of receiving the three-dimensional object data transmitted from the server device and adding the received three-dimensional object data to the three-dimensional virtual space And a request for additional processing for adding three-dimensional object data to the three-dimensional virtual space from the receiving step, and adding the three-dimensional object data as the scene configuration information to the scene configuration information database. Scene configuration management And flop, based on the client display management step for instructing details of the three-dimensional object data display device, the scene configuration information stored in the scene configuration information database, 3 viewed from a viewpoint
A rendering step of rendering the dimensional space scene at the predetermined frame rate according to the level of detail indicated by the display management step; the requesting step; the receiving step; the scene configuration management step; and the display management step. Monitoring the processing status of the rendering step and allocating a processing time to each unit so as to maintain the processing time for rendering in the rendering step at the predetermined designated frame rate; And a task adjusting unit for adjusting the processing time.

The task adjusting step according to the present invention is characterized in that when the processing time in the receiving step exceeds the processing time allocated to the receiving step, the predetermined frame rate cannot be maintained. The processing time is reassigned to the receiving step, a receiving rate at which the processing of the receiving step is completed within the reassigned processing time is determined, and the three-dimensional object data is transmitted at the determined receiving rate. , Requesting the server device to change the transmission rate.

In the task adjusting step according to the present invention, the processing time of the rendering step is as follows:
When the predetermined designated frame rate cannot be maintained because the processing time allocated to the rendering step is exceeded, the detail level of the three-dimensional object data displayed on the client device is set for the display management step. The processing time of the rendering step is shortened, and a request is made to the server apparatus to change the transmission rate of the three-dimensional object data.

The task adjusting step according to the present invention includes a processing time required for a series of processing executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step. It is possible to monitor for a specified period of time, calculate an average value of the processing time required for the series of processes using the monitored result, and maintain the calculated average value at a predetermined specified frame rate. The requesting step, the receiving step, the scene configuration managing step,
The processing time required for each processing executed by the display management step and the rendering step is adjusted.

A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, the three-dimensional object data connected to the server device via a communication path, and transmitted from the server device And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In the method of transmitting and displaying three-dimensional spatial data received and displayed by a client device, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The client device uses the three-dimensional object data. A scene configuration information database that stores scene configuration information that configures the generated three-dimensional virtual space; the three-dimensional virtual space is displayed at a predetermined designated frame rate; Calculating the available average communication speed of the communication path per predetermined time, monitoring the change in the available communication speed of the communication path, and monitoring the change when the change is monitored. Calculating a degree of change in the communication speed based on the determined communication speed and the calculated average communication speed, and a data capacity of three-dimensional object data transmitted from the server device to the client device per predetermined unit time Is set again according to the degree of change in the communication speed calculated in the calculation step. A predetermined amount of three-dimensional object data from the three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit value again in the upper limit value resetting step. Leave as untransmitted data and leave 3
A transmission schedule discarding step of discarding the transmission schedule of the dimensional object data, and viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and moving the viewpoint for a predetermined fixed time based on the input viewpoint information. And sets the priority information for the three-dimensional object data included in the predicted space area according to the purpose of displaying the predetermined three-dimensional space data. Priority setting step, data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. And set it in the priority setting step. Determining the level of detail of the three-dimensional object data according to the priority information, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information; Selecting the three-dimensional object data to be transmitted from the server device to the client device in order from the highest three-dimensional object data to the upper limit value reset by the upper limit value resetting step; At least one of the three-dimensional object data displayed in the order of appearance, the three-dimensional object data close to the position of the viewpoint, and the three-dimensional object data close to the line of sight is transmitted to the client device earlier. So that the three-dimensional A transmission schedule setting step of setting a transmission schedule for transmitting object data to the client device; and a transmission schedule setting step of setting the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule, and outputting a distribution request of the three-dimensional object data to the server device. Receiving the three-dimensional object data transmitted from the server device, and requesting the received three-dimensional object data to be added to the three-dimensional virtual space; and Receiving a request for an additional process of adding three-dimensional object data to the three-dimensional virtual space, and adding the three-dimensional object data as the scene configuration information to the scene configuration information database; and displaying the three-dimensional object data on the client device. A display management step of instructing the degree of detail of the three-dimensional object data to be performed, and the three-dimensional virtual space seen from the viewpoint based on the scene configuration information stored in the scene configuration information database. The rendering step of rendering at the predetermined frame rate according to the degree, the requesting step, the receiving step, the scene configuration management step, the display management step, and monitoring the processing status of the rendering step, In the rendering step And a task adjustment unit for allocating the processing time to each unit and adjusting the processing time of each unit so as to maintain the processing time for performing the rendering at the predetermined designated frame rate. Features.

A server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, and the three-dimensional object data connected to the server via a communication path and transmitted from the server. And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In the method for transmitting and displaying three-dimensional spatial data received and displayed by a client device, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of the data. The client device transmits the three-dimensional image transmitted from the server device. A memory having a variable storage capacity for registering and storing object data; and a scene configuration information database for storing scene configuration information constituting a three-dimensional virtual space generated using the three-dimensional object data. The virtual space is displayed at a predetermined designated frame rate, and the three-dimensional space data transmission and display method includes: inputting storage capacity information indicating the storage capacity of the memory at a predetermined timing from the client device; A calculating step of calculating the degree of change in the storage capacity of the memory using the storage capacity information input at the timing and the storage capacity information input immediately before; and from the server device to the client device per predetermined unit time. The upper limit of the data capacity of the three-dimensional object data transmitted to the In accordance with the degree of change in the storage capacity of the memory calculated in the above, the upper limit value resetting step to set again, and before the upper limit value is set again by the upper limit value resetting step, the server apparatus transmits to the client apparatus. Transmission schedule discarding, in which a fixed amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data and transmission schedules of the three-dimensional object data other than the fixed amount of untransmitted data are discarded. Steps, inputting viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and predicting a spatial region to enter the field of view by moving the viewpoint for a predetermined fixed time based on the input viewpoint information. According to the purpose of displaying the preset three-dimensional space data, the predicted space For 3D object data included in the area,
A priority setting step of setting the priority information; and a memory storing and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. Memory capacity information indicating the capacity is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, and the memory capacity information Accordingly, the degree of detail of the three-dimensional object data is determined, and the three-dimensional object data having the highest priority is sequentially transmitted from the server device to the client until the upper limit value reset in the upper limit value resetting step is performed. Selection to select 3D object data to be sent to the device And at least one of the three-dimensional object data displayed in the client device in the order of appearance, the three-dimensional object data close to the viewpoint position, and the three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so that the three-dimensional object data selected in the selection step is transmitted earlier to the client device; At the end of the transmission schedule of the transmission data, the transmission schedule set in the transmission schedule setting step is merged, and the three-dimensional object data is stored in the client according to the merged transmission schedule. A transmission step of transmitting a three-dimensional object data distribution request to the server device, and a three-dimensional object data transmitted from the server device. A receiving step of requesting a process of adding the three-dimensional object data to the three-dimensional virtual space; and a request of the additional process of adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step of adding the scene configuration information to the scene configuration information database, a display management step of instructing the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration stored in the scene configuration information database Based on information Rendering a three-dimensional virtual space at a predetermined frame rate in accordance with the degree of detail instructed by the display management unit;
The receiving step, the scene configuration managing step,
Monitoring the processing status of the display management step and the rendering step, and assigning a processing time to each unit so as to maintain the processing time for performing the rendering in the rendering step at the predetermined specified frame rate. And a task adjusting unit for adjusting the processing time of each unit.

A server for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server via a communication path and transmitted from the server. And a client device that receives and displays the three-dimensional object data. The three-dimensional object data is transmitted from the server device to the client device. In the method for transmitting and displaying three-dimensional spatial data received and displayed by a client device, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The client device receives the three-dimensional object data and A predetermined processing capacity to be displayed, wherein the predetermined processing capacity changes according to a processing load condition in the client device, and the three-dimensional virtual space is displayed at a predetermined designated frame rate; A scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space generated using object data; the three-dimensional space data transmission and display method includes a load indicating a load status of the processing from the client device; A calculation step of inputting information at a predetermined timing, calculating the degree of change in the load status of the processing by using the load information input at the predetermined timing and the load information input immediately before; On the data capacity of the three-dimensional object data transmitted from the server device to the client device per hour. The upper limit value resetting step to set the value again according to the degree of change in the load situation of the processing calculated in the calculating step, and the step of setting the upper limit value of the data capacity again by the upper limit resetting step. From the scheduled three-dimensional object data to be transmitted from the server device to the client device, a certain amount of three-dimensional object data is left as untransmitted data, and three-dimensional object data other than the certain amount of untransmitted data is left. A transmission schedule discarding step of discarding a transmission schedule, and inputting viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device, and entering the field of view by moving the viewpoint for a predetermined fixed time based on the input viewpoint information. To display the three-dimensional spatial data set in advance by predicting the spatial area that will come Priority setting step of setting the priority information for the three-dimensional object data included in the predicted spatial area, and data processing capability information indicating the data processing capability of the client device from the client device. And the rendering capability information indicating the rendering processing capability and the memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. The priority information set in the priority setting step and the use of the communication path are input. The detail level of the three-dimensional object data is determined according to the possible communication speed, the processing capability information, the rendering capability information, and the memory capacity information, and the three-dimensional object data is determined in order from the higher priority three-dimensional object data. Up to the upper limit value reset in the upper limit value reset step,
A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device;
At least one of the three-dimensional object data, the three-dimensional object data close to the viewpoint and the three-dimensional object data close to the line of sight, is selected by the selection step so as to be transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule for transmitting the obtained three-dimensional object data to the client device; and a transmission schedule setting step at the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule. A request step of outputting a distribution request of three-dimensional object data to the server device, and a process of receiving the three-dimensional object data transmitted from the server device and adding the received three-dimensional object data to the three-dimensional virtual space. A requesting receiving step, and a request for adding processing to add three-dimensional object data to the three-dimensional virtual space from the receiving step, and adding the three-dimensional object data as the scene configuration information to the scene configuration information database A configuration management step; a display management step for instructing the degree of detail of the three-dimensional object data to be displayed on the client device;
Based on the scene configuration information stored in the scene configuration information database, a three-dimensional virtual space seen from the viewpoint is
A rendering step of rendering at the predetermined frame rate according to the level of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is allocated to each unit and the processing time of each unit is adjusted so that the processing time for rendering in the rendering step is maintained at the predetermined designated frame rate. And a task adjusting unit for performing the task.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path and transmitted from the server device. And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In the method of transmitting and displaying three-dimensional spatial data received and displayed by a client device, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The client device has information indicating the moving speed of the viewpoint and the rotation of the line of sight. Notifying the server device of at least one of the viewpoint gaze information and the information indicating the speed, displaying the three-dimensional virtual space at a predetermined designated frame rate, and generating the three-dimensional virtual space using the three-dimensional object data A scene configuration information database that stores scene configuration information that configures the obtained three-dimensional virtual space. The three-dimensional space data transmission and display method includes: inputting the viewpoint viewpoint information from the client device at a predetermined timing; A calculating step of calculating the degree of change of the viewpoint visual line information using the viewpoint visual line information input at a predetermined timing and the viewpoint visual line information input immediately before; and The upper limit of the data capacity of the three-dimensional object data to be transmitted to the The upper limit value resetting step of setting again according to the degree of change of the viewpoint visual line information, and the server apparatus transmits to the client apparatus before setting the upper limit value again by the upper limit value resetting step. A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data as untransmitted data from the scheduled three-dimensional object data and discarding a transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data; The viewpoint information indicating the viewpoint and the movement speed of the viewpoint is input from the client device, and a space area that enters the field of view by moving the viewpoint for a predetermined time based on the input viewpoint information is set in advance. Depending on the purpose of displaying the three-dimensional spatial data, A priority setting step of setting the priority information for the three-dimensional object data; data processing capability information indicating the data processing capability of the client device; rendering capability information indicating the rendering processing capability; Input memory capacity information indicating the storage capacity of the memory for registering and storing the object data, and the priority information set in the priority setting step,
Determining the degree of detail of the three-dimensional object data according to the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information; A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from data, and displayed on the client device; At least one of the three-dimensional object data having the earliest appearance order, the three-dimensional object data close to the viewpoint position, and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. The 3D object data selected in the selection step A transmission schedule for setting a transmission schedule for transmitting to the client device, and the transmission schedule set in the transmission schedule setting step at the end of the transmission schedule of untransmitted data not discarded in the transmission schedule discarding step. A transmitting step of transmitting the three-dimensional object data to the client device according to the merged transmission schedule, and outputting a distribution request of the three-dimensional object data to the server device. ,
The three-dimensional object data transmitted from the server device is received, and the three-dimensional object data
A receiving step for requesting additional processing to the three-dimensional virtual space,
A scene configuration management step of receiving a request for additional processing for adding three-dimensional object data to the three-dimensional virtual space from the receiving step, and adding the three-dimensional object data to the scene configuration information database as the scene configuration information; 3 to be displayed on the client device
A display management step of instructing the degree of detail of the dimensional object data; and, based on the scene configuration information stored in the scene configuration information database, changing the three-dimensional virtual space seen from the viewpoint in accordance with the level of detail specified by the display management unit. Monitoring the processing status of the rendering step of rendering at the predetermined frame rate, the requesting step, the receiving step, the scene configuration management step, the display management step, and the rendering step; And a task adjustment unit for allocating a processing time to each unit and adjusting the processing time of each unit so as to maintain the processing time for rendering by the predetermined designated frame rate. And

The task adjusting step of the client device according to the present invention is executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step of the client device. The processing time required for a series of processing is monitored for a specified period of time, an average value of the processing time required for the series of processing is calculated based on the monitored result, and the calculated average value is designated as a predetermined value. In order to maintain the obtained frame rate, a request is made to the object extraction step of the server device to adjust the detail level information of the three-dimensional object data to be transmitted, and the object extraction step of the server device Transmitted in response to a request from the task adjustment step of the client device. And changes set the level of detail of information of that object.

Further, the task adjusting step of the client device according to the present invention is executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step of the client device. The processing time required for a series of processing is monitored for a specified period of time, and an average value of the processing time required for the series of processing is calculated using the monitored result, and the calculated average value is designated as a predetermined value. In order to maintain the frame rate equal to or less than the set frame rate, in the transmission data capacity adjustment step of the server device, the three-dimensional virtual space existing in the three-dimensional virtual space predicted to be displayed on the client device within the predetermined fixed time period Tertiary data transmitted from the dimensional object data to the client device per predetermined unit time A request is made to adjust the upper limit value of the data capacity to be selected as the object data, and the transmission data capacity adjustment step of the server device is performed in response to a request from the task adjustment step of the client device. It is characterized in that the upper limit value of the capacity is changed.

The task adjusting step of the client device according to the present invention may further comprise adjusting the predetermined designated frame rate to transmit the three-dimensional object to the object extracting unit of the server device. The frequency at which at least one of the request to change the setting of the data detail level information and the request to adjust the upper limit value to the transmission data capacity adjustment unit of the server device is made. It is characterized by reduction.

A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path, and receives three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device.
In a computer-readable recording medium storing a program for causing a computer to execute a three-dimensional spatial data transmission and display method for receiving and displaying the transmitted three-dimensional object data by the client device, the three-dimensional object The data has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of the data, and the client device generates a three-dimensional virtual image generated using the three-dimensional object data. With a scene configuration information database that stores scene configuration information that configures the space,
A computer-readable recording medium that displays the three-dimensional virtual space at a predetermined designated frame rate and records a program for causing a computer to execute the three-dimensional space data transmission and display method includes a computer-readable recording medium per predetermined time. The average communication speed available for the communication path is calculated, and the change in the available communication speed for the communication path is monitored. When the change is monitored, the communication speed for monitoring the change and the calculated communication speed are calculated. A calculating step of calculating the degree of change in the communication speed based on the average communication speed; and calculating the upper limit of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time. An upper limit value resetting step of setting again according to the degree of change of the communication speed calculated in the step; A predetermined amount of three-dimensional object data is left as untransmitted data from three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit value again by the resetting step, A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data, and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device, and inputting the viewpoint information to the input viewpoint information. Based on the purpose of displaying a three-dimensional space data set in advance by predicting a spatial region entering the field of view by moving the viewpoint for a predetermined time based on the three-dimensional object data included in the predicted spatial region, A priority setting step of setting the priority information, The client device inputs data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. The detail level of the three-dimensional object data is determined according to the priority information set in the degree setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, and the memory capacity information. And selecting the three-dimensional object data to be transmitted from the server device to the client device in order from the three-dimensional object data having the highest priority to the upper limit value reset in the upper limit value resetting step. And the order of appearance displayed on the client device. Fast 3D object data and 3 close to the viewpoint position
The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule to be transmitted to, and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object data to the client device according to the merged transmission schedule, and distributing the three-dimensional object data to the server device. And a request step of outputting the request,
The three-dimensional object data transmitted from the server device is received, and the three-dimensional object data
A receiving step for requesting additional processing to the three-dimensional virtual space,
A scene configuration management step of receiving a request for additional processing for adding three-dimensional object data to the three-dimensional virtual space from the receiving step, and adding the three-dimensional object data to the scene configuration information database as the scene configuration information; 3 to be displayed on the client device
A display management step of instructing the degree of detail of the dimensional object data; and, based on the scene configuration information stored in the scene configuration information database, changing the three-dimensional virtual space seen from the viewpoint in accordance with the level of detail specified by the display management unit. Monitoring the processing status of the rendering step of rendering at the predetermined frame rate, the requesting step, the receiving step, the scene configuration management step, the display management step, and the rendering step; And a task adjustment unit for allocating a processing time to each unit and adjusting the processing time of each unit so as to maintain the processing time for rendering by the predetermined designated frame rate. And

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention, the three-dimensional object data connected to the server device via a communication path, and transmitted from the server device And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In a computer-readable recording medium recording a program for causing a computer to execute a three-dimensional spatial data transmission and display method received and displayed by a client device, the three-dimensional object data is:
The client device has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail level of data, and the client device has a storage capacity for registering and storing the three-dimensional object data transmitted from the server device. A memory that changes, and a scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space generated using the three-dimensional object data,
A computer-readable recording medium for displaying the three-dimensional virtual space at a predetermined designated frame rate and recording a program for causing a computer to execute the three-dimensional space data transmission and display method is stored in the memory from the client device. The storage capacity information indicating the storage capacity of the memory is input at a predetermined timing, and the degree of change in the storage capacity of the memory is determined using the storage capacity information input at the predetermined timing and the storage capacity information input immediately before. A calculating step of calculating the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time, the degree of change in the storage capacity of the memory calculated in the calculating step Upper limit value resetting step to set again according to the above, and the upper limit value resetting step From the three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit again, a certain amount of the three-dimensional object data is left as untransmitted data, 3 other than unsent data
A transmission schedule discarding step of discarding the transmission schedule of the dimensional object data, and viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and moving the viewpoint for a predetermined fixed time based on the input viewpoint information. And sets the priority information for the three-dimensional object data included in the predicted space area according to the purpose of displaying the predetermined three-dimensional space data. Priority setting step, data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. And set it in the priority setting step. Determining the level of detail of the three-dimensional object data according to the priority information, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information; From the server device to the client device up to the upper limit value reset in the upper limit resetting step in order from the three-dimensional object data having the highest
A selecting step of selecting three-dimensional object data; and at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so as to transmit one piece of three-dimensional object data to the client device quickly; and discarding the transmission schedule. The transmission schedule set in the transmission schedule setting step is merged with the end of the transmission schedule of the untransmitted data not discarded in the step. A transmitting step of transmitting object data to the client device, a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and receiving the three-dimensional object data transmitted from the server device. Receiving the request for adding the received three-dimensional object data to the three-dimensional virtual space; and receiving the request for the additional processing for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step of adding dimensional object data to the scene configuration information database as the scene configuration information;
A display management step of instructing a degree of detail of the three-dimensional object data to be displayed on the client device; and a three-dimensional virtual space visible from a viewpoint based on scene configuration information stored in the scene configuration information database. A rendering step of rendering at the predetermined frame rate according to the level of detail indicated by
The processing status of the requesting step, the receiving step, the scene configuration management step, the display management step, and the rendering step is monitored, and the processing time for performing the rendering in the rendering step is specified by the predetermined designation. And a task adjusting unit for allocating a processing time to each unit so as to maintain the frame rate at a predetermined value and adjusting the processing time of each unit.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path and transmitted from the server device. And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In a computer-readable recording medium recording a program for causing a computer to execute a three-dimensional spatial data transmission display method received and displayed by a client device, the three-dimensional object data is
The client device has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail level of data, and the client device has a predetermined processing capability of receiving and displaying the three-dimensional object data. The predetermined processing capability changes in accordance with the processing load on the client device, displays the three-dimensional virtual space at a predetermined designated frame rate, and generates the three-dimensional virtual space using the three-dimensional object data. A computer-readable recording medium that includes a scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space, and that stores a program for causing a computer to execute the three-dimensional space data transmission and display method is provided by the client device. The load information indicating the load status of the above processing is input at a predetermined timing, and the predetermined A calculating step of calculating the degree of change in the load status of the processing by using the load information input by theimaging and the load information input immediately before; and from the server device to the client device per predetermined unit time. The upper limit value of the data capacity of the three-dimensional object data to be transmitted is set again according to the degree of change in the load situation of the processing calculated in the calculation step. Before setting the upper limit of the capacity again, from the three-dimensional object data scheduled to be transmitted from the server device to the client device, a certain amount of the three-dimensional object data is left as untransmitted data, Transmission that discards the transmission schedule of 3D object data other than untransmitted data Schedule discarding step, and inputting viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and predicting a spatial region coming into the field of view by moving the viewpoint for a predetermined time based on the input viewpoint information. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the predetermined three-dimensional space data; , Data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. The priority information set by the above, the available communication speed of the above communication path, and the above processing The detail level of the three-dimensional object data is determined in accordance with the capability information, the rendering capability information, and the memory capacity information, and the upper limit value resetting step is performed in order from the higher priority three-dimensional object data. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device up to the set upper limit value; The three-dimensional object data selected in the selection step is transmitted to the client device so that at least one of the three-dimensional object data close to the camera and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. The sending switch to send to the client device The transmission schedule set in the transmission schedule setting step is merged with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. A transmitting step of transmitting the three-dimensional object data to the client device according to a transmission schedule, a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and a transmitting step of transmitting the three-dimensional object data from the server device. A receiving step of receiving the three-dimensional object data and requesting a process of adding the received three-dimensional object data to the three-dimensional virtual space; and an additional step of adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step of receiving the processing request and adding the three-dimensional object data to the scene configuration information database as the scene configuration information; and a display management for instructing a degree of detail of the three-dimensional object data to be displayed on the client device. And a rendering step of rendering a three-dimensional virtual space viewed from a viewpoint at the predetermined frame rate according to the level of detail instructed by the display management unit based on the scene configuration information stored in the scene configuration information database. Monitoring the processing status of the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step, and specifying the processing time for performing the rendering by the rendering step by the predetermined designation. Is And a task adjusting unit for allocating a processing time to each unit so as to maintain the frame rate at a predetermined value and adjusting the processing time of each unit.

Further, a server device for transmitting three-dimensional object data constituting a three-dimensional virtual space according to the present invention is connected to the server device via a communication path and transmitted from the server device. And a client device for receiving and displaying the three-dimensional object data, wherein the three-dimensional object data is transmitted from the server device to the client device, and the transmitted three-dimensional object data is transmitted to the client device. In a computer-readable recording medium recording a program for causing a computer to execute a three-dimensional spatial data transmission and display method received and displayed by a client device, the three-dimensional object data is:
The client device has priority information indicating a priority to be transmitted to the client device and detail information indicating a detail level of data, and the client device includes information indicating a moving speed of a viewpoint and information indicating a rotating speed of a line of sight. Notifying at least one of the viewpoint line-of-sight information to the server device, displaying the three-dimensional virtual space at a predetermined designated frame rate,
A scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space generated using the three-dimensional object data; and a program for causing a computer to execute the three-dimensional space data transmission and display method is recorded. The computer readable recording medium is
The viewpoint gaze information is input at a predetermined timing from the client device, and the degree of change of the viewpoint gaze information is calculated using the viewpoint gaze information input at the predetermined timing and the viewpoint gaze information input immediately before. Calculating the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time according to the degree of change of the viewpoint visual line information calculated in the calculating step. An upper limit value resetting step to set again, and three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit value again in the upper limit value resetting step, Leave the fixed amount of 3D object data as untransmitted data, A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than untransmitted data; and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device, and a predetermined information is determined based on the input viewpoint information. According to the purpose of displaying a three-dimensional space data set in advance by predicting a spatial region entering the field of view by moving the viewpoint for a certain time, the three-dimensional object data included in the predicted spatial region is A priority setting step of setting the priority information; and a memory storing and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. Enter the memory capacity information indicating the capacity and set the priority The detail level of the three-dimensional object data is determined according to the priority information set by the step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. And selecting the three-dimensional object data to be transmitted from the server device to the client device in order from the three-dimensional object data having the highest priority up to the upper limit value reset in the upper limit value resetting step. And at least one of the three-dimensional object data displayed in the client device in the order of appearance, the three-dimensional object data close to the viewpoint position, and the three-dimensional object data close to the line of sight, The selection step is performed so that transmission to the client device is quick. A transmission schedule for setting a transmission schedule for transmitting the three-dimensional object data selected by the client to the client device; and transmitting the three-dimensional object data at the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. Merging the transmission schedule set in the schedule setting step, and according to the merged transmission schedule,
A transmitting step of transmitting the three-dimensional object data to the client device, a requesting step of outputting a three-dimensional object data distribution request to the server device, and a three-dimensional object data transmitted from the server device. Receiving the request for adding the received three-dimensional object data to the three-dimensional virtual space, and receiving the request for the additional processing for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step of adding the three-dimensional object data as the scene configuration information to the scene configuration information database; a display management step of instructing a degree of detail of the three-dimensional object data to be displayed on the client device; Information database A rendering step of rendering a three-dimensional virtual space seen from a viewpoint at a predetermined frame rate in accordance with a degree of detail instructed by the display management unit based on the stored scene configuration information; a requesting step; and a receiving step Monitoring the processing status of the scene configuration management step, the display management step, and the rendering step, and maintaining a processing time for performing rendering in the rendering step at the predetermined designated frame rate. ,
It has a task adjusting unit for allocating a processing time to each unit and adjusting the processing time of each unit.

[0074]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a functional block diagram of the three-dimensional spatial data transmission and display system according to the first embodiment.

As shown in FIG. 1, reference numeral 10 denotes a three-dimensional spatial data transmitting apparatus (hereinafter, also referred to as a server) connected to a communication network 40 of the Internet or an intranet. Reference numeral 11 denotes a transmission data capacity adjustment unit. The transmission data capacity adjustment unit 11 adapts to the degree of change in the available transmission speed (communication bandwidth) of the communication path that changes according to the congestion state that changes from time to time in the communication path,
The degree of change of the upper limit of the total data capacity of the plurality of three-dimensional objects constituting the three-dimensional space transmitted from the server to the client terminal 20 is determined, and the upper limit is appropriately set according to the degree of change of the upper limit. This is a transmission data capacity adjustment unit to be modified. Reference numeral 12 denotes a priority setting unit.
The priority setting unit 12 uses the three-dimensional object that is already within the field of view of the display screen at the current viewpoint position and the three-dimensional object that is predicted to newly enter the field of view with the movement of the viewpoint. Need to display according to the
Alternatively, it is a priority setting unit that sets a priority according to the degree of enhancing visibility. The purpose of use and visibility are 3
The purpose of use of the user who displays the dimensional object is analyzed and ruled, and set in advance. For example, when the purpose of use is to display a three-dimensional object as map information, a building or a sign that serves as a landmark to a point at which the user wants to arrive is always displayed, and anything that does not become a landmark is not displayed. In addition, buildings and signs serving as landmarks are displayed with enhanced visibility so that they can be clearly recognized even if they are far from the user's viewpoint. In this way, the user's purpose of use and visibility corresponding to the purpose of use are made into a rule, and the user is made to make a selection before transmitting the data of the three-dimensional object to the client terminal 20. The priority setting unit 12 sets a priority for the three-dimensional object data based on a rule selected by the user. Reference numeral 13 denotes a three-dimensional object extraction unit. The three-dimensional object extraction unit 13 selects the three-dimensional objects having the highest priority from the three-dimensional objects for which the priority is set. Further, the higher the priority of the three-dimensional object and the higher the available transmission speed in consideration of the congestion state of the communication path before transmission, the higher the detail of the data constituting the three-dimensional object is set. Further, every time the upper limit value of the transmission data capacity is changed, the detail level of the three-dimensional object set before the change of the upper limit value is reset. Then, the three-dimensional object extracting unit re-selects the three-dimensional objects with the highest priority among the three-dimensional objects for which the priority is set so as not to exceed the changed upper limit of the transmission data capacity. Reference numeral 14 denotes a scheduling unit. The scheduling unit 14 sets a transmission schedule of the three-dimensional object to be transmitted to the client terminal 20 so that the three-dimensional object closer to the appearance order or the viewpoint position displayed on the display screen is transmitted earlier. Further, each time the upper limit of the transmission data capacity is changed, the transmission schedule is reset based on the three-dimensional object reselected by the three-dimensional object extraction unit 13. Reference numeral 15 denotes a streaming transmission unit. Each time the upper limit value of the transmission data capacity is changed, the streaming transmission unit 15 performs the following according to the transmission schedule reset by the scheduling unit 14.
It is a streaming transmission unit that sequentially transmits three-dimensional objects. Reference numeral 16 denotes an object information storage unit. The object information storage unit 16 stores three-dimensional object data. The three-dimensional object data includes polygon data representing the shape of the three-dimensional object and texture data to be attached to the three-dimensional object. A three-dimensional object or three-dimensional object data indicates polygon data and texture data. The transmission data capacity adjustment unit 11 is notified of information indicating the reception rate of the client terminal from the task adjustment unit 26 included in the client terminal described below. Upon receiving the notification, the transmission data capacity adjustment unit 11
Comparing the reception rate with the available communication speed of the communication channel at the time of transmission, the communication speed is lower if the communication speed is lower, and the reception rate otherwise. Reset the transmission data capacity.

First, the function of the transmission data capacity adjusting unit 11 will be described. The server 10 is connected to the client terminal 20 via the Internet (wired) or intranet (wired), which is the communication network 40, and further via the wireless network 41. In general, a communication path used for transmitting a three-dimensional object from the server 10 to the client terminal 20 generally has an available communication speed that changes every moment in accordance with a use (congestion) situation. The amount of data that can be transmitted to the client per unit time is limited by the available communication speed of this communication path. Furthermore, since the available communication speed changes every moment, the transmittable data capacity per unit time also changes every moment. Even if data having a data capacity equal to or higher than the available communication speed is transmitted to the communication path, the data is lost on the way, and the retransmission recalls further congestion of the communication path. As a result, data transmission efficiency is further deteriorated. Therefore, the most effective data transmission is to transmit an object having a transmission data capacity per unit time in which the communication speed is lower than the available communication speed. The upper limit of the total transmission data capacity (the upper limit of the total transmission data capacity) of the three-dimensional object existing in the space area that is currently in the field of view and the space area that is predicted to enter the field of view by moving the viewpoint for a certain time in the future. Is the upper limit of the amount of data that can be transmitted per unit time to the client) according to the communication speed of the communication path or the degree of change in the average communication speed of the communication path at certain time intervals. To decide. The greater the degree of the change of the communication channel, the greater the degree of change of the upper limit of the total amount of transmission data. In addition, the smaller the degree of the change of the communication channel is, the smaller the degree of change of the upper limit value of the total transmission data capacity is. Here, the upper limit value is the upper limit value of the total amount of transmission data transmitted from the server 10 to the client terminal 20 during a certain period of time set by the transmission data capacity adjusting unit 11. Depending on the communication status of the communication channel at the time of transmission, the total amount of transmission data may be equal to or less than the upper limit. At the time of transmission planning, the transmission data capacity total amount is extracted as an upper limit, a three-dimensional object to be transmitted is extracted, and a transmission schedule is set and transmitted.

The function of the priority setting section 12 will be described. A predetermined use is made for a three-dimensional object existing in a space area currently in view and a three-dimensional object existing in a space area predicted to enter the view by moving the viewpoint for a certain time in the future. The priority is set higher for a three-dimensional object that needs to be displayed more frequently and for a higher degree of visibility, depending on the purpose. The three-dimensional objects that need to be displayed are to be displayed according to the display rules of the three-dimensional objects designated by the user to be displayed and the three-dimensional objects set by the developer or operator who designed the three-dimensional space contents. Means a three-dimensional object having a high evaluation value indicating the necessity of display. Also, a three-dimensional object with a high degree of enhancing visibility is a three-dimensional object closer to the viewpoint position, a three-dimensional object closer to the line-of-sight direction, or a three-dimensional object with a higher screen occupancy when displaying a three-dimensional space. Refers to an object or the like.

The function of the three-dimensional object extraction unit 13 will be described. The three-dimensional object extraction unit 13 determines the degree of detail of the three-dimensional object to be transmitted according to the priority set by the priority setting unit 12 and the communication speed of the communication path. As the degree of detail increases, the data amount of the three-dimensional object data increases. Then, the three-dimensional objects are selected in order from the highest priority, and the three-dimensional objects are selected up to the upper limit value of the total amount of the transmission data set by the transmission data capacity adjusting unit 11. Further, when the upper limit value of the total amount of the transmission data is changed in the transmission data capacity adjustment unit 11, a certain amount of untransmitted data from the present time (at the time of the upper limit change) of the transmission schedule is left, and the remaining non-transmission data is not changed. The transmission of the transmission data is interrupted, and the interrupted transmission schedule of the untransmitted data is discarded. In response to the change of the upper limit value, the three-dimensional object existing in the space area that is currently in the field of view and the space area that is predicted to come into the field of view by moving the viewpoint for a certain time in the future. The priority setting unit 12 resets the priority of the three-dimensional object to be set. The transmission is performed according to the reset priority, the currently available communication speed of the communication path, the data processing capability of the destination client terminal, the rendering processing capability of the client terminal for the three-dimensional object, and the memory capacity of the client terminal. The degree of detail of the three-dimensional object is determined again. Then, the three-dimensional objects to be transmitted are selected again from the three-dimensional objects having the highest priority up to the upper limit of the total amount of the transmission data set by the transmission data capacity adjusting unit 11. The client terminal notifies the server of the data processing capability of the client terminal, the rendering processing capability of the three-dimensional object of the client terminal, and the memory capacity of the client terminal. Client terminal 20
If the texture data capacity that can be displayed at high speed is equal to or less than the upper limit of the transmission data capacity, the resolution of the texture is set to be higher with higher priority so that the total amount of texture data is equal to or less than the texture data capacity. The three-dimensional object is adjusted step by step so as not to exceed the upper limit of the transmission data capacity. FIG.
Shows the relationship between priority and resolution. In FIG.
(A) is a relationship between the priority and the resolution before adjustment,
(B) is a relationship between the adjusted priority and the resolution. If the total amount of transmission data exceeds the amount of texture data that can be displayed at high speed, adjustment is made so as to reduce the priority belonging to the high-resolution group. For example, FIG.
Then, the priority level belonging to A having the highest resolution is increased, and the width of the priority level belonging to C having the low resolution is adjusted so as to increase. As a result, the overall resolution is reduced, and the volume of the transmitted three-dimensional object data can be reduced. When the data size of the untransmitted transmission object falls below a certain value, the transmission target object is selected again and the priority is set again. Further, the upper limit of the transmission data capacity is reset according to the transmission speed of the communication path and the transmission rate requested by the client terminal 20. Then, the degree of detail of the three-dimensional object to be transmitted is reset according to the change of the upper limit value of the transmission data capacity, and the objects are selected in order from the highest priority so as not to exceed the changed upper limit of the transmission data capacity. cure. In this case, the previous three-dimensional object extraction unit 13
When the same selected object is again selected as an object having a different resolution when the object is selected in step (1), if the previously transmitted data is not discarded, only the difference data is selected. The three-dimensional object extraction unit 13 is notified of information indicating the reception rate of the client terminal from the task adjustment unit 26 provided in the client terminal to be described below. Upon receiving the notification, the three-dimensional object extraction unit 13 compares the reception rate with the available communication speed of the communication path at the time of transmission. If the communication speed is lower, the three-dimensional object extraction unit 13 receives the communication speed. The detail of the three-dimensional object is reset according to the change in the rate.

The function of the scheduling unit 14 will be described. The scheduling unit 14 controls the three-dimensional object extraction unit 13 so that the three-dimensional object closer to the viewpoint position or the three-dimensional object closer to the line-of-sight direction can be displayed earlier in the order of appearance displayed on the display screen. A transmission schedule for the extracted three-dimensional object is set. The transmission schedule is the client terminal 2
The transmission order of the objects is determined in the order of the objects displayed earlier to 0. Then, the transmission time of each object is set so that processing required for display is completed before each object starts to be displayed on the display screen of the client terminal 20, that is, before the object enters the field of view of the viewer of the client terminal 20. Set. Further, the scheduling unit 14 includes a scene configuration management unit 23 described below.
Data size (size) for completing the process of adding the transmitted object to the scene within the processing time allotted to achieve the specified frame rate
And a transmission schedule is set to transmit the three-dimensional object. In addition, since the polygon data and the texture data to be pasted on the polygon data do not need to be sent together with the three-dimensional object data, the scheduling unit 14 transmits the polygon data so that the polygon data is sent in time for the display start time. In the texture data, a transmission schedule is set such that the transmission process is completed while the object is displayed.

The function of the streaming transmission unit 15 will be described. Each time the transmission data capacity adjustment unit 11 changes the upper limit of the total amount of transmission data, the streaming transmission unit 15 deletes a certain amount of untransmitted data from the present time (at the time of changing the upper limit) of the transmission schedule. The transmission of the remaining untransmitted data is interrupted, and the transmission schedule of the interrupted data is discarded. Then, it switches to the transmission schedule reset by the scheduling unit 14 and sequentially transmits the three-dimensional objects. The streaming transmission unit 15 is notified of the reception indicating the reception rate of the client terminal from the task adjustment unit 26 included in the client terminal described below. When notified,
The streaming transmission unit 15 compares the reception rate with the available communication speed of the communication channel at the time of transmission. Send The streaming transmission unit 15 transmits polygon data constituting the three-dimensional object as retransmission guarantee data, and transmits texture data as best effort guarantee data. In other words, polygon data always arrives at the client terminal, and texture data makes every effort to arrive at the client terminal.
This means that they may not arrive. Therefore, the polygon data is stored in the same packet, and the texture data includes a plurality of texture data to be mapped to one object so that rough texture data can be mapped without packet loss and retransmission. The packet is divided and stored and transmitted.

Next, in the three-dimensional data transmission display system, when the available communication speed (transmission speed) changes due to a change in the congestion state of the communication path, the upper limit of the total amount of transmission data capacity, the three-dimensional object The operation of streaming transmission of a three-dimensional object by resetting the transmission level and the transmission schedule will be described with reference to the flowchart of FIG.

It is assumed that the congestion state of the communication path changes and the average available communication speed for a certain period of time changes. The transmission data capacity adjusting unit 11 constantly monitors the communication status of the communication path. Therefore, as soon as a change in communication speed is confirmed,
The transmission data capacity adjustment unit 11 detects the amount of change in the available communication speed. And the detected change amount of the communication speed,
Alternatively, the degree to the average communication speed per fixed time before the change is calculated (S1001, calculation step). The degree of change of the upper limit of the total amount of transmission data capacity of the three-dimensional object with respect to the degree of change of the communication speed is determined according to a predetermined rule,
The upper limit is reset (S1002, upper limit resetting step). For example, the predetermined rule is that the upper limit value is such that the greater the degree of change of the communication speed of the communication path, the greater the degree of change of the upper limit value of the total amount of transmission data capacity. Further, the smaller the degree of change of the communication speed of the communication path is, the smaller the degree of change of the upper limit value of the total amount of the transmission data capacity is. In this way, when the upper limit value is changed, the transmission data capacity adjusting unit 11 leaves a certain amount of untransmitted data from the present time (at the time of changing the upper limit) of the transmission schedule and saves the remaining untransmitted data. The transmission is interrupted, and the transmission schedule of the interrupted data is discarded (S1003, transmission schedule discarding step).
Here, the fixed amount of untransmitted data is set as a fixed amount of data such that the transmission processing is completed during the time required for resetting a new transmission schedule by changing the upper limit value. . Immediately, the priority setting unit 12
Displays three-dimensional objects included in the space area that is currently in the field of view according to the change of the upper limit value, and the space area that is predicted to come into the field of view again by moving the viewpoint for a certain time in the future. The priority is set higher for an object with higher necessity and for an object that improves visibility (S1004, priority setting step). The three-dimensional object extracting unit 13 determines the reset priority,
Details of the three-dimensional object to be transmitted according to the currently available communication speed of the communication path, the data processing capability of the client terminal (transmission destination mobile terminal), the rendering processing capability of the three-dimensional object of the client terminal, and the memory capacity of the client terminal The transmission level is determined again, and transmission is performed in order from the three-dimensional object having the highest priority up to the upper limit value of the total transmission data volume set by the transmission data volume adjustment unit 11.
The dimensional object is selected again (S1005, selection step). When the three-dimensional object to be transmitted and the degree of detail thereof are determined, the scheduling unit 14 displays the three-dimensional object closer to the viewpoint position, the three-dimensional object closer to the viewpoint position, or the object closer to the line of sight, etc. earlier. A transmission schedule of the three-dimensional object is set so that the transmission schedule can be set (S1006, transmission schedule setting step). Then, the scheduling unit 14 merges the transmission schedule with the end of the transmission schedule of the fixed amount of untransmitted data that has not been discarded. The streaming transmission unit 15 sequentially transmits the three-dimensional objects according to the merged transmission schedule.
The maximum transmission rate is the available communication speed of the communication path at the time of transmission, and the transmission rate is appropriately changed and transmitted according to the transmission schedule in consideration of the available communication speed of the communication path at the time of transmission (S1007, transmission). Steps).

Thus, even if the congestion state of the communication path changes and the available communication speed changes, the object to be transmitted, the degree of detail of the object, and the transmission schedule are appropriately changed, thereby causing the user to move the viewpoint. Transmission and display of a three-dimensional object that achieves best-effort display quality can be realized without lowering the operability of operation (frame rate of switching display).

Embodiment 2 In the present embodiment, the transmission data capacity adjustment unit 11 determines whether the space area currently in view is constant in the future according to the degree of change in the memory capacity capable of registering and storing the object data of the client terminal 20. A three-dimensional spatial data transmission and display system that changes the upper limit value of the total transmission data capacity of the three-dimensional object existing in the spatial region predicted to enter the field of view by moving the viewpoint in time will be described.

The memory capacity (total amount of memory) for registering and storing the object data of the client terminal 20 at the transmission destination is determined by storing information other than map information, for example, pictures, moving images, sound information, etc. When the data is registered and stored in a part of the file, or when the spatial map data that is no longer required to be displayed is continuously stored for the purpose of secondary use, the space map data changes momentarily according to the use situation. Therefore, according to this changing memory capacity,
It is necessary to appropriately change the upper limit of the total amount of transmission data. As the degree of change in the memory capacity increases,
The degree to which the upper limit value of the total transmission data capacity is changed is increased. Further, the smaller the degree of change of the memory capacity is, the smaller the degree of change of the upper limit of the total transmission data capacity is.

In the three-dimensional data transmission / display system, when the memory capacity for registering and storing the object data of the client terminal 20 changes, the upper limit of the total transmission data capacity, the degree of detail of the three-dimensional object, the transmission The operation of resetting the schedule and transmitting the three-dimensional object by streaming will be described with reference to the flowchart of FIG.

Assume that the memory capacity of the client terminal 20 in which object data can be registered and stored has changed. The client terminal 20 notifies the server 10 that the memory capacity has changed. Upon receiving the notification of the change in the memory capacity, the transmission data capacity adjustment unit 11 calculates the amount of change in the available memory, that is, the degree of change.
(S2001, calculation step). The degree of change of the upper limit of the total amount of transmission data capacity of the three-dimensional object with respect to the degree of change of the total memory is determined according to a predetermined rule, and the upper limit is reset (S2).
002, upper limit value resetting step). According to a predetermined rule, for example, the upper limit value is such that the greater the degree of change in the total memory amount, the greater the degree of change in the upper limit value of the total amount of transmission data capacity. Further, the smaller the degree of change of the total memory capacity is, the smaller the degree of change of the upper limit of the total amount of the transmission data capacity is. In this way, when the upper limit value is changed, the transmission data capacity adjustment unit 11 leaves a certain amount of untransmitted data from the present time of the transmission schedule (at the time of changing the upper limit) and saves the remaining untransmitted data. The transmission is interrupted, and the transmission schedule of the data whose communication is interrupted is discarded (S2003, transmission schedule discarding step). Thereafter, the above step S is continued.
1004, step S1005, step S1006,
The processing shown in step S1007 is executed.

As a result, even if the memory capacity of the client terminal 20 in which the object data of the client terminal 20 can be registered and stored changes, the object to be transmitted, the level of detail of the object, and the transmission schedule can be appropriately changed to move the viewpoint of the user. The transmission and display of a three-dimensional object that achieves the best-effort display quality can be realized without lowering the operability (frame rate of the switching display) of the operation accompanied by.

Embodiment 3 In the present embodiment, a description will be given of a three-dimensional spatial data transmission display system in which the transmission data capacity adjustment unit 11 changes the upper limit value of the total transmission data amount according to the degree of change in the processing load of the client terminal 20. I do.

At the destination client terminal 20,
In addition to receiving and displaying space / map data, when processing such as receiving and displaying a moving image or receiving and reproducing sound data such as voice and music is performed in parallel, In order to receive and display map data, the amount of processing per unit time that can be assigned to the terminal CPU changes. That is, per unit time,
The amount of processing that can be performed for receiving and displaying the space / map content changes according to the processing load of the client terminal. When data exceeding the processing capacity is transmitted from the server to the client, for example, the target number of display switching times (frame rate) per unit time cannot be maintained, or the processing time allocated for rendering decreases. This causes a problem that all data cannot be rendered within the allocated processing time. Therefore, it is necessary to appropriately change the upper limit value of the total amount of transmission data according to the load condition of the client terminal that changes every moment. The greater the degree of change in the load condition, the greater the degree of change in the upper limit of the total amount of transmission data. In addition, the smaller the degree of change of the load condition is, the smaller the degree of change of the upper limit value of the total transmission data capacity is.

In the three-dimensional data transmission / display system, when the load condition of the client terminal 20 changes, the upper limit value of the total amount of the transmission data capacity, the degree of detail of the three-dimensional object, and the transmission schedule are reset to set the three-dimensional object. About the operation of streaming the object,
This will be described with reference to the flowchart of FIG.

Assume that the load status of the client terminal 20 has changed. The client terminal 20 notifies the server 10 that the load condition has changed. Upon receiving the notification of the change in the load situation, the transmission data capacity adjustment unit 11 calculates the amount of change in the load situation of the client terminal, that is, the degree of the change. (S3001, calculation step). The degree of change of the upper limit of the total amount of transmission data capacity of the three-dimensional object with respect to the degree of change of the load situation is determined according to a predetermined rule, and the upper limit is reset (S3002, upper limit resetting). Steps). According to a predetermined rule, for example, the upper limit value is such that the greater the degree of change in the load condition, the greater the degree of change of the upper limit value of the total amount of transmission data capacity. Further, the smaller the degree of change of the total memory capacity is, the smaller the degree of change of the upper limit of the total amount of the transmission data capacity is. In this way, when the upper limit value is changed, the transmission data capacity adjusting unit 11 leaves a certain amount of untransmitted data from the present time (at the time of changing the upper limit) of the transmission schedule and saves the remaining untransmitted data. The transmission is interrupted, and the transmission schedule of the data whose transmission is interrupted is discarded (S3003, transmission schedule discarding step). Thereafter, the above steps S1004, S1005, S100
6. The processing shown in step S1007 is executed.

Thus, even if the load condition of the client terminal 20 changes, the operability of the operation involving the movement of the viewpoint of the user (switch display) can be changed by appropriately changing the object to be transmitted, the degree of detail of the object, and the transmission schedule. Of the three-dimensional object that achieves the best-effort display quality can be realized without lowering the frame rate.

Embodiment 4 In the present embodiment, the transmission data capacity adjusting unit 11 changes the upper limit of the total amount of transmission data according to a change in the moving speed of the viewpoint or a change in the rotation speed in the line-of-sight direction. Will be described.

When the moving speed of the viewpoint increases, the area to be displayed per unit time increases, and the number of objects transmitted per unit time increases. As the number of objects to be transmitted increases, the amount of data that must be transmitted per unit time increases. As described above, if the communication band of the communication path does not change despite the increase in the transmission data capacity, the object cannot be transmitted to the partner terminal as scheduled. For this reason, even if the viewpoint is moved, there is a problem in that it takes time to receive the transmitted data, and the update processing of the display screen is delayed. Therefore, the transmission data capacity adjusting unit 11
Are three-dimensional objects that exist in the space area that is currently in view when the viewpoint movement speed and the rotation speed in the line of sight increase, and in the space area that is predicted to enter the view by moving the viewpoint for a certain period of time in the future. Is changed so that the upper limit value of the total amount of transmission data capacity becomes smaller. When the moving speed of the viewpoint and the rotational speed in the line of sight become slower, the upper limit is reset to a higher value. Also, the larger the degree of change (the amount of change) of the movement speed of the viewpoint and the rotation speed in the line-of-sight direction is,
The degree of change of the upper limit value (change amount) is set to a larger value. Also, when the difference between the three-dimensional object predicted to enter the field of view in the future due to the movement of the viewpoint and the rotation speed in the line of sight direction and the same predicted three-dimensional object before the viewpoint movement exceeds a predetermined certain amount. The priority setting unit 12 resets the priority of the predicted three-dimensional object. Then, the three-dimensional object extracting unit 13 reselects the three-dimensional object, and the scheduling unit 14 resets the transmission schedule. Further, the priority setting unit 12 resets the priority according to the change in the moving speed of the viewpoint and the rotation speed in the line-of-sight direction. Re-select the 3D objects so that they do not exceed the capacity limit,
The scheduling unit 14 resets the transmission schedule of the three-dimensional object.

In the three-dimensional data transmission / display system, when the moving speed of the viewpoint or the rotation speed in the line of sight changes, the upper limit value of the total amount of the transmission data capacity, the degree of detail of the three-dimensional object, and the transmission schedule are set. The operation of transmitting a three-dimensional object by streaming will now be described with reference to the flowchart of FIG.

It is assumed that the moving speed of the viewpoint or the rotational speed in the line of sight has changed. The client terminal 20 transmits a change in the moving speed of the viewpoint or the rotational speed in the line of sight to the server 1.
Notify 0. Upon receiving notification of a change in the viewpoint moving speed or the line-of-sight direction rotation speed, the transmission data capacity adjusting unit 1
1 calculates the amount of change in the moving speed of the viewpoint or the rotational speed in the line of sight, that is, the degree of change. (S400
1, calculation step). The degree of change of the upper limit value of the total transmission data amount of the three-dimensional object with respect to the change amount (degree of change) of the movement speed of the viewpoint or the rotation speed in the line-of-sight direction is determined according to a predetermined rule,
The upper limit is reset (S4002, upper limit resetting step). The predetermined rule is that, for example, the upper limit is such that the greater the degree of change of the viewpoint moving speed or the line-of-sight rotation speed, the greater the degree of change of the upper limit of the total amount of transmission data capacity. In addition, the smaller the degree of change of the viewpoint moving speed or the line-of-sight direction rotation speed, the smaller the degree of change of the upper limit value of the total amount of the transmission data capacity. In this way, when the upper limit value is changed, the transmission data capacity adjusting unit 11 leaves a certain amount of untransmitted data from the present time (at the time of changing the upper limit) of the transmission schedule and saves the remaining untransmitted data. The transmission is interrupted, and the transmission schedule of the data whose transmission is interrupted is discarded (S4003, transmission schedule discarding step). Thereafter, the above steps S1004, S1005, S1006, S10
The processing indicated by 07 is executed.

Thus, even if the movement speed of the viewpoint or the rotation speed in the line-of-sight direction changes, the upper limit value of the total transmission data amount of the three-dimensional object, the degree of detail of the object, and the transmission schedule are appropriately changed. ,
Transmission of a three-dimensional object that achieves best-effort display quality without lowering the operability (frame rate of switching display) of an operation involving movement of the user's viewpoint;
Display can be realized.

In order to reduce the level of detail and, in some cases, to control the quality of the display, such as by reducing the number of three-dimensional objects to be transmitted, the spatial region currently in view and the The upper limit value of the total transmission data capacity of the three-dimensional object existing in the space area predicted to enter the field of view due to the movement of the viewpoint is changed. The switching frame rate of the video displayed by the viewer of the client terminal 20 is not reduced.

Embodiment 5 FIG. FIG. 8 is a functional block diagram of the three-dimensional spatial data transmission and display system according to the fifth embodiment.

As shown in FIG. 8, reference numeral 20 denotes a client terminal 20 of the three-dimensional spatial data transmission / display system according to the present invention, which is connected to a communication network 40 such as the Internet or an intranet. 21 is a request unit. The request unit 21 is a request unit that issues a request for transmitting a three-dimensional object to the server. 22 is a receiving unit. The receiving unit 22 sequentially registers and stores the three-dimensional objects sequentially transmitted in object units from the server in the main storage device or the auxiliary storage device in the order in which the three-dimensional objects are received.
The receiving unit sequentially requests the scene configuration management unit 23 described later to add processing to the scene. 23 is a scene configuration management unit. The scene configuration management unit 23 is a scene configuration management unit that adds the three-dimensional object notified from the reception unit 22 to the scene configuration information database 27 (scene graph) in the three-dimensional space. 24 is a display management unit. The display management unit 24 is a display management unit that indicates the degree of detail of the three-dimensional object to be displayed. 25 is a rendering unit. The rendering unit 25 is a rendering unit that renders a scene in a three-dimensional virtual space viewed from a viewpoint based on scene configuration information registered in the scene configuration information database 27. 26 is a task adjustment unit. The task adjustment unit 26 monitors the processing status of the request unit 21, the reception unit 22, the scene configuration management unit 23, the display management unit 24, and the rendering unit 25, and determines the switching speed (frame rate) of the scene rendered by the rendering unit 25. A task adjustment unit that adjusts the processing time of each unit so as to maintain the specified constant speed. 27 is a scene configuration information database. The scene configuration information database 27
This is a database that stores three-dimensional object data that forms a three-dimensional space. The scene configuration information database 27 is assumed to be in the main storage device or the auxiliary storage device of the client terminal.

In the client terminal 20 having the components 21 to 27, a series of processes executed by the requesting unit 21, the receiving unit 22, the scene configuration managing unit 23, the display managing unit 24, and the rendering unit 25 are performed in a fixed manner. Each component is made to function so as to be repeatedly executed at time intervals. That is, each component is caused to function such that the number of times of switching (frame rate) per unit time, which is switched and displayed in the rendering unit 25 of the client terminal 20, is kept constant.

First, the function of the scene configuration management unit 23 will be described. The scene configuration management unit 23 allocates the processing time instructed by the task adjustment unit 26 per one frame switching time to the terminal CPU in the scene configuration management step. Then, in the receiving step, the receiving unit 2
The data of the three-dimensional object notified from 2 is analyzed for registration in the scene configuration database, converted into a data structure for the scene configuration database based on the analysis result, and the converted data is added to the scene configuration database. , Etc. are performed. Therefore, each process of adding the object notified from the receiving unit 22 to the scene configuration database (data reading process (A), conversion process of the read data (B), addition of the converted data to the scene configuration database) Processing (C)
), The processing is distributed so as to be completed within the allocated time (T). (Time of process (A) + time of process (B) + time of process (C) ≦ time (T)) Therefore, for example, the process of reading data of the object (1) that has received the reception notification from the receiving unit 22 ( A)
And the time of the data conversion processing (B) are:
Although the processing can be performed within the allocated time (T), if the processing is performed up to the addition processing (C) to the scene configuration database, the processing may exceed the allocated time (T). In this case, the processing (A) and the processing (B) for the object notified from the receiving unit 22 are processed at the allocated time. The remaining processing (C) is performed at the next switching frame. That is, when the processing of the object (2) received next to the object (1) is performed, the remaining processing (C) is also performed. When each processing time is short, for example, the received object (1)
(A), (B), and (C), if there is a considerable margin, if the reception processing of the next received object is completed and waiting, the next object The processing of (A), (B), and (C) in (2) is performed in the switching frame until the allocated time is exceeded.

The processing for adding to the scene configuration database is as follows:
If a case occurs in which the task adjustment unit 26 cannot perform the processing within the designated time, an instruction / request is issued to the task adjustment unit 26 so as to adjust the size of the transmission object such as reducing the data size of the object to be transmitted. Or,
An instruction / request is issued to the task adjustment unit 26 so as to increase the allocation of the processing time of the scene configuration management unit 23.

If the viewpoint is moved or the line of sight is rotated, even if the same object is displayed, the degree of detail of the object required for display is different. For example, as shown in FIG. 7, when the user's viewpoint moves from viewpoint A to viewpoint B, the object X drawn in the field of view Y is located at the position of viewpoint B rather than at the position of viewpoint A. When viewing, the distance from the viewpoint to the object is shorter, so that the degree of detail is higher. In this way, the server 10 stores only data of various levels of detail of the same object necessary for display in accordance with viewpoint movement or rotation in the line of sight, and only difference data from previously transmitted data in the order of display.
Transmit the data in order. At this time, the scene configuration management unit 23 checks the identification information contained in the received packet received from the server 10, and then determines whether or not the object has transmitted only the difference data. If it is a difference object, it is checked whether the polygon data among the data constituting the three-dimensional object has been changed. If it has been changed, the scene configuration data of the object is deleted from the scene configuration information database 27, scene configuration data based on the newly received polygon data is added to the scene configuration information database 271, and texture data is added. If the polygon data has not been changed, if there is no possibility that the object will be displayed with the detail level before the change in the future, the texture data used so far is discarded. When there is a possibility, the texture data used to display with the detail before the change and the texture data that may be used to display with the detail after the change can be switched and displayed according to the viewpoint position. , Scene configuration information database 27
Add to The scene configuration management unit 23 determines whether the processing time allocated by the task
From the processing capacity of U, the upper limit of the data capacity of the object to be added to the scene configuration data is determined per unit interval, and the processing time allocated by the task adjustment unit 26 is changed. The upper limit of the data capacity of the object to be
Reset using the processing capacity of the PU.

The scene configuration management unit 23 registers the received three-dimensional object in the scene configuration information database 27 within the processing time per one frame switching display time instructed by the task adjustment unit 26. Further, when the registration cannot be performed within the time, the task adjustment unit 26 is requested to change the allocation of the processing time. The operation of registering in the scene configuration information database 27 and the operation of requesting the task adjustment unit 26 to change the allocation of the processing time will be described with reference to the flowchart of FIG. After the display screen is switched by the rendering, after receiving the reception notification of the object from the receiving unit 22, the object is selected from the three-dimensional objects indicated in the received notification in order from the object with the shortest reception completion time. The number of objects to be selected is determined by predicting the processing time required for reading data, converting data, and registering a scene from the data size of the object. In step S5001, a number is selected that is predicted to be able to be processed. Then, the data of the object is read from the temporarily stored main storage or auxiliary storage, and the data is converted into a data structure that can be registered in the scene configuration database (S50002). This conversion processing is unnecessary when the server has already converted and transmitted the converted data. If there is no registration data, the process ends. The number of objects to be selected depends on the data reading process that is statistically predicted from the data size of the objects,
It is determined from the time required for the data conversion processing and the processing for adding to the scene configuration database. The processing time is calculated by calculating the number of processing steps statistically predicted from the data size of the object and the processing time from the processing speed of the CPU of the client terminal 20. After the data conversion, the object is additionally registered in the scene configuration database (S5).
0003). After the additional registration and the screen switching, the processing of the scene configuration management unit 23 is executed by the CPU of the client terminal 20.
Check whether the total time processed by the user exceeds the processing time allocated by the task adjusting unit 26.

(A) If it does not exceed, and if there are received objects that have not been registered in the scene configuration information database 27, if the received processing completion time of the unprocessed objects is the earliest object, At the shortest time, an object is determined for which it is determined that the data reading process, the data converting process, and the adding process to the scene configuration information database 27 are possible. If not, the processing of the scene configuration management unit 23 ends. When an object is selected, a process of additionally registering the selected object in the scene configuration information database 27 is performed. This is to absorb a prediction error and realize more efficient processing of adding data to a scene. The prediction error is reflected in the statistical data of the processing prediction, and efforts are made to improve the accuracy of the next prediction. (B) If it exceeds, if only one object has been registered in the scene configuration information database 27, registration processing to the scene cannot be performed in the processing time allocated by the task adjusting unit 26. . Therefore, when such a process of registering one object in the scene configuration information database 27 is continued for a certain period of time (S50004), the process of not completing the process within the allocated processing time is performed. 26 is requested to change so as to increase the allocation of the processing time of the scene configuration management unit 23 (S50005). Here, the required time required for both the "data reading process + data conversion process" and the "registration process to the scene configuration database" to be processed within the processing time was checked. But,
The “data reading process + data conversion process” and the “registering process in the scene configuration database” may be processed separately in separate frames. For example, 2 or 3
It is also possible to perform an additional process for one object during the frame switching. When additional processing is performed between two frames, “data reading processing and data conversion processing” and “scene registration database registration processing” are performed between the first and second frames. When additional processing is performed during the switching of the third frame, “data reading processing, data conversion processing” is performed between the first and second frames, and “addition processing” is performed between the second and third frames. Registration process to scene configuration database ". Further, depending on the situation, the above-described processing may be performed in a time-division manner and performed between switching of a plurality of frames. By doing so, even if the processing time of the additional registration processing to the scene becomes considerably long, the additional registration of the object to the scene can be performed without changing the frame rate. However, in this case, an object that is not displayed even when the viewpoint is moved may occur. Further, if an object having an excessively large size is added, the rendering processing time increases, and eventually, there is a high risk that the designated frame rate cannot be maintained.

The function of the display management unit 24 will be described.
The display management unit 24 monitors an instruction of a rendering method by the rendering unit 25 and a time required for the rendering process. If the required rendering time exceeds the processing time allocated by the task adjusting unit 26, the control method of the display quality is changed so that the rendering processing time is shortened, or the task adjusting unit 26 increases the rendering processing time. Give instructions. As a result, display management is performed so that rendering processing can be performed within the processing time allocated by the task adjustment unit 26 as much as possible. The display management unit 24
In the display management step, the display switching frame rate is adjusted by adjusting the degree of detail for displaying the three-dimensional object. That is, if the level of detail is small, the amount of three-dimensional object data is small, so that the time for display is short and the frame rate can be increased. Conversely, if the degree of detail is large, the amount of three-dimensional object data is large, so that the time for display is long and the frame rate is reduced.
Furthermore, the upper limit of the viewpoint moving speed is determined according to the display quality set by the number of objects that are not displayed but are not transmitted from the server, the occupancy of the display area of the objects, and the priority of the objects. Set. For example, if the number of untransmitted objects is larger than the server, the occupancy of the object is large, and the priority is high, the amount of data to be transmitted increases, and the time required for transmission increases. For this reason, the upper limit of the moving speed of the viewpoint is set lower, and the amount of three-dimensional object data required for display is suppressed. Also, the upper limit of the line-of-sight direction switching (rotation) speed is adjusted. The display management unit 24
Alternatively, the task adjustment unit 26 adjusts the display switching frame rate by adjusting the upper limit value of the viewpoint moving speed or the line-of-sight direction switching (rotation) speed.
For example, when the moving speed is high, the frame rate is increased, and when the moving speed is low, the frame rate is reduced. Whether the moving speed is fast or slow is determined by setting a reference moving speed in advance and comparing with the set reference speed. The display management unit 24 adjusts the reception rate of the three-dimensional object received from the server by adjusting the upper limit value of the viewpoint moving speed or the line-of-sight direction switching (rotation) speed. When the speed is high, the reception rate is reduced by reducing the speed upper limit value. When the speed is high, the data amount of the object to be transmitted per unit time increases, so that the display switching rate (frame rate) decreases. Therefore, in such a case, the moving speed and the rotating speed are reduced for the purpose of reducing the transmission rate. The reason why the upper limit of the same speed is restricted is to enable movement at a speed lower than the upper limit. When the speed is low,
By increasing the upper limit, the reception rate is increased to increase the reception rate.

The operation of the display management unit 24 for managing the display as described above will be described. Display management unit 24
If the rendering processing exceeds the allocated processing time, or if the number of objects arriving per unit time decreases due to communication channel congestion, the number of objects with high detail at the time of rendering is reduced. The display quality of the object is controlled to reduce the degree of detail so as to reduce the number. Even if the adjustment is performed, the rendering processing time will be exceeded, and if there is a large number of objects for which display data has not yet been transmitted even if an attempt is made to display, the task adjustment unit 26 is required to increase the rendering processing time. Request. In the display management unit 24, as described above, LOD (LOD is Level of data
Abbreviation for l. As soon as the method of level of control (degree of detail) control is changed, the request unit 21 is instructed to notify the server of the changed display LOD realization method. As a result, data transmitted from the server in the future will be transmitted in accordance with the LOD.

The display management unit 24 renders a three-dimensional space image to be rendered by the rendering unit 25, that is, a screen display strategy for determining how to determine the degree of detail of each object display, and the user's viewpoint position. , A viewing direction, a viewing angle, a screen display size, a screen resolution, and the like are notified to a viewer having an object display function of the rendering unit 25. The screen display strategy is, for example, a screen display strategy for determining the degree of detail of the object so that the object can be displayed in the rendering processing time instructed by the task adjusting unit 26, a distance from the viewpoint to the object to be displayed. Object when the viewer displays the object, such as a screen display strategy that determines the degree of detail of the object according to the object, or a screen display strategy that sets the degree of detail higher for objects closer to the line of sight. Is a method of determining the level of detail. When there is no data of the three-dimensional object in the region to be displayed, the display management unit 24 determines the viewer's viewpoint position, line-of-sight direction, viewing angle, screen display size, screen resolution, display switching frame rate, and screen display. The request unit 21 is requested to transmit the data of the three-dimensional object necessary for display, together with the strategy, the CPU speed of the client terminal, the presence / absence of a hardware acceleration card in the client terminal, the memory capacity, and the like. If the rendering process cannot be completed within the designated time continuously for a certain period of time, the task adjustment unit 26 is requested to increase the time allotted for the rendering process. Also, if the rendering process has been completed for a certain amount of time within the specified amount of processing time within a certain amount of time, the task is adjusted to reduce the time allocated for rendering Request the part 26. For example, the designated time is 3 seconds, and the rendering unit 25
If the processing time of 1 second ends for 5 seconds, it can be determined that there is room for the processing by the rendering unit 25, so that the processing time allocated to the rendering unit 25 can be reduced. The display management unit 24 may change the display strategy or instruct the server to change the display strategy based on the display status.

The function of the rendering unit 25 will be described. The rendering unit 25 determines the viewpoint position, line-of-sight direction,
Scene information is extracted from the scene configuration information database 27 according to the viewing angle, the screen display size, the screen resolution, and the screen display strategy. Then, using the extracted scene information, the video of the scene to be displayed on the display screen is rendered (drawn).

The function of the request unit 21 will be described. The request unit 21 processes a request (request) received from each unit in a request step. The received request is a request to the server, and transmits a request received from each unit to the server to request transmission of three-dimensional object data.

The function of the receiving section 22 will be described. In the receiving step, the receiving unit 22 allocates the reception processing time per frame specified by the task adjustment unit 26 to the processing of the CPU, and performs the reception processing of the three-dimensional object data transmitted from the server. The reception process temporarily stores the received data in the main storage device and the auxiliary storage device, and when the storage process is completed, notifies the scene configuration management unit 23 that the object has been received.

The operation of the receiving unit 22 when the receiving process is not completed within the processing time allocated by the task adjusting unit 26 will be described. If an object that cannot be received within the processing time designated by the task adjusting unit 26 occurs more than a specified number of times during a certain period of time, the task adjusting unit 26 is requested to increase the receiving processing time. When an instruction to increase the reception processing time of the reception unit 22 is received from the task adjustment unit 26, the reception processing is performed according to the instruction. If the processing is not completed within the designated reception processing time even if the reception processing is increased, or the task adjustment unit 26
Requesting the request unit 21 to instruct the server to adjust the size, the degree of detail, and the transmission rate of the object of the transmission data when there is an instruction that the time cannot be used for the reception processing. I do. If the number of objects that occur for a certain period of time exceeds the specified value for objects whose reception processing time exceeds the specified time, if the communication speed of the communication path is lower than the assumed communication speed, Requesting unit 21 to instruct the server to lower the transmission rate
Ask for If it is determined that the processing time has been exceeded due to the large data size of the receiving object,
The request unit 21 is requested to issue an instruction to the server to subdivide the size of the transmission object.

The function of the task adjusting unit 26 will be described. In the task adjustment step, the task adjustment unit 26 includes the request unit 21, the reception unit 22, the scene configuration management unit 23,
The processing status of the display management unit 24 and the rendering unit 25 is monitored, and the processing time of each unit is adjusted so that the switching speed (frame rate) of the scene to be rendered by the rendering unit 25 is maintained at a specified constant speed. The requesting unit 21, the receiving unit 22, the scene configuration managing unit 23,
The display management unit 24 and the processing time allocated to each unit of the rendering unit 25 are reset.

The operation of the task adjusting section 26 for adjusting the processing time of each section will be described below. Task adjustment unit 26
When a request for changing the allocation of processing time is received from each unit, the processing time of each unit is reallocated according to the processing status and processing prediction of each unit so as to satisfy the request as much as possible. Further, the task adjustment unit 26 forcibly changes the allocation time even if there is no request to change the allocation from each unit, that is, even if each unit has completed the processing within the scheduled processing time. An example in which the assigned time is forcibly changed will be described. The fact that the processing is completed in each unit at the scheduled time is considered to be sufficient for the processing in each unit. Therefore, when it can be determined that the data capacity of the three-dimensional object to be displayed is likely to be large, the allocation time is forcibly changed so that the processing time of the receiving unit 22 becomes long. When it is determined that the adjustment of the allocation time is impossible, the allocation time of the process is changed by changing the frame rate. Further, the request unit 21 is requested to the server to change the level of detail of the object to be transmitted, the number of objects, and the transmission rate. Whether to change the frame rate or request the server to change the frame rate is determined depending on whether the non-adjustable situation is temporary or may be prolonged. If it is determined that the disabled state is temporary, the frame rate is temporarily changed to take measures. The determination of whether the disabled state is temporary or not is, for example, if the state of the congestion has changed to a disabled state due to a change in the congestion state of the communication path, statistically, over a long period of time, the congestion state must be resolved. Except when it is judged, the frame rate is changed temporarily in principle. However, if a predetermined time is set in advance, and adjustment continues beyond the set time,
If it is determined that the period is to be prolonged, and if the situation in which adjustment is not possible ends within the set time, it is determined to be temporary. If it is determined that the time will be extended, a change to the server is requested at that time. In a case where the state becomes impossible due to an increase in data transmitted from the server, a message for confirming the transmission schedule is transmitted to the scheduling unit 14 of the server. After examining the transmission schedule,
If it is confirmed that the same data amount or more data will be transmitted in the future, the server is requested to change the data to be transmitted. For example, an instruction is given to change the level of detail of the object. Also, send the data of the object with the level of detail that matches the specified screen display strategy, or formulate an optimal screen display strategy that is different from the current one, and Instructs the server to send data for the object. In addition, data temporarily increases,
If it is confirmed that the error will be resolved after a certain period of time, the problem is dealt with by changing the frame rate. Whether the data is temporarily high or not,
The determination can be made by checking the scheduling unit 14 of the server. The task adjustment unit 26 determines
And adjust the processing time of each unit so as to maintain the specified frame rate as much as possible.

By providing the above-described components in the client terminal 20, the frame rate can be kept constant even if the communication speed of the communication path changes or the data of the three-dimensional objects forming the three-dimensional space varies due to the density. It is possible to easily realize the best effort display quality.

Next, the processing performed by the task adjusting unit 26 to maintain the display switching speed (frame rate) will be described. If the designated display switching frame rate cannot be maintained because the reception processing time in the receiving unit 22 exceeds the processing time allocated by the task adjusting unit 26, adjustment is performed to increase the current switching display frame rate. . For this, the task adjustment unit 2
6 instructs the request unit 21 to issue a request to the server to transmit the three-dimensional object according to the reception data rate at which the reception processing is completed within the time allocated to the reception unit 22. When there is room in the processing in each unit other than the receiving unit 22, the extra space is allocated to the receiving unit 2.
In this case, the total of the processing times of the above series of processes is not changed. Therefore, if there is no allowance, the allocation of the processing time of the receiving unit 22 cannot be changed. Therefore, the server is requested to reduce the amount of data transmitted per unit interval.

If it is determined that such a situation that the receiving processing time of the receiving unit 22 becomes long is temporary,
The frame rate is temporarily lowered, and the process waits until the reception processing time is completed within the processing time allocated by the task adjustment unit 26. The determination as to whether or not it is temporary may be that the receiving process of the receiving unit 22 is longer than expected, even though the server originally transmitted the data assuming the receiving rate of the receiving unit 22 of the client. It is determined that the reason why the reception processing time of the reception unit 22 is long is due to the congestion of the communication path. Therefore, it is determined that the predetermined time period is temporary. If it is not resolved even after a certain period of time, it is determined to be long. If it is determined that the reception processing is to be performed for a long time, the object is transmitted at a transmission rate such that the reception processing is completed within the reception processing time reassigned to the reception unit 22 by the task adjustment unit 26 in consideration of the congestion state of the communication path. Thus, the request is made to the server via the request unit 21.

Further, in the task adjusting section 26, the rendering processing time becomes longer, and the above series of processing exceeds the designated frame rate. In addition, a description will be given of a process performed when an object to be added to the scene configuration data includes an object that is not currently displayed. With respect to the scene configuration data, the process of adding some or all of the same objects that are not currently displayed is temporarily suspended. As a result, the scene configuration management unit 2
The processing time of step 3 is reduced, and an instruction is issued to the scene configuration management unit 23 so that the frame rate of the client approaches the designated frame rate. When the client attempts to additionally register in the scene configuration database sent from the server, it is determined whether or not the object is the current display target object, and after confirming that the object is the display target object, the registration to the scene configuration information database 27 is performed. To do. By performing such a check immediately before registration in the scene configuration information database 27, the object to be displayed can be preferentially registered in the scene. Therefore, the suspension of the addition to the scene can contribute to maintaining the frame rate. When the distance from the viewpoint position is longer than a certain value, the temporarily held object is determined not to be displayed, and the data itself is discarded. Until then, it will be held as an object that can enter the field of view. Furthermore, if the distance between the pending object and the viewpoint is equal to or less than a certain value, there is no object that has not yet been subjected to the process of adding the currently displayed object to the scene, and the rendering processing time is Only when the processing time allocated by the task adjusting unit 26 does not exceed the time, additional registration to the scene is performed.

In the task adjusting unit 26, when the rendering processing time becomes longer and the series of processing exceeds the designated frame rate, the rendering processing time is shortened to approach the designated frame rate. Thus, the display management unit 24 is instructed to reset the detail level of the object to be displayed. Alternatively, it instructs the request unit 21 to request the server to review the setting of the level of detail of the object to be transmitted. If the rendering time is longer than a certain processing time than the processing time allocated by the task adjusting unit 26, if there is an object that can change the level of detail of the object to be displayed on the display management unit 24, it is displayed. To change the setting of LOD. As a result, the time required for the rendering process is reduced as much as possible, and an effort is made to set the screen switching display speed to the specified frame rate. If the period during which the display management unit 24 needs to adjust the level of detail continues for a certain period of time or more, an instruction to adjust the level of detail of the object to be transmitted is sent to the server via the request unit 21. put out. If the rendering processing time is less than the above-mentioned certain time, the frame rate is slightly reduced until the certain time passes, but the processing is continued as it is. If the rendering processing time exceeds the processing time instructed by the task adjusting unit 26 even after the fixed time has elapsed, the request unit 21 is instructed to change the setting of the level of detail of the object transmitted to the server. At the same time, the display management unit 24 is instructed to change the level of detail of the display object and reduce the rendering processing time.

Embodiment 6 FIG. In the present embodiment, by changing the degree of detail of an object to be transmitted according to a change in the moving speed of the viewpoint or the rotational speed in the line of sight, the moving speed of the viewpoint or the rotational speed in the line of sight can be changed on demand by the user. A three-dimensional spatial data transmission / display system will be described which always enables display at a specified frame rate, even if the system is changed to.

A series of processes performed by the request unit 21, the reception unit 22, the scene configuration management unit 23, the display management unit 24, and the rendering unit 25, and the transmission data capacity adjustment unit 11 in the server , The priority setting unit 12, the three-dimensional object extraction unit 13, the scheduling unit 14, the streaming transmission unit 15.
The total processing time required for a series of processing performed by
A frame rate maintenance unit that suppresses a display screen within a switching interval time that achieves a specified frame rate will be described.

FIG. 10 is a functional block diagram of the three-dimensional spatial data transmission / display system according to the sixth embodiment. FIG.
At 0, the same reference numerals as those in FIGS. 1 and 8 indicate the same or corresponding parts. Reference numeral 30 denotes a frame rate maintenance unit. The frame rate maintenance unit 30 changes the degree of detail of the object to be transmitted according to the change in the moving speed of the viewpoint or the rotation speed in the line of sight, or the available communication speed (communication band) of the communication path at the time of transmission. The request unit 2 in the client terminal 20
1. a series of processing performed by the reception unit 22, the scene configuration management unit 23, the display management unit 24, the rendering unit 25, and the task adjustment unit 26, and the transmission data capacity adjustment unit in the server 11, the priority setting unit 12, the three-dimensional object extraction unit 13, the scheduling unit 14, the streaming transmission unit 1.
5 is a frame rate maintenance unit that suppresses the total processing time required for a series of processing performed in step 5 within a switching interval time of a display screen that realizes a specified frame rate. The frame rate maintenance unit 30
The client terminal provided in the server 10 is monitored, and an instruction is given to each of the units 11 to 15 of the server 10 based on the monitored result.

The function of the frame rate maintenance unit 30 will be described. When the viewpoint moving speed or the line-of-sight rotation speed changes, it enters the field of view per unit time. Alternatively, the region size of the display target space region predicted to enter the field of view changes. As the size of the display target space area changes, the number of three-dimensional objects and the data amount included in the space area change. Further, even if the moving speed of the viewpoint and the rotational speed of the line of sight do not change, the amount of data that must be transmitted from the server 10 to the client terminal 20 per unit time is constantly changing depending on the density of the objects in the three-dimensional space. Change. Therefore, the change in the viewpoint moving speed or the line-of-sight rotation speed, or the movement of the viewpoint, or the data capacity transmitted by the server that changes in accordance with the rotation of the line of sight, is changed by changing the level of detail of the object to be transmitted. By changing the selection method, the switching speed (frame rate) of the space display at the client terminal 20 is kept constant.

Further, the three-dimensional object newly entering the field of view due to the movement of the viewpoint or the rotation of the line of sight is transmitted from the server 10 to the client terminal 20 for display. 22, the scene configuration management unit 23, the display management unit 24, the rendering unit 25, the task adjustment unit 26, the transmission data capacity adjustment unit 11, the priority setting unit 12, the three-dimensional object extraction unit 13, By performing a series of processes performed by the scheduling unit 14 and the streaming transmission unit 15 within one frame (display) switching interval for realizing the specified frame rate, the processing is always performed at the specified frame rate. It is possible to display a dimensional space.

When the congestion state of the communication path changes, the degree of detail of the object transmitted by the server is changed according to the available communication speed (communication band) that changes due to the change in the congestion state of the communication path. By changing the amount of data that the server sends to the client per unit time, the above series of processing can be performed within one frame (display) switching interval that achieves the specified frame rate, and is always possible. , Realizing display of a three-dimensional space at a designated frame rate.

When the amount of data that must be transmitted from the server 10 to the client terminal 20 per unit time changes every moment in accordance with the movement of the viewpoint, the rotation of the line of sight, the change in the viewpoint movement speed, or the rotation of the line of sight, Frame rate maintenance and management in which the series of processes described above are processed within one frame (display) switching interval for realizing a specified frame rate by changing the degree of detail of an object to be transmitted and changing a method of selecting a transmission object. The operation of the unit 30 will be described.

By moving the viewpoint or rotating the line of sight, the server 1
From 0, the amount of data that must be transmitted per unit time to the client terminal 20 changes according to the sparse density of the three-dimensional objects in the three-dimensional space. When the viewpoint moving speed or the line-of-sight rotation speed changes as appropriate, the number of three-dimensional objects entering the field of view per unit time changes according to the change. Therefore, the data capacity of the object that must be transmitted from the server to the client per unit time depends on the density of the space coming into the field of view when the viewpoint moves or the line of sight rotates, the viewpoint moving speed / the line of sight rotation speed, or the speed of the line of sight rotation. It changes according to the change. At this time, if the data capacity to be transmitted per unit time is equal to or less than the available communication speed of the communication path, the level of detail of the object is not changed. However, if the transmission speed is equal to or higher than the communication speed, the degree of detail of the object is changed, and the transmission data capacity per unit time is reduced to the transmission bandwidth that can be used in the communication path at the time of transmission. Furthermore, the total time required for the series of processes, such as the time required for the object transmitted to the client terminal 20 to register in the scene configuration information database 27 and the rendering process in the client terminal 20, is specified. The processing status of each unit is monitored to see if it is within one frame (display) switching interval time for realizing the frame rate. If the processing time exceeds, the setting method of the degree of detail of the object is changed so that the processing time falls within the same interval time. Further, in such adjustment of the degree of detail, if the processing time cannot be kept within the same interval time, it is necessary to set the degree of detail of the object of the display screen to be watched so as not to change as much as possible. Rather than transmitting and displaying all objects, priority is given to transmitting and displaying main objects, thereby reducing the amount of transmission data and maintaining the switching display frame rate. However, if the area that has once entered the field of view reenters the field of view, or has entered the field of view, but after a certain period of time without being displayed, the viewpoint has stopped moving or the viewpoint moving speed has slowed down. When the data capacity of an object that needs to be transmitted per time is reduced, untransmitted data is transmitted from the server by the reduced data capacity. Further, when the transmission data capacity has room, the server 10 additionally transmits data for increasing the degree of detail of the data in the field of view using the band in which the space has occurred. At the time of submission,
Because the amount of transmitted data was large, the level of detail of the display was set low, and the level of the transmitted and displayed object was low, but the viewpoint movement speed was slow, and the amount of transmitted data was small. Attempts to return the detail level setting to its original setting. At this time, since the detail level is reset to a higher level as a whole, a detail level different from the detail level of the already displayed object may be reset. As described above, the difference between the detail level of the object at the time of transmission and the object having the difference caused by the change in the setting rule of the display detail level of the object in the current field of view is transmitted.

Due to the change in the communication band of the communication path,
The method of changing the degree of detail of the object in accordance with the change in the data transmission capacity per unit time of the server is the same as in the case where the moving speed of the viewpoint is changed. That is, the data capacity per unit time transmitted from the server is changed to be smaller as the communication band of the communication path becomes smaller. The reverse is also true.

Embodiment 7 FIG. In the present embodiment, the display switching frame rate (the number of switching times / second) in the client terminal 20 is recognized as a rate value calculated from an average value of a certain period of time specified as the processing time required for the series of processes. In order to maintain the frame rate at the designated frame rate (rate value), the level of detail of the object to be transmitted and the object data existing in the spatial region predicted to enter the field of view of the client terminal 20 within the above-mentioned fixed time Client terminal 2 from inside
A task adjustment unit 26 that requests the server to adjust the upper limit of the total data capacity of the object selected as the object to be transmitted to 0; and an adjustment of the detail level of the object in response to the request of the task adjustment unit 26. The three-dimensional object extracting unit 13 of the server that performs the setting and the transmission data capacity adjusting unit 11 that changes the setting of the upper limit will be described.

In the task adjusting unit 26 of the three-dimensional spatial data transmission / display system described in the second embodiment, the frame rate realized by the viewer of the client terminal is approximated to the number of display switching per unit time (frame rate). , The frame rate detected every moment is adopted as the frame rate of the terminal. However, in the present embodiment, the average value of the frame rates detected during the specified fixed time is adopted as the frame rate of the client terminal. In addition, the length of the designated fixed time is adjusted according to the fluctuation state of the frame rate. This makes it more difficult to maintain the frame rate due to the processing overhead caused by the above-mentioned series of processing changes that frequently occur when the frame rate detected by the terminal frequently and slightly fluctuates up and down, This solves the problem that the controllability is inferior, and the amount of data transmitted from the object is correspondingly reduced, and the time allotted for display is reduced, and the display quality is worsened.

The task adjustment unit 26 specifies the frame rate for switching the display at the client terminal 20, that is, the rate value calculated from the average value of a certain period of time specified as the processing time required for the series of processes. When the rate value is smaller than the specified rate value, in order to make the display switching frame rate in the client terminal 20 close to the specified rate value, that is, to reduce the processing time required for display, the detail level of the object is changed from the current state. A request is made to the three-dimensional object extraction unit 13 to reset (change) to a smaller value, and to the transmission data capacity adjustment unit 11 to reduce the upper limit. Upon receiving the request, the three-dimensional object extraction unit 13 reduces the data capacity of the transmission object by reducing the degree of detail of the object to be transmitted. As the data capacity of the transmission object decreases, the reception processing time, the addition processing to the scene configuration database, and the rendering processing time decrease accordingly. Thereby, the series of processing time is reduced.
Therefore, the total processing time required to switch the display once decreases, thereby increasing the display frame rate.

A method for dealing with the case where the calculated frame rate becomes larger than the designated rate value is as follows. (1) When the frame rate of the client terminal 20 increases due to an increase in the available communication speed of the communication path, the three-dimensional object extraction unit 13 specifies the level of detail of the transmission object in advance. Alternatively, compared to the detail level of each object calculated assuming the available communication speed in a state where the communication path is free of congestion, if it is coarse and small, the detail level of each object is more limited up to the assumed detail level. Make sure to set it high in detail.
Further, the transmission data capacity adjustment unit 11 increases the upper limit of the total amount of the transmission data capacity. (2) If the available communication speed of the communication channel has not changed, the three-dimensional object extraction unit 13 and the transmission data capacity adjustment unit 11 continue the processing without changing anything. Further, by adjusting the display switching frame rate at the client terminal 20, that is, the length of a certain time designated as the processing time required for the series of processing, the degree of detail of the object to be transmitted or the data capacity of the object is adjusted. Is adjusted so as to reduce the frequency of adjustment or to follow finer changes in frame rate. The longer the fixed time is, the easier it is to absorb fluctuations in the frame rate up and down, so that the fluctuation width becomes gentler than the actual fluctuation in the frame rate. Therefore, the number of times (frequency) of changing the processing method of the three-dimensional object extraction unit 13 and the transmission data capacity adjustment unit 11 can be reduced. Conversely, if the display switching frame rate in the client terminal 20, that is, the same fixed time specified as the processing time required for the series of processing is shortened, the details of the object data transmitted more sensitively to the fluctuation in the frame rate are reduced. The data capacity can be changed at any time. When the frame rate for displaying the virtual space of the client terminal 20 rises above the designated value, the server 10
Increases the transmission data rate or resets the transmission object to a higher level of detail. When the frame rate for displaying the virtual space of the client terminal 20 falls below the specified value, the server 10 reduces the transmission data rate or resets the transmission object to a lower level of detail.

[0135]

Since the present invention is configured as described above, it has the following effects.

A three-dimensional spatial data transmission display system according to the present invention, a three-dimensional spatial data transmission method, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission method,
In a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission and display method,
Adapting to the degree of change in the available transmission speed of the communication path that changes according to the congestion situation that changes every moment of the communication path,
The upper limit value of the data capacity of the three-dimensional object data selected as the three-dimensional object data transmitted from the server device to the client device is reset. For this reason, transmission of three-dimensional object data can be realized in response to a change in the available transmission speed of the communication path that changes according to the congestion situation that changes every moment on the communication path. This has the effect of improving transmission efficiency.

A three-dimensional spatial data transmission / display system according to the present invention, a three-dimensional spatial data transmitting method, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmitting method, In a computer-readable recording medium storing a program for causing a computer to execute the spatial data transmission and display method and the three-dimensional spatial data transmission and display method, the server device registers and stores the three-dimensional object data of the transmission destination client device. The upper limit value of the data capacity to be transmitted to the client device per a predetermined unit time is reset according to the degree of change in the total capacity of the available memory. Therefore, there is an effect that an object having an appropriate data capacity can be efficiently transmitted in response to a change in the total capacity of the memory capable of registering and storing the three-dimensional object data of the client device.

A three-dimensional spatial data transmission / display system according to the present invention, a three-dimensional spatial data transmitting method, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmitting method, In a computer-readable recording medium on which a program for causing a computer to execute the spatial data transmission and display method and the three-dimensional spatial data transmission and display method, the server device determines whether or not the load status of the transmission destination client device changes. Then, the upper limit of the amount of data to be transmitted per predetermined unit time to the client device is reset. Therefore, it is possible to transmit the three-dimensional object data immediately corresponding to the processing load of the client device. This has the effect that it is possible to realize efficient transfer of three-dimensional object data without reducing the processing efficiency of the client.

A three-dimensional spatial data transmission / display system according to the present invention, a three-dimensional spatial data transmitting method, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmitting method, and a three-dimensional spatial data transmitting method In a computer-readable recording medium storing a program for causing a computer to execute the spatial data transmission and display method and the three-dimensional spatial data transmission and display method, the server device changes the viewpoint moving speed or the line-of-sight direction changing speed. , The upper limit of the amount of data to be transmitted per predetermined unit time to the client device is reset. As a result, the amount of data transmitted per unit time increases due to changes in the moving speed of the viewpoint and the rotational speed in the line of sight, thereby reducing the display processing of the client device and transmitting data exceeding the transmittable data capacity of the communication path. There is an effect that it is possible to suppress a decrease in transmission efficiency due to the attempt.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the server device newly enters the field of view with the three-dimensional object data already existing within the field of view of the display screen at the current viewpoint position. The priority information is set for the three-dimensional object data predicted to come in accordance with the use purpose set in advance. In addition, the higher the priority of the three-dimensional object data and the higher the available transmission speed in consideration of the congestion state of the communication path before transmission, the higher the detail information of the three-dimensional object data is set, and the transmission data capacity is set. Each time the upper limit of the above is changed, the above 3 set before the above upper limit is changed
The detail level information of the dimensional object data is reset, and the three-dimensional object data having the highest priority is selected again so as not to exceed the changed upper limit of the transmission data capacity. In addition, the upper limit of the transmission data capacity of the transmission schedule of the three-dimensional object data to be transmitted to the client device is changed so that the three-dimensional object data closer to the appearance order or the viewpoint position displayed on the display screen is transmitted earlier. Every time, the setting is reset based on the selected three-dimensional object data. Each time the upper limit of the transmission data capacity is changed, the transmission schedule is switched to the reset transmission schedule, and the three-dimensional object data is transmitted according to the reset schedule. Therefore, even if the moving speed of the viewpoint or the changing speed of the line of sight changes, there is an effect that it is possible to realize efficient data transmission and display.

In the three-dimensional spatial data transmission / display system according to the present invention, the streaming unit transmits polygon data constituting the three-dimensional object data as retransmission guarantee data, and texture data as best effort guarantee data. Send. For this reason, even if the congestion state of the communication path deteriorates abruptly and the transmission speed decreases, there is an effect that a process of always maintaining a constant switching frame rate of the display screen displayed on the client device can be performed.

[0142] In the three-dimensional spatial data transmission / display system according to the present invention, the streaming transmission unit includes:
Polygon data is stored in the same packet, and texture data can be roughly mapped without texture loss and retransmission.
The texture data to be mapped to one object is divided into a plurality of packets, stored, and transmitted. Therefore, there is an effect that even if one packet is lost, texture mapping can be performed without retransmission.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the client device monitors the processing status of the requesting unit, the receiving unit, the scene configuration managing unit, the display managing unit, and the rendering unit. The rendering frame rate (display screen switching speed)
The processing time of each unit is adjusted so as to maintain a predetermined specified constant speed. Then, a series of processes executed by the requesting unit, the receiving unit, the scene configuration managing unit, the display managing unit, and the rendering unit are repeatedly executed at fixed time intervals. For this reason, there is an effect that processing that always keeps the frame rate displayed on the client device constant can be performed.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the task adjusting unit may determine whether the receiving processing time in the receiving unit exceeds the processing time allocated by the task adjusting unit. When the rate cannot be maintained, the three-dimensional object data is transmitted at the reception rate at which the reception processing is completed within the reception processing time of the reception unit reassigned by the task adjustment unit in order to achieve the specified frame rate. Request the server device to change the transmission rate. For this reason, there is an effect that processing that always keeps the frame rate in the client device constant can be performed.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the task adjustment unit may increase the rendering processing time to allow a series of processing in the client device to exceed the designated frame rate, and to further include a scene configuration database. If there is 3D object data that is not currently displayed in the 3D object data to be added to the scene configuration database, adding some or all of the 3D object data that is not currently displayed to the scene configuration database By temporarily suspending the processing, an instruction is issued to the scene configuration management unit to reduce the processing time of the scene configuration management unit and bring the frame rate of the client device closer to the specified frame rate.
For this reason, there is an effect that it is possible to perform a process of always keeping the switching frame rate of the display screen displayed on the client device constant.

In the three-dimensional spatial data transmission / display system according to the present invention, when the rendering processing time is long and a series of processing of the client device exceeds the designated frame rate, the task adjusting unit performs the rendering processing. An instruction is issued to the display management unit to reset the detail level of the object to be displayed so as to shorten the time and approach the designated frame rate. Also, send 3
Request the server device to review the setting of the detail level of the dimensional object data. For this reason, there is an effect that it is possible to perform a process of always keeping the switching frame rate of the display screen displayed on the client device constant.

[0147] In the three-dimensional spatial data transmission / display system according to the present invention, the scene configuration management unit determines, based on the processing time allocated by the task adjustment unit and the processing capability of the client device, per unit interval. The upper limit of the data capacity of the three-dimensional object data to be added to the scene configuration database is determined. Further, the scene configuration management unit sets the upper limit of the data capacity of the three-dimensional object data to be added per unit interval as the processing time allocated by the task adjustment unit is changed, using the processing capability of the client device. And set again. For this reason, there is an effect that it is easy to control such that the switching frame rate of the display screen displayed on the client device is always kept constant.

In the three-dimensional spatial data transmission / display system according to the present invention, the display management unit or the task adjustment unit adjusts the upper limit of the viewpoint moving speed or the line-of-sight rotation speed to change the display switching frame rate. To adjust. Therefore, by adjusting the viewpoint moving speed or the line of sight rotation speed, there is an effect that the switching frame rate of the display screen displayed on the client device can be easily adjusted.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the display management unit adjusts the upper limit of the viewpoint moving speed or the line-of-sight rotation speed so that the three-dimensional object data received from the server device is adjusted. Adjust the reception rate. Therefore, by adjusting the viewpoint moving speed or the line of sight rotation speed, there is an effect that the switching frame rate of the display screen displayed on the client device can be easily adjusted.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the scene configuration management unit may perform the process of additionally registering the three-dimensional object data in the scene configuration database within the processing time specified by the task adjustment unit. If the processing cannot be performed, the task adjustment unit is requested to adjust the data capacity of the three-dimensional object data transmitted by the server device or increase the allocation of the processing time of the scene configuration management unit. For this reason,
There is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the display management unit may be configured to reach the per-unit time when the rendering processing exceeds the allocated processing time or due to a change in the congestion state of the communication path. When the number of objects to be reduced decreases, display quality control for adjusting the degree of detail of the three-dimensional object data is performed so as to reduce the number of three-dimensional object data having a high degree of detail at the time of rendering. For this reason, there is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the reception unit may perform the reception process during a certain period of time during which the three-dimensional object data that cannot be processed within the processing time maintained by the task adjustment unit. When the number of occurrences exceeds the specified number, the task adjustment unit is requested to increase the reception processing time. If the processing is not completed within the specified reception processing time even if the reception processing is increased, or if there is an instruction that the task adjustment unit cannot allocate more time to the reception processing, the request unit Then, it requests the server device to give an instruction to adjust the size, detail level, and transmission rate of the object of the transmission data. When the number of three-dimensional object data whose reception processing time exceeds the specified time exceeds a specified value, the communication speed of the communication path is lower than the assumed communication speed. In this case, the server is requested to instruct the request unit to lower the transmission rate. If it is determined that the processing time has been exceeded because the data size of the received three-dimensional object data is large, an instruction is issued to the server device to subdivide the size of the three-dimensional object data to be transmitted. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

In the three-dimensional spatial data transmission / display system according to the present invention, the task adjustment unit may be any one of the request unit, the reception unit, the scene configuration management unit, the display management unit, and the rendering unit. If the processing cannot be performed within the processing time instructed by the task adjustment unit, and the processing cannot be completed within the processing time instructed even if the processing time of each unit is adjusted, the time when the adjustment cannot be performed is If it is temporary, change the frame rate temporarily. If there is a high possibility of prolongation, an instruction is issued to change the degree of detail, the number of objects, and the transmission rate of the three-dimensional object data to be transmitted to the server device. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the task adjustment unit may include a frame rate in the client device, that is, an average value of a processing time required for the series of processing for a specified fixed time. In order to maintain the calculated rate value at the specified rate value, a request is made to the object extraction unit of the server device to adjust the level of detail of the three-dimensional object data to be transmitted. The object extraction unit changes the setting of the level of detail of the object to be transmitted in response to the request. For this reason, even when the measured frame rate fluctuates up and down frequently, the frequency of issuing a change request to the server device is suppressed in order to maintain the rate value calculated from the average value at the specified rate value. This has the effect that efficient processing can be realized.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the task adjusting unit includes a frame rate in the client device, that is, an average value of a processing time required for the series of processing for a specified fixed time. In order to maintain the calculated rate value below the specified rate value, the client device transmits to the client device from among the three-dimensional object data existing in the spatial area predicted to enter the field of view of the client device within the fixed time. A request is made to the transmission data capacity adjustment unit of the server device to adjust the upper limit of the data capacity to be selected as three-dimensional object data. Therefore, in order to maintain the rate value calculated from the average value below the specified rate value, the frequency of issuing a change request to the server device is suppressed even when the measured frame rate fluctuates up and down frequently. This has the effect that efficient processing can be realized.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the task adjustment unit adjusts the frame rate so that the three-dimensional object data to be transmitted to the object extraction unit of the server device is adjusted. The frequency of requesting adjustment of the detail information is reduced. Alternatively, the frequency of requesting the transmission data capacity adjustment unit of the server device to adjust the upper limit of the data capacity is reduced. For this reason, even when the measured frame rate fluctuates up and down frequently, the frequency of issuing a change request to the server device can be suppressed, and there is an effect that efficient processing can be realized.

In the three-dimensional spatial data transmission / display system according to the present invention, a series of processing performed by the request unit, the reception unit, the scene configuration management unit, the display management unit, the rendering unit, and the task adjustment unit of the client device. Processing, a transmission data capacity adjustment unit, a priority setting unit,
The three-dimensional object that transmits the total processing time required for a series of processing performed by the three-dimensional object extraction unit, the scheduling unit, and the streaming transmission unit according to a change in a viewpoint moving speed or a line-of-sight rotation speed. A frame rate maintenance unit is provided for changing the degree of detail of the object data to suppress the display screen within the switching interval time for realizing the specified frame rate. For this reason, there is an effect that it is possible to perform processing for always keeping the switching frame rate of the display screen displayed on the client device constant.

Further, in the three-dimensional spatial data transmission / display system according to the present invention, the frame rate maintenance / management unit transmits the three-dimensional object data to be transmitted according to the available communication speed which changes due to the change in the congestion state of the communication path. By changing the detail level information of the request unit, the receiving unit, the scene configuration management unit, the display management unit, the rendering unit,
Task adjustment unit, transmission data capacity adjustment unit, priority setting unit,
A series of processes performed in the three-dimensional object extraction unit, the scheduling unit, and the streaming transmission unit are suppressed within a switching interval of a display screen that achieves a specified frame rate. For this reason, there is an effect that it is possible to perform a process of always keeping the switching frame rate of the display screen displayed on the client device constant.

Also, a three-dimensional spatial data transmission method according to the present invention, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission method, a three-dimensional spatial data transmission and display method, A computer-readable recording medium that stores a program for causing a computer to execute the three-dimensional space data transmission and display method detects a change in the available communication speed of a communication path, and detects the change per fixed time before detecting the change. Calculating the degree of change with respect to the average communication speed, and calculating the amount of change in the upper limit of the transmission data capacity in accordance with the degree of change in the communication speed calculated in the above calculation step, taking into account the amount of change. The upper limit value resetting step, and the transmission schedule for the remaining untransmitted data while leaving a certain amount of untransmitted data. Discarding transmission schedule discarding steps Yuru, 3 included in the region of space again predicted to come in sight by the movement of the viewpoint of the future predetermined time
A priority setting step of resetting priority information according to the purpose of displaying predetermined three-dimensional space data with respect to the three-dimensional object data; the reset priority; The degree of detail of the three-dimensional object data to be transmitted is determined again according to the speed, the data processing capability of the destination mobile terminal, the rendering processing capability of the three-dimensional object data, and the memory capacity. A selection step of reselecting the three-dimensional object data to be transmitted up to the upper limit value of the transmission data capacity; and a three-dimensional object data that is close to the viewpoint or the order of appearance displayed on the display screen, or close to the line of sight. The transmission schedule of the same 3D object data so that the 3D object data can be displayed as quickly as possible And a transmission schedule in which the transmission schedule reset in the transmission schedule setting step is merged with the end of the transmission schedule of the fixed amount of untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object according to a schedule. For this reason, there is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

A three-dimensional spatial data transmission method according to the present invention, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission method, a three-dimensional spatial data transmission display method, A computer-readable recording medium that stores a program for causing a computer to execute the three-dimensional space data transmission and display method detects a change in the storage capacity of the memory of the client device, and stores the change in the memory before the detection of the change. A calculation step of calculating the degree of change with respect to the capacity, and setting the upper limit value of the transmission data capacity in accordance with the degree of change of the storage capacity calculated in the above calculation step, taking into account the change amount The upper limit value resetting step and the transmission schedule for the remaining untransmitted data while leaving a certain amount of untransmitted data. A transmission schedule discarding step of discarding a rule, and a preset three-dimensional space data for a three-dimensional object included in a spatial region predicted to reenter the field of view by moving the viewpoint for a certain time in the future. A priority setting step of resetting the priority information according to the purpose to be displayed, the reset priority information, the currently available communication speed of the communication path, the data processing capability of the destination mobile terminal, and the three-dimensional The degree of detail of the three-dimensional object data to be transmitted is determined again according to the rendering processing capability and the memory capacity of the object, and the three-dimensional objects to be transmitted are transmitted in order from the three-dimensional object data having the highest priority to the upper limit of the transmission data capacity. A selection step of reselecting data, and a three-dimensional object close to the appearance order or viewpoint position displayed on the display screen A transmission schedule setting step of setting a transmission schedule of the three-dimensional object data so that the data or the three-dimensional object data closer to the line-of-sight direction can be displayed earlier; A transmission step of transmitting the same three-dimensional object data in accordance with a transmission schedule obtained by merging the transmission schedule reset in the transmission schedule setting step at the end of the transmission schedule of the untransmitted data. For this reason, there is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission method according to the present invention, the three-dimensional spatial data transmission display method, A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional space data transmission and display method detects a change amount of a load situation of a client device of a transmission destination, and detects a load amount before detecting the change amount. And a calculation step for calculating the degree of change with respect to the upper limit value, and an upper limit value of the transmission data capacity is calculated in accordance with the degree of change of the load amount calculated in the above calculation step, and the upper limit value is reset in consideration of the change amount. Resetting step and transmission that leaves a fixed amount of untransmitted data and discards the transmission schedule of other untransmitted data According to the purpose of displaying preset three-dimensional space data with respect to the three-dimensional object data included in the space area that is predicted to reenter the field of view by moving the viewpoint for a certain period of time in the schedule discarding step and the future. Priority setting step of resetting the priority information, the reset priority, the currently available communication speed of the communication path, the data processing capability of the destination mobile terminal, and
The degree of detail of the three-dimensional object data to be transmitted is determined again according to the rendering processing capability and the memory capacity of the three-dimensional object data, and the three-dimensional object data to be transmitted is transmitted in order from the highest priority to the upper limit of the transmission data capacity. A selection step of reselecting the three-dimensional object data, and a three-dimensional object data closer to the viewpoint position, the appearance order, or the viewpoint position, or the three-dimensional object data closer to the line-of-sight direction. A transmission schedule setting step for setting a transmission schedule of the same three-dimensional object data and a transmission schedule of the fixed amount of untransmitted data which has not been discarded in the transmission schedule discarding step are reset in the transmission schedule setting step. The above transmission schedule According merged transmission schedule, and a transmission step of transmitting the three-dimensional object data. For this reason, there is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

Also, a computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission method according to the present invention, the three-dimensional spatial data transmission display method, A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional space data transmission and display method detects a change in a moving speed of a viewpoint or a change in a changing speed of a line of sight, and detects the same change amount. A calculation step of calculating the degree of change with respect to the movement speed of the previous viewpoint or the change speed of the line-of-sight direction, and the upper limit of the transmission data capacity, An upper limit value resetting step of calculating and resetting in consideration of the same amount of change according to the degree; A transmission schedule discarding step of discarding the transmission schedule of the remaining untransmitted data while leaving the amount of untransmitted data, and being included in a spatial region predicted to reenter the field of view by moving the viewpoint for a certain time in the future A priority setting step for resetting priority information for three-dimensional object data in accordance with the purpose of displaying the predetermined three-dimensional space data, the reset priority, and the currently available communication path. Redetermining the degree of detail of the three-dimensional object data to be transmitted in accordance with the communication speed, the data processing capability of the destination mobile terminal, the rendering processing capability of the three-dimensional object data, and the memory capacity;
A selection step of reselecting the three-dimensional object data to be transmitted in order from the three-dimensional object data having the highest priority up to the upper limit of the transmission data capacity; A transmission schedule setting step of setting a transmission schedule of the three-dimensional object data so that the object data or the three-dimensional object data closer to the line-of-sight direction can be displayed earlier; A transmission step of transmitting the same three-dimensional object data in accordance with a transmission schedule obtained by merging the transmission schedule reset in the transmission schedule setting step at the end of the transmission schedule of the untransmitted data. For this reason, there is an effect that the processing efficiency of transmission of three-dimensional object data and display processing of the client device can be improved.

In the three-dimensional spatial data transmission method according to the present invention, the priority setting step resets the priority in accordance with a change in the viewpoint moving speed or the line-of-sight direction changing speed. Resets the detail level of the three-dimensional object data according to the change in the viewpoint moving speed or the line-of-sight direction changing speed.
The three-dimensional object data to be transmitted is reselected in order from the dimensional object data up to the upper limit of the transmission data capacity, and the transmission schedule setting step resets the transmission schedule of the reselected three-dimensional object data. Therefore, there is an effect that the efficiency of the transmission processing of the three-dimensional object data can be improved.

A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to the present invention, the three-dimensional spatial data transmission and display method, A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional space data transmission and display method, wherein the client device requests the server device to transmit a three-dimensional object data transmission request; The three-dimensional object data sequentially transmitted from the device in object units is sequentially registered and stored in the main storage device or the auxiliary storage device in the order of arrival, and after the registration and storage, reception for sequentially requesting additional processing to the three-dimensional virtual space Step and the receiving step. The three-dimensional object data was 3
A request for adding to the three-dimensional virtual space is received, and a scene configuration management step for adding to the scene configuration information database, a display management step for indicating the degree of detail of the three-dimensional object data to be displayed, and A rendering step of rendering a three-dimensional virtual space visible from a viewpoint based on scene configuration information; and monitoring processing states of the requesting step, the receiving step, the scene configuration management step, the display management step, and the rendering step. A task adjusting step of adjusting the processing time of each unit so as to maintain the frame rate rendered in the rendering step at a specified constant speed, wherein the requesting step, the receiving step, the scene configuration managing step, Display management Step, a series of processes executed by the rendering step is performed repeatedly at regular time intervals. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

[0165] In a computer readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to the present invention, the task adjusting step includes: In the apparatus, when the reception processing time in the reception step exceeds the processing time allocated in the task adjustment step, when the specified frame rate can not be maintained, to realize the specified frame rate, The task adjustment step sends a request to the server device to transmit the three-dimensional object data at a reception rate at which the reception processing is completed within the processing time allocated to the processing of the reception step reallocated. Give instructions to the request step. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

[0166] In the computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to the present invention, the task adjusting step includes a rendering process. When the above-described series of processing exceeds the specified frame rate due to a longer time, the detail level of the three-dimensional object data to be displayed is reset so that the rendering processing time is shortened to approach the specified frame rate. To the display management step
Further, the server requests the server to review the setting of the detail level of the three-dimensional object data to be transmitted. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

Also, in the computer readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to the present invention, the task adjusting step is performed by the client A series of processes in the client device are adjusted so that the average value of the frame rate in the device for the specified fixed time can maintain the specified rate value. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

In the method for transmitting and displaying three-dimensional spatial data according to the present invention, the task adjusting step includes the step of: setting the frame rate in the client device, that is, the average value of the processing time required for the series of processing over a designated fixed time. In order to maintain the calculated rate value at the specified rate value, a request is made to the object extraction step of the server device to adjust the degree of detail of the three-dimensional object data to be transmitted. In the object extracting step, the detail of the three-dimensional object data to be transmitted is set and changed according to the request. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

Further, in the three-dimensional spatial data transmission / display method according to the present invention, the task adjusting step includes the step of: setting the frame rate in the client device, that is, the average value of the processing time required for the series of processing in a designated fixed time. In order to maintain the calculated rate value below the specified rate value, the client device transmits to the client device from among the three-dimensional object data existing in the spatial area predicted to enter the field of view of the client device within the fixed time. A request is made to the transmission data capacity adjustment step of the server device to adjust the upper limit of the data capacity of the three-dimensional object data selected as the three-dimensional object data. The transmission data capacity adjustment step changes the setting of the upper limit in response to a request from the task adjustment step. Therefore, there is an effect that the processing efficiency of the transmission of the three-dimensional object data and the reception and display processing of the client device can be improved.

In the method for transmitting and displaying three-dimensional spatial data according to the present invention, the task adjusting step adjusts the length of the predetermined time so that the three-dimensional object data transmitted to the object extracting unit is adjusted. The frequency of making a request to change the setting of the degree of detail is reduced. Alternatively, the frequency of requesting the transmission data capacity adjustment unit to adjust the upper limit value is reduced. Therefore, 3
There is an effect that the processing efficiency of the transmission of the dimensional object data and the reception and display processing of the client device can be improved.

[Brief description of the drawings]

FIG. 1 is a functional block diagram showing an example of a three-dimensional spatial data transmission and display system according to a first embodiment.

FIG. 2 is a diagram illustrating a relationship between priority and resolution according to the first embodiment.

FIG. 3 is a flowchart showing an object transmission procedure when the available communication speed (transmission speed) changes due to a change in the congestion state of the communication path of the three-dimensional spatial data transmission display system according to the first embodiment.

FIG. 4 is a flowchart showing an object transmission procedure when the memory capacity of a client terminal of the three-dimensional spatial data transmission / display system according to the second embodiment changes.

FIG. 5 is a flowchart showing an object transmission procedure when the additional state of processing of the client terminal of the three-dimensional spatial data transmission / display system according to the third embodiment changes.

FIG. 6 is a flowchart illustrating an object transmission procedure when the viewpoint moving speed or the line-of-sight rotation speed of the three-dimensional spatial data transmission and display system according to the fourth embodiment changes.

FIG. 7 is a diagram for describing the degree of detail of a three-dimensional object according to movement of a viewpoint according to the fourth embodiment.

FIG. 8 is a functional block diagram of a three-dimensional spatial data transmission and display system according to a fifth embodiment.

FIG. 9 is a flowchart illustrating an operation of a scene configuration management unit according to the fifth embodiment.

FIG. 10 is a functional block diagram of a three-dimensional spatial data transmission / display system according to a sixth embodiment.

FIG. 11 is a functional block diagram of a virtual space information creating device disclosed in Japanese Patent Application Laid-Open No. 10-83462.

FIG. 12 is a functional block diagram of a virtual space information creating apparatus disclosed in Japanese Patent Application Laid-Open No. 10-83462.

FIG. 13 is a flowchart of a processing procedure of a high-speed display method of three-dimensional spatial data disclosed in Japanese Patent Application Laid-Open No. 05-266213.

FIG. 14 is a functional block diagram of a virtual space display device disclosed in JP-A-11-313255.

FIG. 15 is a flowchart of a video display method of the user participation type system disclosed in Japanese Patent Application Laid-Open No. 9-212679.

FIG. 16 shows the structure of 3 disclosed in JP-A-10-40423.
The flowchart figure of the three-dimensional virtual space display method.

FIG. 17 is a flowchart of a texture-based three-dimensional space display method disclosed in Japanese Patent Application Laid-Open No. 2000-187740.

FIG. 18 is a functional block diagram of a texture-based three-dimensional space display device disclosed in Japanese Patent Application Laid-Open No. 2000-187740.

FIG. 19 is a cross-sectional view of 3 disclosed in JP-A-9-282249.
FIG. 2 is a functional block diagram of a two-dimensional shape communication system.

FIG. 20 is a view showing a structure of 3 disclosed in JP-A-9-282249.
The flowchart figure which showed the main operation | movement procedure of the three-dimensional-shape generation apparatus.

[Explanation of symbols]

10 server (device), 11 transmission data capacity adjustment unit,
12 priority setting unit, 13 three-dimensional object extraction unit, 14 scheduling unit, 15 streaming transmission unit, 16 object information storage unit, 20 client terminal (device), 21 request unit, 22 reception unit, 2
3 scene configuration management unit, 24 display management unit, 25 rendering unit, 26 task adjustment unit, 27 scene configuration information database, 30 frame rate maintenance management unit, 4
0 Communication network, 41 wireless networks.

 ──────────────────────────────────────────────────続 き Continuation of the front page (54) [Title of the invention] 3D spatial data transmission and display system, 3D spatial data transmission method, 3D spatial data transmission method Computer readable recording a program for causing a computer to execute the method Recording medium, three-dimensional spatial data display method, computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method, three-dimensional spatial data transmission and display method, and three-dimensional spatial data transmission and display method Computer-readable recording medium on which a program for causing a computer to execute the display method is recorded.

Claims (54)

[Claims] 1. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission and display system comprising a client device for displaying and transmitting data. The communication channel is a communication channel whose available transmission speed changes according to the congestion state of the communication channel. Monitor the congestion status of the communication path,
By calculating the degree of change in the available transmission rate that changes according to the congestion situation, the upper limit of the data capacity to be selected as the three-dimensional object data to be transmitted per predetermined unit time to the client device is calculated. A three-dimensional spatial data transmission display system, comprising: a transmission data capacity adjustment unit that is set according to a degree of change. 2. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission and display system comprising: a client device for displaying and displaying the three-dimensional object data transmitted from the server device; Calculates the degree of change in the storage capacity of the memory of the client device, and calculates the upper limit of the data capacity to be selected as three-dimensional object data to be transmitted per predetermined unit time to the client device. That a transmission data capacity adjustment unit to be set according to the degree of change is provided. Characteristic three-dimensional spatial data transmission and display system. 3. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission and display system comprising a client device for displaying and displaying the three-dimensional object data. The client device has a predetermined processing capability for receiving and displaying the three-dimensional object data. The server device monitors the load status of the processing of the client device, and calculates the degree of change in the predetermined processing capability by monitoring the load status of the processing of the client device. Selected as three-dimensional object data to be transmitted to the client device per predetermined unit time The upper limit of the over data volume, three-dimensional spatial data transmission display system characterized by comprising a transmission data amount adjustment section set according to degree of change calculated above. 4. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission display system comprising: a client device that displays and displays at least one of the viewpoint gaze information of information indicating a moving speed of a viewpoint and information indicating a rotation speed of a gaze. Notifying the server device, the server device uses the viewpoint line-of-sight information notified from the client device, and at least one of the degree of change in the viewpoint moving speed and the degree of change in the line-of-sight rotation speed. The degree of change is calculated, and the three-dimensional object transmitted to the client device per predetermined unit time is calculated. The upper limit of the data volume to be selected as Kutodeta, three-dimensional spatial data transmission display system characterized by comprising a transmission data amount adjustment section set according to the degree of change calculated above. 5. The three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a detail level of the data. The server device includes: Three-dimensional object data existing in a new field of view based on the received viewpoint gaze information by receiving at least one of viewpoint gaze information and information indicating a gaze rotation speed; A priority setting unit for setting the priority information in accordance with the purpose of displaying predetermined three-dimensional space data with respect to three-dimensional object data already existing in the field of view; Of the three-dimensional object data according to the transmission speed and the priority information of the three-dimensional object data set by the priority setting unit. Setting the fineness information and transmitting to the client device in descending order of the priority set by the priority setting unit so as not to exceed the upper limit of the data capacity set by the transmission data capacity adjusting unit; When the upper limit value is changed by the transmission data capacity adjustment unit while selecting the three-dimensional object data, the detail level of the three-dimensional object data set before changing the upper limit value is reset, and the changed upper limit is changed. The three-dimensional object data to be transmitted to the client device is selected from the three-dimensional object data having the reset detailed level information in the descending order of the priority set by the priority setting unit so as not to exceed the value. From the three-dimensional object extraction unit to be corrected and the three-dimensional object data selected by the three-dimensional object extraction unit, A three-dimensional object is transmitted to the client device so that at least one of the three-dimensional object data displayed in the client device in the order of appearance and the three-dimensional object data close to the viewpoint position is transmitted to the client device as soon as possible. When a data transmission schedule is set and the upper limit value is changed by the transmission data capacity adjustment unit, the transmission of the three-dimensional object data selected again by the three-dimensional object extraction unit to the client device is transmitted. A scheduling unit for resetting to a schedule, transmitting the three-dimensional object data to the client device according to a transmission schedule set by the scheduling unit, and changing the upper limit value by the transmission data capacity adjustment unit. 5. The streaming transmission unit according to claim 1, further comprising: a streaming transmission unit configured to switch to the transmission schedule reset by the scheduling unit and transmit the three-dimensional object data to the client device. 3D spatial data transmission display system. 6. The priority setting unit calculates one of a degree of change of a viewpoint and a degree of change of a line of sight using the received viewpoint line of sight information, and calculates a degree of change of the calculated change. The priority information of the three-dimensional object data is reset according to the degree, and the three-dimensional object extracting unit sets the detail information according to the priority information of the three-dimensional object data reset by the priority setting unit. The client device is reset from the three-dimensional object data having the detailed level of the reset data so as not to exceed the upper limit value in the order of higher priority reset by the priority setting unit. 6. The three-dimensional spatial data transmission / display system according to claim 5, wherein the three-dimensional object data to be transmitted to the third party is selected again. 7. The three-dimensional object data has at least polygon data indicating a shape of an object and texture data which is image data to be mapped to the polygon data. When transmitting, the polygon data is transmitted as retransmission guarantee data so as to be surely received by the client device, and the three-dimensional virtual space can be displayed even when the texture data is not received by the client device. The three-dimensional spatial data transmission / display system according to claim 5, wherein the transmission is performed as best-effort guarantee data. 8. The three-dimensional object data includes at least polygon data indicating a shape of an object and texture data which is image data to be mapped to the polygon data. The polygon data included in the data is stored in the same packet and transmitted. The texture data included in one three-dimensional object data is divided into a plurality of packets and stored and transmitted. 6. The three-dimensional spatial data transmission / display system according to claim 5, wherein texture data can be mapped in said client device without retransmission. 9. A server device for transmitting three-dimensional object data forming a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. And a client device for generating a three-dimensional virtual space using the received three-dimensional object data and displaying the generated three-dimensional virtual space at a predetermined designated frame rate (display screen switching speed). In the three-dimensional space data transmission and display system, the client device includes: a scene configuration information database that stores a plurality of three-dimensional object data configuring the three-dimensional virtual space as scene configuration information; and transmission of the three-dimensional object data to the server device. A request unit for outputting a request, and a three-dimensional sent from the server device Receives object data, a three-dimensional object data received 3
A receiving unit for requesting additional processing to the three-dimensional virtual space; and a request for additional processing for adding three-dimensional object data to the three-dimensional virtual space from the receiving unit, and using the three-dimensional object data as the scene configuration information. A scene configuration management unit to be added to the scene configuration information database; a display management unit to indicate the degree of detail of the three-dimensional object data to be displayed on the client device; and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering unit that renders at the predetermined frame rate in accordance with the degree of detail instructed by the display management unit, the request unit, the reception unit, the scene configuration management unit, the display management unit, and the rendering unit A task adjustment for allocating a processing time to each unit and adjusting a processing time of each unit so as to maintain the rendering by the rendering unit at the predetermined specified frame rate by monitoring the processing status of the unit. And a three-dimensional spatial data transmission / display system comprising: 10. The task adjusting unit, when the processing time by the receiving unit exceeds the processing time assigned to the receiving unit and the predetermined designated frame rate cannot be maintained, The processing time is reallocated to the server device so that the reception rate at which the processing of the receiving unit is completed within the reallocated processing time is determined, and the three-dimensional object data is transmitted at the determined reception rate. 10. The three-dimensional spatial data transmission / display system according to claim 9, wherein the transmission rate is requested to be changed. 11. The task adjustment unit, wherein the processing time of the rendering unit exceeds the processing time allocated to the rendering unit, so that the predetermined frame rate cannot be maintained and the scene configuration management unit When the three-dimensional object data to be added to the scene configuration information database includes three-dimensional object data that is not currently displayed, at least a part of the three-dimensional object data that is not currently displayed is displayed. 10. The three-dimensional spatial data transmission / display system according to claim 9, wherein the system temporarily suspends the addition to the scene configuration information database and instructs the scene configuration management unit to reduce the processing time. . 12. The task adjustment unit, when the processing time by the rendering unit exceeds the processing time allocated to the rendering unit, and the predetermined designated frame rate cannot be maintained, Instructing the client device to reset the level of detail of the three-dimensional object data to be displayed on the client device, shortening the processing time of the rendering unit and transmitting the three-dimensional object data to the server device 10. The three-dimensional spatial data transmission / display system according to claim 9, wherein a request is made for a change. 13. The scene configuration management unit adds the scene configuration information database to the scene configuration information database per predetermined unit interval based on the processing time allocated to the scene configuration management unit by the task adjustment unit and the processing capability of the client device. The upper limit of the data capacity of the three-dimensional object data to be determined is determined. When the processing time of the scene configuration management unit is reallocated by the task adjustment unit, the three-dimensional object data to be added per predetermined unit interval is determined. 10. The three-dimensional spatial data transmission according to claim 9, wherein the additional upper limit value of the data capacity is reset based on the processing time reallocated to the scene configuration management unit and the processing capability of the client device. Display system. 14. At least one of the display management unit and the task adjustment unit sets at least one of a speed upper limit of a viewpoint moving speed and a line of sight rotation speed upper limit. The three-dimensional spatial data transmission / display system according to claim 9, wherein the predetermined designated frame rate is adjusted by adjusting and setting. 15. The display management unit according to claim 10, wherein at least one of the speed upper limit of the moving speed of the viewpoint and the speed upper limit of the line of sight is adjusted and set. The three-dimensional spatial data transmission / display system according to claim 9, wherein the adjusting unit is instructed to adjust a reception rate of the three-dimensional object data received from the server device. 16. The scene configuration management unit, when the processing of adding the three-dimensional object data to the scene configuration information database exceeds the processing time allocated by the task adjustment unit, Instructing to perform at least one of adjusting the data capacity of the three-dimensional object data transmitted per predetermined unit time of the server device and increasing the allocation of the processing time of the scene configuration management unit. The three-dimensional spatial data transmission / display system according to claim 9, wherein: 17. The display management unit according to claim 1, wherein the rendering process performed by the rendering unit exceeds a processing time allocated by the task adjustment unit, and a change in the congestion state of the communication channel causes the rendering process to be performed per unit time. In at least one of the case where the number of three-dimensional object data arriving at the client device decreases, the degree of detail of the three-dimensional object data is adjusted so as to reduce the number of three-dimensional object data having a high degree of detail. The three-dimensional spatial data transmission / display system according to claim 9, wherein display quality control is performed. 18. The method according to claim 18, wherein the receiving unit receives the three-dimensional object data exceeding a processing time allocated to the receiving unit by the task adjusting unit for a specified number of times during a predetermined time. 10. The three-dimensional spatial data transmission / display system according to claim 9, wherein the task adjusting unit is instructed to increase the processing time of the unit. 19. The three-dimensional object, wherein the processing time of the receiving unit is reassigned by the task adjusting unit, and the processing time exceeds the processing time reassigned to the receiving unit by the task adjusting unit. When the data reception processing occurs more than a specified number of times during a certain period of time, if it is determined that the communication speed of the communication path is lower than the assumed communication speed, The server device is instructed to lower the transmission rate, and when it is determined that the processing time is exceeded because the data size of the received three-dimensional object data is large, the request unit is
19. The three-dimensional spatial data transmission / display system according to claim 18, wherein an instruction is given to the server device to segment the three-dimensional object data to be transmitted. 20. The task adjustment unit, wherein processing performed by at least one of the request unit, the reception unit, the scene configuration management unit, the display management unit, and the rendering unit is assigned by the task adjustment unit. If the processing time exceeds the given processing time, the processing time of each unit described above is re-allocated, and if it is detected that the processing that exceeds the re-allocated processing time cannot be adjusted, the non-adjustment is determined to be temporary. In this case, when the predetermined instructed frame rate is temporarily changed, and it is determined that the adjustment failure is prolonged, the three-dimensional object data transmitted from the server device to the request unit is determined. Of the detail information and 3 transmitted by the server device.
The three-dimensional spatial data transmission display according to claim 9, wherein an instruction is given to change at least one of the number of the three-dimensional object data and the transmission rate of the three-dimensional object data transmitted by the server device. system. 21. A client device, comprising: a scene configuration information database storing scene configuration information constituting a three-dimensional virtual space generated using the three-dimensional object data; and transmitting the three-dimensional object data to the server device. A requesting unit that outputs a request, a receiving unit that receives the three-dimensional object data transmitted from the streaming transmitting unit of the server device, and requests an additional process of adding the received three-dimensional object data to the three-dimensional virtual space. A scene configuration management unit that receives a request for additional processing for adding three-dimensional object data to a three-dimensional virtual space from the receiving unit, and adds the three-dimensional object data to the scene configuration information database as the scene configuration information; 3D object data displayed on the client device A display control section for instructing the detail of the, based on the scene configuration information stored in the scene configuration information database, a 3-dimensional virtual space viewed from the viewpoint,
A rendering unit that renders at the predetermined frame rate according to the degree of detail instructed by the display management unit; a request unit; the reception unit; the scene configuration management unit; the display management unit; And the processing time is allocated to the respective units so that the rendering processing by the rendering unit is maintained at the predetermined designated frame rate, and the processing time of the respective units is adjusted. The three-dimensional spatial data transmission and display system according to claim 5, further comprising: a task adjustment unit that performs the task adjustment. 22. The task coordinator of the client device performs a series of processes executed by the requester, the receiver, the scene configuration manager, the display manager, and the renderer of the client device. The processing time required
Monitoring for a specified period of time, calculating an average value of the processing time required for the series of processes using the monitored result, and maintaining the calculated average value at a predetermined specified frame rate. Requesting the object extraction unit of the server device to adjust the level of detail of the object to be transmitted, and the object extraction unit of the server device responds to a request from the task adjustment unit of the client device. 22. The three-dimensional spatial data transmission / display system according to claim 21, wherein the detail information of the three-dimensional object data to be transmitted is set and changed. 23. The task adjustment unit of the client device includes a series of processes executed by the request unit, the reception unit, the scene configuration management unit, the display management unit, and the rendering unit of the client device. The processing time required
In order to monitor for a specified period of time, calculate the average value of the processing time required for the series of processes using the monitored result, and maintain the calculated average value at a predetermined specified frame rate. The three-dimensional object data existing in the three-dimensional virtual space that is predicted to be displayed on the client device within the predetermined time period for the transmission data capacity adjustment unit of the server device. Requesting that the upper limit value of the data capacity to be selected as the three-dimensional object data to be transmitted per predetermined unit time be adjusted. The transmission data capacity adjustment unit of the server device includes the task adjustment unit of the client device. 22. The three-dimensional spatial data transmission and display system according to claim 21, wherein the upper limit is changed in response to a request from the third party. Beam. 24. The task adjustment unit of the client device, by adjusting the predetermined designated frame rate, to specify the degree of detail of the three-dimensional object data transmitted to the object extraction unit of the server device. Requesting to adjust information and reducing the frequency of making at least one of the request to adjust the upper limit to the transmission data capacity adjustment unit of the server device. The three-dimensional spatial data transmission / display system according to claim 22 or 23, characterized in that: 25. The server device, comprising: a series of processing executed by the request unit, the receiving unit, the scene configuration management unit, the display management unit, the rendering unit, and the task adjustment unit of the client device. The total of the processing time and the processing time of a series of processing executed by the transmission data capacity adjusting unit, the priority setting unit, the three-dimensional object extracting unit, the scheduling unit, and the streaming transmitting unit of the server device. Is transmitted in accordance with a change in at least one of the moving speed of the viewpoint and the rotational speed of the line of sight in order to suppress the display screen switching interval time for realizing the predetermined specified frame rate. Claims: A frame rate maintenance / management unit for changing detail information of three-dimensional object data is provided. 21 three-dimensional space data transmission display system according. 26. A sequence executed by the request unit, the receiving unit, the scene configuration management unit, the display management unit, the rendering unit, and the task adjustment unit of the client device. And the processing time of a series of processing executed by the transmission data capacity adjusting unit, the priority setting unit, the three-dimensional object extracting unit, the scheduling unit, and the streaming transmitting unit of the server device. The three-dimensional object to be transmitted according to the available communication speed that changes depending on the congestion state of the communication path in order to suppress the sum of 26. The three-dimensional spatial data transmission display according to claim 25, wherein data detail level information is changed. Stem. 27. A server device for transmitting three-dimensional object data forming a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission method for transmitting the three-dimensional object data from the server device to the client device, wherein the three-dimensional object data is transmitted to the client device. The method of transmitting three-dimensional spatial data includes priority information indicating a priority to be transmitted to a device and detail information indicating a detail of data. The average available communication of the communication path per a predetermined time period In addition to calculating the speed, the change in the available communication speed of the communication path is monitored to detect the change. If you put it out,
A calculating step of calculating a degree of change in the communication speed based on the communication speed monitoring the change and the calculated average communication speed; and a three-dimensional object transmitted from the server device to the client device per a predetermined unit time. An upper limit value resetting step of setting the upper limit value of the data capacity of the data again according to the degree of change in the communication speed calculated in the calculating step; and before setting the upper limit value again in the upper limit value resetting step. A predetermined amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data to be transmitted from the server device to the client device; A transmission schedule destroying step for destroying the data transmission schedule; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input from the client device, and based on the input viewpoint information, a space area that enters the field of view by moving the viewpoint for a predetermined fixed time is predicted and set in advance. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the three-dimensional spatial data obtained from the client device; Data processing capability information indicating the processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input, and the priority set in the priority setting step is set. Information, available communication speed of the communication path, the processing capability information, and the rendering The upper limit value reset in the upper limit resetting step is determined in accordance with the capability information and the memory capacity information, and determines the detail level of the three-dimensional object data in order from the higher priority three-dimensional object data. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device; and three-dimensional object data displayed in the client device in the order of appearance and three-dimensional object data close to the viewpoint position. The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. Set the transmission schedule A setting step, and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step, and according to the merged transmission schedule, Transmitting a three-dimensional object data to the client device. 28. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission method for transmitting the three-dimensional object data from the server device to the client device, wherein the three-dimensional object data is transmitted from the client device to the client device. The client device has priority information indicating a priority to be transmitted to the device and detail information indicating a detail of data, and the client device has a storage capacity for registering and storing the three-dimensional object data transmitted from the server device. The three-dimensional spatial data transmission method, wherein the client The storage capacity information indicating the storage capacity of the memory is input from the device at a predetermined timing, and the storage capacity information of the memory is input using the storage capacity information input at the predetermined timing and the storage capacity information input immediately before. A calculating step of calculating a degree of change; and a storage capacity of a memory calculated in the calculating step, the upper limit value of a data capacity of three-dimensional object data transmitted from the server device to the client device per predetermined unit time. In accordance with the degree of change of the upper limit value, the upper limit value resetting step to set again, and the scheduling of transmitting from the server device to the client device before setting the upper limit value again by the upper limit value resetting step was performed. From the three-dimensional object data, a certain amount of three-dimensional object data is left as untransmitted data. A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data; and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device. Based on the information, a spatial region coming into the field of view by moving the viewpoint for a predetermined period of time is predicted, and the three-dimensional region included in the predicted spatial region is set according to the purpose of displaying the predetermined three-dimensional spatial data. A priority setting step of setting the priority information with respect to the object data; and data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. Enter memory capacity information indicating the storage capacity of the memory to be registered and stored Then, according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information, the three-dimensional object data A three-dimensional object to be transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step, in order of the degree of detail, in order from the higher priority three-dimensional object data. A selecting step of selecting data; and at least one of three-dimensional object data displayed in the client device in an early appearance order, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. Quickly send 3D object data to the client device A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule, and merging the transmission schedules set in the transmission schedule setting step. Spatial data transmission method. 29. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission method for transmitting the three-dimensional object data from the server device to the client device, wherein the three-dimensional object data is transmitted from the client device to the client device. The client device has priority information indicating a priority to be transmitted to the device and detail information indicating a level of detail of the data. The client device has a predetermined processing capability of receiving and displaying the three-dimensional object data. The predetermined processing capacity changes according to the processing load status of the client device, The three-dimensional spatial data transmission method includes: inputting load information indicating a load status of the processing from the client device at a predetermined timing; and using the load information input at the predetermined timing and the load information input immediately before. A calculating step of calculating the degree of change in the load status of the processing; and calculating the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time. An upper limit value resetting step of setting again in accordance with the degree of change in the load situation of the processing calculated in the step; and a step of re-setting the upper limit of the data capacity by the upper limit value resetting step. From the scheduled 3D object data to be transmitted to the device, A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data while leaving the object data as untransmitted data; viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device; And predicting a spatial area that enters the field of view by moving the viewpoint for a predetermined period of time based on the input viewpoint information, and performing the prediction based on the purpose of displaying three-dimensional spatial data set in advance. Priority setting step of setting the priority information for the three-dimensional object data included in the divided spatial region; and data processing capability information indicating the data processing capability of the client device and rendering indicating the rendering processing capability from the client device. Memory for registering and storing performance information and 3D object data Memory capacity information indicating the storage capacity is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, the memory capacity information, In accordance with the above, the detail level of the three-dimensional object data is determined, and the three-dimensional object data having the highest priority is sequentially transmitted from the server device to the upper limit value reset in the upper limit value resetting step, from the higher priority. A selection step of selecting three-dimensional object data to be transmitted to the client device; three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three close to the line of sight. At least one of the three-dimensional object data with the three-dimensional object data A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so that the three-dimensional object data is transmitted earlier to the client device; At the end of the data transmission schedule, a transmission step of merging the transmission schedule set in the transmission schedule setting step and transmitting the three-dimensional object data to the client device according to the merged transmission schedule. A method for transmitting three-dimensional spatial data, comprising: 30. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving the three-dimensional object data transmitted from the server device. A three-dimensional spatial data transmission method for transmitting the three-dimensional object data from the server device to the client device, wherein the three-dimensional object data is transmitted from the client device to the client device. The client device has priority information indicating a priority to be transmitted to the device and detail information indicating a detail of data, and the client device has at least one of information indicating a moving speed of a viewpoint and information indicating a rotating speed of a line of sight. Notifying one of the viewpoint line-of-sight information to the server device, and transmitting the three-dimensional spatial data The communication method includes: inputting the viewpoint gaze information at a predetermined timing from the client device; and using the viewpoint gaze information input at the predetermined timing and the viewpoint gaze information input immediately before, changing the viewpoint gaze information. A calculating step of calculating the degree of the image data; and changing the upper limit of the data capacity of the three-dimensional object data transmitted from the server apparatus to the client apparatus per predetermined unit time by changing the viewpoint visual line information calculated in the calculating step. Upper limit value resetting step of setting again in accordance with the degree of the above, and scheduling for transmitting from the server device to the client device before setting the upper limit value again in the upper limit value resetting step. Leave a certain amount of 3D object data as untransmitted data from the object data A transmission schedule discarding step of discarding a transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data; and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device; Based on the purpose of displaying a three-dimensional space data set in advance by predicting a spatial region entering the field of view by moving the viewpoint for a predetermined time based on the three-dimensional object data included in the predicted spatial region, A priority setting step of setting the priority information, and registering and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. And memory capacity information indicating the storage capacity of the memory to be
The details of the three-dimensional object data according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. 3D object data transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. Selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. To send the dimensional object data to the client device as soon as possible, A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step, Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule, and merging the transmission schedules set in the transmission schedule setting step. Data transmission method. 31. The priority setting step calculates one of a degree of change of a viewpoint and a degree of change of a line of sight using the received viewpoint line of sight information, and calculates the degree of change of the calculated change. The priority information of the three-dimensional object data is reset according to the degree, and the selecting step resets the detail information according to the priority information of the three-dimensional object data reset by the priority setting step. In order to avoid exceeding the upper limit of the data capacity, the client sets the priority of the three-dimensional object data having the reset detailed information in the order of the priority reset by the priority setting unit. The three-dimensional object data to be transmitted to the device is reselected. Claim 2, characterized in that resetting the transmission schedule of the source object data
31. The three-dimensional spatial data transmission method according to any one of 7 to 30. 32. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A program for causing a computer to execute a three-dimensional spatial data transmission method of transmitting the three-dimensional object data from the server device to the client device in a three-dimensional spatial data transmission display system including a client device for displaying. In a computer-readable recording medium, the three-dimensional object data has priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. That stores a program for causing a computer to execute The computer-readable recording medium calculates the average available communication speed of the communication path per a predetermined time, monitors the available communication speed of the communication path, and monitors the change. In case,
A calculating step of calculating a degree of change in the communication speed based on the communication speed monitoring the change and the calculated average communication speed; and a three-dimensional object transmitted from the server device to the client device per a predetermined unit time. An upper limit value resetting step of setting the upper limit value of the data capacity of the data again according to the degree of change in the communication speed calculated in the calculating step; and before setting the upper limit value again in the upper limit value resetting step. A predetermined amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data to be transmitted from the server device to the client device; A transmission schedule destroying step for destroying the data transmission schedule; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input from the client device, and based on the input viewpoint information, a space area that enters the field of view by moving the viewpoint for a predetermined fixed time is predicted and set in advance. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the three-dimensional spatial data obtained from the client device; Data processing capability information indicating the processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input, and the priority set in the priority setting step is set. Information, available communication speed of the communication path, the processing capability information, and the rendering The upper limit value reset in the upper limit resetting step is determined in accordance with the capability information and the memory capacity information, and determines the detail level of the three-dimensional object data in order from the higher priority three-dimensional object data. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device; and three-dimensional object data displayed in the client device in the order of appearance and three-dimensional object data close to the viewpoint position. The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. Set the transmission schedule A setting step, and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step, and according to the merged transmission schedule, A transmission step of transmitting three-dimensional object data to the client device. A computer-readable recording medium recording a program for causing a computer to execute a three-dimensional spatial data transmission method. 33. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A program for causing a computer to execute a three-dimensional spatial data transmission method of transmitting the three-dimensional object data from the server device to the client device in the three-dimensional spatial data transmission display system including a client device for displaying the recorded data. In a computer-readable recording medium, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. Register and save the 3D object data sent from A computer-readable recording medium having a memory having a variable storage capacity and storing a program for causing a computer to execute the three-dimensional spatial data transmission method includes storage capacity information indicating a storage capacity of the memory from the client device. At a predetermined timing, and calculating the degree of change in the storage capacity of the memory using the storage capacity information input at the predetermined timing and the storage capacity information input immediately before; An upper limit for setting again the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per unit time according to the degree of change in the storage capacity of the memory calculated in the calculation step. The upper limit is set again by the value resetting step and the upper limit resetting step. Before performing the scheduling, the fixed amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data transmitted from the server device to the client device. A transmission schedule discarding step of discarding the transmission schedule of the dimensional object data; and inputting viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and moving the viewpoint for a predetermined fixed time based on the input viewpoint information. And sets the priority information for the three-dimensional object data included in the predicted space area according to the purpose of displaying the predetermined three-dimensional space data. Priority setting step to be performed, and Data processing capability information indicating the data processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data, and are set in the priority setting step. Determining the level of detail of the three-dimensional object data according to the priority information, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information; Selecting the three-dimensional object data to be transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the highest three-dimensional object data; 3D object data and viewpoint that appear in the device in the order of appearance The three-dimensional object selected in the selecting step so that at least one of the three-dimensional object data close to the position of the eye and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. A transmission schedule for setting a transmission schedule for transmitting data to the client device; and a transmission schedule set in the transmission schedule setting step at the end of a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step. Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule. A computer-readable recording medium that records a program to be executed by a computer. 34. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A program for causing a computer to execute a three-dimensional spatial data transmission method of transmitting the three-dimensional object data from the server device to the client device in the three-dimensional spatial data transmission display system including a client device for displaying the recorded data. In a computer-readable recording medium, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. Predetermined processing capacity to receive and display object data A computer-readable recording medium that stores a program for causing a computer to execute the three-dimensional spatial data transmission method, wherein the predetermined processing capability changes according to a processing load situation in the client device. The load information indicating the load status of the processing is input at a predetermined timing from the client device, and the load information input at the predetermined timing and the load information input immediately before are used to change the load status of the processing. A calculation step of calculating a degree; and a change in the load condition of the processing calculated in the calculation step, the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per a predetermined unit time. The upper limit value resetting step to be set again according to the degree of Before the upper limit of the data capacity is set again by the backup, a certain amount of three-dimensional object data is left as untransmitted data from the three-dimensional object data scheduled to be transmitted from the server device to the client device. A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data; and viewpoint information indicating a viewpoint and a moving speed of the viewpoint from the client device; 3D object included in the predicted spatial region according to the purpose of displaying a predetermined 3D spatial data by predicting a spatial region entering the field of view by moving the viewpoint for a predetermined fixed time based on the A priority setting step of setting the priority information for the data; Data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input from the client device. The detail level of the three-dimensional object data is determined according to the priority information set in the setting step, the available communication speed of the communication path, the processing capacity information, the rendering capacity information, and the memory capacity information. And selecting the three-dimensional object data to be transmitted from the server device to the client device in order from the three-dimensional object data having the highest priority to the upper limit value reset in the upper limit resetting step. Steps and appearances displayed on the client device The selection is performed so that at least one of the three-dimensional object data, the three-dimensional object data close to the position of the viewpoint, and the three-dimensional object data close to the line of sight, is transmitted to the client device as soon as possible. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected by the step to the client device; Transmitting the three-dimensional object data to the client device according to the merged transmission schedule by merging the transmission schedules set in the schedule setting step. A computer-readable recording medium storing a program for executing a three-dimensional space data transmission wherein the computer. 35. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. A program for causing a computer to execute a three-dimensional spatial data transmission method of transmitting the three-dimensional object data from the server device to the client device in a three-dimensional spatial data transmission display system including a client device for displaying. In a computer-readable recording medium, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The information indicating the moving speed and the information indicating the rotation speed of the line of sight And a computer-readable recording medium that records a program for notifying one of the viewpoint visual line information to the server device and causing the computer to execute the three-dimensional spatial data transmission method. Calculating a degree of change in the viewpoint gaze information by inputting the gaze information at a predetermined timing and using the viewpoint gaze information input at the predetermined timing and the viewpoint gaze information input immediately before; The upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per unit time according to the degree of change of the viewpoint visual line information calculated in the calculation step. The upper limit value is set again by the value resetting step and the upper limit value resetting step. From the three-dimensional object data previously scheduled to be transmitted from the server device to the client device, a certain amount of three-dimensional object data is left as untransmitted data, and three-dimensional data other than the certain amount of untransmitted data is left. A transmission schedule discarding step of discarding the transmission schedule of the object data; and inputting viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and moving the viewpoint for a predetermined fixed time based on the input viewpoint information. The priority information is set for the three-dimensional object data included in the predicted space area according to the purpose of displaying the three-dimensional space data set in advance by predicting the spatial area entering the field of view. A priority setting step, and a client device data Inputs the memory capacity information indicating the storage capacity of the memory register stores the rendering capability information and the three-dimensional object data indicating a data processing capability information and rendering capabilities showing a data processing capability,
The details of the three-dimensional object data according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. 3D object data transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. Selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. To send the dimensional object data to the client device as soon as possible, A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step, Transmitting the three-dimensional object data to the client device in accordance with the merged transmission schedule and merging the transmission schedules set in the transmission schedule setting step. A computer-readable recording medium on which a program for causing a computer to execute a data transmission method is recorded. 36. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving the three-dimensional object data transmitted from the server device. And a client device for generating a three-dimensional virtual space using the received three-dimensional object data and displaying the generated three-dimensional virtual space at a predetermined designated frame rate (display screen switching speed). In the three-dimensional space data display method of the three-dimensional space data transmission display system, the client device stores the three-dimensional object data constituting the three-dimensional virtual space as scene configuration information. A scene configuration information database is provided. A requesting step of outputting a signal request, receives the three-dimensional object data transmitted from the server apparatus, the three-dimensional object data received 3
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. A rendering step of rendering a three-dimensional space scene viewed from a viewpoint at the predetermined frame rate in accordance with the degree of detail indicated by the display management step; the requesting step; the receiving step; the scene configuration management step; Display management step And monitoring the processing status of the rendering step and allocating the processing time to each unit so as to maintain the processing time for rendering in the rendering step at the predetermined designated frame rate. And a task adjusting unit for adjusting the processing time of each unit. 37. The task adjusting step, comprising: when the processing time in the receiving step exceeds the processing time allocated to the receiving step, so that the predetermined designated frame rate cannot be maintained. , The processing time is re-allocated to the server device, the receiving rate at which the processing of the receiving step is completed within the re-allocated processing time is determined, and the three-dimensional object data is transmitted at the determined receiving rate. 37. The three-dimensional spatial data display method according to claim 36, wherein a request is made for a change in the transmission rate. 38. The task adjusting step, wherein the processing time of the rendering step exceeds the processing time allocated to the rendering step, and the predetermined frame rate cannot be maintained. To the client device to reset the level of detail of the three-dimensional object data displayed on the client device, thereby shortening the processing time of the rendering step, and transmitting the three-dimensional object data to the server device. 37. The three-dimensional spatial data display method according to claim 36, wherein a request for changing the rate is made. 39. The task adjusting step includes a processing time required for a series of processing executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step. Monitoring for a certain period of time, calculating the average value of the processing time required for the series of processes using the monitored result, and requesting the calculated average value to maintain the predetermined specified frame rate. 37. The three-dimensional space data display method according to claim 36, wherein a processing time required for each processing executed by the step, the receiving step, the scene configuration management step, the display management step, and the rendering step is adjusted. . 40. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a predetermined communication path, and receiving three-dimensional object data transmitted from the server device. And a client device for generating a three-dimensional virtual space using the received three-dimensional object data and displaying the generated three-dimensional virtual space at a predetermined designated frame rate. A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional space data display method, wherein the client device transmits a plurality of three-dimensional object data constituting the three-dimensional virtual space to scene configuration information. 3D sky with scene configuration information database stored as A computer-readable recording medium storing a program for causing a computer to execute the data display method, a requesting step of outputting a distribution request for three-dimensional object data to the server device, Data is received, and the 3D object data 3
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. A rendering step of rendering a three-dimensional space scene viewed from a viewpoint at the predetermined frame rate in accordance with the degree of detail indicated by the display management step; the requesting step; the receiving step; the scene configuration management step; Display management step And monitoring the processing status of the rendering step and allocating the processing time to each unit so as to maintain the processing time for rendering in the rendering step at the predetermined designated frame rate. A computer-readable storage medium storing a program for causing a computer to execute a three-dimensional spatial data display method, comprising: a task adjustment unit that adjusts a processing time of each unit. 41. The task adjusting step, comprising: when the processing time in the receiving step exceeds the processing time allocated to the receiving step, so that the predetermined designated frame rate cannot be maintained. , The processing time is re-allocated to the server device, the receiving rate at which the processing of the receiving step is completed within the re-allocated processing time is determined, and the three-dimensional object data is transmitted at the determined receiving rate. 41. A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to claim 40, wherein the computer requests the transmission rate change. 42. The task adjusting step, wherein the processing time in the rendering step exceeds the processing time allocated to the rendering step, and the predetermined designated frame rate cannot be maintained. Is instructed to reset the degree of detail of the three-dimensional object data displayed on the client device, thereby shortening the processing time of the rendering step and transmitting the three-dimensional object data to the server device. 41. A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data display method according to claim 40, wherein the computer requests the change of a rate. 43. The task adjusting step specifies a processing time required for a series of processing executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step. Monitoring for a certain period of time, calculating the average value of the processing time required for the series of processes using the monitored result, and requesting the calculated average value to maintain the predetermined specified frame rate. 41. The three-dimensional space data display method according to claim 40, wherein a processing time required for each processing executed by the step, the receiving step, the scene configuration management step, the display management step, and the rendering step is adjusted. Computer-readable recording recording a program for causing a computer to execute the program Body. 44. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In the method for transmitting and displaying three-dimensional data, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of data. The client device generates a third-order object generated using the three-dimensional object data. A scene configuration information database for storing scene configuration information constituting the original virtual space, wherein the three-dimensional virtual space is displayed at a predetermined designated frame rate; Calculating the average available communication speed of the communication path per time, monitoring the change in the available communication speed of the communication path, and monitoring the change,
A calculating step of calculating a degree of change in the communication speed based on the communication speed monitoring the change and the calculated average communication speed; and a three-dimensional object transmitted from the server device to the client device per a predetermined unit time. An upper limit value resetting step of setting the upper limit value of the data capacity of the data again according to the degree of change in the communication speed calculated in the calculating step; and before setting the upper limit value again in the upper limit value resetting step. A predetermined amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data to be transmitted from the server device to the client device; A transmission schedule destroying step for destroying the data transmission schedule; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input from the client device, and based on the input viewpoint information, a space area that enters the field of view by moving the viewpoint for a predetermined fixed time is predicted and set in advance. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the three-dimensional spatial data obtained from the client device; Data processing capability information indicating the processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input, and the priority set in the priority setting step is set. Information, available communication speed of the communication path, the processing capability information, and the rendering The upper limit value reset in the upper limit resetting step is determined in accordance with the capability information and the memory capacity information, and determines the detail level of the three-dimensional object data in order from the higher priority three-dimensional object data. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device; and three-dimensional object data displayed in the client device in the order of appearance and three-dimensional object data close to the viewpoint position. The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. Set the transmission schedule A setting step, and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step, and according to the merged transmission schedule, A transmitting step of transmitting three-dimensional object data to the client device, a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and a three-dimensional object data transmitted from the server device. Received and received 3D object data 3
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. A three-dimensional spatial data transmission and display method, comprising: 45. A server device for transmitting three-dimensional object data forming a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In the method for transmitting and displaying three-dimensional spatial data, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The device is a three-dimensional object data transmitted from the server device. And a scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space generated using the three-dimensional object data, and that stores the three-dimensional virtual space. Is displayed at a predetermined designated frame rate. In the three-dimensional spatial data transmission and display method, storage capacity information indicating the storage capacity of the memory is input from the client device at a predetermined timing, and at the predetermined timing, A calculating step of calculating the degree of change in the storage capacity of the memory using the input storage capacity information and the storage capacity information input immediately before; and from the server device to the client device per predetermined unit time. The upper limit of the data capacity of the three-dimensional object data to be transmitted is determined by the method calculated in the above calculation step. An upper limit value resetting step of resetting according to the degree of change in the storage capacity of the memory; and transmitting the upper limit value from the server device to the client device before setting the upper limit value again in the upper limit value resetting step. A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data from the scheduled three-dimensional object data as untransmitted data and discarding a transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input from the client device, and based on the input viewpoint information, a space area that enters the field of view by moving the viewpoint for a predetermined fixed time is predicted and set in advance. Depending on the purpose of displaying the three-dimensional spatial data, Priority setting step of setting the priority information for the three-dimensional object data; data processing capability information indicating the data processing capability of the client device; rendering capability information indicating the rendering processing capability; Memory capacity information indicating the storage capacity of a memory for registering and storing object data is input, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, and the rendering The level of detail of the three-dimensional object data is determined according to the capability information and the memory capacity information, and the upper limit reset by the upper limit resetting step in the order of higher priority three-dimensional object data. Up to a value, transmitted from the server device to the client device A selecting step of selecting three-dimensional object data; and at least one of three-dimensional object data displayed in the client device in an early appearance order, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so as to transmit one three-dimensional object data to the client device earlier; The transmission schedule set in the transmission schedule setting step is merged with the end of the transmission schedule of the untransmitted data that has not been discarded in the step. A transmitting step of transmitting original object data to the client device, a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and receiving the three-dimensional object data transmitted from the server device And 3 of the received 3D object data
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. A three-dimensional spatial data transmission and display method, comprising: 46. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In the method for transmitting and displaying three-dimensional spatial data, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a level of detail of the data. The apparatus is configured to receive and display the three-dimensional object data. The predetermined processing capability changes according to the processing load of the client device, displays the three-dimensional virtual space at a predetermined designated frame rate, and uses the three-dimensional object data. A scene configuration information database that stores scene configuration information that configures the generated three-dimensional virtual space. The method for transmitting and displaying three-dimensional space data includes: Calculating at a timing, using the load information input at the predetermined timing and the load information input immediately before, to calculate a degree of change in the load status of the processing; and The upper limit of the data capacity of the three-dimensional object data transmitted from the server to the client The upper limit value resetting step to be set again according to the degree of change in the load situation of the processing calculated in the output step, and the server apparatus performs the above setting before setting the upper limit of the data capacity again by the upper limit value resetting step. From the three-dimensional object data scheduled to be transmitted to the client device, a fixed amount of three-dimensional object data is left as untransmitted data, and the transmission schedule of the three-dimensional object data other than the fixed amount of non-transmitted data is discarded. A transmission schedule discarding step, and inputting viewpoint information indicating the viewpoint and the moving speed of the viewpoint from the client device, and moving into the field of view by moving the viewpoint for a predetermined fixed time based on the input viewpoint information. According to the purpose of displaying 3D spatial data set in advance A priority setting step of setting the priority information for the three-dimensional object data included in the predicted spatial region; data processing capability information indicating the data processing capability of the client device from the client device; And memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. The priority information set in the priority setting step and the available communication speed of the communication path are input. Determining the level of detail of the three-dimensional object data according to the processing capability information, the rendering capability information, and the memory capacity information, and resetting the upper limit value in order from the three-dimensional object data having the higher priority. Up to the upper limit value reset by the step, the server device A step of selecting three-dimensional object data to be transmitted to the client device; three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three lines close to the line of sight. A transmission schedule for setting a transmission schedule for transmitting the three-dimensional object data selected in the selecting step to the client device so that at least one of the three-dimensional object data and the three-dimensional object data is transmitted to the client device as soon as possible. Setting step; and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step. A transmitting step of transmitting the three-dimensional object data to the client device according to a schedule; a requesting step of outputting a distribution request of the three-dimensional object data to the server device; Receives three-dimensional object data and receives three-dimensional object data
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. A three-dimensional spatial data transmission and display method, comprising: 47. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In the method for transmitting and displaying three-dimensional data, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device and detail information indicating a detail of data. The client device has information indicating the moving speed of the viewpoint and information indicating the rotating speed of the line of sight. At least one of the viewpoint line-of-sight information is notified to the server device, the three-dimensional virtual space is displayed at a specified frame rate, and the three-dimensional object generated using the three-dimensional object data is displayed. A scene configuration information database that stores scene configuration information configuring a virtual space; the three-dimensional space data transmission and display method includes: inputting the viewpoint line-of-sight information from the client device at a predetermined timing; A calculating step of calculating the degree of change of the viewpoint line-of-sight information using the input viewpoint line-of-sight information and the viewpoint line-of-sight information input immediately before; and transmitting from the server device to the client device per predetermined unit time. The viewpoint gaze calculated in the above calculation step is the upper limit value of the data capacity of the three-dimensional object data to be calculated. The upper limit value resetting step of setting again according to the degree of change of the information, and scheduling the transmission from the server device to the client device before setting the upper limit value again by the upper limit value resetting step. A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data as untransmitted data from the three-dimensional object data and discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input, and based on the input viewpoint information, a spatial region which enters the field of view by moving the viewpoint for a predetermined fixed time is predicted, and a predetermined three-dimensional region is set. Depending on the purpose of displaying the spatial data, the three-dimensional Priority setting step of setting the priority information with respect to the project data; and data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and the three-dimensional object data. Enter memory capacity information indicating the storage capacity of the memory to be registered and stored,
The details of the three-dimensional object data according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. 3D object data transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. Selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. To send the dimensional object data to the client device as soon as possible, A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step, Transmitting the three-dimensional object data to the client device according to the merged transmission schedule according to the merged transmission schedule, and transmitting the three-dimensional object data to the server device. A requesting step of outputting a distribution request of the object data; receiving the three-dimensional object data transmitted from the server device;
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. A three-dimensional spatial data transmission and display method, comprising: 48. The task adjusting step of the client device includes a series of processes executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step of the client device. The required processing time is monitored for a specified fixed time, an average value of the processing time required for the above series of processing is calculated using the monitored result, and the calculated average value is calculated at a predetermined frame rate. In order to maintain the above, for the object extraction step of the server device,
A request is made to adjust the level of detail information of the three-dimensional object data to be transmitted. 48. The method of transmitting and displaying three-dimensional spatial data according to claim 44, wherein the setting is changed. 49. The task adjusting step of the client device includes a series of processes executed by the requesting step, the receiving step, the scene configuration managing step, the display managing step, and the rendering step of the client device. The required processing time is monitored for a specified fixed time, an average value of the processing time required for the above series of processing is calculated using the monitored result, and the calculated average value is calculated at a predetermined frame rate. To keep below
In response to the transmission data capacity adjustment step of the server device, the client device can be selected from the three-dimensional object data existing in the three-dimensional virtual space predicted to be displayed on the client device within the predetermined time. A request is made to adjust an upper limit value of a data capacity to be selected as three-dimensional object data to be transmitted per predetermined unit time, and the transmission data capacity adjusting step of the server device includes:
48. The three-dimensional spatial data transmission / display method according to claim 44, wherein the upper limit value of the selected data capacity is changed in response to a request from the task adjusting step of the client device. . 50. The task adjusting step of the client device, wherein the predetermined designated frame rate is adjusted to obtain a degree of detail of the three-dimensional object data transmitted to the object extracting unit of the server device. Reducing the frequency of making at least one of the request to change the setting of the information and the request to adjust the upper limit to the transmission data capacity adjustment unit of the server device. 50. The method of transmitting and displaying three-dimensional spatial data according to claim 48 or 49. 51. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving the three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission display method for displaying and displaying the three-dimensional object data; Level of detail that indicates the level of detail of information and data The client device includes a scene configuration information database that stores scene configuration information that configures a three-dimensional virtual space generated using the three-dimensional object data, and stores the three-dimensional virtual space in a predetermined format. A computer-readable recording medium displaying a specified frame rate and recording a program for causing a computer to execute the three-dimensional spatial data transmission and display method is provided by: an available average of the communication path per a predetermined time period; When calculating the communication speed and monitoring a change in the available communication speed of the communication path, and monitoring the change,
A calculating step of calculating a degree of change in the communication speed based on the communication speed monitoring the change and the calculated average communication speed; and a three-dimensional object transmitted from the server device to the client device per a predetermined unit time. An upper limit value resetting step of setting the upper limit value of the data capacity of the data again according to the degree of change in the communication speed calculated in the calculating step; and before setting the upper limit value again in the upper limit value resetting step. A predetermined amount of three-dimensional object data is left as untransmitted data from the scheduled three-dimensional object data to be transmitted from the server device to the client device; A transmission schedule destroying step for destroying the data transmission schedule; The viewpoint information indicating the viewpoint and the moving speed of the viewpoint is input from the client device, and based on the input viewpoint information, a space area that enters the field of view by moving the viewpoint for a predetermined fixed time is predicted and set in advance. A priority setting step of setting the priority information with respect to the three-dimensional object data included in the predicted space area in accordance with a purpose of displaying the three-dimensional spatial data obtained from the client device; Data processing capability information indicating the processing capability, rendering capability information indicating the rendering processing capability, and memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data are input, and the priority set in the priority setting step is set. Information, available communication speed of the communication path, the processing capability information, and the rendering The upper limit value reset in the upper limit resetting step is determined in accordance with the capability information and the memory capacity information, and determines the detail level of the three-dimensional object data in order from the higher priority three-dimensional object data. A selecting step of selecting three-dimensional object data to be transmitted from the server device to the client device; and three-dimensional object data displayed in the client device in the order of appearance and three-dimensional object data close to the viewpoint position. The three-dimensional object data selected in the selecting step is transmitted to the client device so that at least one of the three-dimensional object data and the three-dimensional object data close to the line of sight is transmitted to the client device as soon as possible. Set the transmission schedule A setting step, and merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data not discarded in the transmission schedule discarding step, and according to the merged transmission schedule, A transmitting step of transmitting three-dimensional object data to the client device, a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and a three-dimensional object data transmitted from the server device. Received and received 3D object data 3
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. And a task adjusting unit for performing a method of transmitting and displaying the three-dimensional spatial data. 52. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving the three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In a computer-readable recording medium storing a program for causing a computer to execute a three-dimensional spatial data transmission and display method, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device. And detail level information indicating the level of detail of the data The client device comprises a memory having a variable storage capacity for registering and storing the three-dimensional object data transmitted from the server device, and a three-dimensional virtual space generated by using the three-dimensional object data. A scene configuration information database for storing scene configuration information; displaying the three-dimensional virtual space at a predetermined designated frame rate; and recording a program for causing a computer to execute the three-dimensional space data transmission and display method. In the computer-readable recording medium, the storage capacity information indicating the storage capacity of the memory is input from the client device at a predetermined timing, and the storage capacity information input at the predetermined timing and the storage capacity information input immediately before are input. Is used to calculate the degree of change in the storage capacity of the memory. Calculating the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time according to the degree of change in the storage capacity of the memory calculated in the calculating step. Accordingly, an upper limit value resetting step to be set again, and from the three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit value again in the upper limit value resetting step. A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data as untransmitted data and discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data; and moving the viewpoint from the client device to the viewpoint. Enter viewpoint information indicating speed and enter Based on the viewpoint information, a spatial region entering the field of view by moving the viewpoint for a predetermined period of time is predicted, and the three-dimensional space data included in the predicted spatial region is set according to the purpose of displaying the predetermined three-dimensional spatial data. A priority setting step of setting the priority information with respect to the dimensional object data; data processing capability information indicating the data processing capability of the client device from the client device; rendering capability information indicating the rendering processing capability; and three-dimensional object data And memory capacity information indicating the storage capacity of the memory for registering and storing, and the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, and the rendering capability information And the above-mentioned memory capacity information. The three-dimensional object data to be transmitted from the server device to the client device is selected in order from the three-dimensional object data having the highest priority up to the upper limit value reset in the upper limit resetting step. And selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so that the data is transmitted to the client device earlier; A step of merging the transmission schedule set in the transmission schedule setting step with the end of the transmission schedule of the untransmitted data, and transmitting the three-dimensional object data to the client device according to the merged transmission schedule; And a requesting step of outputting a distribution request of the three-dimensional object data to the server device, and receiving the three-dimensional object data transmitted from the server device and receiving the three-dimensional object data.
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. And a task adjusting unit for performing a method of transmitting and displaying the three-dimensional spatial data. 53. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. In a computer-readable recording medium storing a program for causing a computer to execute a three-dimensional spatial data transmission and display method, the three-dimensional object data includes priority information indicating a priority to be transmitted to the client device. And detail level information indicating the level of detail of the data The client device has a predetermined processing capability of receiving and displaying the three-dimensional object data, and the predetermined processing capability changes according to a processing load situation in the client device. A scene configuration information database that displays a three-dimensional virtual space at a predetermined designated frame rate and stores scene configuration information that configures a three-dimensional virtual space generated using the three-dimensional object data; A computer-readable recording medium that records a program for causing a computer to execute the data transmission display method, at a predetermined timing, inputs load information indicating a load status of the processing from the client device, and at the predetermined timing Using the input load information and the load information input immediately before, A calculating step of calculating a degree of change in the situation; and an upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time. An upper limit value resetting step of setting again according to the degree of change in the load condition, and the server apparatus transmits to the client apparatus before setting the upper limit of the data capacity again in the upper limit value resetting step. A transmission schedule discarding step of leaving a fixed amount of three-dimensional object data from the scheduled three-dimensional object data as untransmitted data and discarding a transmission schedule of the three-dimensional object data other than the fixed amount of untransmitted data; The viewpoint and the moving speed of the viewpoint are indicated by the client device. According to the purpose of displaying the three-dimensional spatial data set in advance by inputting the viewpoint information, predicting a spatial region entering the field of view by moving the viewpoint for a predetermined fixed time based on the input viewpoint information. A priority setting step of setting the priority information for the three-dimensional object data included in the predicted spatial region; data processing capability information indicating the data processing capability of the client device from the client device; And memory capacity information indicating the storage capacity of the memory for registering and storing the three-dimensional object data. The priority information set in the priority setting step and the available communication speed of the communication path are input. And a three-dimensional object according to the processing capability information, the rendering capability information, and the memory capacity information. Object data is determined and transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. A step of selecting three-dimensional object data to be displayed, and at least three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device so as to transmit any one of the three-dimensional object data to the client device earlier; Schedule break The transmission schedule set in the transmission schedule setting step is merged with the end of the transmission schedule of the untransmitted data not discarded in the step, and the three-dimensional object data is transmitted to the client device according to the merged transmission schedule. Requesting step of outputting a request for distribution of three-dimensional object data to the server device; receiving the three-dimensional object data transmitted from the server device; Data 3
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. And a task adjusting unit for performing a method of transmitting and displaying the three-dimensional spatial data. 54. A server device for transmitting three-dimensional object data constituting a three-dimensional virtual space, connected to the server device via a communication path, and receiving the three-dimensional object data transmitted from the server device. And transmitting the three-dimensional object data from the server device to the client device, and receiving the transmitted three-dimensional object data by the client device. A computer-readable recording medium storing a program for causing a computer to execute the three-dimensional spatial data transmission display method for displaying and displaying the three-dimensional object data; Level of detail that indicates the level of detail of information and data Wherein the client device notifies the server device of at least one of viewpoint information on viewpoint movement speed and information on line of sight rotation speed, and the three-dimensional virtual space. At a predetermined designated frame rate; and a scene configuration information database for storing scene configuration information constituting a three-dimensional virtual space generated using the three-dimensional object data; A computer-readable recording medium recording a program for causing a computer to execute the method, the viewpoint visual line information is input at a predetermined timing from the client device, and immediately before the viewpoint visual line information input at the predetermined timing. Calculation for calculating the degree of change in the viewpoint visual line information using the input viewpoint visual line information The step, the upper limit value of the data capacity of the three-dimensional object data transmitted from the server device to the client device per predetermined unit time, according to the degree of change of viewpoint visual line information calculated in the calculation step, An upper limit value resetting step to set again; and a predetermined amount from the three-dimensional object data scheduled to be transmitted from the server device to the client device before setting the upper limit value again in the upper limit value resetting step. A transmission schedule discarding step of discarding a transmission schedule of three-dimensional object data other than the fixed amount of untransmitted data while leaving the three-dimensional object data as untransmitted data; Enter the viewpoint information shown, and 3D object data included in the predicted space area according to the purpose of displaying a predetermined 3D space data based on the prediction of a space area entering the field of view by moving the viewpoint for a predetermined time. A priority setting step of setting the priority information, and registering and storing data processing capability information indicating the data processing capability of the client device, rendering capability information indicating the rendering processing capability, and three-dimensional object data from the client device. And memory capacity information indicating the storage capacity of the memory to be
The details of the three-dimensional object data according to the priority information set in the priority setting step, the available communication speed of the communication path, the processing capability information, the rendering capability information, and the memory capacity information. 3D object data transmitted from the server device to the client device up to the upper limit value reset in the upper limit value resetting step in order from the higher priority three-dimensional object data. Selecting at least one of three-dimensional object data displayed in the client device in the order of appearance, three-dimensional object data close to the viewpoint position, and three-dimensional object data close to the line of sight. To send the dimensional object data to the client device as soon as possible, A transmission schedule setting step of setting a transmission schedule for transmitting the three-dimensional object data selected in the selection step to the client device; and a transmission schedule of untransmitted data not discarded in the transmission schedule discarding step, Transmitting the three-dimensional object data to the client device according to the merged transmission schedule according to the merged transmission schedule, and transmitting the three-dimensional object data to the server device. A requesting step of outputting a distribution request of the object data; receiving the three-dimensional object data transmitted from the server device;
A receiving step for requesting an additional process to the three-dimensional virtual space; and a request for an additional process for adding the three-dimensional object data to the three-dimensional virtual space from the receiving step, and using the three-dimensional object data as the scene configuration information. A scene configuration management step to be added to the scene configuration information database, a display management step to instruct the degree of detail of the three-dimensional object data to be displayed on the client device, and a scene configuration information stored in the scene configuration information database. The three-dimensional virtual space seen from the viewpoint,
A rendering step of rendering at the predetermined frame rate according to the degree of detail instructed by the display management unit; a requesting step; a receiving step; a scene configuration management step; a display management step; The processing time is assigned to each unit and the processing time of each unit is adjusted so as to maintain the processing time for performing the rendering in the rendering step at the predetermined designated frame rate. And a task adjusting unit for performing a method of transmitting and displaying the three-dimensional spatial data.