WO1998000812A1

WO1998000812A1 - Server space forming method and apparatus

Info

Publication number: WO1998000812A1
Application number: PCT/JP1997/002273
Authority: WO
Inventors: Hideto Ikeda
Original assignee: Gakkohojin Ritsumeikan
Priority date: 1996-06-28
Filing date: 1997-06-27
Publication date: 1998-01-08
Also published as: JPH1021215A

Abstract

The load on a client apparatus is lightened by a method of three-dimensionally moving characters and synthesizing a visual field at a stop. In a cyberspace, a platform is expressed by using four elements, a space (S), an object (O), a manager (M) and an abutter (A). Especially, when a manager (M) based on negative programming is added so as to maintain the order of the space, a cyberspace having a high-degree function can be formed easily. A client apparatus (3) receives space data from a server apparatus (1), and reduces a still picture showing the figures of the object and abutter (A) on a still picture showing the background of the space, in accordance with the degree of the depth of the arrangement thereof, whereby the server space is visualized. The movements of the abutter (A) and object are controlled by detecting the mutual collision of them, and the visual sense of distance of a three-dimensional space is imitated by using a two-dimensional still picture.

Description

Description Cyberspace creation method and its creation device

The present invention relates to a method and apparatus for creating a cyberspace for realizing a society (virtual space) on a computer network in a client Z server system. Background art

Communication is changing significantly with the spread of the Internet. E-mail in the 1980's From communication centered on character texts through networking, in the early 1990's information on multimedia text hyperlinked by the World Wide Web (WWW) The number of participating users has exploded in place of communication centered on outgoing calls.

Utilization of this increased number of participants for business and other purposes is also progressing, and this is spurring the creation of new technologies.

Among them, “cyberspace,” a society realized using networks and computers, has attracted great expectations, and technological development for building, operating, and applying cyberspace is being actively pursued.

Common issues in various trials of these cyberspace (construction, operation, and application) technology developments are:

① Three-dimensionalization of space and objects

② Interactivity (interactivity or interaction)

③ Cooperation with the real world Is raised.

As methods for realizing society on computer networks, there are already low-level languages such as C / C +, 3D graphics libraries such as OpenGL, and GUKGraphi such as Mot if. cal User Interface) A method of building individual cyberspaces by calling a network library such as a library, Socket, etc., a face library, a multimedia library, etc. (Here, the expression method in low-level language j ) And a method of integrating these functions into a single language system to facilitate development (herein referred to as “expressing in a medium-level language”). It can be divided into methods of developing a cyberspace with functions (here, "Expression in a high-level language").

As for the implementation method using the above low-level languages, various libraries have been developed and standardized, and it can be said that basic software tools have been prepared. However, development in this manner has poor productivity and low success rates.

In order to reliably and easily build cyberspace with advanced functions, methods using medium-level languages are being developed. It is equipped with VRML (Virtual Reality Modeling Language) that can walk in three-dimensional space just by giving three-dimensional model data, graphic processing and an Internet interface as standard, and sends programs from the server to the client. There is a Java language with improved operability, and QuickTimeVR, which cuts out the viewing angle of a wide-angle still image and displays it 360 degrees. However, these methods are still not enough to easily build sophisticated cyberspace.

For this reason, the above languages are being improved, but have not yet been developed as high-level languages.

In addition, the VRML technology described above, which shows the space in three dimensions and allows you to walk in it Has the advantage that users can express something closer to the real-world entity. However, there is a problem that the PC device cannot be easily participated by the client device because a very large load is applied to the client device (a high load problem on the client side).

Furthermore, in order to expand the application range of the alternative space in the real world, functions such as collision control, voice and object functionalization, and space sharing among multiple users have been enhanced, which has reduced the load on client devices. There is a contradictory problem of getting higher and higher.

In addition, the three-dimensional space constructed by the VRML technology described above performs space walking (walk-through) by manipulating the steering wheel displayed at the bottom of the screen, but the visual field on the screen changes dynamically when walking. Is what you do. By dynamically showing the change in the field of view that accompanies this movement, this space gives a sense of reality.

However, there are no people in this space, and there are various problems such as slipping through and collision with objects. In addition, there is also a problem that the expression of the object displayed on the screen has no realism and is like a toy.

The present invention has been made in view of the above points, and provides a platform for easily constructing a cyberspace having advanced functions. By providing a method of creating cyberspace and reducing the load on the client device side by replacing the method of “moving the viewpoint” of the above with the method of “3D character movement + visual field synthesis when stopped” Things. Disclosure of the invention

In the cyberspace creation method according to claim 1 of the present invention, the server device 1 and one or more client devices 3 are connected to a computer network. In the method of creating a cyberbase for realizing a cyberspace as a virtual society formed on this computer network, the cyberspace is connected to each other on a computer network. A space S, which represents the shape and properties of a three-dimensional space, such as a box type, an open type such as a university, a town, etc. Object 0 as a possessed object, Aba Yuichi A as a character visualized as an agent of a user who participates in the above-mentioned space S and acts as an agent, and Obuji X Xt 0 and Avatar A as above The server device 1 is modeled by four elements, namely, the manager M as a control function that maintains the order in the space S so as not to exert the functions under certain conditions. , Object I, Manager M, and Aba Yuichi A. A data holding function 11 that holds data for building cyberspace described by four elements, and one or more data of this data holding function 11 1. Space control functions 10 and 11 for one user to share from his / her client device 3 via the network 2 and communication for exchanging data and signals with the client device 3 on the network 2 The client device 3 has a function 13 and a cyber space data receiving function 17 8 for receiving and holding a cyber space construction data sent from the server device 1 and a cyber space receiving function. Data reception function 178 Cyber space visualization function that receives data from 178 and visualizes a two-dimensional still image on the screen, and data and signals from server device 1 A communication function for sending and receiving data, and receiving a 2D still image from the server device 1 in response to a request from the client device 3 and performing 3D space imitation drawing by the perspective method. It features. The method for creating cyberspace according to claim 2 is characterized in that the server device 1 has a space resource management function 11 for defining, storing, searching, updating, and deleting data for building cyberspace. I have. Further, the method for creating a cyberspace according to claim 3 is characterized in that the server device 1 is provided with a function for storing and reproducing the activity history of the avatar A 132.

According to the method for creating a cyberspace described in claim 4, the common space control functions 10 and 11 of the server device 1 are configured such that the space S and the object 0 constituting the cyberspace are viewed from the viewpoint of each user. A view image synthesis function for generating a three-dimensional still image, an activity possibility search function for examining the possibility of the activity of the avatar A sent from each client device 3 based on the definition of the manager M, and an avatar In order to reflect the activity of A on each client device 3, an activity reflecting function of notifying the client device 3 is provided.

Furthermore, in the method for creating a cyberspace according to claim 5, the resource management function 11 of the server device 1 is a class management that manages, as a class, those that share the properties of the resources to be managed and a group of programs for processing the resources. Functions and related management functions that manage generalization, aggregation, and other relationships between classes of the classifying function, and an instance access function that enables high-speed search, update, and deletion of instances as class resources It is also characterized by an existing function integration function that reconfigures existing programs of the operating system as class methods.

According to the cyberspace creation method described in claim 6, the cyberspace visualization function of the client device 3 includes the object ◦ and the avatar A on a wide-angle still image in perspective which shows the background of the space S. A far-field image reduction function that reduces the still image that indicates the position of the image according to the depth of the layout, and a two-dimensional still image that overwrites the background image from the deepest It is characterized by having a forward image overwriting function that imitates closeness In the method for creating cyberspace according to claim 7, the cyberspace visualization function of the client device 3 detects a collision between the mutual positions of the butter A objects and controls the movement of the avatar A. It is characterized by having.

In the method for creating cyberspace according to claim 8, the client device 3 includes a three-dimensional speech synthesis / playback function for synthesizing / playing the generated sound three-dimensionally according to the positional relationship between the sound generation position and the avatar A. , This 3D speech synthesis • The playback function includes a voice distance attenuation function that controls the volume of the avatar A's voice according to the distance between the user's own avatar A and other avatars A and the space S. It has a directional speech synthesis function that allows the voice of avatar A to reach the right ear earlier than the left ear.

Further, in the cyberspace creation device according to the ninth aspect, the server device 1 and one or more client devices 3 are mutually connected on a computer network. In the method of creating a cyber space for realizing a cyber space as a virtual society formed by the above, the above cyber space is a three-dimensional such as a box type such as a classroom and a conference room, and an open type such as a university and a town. Participating in the above-mentioned space S, the space S as data representing the shape and properties of the space, the object 0 as an object arbitrarily arranged in this space S, and having a specific attribute group and function group Under certain conditions, Avatar A as a character visualized as a proxy for a user who is active and the functions provided by Object 0 and Avatar A are provided under certain conditions. It is modeled by four elements with the manager M as a control means for maintaining the order in the space S so as not to exert it, and the server device 1 is composed of the space S, the object, the manager M, and the avatar. A data holding means 11 for holding data for building a cyberspace described by the four elements of A, and one or more users Common space control means 10 and 11 for sharing from the client device 3 via the network 2 and communication means 13 for exchanging data and signals with the client device 3 on the network 2 The client device 3 includes a cyberspace data receiving unit 178 that receives and holds the data for building cyberspace sent from the server device 1, and a cyberspace data receiving unit 178. Cyberspace visualization means that receives 2D still image data and performs 3D space imitation drawing on the screen by perspective, and communication means 177 that communicates with the server device 1 and sends and receives signals It is characterized by having.

In the cyberspace creation device according to claim 10, the server device 1 is provided with space resource management means 11 for defining, storing, searching, updating, and deleting cyberspace construction data. Features.

Further, in the cyberspace creation device according to claim 11, the server device 1 is provided with means for storing and reproducing the activity history of Ababa Yuichi A 132.

In the cyberspace creation device according to claim 12, the server device 1 includes the common space control means 10 and 11 which are configured to view the space S and the object を constituting the cyberspace from the viewpoint of each user. A field-of-view image synthesizing means for generating a three-dimensional still image, an activity possibility search means for inspecting the activity possibility of avatar A sent from each client device 3 based on the definition of manager M, An activity reflecting means for notifying the client device 3 in order to reflect the activity A in each client device 3 is provided.

In the cyberspace creation device according to claim 13, the resource management means 11 of the server device 1 is a classifying means for managing, as a class, those which share the properties of the resources to be managed and a group of programs for processing the resources. And the means of classifying An association management means that manages generalization and aggregation and other associations between classes, an instance access means that enables high-speed search, update, and deletion of instances as class resources, and an operating system It is characterized by the provision of existing function integration means that reconfigures existing programs owned by as a class method.

Furthermore, in the cyberspace creation device according to claim 14, the cyberspace visualization means of the client device 3 includes the object の and the avatar A on a wide-angle still image in perspective which shows the background of the space S. A distant image reduction unit that reduces the still image showing its appearance according to the depth of its arrangement, and a perspective image in 3D space using a 2D still image by overwriting the background image in order from the deepest It is characterized by having forward image overwriting means for imitating the feeling.

In the cyberspace creation device according to claim 15, the cyberspace visualization means of the client device 3 detects a collision between the avatars A and A, and controls the movement of the avatar A. It is characterized by having means.

In the cyberspace creation device according to claim 16, the client device 3 includes a three-dimensional sound synthesis / reproduction means for synthesizing / reproducing the generated sound three-dimensionally according to the positional relationship between the sound generation position and the avatar A. The three-dimensional sound synthesizing / reproducing means includes sound distance attenuating means for controlling the volume of the sound of avatar A according to the distance between own avatar A and other avatars A and space S. And a directional voice synthesizing means for causing the voice of the avatar A on the right side to reach the right ear earlier than the left ear.

Here, the platform we are trying to build is a cyberspace represented by four elements: space, object (Object), manager (Manager), and butter (Avat or). Things. Resource Library I

The space resource management system stores space libraries such as rooms and open spaces, desks, chairs, computers, VCRs, object libraries such as blackboards, one avatar face image library, one avatar clothing library, etc. It is managed, and the specific cyberspace designer defines the structure of cyberspace by combining these.

Maintaining spatial order

The components of cyberspace have potential functions and constraints since they were brought into space. Space imposes restrictions on the placement of observable avatars, and objects have their potential functions defined as methods. Also, avatars have the potential to move in space and manipulate objects.

However, if all these potentials are exercised, the space will be chaotic. For example, it is potentially possible to make unrelated statements or move around during a meeting, but if you let it go freely, it will not function as a meeting room (space). It is the role of the manager to control this.

Since what restrictions are required depends on the nature of the cyberbase as an application, the application designer defines this in a (manager description) language. Although this language can be expressed in various ways, it essentially limits the potential functions under certain conditions. This is called "negative 'programming."

Model features

By describing cyberspace with the above four elements (Spatial S, Object II, Manager M, Avatar A), especially by adding a negative 'programming manager to maintain spatial order, High -1 o-A feature of the present invention is that a cyberspace having various functions can be easily described (constructed). This model is called the “S. OMA model” (see Fig. 1).

Cyberspace building procedure

① Hardware configuration

Next, we will explain how to realize cyberspace using the SOMA model. As shown in FIG. 1, first, the server device 1 is composed of, for example, a high-performance UNIX-based graphics computer, and the client device 3 is composed of, for example, a low-cost standard computer equipped with Windows 95. It is composed of a personal computer, and the server device 1 and one or more client devices 3 are connected by a network 2 using, for example, INS 64 lines.

② Selection and realization of space type

A person who builds a cyberspace using this system first specifies an appropriate space type from a space library based on how the server space looks spatially. Generally, it is either a box-shaped space such as a room or an open space such as a town. This space type includes parameters such as background, size, color, and light source. By specifying specific values for these parameters, the specific space can be visualized (see Fig. 2). ).

③ Selection, realization and arrangement of objects

Next, objects such as desks / chairs, computers, and video devices to be placed in the space are selected from the space resource management system. The object also contains parameters like the space type, and these values are specified and the position in the space is determined at the same time. The specific objects placed in this way are:

It has properties and functions such as weight and price while having a three-dimensional shape.

2).

追加 Additional development of new resources The system has the most commonly used spatial type objects from the start, but if you don't have the right one, you can develop your own. It takes a low-level language approach. These are managed by the space resource management system of the server device 1 (spatial resource management function), using cyberspace as a construction-level language library.

決定 Determine your avatar

After the appearance of the space is determined in this way, the figure of Aba Yuichi (see Aba Yuichi A in Figure 5) acting in the space as the agent of the user participating in the space is determined. The avatar's body type is determined by specifying specific values for the parameters that determine the body type, such as height, chest measurement, and sitting height, and by attaching head image data to the head and clothing image data to the body. Be able to identify individuals. Avatars are potentially able to move around in space, change postures, talk to other avatars (users) with voice, and manipulate objects. (See Figure 2).

空間 Programming of spatial order: Designation of manager

In order for such a space to maintain a certain order, certain restrictions must be imposed on the avatar's activity and the function of the object. If you speak or walk around without permission during the meeting, the function of the space called the meeting room cannot be demonstrated.

This constraint is not generally determined and varies from space to space. Therefore, we specify what restrictions there are for each space. This is to limit the capabilities and functions that Avatar and objects have potentially, so it is not `` positive programming '' by embedding functions like a conventional programming language. And “negative, programming”. This point is also a feature of the present invention, and is one of the reasons why this method can easily construct an advanced space. Cyberspace in action

① Launch of space and user participation

The cyberspace data defined in this way is held in the server device 1. As shown in Fig. 3, when the space manager starts up the cyberspace, the user must join the cyberspace via the network 2 using a personal computer (client device 3) on which the client software has been installed. Can be. After the user authentication, the server device 1 transmits to the client device 3 a message indicating the state of the space viewed from the viewpoint of the user. This data consists of a still image to be the background, a still image and position indicating the shape of each object, the body type of the participating avatars, the posture parameter values and the head, and the clothing image data and position, and the space and object attribute values. And function group values.

② Visualization of space

The client device 3 that has received the spatial data visualizes the cyberspace (see Figs. 3 and 5). The method is as follows: First, a still image showing the image of object X Avatar A is reduced according to the depth of the arrangement on a perspective still image showing the background of the space (far image reduction function). ). Then, the background image is overwritten in order from the deepest (forward image overwriting function), and the movement of the avatar is detected by detecting the collision of the A-objects with each other (collision control function). Mimics the visual perspective of a three-dimensional space using a still image of ο

③ Voice communication

Further, when the user utters a voice, the voice is transmitted from the client device 3 to the server device 1 via the network 3, and the server device 1 executes the voice data of all the users together with the avatar A's positional relationship data. Send to client device 3 in time. Upon receiving this, the client device 3 The volume of the avatar's voice is reduced according to the distance between the avatar and other avatars in the space (voice distance attenuation function), and the sound of the avatar Yuichi who is closer to the right has the right-side volume slightly higher than the left side. Simulates the sound in a three-dimensional space by causing it to arrive early (directional speech synthesis function) and playing it back (3D speech synthesis and playback function)

).

活動 Activities in the space

When the avatar A performs an activity such as moving, changing a posture, or manipulating an object, the avatar A is queried to the server device 1 to check whether the avatar A may disturb the order in the space (activity). Result reporting function). The server device 1 inspects it according to the definition of the manager (activity possibility check function), and if possible, permits the action, and at the same time notifies other client devices 3 of it (activity reflection function). It plays the role of controlling for consistent communication (common space control function).

履歴 History function

In addition, the history of Aba Yuichi's activities in the space is saved, and this can be reproduced later from any angle (Activity history storage / reproduction function) o

Thus, in the present invention, cyberspace is added to the three elements of space, object, and avatar by adding an element called a manager by negative programming that has a function of a certain rule and restriction. Cyberspace with advanced functions can be easily configured.

In addition, the introduction of managers through negative programming plays an important role in increasing the productivity of cyberspace construction and increasing the success rate of development. In addition, the effect is enhanced by managing a library of space objects that make up cyberspace with the space resource management system on the server device 1 side. Furthermore, without bringing a 3D model of space or objects to the client device 3, the client device 3 imitates a 3D space based on a 2D still image created by a powerful graphics server. It is a low-speed personal computer that allows you to participate in a space represented by high-quality images. In addition, VRML and the Java language use the visualization (rendering) of the three-dimensional space on the client device 3 side, so if you want to improve the image quality, the client device 3 has a higher quality. In the present invention, the defect that performance is required is improved by making the high-performance server device 1 render.

In addition, the 3D speech synthesis and playback functions can realize immersive communication, and in this regard, it can also realize a sophisticated space that was not possible with conventional methods. BRIEF DESCRIPTION OF THE FIGURES

Figure 1 is a system configuration diagram for building a cyberspace according to the present invention.o

FIG. 2 is a diagram showing a basic procedure for building a cyberspace according to the present invention.

FIG. 3 is a diagram showing a basic operation of the cyberspace of the present invention. FIG. 4 is a schematic block diagram of the server device of the present invention.

FIG. 5 is a diagram showing a state in which cyber space is drawn on the display unit on the client device side of the present invention.

FIG. 6 is a block diagram showing a functional configuration of a server basic control library of the server device of the present invention.

FIG. 7 is a block diagram showing a functional configuration of the space basic control function unit in the server basic control library 1 of the present invention. FIG. 8 is a flowchart showing the control operation of the space start function unit in the space basic control function unit of the present invention.

FIG. 9 is a flowchart showing the control operation of the space participation function unit in the space basic control function unit of the present invention.

FIG. 10 is a flowchart showing the control operation of the space leaving function unit in the space basic control function unit of the present invention.

FIG. 11 is a flowchart showing the control operation of the space end function unit in the space basic control function unit of the present invention.

FIG. 12 is a block diagram showing a functional configuration of an object basic control function unit in the server basic control library of the present invention.

FIG. 13 is a block diagram showing a functional configuration of the avatar basic control function unit in the server basic control library 1 of the present invention.

FIG. 14 is a block diagram showing the functional configuration of the neighborhood space extraction function unit in the server basic control library 1 of the present invention.

FIG. 15 is a flowchart showing the control operation of the neighborhood object extraction function unit of the present invention.

FIG. 16 is a block diagram showing a functional configuration of the model conversion function unit in the server basic control library 1 of the present invention.

FIG. 17 is a flowchart showing the control operation of the wide-angle still image creation function unit of the present invention.

FIG. 18 is a block diagram showing a functional configuration of one of the spatial libraries according to the present invention.

FIG. 19 is a block diagram showing a functional configuration of one common object library of the present invention.

FIG. 20 is a block diagram showing a functional configuration of a video object in the common object library according to the present invention. FIG. 21 is a flowchart showing a control operation of preparation for reproduction and start of reproduction in the video object x video of the present invention.

FIG. 22 is a flowchart showing a control operation of pause of reproduction in the video object of the present invention.

FIG. 23 is a flowchart showing a control operation for stopping reproduction in the video object of the present invention.

FIG. 24 is a flowchart showing a control operation for ending an image in the video object of the present invention.

FIG. 25 is a block diagram showing a functional configuration of a video camera object in the common object library of the present invention.

FIG. 26 is a flowchart showing the control operation in the camera preparation function unit of the video camera object of the present invention.

FIG. 27 is a flowchart showing the control operation in the camera image distribution function unit of the video camera object of the present invention.

FIG. 28 is a flowchart showing a control operation in the video start function unit and the recording stop function unit of the video camera object of the present invention.

FIG. 29 is a flowchart showing a control operation in the playback start function unit and the playback pause function unit of the video camera object X of the present invention.

FIG. 30 is a flowchart showing a control operation in the playback stop function unit and the end function unit of the video camera object of the present invention.

FIG. 31 is a block diagram showing a functional configuration of a blackboard object in the common object library 1 of the present invention.

FIG. 32 is a flowchart showing a control operation in the blackboard preparation function unit and the drawing start instruction function unit of the blackboard object of the present invention.

FIG. 33 is a flowchart showing the control operation in the drawing distribution function unit and the drawing end distribution function unit of the blackboard object of the present invention. FIG. 34 is a flowchart showing a control operation in the blackboard object end function unit of the blackboard object of the present invention.

FIG. 35 is a block diagram showing a functional configuration of a microphone / speech force object in the common object library of the present invention.

FIG. 36 is a flowchart showing a control operation in the microphone preparation function unit of the microphone / speaker object of the present invention.

FIG. 37 is a flowchart showing a control operation in the voice distribution function unit of the microphone / speaker object of the present invention.

FIG. 38 is a flowchart showing the control operation in the recording start function unit and the recording stop function unit of the microphone and speaker object of the present invention.

FIG. 39 is a flowchart showing a control operation in the reproduction start function section and the reproduction pause function section of the microphone 1 speaker object of the present invention. FIG. 40 is a flowchart showing a control operation in the stop function unit of the microphone / speaker object according to the present invention.

FIG. 41 is a flowchart showing the control operation of the microphone / speaker object termination function unit of the present invention.

FIG. 42 is a block diagram showing a functional configuration of a chat object in the common object library of the present invention.

FIG. 43 is a flowchart showing a control operation in the start function section and the text distribution function section of the chat object according to the present invention.

FIG. 44 is a block diagram showing a functional configuration of a manager library according to the present invention.

FIG. 45 is a block diagram showing a functional configuration of the position manager 1 function unit in the manager library 1 of the present invention.

FIG. 46 is a block diagram showing the functional configuration of the security manager function unit in the manager library 1 of the present invention. FIG. 47 is a block diagram showing a functional configuration of the history manager function unit in the manager library 1 of the present invention.

FIG. 48 is a block diagram showing the functional configuration of the client / server communication function unit of the present invention.

FIG. 49 is a block diagram of the client device of the present invention.

FIG. 50 is a block diagram showing the functional configuration of the memory of the client device of the present invention.

FIG. 51 is a flowchart showing the control operation of the speaker object of the client device of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present invention, a cyber space is described by four elements: a space, an object, a manager, and an avator / agent, and operates on the Internet. The system configuration is shown in Fig. 1.

The server device 1 is composed of a high-performance graphics computer capable of high-speed rendering processing, multi-user control, and the like. The client device 3 is, for example, a low-cost standard computer equipped with Windows 95. It is composed of a personal computer, and the server device 1 and one or more client devices 3 are connected, for example, by a network 2 with INS 64 lines.

In order to establish a platform for easily constructing cyberspace, it is of utmost importance to describe (express) the cyberspace with a model. Describe with four elements.

Space It is a high-level description of a three-dimensional space that can be described with VRML version 1.0, with the functions of the space embedded. The space structure and functions can be easily described by storing parameterized space models and function modules in an object-oriented database management system, and associating them with specific values over time. It is made possible. The parameterized space in the database is described using VRML, and the functions are described, for example, as C language functions.

Object

It has a form described in VRML, and it consists of state variables (attributes) that it holds and methods that process the variables. These methods are basically activated by the operation of the avatar described later. Some of these objects have a sensor, and a dynamic object whose state or shape changes with the sensor. An autonomous object whose method is automatically activated by a change in state. There is also.

Manager

When multiple people (avatars) enter a single space for communication and cooperative work, certain rules and restrictions are required if the space serves a specific purpose. Timing of remarks and manipulation of objects is essential for efficient communication and collaboration, and the range of movement of Ababa Yuichi must be limited. These are established in the real world as manners, rules, etc. If they are violated, they will be punished for social criticism and restrictions on actions by power, but they will be programmatically implemented on the network. No, it's the manager.

Avator

Characters acting in the space as a user's agent are called avatars. It has the shape of a human being, and is three-dimensional in a three-dimensional space represented by perspective. Move to For example, if Ababa A shown in Fig. 5 goes deeper, it becomes smaller, if it comes closer, Ababa A becomes larger, and if it turns sideways, it becomes horizontal. Ababa-A is an object, for example, if you hide behind a pillar, you will not be able to see part of it. And Avatar A can manipulate the object and speak in a live voice. You control your avatar A's actions with your mouse.

In this system, in order to maintain the order of the above four elements (space, object, avatar, and manager) and perform their functions, when an event occurs, negative programming corresponding to the event is performed. As a description of the space, the space type is managed as a space library in the database 11 shown in Fig. 4, and what kind of space is called here is specified, and the background size, color, light source And so on. Also, the space is divided into areas to cause events.

The object description is also stored in the database 11 in the same manner as the object library, and the object library is managed. The server device 1 stores the name of the object library and the parameters that the object has. Specify evening. In addition, the description of Ababa Yuichi, which specifies the moving range of objects, is as follows. Only one Ababa Yuichi library, whose shape is roughly determined, is managed in database 11 and the server Use device 1 to specify parameters such as the avatar's body type, head image, and clothing. It also specifies the initial avatar layout coordinates and posture, and specifies the user name to control.

In addition, the manager's description specifies when the function of a given object cannot be triggered by Ababa Yuichi in the form of “negative 'programming'”.

Based on this theoretical model, the platform This is realized by a server architecture, in which the server device 1 and the client device 3 share functions.

The server device 1 holds a cyberspace model, notifies each client device 3 of the state of the space (data), and also informs the actions of other clients and their results, so that the actions of the clients do not contradict each other. Control function.

Here, it is extremely important that the objects and spaces of interest have reality in order for communication to take place over the network in earnest. In this system, a 3D model is held on the server device 1, and a high-precision still image that has been subjected to advanced processing such as texture pasting and shadow processing is created, and this still image is sent to the client device 3. , The reality is improving.

In addition, each user receives the state of the space viewed from any position and direction as a high-precision still image. The space is represented as a high-precision still image by a perspective method. It moves around on a still image under the control of the user. When Aba Yuichi goes to a predetermined area (position) in the space, the character transforms and shows its state, and at the same time manipulates things and flies to another space (warps). Can be.

In other words, in this system, instead of the VRML method of “dynamic viewpoint movement”, the method of “3D character movement + visual field synthesis at stop” is adopted, and the load on the client device 3 side is reduced by this method. ing . Since the server device 1 can use a high-performance graphics computer, it can synthesize high-quality still images at high speed according to the viewpoint and send it to the client device 3.

At shopping malls and virtual museums in cyberspace, the “dynamic viewpoint movement” performed by conventional VRML is not performed smoothly. The quality of the image at the time of stopping is important, and in this system, high-precision still images are sent to the client device 3 with a light load, while maintaining the image quality, and light processing on the client device 3 side Has been realized.

On the other hand, the client device 3 is a personal computer directly operated by a user participating in cyberspace (virtual space). The client 3 visualizes the space model received from the server device 1 via the network 2 and operates the avatar A. Is to be performed.

In addition, since heavy processing such as rendering and ray tracing and control of a multi-user environment are performed on the powerful server device 1 side as described above, the client device 3 side receives the client device 3 side. Processing can be reduced, and users can participate in the space with low-cost personal computers ο

By the way, there are various shapes in the space, but they can be roughly divided into two. One is a box-shaped space such as a classroom or a conference room, and the other is an open space such as a university or a baseball field. In the present invention, these two types of space are stored in the database 11.

The box-shaped space is a space surrounded by walls on all sides, with windows and doors attached. Examples of the space are the classrooms, conference rooms, and gymnasiums described above. The attributes of this type of space include width, height, and depth.

An open space is a flat space without any surroundings, and examples of such spaces are the above-mentioned university campuses, baseball stadiums, and towns. Configuration of server device 1

Fig. 4 shows a block diagram of the server device 1. The database 11 stores various data and programs in advance as a library, the memory 12 stores data programs, and the exchange of data with the client device 3. Client communication server 13 and database management system , Etc., and a CPU 10 which controls the entire control.

The functions supported by this server device 1 are: (1) neighborhood space extraction function, (2) model conversion function, (3) multi-user control function, (4) shared object management function, (4) opening function, and (4) data management function. It is.

The neighborhood space extraction function described above is a function to cut out only the part (space, object, avatar) related to the client in the space where the client participates. Also, (2) the model conversion function is a function that generates a pseudo three-dimensional cyberspace model to be sent to the client from the client's point of view. (3) The multi-user one control function is that multiple users are the same. This function is necessary for sharing space and communicating without contradiction.

Furthermore, ④the shared object management function is a function to manage the objects existing in the space, and ⑤the log function is to record the movement of the avatar in the space and the changes of the objects. It is a function that manages and reproduces this. The database management function manages the components of the space (SOMA space) as a database 11. As shown in FIG. 4, various libraries 16 to 19 created to support the above-mentioned functions are stored in the database 11 in advance. The server basic control library 16 is a library required to configure the main part of the server device 1, and the space library 17 is a library representing the space of cyber space. . The common object library 118 is a library of objects existing in cyberspace, and the manager library 19 is a library necessary for realizing the order in cyberspace.

Next, the server basic control library 16 will be described. The server device 1 is located in the space where the server device 1 is standing. It manages the business and the avatar A and responds to the request from the client device 3 while cooperating with the manager who realizes the order in the space, and provides the functions necessary to configure the main part. The library that we have is the server basic control library 16.

As shown in Fig. 6, the server basic control library 16 is composed of a basic space control function unit 22, a basic Xbox basic control function unit 23, a basic unit control function unit 24, and a neighborhood space extraction function. It consists of a function part 25 and a model conversion function part 26.

The basic space control function unit 22 has the functions necessary for the server device 1 to manage the space constituting the cyber space, and the basic object control function unit 23 has the function of the cyber space. The server device 1 has functions necessary for the server device 1 to manage the configured objects. The avatar basic control function unit 24 has a function necessary for the server device 1 to manage the avatar A participating in the cyber space, and the neighborhood space extraction function unit 25 sends the avatar A to the client device 3. It has an object near the avatar A and a function to select another avatar A. Further, the model conversion function unit 26 has a function of creating a wide-angle still image of a space or an object which needs to be sent to the client device 3 and is viewed from the viewpoint of the user of the client device 3.

Next, the details of the functional units 22 to 26 of the server basic control library 16 will be described. The basic space control function unit 22 of the server basic control library 16 has a configuration as shown in Fig. 7, and the space start function unit 31, the space participation function unit 32, the space exit function unit 33, Space end function 34, space attribute setting function 35, space attribute inquiry function 36, space area inquiry function 37, administrator authentication function 38, and user-authentication function 39 It is configured. The function of the space start function section 31 is to start up a space, and the space is designed to be started up by a user who has management qualifications. As shown in FIG. 8, the operation is started by an event from the client device 3, the server device 1 is called by a space start request (step S 1) from a certain client device 3, and on the server device 1 side, As shown in step S2, a check is made with a passcode to determine whether the user who has requested startup has administrative qualifications. If the user has the management qualification in step S3, the process proceeds to step S4, and the space (SOMA space) is set up according to the space stored in the designated directory. .

The space participation function unit 32 shown in FIG. 7 has a function to allow the user to participate in the space where the user is standing up, and is driven by an event from a certain client device 3 as shown in FIG. Is done. That is, a space participation request is sent from a certain client apparatus 3 to the server apparatus 1 as shown in step SI 1. As shown in step S12, the server device 1 checks whether the designated space is up and checks with a password whether the user who has requested participation has participation qualification.

As a result of this check, if there is eligibility to participate (step S13), the user is allowed to participate in the space as shown in step S14. Further, the server device 1 sends a data of the space model and the control model of the participating space to the client device 3 (step S15).

The space exit function section 33 shown in FIG. 7 is for letting the user participating in the space exit the space, and is driven by an event from the client device 3 of the user who wants to exit as shown in FIG. Is done. That is, when a user participating in the current space leaves, a space exit request is sent from the user's client device 3 to the server device 1 (step S2). 1) The server device 1 determines that there is an exit request in step S22, and exits the user who has made a request from the space as shown in step S23. Then, the server device 1 sends a notification that the user has left the space to the client device 3 of the user who has requested the notification (step S24), and the client device 3 that has sent the space exit request returns to the client device 3. The fact is received (step S25).

The space end function unit 34 in FIG. 7 is for terminating the rising space, and is driven by an event from the management user. FIG. 11 shows a flowchart for ending this space, and a space ending request is sent from the client device 3 having the management qualification to the server device 1 from the client device 3 (step S31). Upon receiving the space end request, the server device 1 checks in step S32 whether the user has a management qualification with a password. As a result of the check, if the user has the management qualification, a signal for instructing all participants to leave is sent to each client device 3 in step S33, and the space is closed in step S34.

Next, the space attribute setting function unit 35 shown in FIG. 7 is for setting the attributes of the space, and the attributes include the color of the wall.

The space attribute inquiry function unit 36 has a function of responding to an inquiry about the attribute of the space, and is driven by a request from the client device 3. Attributes include the color of the wall.

Further, the space area inquiry function unit 37 has a function of responding to an inquiry about information on an area held by the space, and is defined by a space object when called by a request from the client device 3. The area information is returned to the requesting client device 3.

The administrator authentication function unit 38 of the basic space control function unit 22 shown in FIG. 7 has a function of authenticating whether or not the user is an administrator. The space shown in FIG. 8 and FIG. During the startup of the space or the end of the space Be moved. The operation of the administrator authentication function unit 38 is performed by the pass-word sent as to whether the user who starts up the space or ends the space shown in FIGS. 8 and 11 has the management qualification. Check is performed.

The user authentication function unit 39 performs user authentication, and is called and driven during the space participation process. The operation of the user authentication function section 39 checks with a password whether the user who has applied for participation in the space shown in FIG. 9 has the participation qualification.

FIG. 12 shows a functional block diagram of the object basic control function part 23 in the server basic control library 16 shown in FIG. 6, and includes an object addition function part 42 and an object deletion function part. 43, an object attribute setting function unit 44, an object attribute inquiry function unit 45, and an object operation function unit 46.

The object addition function section 42 has a function of adding an object in the space under the control of the server device 1 and is configured to configure the space during the space start-up process described above. The object addition function unit 42 is driven by an event when the server device 1 is called or when called by a request from a certain client device 3. It is registered so that it can be managed, and it is also registered with necessary managers (such as the location manager and security manager described later).

The object deletion function unit 43 shown in FIG. 12 has a function of deleting an object in the space from the control of the server device 1. The object deletion function unit 43 is in the process of terminating the space or from the client device 3. Driven by request. The operation of this object deletion function unit 43 is registered in the server 1 This is to delete the objects that have been deleted, and also delete them as necessary manager functions.

Next, the object property setting function section 4 shown in FIG. 12 will be described. The object property setting function section 44 sets attributes of the object, Driven by request from 3

The operation of the object attribute setting function unit 44 sets the attribute of the object after asking the manager whether the attribute setting change is permitted. These attributes include name, color, and object-specific state.

The object attribute inquiry function unit 45 shown in FIG. 12 responds to the inquiry about the attribute of the object set in the object attribute setting function unit 44 described above. Driven by request from

The operation of the object property inquiry function unit 45 inquires of the manager whether or not the attribute inquiry is permitted, and then returns the object attribute to the client device 3 which has requested the attribute. Attributes include name, color, object-specific obscureness, and the like.

Next, the object operation function unit 46 operates an object registered in the manager, and is driven by a request from the client device 3. It is also driven from the server device 1.

The operation of the object operation function part 46 calls the manager of the object after inquiring the manager whether the operation is permitted.

FIG. 13 shows a functional block diagram of the avatar basic control function unit 24 in the server basic control library 16 shown in FIG. 0, avatar deletion function 51, avatar control stop function 52, avatar control stop release function 53, avatar attribute setting function 54, avatar attribute inquiry function 55, etc. I have.

The avatar addition function section 50 has a function of adding the avatar A that has joined the space under the management of the server device 1, and is driven by a space participation request from the client device 3.

The operation of the avatar addition function unit 50 is for registering the server device 1 so as to manage the avatar A participating in the space, and also performs the registration as a function of the manager.

The avatar deletion function unit 51 shown in FIG. 13 deletes the avatar A who has left the space from the control of the server device 1 and is driven by a space exit request from the client device 3. Is done.

The operation of the avatar deletion function unit 51 is to delete the avatar A registered in the server device 1 and also delete it from the manager.

Further, an avatar control stop function unit 52 shown in FIG. 13 stops control of the avatar A, and is called and driven by the server device 1. The operation of the avatar control stop function section 52 changes the state of the avatar A to the control stop state so that control from the client device 3 cannot be performed.

The avatar control stop release function unit 53 restarts the control of the avatar A, which has stopped the control of the avatar A by the avatar control stop function unit 52, and is called and driven by the server device 1. You. The operation of the avatar control stop canceling function unit 53 changes the state of the avatar A to a controllable state and enables control from the client device 3.

Next, the avatar attribute setting function unit 54 shown in FIG. 13 sets the attribute of the avatar A, and is driven by a request from the client device 3. You. The operation of the avatar attribute setting function unit 54 sets the attribute of the avatar A after inquiring of the manager whether the attribute setting change is permitted. These attributes include name and appearance (gif file), etc. ο

The avatar attribute inquiry function unit 55 responds to an inquiry about the attribute of the avatar A, and is driven by a request from the client device 3. The operation of the butter attribute inquiring function unit 55 is to inquire of the manager whether the inquiring of the attribute is permitted, and then return to the client device 3 which has requested the attribute of the avatar A. These attributes include name and appearance (gif file).

FIG. 14 shows a functional block diagram of the neighborhood space extraction function unit 25 shown in FIG. 6, and the neighborhood space extraction function unit 25 is located in the space where the client device 3 participates. It has a function to cut out only the part (space, object, Ava Yu A) related to the client device 3 (user).

The neighborhood space extraction function unit 25 is constituted by a neighborhood object extraction function unit 57. Then, the nearby object extraction function unit 57 selects an object to be sent to the client device 3 near the avatar A or another avatar A.

FIG. 15 shows a control flow diagram of the neighborhood object extraction function unit 57. A view update request is sent from the client device 3 to the server device 1 (step S41), and the server device 1 executes step S4. In step 2, it is determined that the view is updated, and the process proceeds to step S43. When the field of view of the client device 3 is updated, an object that is located near the avatar A and affects the avatar A is selected (step S43), and the object selected in step S44 is further selected. To the client device 3.

FIG. 16 shows a functional block diagram of the model conversion function unit 26 shown in FIG. The model conversion function unit 26 has a function of generating a pseudo three-dimensional cyber base model to be sent to the client device 3 from the viewpoint of the user of the client device 3.

The model conversion function unit 26 is composed of a wide-angle still image creation function unit 59. The wide-angle still image creation function unit 59 creates a wide-angle still image of a space or object viewed from the viewpoint of the user of the client device 3.

FIG. 17 shows a control flow diagram of the wide-angle still image creation function unit 59. A view update request is sent from the client device 3 to the server device 1 (step S51). In step 52, it is determined that the view is updated, and the process proceeds to step S53. Then, when updating the field of view of the client device 3, a wide-angle still image of the entire space visible from the viewpoint of the client device 3 is created (step S53), and the wide-angle still image created in step S54 is created. It is sent to the requested client device 3.

Fig. 18 shows a functional block diagram of the spatial library 17 stored in the database 11 shown in Fig. 4. This spatial library — 17 is a cyberspace based on the SOMA model. It is one of the class libraries for realizing the space required to construct the. The space stored in the space library 17 is a high-level description of the three-dimensional space that can be described by VRML 1.0, with the functions of the space embedded. As shown in FIG. 18, the space library 17 includes an open space function unit 61 and a room space function unit 62. In the open space function unit 61, only the ground exists, and the attributes of the space that extends infinitely include the ground color and the background. Also, in the room space function part 62, the four sides and the upper part are surrounded by walls, and it is impossible to get out of it. It's swelling. The attributes of this space include the size of the room (width, depth, height) and the color of the walls.

FIG. 19 shows a functional block diagram of the common object library 18 stored in the database 11 shown in FIG. 4, and the common object library 18 is shared on the platform. This is a group of object libraries prepared in advance for the purpose of use.

As shown in Fig. 19, the common object library 18 has a video object 65, a video camera object 66, a blackboard object 67, a microphone 'speaker object 68, and a chat object 69. It consists of office objects 70, such as desks, chairs, bookcases, and mouthpieces, HTML objects 71, and computer objects 72. Here, the above-mentioned eight objects 65 to 72 are provided as an example, but the present invention is not limited to these, and objects necessary for cyberspace may be further added.

Further, these objects 65 to 72 are objects that are physically operated to directly restrict the SOMA space or as a communication tool between the client devices 3 (one user). is there.

Hereinafter, each object will be specifically described. The video object 65 has a function of reproducing a moving image in a previously prepared MPEG (Motion Picture Experts Group) format, and has a configuration as shown in FIG. I have.

That is, the video object 65 is composed of a playback preparation function section 76, a playback start function section 77, a pause function section 78, a stop function section 79, an end function section 80, a midway participation function section 81, And the exit function section.

The playback preparation function unit 76 receives a use start instruction from a certain client device 3. It is driven as an event, and a use start request is sent from the client device 3 to the server device 1 as shown in FIG. 21 (step S61). The server device 1 transmits the video object specified by the client device 3 to each client device 3 in an MPEG format file (step S62), and prepares for the client device 3 to play back the video. To be able to Then, as processing on the client device 3 side, a window for MPEG playback is started (step S63).

The playback start function unit 77 is driven by using a playback start instruction from the client device 3 as an event. As shown in FIG. 21, the client device 3 that has started the window in step S63, A playback start request is sent to server device 1 (step S64). The server device 1 receives the playback start instruction from the client device 3 and sends a playback start instruction to each client device 3 (step S65). Then, the client device 3 which has received the instruction to start the reproduction from the server device 1 starts the reproduction of the MPEG image (step S66).

The pause function unit 78 in the video object 65 shown in FIG. 20 is for temporarily stopping the reproduction of an image in response to a pause request from the client device 3. As shown in FIG. 22, the client device 3 sends a pause request to the server device 1 while reproducing the image in step S71 (step S72). The server device 1 that has received the suspension instruction from a certain client device 3 sends a suspension instruction to each client device 3 in step S73.

Then, in step S73, each client device 3 temporarily stops playing the MPEG image. Thereafter, if there is no reproduction start instruction from the server device 1 shown in step S76, the paused state is maintained, and if the reproduction start instruction is received from the server device 1, steps S75 to S7 are executed. Go to 7, Play the next image.

The stop function unit 79 shown in FIG. 20 is for stopping an image being played back on the client device 3, and as shown in FIG. 23, a stop instruction request from the client device 3 is sent to the server device. It is sent to 1 (step S81). The server apparatus 1 receives a stop instruction from a certain client apparatus 3 and sends a stop instruction to each client apparatus 3 (step S82).

Upon receiving the stop instruction from the server device 1, each client device 3 stops the MPEG image (step S83). Thereafter, if the reproduction start instruction is not received from the server device 1 shown in step S8, the stop of the image is continued, and if the reproduction start instruction is received from the server device 1, the steps S85 to S8 are executed. Go to step 6 and play the image from the beginning. The termination function unit 80 terminates the window of the client device 3, and sends a termination request from a certain client device 3 to the server device 1 as shown in FIG. 24 (step S91). . The server device 1 receives an end instruction from a certain client device 3 and sends an instruction to close the MPEG playback window to each client device 3 (step S92).

Each client device 3 that has received the end instruction from the server device 1 ends the window for MPEG playback (step S93).

The midway participation function unit 81 of the video object 65 is driven as an event when the server device 1 receives a signal to which a certain client device 3 (user) newly participates. The client device 3 (user) is added to the client table to be transmitted by this event, and the MPEG image and the playback start position are sent to the video object of the client device 3.

The newly joined client device 3 is a window for MPEG playback. Create ゥ and play the MPEG image in the same way as above.

Also, the exit function unit 82 is driven as an event when the client exits, and deletes the client device 3 from the client table to be transmitted. In this case, there is no particular processing on the client device 3 side.

Next, the video camera object 66 of the common object library 18 shown in FIG. 19 will be described. This video camera project 66 has a function of saving an image captured from the video camera on the client device 3 side in a JPEG Joint Photographic Expert Group (JPEG) format and displaying the images sequentially. It also has the function of playing back recorded images.

As shown in Fig. 25, this video camera object 66 has a camera preparation function 85, a camera image distribution function 86, a camera vision change function 87, a recording start function 88, a recording function Stop function section 89, playback start function section 90, playback pause function section 91, playback stop function section 92, end function section 93, midway participation function section 94, exit function section 95, etc. It is configured.

The camera preparation function unit 85 causes a window for recording to be displayed on each client device 3, and as shown in FIG. 26, a request to start using a video camera from the client device 3. Driven as an event. That is, a use start request is sent from the client device 3 to the server device 1 (step S100). The server device 1 checks whether or not the video camera object specified by a certain client device 3 is operable based on the use start request sent from the client device 3, and if it is operable, sends a message to each client device 3. An instruction to display a window for recording and playback is transmitted (step S101).

Each client device 3 receiving the instruction from the server device 1 displays a window for planning (step S102), and further notifies the client device 3 that the window has been displayed from each client device 3 to the server device. Send to 1 Bus S103).

The camera image distribution function unit 86 operates by being driven by the image reception signal from the client device 3 as an event. That is, as shown in step S103 of FIG. 26, a notification that a window has been displayed is received from each client device 3, and the server device 1 receives a JPEG image captured from the video camera at fixed time intervals. Then, as shown in step S110 of FIG. 27, when there is an image reception request from the client device 3, the received JPEG image is transmitted to each client device 3 at a fixed time interval (step S110). S 1 1 1). Then, as shown in step S113, this process is repeated until a certain client device 3 notifies the end of recording.

On the other hand, each client device 3 that has received the JPEG image from the server device 1 displays the JPEG image as shown in step S112. The camera visual change function unit 87 shown in FIG. 25 is driven by a visual change instruction from the client device 3 as an event. An instruction to change the visual sense of the video camera from a certain client device 3 is sent to the server device 1. Side, and transmits the visual change data corresponding to the content to the client device 3. Upon receiving the visual change data, the client device 3 controls the visual change of the attached video camera according to the data. In this case, there is no particular processing on the client device 3 side, and the change in the visual sense is directly controlled from the server device 1 side.

Next, the operation of the recording start function unit 88 of the video camera object 66 will be described. This recording start function unit 88 is driven by a recording start instruction from the client device 3 from the client device 3 as an event. As shown in FIG. 28, in step S120, A recording start request is sent from a certain client device 3 to the server device 1. Server device 1 Receiving a recording start instruction from the client device 3 and storing the images taken from the video camera in the server device 1 in chronological order in the JPEG format (step S122) o

Then, as shown in step S122, the stored JPEG image is transmitted to each client device 3. Each client device 3 displays the received JPEG image (step S123).

The recording stop function unit 89 shown in FIG. 25 is driven by a recording stop instruction from a certain client device 3 as an event, and as shown in FIG. The request is sent to the server device 1 (step S124), and the server device 1 that has received the recording stop instruction from the certain client device 3 stops storing the image captured from the video camera (step S12). Five) .

In this case, there is no particular processing on the client device 3 side.

Furthermore, the recording / playback function unit 90 of the video camera object 66 shown in FIG. 25 operates by driving a playback start instruction from a certain client device 3 as an event. That is, as shown in FIG. 29, in step S131, a playback start request is sent from a certain client device 3 to the server device 1, and the server device 1 receives this playback start instruction, and The data is transmitted in time series in the JPEG format (step S1 32).

Each client device 3 received from the server device 1 displays the JPEG image (step S133).

The playback pause function unit 91 is driven by a pause instruction from a client device 3 as an event. That is, in step S134 of FIG. 29, a suspension request is sent from a certain client device 3 to the server device 1, and the server device 1 that has received the suspension request sends a suspension request to each client device 3. Send instructions (step S135). Then, each of the client devices 3 receiving the pause instruction pauses the reproduction (step S136). After that, when the server device 1 receives a reproduction start instruction from the client device 3 as shown in step S137, the server device 1 sends the continued image to the respective client devices 3 after the pause. Send it (Step S138). Each client device 3 displays the JPEG image received from the server device 1 (step S139).

Next, the operation of the playback stop function unit 92 and the end function unit 93 of the video camera object 66 shown in FIG. 25 will be described. The rehabilitation captive function section 92 is driven by a stop instruction from a certain client device 3 as an event. As shown in FIG. 30, a reactivation stop request from a certain client device 3 is sent to the server device 1. Sent (step S144). The server device 1 that has received the stop instruction from the client device 3 transmits a playback stop instruction to each client device 3 (step S144). Then, each of the client devices 3 which has received the stop instruction from the server device 1 stops the reproduction (step S144).

Thereafter, as shown in step S14, when a reproduction start request is sent from a certain client device 3 to the server device 1, the server device 1 transmits the image from the beginning to each client device 3. Yes (step S 1 4 5). Then, each client device 3 displays a JPEG image (step S16) o

The end function unit 93 is driven and operated by using an end instruction from a certain client device 3 as an event, and as shown in step S147 of FIG. 30, a certain client device 3 When a termination request is sent to the server device 1 from the server device 1, the server device 1 that has received the termination instruction sends an instruction to close the window for recording and playback to each client device 3 (Step S148) o Each of the client devices 3 receiving the ft indication for closing the window from the server device 1 closes the window for recording and playback (step S 19) o

Next, a description will be given of the mid-participating function unit 94 of the video camera object 66 shown in FIG. 25. The client device 3 is driven by an event of newly joining. The server device 1 adds a client to the client table to be transmitted, and transmits the JPEG image to the video camera object of the new client. Then, the newly participating client (client device 3) displays a window for recording in the same manner as described above, and displays the received JPEG image.

The leaving function unit 95 is driven by an event that the client (client device 3) leaves, and the server device 1 deletes the client from the client table to be transmitted. In this case, there is no special processing on the client side to leave.

FIG. 31 shows a functional block diagram of the blackboard object 67 in the common object library 18 shown in FIG. 19, and the blackboard object 67 is in a paint format. An object that can draw characters, pictures, and figures.

As shown in FIG. 31, the blackboard object 67 includes a blackboard preparation function unit 101, a drawing start instruction function unit 102, a drawing distribution function unit 103, and a drawing end distribution function unit 104. It consists of a blackboard object ending function unit 105, a halfway participation function unit 106, and a leaving function unit 107.

Next, the blackboard preparation function unit 101 will be described. The blackboard preparation function unit 101 drives and operates a use start request from a certain client device 3 as an event. As shown in step S 151 of FIG. Sends a use start request to the server device 1. Sa —The server device 1 receives the use of the blackboard object from the client device 3 and transmits the final drawing state of the specified blackboard object to each client device 3 (step S 15 2).

Each client device 3 displays a window for the blackboard and displays the received drawing status (step S153). At this time, the client device 3 is set to a state in which only a drawing start instruction can be given, and a drawing object is set to a disabled state.

Next, in the drawing start instruction function unit 102, as shown in step S15 in FIG. 32, a drawing start request from a certain client device 3 is sent to the server device 1, and in the server device 1, A drawing start is received from a certain client device 3, and an instruction to disable drawing is transmitted to another client device 3 (step S155). Then, the client device 3 that has transmitted the drawing start request enables the object for drawing (step S156), and disables the drawing start of the other client devices 3 (step S156). S 1 5 7) o

The drawing distribution function unit 103 of the blackboard object 67 is driven by receiving a drawing image from the client device 3, and as shown in step S 161 of FIG. 33, the client device The drawing image is transmitted to the server device 1 from the server device 3, and the server device 1 receives the drawing state of the client device 3 capable of drawing at regular intervals and saves the drawing state in a time-series manner (step S1662). Further, the server device 1 transmits the drawing state to the other client devices 3 as shown in step S163.

The other client device 3 displays the drawing received from the server device 1 (Step S164).

Further, the drawing end distribution function unit 104 drives a drawing end instruction from a certain client device 3 as an event, as shown in step S165 of FIG. 33. As described above, a drawing end request is sent from a certain client device 3 to the server device 1. Upon receiving the drawing end request from the client device 3, the server device 1 transmits an instruction to enable drawing to the other client devices 3 (step S166)

) o

The client device 3 that has received the drawing enable instruction from the server device 1 becomes usable for starting drawing, and the object for drawing becomes unavailable. Further, the blackboard object termination function unit 105 is driven by a termination request sent from a certain client device 3 to the server device 1 (step S171). The server device 1 receives an end instruction from a certain client device 3 and transmits an instruction to close the window for the blackboard object to each client device 3 (step S 172).

Each client device 3 that has received the instruction from the server device 1 ends the window for the blackboard object (step S172).

Next, the midway participation function unit 106 of the blackboard object 67 is operated when a client device 3 (client) newly participates. The client is added to the client table to be transmitted, and the drawing state and the drawing image to the blackboard object are transmitted to the client.

As processing on the client device 3 side, a window for a blackboard is displayed, and a drawing image is displayed. Also set the usable state.

Further, the exit function unit 107 is operated by the event that the client exits. That is, the client is deleted from the client table to be transmitted. There is no particular processing on the client device 3 side. A functional block diagram of the microphone's speaker object 68 in the common object library 18 shown in FIG. 19 is shown in FIG. This microphone- The speed object 68 has a function of storing the sound recorded from the microphone and reproducing the sound sequentially, and also has a function of reproducing the recorded sound.

As shown in Fig. 35, the microphone / speaker object 68 includes a microphone preparation function unit 111, a voice distribution function unit 112, a recording start function unit 113, and a recording stop function unit 111. 4, Play start function 1 1 5, Play pause function 1 1 6, Stop function 1 1 7, End function 1 1 8, Participation function 1 1 9 and Exit function 1 2 0, etc. It is composed of

First, from the microphone preparation function unit 111, the microphone preparation function unit 111 is driven by a use start instruction from a certain client device 3. That is, as shown in FIG. 36, a use start request is sent from a certain client device 3 to the server device 1 (step S181), and on the server device 1 side, a request from a certain client device 3 is specified. It is checked whether or not the microphone is operable, and if operable, the microphone of the client device 3 is enabled (step S182). In addition, an instruction to disable the microphone is transmitted to the other client device 3 and an instruction is transmitted so that the speaker of the other client device 3 can be used (step S183).

The client device 3 that has sent the use start request to the server device 1 prepares for the microphone operation and the speaker (step S184), and confirms that these preparations have been completed. Send to 1 (Step S 1 8 5) o

The voice distribution function unit 112 of the microphone / speaker object 68 shown in FIG. 35 is driven by using a voice reception instruction from the client device 3 as an event. As shown in FIG. 37, in step S191, a client device 3 sends a voice reception request to the server device 1, and the server device 1 transmits the voice recorded from each client device 3 at regular time intervals. Receive each client The data is transmitted to the device 3 (Step S192). This process is repeated until there is a notice of termination from the client device 3.

On the other hand, the client device 3 that has received the audio from the server device 1 reproduces the audio (step S193).

FIG. 38 shows a control flow diagram of the recording start function unit 113 and the recording stop function unit 114 of the microphone / speaker object 68. The recording start function unit 113 is driven by a sound start instruction from the client device 3 as an event. As shown in step S201, a recording start request is sent from the client device 3 to the server device 1, and the server device 1 receives a recording start instruction from a certain client device 3, and receives the transmitted voice. The data is stored in the server device 1 in chronological order (step S202). Further, the stored voice is transmitted to each client device 3 (step S203).

Each client device 3 that has received the audio from the server device 1 reproduces the audio (step S204).

The recording stop function section 114 is driven as an event by a recording stop instruction from the client device 3. As shown in step S205 of FIG. 38, a recording stop request is sent from a certain client device 3 to the server device 1, and the server device 1 receives the recording stop instruction from the client device 3, and stores the voice. Is stopped (step S206).

In this case, there is no particular processing on the client device 3 side.

FIG. 39 is a flowchart showing a control operation of the reproduction start function unit 115 and the reproduction pause function unit 116 of the microphone / speaker object 68. The playback start function unit 115 is driven by a playback start instruction from the client device 3, and as shown in step S211 of FIG. 39, a playback start request is issued from a certain client device 3. Sent to server device 1. Server device 1 receives the instruction to start playback from client device 3 and sends it to each client device. The voice is transmitted in time series to 3 (step S2 1 2).

Each of the client devices 3 receiving the voice from the server device 1 reproduces the voice (step S213).

The playback pause function section 116 is driven by receiving a playback pause instruction from a certain client device 3. As shown in step S2114 in FIG. 39, a playback pause request is sent from a certain client device 3 to the server device 1, and the server device 1 receives the playback pause instruction from the client device 3. Then, a pause instruction is sent to each client device 3 (step S215).

Each of the client devices 3 that has received the pause instruction from the server device 1 pauses the sound reproduction (step S216).

Thereafter, as shown in step S217, when a playback start request is sent from a certain client device 3 to the server device 1, the server device 1 that has received the playback start instruction outputs the subsequent audio to each of the devices. The message is transmitted to the client device 3 (step S218). Then, each of the client devices 3 receiving the continuous audio from the server device 1 plays the continuous audio, stops the audio after playing the final audio (step S219).

The control operation of the stop function section 117 of the microphone / speaker object 68 shown in Fig. 35 is as shown in Fig. 40. This stop function section 117 stops the client device 3 from stopping. The instruction is driven as an event. As shown in step S2221 in FIG. 40, a stop request is sent from a certain client device 3 to the server device 1, and the server device 1 receives the stop instruction from the client device 3, and receives a stop instruction from each client device 3. A stop instruction is sent to the device 3 (step S222). Each of the client devices 3 receiving the stop instruction from the server device 1 stops the voice (step S223).

After that, as shown in step S224, a client device When the playback start request is sent from the device 3 to the server device 1, the server device 1 that has received the playback start instruction transmits a sound to each client device 3 from the beginning (step S2 25). . Then, each client device 3 receives the sound from the server device 1 from the beginning, stops the reproduction after reproducing the final sound (step S226).

FIG. 41 is a flowchart showing the control operation of the end function section 118 of the microphone 'speaker object 68. The end function section 118 is driven by an end instruction from the client device 3. Is what is done. As shown in step S227 of FIG. 41, a termination request is sent from a certain client device 3 to the server device 1, and the server device 1 receives the termination instruction from the client device 3, and receives a microphone / speaker. Is transmitted to each client device 3 (step S228).

Each client device 3 that has received the end instruction from the server device 1 stops the sound of the microphone and the speaker (step S229).

Next, the participant function unit 119 of the microphone / speaker object 68 shown in FIG. 35 is driven as an event that a client (client device 3) newly participates. The server device 1 that has received the request for participation from the new client device 3 adds the client to the client table to be transmitted, and transmits audio to the speaker object of the client device 3.

The new client device 3 prepares a speaker in the same manner as described above, and performs audio reproduction processing.

The exit function section 120 of the microphone's speaker object 68 is driven by the exit of the participating client (client device 3). The server device 1 that has received the signal to exit from a certain client device 3 sends the exiting client table from the client table to be transmitted. Delete the event.

Note that, in this case, there is no particular processing of the client device 3 that leaves.

FIG. 42 shows a functional block diagram of the chat object 69 in the common object library 18 shown in FIG. The chat object 69 has a function of communicating between clients (client devices 3) by text.

As shown in FIG. 42, the chat object 69 includes a start function unit 123, a text distribution function unit 124, a chat object end function unit 125, a mid-participation function unit 126, and The exit function section consists of 127, etc. First, the start function unit 123 will be described. The start function unit 123 is driven by a use start instruction from the client device 3 as an event. As shown in step S 2 3 1 in FIG. 4 3, a use start request is sent from a certain client device 3 to the server device 1, and the server device 1 having received the use start instruction from the client device 3 sends the request to each client device 3. A chat start instruction is transmitted to the device 3 (step S232).

Each client device 3 that has received the chat start instruction from the server device 1 displays a window for chatting and enables text input display (step S2 33) o

The text distribution function unit 124 is driven by receiving text from the client device 3. As shown in step S2334 of FIG. 43, a text is transmitted from a certain client device 3 to the server device 1, and the server device 1 receives the text from a certain client device 3, and transmits the received text. The client name is added to the other client device 3 and transmitted (step S235).

Then, the other client devices 3 that received the text from the server device 1 Displays text in a window (step S2336).

The chat object ending function section 125 of the chat object 69 shown in Fig. 42 is driven by the fact that the text from the client device 3 is no longer transmitted, and the server device 1 executes the chat object. finish. In this case, there is no particular processing on the client device 3 side.

The midway participation function section 126 of the chat object 69 is driven by the server device 1 receiving a signal indicating that a client (client device 3) newly participates. In this case, the server device 1 adds the client to the client table to be transmitted, and transmits the latest text to the client's chat object.

The newly joined client (client device 3) displays the window of the chat and displays the text sent from the server device 1 ο

The exit function section 127 of the chat object 69 is driven by the participating client (client device 3) exiting, and receives a signal from the client device 3 to leave the server. The device 1 deletes the leaving client from the client table to be sent.

In this case, there is no particular processing on the client device 3 side that leaves.

The office objects 70 in the common object library 18 shown in Fig. 19 are furniture-like objects that give a sense of realism to the space, and each has attributes such as size and color. . In addition, the office object 70 has a function of physically constraining the space in which Aba Yuichi A can move.

The HTML object 71 has a function of transmitting an HTML file, and transmits an HTML file specified by a client. Then, the client device 3 received from the server device 1 The HTML file you received is displayed.

Further, the computer object 72 provides a function of emulating the computer object, and has a function of transmitting information such as the terminal type and host name of the computer object specified by the client device 3. have. As a process on the client device 3 side, an emulation of the computer specified from the received terminal event and the host name is displayed.

FIG. 44 shows a functional block diagram of the manager library 19 shown in FIG. 4. The manager library 19 has a manager for managing the order in space. It is provided for the purpose. Each individual manager manages his or her assigned information. These information are queried or set from the server device 1 in response to a request from the client device 3.

As shown in FIG. 44, the manager library 19 includes a location manager function unit 130, a security manager function unit 131, a history manager function unit 132, and the like.

The position manager function unit 130 has a function of managing the position of the avatar A object in the cyberspace and preventing inconsistency in the space due to the movement of the avatar A.

The security manager one function unit 131 has the functions necessary to manage the security of the object Avatar A in cyberspace (object use restriction and exclusive control).

In addition, the history (log) manager function section 13 records events that occurred in cyberspace, and has the necessary functions to reproduce them.

Figure 45 shows the location manager in the manager library 19 shown in Figure 44. 3 shows a functional block diagram of the jar function unit 130. FIG. As shown in the figure, the position manager function unit 130 has an object addition function unit 135, an object deletion function unit 1336, an object movement function unit 1337, and an object position inquiry function. 138, avatar addition function 139, avatar deletion function 140, avatar movement function 141, avatar position inquiry function 1442, and avatar movement collision judgment function It is composed of 1 4 3 mag.

The object addition function unit 135 of the position manager function unit 130 has a function of adding an object in the space under the management of the manager, and the operation is such that the manager exists in the space. Register so that the location information of the object can be managed. It is driven by a request to add an object to the server device 1.

The object addition function unit 1336 has a function of deleting objects in the space from the management of the manager, and operates as a function of deleting objects registered in the manager. It is. Then, it is driven by a deletion request from the server device 1 of the object.

The object movement function part 1337 of the position manager function part 130 has a function to update the position information of the object X-tat, and the operation is performed by the manager. It updates the location information of the object to be updated, and also updates the location information of the object itself. It is driven by a request from the client device 3 or a request to move an object caused by another event.

The object position inquiry function unit 1338 has a function of responding to an inquiry about the position information of an object, and returns the position information of the corresponding object managed by the manager. is there. In addition, the obfuscation caused by client device 3 requests and other events It is driven by the movement request of the project.

The avatar addition function section 1339 of the location manager 1 function section 130 has a function of adding the avatar A in the space under the management of the manager. The registration is performed so that the jar can manage the location information of Avatar A existing in the space. It is also driven by an avatar A request to be added to the server device 1.

The avatar delete function section 140 has a function of deleting avatar A in the space from the management of the manager. The operation is to delete avatar A registered in the manager. It is. It is driven by a deletion request from the server device 1 of the avatar A.

The location manager function section 130's avatar evening movement function section 14 4 1 updates the location information of the avatar — A. The operation is performed by the manager that manages the corresponding avatar. It updates the location information of Yuichi A, and also updates the location information of Abba Yuichi A itself. Then, it is driven by a movement request of the client device 3.

The avatar position inquiry function unit 142 responds to the inquiry about the position information of the avatar A. The operation returns the corresponding position of the avatar A, which is managed by the manager. Then, it is driven by the movement request of the client device 3.

Further, the avatar movement collision determination function unit 1443 has a function of determining whether or not a collision occurs when the avatar A moves, and the movement of the avatar A is an object.ゃ The manager determines whether it will collide with another avatar A or a wall in the space based on the location information managed by the manager. Then, it is driven by the movement request of the client device 3. FIG. 46 shows a functional block diagram of the security manager function unit 131 in the manager library 19 shown in FIG. 44. The security manager function part 13 1 is the object addition function part 14 6, the object deletion function part 14 7, the avatar addition function part 14 8, the avatar deletion function part 14 9, the security information setting function It consists of a part 150, a security information inquiry function part 151, and a security check function part 152.

First, the object adding function unit 146 will be described. The object adding function unit 146 has a function of adding an object in the space under the management of the manager. As a method, registration is performed so that managers can manage security information of objects existing in the space. Then, it is driven by an addition request of the object to the server device 1.

Also, the object deletion function part 147 has a function of deleting an object in the space 內 from the management of the manager, and the operation is to delete the object registered in the manager. Is what you do. Then, the object is driven by a deletion request to the server device 1.

The avatar addition function unit 148 of the security manager function unit 1 3 1 has a function of adding the avatar A in the space under the management of the manager. The registration is performed so that the security information of avatar A that exists in the company can be managed. Then, it is driven by an additional request to the server device 1 of Ava Yuichi A. In addition, the Ababa Yuichi deletion function section 148 has a function to delete Ababa Yuichi A in the space from the management of the manager, and the operation is registered with the manager. Aba Yuichi A is to delete A. Then, it is driven by a deletion request of the avatar A to the server device 1.

The security information of the security manager function section 13 1 shown in Figure 46 The information setting function section 150 has a function of setting the security information of the space object and the avatar A. The operation is performed in the corresponding space, object, and avatar A. Set security information. The security information includes "who can operate", "when can it operate", "where can it operate" and so on. Then, it is driven by a request based on preset information during the space start-up process.

The security information inquiry function unit 151 has a function of responding to the inquiry about the security information of the space object and the avatar A. The operation is performed in the corresponding space, object, and server. It returns security information of A. The security information includes “who can operate”, “when can it be operated”, “where can it be operated” and so on. It is driven by a request from the client device 3.

The security check function section 152 of the security manager function section 131 has a function of checking whether or not the specified operation is possible in terms of security. The operation of the security check function unit 152 returns whether or not the specified operation is possible based on the security information managed by the manager. The content to be checked is determined based on the user, time, location, and the like. Then, it is driven by a request from the client device 3.

FIG. 47 shows a functional block diagram of the history manager function part 13 2 in the manager library 19 shown in FIG. 44. The log storage function part 15 5 and the log reading function part 15 6 It is composed of

The log storage function section 155 has a function to save everything that happened in the space (SOMA space). The operation was performed by Aba Yuichi A, and the avatar A was moved. It saves all events that have occurred and other events that have occurred. Also, the sky created by the event Interim objects and changes in the state of Avatar A are also saved. The contents to be saved are "What kind of event", "When it occurred", "Who caused it", "What changed and how?" 5 5 shows the basic space control function part 22 in the server basic control library 16 shown in Fig. 6 and the basic object control function part 2 when a request or other event from the client device 3 occurs. 3. The avatar basic control function section 2.3 is driven by a request during processing.

The log reading function unit 156 has the function of reading stored logs (histories). The operation is to read logs stored in the past. It reproduces what happened in space in the past based on the data. Further, it is driven by a request from the client device 3.

Next, a database management system used in the system of the present invention will be described. Before that, let me explain the conventional database management system. The multimedia management era, which has entered the multimedia era, is required to manage multimedia data. There are the following problems when trying to do this with the base technology.

Access unit issues

In a conventional database management system, data is captured in the basic structure of files (tables), records (rows), and fields (column attributes), and records are placed at the center of access. In each case, tables are subject to predicate rather than search, records are subject to search, and fields are subject to extraction. If you try to handle audio and video in this way, you will have to push data as the value of one field, and if you access a record that contains audio, images, long text, etc. at the same time, a large cost (resource usage, time, CPU Time) and efficiency is reduced.

Problems with processing programs and access methods

Audio, still images, moving images, etc. have complicated structures themselves, and it is difficult for application programmers to write programs that directly process these data. Therefore, they call and use already prepared programs. These programs are also offered as low-level subprograms, but are often offered and used as stand-alone programs. It is difficult to build your own inf face from low-level subprograms. This tendency is remarkable in programs that deal with multimedia.

In addition, these programs are designed to process data by directly reading OSC (peripheral system) files. Conventional database management systems can only access data using a proprietary data access method to maintain data integrity and security, so data stored in the database management system is processed by these programs. I can't. Thus, when storing multimedia data in a conventional database management system, existing programs cannot be used.

On the other hand, if the standard file management system provided by OS is directly used without using a database management system, the following problems occur. Files that will be stored in directories by classifying them by type ^

Storing many files in a single directory on a flat file takes time to retrieve. But if you do unnecessary layering, The path specification becomes complicated.

The attribute cannot be assigned to the file, so the file cannot be searched with that attribute.

To maintain consistency between files, the user must develop the program.

Weak file security and failure measures.

Both programs and data are recognized only as files, and the relationship between data and programs is not managed.

These are the factors that led to the creation of database technology. However, the conventional technology cannot solve the above problem. What we need to consider here is that the environment and requirements are different from the 1960s when database technology was born.

The performance of computers and the performance of networks have changed drastically, and the data we want to deal with is not HR or transaction data centered on character strings or numerical values, but rather multimedia data including photos, voices, videos, and full text. is there. The biggest opportunity for the creation of database technology was that data management in the OS did not meet the business data processing requirements that required data management on a record-by-file basis. However, there is no problem if the multimedia data is managed as one file. Rather it is more convenient. Therefore, what we need to do is to find a way to overcome the above problems and integrate it with database technology, while taking advantage of the file management capabilities of the OS directory.

Here is the basic framework (paradigm) for solving this problem o

First, let the unit of data management be an OS file. OS files are managed with attributes such as owner, creation / update date, name, simple confidentiality, etc., and various attributes that allow users to manage the file efficiently are added to this file. Allow to attach.

Files with the same structure and attributes are grouped together and given a group name to manage them as a group.

From a group that includes many files, search for the desired file based on the characteristics of its attribute values.

Since the files in a group have the same structure, programs that process it can be grouped together. By managing this together, the relationship between data and programs can be clarified.

If there are groups with many similar attributes and programs, only the common characteristics and programs are taken as a separate group, and if the relationship with the common group is described, the attributes and programs are redundant. And it is easy to expand after the group.

High system reliability is ensured by adding traditional database technologies such as security, integrity, transaction management, and disaster recovery functions.

This paradigm is so close to the object-oriented paradigm that it can incorporate many of the advantages and features of object-oriented X-axis. By adding features such as object-oriented inheritance, encapsulation, polymorphism, and message bashing, it improves the reusability of data and the software that handles it, enhances security, and enhances user experience. The aim is to improve the quality of services.

FIG. 48 shows a functional block diagram of the client / server communication function unit 13 shown in FIG. 4. The client / server communication function unit 13 has a queue creation function unit 160 and a table creation function unit 1. 6 1, Protocol data processing machine No. 162, reference table addition / deletion function 163, and queue management function 1664.

The client / server communication function unit 13 has a function of exchanging a protocol with the client device 3 and realizing mutual communication and role sharing with the client device 3.

The server device 1 has a function of receiving the protocol data from the client device 3, analyzing them, transmitting a signal to the object of the server device 1, and returning a signal to the client device 3. ing. In addition, depending on the request from the client device 3, there are those that must return a live response in real time, those that must return in a sequence of operations, and those that may return a reply at any time. The server device 1 has a function to control by distinguishing between them.

Next, the functional units 160 to 164 of the client's server communication function unit 13 of the server device 1 shown in FIG. 48 will be described. The queue creation function section 160 receives a signal from the client device 3 or the server device 1 when the server device 1 is started, and creates a queue (QUEUE) for stocking the signal. The size of this queue can be changed by a parameter.

The table creation function section 161 searches for another server device to be connected when the server device 1 is started, and creates a reference table of the connected server device and its corresponding space name.

The protocol data processing function section 162 of the client's server communication function section 13 has a function of processing the protocol data stored in the queue (QUEUE), and the protocol data is stored in the queue. In some cases, it extracts one protocol, interprets it, sends a signal to its own server device 1 object, sends it to another server device, or It has a function of transmitting a signal to the remote control device 3.

The reference table addition / deletion function part 16 3 is for adding or deleting a client (client device 3) when entering or leaving, and a new client newly enters the server device 1. In this case, it has a function to create a client reference table and to add / delete it as needed in order to search for the client name and IP (Internet Protocol) address at high speed.

The queue management function block 164 shown in Fig. 48, when the queue (QUEUE) is full, but receives a protocol overnight, replies to the source that the protocol cannot be processed. It has a function to notify the sender that processing cannot be performed.

Further, the protocol to be processed is controlled according to the type of protocol data in the queue (QUEUE). In the case of data that is processed in real time, it is processed with the highest priority, and if a series of operations is required, it is processed sequentially after all the operations are completed. Other processing is provided with a function of processing at an available time. The attributes that the protocol should have are as follows. Source name (client device or server device), destination name (client device or server device), space name, object name, operation name, operand name, time stamp processing category, real-time category, reply By having these attributes, such as deadline relative order division, relative order group, intra-group order, and general division, the management function of the queue management function unit 164 controls transmission and reception of protocols. I have.

Configuration of client device 3

FIG. 49 shows a block diagram of the client device 3. The client device 3 is a general personal computer. It is a low-cost personal computer.

The client device 3 includes a microphone 170, a mouse 171, a keyboard 172, a video camera 1723, left and right speakers 174, 175, IZO interface 1769, {1} Display section 176 of a block, etc., memory 178 for storing various programs and data, for example, a server that communicates with the server 1 via a network 2 such as INS 6 4 lines, etc.'Client communication function section 1 77, Overall control · Control for performing calculations · Computing section 179 etc. FIG. 50 shows a functional block diagram of a group of programs and a group of objects stored in the memory 178. The event control unit 181, the background display unit 182, the object Abba evening display section 1 8 3, Ababa evening 1 control section 1 84, Position control manager 1 85, Object's manager 1 86, Magic object 1 87, Speed force object 1 88, video camera's object 189, etc. are stored in the memory 178.

Next, the event control section 18 1 will be described. The event control section 18 1 has an event loop, an event and a server by an input from the user's mouse 17 1 and keyboard 17 2. · Performs operations corresponding to events received from the client communication function unit 177. These events are allocated to the corresponding local manager (the manager on the client device 3 side) and executed. . It is the control section that controls the local manager.

The avatar control unit 18 4 executes the operation of the avatar A, inquires of the position control manager i 85 whether the operation can be executed, and if possible, the object / avatar display unit 18 3 Call and execute. In addition, the operation is transmitted to the server device 1. The method is as follows. Method

(1) Pause: Pauses the operation of avatar A.

②Resume operation: Resume the movement of avatar A in the paused state.

(3) Forced termination: Avatar A operation is forcibly terminated.

④Drawing update: Performs avatar A drawing (redrawing).

⑤Pattern change: To visualize the basic movement (walking, sitting) of Aba Yuichi A, it is necessary to hold several patterns, but change the pattern to accommodate the change in movement. .

⑥Delete: Discard the avatar A image (pattern).

⑦Location report: Report the location of Avatar A.

⑧Other: Actual action method (walk, sit, raise hand, etc.) The position control manager 1885 controls the moving range of avatar A by communicating with other managers. The method is as follows.

Method

(1) Registration: Register avatar A and the object along with its geometry (coordinates).

② Delete: Yuichi Aba and the object are deleted.

③ Change: Change the geometry of avatar A or the object.

(4) Permission request: Returns whether permission is given for avatar A's movement request.

The object 'manager-186' determines whether a group of local 'managers' can be controlled by Aba Yuichi A. The method is as follows.

Method

①Registration: Register the object. (2) Delete: Delete the object.

③ Change: Change the state of the object.

登録 Aba Yuichi Registration: Register Aba Yuichi A that can operate the specified object.削除 Delete avatar: Cancel registration of avatar that can operate the specified object.

(4) Permission request: Returns an operation that can be performed by Ababa Yuichi in response to object operation.

The microphone object 187 transmits the voice file received from the microphone 170 to the server device 1 via the server-client communication function unit 177, and the method is as follows. It has become.

Method K

(1) Hardware connection status: Returns whether microphone 170 is usable.

(2) Execute: The sound from the microphone 170 is dropped to a file.

(3) Exit: Terminates input from the microphone 170.

The speaker object 188 is for reproducing the audio file received from the server device 1, and the method is as follows.

(1) Hardware connection status: Returns whether the speaker (sound source board) is usable.

(2) Execute: Receive and play back audio files.

③ Volume control: Control the volume of the sound.

④Pause: Stop playback.

⑤Resume ： Resume playback.

⑥End: End playback.

Video Power Memo Object 189 Holds Video Conference Style Meetings In this case, at regular time intervals, the video of the user from the video camera 173 is transmitted as a still image to the server device 1 via the server-client communication function unit 177, and is used as a method. Is as follows.

Method

①Hardware connection status: Respond whether video camera 1 7 3 is usable

(2) Execute: Drop the image from video camera 1 7 3 into a file

(3) Timing control: Specify how often images from video camera 1 73 are taken.

④Exit: Terminates the input from video camera 1 7 3.

Cyberspace in action

Next, the overall control operation of the present system will be described. Since the details of each object group and functional group in this system have been described above, the details of the control generated by the event will be omitted.

① Launch of the space and participation of UNIZA

Various data of the cyberspace defined as described above are stored and held in advance on the server device 1 side. When cyberspace is started up by a predetermined space manager (Basic Control Library 16 and Basic Control Function 22), one or more users are connected to the network 2 by the client device 3. You can participate in the cyber space through (Spatial Basic Control Function Unit 22).

The server device 1 authenticates the user who wants to participate in cyberspace (the basic space control function section 22 and the user authentication function section 39), and after the authentication, the state of the space viewed from the user's point of view. The client transmits the indicated date and time to the client device 3. Participating users can use location information Since the image is sent to the server device 1, a still image corresponding to the viewpoint from the position of the user is transmitted from the server device 1 to the client device 3 (neighboring space extraction function unit 25, model conversion function unit 26).

The data transmitted from the server device 1 to the client device 3 includes the above-described still image as the background, a still image indicating the shape of each object and position information, the participation of the butter A, the body type, posture parameter values, and the head. · Clothing image data and location information, space and object attribute values and function groups (see Fig. 5).

② Visualization of space

The client device 3 that has received the spatial data from the server device 1 visualizes the cyberspace as shown in FIG. 5 (event control section 181, background display section 182, control / calculation means 179, Display section 1 7 6). The method is based on the perspective image showing the background of the space, and the still image showing the avatar A of the object, the self, or the other person, according to the depth of the arrangement. The image is reduced (far-field image reduction function using the object / avatar display section 183) and overwritten on the background image in order from the deepest one (the forward image overwrite function using the object / avatar display section 183).

The user acts (moves) through his / her agent, Avatar A. As shown in Fig. 5, Ava Yuichi A is in the space as a three-dimensional character. The movement of avatar A is controlled and managed by the avatar control section 184 and the position control manager 185, and if there are other objects such as avatars, pillars, walls, etc. Is regulated as impossible (collision control function).

For example, the user moves the avatar A using the mouse 171, and when the user moves the mouse 171 left and right while pressing the left button, for example, Ava Yuichi A walks left and right. Avatar A moves back and forth if you move it back and forth while holding down the left button of mouse 17 1. In this case, Avatar A When A moves backward, Avatar A becomes smaller due to perspective, and when it comes forward, Avatar A becomes larger (see Fig. 5).

If you move the mouse up and down and left and right while holding down the right button of the mouse 171, the avatar A's neck turns up and down and left and right, and the viewing direction changes.

Mouse 17 1 Double-clicking the left button of the mouse sends the data of the viewpoint (the position in the space of Aba Yuichi A and the viewing direction) to the server 1 and the server 1 The appearance of the space with respect to is synthesized as a still image, and the still image data is transmitted from the server device 1 to the client device 3 and displayed on the screen of the client device 3. In other words, the walking in SOMA space in cyberspace in this system is realized by the above-mentioned method, and this method or system is called “3D character movement + stop-time view synthesis”.

The feature of this method or system is that the load on the client device 3 is small, and the server device 1 uses a high-performance graphics computer, so that high-quality still images can be viewed from the user's viewpoint. The still image data can be easily sent to the client device 3.

Also, in shopping malls and cyber museums in cyberspace, the quality of images when stopping is more important than the smooth “dynamic viewpoint movement” performed by VRML. The client device 3 is very advantageous because it can participate in cyberspace with a low-cost puff con or the like.

When moving Ababa Yuichi A, collision between other Abba Yuichi A and objects is detected and the movement is controlled (Aba Yuichi Control Section 184, Position Control Manager 1 8 5) This makes it possible to imitate the visual perspective of a three-dimensional space using a two-dimensional still image.

③ Communication by voice When the user utters a voice through the microphone 170, the voice data is transmitted from the client device 3 to the server device 1, and the server device 1 transmits the voice data of all the users together with the avatar A positional relationship data received together. The data is transmitted to each client device 3 in real time.

The client device 3, which has received these data from the server device 1, drops the volume of the avatar A's voice according to the distance between the avatar A and the other avatars in the space, and the avatar A located at the right side position. The first sound is reproduced with the right side volume slightly higher than the left side and reached earlier, thereby reproducing the sound in a three-dimensional space (speaker object 188).

That is, as shown in FIG. 51, when there is a voice input from another client device 3 via the server device 1 (step S 2 4 1), the avatar, which is the sound source sent from the server device 1, is input. Based on the position information, the distance between itself and the other avatar in the space is calculated (step S2422). Then, as shown in step S243, the sound volume to be reproduced is attenuated according to the distance between the user and another avatar (voice distance attenuating function).

Further, the direction of another avatar is detected based on the position information from the server device 1 (step S2444), and if another avatar is on the right side, for example, steps S245 and S24 are performed. As shown in Fig. 6, the audio output on the left is slightly delayed in time, and the audio output on the right is reproduced quickly (directional audio synthesis function). By doing this, we can imitate speech in a 3D space (3D speech synthesis and playback

活動 Activities in the space

When the avatar moves, changes its posture, or performs an operation such as manipulating an object, the avatar is queried to the server device 1 to check whether the avatar does not disturb the order in the space as an event (ababa). Evening control section 18 4, activity result reporting function by position control manager 18 5). The server device 1 checks it according to the definition of the manager 1 (activity check function by the manager library 19), permits the action if possible, and notifies the other client devices 3 at the same time. (Activity reflection function by Manager Library 19). As a result, it is possible to perform control for communication without contradiction (common space control function).

履歴 History I

The history of Aba Yuichi's activities in the space is saved, and this can be reproduced later from any angle (Activity history storage / reproduction function by the history manager function unit 132).

As described above, in the present invention, cyberspace is advanced by adding an element called a negative programming manager having a function of certain rules and restrictions to three elements of space, an object, and an avatar. Cyberspace with various functions can be easily configured.

In addition, the introduction of managers through negative programming plays an important role in increasing the productivity of cyberspace construction and increasing the success rate of development. In addition, the effect is enhanced by managing a library of space objects that make up cyberspace with the space resource management system on the server device 1 side.

Furthermore, without bringing a 3D model of the space object to the client device 3 side, the client device 3 can imitate a 3D space based on a 2D still image created by a powerful graphics server. It is a low-speed personal computer that allows you to participate in a space represented by high-quality images. In VRML and the Java language, visualization (rendering) of the three-dimensional space is performed on the client device 3 side, so if the quality of the image is to be improved, the client device 3 has high performance. Will require In the present invention, such defects are improved by rendering the high-performance server device 1 for rendering.

In addition, the 3D speech synthesis / reproduction function can realize realistic communication, and in this regard, it can also realize a sophisticated space that was not possible with conventional methods.

The procedure of various object groups in the server device 1 and the client device 3 and a floppy disk storing the procedure of the entire system as a program are also included in the scope of the present invention.

By the way, the present invention can be applied to the following as an application of cyberspace. In other words, in collaboration with a network that takes advantage of the features of high-definition image quality, multi-user characteristics, real-time conversation function by voice, and the function of maintaining spatial order by a manager, and communication, textiles and industrial products There is design development such as. In these tasks, it is very important how realistic the design target is, and it is essential to communicate while pointing to each other.

Such a situation is also effective when a manufacturer teaches a consumer how to operate a product, or when a fault diagnosis is supported or a maintenance method is instructed. Furthermore, it is important for the sale of goods to be able to display the goods as close to the real thing as possible. Communication via networks such as teleconferencing and distance lectures involves sharing a space or object with reality and voice, and it is important to control the timing of remarks. Such functional spaces are interconnected, and offices, companies, museums, etc. can be realized on the network.

In addition, if the cyberspace of the present invention enables home work and home study, companies that do not have a physical office or schools that do not have classrooms will be possible. In other words, you can find them at museums, libraries, and museums where you can see them without having to go there. Information exchange and business on the network will become more extensive and safer than now.

In the above description, the personal computer on the client device 3 side is exemplified, for example, a personal computer equipped with Windows. However, the present invention is not limited to this. Of course, it can also be applied to low-priced personal computers of the ntosh type.

Claims

Scope of claim

1. A server device (1) and one or more client devices (3) are interconnected on a computer network, and a cyberspace as a virtual society formed on this computer network is established. In the method of creating a cyberspace for realization, the above-mentioned cyberspace is a space as data representing the shape and properties of a three-dimensional space such as a box type such as a classroom or a conference room, or an open type such as a university or a town. And an object (0) arbitrarily placed in this space (S) and having a specific attribute group and function group, and a user who participates and operates in the space (S). The avatar (A) as a character visualized as an agent and the functions provided by the object (0) and Aba Yuichi (A) must not be exercised under certain conditions. Modeled in four elements of the manager one (M) of a control function for maintaining order in the space (S), the server apparatus (1), said space

(S), an object (0), a manager (M), and an avatar (A). A common space control function (10) (11) for one or more users to share the data of the holding function (11) from their own client device (3) via the network (2); It has a communication function (13) for exchanging data and signals with a client device (3) on the network (2), and the client device (3) has the server device described above.

The cyberspace data receiving function (I78), which receives and holds the data for building cyberspace sent from (1), and the data received from this cyberspace data receiving function (178) on the screen It has a cyberspace visualization function for visualizing two-dimensional still images and a communication function (177) for exchanging data and signals with the server device (1). A method for creating a cyberspace, which is characterized in that a two-dimensional still image is received from a server device (1) in response to a request from the device (3) and a three-dimensional imitation drawing is performed by a perspective method.

2. The server device (1) is provided with a space resource management function (11) for defining, storing, retrieving, updating, and deleting data for building a cyberspace. How to create cyberspace.

3. The server device (1) has an avatar (A) activity history storage and reproduction function (

13. The method for creating a cyberspace according to claim 1 or claim 2, wherein the method comprises:

4. The common space control function (10) (11) of the server device (1) is a two-dimensional stationary system that views the space (S) and the object (0) constituting the cyber space from the viewpoint of each user. A view image synthesizing function to generate images and an activity possibility search function to check the possibility of the activity of the avatar (A) sent from each client device (3) based on the definition of the manager (M) A function of notifying a client device (3) that the activity of (a) is reflected in each client device (3) so that the activity of (A) is reflected in each client device (3). The creation method of cyberspace described in any of Section 3.

5. The resource management function (11) of the server device (1) is a classifying function that manages the resources to be managed as classes that share the characteristics and the programs that process them, and a class of the classifying function. Generalization / aggregation between the groups · A relation management function that manages other relations, an instance access function that enables high-speed search, update, and deletion of instances as class resources from their properties, and an existing operating system The cyberspace creation method according to any one of claims 1 to 4, further comprising an existing function integration function for reconfiguring the program as a class method.

6. The cyberspace visualization function of the client device (3) A perspective image showing the object (〇) and the image of Ababa Yuichi (A) on a wide-angle perspective still image showing the background of (), and a reduction according to the depth of the arrangement. 2. The method according to claim 1, further comprising: a reduction function; and a forward image overwriting function of imitating perspective in a three-dimensional space using a two-dimensional still image by overwriting a background image in order from the deepest. A method for creating a cyberspace according to any one of claims 5 to 5.

7. The cyberspace visualization function of the client device (3) detects the collision of the avatar (A) with the position of the avatar (A) and the object (0).

7. The method for creating cyberspace according to claim 1, further comprising a collision control function for controlling movement of the cyberspace.

8. The client device (3) has a three-dimensional speech synthesis and playback function that synthesizes and reproduces the generated sound three-dimensionally according to the positional relationship between the sound generation position and the avatar (A). The voice synthesis and playback function controls the sound volume of the avatar (A) and other avatars (A) according to the distance in the space (S) with the avatar (A) and the other avatar (A). 8. The cyber device according to any one of claims 1 to 7, comprising a function and a directional speech synthesis function for causing the sound of Aba Yuichi (A) on the right side to reach the right ear earlier than the left ear. How to create a space.

9. The server device (1) and one or more client devices (3) are interconnected on a computer network, and a virtual society formed on this convenience network is established. In the method of creating cyberspace for realizing cyberspace, the above-mentioned cyberspace is used as a data representing the shape and properties of a three-dimensional space such as a box type such as a classroom or a conference room, or an open type such as a university or a town. Space (S), an object (0) that is arbitrarily placed in this space (S) and has a specific set of attributes and functions, and a participant in the space (S) See as a delegate for active users Ava Yuichi (A) as a masqueraded character and the above object (

Ii) A manager as a control means to maintain the order in the space (S) by preventing the functions of the avatar (A) from being performed under certain conditions. The server device (1) is modeled and holds data for building cyberspace described by four elements: the space (S), the object (◦), the manager (M), and the avatar (A). The data holding means (11) and the data of the data holding means (11) are shared by one or more users from their own client device (3) via the network (2). And a communication device (13) for transmitting and receiving data and signals to and from a client device (3) on a network (2). 3) is sent from the server (1) above. Cyberspace data receiving means (178) that receives and holds the data for building cyberspace, and two-dimensional still image data received from the cyberspace data receiving means (178) on the screen. Cyberspace characterized by comprising cyberspace visualization means for performing three-dimensional space imitation drawing by perspective and communication means (177) for exchanging data and signals with the server device (1). Making equipment.

10. The server device (1) is provided with space resource management means (11) for defining, storing, searching, updating, and deleting data for building cyberspace. Creation device of the described cyberspace.

10. The cyberspace creation apparatus according to claim 9 or claim 10, wherein the server device (1) is provided with means for storing and reproducing the activity history of the avatar (A). .

1 2. The common space control means (10) (11) of the server device (1) uses the space (S) and the object (〇) constituting the server space as viewed from each user's viewpoint. View image synthesizing means for generating a two-dimensional still image; An activity possibility search means that checks the possibility of the activity of the avatar (A) sent from the client device (3) based on the definition of the manager (M). The cyberspace according to any one of claims 9 to 11, further comprising: activity reflecting means for notifying the client device (3) so that the information is reflected on each client device (3). Making equipment.

1 3. The resource management means (11) of the server device (1) consists of a classifying means for managing the resources to be managed as classes that share the properties and programs that process them, and a classifying means for the classifying means. Related management means for managing generalization, aggregation, and other associations between classes, and instance access means for enabling high-speed search, update, and deletion of instances as class resources, and operating The cyberspace creation apparatus according to any one of claims 9 to 12, further comprising an existing function integration means for reconfiguring an existing program of the system as a class method.

1 4. The cyberspace visualization means of the client device (3) is based on a perspective wide-angle still image showing the background of the space (S), and a static image showing the object (0) and the avatar (A). A distant image reduction unit that reduces the image according to the depth of the arrangement, and a two-dimensional still image is used to imitate perspective in a three-dimensional space by overwriting the background image in order from the deepest one The cyberspace creation device according to any one of claims 9 to 13, further comprising a front image overwriting means.

1 5. The cyberspace visualization means of the client device (3) controls the movement of the Ababa Yuichi (A) by detecting the collision of the Abba Yuichi (A) and the object (0) with each other. Claims characterized by comprising collision control means.

The cyberspace creation device according to any one of claims 9 to 14.

1 6. The client device (3) has a sound generation position and an avatar (A). Equipped with three-dimensional speech synthesis and playback means that synthesizes and reproduces the generated sound three-dimensionally according to the positional relationship. Distance attenuation means for controlling the volume of the sound of the avatar (A) according to the distance in the space and the space (S), and the direction in which the sound of the avatar (A) on the right reaches the right ear earlier than the left ear The cyberbase creation apparatus according to any one of claims 9 to 15, further comprising a speech synthesis unit.