JPH10222698A - Communication equipment of three-dimensional virtual space and communicating method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To transmit required information between clinents by moving a crater in three-dimensional virtual space based on the intention of an operator. SOLUTION: When three-dimensional data including shape data, frame data of the crater and action data of the crater in three-dimensional virtual space is inputted from an output, a preserving part 1 preserves three-dimensional data. A generating part 31 generates a three-dimensional space shape based on shape data. The generating part 32 generates a three-dimensional frame animation based on frame data and action data. A display part 4 displays the three-dimensional space shape and the three-dimensional frame animation. When an operation signal corresponding to the operation for permitting a user to actually transmit required information to a desired client is inputted, an operating part 2 converts an operation signal into mobile information, preserves mobil information to the preserving part 1 and also calculates action difference information based on mobile information. A transmitting/receiving part 7 selects action difference information from action difference data and generates a packet based on action difference information so as to transmit it.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to three-dimensional computer graphics (hereinafter "3DCG: three-dimensional computer graphics") based on a worldwide network such as the Internet.
"Imensional computer graphics." ) For transmission or commercial use, shapes in a virtual space based on 3DCG, for example, shapes having a skeletal structure like a human, manipulation of their motion information, audio, and moving image data The present invention relates to a communication device and a communication method for a three-dimensional virtual space capable of handling intensively.

[0002]

2. Description of the Related Art Recently, as a field of application of 3DCG, WW
Virtual malls (Virtual Mall) on the Internet, such as W (World Wide Web), and various homepages have attracted attention. In particular, due to the rapid development of the Internet,
3DCG for games, movies, virtual malls, etc.
The environment in which homes are easily handled in homes is rapidly being prepared.

In the conventional WWW or the like, a plurality of machines such as a personal computer are connected to machines called a server such as a workstation and a personal computer via the Internet to respond to a request from the client. In order to obtain necessary information, the server downloads data such as images, sounds, texts, and arrangement information provided by the server as necessary, and reconstructs (browses) the data on the client side. It has become.
The communication between the server and the client uses TCP
/ IP (Transmission Control Protocol / Internet Prot
ocol).

Conventionally, data provided from the server side is:
Mainly text data and image data only, but recently, VRML (Virtual Reality Model
ng Language) and its browsers (browsing tools) are spreading and standardizing.
There is a movement to transfer CG data itself.

[0005] Here, the above VRML will be briefly described. In a conventional data format, such as HMTL (Hyper Text Markup Language), which mainly includes image data and text data represented by characters, a huge transfer time is required to transfer image data, particularly moving image data. And transfer costs are needed. Therefore, in the current system,
There are network traffic restrictions. In particular,
When communicating between the server and the client, there are restrictions on the time to access the server from the client,
There is a waiting time before accessing. On the other hand, in the conventional 3DCG, in order to specify the shape viewed from the viewpoint based on the shape of the object arranged in the virtual space and the surface attribute of the object, all of the viewpoint information and light source information including the shape are included. Was processed with three-dimensional data. With the advance of computer graphics (CG) technology, the image quality of images created by CG has rapidly improved, and transferring CG data as it is is much more efficient in terms of data volume. Efficiency has improved.
Normally, the transfer amount of moving image data and VRML data at the same time has a compression ratio of 1/100 or more. Therefore, there is a movement to standardize a method of transferring 3DCG data through a low-speed network such as a telephone line. As one approach, standardization of 3DG data called VRML has been proposed (see “VRML Ver.2.0 Specificati
on "). In VRML, data formats such as shape data called primitives, various types of light source data, viewpoint data, and texture data, and communication protocols are defined.

On the other hand, what has been recently attracting attention in the conventional CG field is an animation for creating an image in real time, that is, a so-called real animation. By adopting this real animation, CM (commercia
l message) and a movie. As one of the methods, there is a method called a kinematics method in which a complex shape such as a human is represented by a skeletal structure, and the movement of a joint of the skeleton which changes every moment is calculated to thereby naturally reproduce the complicated movement.

[0007] The kinematics method is a technique developed mainly in robotics. In such a kinematics method, the rotation angle of the joint part of the skeleton model having a linear link structure (consisting of a link and a joint (joint)) in the X, Y, and Z axis directions and X, Y,
The posture of the skeleton model is determined by setting the movement amount in the Z-axis direction.

By applying this kinematics method to a character having an arbitrary skeletal structure created by CG, the amount of data can be reduced as compared with a conventional polygon-based animation, and at the same time, humans and dinosaurs can be reduced. It is becoming possible to reproduce natural movements such as.

As described above, in an environment based on the Internet, CG data, image data,
There is a demand for an environment for processing text and the like collectively.

Therefore, conventionally, a personal computer and a workstation are usually used as information receiving apparatuses on the Internet, and characters and images are accessed using dedicated browser software.
3DCG is accessed using dedicated browser software. Recently, the Internet T
V (television) and the like have also been proposed, and it is becoming possible to easily access a homepage on the Internet simply by turning on a switch.

[0011]

As described above, the HTM
In the conventional description method or user interface based on L, character data and image data can be expressed.

However, in the conventional description method based on HTML or the user interface,
The interface itself has a two-dimensional hierarchy. Therefore, it is difficult to easily reproduce the information of the three-dimensional virtual space.

When transmitting and receiving image data via the Internet, a large amount of transmission and a large transmission time are required.

Further, in a conventional three-dimensional virtual space represented by VRML, there is no mechanism for realizing a character (avatar) having a skeletal structure such as a human and moving the character with a small amount of data. is there.

In addition, there is a problem that it is difficult to operate an avatar in a three-dimensional virtual space, and integrated information including characters and images is not smoothly transmitted.

The present invention has been made in view of the above situation, and communicates required information between clients by moving a virtual creature having a skeletal structure in a three-dimensional virtual space based on an operator's will. An object of the present invention is to provide a communication device and a communication method for a three-dimensional virtual space that can realize a communication state of a three-dimensional virtual space full of a sense of reality by being able to perform the communication.

[0017]

In order to achieve the above object, a communication apparatus for a three-dimensional virtual space according to claim 1,
A device for communicating required information between clients by moving a virtual creature having a skeletal structure in a three-dimensional virtual space based on an operator's will, and is a device for externally transmitting data in the three-dimensional virtual space. When three-dimensional data including shape data, the skeleton data of the virtual organism, and motion data of the virtual organism is input, a three-dimensional space for temporarily storing the input three-dimensional data. A shape storage unit, and reads out the shape data in the three-dimensional virtual space included in the three-dimensional data temporarily stored in the three-dimensional space shape storage unit, and reads out the read-out shape in the three-dimensional virtual space. A three-dimensional space shape generating means for generating a three-dimensional space shape based on the data; and the virtual data included in the three-dimensional data temporarily stored in the three-dimensional space shape storage means. Read the skeleton data of the virtual organism and the operation data of the virtual organism, and associate the read skeleton data of the virtual organism and the operation data of the virtual organism with each other. By deforming the skeleton data of the virtual creature in accordance with the attached motion data of the virtual creature, 3
Three-dimensional skeleton animation generating means for generating a three-dimensional skeleton animation, the three-dimensional space shape generated by the three-dimensional space shape generating means, and the three-dimensional skeleton animation generated by the three-dimensional skeleton animation generating means Is written in the drawing-only memory, the three-dimensional space shape and the three-dimensional skeleton animation written in the drawing-only memory are read, and the read three-dimensional space shape and the three-dimensional skeleton animation are displayed on a display screen. When an operation signal corresponding to an operation for actually transmitting required information to a desired client by the operator is input to the three-dimensional display means, the input operation signal is displayed in the three-dimensional virtual space. It is converted into movement information for moving a virtual organism, and the converted movement information is converted into the above-mentioned tertiary information. Together it is temporarily stored at room shape storage means, if necessary, based on the movement information,
A three-dimensional space operation means for calculating motion difference data representing the amount of change in the movement of the virtual living body, and it is necessary to transmit the motion difference data calculated by the three-dimensional space operation means to a desired client Select the motion difference information
A transmission means for generating a packet to be transmitted to a desired client based on the selected operation difference information, and transmitting the generated packet.

A communication device for a three-dimensional virtual space according to a second aspect of the present invention is the communication device for a three-dimensional virtual space according to the first aspect, which receives a packet transmitted from another client, and receives the received packet. The necessary operation difference data is read from the
Receiving means for passing to the three-dimensional skeleton animation generating means, wherein the three-dimensional skeleton animation generating means generates a three-dimensional skeleton animation based on the motion difference data passed from the receiving means. is there.

According to a third aspect of the present invention, in the three-dimensional virtual space communication apparatus, when broadcast data including moving image data is input, the input is performed. Moving image data input means for temporarily storing moving image data included in the broadcast data, and moving image data temporarily stored in the moving image data input means. And moving image mapping means for attaching the moving image to a designated shape in the three-dimensional virtual space by performing moving image mapping.

According to a third aspect of the present invention, there is provided a communication apparatus for a three-dimensional virtual space according to any one of the first to third aspects, wherein an actual operator controls required home appliances. When the operation signal corresponding to the operation for performing the operation is input, the input operation signal is converted into the first operation information of the virtual home appliance in the three-dimensional virtual space, and the converted first operation information is converted. A control information acquisition unit that specifies the home device to be controlled from the operation information of the control device and obtains the control information, and the control information obtained by the control information acquisition unit is a second control device of the home device to be controlled. Home device that converts the converted second operation information into a communication protocol with the home device to be controlled, and transfers the converted communication protocol to the home device to be controlled. Including control means It is an feature.

According to a third aspect of the present invention, in the three-dimensional virtual space communication method, required information is exchanged between clients by moving a virtual creature having a skeletal structure in the three-dimensional virtual space based on an operator's will. Wherein three-dimensional data including shape data in the three-dimensional virtual space, skeleton data of the virtual creature, and motion data of the virtual creature is input from outside. Then, a three-dimensional space shape storage step of temporarily storing the input three-dimensional data, and the three-dimensional virtual shape included in the three-dimensional data temporarily stored in the three-dimensional space shape storage step The shape data in the space is read, and based on the read shape data in the three-dimensional virtual space,
A three-dimensional space shape generating step of generating a three-dimensional space shape, the virtual skeleton data of the virtual organism included in the three-dimensional data temporarily stored in the three-dimensional space shape storage step, and the virtual Operation data of the virtual organism, and correlates the read skeleton data of the virtual organism and the operation data of the virtual organism with each other; Deforming the skeleton data of the virtual organism according to the data, generating a three-dimensional skeleton animation by generating a three-dimensional skeleton animation, and the three-dimensional space shape generated in the three-dimensional space shape generating step; And a memory dedicated to drawing the three-dimensional skeleton animation generated in the three-dimensional skeleton animation generation step. Writing, reading the three-dimensional space shape and the three-dimensional skeleton animation written in the dedicated drawing memory, and displaying the read three-dimensional space shape and the three-dimensional skeleton animation on a display screen; When an operation signal corresponding to an operation for actually transmitting necessary information to a desired client is input by the operator, the input operation signal is transmitted to the virtual living body in the three-dimensional virtual space. Is converted into movement information for moving the virtual living body, and the converted movement information is temporarily stored in the three-dimensional space shape storage step, and, if necessary, based on the movement information. Three-dimensional space operation step for calculating motion difference data representing the amount of change in the motion of the object, and the motion calculated in the three-dimensional space operation step Selecting necessary operation difference information to be transmitted to the desired client from the minute data, creating a packet to be transmitted to the desired client based on the selected operation difference information, and transmitting the created packet And characterized in that:

According to a sixth aspect of the present invention, in the three-dimensional virtual space communication method, a packet transmitted from another client is received, and the received packet is transmitted. The necessary operation difference data is read from the
A receiving step of passing to the three-dimensional skeleton animation generating step, wherein the three-dimensional skeleton animation generating step generates a three-dimensional skeleton animation based on the motion difference data passed from the receiving step. is there.

A communication method for a three-dimensional virtual space according to a seventh aspect of the present invention is the communication method for a three-dimensional virtual space according to the fifth or sixth aspect, wherein when broadcast data including moving image data is input, the input is performed. A moving image data input step for temporarily storing moving image data included in the broadcast data, and reading the moving image data temporarily stored in the moving image data input step. A moving image generation step of applying the moving image mapping to paste the moving image to a designated shape in the three-dimensional virtual space.

According to a third aspect of the present invention, in the three-dimensional virtual space communication method according to any one of the fifth to seventh aspects, an actual operator controls required home appliances. When the operation signal corresponding to the operation for performing the operation is input, the input operation signal is converted into the first operation information of the virtual home appliance in the three-dimensional virtual space, and the converted first operation information is converted. A control information acquisition step of obtaining control information by specifying a household device to be controlled from the operation information of the second device, and the control information obtained in the control information acquisition step is used as a second control of the household device to be controlled. Home device that converts the converted second operation information into a communication protocol with the home device to be controlled, and transfers the converted communication protocol to the home device to be controlled. Control step It is characterized in that comprises a.

[0025]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

Embodiment 1 FIG. 1 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to the first embodiment of the present invention. With reference to FIG. 1, the communication device for a three-dimensional virtual space according to the first embodiment transmits a virtual human having a skeletal structure in the three-dimensional virtual space (hereinafter, referred to as “avatar”) based on a user's will. 3D space shape storage unit 1, 3D space operation unit 3, 3D space generation unit 3, 3D display unit 4, sound It includes a reproducing unit 5, a virtual space data connecting unit 6, and a virtual space motion information transmitting / receiving unit 7.

The three-dimensional space shape storage unit 1 receives externally input three-dimensional data including shape data in the three-dimensional virtual space, avatar skeleton data, and avatar motion data (including avatar expressions). And for temporarily storing the input three-dimensional data. Specifically, in the three-dimensional space shape storage unit 1, for example, TV,
For example, audio and AV (Audio and Visual) devices generally existing in a user's home, such as a telephone,
It is created in advance with separate CG shape data expressed in the VRML format, and the created CG shape data is stored on a disk or the like together with avatar data as CG characters and moving image data. In addition, the shape data is transferred according to a client's request from a server homepage or the like linked via the Internet,
For example, it may be stored in a rewritable disc such as a PD (Photo Disc), a CD (Compact Disc), and a DVD (Digital Video Disc) in file units.

The three-dimensional space generation unit 3 reads out the shape data in the three-dimensional virtual space included in the three-dimensional data temporarily stored in the three-dimensional space shape storage unit 1, and reads out the read three-dimensional virtual space. A three-dimensional space shape generation unit 31 for generating a three-dimensional space shape based on the shape data in the avatar; avatar skeleton data included in the three-dimensional data temporarily stored in the three-dimensional space shape storage unit 1; By reading the avatar's motion data and the read avatar's skeleton data and the avatar's motion data, the three-dimensional skeleton animation is created by deforming the avatar's skeleton data according to the associated avatar's motion data. 3D skeleton animation generator 32 to be generated
And In the three-dimensional space generation unit 3, when the user activates the communication device in the three-dimensional virtual space, the three-dimensional space shape generation unit 31 stores the three-dimensional virtual space shape data stored in the three-dimensional space shape storage unit 1. Is read, and the three-dimensional virtual space is displayed on the three-dimensional display unit 4 in a state where the articles are arranged in the three-dimensional virtual space according to the arrangement information or the like.
Usually, a three-dimensional virtual space can be created in a desired (customized) three-dimensional space by changing the position of an article or exchanging the article itself by a user operation. In this case, the user selects (pick) an article in the three-dimensional virtual space with the three-dimensional space operation unit 2, specifies surface attributes, movement information, and desired parameters such as Cut & Paste, and specifies the three-dimensional space shape generation unit. This can be realized by changing a desired node of the scene tree corresponding to the internal data structure of the scene tree 31.

The three-dimensional display unit 4 stores the three-dimensional space shape generated by the three-dimensional space shape generation unit 31 and the three-dimensional skeleton animation generated by the three-dimensional skeleton animation generation unit 32 in a frame memory (not shown). ), And the three-dimensional spatial shape written to this frame memory,
And a three-dimensional skeleton animation are read out, and the read three-dimensional space shape and the three-dimensional skeleton animation are displayed on a display screen. The display (not shown) such as a television monitor and a liquid crystal display device. It has.

When a user inputs an operation signal corresponding to an operation for transmitting necessary information to a desired client, the three-dimensional space operation unit 2 converts the input operation signal into a three-dimensional virtual space. Is converted into movement information for moving the avatar within the avatar, and the converted movement information is temporarily stored in the three-dimensional space shape storage unit 1. If necessary, the movement of the avatar is performed based on the movement information. Is calculated as the motion difference data representing the amount of change in. The three-dimensional space operation unit 2 connects viewpoint information such as a viewpoint position, a zoom angle, and a line-of-sight direction for observing a three-dimensional virtual space according to a user's intention, a position of an article, a moving direction of an avatar, and a connection of a basic operation. Avatar movement such as information, a sound activation command, and a moving image selection display condition are specified. Usually, a mouse or the like is used as the input device, but a remote control switch, a data glove, and the like can also be applied as the input device.

The virtual space motion information transmitting / receiving unit 7 selects necessary motion difference information to be transmitted to a desired client from the motion difference data calculated by the three-dimensional space operation unit 2, and selects the selected motion difference information. A packet to be transmitted to a desired client is created based on the received packet, and while the created packet is transmitted, a packet transmitted from another client is received, and necessary operation difference data is read from the received packet, The read operation difference data is transferred to the three-dimensional skeleton animation generation unit 32. The three-dimensional skeleton animation generator 32
Receives the motion difference data from the motion information transmitting / receiving unit 7 in the virtual space, and generates a three-dimensional skeleton animation based on the passed motion difference data.

The sound reproducing unit 5 is set in advance, that is, for example, Wav (microsoft Wav format for windows), MI
A standard file of sound data such as DI (Musical Instrument Digital Interface) and AIFF (Audio Interchange File Format) is reproduced by a sound reproduction board or the like.

The virtual space data connection unit 6 is for dynamically connecting a plurality of three-dimensional virtual spaces on a server linked to the three-dimensional virtual space via the Internet.

By the way, as shown in FIG.
If you need to make your avatar appear in your virtual space,
2 draws the CG character in the three-dimensional virtual space. The shape data of the CG character is stored in the three-dimensional space shape storage unit 1 or the like in advance using general-purpose modeler software, for example, in a format to which necessary hierarchical information is added, such as a VRML extension format.

When the user turns on the power in the same manner as when activating the TV and the personal computer, the three-dimensional virtual space generated by the three-dimensional space generation unit 3 is automatically displayed on the display of the three-dimensional display unit 4. Is displayed. The three-dimensional virtual space displayed on the display is what the user has individually. In the display,
A shape equivalent to the AV equipment in the actual user's room is displayed in the same arrangement. This may be stored in advance in a format such as VRML on a rewritable disk or the like of the three-dimensional space shape storage unit 1. As shown in FIG. 2, in order to make an avatar appear in a three-dimensional virtual space and operate the avatar, the avatar is defined by a skeletal structure, and each joint such as a joint angle of each joint and position information. Operation data must be received. This motion data basically receives only basic motions such as “walk” and “run” which are the minimum necessary, and the three-dimensional skeleton animation generation unit 32 determines, for example, the rotation angle of each joint of the skeleton. The avatars are interactively moved in the three-dimensional virtual space according to the user's instructions by weighting the directions and connecting the basic operations smoothly.

FIG. 3 and FIG. 4 are flowcharts showing the flow of the operation when moving and displaying an avatar that has appeared in a three-dimensional virtual space. With reference to FIG. 3 and FIG. 4, a description will be given of an operation flow when the avatar appearing in the three-dimensional virtual space is moved and displayed in the communication device in the three-dimensional virtual space.

First, referring to FIG. 3, when the communication device for the three-dimensional virtual space is activated (step S1), the three-dimensional space shape storage unit 1 determines whether or not three-dimensional data has been input from the outside. Determine. Here, when it is determined that the three-dimensional data is input from the outside, the three-dimensional space shape storage unit 1 checks the content of the input three-dimensional data based on the header or extension attached to the three-dimensional data. (Step S2). Here, when the three-dimensional data includes the shape data of the three-dimensional virtual space, based on the content of the address of the shape data, whether the shape data is input via the network or the shape data is It is determined whether or not the data is input from the local disk (step S
3). If it is determined that the shape data has been input via the network, the three-dimensional space shape storage unit 1
Read shape data from the Internet (step S
4). On the other hand, when it is determined that the shape data has been input from the local disk, the shape data is read from a CD, a DVD, or the like (step S5). Also, 3
If the dimensional data includes avatar skeleton data, the skeleton data is input via a network or the skeleton data is input from a local disk based on the contents of the address of the skeleton data. It is determined whether or not (step S6). If it is determined that the skeleton data has been input via the network, the three-dimensional space shape storage unit 1 reads the shape data from the Internet (step S7). On the other hand, if it is determined that the skeleton data has been input from the local disk,
D and shape data are read from a DVD or the like (step S8). Furthermore, when the avatar operation data is included in the three-dimensional data, the operation data is input via a network or the operation data is input from a local disk based on the contents of the address of the operation data. It is determined whether or not it has been performed (step S9). If it is determined that the operation data has been input via the network, the three-dimensional space shape storage unit 1 reads the operation data from the Internet (step S10). On the other hand, when it is determined that the operation data has been input from the local disk, the operation data is read from a CD, a DVD, or the like (step S11).

Referring to FIG. 4, when the reading of each data is completed, the three-dimensional space shape storage unit 1 determines whether each read data is compressed or not (step S12). Here, if it is determined that each of the read data is compressed, the three-dimensional space shape storage unit 1 performs a restoration process (including interpolation) on the read data (step S13), and thereafter, if necessary. Then, the restored data is temporarily stored in a memory (not shown) or the like (step S14). On the other hand, when determining that the read data is not compressed, the three-dimensional space shape storage unit 1
The read data is temporarily stored in a memory or the like as needed without performing the restoration process (step S14).

Processing for saving the above data (step S
When 14) is completed, the three-dimensional space shape generation unit 31
The three-dimensional virtual space shape data temporarily stored in the memory of the three-dimensional space shape storage unit 1 is read, and a three-dimensional space shape is generated based on the read three-dimensional virtual space shape data (step S15). To S19). Specifically, first, shape data of the three-dimensional virtual space temporarily stored in a memory or the like of the three-dimensional space shape storage unit 1 is read, and world coordinates are converted into local coordinates for each shape. The local coordinates are converted into the viewpoint coordinates for each shape (steps S15 and S16). Then, after performing clipping based on the viewpoint information based on the converted viewpoint coordinates, the luminance of each vertex is calculated for each shape (steps S17 and S18). Finally, pixel-level interpolation processing on the screen is performed based on the calculated luminance (step S19).

When the process of generating the three-dimensional space shape (steps S15 to S19) is completed, the three-dimensional display unit 4
Writes the three-dimensional space shape generated by the three-dimensional space shape generation unit 31 into a frame memory, reads the three-dimensional space shape written into the frame memory, and displays the read three-dimensional space shape on a display. (Steps S20 and S21). Specifically, first, the interpolation data interpolated in step S19 is written in the frame memory (step S20). After that, the interpolation data written in the frame memory is read, and the read interpolation data is displayed as a scene on a display (step S21). As a result, the three-dimensional virtual space generated by the three-dimensional space generation unit 3 is automatically displayed on the display of the three-dimensional display unit 4.

When the processing for storing the above data (step S14) is completed, the three-dimensional skeleton animation generating unit 32 is included in the three-dimensional data temporarily stored in the three-dimensional space shape storing unit 1. By reading avatar skeleton data and avatar motion data, associating the read avatar skeleton data and avatar motion data with each other, and deforming the avatar skeleton data according to the associated avatar motion data, 3 Generate a two-dimensional skeleton animation (step S22)
To S28). Specifically, first, avatar skeleton data temporarily stored in a memory or the like of the three-dimensional space shape storage unit 1 is read, and based on the read skeleton data,
A process for associating the skeleton with the skin, that is, a so-called grouping is performed (step S22). Then, the avatar operation data temporarily stored in the memory or the like of the three-dimensional space shape storage unit 1 is read, and based on the read operation data, the link posture in local coordinates is determined for each joint. The process to calculate the link posture in local coordinates for each joint and the process to draw the skin by multiplying all the grouping data obtained as a result of the grouping by the obtained elements are specified. Until the processing is performed on all the frames, the processing of calculating the link posture at the local coordinates of each joint and the processing of drawing the skin are performed in time series for each predetermined frame unit ( Steps S23 to S25). Thereafter, for all the specified frames, the process of calculating the link posture in the local coordinates of each joint (step S23) and the process of drawing the skin (step S2)
When 5) is performed, it is determined whether or not the operation should be connected (step S26). Here, when a new operation signal is input to the three-dimensional space operation unit 2 to move the avatar, and it is determined that the operation should be connected, a process for connecting the basic operation is performed. After doing
The reproduction of the operation is continued until an operation signal urging the end of the operation is input to the three-dimensional space operation unit 2 (step S27,
And S28). On the other hand, when it is determined that there is no new operation signal input to the three-dimensional space operation unit 2 and the connection of the operation should not be performed, the processing for connecting the basic operation is performed without performing the processing for connecting the basic operation. The reproduction of the operation is continued until an operation signal urging the end of the operation is input to the space operation unit 2 (step S28). And three-dimensional space operation unit 2
When the operation signal urging the end of the operation is input to the CPU, the reproduction of the operation is ended (step S28).

Processing for drawing the skeleton (step S2)
The skeleton drawing processing data obtained in 5) is written to the frame memory of the three-dimensional display unit 4 (step S2).
0). As a result, the user can make his or her avatar appear in the three-dimensional virtual space.

When an operation signal corresponding to an operation for transmitting necessary information to a desired client is input by the user (step S29), the three-dimensional space operation unit 2
The input operation signal is converted into movement information for moving the avatar in the three-dimensional virtual space (step 30). The converted movement information is temporarily stored in a memory of the three-dimensional space shape storage unit 1 or the like. As a result, the avatar can be interactively moved in the three-dimensional virtual space according to the user's instruction.

FIG. 5 is a flowchart showing the flow of the operation when transmitting avatar motion information. With reference to FIG. 5, a description will be given of an operation flow when transmitting avatar motion information in the communication device in the three-dimensional virtual space.

First, when an operation signal for moving the avatar is input, the three-dimensional space operation unit 2 converts the input operation signal into movement information for moving the avatar in the three-dimensional virtual space ( Step 31) If necessary, motion difference data representing the amount of change in avatar motion is calculated based on the converted movement information (step S32).

When the process of calculating the motion difference data (step S32) is completed, the motion information transmitting / receiving unit 7 in the virtual space transmits the motion difference data calculated by the three-dimensional space operation unit 2 to a desired client. The required operation difference information to be transmitted is selected, a packet to be transmitted to a desired client is created based on the selected operation difference information, and the created packet is transmitted (steps S33 to S4).
3). Specifically, first, it is determined whether or not information should be transmitted to another client (step S33). Here, the operation signal input to the three-dimensional space operation unit 2 does not actually correspond to an operation for the user to transmit required information to a desired client, and information should not be transmitted to another client. If it is determined that nothing is transmitted, nothing is transmitted (step S34). On the other hand, the three-dimensional space operation unit 2
If it is determined that the operation signal input to the user actually corresponds to the operation for transmitting the required information to the desired client and the information should be transmitted to another client, the transmission is performed. It is determined whether or not the information to be included includes audio data (step S35). Here, if it is determined that the information to be transmitted does not include audio data, the audio data is not transmitted (step S
36). On the other hand, if it is determined that the information to be transmitted includes audio data, audio data is set to transmit the audio data (step S37).
When the process of setting the audio data (Step S37) is completed, it is determined whether or not the data to be transmitted includes moving image data (Step S38). If it is determined that the information to be transmitted does not include the moving image data, the moving image data is not transmitted (step S3).
9). On the other hand, when it is determined that the information to be transmitted includes the moving image data, the moving image data is set to transmit the moving image data (step S4).
0). Processing for setting moving image data (step S4
When 0) is completed, necessary operation difference information to be transmitted to a desired client is selected from the operation difference data calculated by the three-dimensional space operation unit 2 (step S41). Thereafter, based on the selected operation difference information, a packet to be transmitted to a desired client is created (step S4).
2). Finally, the created packet is transmitted to the chat server in a state where the voice data and the moving image data are combined (step S43). as a result,
By moving an avatar based on the operator's intention in a three-dimensional virtual space, necessary information is transmitted from a chat server to a client specified by a packet, together with audio data and moving image data. Can be.

FIG. 6 is a flowchart showing the flow of the operation when receiving avatar motion information. With reference to FIG. 6, a description will be given of an operation flow when the avatar motion information is received in the communication device in the three-dimensional virtual space.

Upon receiving a packet transmitted from another client, the motion information transmitting / receiving section 7 in the virtual space
The necessary motion difference data is read from the received packet, and the read motion difference data is passed to the three-dimensional skeleton animation generation unit 32 (steps S50 to S5).
7). Specifically, first, necessary operation difference data is read from the received packet (step S50). Then, it is determined whether or not the read operation difference data includes audio data (step S51). Here, if it is determined that no audio data is included in the motion difference data, no audio data is received (step S5).
2). On the other hand, when it is determined that the motion difference data includes the voice data, the voice data is received and set to a desired format (step S53). When the process of setting audio data (step S53) is completed, it is determined whether or not the read motion difference data includes moving image data (step S54). Here, if it is determined that the motion difference data does not include the moving image data, the moving image data is not received (step S55). On the other hand, when it is determined that the motion difference data includes the moving image data, the moving image data is received and set to a desired format (step S56). When the process of setting the moving image data (Step S56) is completed, necessary data is passed to the three-dimensional skeleton animation generating unit 32 (Step S57). Then, the three-dimensional skeleton animation generating unit 32 generates a three-dimensional skeleton animation based on the motion difference data passed from the motion information transmitting / receiving unit 7 in the virtual space. As a result, by moving a virtual creature having a skeletal structure in a three-dimensional virtual space based on the operator's intention, necessary information transmitted from another client is received, and the received required information is received. The avatar can be made to appear in the three-dimensional virtual space and displayed on the display of the three-dimensional display unit 4 in a state conforming to the contents of the above.

That is, in the first embodiment, when three-dimensional data including shape data in the three-dimensional virtual space, avatar skeleton data, and avatar operation data is input from the outside, the three-dimensional space shape is stored. The unit 1 temporarily stores the input three-dimensional data. Then, the three-dimensional space shape generation unit 31 reads out the shape data in the three-dimensional virtual space included in the three-dimensional data temporarily stored in the three-dimensional space shape storage unit 1, and reads the read three-dimensional virtual space. A three-dimensional space shape is generated based on the shape data in the space. On the other hand, the three-dimensional skeleton animation generating unit 32
The avatar skeleton data and the avatar operation data included in the three-dimensional data temporarily stored in the dimensional space shape storage unit 1 are read, and the read avatar skeleton data and the avatar operation data are associated with each other. By deforming the avatar skeleton data according to the associated avatar motion data, a three-dimensional skeleton animation is generated. Next, the three-dimensional display unit 4 writes the three-dimensional space shape generated by the three-dimensional space shape generation unit 31 and the three-dimensional skeleton animation generated by the three-dimensional skeleton animation generation unit 32 into a frame memory. 3D space shape written in this frame memory,
And the three-dimensional skeleton animation are read, and the read three-dimensional space shape and the three-dimensional skeleton animation are displayed on a display. Thereafter, when an operation signal corresponding to an operation for actually transmitting necessary information to a desired client by a user is input, the three-dimensional space operation unit 2 converts the input operation signal into a three-dimensional virtual space. Is converted into movement information for moving the avatar, and the converted movement information is temporarily stored in the three-dimensional space shape storage unit 1 and, if necessary, based on the movement information. The motion difference data representing the amount of change is calculated.
Then, the motion information transmission / reception unit 7 in the virtual space selects necessary motion difference information to be transmitted to a desired client from the motion difference data calculated by the three-dimensional space operation unit 2, and transmits the selected motion difference information. Based on this, a packet to be transmitted to a desired client is created, and the created packet is transmitted. Therefore, by moving the avatar in the three-dimensional virtual space based on the operator's intention, necessary information can be transmitted to the client specified by the packet.

When a packet transmitted from another client is received, the motion information transmitting / receiving section 7 in the virtual space reads necessary operation difference data from the received packet, and converts the read operation difference data into three-dimensional data. This is passed to the skeleton animation generator 32. Then, the three-dimensional skeleton animation generating unit 32 generates a three-dimensional skeleton animation based on the motion difference data passed from the motion information transmitting / receiving unit 7 in the virtual space. Therefore, by moving the avatar in the three-dimensional virtual space based on the operator's intention, required information transmitted from another client is received, and the avatar is transmitted in accordance with the content of the received required information. Appear in the three-dimensional virtual space and can be displayed on the display of the three-dimensional display unit 4.

As described above, according to the first embodiment, 3
By moving the avatar in the three-dimensional virtual space based on the operator's intention, necessary information can be communicated between the clients, and the following effects are obtained.

That is, a description method based on HTML,
Alternatively, also in the user interface, it is easy to easily reproduce the information of the three-dimensional virtual space.
Even when image data is transmitted and received via the Internet, a large amount of transmission and a large transmission time are not required. Furthermore, even in a virtual space represented by VRML, a realistic movement can be given to an avatar with a small amount of data. In addition, the operation of the avatar in the three-dimensional virtual space is facilitated, and integrated information including characters and images can be smoothly transmitted.

In other words, it is possible to realize a communication state in a three-dimensional virtual space that is full of a sense of reality.

Embodiment 2 FIG. 7 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to the second embodiment of the present invention. Referring to FIG. 7, a feature of the communication device in the three-dimensional virtual space according to the second embodiment is that when broadcast data including moving image data is input, moving image data included in the broadcast data is temporarily stored. A moving image data input unit 8
The moving image data temporarily stored in the moving image data input unit 8 is read, and moving image mapping is performed on the read moving image data, so that the moving image is designated in the three-dimensional virtual space. And a moving image generation unit 33 to be attached to the shape.
This is the same as in the first embodiment.

By the way, when the power supply (not shown) of the communication device in the three-dimensional virtual space is turned on, the shape part data customized by the user is read from a DVD or the like, and the read shape part data is stored in the three-dimensional virtual space. Is placed within. The user moves the avatar in his or her three-dimensional virtual space according to the application, and operates a desired device in the three-dimensional virtual space to control an actual device connected thereto. In particular, in the communication device of the three-dimensional virtual space, when the moving image data input unit 8 receives a moving image broadcast according to a user's instruction, the moving image generation unit 33 transmits the moving image received by the moving image data input unit 8. The moving image data included in the broadcast is displayed at a predetermined position in the three-dimensional virtual space.

Note that the moving image data is, for example, in the form of a normal TV broadcast or digital broadcast.
The information can be displayed by receiving the data using a downlink transmission path from a satellite. Alternatively, it is also possible to display by receiving moving image data from a server that distributes moving images connected to the Internet.

FIG. 8 is a flowchart showing the flow of the operation when pasting a moving image. Referring to FIG.
The flow of operation when pasting a moving image in a communication device in a three-dimensional virtual space will be described.

When broadcast data including moving image data is input, first, the moving image data input section 8 temporarily stores moving image data included in the input broadcast data (steps S60 to S62). Specifically, first, it is determined whether or not the moving image data is compressed (step S
60). Here, if it is determined that the moving image data is compressed, a restoring process is performed on the moving image data (step S61), and then, if necessary, the restored data is stored in a memory (not shown) or the like. (Step S62). On the other hand, if it is determined that the moving image data is not compressed, the moving image data is temporarily stored in a memory or the like as needed without performing the decompression process (step S62).

When the process of storing the moving image data (steps S60 to S62) is completed, the moving image generation unit 33
The moving image data temporarily stored in the moving image data input unit 8 is read, and the read moving image data is subjected to moving image mapping, so that the moving image is converted into a specified shape in the three-dimensional virtual space. (Steps S63 to S65). Specifically, first, moving image data temporarily stored in the moving image data input unit 8 is read, and mapping coordinates are set based on the read moving image data (step S63). Thereafter, image processing is performed in accordance with the set mapping coordinates (step S
64). Finally, a moving image is generated by performing a moving image mapping process on the image processing data, and the generated moving image is pasted on a designated shape in the three-dimensional virtual space (step S65).

That is, in the second embodiment, when broadcast data including moving image data is input, the moving image data input unit 8 temporarily stores moving image data included in the broadcast data. Then, the moving image generation unit 33
Reads out the moving image data temporarily stored in the moving image data input unit 8 and performs moving image mapping on the read moving image data, so that the moving image is designated in the three-dimensional virtual space. Paste in the shape.

Therefore, according to the second embodiment, when broadcast data including moving image data is received in accordance with a user's instruction, moving image data included in the received broadcast data is transferred to a predetermined position in the three-dimensional virtual space. Can be displayed. As a result, the moving image data displayed in the three-dimensional space can be shared between the clients, and
Moving image data displayed in the three-dimensional space can be viewed and enjoyed from all angles.

Embodiment 3 FIG. 9 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to the third embodiment of the present invention.

Referring to FIG. 9, the feature of the communication device for three-dimensional virtual space of the third embodiment is that
When an operation signal corresponding to an operation for controlling a required home device by an actual operator is input to the three-dimensional space operation unit 2, the input operation signal is converted into a virtual image in the three-dimensional virtual space. A point configured to convert into the first operation information of the home device, identify the home device to be controlled from the converted first operation information, and obtain the control information, and a three-dimensional space generation unit 3 is converted into the second operation information of the home appliance to be controlled, and the converted second
Is provided with a home device control unit 9 for converting the operation information of the device into a communication protocol with the home device to be controlled, and transferring the converted communication protocol to the home device to be controlled. The configuration is the same as that of the second embodiment.

The home appliance control unit 9 includes virtual appliances in a three-dimensional virtual space such as a TV, a telephone, and a switch.
A home automation management system that controls devices in a real room and a home security system are linked to each other. Therefore, for example, 3
When the channel of the TV in the virtual virtual space is changed, the channel of the actual TV is changed in conjunction with this,
When the door in the three-dimensional virtual space is unlocked, the door can be opened in conjunction with this. To realize this, the connection mechanism or the control mechanism is, for example, an IEEE No. According to the standard format of the 1394 Recommendation.

FIG. 10 is a flow chart showing the flow of operation when controlling household appliances. Referring to FIG.
A description will be given of an operation flow when controlling the home device in the communication device in the three-dimensional virtual space.

An operation signal corresponding to an operation for an actual operator to control required home appliances is transmitted to the three-dimensional space operation unit 2.
, The three-dimensional space generation unit 3 converts the input operation signal into first operation information of virtual home devices in the three-dimensional virtual space (step S70), and converts the operation signal. A home device to be controlled is specified from the first operation information to obtain control information (step S71).

When the process for specifying the home device to be controlled (step S71) is completed, the home device control unit 9
Converts the control information obtained by the three-dimensional space generation unit 3 into the second operation information of the home appliance to be controlled (step S72), and the converted second operation information becomes the control object. The communication protocol is converted into a communication protocol with the home device (step S73), and the converted communication protocol is transferred to the home device to be controlled (step S74).

That is, in the third embodiment, when an operation signal corresponding to an operation for controlling a required home device by an actual operator is input, the three-dimensional space generation unit 3
Converts the input operation signal into first operation information of a virtual home device in a three-dimensional virtual space, and specifies a home device to be controlled from the converted first operation information. To obtain control information. Then, the home device control unit 9 converts the control information obtained by the three-dimensional space generation unit 3 into second operation information of the home device to be controlled, and converts the converted second operation information. The communication protocol is converted into a communication protocol with the home device to be controlled, and the converted communication protocol is transferred to the home device to be controlled.

Accordingly, when the avatar is moved in the three-dimensional virtual space based on the operator's intention and the virtual home appliance in the three-dimensional virtual space is operated, the control can be performed in conjunction with this operation. it can. As a result, it is possible to centrally manage the control of the actual home device on the communication device side in the three-dimensional virtual space without actually operating the home device.

The present invention is not limited to the above embodiments. For example, in each of the above embodiments, a user interface of a communication device in a three-dimensional virtual space may be connected to another general-purpose interface via the Internet. Information may be shared by dynamically linking to a three-dimensional virtual space or by using a plurality of avatars.

A method for achieving this will be described. When sharing information by dynamically linking from a user interface of a communication device in a three-dimensional virtual space to another general-purpose three-dimensional virtual space via the Internet, or by using a plurality of avatars, Data expressing a three-dimensional virtual space needs to be shared between a plurality of clients via the Internet. Therefore, it is necessary to follow a standard data format for each shape of an article existing in the three-dimensional virtual space.

The following description is based on the assumption that the VRML format, which is becoming the standard when transmitting and receiving three-dimensional data on the Internet, is used.

In VRML, parts existing in a three-dimensional virtual space are divided into smaller units (hereinafter, referred to as “polygons”) and are usually expressed in an Indexed Faceset format (see “VRML Ver. 2.0 Specification”). The shape of each polygon is modeled using a general-purpose modeler and output in VRML data format. With VRML, in addition to the shape of each component, surface attributes such as color and optical attributes can be set. Further, the shapes of the individual polygons are scaled and arranged at desired positions in the three-dimensional virtual space. With VRML, a file can be provided for each individual component, or a slightly larger level such as a room where some components are gathered and arranged can be expressed as one file. In any case, the three-dimensional space shape generation unit 31 reads the shape part data in the VRML format and manages it in a form expressed hierarchically on a predetermined scene tree.

Further, in VRML, there are nodes called WWWInline and WWWAnchor, and a VRML shape different from the shape in the three-dimensional virtual space, a sound file, an image file, and the like can be linked. For example, if a scene of another three-dimensional virtual space is linked to the shape of the door of the three-dimensional virtual space displayed by the communication device of the three-dimensional virtual space by WWWAnchor, the user can click the door according to the action of clicking the door. URL (Uniform Resource Locator)
File or HTTP (Hypertext T
(ransfer Protocol) The VRML scene data on the server specified by the address is read and displayed as a new space by the three-dimensional space generation unit 3. In this case, as if 3
A user looking at a communication device in a three-dimensional virtual space can provide an interface to move from his virtual room in the three-dimensional virtual space to a new space, such as a town or a city.

In WWWAnchor and WWWInline,
ASCII (American Standerd Code for Information
In an Interchange format, the address of the VRML file to be moved when the shape is clicked (HTTP format) and the location of the audio file to be reproduced are defined in advance. If the file specified by WWWAnchor is a sound file such as Wav, MIDI, and AIFF format, the extension of the file is determined (MIME (Multipurpose Internet Mail Extension)).
), And the sound reproducing unit 5 reproduces the file. Similarly, in the case of an image file, determination is made based on the file extension, and the moving image generation unit 33 displays moving image data on a three-dimensional object (polygon) by moving image mapping. Furthermore, the file defined by WWWAnchor is VR
In the case of ML data, it is determined based on an extension such as VRML and wrl, and the three-dimensional space shape generation unit 31 reproduces a three-dimensional virtual space.

The relationship between the server and the client linked via the Internet is as follows.
That is, data such as room data in the virtual space customized for the user is created in advance as personal information in the communication device of the three-dimensional virtual space on the client side.
A VRML environment uniquely set by the user is displayed on the communication device in the three-dimensional virtual space on the client side.
From the VRML environment set by the user to another general-purpose V
In order to move to the RML environment, a necessary WWW Anchor or the like may be used to link the required HTTP address of the three-dimensional virtual space, or the user may directly specify the address.

The actual VRML data is a shared VRM
V connected to the Internet using an L server
It is placed in a distributed form on the RML server. Distributed server requests from communication device in 3D virtual space (HTTP)
The VRML data of the required unit corresponding to the above is distributed. The unit and the scale of the VRML data to be distributed are arbitrarily determined depending on the scale of the three-dimensional virtual space on the Internet where the service is provided.

[0078] 3 displayed on the communication device in the three-dimensional virtual space
When an avatar that is an alter ego of multiple users appears in a three-dimensional virtual space, a chat server connected to the Internet manages only the avatar's movement and conversation change information. Broadcast the quantity to the required users connected to the network.

It goes without saying that various design changes and modifications can be made within the scope of the present invention.

[0080]

As is apparent from the above description, according to the first and fifth aspects of the present invention, the required information is moved by moving the avatar in the three-dimensional virtual space based on the operator's will. As a result of being able to transmit to the client specified by the packet, it is possible to realize a transmission state of the three-dimensional virtual space which is full of a sense of reality.

According to the second and sixth aspects of the present invention, by moving an avatar in a three-dimensional virtual space based on an operator's intention, required information transmitted from another client is received. The avatar can appear in the three-dimensional virtual space and be displayed in a state in accordance with the content of the received required information. As a result, it is possible to realize a realistic three-dimensional virtual space reception state. it can.

According to the third and seventh aspects of the present invention, when broadcast data including moving image data is received in accordance with a user's instruction, moving image data included in the received broadcast data is converted into a three-dimensional virtual space. As a result, the moving image data displayed in the three-dimensional space can be shared between clients, and the moving image data displayed in the three-dimensional space can be viewed from all angles. You can enjoy.

According to the fourth and eighth aspects of the present invention, the avatar is moved in the three-dimensional virtual space based on the operator's intention to operate the virtual household equipment in the three-dimensional virtual space. Then, as a result of being able to control in conjunction with this operation, it is possible to centrally manage the control of the actual home device on the communication device side of the three-dimensional virtual space without actually operating the home device. it can.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to a first embodiment of the present invention.

FIG. 2 is a diagram showing a state in which an avatar appears in a three-dimensional virtual space.

FIG. 3 is a flowchart showing a flow of an operation when an avatar that has appeared in a three-dimensional virtual space is moved and displayed.

FIG. 4 is a flowchart illustrating a flow of an operation when an avatar that has appeared in a three-dimensional virtual space is moved and displayed.

FIG. 5 is a flowchart illustrating a flow of an operation when transmitting avatar motion information.

FIG. 6 is a flowchart showing a flow of an operation when receiving avatar motion information.

FIG. 7 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to a second embodiment of the present invention;

FIG. 8 is a flowchart showing a flow of an operation when pasting a moving image.

FIG. 9 is a block diagram illustrating a configuration of a communication device in a three-dimensional virtual space according to a third embodiment of the present invention;

FIG. 10 is a flowchart showing a flow of an operation when controlling home appliances.

[Explanation of symbols]

 Reference Signs List 1 3D space shape storage unit 2 3D space operation unit 3 3D space generation unit 31 3D space shape generation unit 32 3D skeleton animation generation unit 33 Moving image generation unit 4 3D display unit 5 Sound reproduction unit 6 Virtual space Data connection unit 7 Motion information transmission / reception unit in virtual space 8 Moving image data input unit 9 Home device control unit

Claims (8)

[Claims] 1. A device for communicating required information between clients by moving a virtual creature having a skeletal structure in a three-dimensional virtual space based on an operator's will. When the three-dimensional data including the shape data in the three-dimensional virtual space, the skeleton data of the virtual creature, and the operation data of the virtual creature is input, the input three-dimensional data is temporarily stored. Means for storing the three-dimensional space shape stored in the three-dimensional space shape storage means; and the three-dimensional data contained in the three-dimensional data temporarily stored in the three-dimensional space shape storage means. Generate 3D space shape based on shape data in 3D virtual space 3
Three-dimensional space shape generation means; and the virtual skeletal data of the virtual creature included in the three-dimensional data temporarily stored in the three-dimensional space shape storage means, and the operation data of the virtual creature Reading out the read skeleton data of the virtual organism, and associating the operation data of the virtual organism with each other, and according to the associated operation data of the virtual organism, the virtual organism Three-dimensional skeleton animation generation means for generating a three-dimensional skeleton animation by deforming the skeleton data of the three-dimensional skeleton animation; the three-dimensional space shape generated by the three-dimensional space shape generation means; and the three-dimensional skeleton animation generation means Write the above three-dimensional skeletal animation generated in step 3 into the drawing-only memory and write it into this drawing-only memory. Three-dimensional display means for reading the three-dimensional space shape and the three-dimensional skeleton animation and displaying the read three-dimensional space shape and the three-dimensional skeleton animation on a display screen; When an operation signal corresponding to an operation for transmitting required information is input, the input operation signal is converted into movement information for moving the virtual organism in the three-dimensional virtual space, The converted movement information is temporarily stored in the three-dimensional space shape storage unit, and, if necessary, based on the movement information, motion difference data representing the amount of change in the movement of the virtual organism. A three-dimensional space operation means for calculating the motion difference information, and necessary motion difference information to be transmitted to a desired client from the motion difference data calculated by the three-dimensional space operation means And a transmission means for transmitting a packet to be transmitted to a desired client based on the selected operation difference information, and transmitting the generated packet. . 2. The communication device according to claim 1, wherein a packet transmitted from another client is received, necessary operation difference data is read from the received packet, and the read operation is performed. Receiving means for passing the difference data to the three-dimensional skeleton animation generating means, wherein the three-dimensional skeleton animation generating means generates a three-dimensional skeletal animation based on the motion difference data passed from the receiving means. A communication device for a three-dimensional virtual space that is a feature. 3. The communication device for a three-dimensional virtual space according to claim 1, wherein, when broadcast data including moving image data is input, moving image data included in the input broadcast data is temporarily stored. Moving image data input means for storing, and moving image data temporarily stored in the moving image data input means, and moving image mapping is performed on the read moving image data to convert the moving image A three-dimensional virtual space communication device, comprising: a moving image generation unit for pasting the moving image to a designated shape in the three-dimensional virtual space. 4. The method according to claim 1, wherein
In a communication device of a three-dimensional virtual space, when an operation signal corresponding to an operation for controlling a required home device by an actual operator is input, the input operation signal is transmitted to a virtual device in the three-dimensional virtual space. Control information obtaining means for converting the first operation information of a typical household device, identifying the home device to be controlled from the converted first operation information, and obtaining the control information; The control information obtained by the means is converted into second operation information of a home device to be controlled, and the converted second operation information is converted into a communication protocol with a home device to be controlled. And a home device control unit for transferring the converted communication protocol to a home device to be controlled. 5. A method for communicating required information between clients by moving a virtual creature having a skeletal structure in a three-dimensional virtual space based on an operator's will, the method comprising: When the three-dimensional data including the shape data in the three-dimensional virtual space, the skeleton data of the virtual creature, and the operation data of the virtual creature is input, the input three-dimensional data is temporarily stored. A three-dimensional space shape storing step of storing the three-dimensional space shape data in the three-dimensional virtual space included in the three-dimensional data temporarily stored in the three-dimensional space shape storing step; A three-dimensional space shape generating step of generating a three-dimensional space shape based on the shape data in the three-dimensional virtual space; The skeleton data of the virtual creature and the operation data of the virtual creature included in the three-dimensional data are read, and the read skeleton data of the virtual creature and the virtual creature are read out. Three-dimensional skeleton animation generating step of generating a three-dimensional skeleton animation by associating the motion data with each other and deforming the skeleton data of the virtual organism according to the associated motion data of the virtual organism And the 3 generated in the 3D space shape generating step
The three-dimensional space shape and the three-dimensional skeleton animation generated in the three-dimensional skeleton animation generation step are written in a dedicated drawing memory, and the three-dimensional space shape and the three-dimensional skeleton animation written in the dedicated drawing memory are read out. A three-dimensional display step of displaying the read three-dimensional space shape and the three-dimensional skeleton animation on a display screen; and an operation corresponding to an operation for the operator to actually transmit necessary information to a desired client. When the signal is input, the input operation signal is converted into movement information for moving the virtual living body in the three-dimensional virtual space, and the converted movement information is stored in the three-dimensional space shape storing step. At the same time, and, if necessary, the virtual organism based on the movement information. Three-dimensional space operation step of calculating motion difference data representing the amount of change in the motion of the user, and selecting necessary motion difference information to be transmitted to a desired client from the motion difference data calculated in the three-dimensional space operation step Transmitting a packet to be transmitted to a desired client based on the selected operation difference information, and transmitting the generated packet. 6. The communication method according to claim 5, wherein a packet transmitted from another client is received, necessary operation difference data is read from the received packet, and the read operation is performed. A receiving step of passing the difference data to the three-dimensional skeleton animation generating step, wherein the three-dimensional skeleton animation generating step is performed based on the motion difference data passed from the receiving step.
Generate 3D skeleton animation 3
A communication method for a three-dimensional virtual space. 7. The communication method for a three-dimensional virtual space according to claim 5, wherein when broadcast data including moving image data is input, moving image data included in the input broadcast data is temporarily stored. A moving image data input step to be saved, and moving image data temporarily stored in the moving image data input step are read out, and the read moving image data is subjected to moving image mapping, whereby the moving image Generating a moving image to be attached to a designated shape in the three-dimensional virtual space. 8. The method according to claim 5, wherein
In the communication method of the three-dimensional virtual space, when an operation signal corresponding to an operation for controlling a required home device by an actual operator is input, the input operation signal is transmitted to the virtual space in the three-dimensional virtual space. A control information obtaining step of converting control information into first operation information of a typical home device, identifying a home device to be controlled from the converted first operation information, and obtaining control information; Converting the control information obtained in the step into second operation information of the home appliance to be controlled,
A home device control step of converting the converted second operation information into a communication protocol with the home device to be controlled, and transferring the converted communication protocol to the home device to be controlled. A featured communication method for a three-dimensional virtual space.