JP2004139305A - Method and terminal for multimedia display in virtual space, virtual space management server, multimedia display program in virtual space and recording medium having the same program recorded thereon - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To synchronously display a plurality of media in a virtual space shared by two or more users, and to allow those users to share an operation to those media. <P>SOLUTION: A virtual space management server 2 transmits to individual user terminals 4 a plurality of pieces of media information including media synchronizing information including the difference between the time of those user terminals 4 and its own time. Those user terminals 4 acquire a plurality of media from a media distributing server 3 according to the media information and its media synchronizing information, and display those media in parallel according to respective timings in which they should be displayed by taking the time of the virtual space management server 2 as a reference. The virtual space management server 2 generates operation synchronizing information to the media on the basis of operation information performed to those media by a certain user terminal 4, and distribute the generated operation synchronizing information to the user terminals 4 sharing the virtual space. The individual user terminals 4 operate those media according to the operation synchronizing information and the operation information, and re-display those media according to the timings in which they should be displayed. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a multi-media display method capable of handling a plurality of media in a virtual space communication system in which a user uses a virtual space by computer graphics and a plurality of users share the virtual space as necessary. And a terminal device and a virtual space management server device constituting a virtual space communication system capable of handling a plurality of media.
[0002]
[Prior art]
Conventionally, in a communication system in which a plurality of users share a virtual space, when displaying a plurality of media such as images and documents outside the virtual space, another service and software are activated by using a function such as an OS. Needed to be displayed separately from the virtual space system. Therefore, it has been difficult to operate the displayed media in synchronization with each other.
[0003]
Further, it is difficult to display the synchronization operation of a plurality of media in synchronization with a plurality of users, and to share user operations performed on the displayed media among a plurality of users. Was.
[0004]
Japanese Patent Application Laid-Open No. 9-81781 considers providing a virtual reality space that can be shared by an unspecified number of users. However, it is considering displaying a plurality of media in the virtual space and sharing media and operations. Absent.
[0005]
Japanese Patent Application Laid-Open No. 2000-250864 allows communication in accordance with a cooperative operation performed in a virtual space, but does not consider a synchronization operation between a plurality of media or media synchronization between users.
[0006]
[Patent Document 1]
JP-A-9-081781
[0007]
[Patent Document 2]
JP-A-2000-250864
[0008]
[Problems to be solved by the invention]
An object of the present invention is that, in the above-described conventional virtual space service, a plurality of media cannot be displayed in a unified manner, a virtual space and a plurality of media cooperate, and a synchronous operation cannot be performed. It is an object of the present invention to provide a virtual space service with high expressiveness by solving the problem that a media cannot be operated in synchronization with a plurality of users in a communication service. It is still another object of the present invention to provide a virtual space communication service in which a plurality of users can perform a collaborative operation by resolving a problem that an operation on a medium cannot be shared among a plurality of users.
[0009]
[Means for Solving the Problems]
In order to solve the above problem, the present invention is a method of displaying a plurality of media in a virtual space by computer graphics, wherein a process of obtaining virtual space information and a plurality of media information, A method for displaying a plurality of media in a virtual space, the method comprising: displaying the virtual space; and acquiring and displaying the plurality of media based on the plurality of media information in parallel. Means.
[0010]
Alternatively, there is provided a method of synchronously displaying a plurality of media in a virtual space by computer graphics, comprising: obtaining virtual space information, a plurality of media information, and synchronization information between the plurality of media; Based on, the step of displaying the virtual space, and, based on the plurality of media information and the synchronization information, to obtain the plurality of media, and to display in parallel according to the respective display timing, A method for displaying a plurality of media in a virtual space, characterized by having:
[0011]
Alternatively, a method of displaying a plurality of media in a virtual space by computer graphics in synchronization with a plurality of terminal devices, wherein each terminal device transmits its own time information to a virtual space management server device; , The virtual space management server device receives the time information of each terminal device and generates the corresponding time information of the terminal device or the synchronization information of the plurality of media for each terminal device including the time difference from the time information of the terminal device Performing each terminal device, obtaining virtual space information, a plurality of media information, and the synchronization information, each terminal device displaying the virtual space based on the virtual space information, The device acquires the plurality of media based on the plurality of media information and the synchronization information, and obtains time information of the virtual space management server device, and obtains the time information. And means solving multiple media display method in a virtual space, comprising the steps of displaying in parallel according to the timing to be displayed respectively as a quasi, the.
[0012]
Alternatively, a method of displaying a plurality of media in a virtual space by computer graphics in synchronization with a plurality of terminal devices, wherein each terminal device transmits its own time information to a virtual space management server device; , The virtual space management server device receives the time information of each terminal device and generates the corresponding time information of the terminal device or the synchronization information of the plurality of media for each terminal device including the time difference from the time information of the terminal device Performing each terminal device, obtaining virtual space information, a plurality of media information, and the synchronization information, each terminal device displaying the virtual space based on the virtual space information, The device acquires the plurality of media based on the plurality of media information and the synchronization information, and obtains time information of the virtual space management server device, and obtains the time information. As a standard, a process of displaying in parallel with each display timing, and the virtual space management server device generates operation synchronization information for the medium including operation information performed on the medium in any of the terminal devices. The process of distributing the same virtual space to terminal devices displaying the same virtual space, and the timing at which each terminal device operates the medium based on operation synchronization information including operation information performed on the medium to display the same. And displaying the plurality of media in the virtual space.
[0013]
Alternatively, there is provided a method of synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices, wherein the step of receiving time information of each terminal device corresponds to the time information of each terminal device. A step of generating synchronization information of a plurality of media for each terminal device including its own time information or a time difference from the corresponding own time information, and a step of distributing the synchronization information to the terminal device. A method for displaying a plurality of media in a virtual space, which is characterized in that it is a solution, is provided.
[0014]
Alternatively, there is provided a method of synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices, wherein the step of receiving time information of each terminal device corresponds to the time information of each terminal device. A step of generating synchronization information between a plurality of media for each terminal device including its own time information or a time difference from the corresponding own time information, and a process of distributing the synchronization information to the terminal device; Receiving the operation information performed on the medium from the terminal device in the terminal device, and generating the operation synchronization information for the medium including the operation information performed on the medium, and displaying the same virtual space. A method for displaying a plurality of media in a virtual space, characterized by comprising a step of distributing to a device.
[0015]
Alternatively, there is provided a method of synchronously displaying a plurality of media in a virtual space by computer graphics, the process of transmitting its own time information to a virtual space management server device, the virtual space information and the plurality of media information, A process of receiving and generating information, and acquiring synchronization information between a plurality of media including a time difference between the time information and the time information of the corresponding virtual space management server device or the time information of the virtual space management server device, Displaying the virtual space based on the virtual space information, acquiring the plurality of media based on the plurality of media information and the synchronization information, and obtaining time information of the virtual space management server device. And displaying the images in parallel according to the respective display timings on the basis of And means solving multiple media display method between.
[0016]
Alternatively, there is provided a method of synchronously displaying a plurality of media in a virtual space by computer graphics, the process of transmitting its own time information to a virtual space management server device, the virtual space information and the plurality of media information, A process of receiving and generating information, and acquiring synchronization information between a plurality of media including a time difference between the time information and the time information of the corresponding virtual space management server device or the time information of the virtual space management server device, Displaying the virtual space based on the virtual space information, acquiring the plurality of media based on the plurality of media information and the synchronization information, and obtaining time information of the virtual space management server device. Displaying the virtual space management server device in parallel with each display timing based on Receiving and synchronizing the operation synchronization information including the operation information performed on the medium in any one of the terminal devices, and operating the medium based on the operation synchronization information including the operation information performed on the medium. A method of displaying a plurality of media in a virtual space, characterized by comprising the steps of:
[0017]
Alternatively, a terminal device for displaying a plurality of media in a virtual space by computer graphics, wherein the terminal device acquires virtual space information and a plurality of media information, and displays the virtual space based on the virtual space information. And a means for acquiring the plurality of media based on the plurality of pieces of media information and displaying the obtained plurality of media in parallel.
[0018]
Alternatively, a terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics, comprising: means for acquiring virtual space information, a plurality of media information, and synchronization information between the plurality of media; Means for displaying the virtual space, and acquiring the plurality of media based on the plurality of media information and the synchronization information of the media, and displaying the plurality of media in parallel according to their respective display timings And a means for displaying a plurality of media in a virtual space.
[0019]
Alternatively, a server device for synchronously displaying a plurality of media among a plurality of terminal devices in a virtual space by computer graphics, wherein the server device receives time information of each terminal device, and corresponds to the time information of each terminal device. Means for generating synchronization information between a plurality of media for each terminal device including a time difference between the own time information or the corresponding own time information, and means for distributing the synchronization information to the terminal device. The solution is a virtual space management server device characterized by having a virtual space management server device.
[0020]
Alternatively, a server device for synchronously displaying a plurality of media among a plurality of terminal devices in a virtual space by computer graphics, wherein the server device receives time information of each terminal device, and corresponds to the time information of each terminal device. Means for generating synchronization information between a plurality of media for each terminal device including the time information of the terminal device itself or the time difference from the corresponding own time information, and means for distributing the synchronization information to the terminal device; Means for receiving, from the terminal device, operation information performed on the medium in the terminal device, and operation synchronization information for the medium including the operation information performed on the medium are generated, and the same virtual space is displayed. And a means for distributing to the terminal device.
[0021]
Alternatively, a terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics, wherein the terminal device transmits its own time information to a virtual space management server device, the virtual space information and the plurality of media information, Means for receiving and generating time information, acquiring synchronization information between a plurality of media including time information of the virtual space management server device or time information of the virtual space management server device corresponding to the time information, Means for displaying the virtual space based on the virtual space information, acquiring the plurality of media based on the plurality of media information and the synchronization information, and obtaining time information of the virtual space management server device. Means for displaying in parallel according to the respective timings to be displayed on the basis of this. A plurality of media display terminal device in a virtual space and means solving.
[0022]
Alternatively, a terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics, wherein the terminal device transmits its own time information to a virtual space management server device, the virtual space information and the plurality of media information, Means for receiving and generating time information, acquiring synchronization information between a plurality of media including time information of the virtual space management server device or time information of the virtual space management server device corresponding to the time information, Means for displaying the virtual space based on the virtual space information, acquiring the plurality of media based on the plurality of media information and the synchronization information, and obtaining time information of the virtual space management server device. Means for displaying in parallel with the respective display timings based on this, Means for receiving operation synchronization information including operation information performed on a medium in any of the terminal devices generated and distributed by the terminal device, and operating the medium based on the operation synchronization information including operation information performed on the medium And a means for redisplaying in accordance with the timing to be displayed.
[0023]
Alternatively, there is provided a program for displaying a plurality of media in a virtual space, wherein the process in the method for displaying a plurality of media in a virtual space is a program for causing a computer to execute the process.
[0024]
Alternatively, a program for causing a computer to execute the process in the method for displaying a plurality of media in the virtual space is recorded on a recording medium readable by the computer. The recording medium on which is recorded is a means for solving the problem.
[0025]
The present invention has a process and means for storing information of the virtual space and information of the media, and a process and means for acquiring a plurality of media and performing display and operation in the virtual space according to the information. Thus, a plurality of media can be displayed in a virtual space shared by a plurality of users. In addition, in the present invention, in addition to the above, by having a process or means for storing synchronization information between a plurality of media, and according to the synchronization information between the media, by having a process or means for operating a plurality of media in synchronization with each other, To enable a plurality of media to be displayed synchronously in a virtual space shared by a plurality of users. Furthermore, in the present invention, in addition to the above, a process and means for distributing synchronization information of an operation performed on a medium by a certain terminal device to another terminal device sharing a virtual space, and according to this operation synchronization information, By having a process or means by which another terminal device can operate and display / operate its own media, a plurality of users can share operations on this media.
[0026]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
[0027]
FIG. 1 is a configuration diagram illustrating an example of a system that performs a virtual space communication service to which the present invention is applied. The configuration of this system is such that a virtual space management server device (hereinafter, simply referred to as a server) 2, a plurality of media distribution servers 3, and a plurality of terminal devices (hereinafter, referred to as user terminals) are provided in a network 1 such as the Internet. 4 are connected.
[0028]
FIG. 2 shows an example of a module configuration of the virtual space management server 2. The information transmitted from each user terminal 4 is received by the communication control unit 21, the data is analyzed by the data processing unit 22, and the data is sent to the module that actually performs the processing. The management and authentication of the user's registration information are processed by the user information management unit 23. The collection and distribution of information on the position and direction of each user's viewpoint transmitted from each user terminal 4 at predetermined time intervals is performed by the user position management unit 24. The processing functions of the media synchronization unit 25, the spatial information management unit 26, and the media management unit 261 will be described later in each embodiment.
[0029]
The media distribution server 3 includes means for distributing each media to each user terminal 4. The media distribution server 3 exists for each medium such as video, image, and character, and distributes media information when each user terminal 4 requests. The media distribution server 3 uses an existing video distribution server or the like.
[0030]
FIG. 3 shows an example of a module configuration of the user terminal 4. In the user terminal 4, the virtual space display unit 41 displays a virtual space by computer graphics, and operates in the virtual space by the user using the user input device 43 by the user input processing unit 42. Means for changing the position and direction of the user's point of view of the user. Also, after each user terminal 4 receives information on the position and direction of the viewpoint of each user transmitted from the virtual space management server 2 by the communication control unit 45 and performs data processing by the data processing unit 44 The virtual space display unit 41 includes means for drawing an incarnation (avatar) of another user on the display 46 in the three-dimensional virtual space. Other processing functions of the data processing unit 44, the media synchronization unit 441, the virtual space display unit 41, and the media display unit 411 will be described later in each embodiment.
[0031]
FIG. 4 is a diagram illustrating the first embodiment of the present invention, and illustrates a screen example of the user terminal 4. A plurality of media (A, B, C) 7 such as characters, videos, and images are displayed in the virtual space 5. These media 7 can be pasted on objects of various shapes constituting the virtual space 5 and displayed. The type of the media 7 to be displayed in the virtual space 5, the object to be pasted, the position (<POS> *, *, * </ POS>), the size (<SIZE> *, *, * </ SIZE>), and the angle Information about the media such as (<ORI> *, *, * </ ORI>) is described in the virtual space definition file together with the virtual space information by the virtual space creator.
[0032]
FIG. 5 shows an example of a virtual space definition file including virtual space information and media information. This virtual space information may be automatically generated by the system in addition to being described by the virtual space creator. Further, the virtual space information is not only stored in the virtual space information management unit 26 of the virtual space management server 2 but also stored in another server or stored in the storage unit of each user terminal 4. It may have been. The media information is managed by the media management unit 261 of the virtual space management server 2.
[0033]
The virtual space display processing is performed by the user terminal 4. FIG. 6 shows the flow of the processing at this time. In FIG. 6, first, the data processing unit 44 reads the virtual space information from the storage destination, and displays the virtual space on the display 46 by the virtual space display unit 41. The data processing unit 44 reads a plurality of pieces of media information, downloads media contents described for each piece of media information from the media distribution server 3, and uses the media display unit 411 to store the media 7 in the virtual space 5 based on the media content. To be displayed.
[0034]
Further, these multiple media 7 can operate synchronously. For example, it is possible to perform a synchronous operation between media in such a manner as to follow a scenario, such as displaying a document when a moving image ends, and playing a sound when a user clicks the document. As shown in FIG. 5, synchronization information between media is also described in the virtual space definition file together with media information. In the example of FIG. 5, media synchronization information (<START> movie1, end </ START>) indicating that the document html1 is displayed when the movie movie1 ends. It is also possible to describe a case where the operation of the medium is caused by the operation of the user or a case where the system automatically executes the operation of the medium. For example, when a certain medium is automatically started three minutes after the start of movie2, media synchronization information of <START> movie2,000300 <// START> is described in the media information. The media synchronization information between media may be described in the virtual space information.
[0035]
This media synchronization process is performed by the user terminal 4. FIG. 7 shows a processing flow at this time. In FIG. 7, the process up to the process of downloading a plurality of media contents from the media distribution server 3 is the same as the process of FIG. Thereafter, it is determined whether or not the media information includes the media synchronization information. If there is, the media synchronization information (<START> movie1, end </ START> in the example of FIG. 5) is held and the display timing is determined. Judge and display the media 7. If there is no media synchronization information in the media information, the display of the media 7 is immediately performed.
[0036]
In FIG. 4, a media operation object 8 for operating the medium 7 such as reproduction, stop, and fast forward is displayed. The user can operate the medium 7 by clicking a button in the object 8 or the like. Similarly, information about media operation such as display / non-display of the media operation object 8, availability of media operation, and automatic operation based on user's action is described in the virtual space definition file by the virtual space creator as shown in FIG. I do. In the example of FIG. 5, the media operation object 8 is displayed for the movie 1, and synchronization enable / disable information (<CNTROL> TRUE <// CNTROL>) indicating that the media operation is possible is described. , Describes the synchronization enable / disable information (<CNTROL> FALSE </ CNTROL>) indicating that the media operation is not possible without displaying the media operation object. In addition, the operation synchronization information (<SYNC> TRUE <// SYNC>) indicating that the operation is automatically performed according to the user's action is described for movie1, and the operation not performing the automatic operation due to the user's action is performed for html1. Synchronization information (<SYNC> FALSE </ SYNC>) is described.
[0037]
The display / operation processing of the media operation object is performed by the user terminal 4. The processing flow at this time is shown in FIGS. FIG. 8 shows the display / operation processing of the media operation object after the virtual space display processing of FIG. FIG. 9 shows a display / operation process of the media operation object after the media synchronization process of FIG. In any case, after displaying the media 7 in the virtual space 5, the data processing unit 44 determines whether or not to display the media operation object according to the operation availability information described in the media information. Displays the media operation object 8 in the virtual space 5 by the media display unit 411. When there is an operation input from the user input device 43 to the button of the media operation object 8, the data processing unit 44 instructs the operation of the media, and the media display unit 411 places the media 7 in the virtual space 5. Redisplay.
[0038]
It should be noted that the first embodiment can be executed not by the virtual space communication service shown in FIG. 1 but also by a virtual space service that is operated independently when the user terminal is not connected to the network. .
[0039]
FIG. 10 is a diagram illustrating the second embodiment of the present invention, and illustrates a screen example of the display 46 of the user terminal 4. Since the virtual space 5 is shared by a plurality of users, the avatars 6, 6 ', 6 "of the plurality of users are displayed. In the shared virtual space 5, a plurality of media (A, B) are displayed. 7) are displayed, and these are operating synchronously, and these operations appear to be the same operations at the same timing as viewed from each user.
[0040]
This synchronization process is performed by the user terminal 4 and the virtual space management server 2 in cooperation. FIG. 11 shows the processing flow at this time. In FIG. 11, time (hereinafter, referred to as time) information as shown in FIG. 12 is transmitted from each user terminal 4 to the virtual space management server 2 at predetermined time intervals. In the virtual space management server 2, the media synchronization unit 25 manages the time information received from each user terminal 4 in a database as shown in FIG. This database is updated when time information is received from each user terminal 4. When the media management unit 261 of the virtual space management server 2 reads the virtual space information and the media information and checks the media synchronization information, the time information of each user terminal 4 managed by the media synchronization unit 25 and the virtual The media information as shown in FIG. 14 is transmitted to each user terminal 4 together with the time information of the space management server 2 or the time difference information between the two and the media synchronization information.
[0041]
In the example of the media information in FIG. 14, the difference between the time of the user terminal 4 managed by the media synchronization unit 25 and the time of the virtual space management server 2 is calculated, and the time difference information (for example, a delay of 21 seconds) For example, <NET_DELETE> 0000000000021 </ NET_DELETE> etc.) is transmitted. When the communication control unit 45 of each user terminal 4 receives the operation synchronization information of FIG. 14 from the virtual space management server 2, the data processing unit 44 and the media synchronization unit 441 perform processing. The media 7 is downloaded from the distribution server 3, and subsequently the media 7 is operated in the virtual space 5 of the display 46 by the virtual space display unit 41 and the media display unit 411 at the timing specified by the media synchronization information. At this time, the user terminal 4 is calculated by using the time information of the virtual space management server 2 corresponding to the time of the user terminal 4 managed by the media synchronization unit 25 and the time difference information between the two. By performing the operation of the media based on the time of the virtual space management server 2, it is possible to more accurately perform the synchronization operation between the user terminals.
[0042]
Furthermore, when a user performs an operation on a medium at a certain user terminal 4, operation synchronization information indicating that the operation has been performed is transmitted to each of the other user terminals 4 via the virtual space management server 2, Be executed. Therefore, it seems that the user terminal 4 performs the same operation on the medium, and the state of the medium is maintained in all the user terminals 4 in the same manner. For example, when the user A plays the stopped video, the stopped video is also played on the user terminals 4 of the users B and C participating in the same virtual space. This process is performed by the user terminal 4 and the virtual space management server 2 in cooperation.
[0043]
FIG. 15 shows the flow of the process at the time of this operation. When the user input processing unit 42 determines that the operation input using the user input device 43 is an operation on the medium 7, the data processing unit 44 performs processing based on the operation synchronization information as shown in FIGS. 16 and 17. Is created, and the communication control unit 45 transmits the operation information to the virtual space management server 2. When the virtual space management server 2 receives the operation information, it adds time information and time difference information (in some cases, the time information and time difference information can be omitted as shown in FIG. 16) as shown in FIGS. 16 and 17. And generates operation synchronization information and transmits it to all users existing in the same virtual space. According to the received operation synchronization information, each user terminal 4 processes the operation on the medium 7 by the media processing unit 44 and the media synchronization unit 441 in the same manner as in FIG. The medium 7 is operated in the virtual space 5 of 46. As described above, by distributing the operation synchronization information to all the user terminals 4, it is possible to perform the operation on the media in synchronization with all the user terminals 4.
[0044]
Although FIGS. 6 to 9 illustrate a case where the number of media displayed on the user terminal is three, the present invention is applicable even if the number of media displayed is one, two, or four or more. Can be implemented similarly. Further, FIGS. 11 and 15 illustrate a case where the number of user terminals is two, but the present invention is similar even if the number of user terminals is three or more as shown in FIG. Can be implemented.
[0045]
Note that some or all of the processing functions of each unit shown in FIGS. 1 to 3 can be realized using arithmetic processing means and control means such as a computer, or FIGS. Needless to say, it is possible to cause a computer or the like to execute the process of the process shown, or a program for realizing the processing function of each unit in the computer or the like, or a program for causing a computer or the like to execute the process. It can be recorded on a recording medium readable by a computer or the like, for example, a flexible disk, an MO, a ROM, a memory card, a CD, a DVD, a removable disk, and the like, and can be stored or provided. The program can be provided through a network such as the Internet. The present invention can be implemented by installing a program provided by a recording medium or a network in a computer or the like in this manner.
[0046]
【The invention's effect】
As described above, according to the present invention, a plurality of media can be displayed and operated in a virtual space. Further, it becomes possible for a plurality of media to operate in synchronization with each other in the virtual space. As a result, in addition to the effect of unifying operations, the expressive power of the virtual space is improved, and it is possible to present information that attracts the user's interest. When a virtual space is shared by a plurality of users, a plurality of users can operate a plurality of media in synchronization with each other. Further, it is possible to share the user's operation on the media among a plurality of users. With these, it becomes possible to perform joint work and smooth communication by a plurality of users.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of the entire system of the present invention.
FIG. 2 is a module configuration diagram of a virtual room management server.
FIG. 3 is a diagram showing a module configuration of a user terminal.
FIG. 4 is a diagram showing an example of a screen of a user terminal according to the first embodiment;
FIG. 5 is a diagram showing a description example of a virtual space definition file.
FIG. 6 is a processing flowchart when displaying a plurality of media in the first embodiment.
FIG. 7 is a processing flow diagram when synchronizing a plurality of media in the first embodiment.
FIG. 8 is a processing flow diagram at the time of operating a plurality of media in the first embodiment.
FIG. 9 is a processing flowchart at the time of synchronization and operation of a plurality of media in the first embodiment.
FIG. 10 is a diagram illustrating an example of a screen of a user terminal according to the second embodiment.
FIG. 11 is a processing flow diagram when synchronizing a plurality of media between user terminals in the second embodiment.
FIG. 12 is a diagram showing a description example of time information transmitted from each user terminal to the virtual space management server.
FIG. 13 is a diagram showing a configuration example of a database for managing time information received from each user terminal.
FIG. 14 is a diagram showing an example of description of time difference information between the time information of each user terminal and the time information of the virtual space management server, and media information created from media synchronization information.
FIG. 15 is a processing flowchart at the time of operating a media between user terminals in the second embodiment.
FIG. 16 is a diagram showing a description example of operation synchronization information.
FIG. 17 is a diagram showing another description example of the operation synchronization information.
[Explanation of symbols]
1. Network
2 ... Virtual space management server
21 Communication control unit
22 Data management unit
23 ... User Information Management Department
24 ... User location management unit
25 ... Media synchronization unit
26 ... Spatial Information Management Department
261: Media management unit
3. Media distribution server
4 ... User terminal
41 ... virtual space display unit
411: Media display section
42 ... user input processing unit
43 ... User input device
44 ... Data processing unit
441: Media synchronization unit
45 Communication control unit
46 ... Display
5 virtual space
6 ... Avatar
7… Media
8… Media operation object

Claims (16)

A method of displaying a plurality of media in a virtual space by computer graphics,
Acquiring virtual space information and a plurality of media information;
Displaying the virtual space based on the virtual space information;
A step of acquiring the plurality of media and displaying the plurality of media in parallel based on the plurality of media information;
A method for displaying a plurality of media in a virtual space, comprising: A method for synchronously displaying a plurality of media in a virtual space by computer graphics,
Acquiring virtual space information, a plurality of media information, and synchronization information between the plurality of media,
Displaying the virtual space based on the virtual space information;
A step of acquiring the plurality of media based on the plurality of media information and the synchronization information, and displaying the plurality of media in parallel according to a timing to be displayed,
A method for displaying a plurality of media in a virtual space, comprising: A method of displaying a plurality of media in a virtual space by computer graphics in synchronization between a plurality of terminal devices,
A process in which each terminal device transmits its own time information to the virtual space management server device;
The virtual space management server device receives the time information of each terminal device, and generates synchronization information of a plurality of media for each terminal device including its own time information or a time difference from its own time information. Process
A step in which each terminal device acquires virtual space information, a plurality of media information, and the synchronization information,
A step in which each terminal device displays the virtual space based on the virtual space information;
Each terminal device obtains the plurality of media based on the plurality of media information and the synchronization information, obtains time information of the virtual space management server device, and adjusts the time information to be displayed based on the time information. The process of displaying in parallel,
A method for displaying a plurality of media in a virtual space, comprising: A method of displaying a plurality of media in a virtual space by computer graphics in synchronization between a plurality of terminal devices,
A process in which each terminal device transmits its own time information to the virtual space management server device;
The virtual space management server device receives the time information of each terminal device, and generates synchronization information of a plurality of media for each terminal device including its own time information or a time difference from its own time information. Process
A step in which each terminal device acquires virtual space information, a plurality of media information, and the synchronization information,
A step in which each terminal device displays the virtual space based on the virtual space information;
Each terminal device obtains the plurality of media based on the plurality of media information and the synchronization information, obtains time information of the virtual space management server device, and adjusts the time information to be displayed based on the time information. The process of displaying in parallel,
A step in which the virtual space management server device generates operation synchronization information for the medium including operation information performed on the medium in any of the terminal devices, and distributes the operation synchronization information to the terminal device displaying the same virtual space;
A process in which each terminal device operates the medium based on operation synchronization information including operation information performed on the medium and redisplays the medium in accordance with the timing at which the medium is to be displayed;
A method for displaying a plurality of media in a virtual space, comprising: A method for synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices,
Receiving time information of each terminal device;
A process of generating synchronization information between a plurality of media for each terminal device including a time difference between the time information of each terminal device and its own time information or the corresponding time information thereof,
Delivering the synchronization information to the terminal device;
A method for displaying a plurality of media in a virtual space, comprising: A method for synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices,
Receiving time information of each terminal device;
A process of generating synchronization information between a plurality of media for each terminal device including a time difference between the time information of each terminal device and its own time information or the corresponding time information thereof,
Delivering the synchronization information to the terminal device;
A step of receiving operation information performed on the media in any of the terminal devices from the terminal device;
A step of generating operation synchronization information for the medium including operation information performed on the medium, and distributing the operation synchronization information to a terminal device displaying the same virtual space;
A method for displaying a plurality of media in a virtual space, comprising: A method for synchronously displaying a plurality of media in a virtual space by computer graphics,
Transmitting its own time information to the virtual space management server device;
The plurality of virtual space information and the plurality of media information, and the plurality of times including the time difference between the time information received and generated and the time information of the virtual space management server device or the time information of the virtual space management server device corresponding to the time information. A process of acquiring synchronization information between media;
Displaying the virtual space based on the virtual space information;
On the basis of the plurality of media information and the synchronization information, the plurality of media are obtained, and the time information of the virtual space management server device is obtained and displayed in parallel with each display timing based on the time information. Process
A method for displaying a plurality of media in a virtual space, comprising: A method for synchronously displaying a plurality of media in a virtual space by computer graphics,
Transmitting its own time information to the virtual space management server device;
The plurality of virtual space information and the plurality of media information, and the plurality of times including the time difference between the time information received and generated and the time information of the virtual space management server device or the time information of the virtual space management server device corresponding to the time information. A process of acquiring synchronization information between media;
Displaying the virtual space based on the virtual space information;
On the basis of the plurality of media information and the synchronization information, the plurality of media are obtained, and the time information of the virtual space management server device is obtained and displayed in parallel with each display timing based on the time information. Process
A step of receiving operation synchronization information including operation information performed on media in any of the terminal devices, generated and distributed by the virtual space management server device,
Based on the operation synchronization information including the operation information performed on the medium, a step of operating the medium and re-displaying it according to the timing to be displayed,
A method for displaying a plurality of media in a virtual space, comprising: A terminal device for displaying a plurality of media in a virtual space by computer graphics,
Means for acquiring virtual space information and a plurality of media information;
Means for displaying the virtual space based on the virtual space information;
Means for acquiring and displaying the plurality of media in parallel based on the plurality of media information;
A multi-media display terminal device in a virtual space, comprising: A terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics,
Means for acquiring virtual space information, a plurality of media information, and synchronization information between the plurality of media,
Means for displaying the virtual space based on the virtual space information;
Means for acquiring the plurality of media based on the plurality of media information and the synchronization information of the media, and displaying the plurality of media in parallel according to their respective display timings;
A multi-media display terminal device in a virtual space, comprising: A server device for synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices,
Means for receiving time information of each terminal device;
Means for generating synchronization information between a plurality of media for each terminal device including a time difference between the time information of each terminal device and its own time information or the corresponding time information of its own,
Means for delivering the synchronization information to the terminal device;
A virtual space management server device comprising: A server device for synchronously displaying a plurality of media in a virtual space by computer graphics among a plurality of terminal devices,
Means for receiving time information of each terminal device;
Means for generating synchronization information between a plurality of media for each terminal device including a time difference between the time information of each terminal device and its own time information or the corresponding time information of its own,
Means for delivering the synchronization information to the terminal device;
Means for receiving operation information performed on media in any of the terminal devices from the terminal device;
Means for generating operation synchronization information for the medium including the operation information performed on the medium, and distributing the operation synchronization information to a terminal device displaying the same virtual space;
A virtual space management server device comprising: A terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics,
Means for transmitting its own time information to the virtual space management server device;
The plurality of virtual space information and the plurality of media information, and the plurality of times including the time difference between the time information received and generated and the time information of the virtual space management server device or the time information of the virtual space management server device corresponding to the time information. Means for acquiring synchronization information between media;
Means for displaying the virtual space based on the virtual space information;
On the basis of the plurality of media information and the synchronization information, the plurality of media are obtained, and the time information of the virtual space management server device is obtained and displayed in parallel with each display timing based on the time information. Means,
A multi-media display terminal device in a virtual space, comprising: A terminal device for synchronously displaying a plurality of media in a virtual space by computer graphics,
Means for transmitting its own time information to the virtual space management server device;
The plurality of virtual space information and the plurality of media information, and the plurality of times including the time difference between the time information received and generated and the time information of the virtual space management server device or the time information of the virtual space management server device corresponding to the time information. Means for acquiring synchronization information between media;
Means for displaying the virtual space based on the virtual space information;
On the basis of the plurality of media information and the synchronization information, the plurality of media are obtained, and the time information of the virtual space management server device is obtained and displayed in parallel with each display timing based on the time information. Means,
Means for receiving operation synchronization information including operation information performed on media in any of the terminal devices, generated and distributed by the virtual space management server device,
Means for operating the medium based on the operation synchronization information including the operation information performed on the medium and redisplaying the medium in accordance with the timing to be displayed;
A multi-media display terminal device in a virtual space, comprising: 9. A program for displaying a plurality of media in a virtual space, wherein the process in the method for displaying a plurality of media in a virtual space according to any one of claims 1, 2, 5 to 8 is a program for causing a computer to execute the process. A program for causing a computer to execute the steps in the method for displaying a plurality of media in a virtual space according to any one of claims 1, 2, 5 to 8,
A recording medium recording a program for displaying a plurality of media in a virtual space, wherein the program is recorded on a recording medium readable by the computer.

Images