JP2005100053A - Method, program and device for sending and receiving avatar information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for making it possible to obtain data on the kinds of spaces to which users with various attributes have moved, the times when they have moved there, the kinds of images which the users have viewed, and the kinds of comments which the users have made, regardless of the users' locations in real space. <P>SOLUTION: A server computer that can send and receive data to and from first and second client computers stores a space ID, and space configuration information and image information that correspond to the space ID (1); on receiving the space ID and the first position information of a first avatar from the first client, stores the first user ID of a first user, the space ID, the first position information and first time information in association and sends the first position information to the second client (2); and on receiving a space ID and the second position information of a second avatar from the second client, stores the second user ID of a second user, the space ID, second position information and second time information in association and sends the second position information to the first client (3). <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a method, a program, and an apparatus in which a plurality of users can share a 3D virtual space constructed on a network and can communicate in real time while viewing the same content (streaming video, Flash, etc.). The present invention relates to a method, a program, and an apparatus for communicating by expressing each user as an avatar (character) called an avatar.

  In recent years, broadbandization of communication lines has progressed, and when a part of a data file is read into a buffer memory, playback starts, and Internet broadcasting (concert etc.) using streaming distribution technology that simultaneously reads and plays is performed. Yes.

  In addition, there is also a method for conducting a questionnaire related to content in a timely manner for viewers of streaming distribution content (see, for example, Patent Document 1).

However, it is possible to conduct questionnaires related to the content in a timely manner for viewers of streaming content, and viewers can respond to the questionnaires related to advertisements provided in video content without stress. I just did.
JP 2003-61065 A

  The problem to be solved by the present invention is that a user having various attributes moves to any space, what kind of space, what kind of video, what kind of remarks, regardless of the location in the real space. It is to provide a technique for acquiring data related to whether or not the data has been used and making it available as marketing data.

  A first feature of the present invention is that a server computer capable of transmitting / receiving data to / from the first and second client computers includes (1) a space ID, space configuration information corresponding to the space ID, and video information. (2) When receiving the space ID and the first position information of the first avatar from the first client computer, the first user ID, the space ID, the first position information, and the first time information of the first user And the first location information is transmitted to the second client computer. (3) When the space ID and the second location information of the second avatar are received from the second client computer, the second user's The second user ID, the space ID, the second position information, and the second time information are stored in association with each other, and the second position information is transmitted to the first client computer.

  “When the space ID and the first position information of the first avatar are received, the first ID of the first user, the space ID, the first position information, and the first time information are stored in association with each other.” After receiving the first location information, the first ID, the space ID, the first location information, and the first time information are associated with each other and stored at the same time. Are stored in association with each other, and after receiving the first position information, the first ID, the first position information, and the first time information are stored in association with each other. The same applies to the second position information, the second ID, and the second time information.

  The space ID is an identifier that specifies space configuration information. The space configuration information is information necessary for displaying a 3D space on a display means such as a CRT display or a liquid crystal display of a client computer. For example, VRML (Virtual Reality Modeling Language), HTML (Hypertext Markup Language), etc. It is described by. The VRML browser or Web browser stored in the storage means of the client computer interprets the VRML file or the HTML file, and in any position of the display means with respect to the OS (Operating System) or API (Application Programming Interface) Instructs whether to display 3D graphics. When information related to moving image display is embedded in the VRML file, the VRML browser reads a necessary moving image data file from the server computer. RTSP (Real Time Streaming Protocol) or the like is used for streaming distribution of moving image data files.

  The position information is information indicating the position in the 3D space of a predetermined point (for example, the head vertex) of each avatar, and includes an X coordinate value, a Y coordinate value, and a Z coordinate value.

  The first time information includes the time when the first position information is generated, the time when the first position information is transmitted from the first client computer to the server computer, the time when the server computer receives the first position information, and the like. included. Similarly, the second time information includes the time at which the second position information was generated, the time at which the second position information was transmitted from the second client computer to the server computer, and the server computer received the second position information. Includes time etc.

  The second feature of the present invention is that when the server computer further receives (1) the first line-of-sight information of the first avatar from the first client computer, the first user ID and the first line-of-sight information are stored in association with each other, The first line-of-sight information is transmitted to the second client computer, and (2) when the second line-of-sight information of the second avatar is received from the second client computer, the second user ID and the second line-of-sight information are stored in association with each other. It is to transmit the second line-of-sight information to one client computer.

  The line-of-sight information is information indicating where each avatar is looking in the 3D space. For example, the line-of-sight information includes the coordinate value of the viewpoint center, the line-of-sight direction indicating which one is viewed from the viewpoint center, and the viewing angle.

  The third feature of the present invention is that, when the server computer further receives (1) the first message information of the first avatar from the first client computer, the first user ID and the first message information are stored in association with each other, The first message information is transmitted to the second client computer. (2) When the second message information of the second avatar is received from the second client computer, the second user ID and the second message information are stored in association with each other. The second message information is transmitted to one client computer.

  The speech information is composed of characters, numbers, and symbols that are input by each user using character input means such as a keyboard at hand.

  According to a fourth feature of the present invention, the server computer further stores (1) a plurality of video IDs and a plurality of video information in association with one space ID, and (2) a space ID from the first client computer. When the video ID selected from the selection candidates is received from the first client computer, a plurality of video IDs associated with the space ID are transmitted as selection candidates to the first client computer. (3) When receiving the space ID from the second client computer, the second client computer uses the plurality of image IDs associated with the space ID as selection candidates. The video ID selected from the selection candidates is transmitted to the second client compilation. Once received from over data is to transmit the image information associated with the image ID selected to the second client computer.

  Video IDs 1 to n are stored in association with one space ID. There is one piece of video information stored in association with each video ID. That is, when one video ID is selected, one video information is specified.

  Examples of the format of a moving image file distributed as video information include Windows Media, Real Media, Quick Time, and the like. Viewing a video file in each format requires a plug-in player for each format.

  The fifth feature of the present invention is that the server computer further stores (1) the first and second user IDs in association with the first and second user IDs, respectively, and the target user condition for each of the video information. (2) When the space ID is received from the first client computer, the target user condition of the plurality of video IDs associated with the space ID is compared with the first user attribute information, and the target user condition Only the video IDs satisfying the above are transmitted to the first client computer as selection candidates, and (3) when the space ID is received from the second client computer, the target user condition of the plurality of video IDs associated with the space ID and the first 2 The user attribute information is compared, and only the video ID satisfying the target user condition is selected as a selection candidate. It is to send to.

  The user attribute information includes the user's gender, age, favorite movie genre, and the like. The target user condition includes a user's gender, age, movie genre, and the like. For example, when a plurality of movies associated with the space ID include “target user condition: 18 years old or older”, the age of the first user is 20 years old, and the age of the second user is 18 years old This movie is sent to the first user, but not to the second user. In other words, this movie is one of the selection candidates for the first user, but this movie is excluded from the selection candidates for the second user.

  According to the first feature of the present invention, when and in which 3D space each avatar was present and in which position can be stored in the storage means.

  According to the 2nd characteristic of this invention, what each user corresponding to each avatar was looking at can be memorize | stored in a memory | storage means.

  According to the 3rd characteristic of this invention, what kind of statement each user corresponding to each avatar made further can be memorize | stored in a memory | storage means.

  According to the 4th characteristic of this invention, each user corresponding to each avatar can memorize | store in the memory | storage means which video was selected and watched in which 3D space.

  According to the fifth feature of the present invention, it is possible to narrow down videos to be presented as selection candidates according to the attributes of each user corresponding to each avatar.

  Embodiments of the present invention will be described below with reference to the drawings.

  As shown in FIG. 1, in the client server system used in this embodiment, a large number of client computers (hereinafter referred to as “clients”) 1a to 1d are connected to a LAN, a WAN, a public line, etc. A server computer (hereinafter referred to as “server”) 3 can be accessed via a communication line.

In response to requests from the clients 1a to 1d, the server 3
A function as a Web server that transmits VRML files and HTML files necessary for 3D space display,
A function as a media server that distributes moving image files, and a function as a communication server that transfers chat data in text format transmitted from each of the client computers 1a to 1d to a client other than the speaker.

  The client 1 and the server 3 exchange data according to HTTP (hypertext transfer protocol), UDP (user datagram protocol), RTSP (real time streaming protocol), or the like.

  The clients 1a to 1d receive the HTML file sent from the server 3, and display the 3D space on each display means such as a CRT or a liquid crystal display of the clients 1a to 1d using a Web browser. Furthermore, the moving image file distributed from the server 3 is received, and the moving image is reproduced in the moving image area in the 3D space displayed on each display means.

  As shown in FIG. 2, the server 3 used in this embodiment has a storage device 303 connected to a main control unit (control means, hereinafter referred to as “CPU”) 301 that controls the whole. A receiving unit 307 and a transmitting unit 309 are also connected to the CPU 301 via an input / output control unit 305. Further, although not shown, a read only memory (ROM) storing a basic input / output system (BIOS) and the like, and a random access memory (RAM) having a program area and a data area are connected to the CPU 301.

  The storage device 303 is storage means such as a hard disk, a flexible disk, an optical disk, or a magneto-optical disk, and includes a plurality of 3D space display files 311, a plurality of moving image files 313, a user space table T 101 indicating a correspondence relationship between users and spaces, a space Image table T111 indicating the correspondence between the image and the image, a plurality of avatar position tables T121 in which the position of each avatar is recorded every predetermined time, a chat log file 317 in which the chat content is recorded, and user basic information and avatar configuration information of each user A user management information file 319 and the like are stored.

  In addition, the storage device 303 includes web server application software such as an OS and Apache that can transmit and receive data according to a communication protocol such as TCP / IP, and multimedia application software that uses an API (application programming interface) group such as DirectX. Stores Java applets that are downloaded from the server to the client and executed on the client's web browser.

  The 3D space display file 311 is transmitted from the server 3 to the client 1, interpreted by a Web browser activated on the client 1, and displays the 3D space on the display unit of the client 1.

  3A and 3B and FIGS. 4A and 4B are conceptual diagrams of a 3D space displayed on the display unit of each client 1. FIG. As will be described later, the position of the avatar in each figure is different from the position of the avatar displayed on the display means of each client 1. In the 3D space shown in FIGS. 3 and 4, five buttons B 1 to 5 “On Demand 1” to “On Demand 5” are displayed on the left side of the moving image reproduction area 10. When any button is selected and clicked, the moving image associated with the clicked button is distributed from the server 3 to the client 1. In addition, the date and time such as “Live (12/22) 10: 00-11: 00” and “Live (2/2) 13: 00-13: 30” are displayed on the right panel 1-2 of the video playback area 10. Is displayed. These indicate that the predetermined moving image distribution is started at the designated date and time.

  The moving image file 313 is distributed from the server 3 to the client 1, and the moving image is reproduced in the moving image reproduction area 10 in the 3D space displayed on the display unit of the client 1. In the 3D space shown in FIGS. 3 and 4, a video of a soccer game is played.

  FIG. 5A shows an example of the user space table T101. As shown in FIG. 5A, a user ID field F101 for storing a user ID, an IP address field F102 for storing an IP address of a client used by the user, and a Web browser activated on the client Are provided with a port number field F103 for storing a port number used by the client and a space ID field F104 for storing a space ID transmitted to the client.

  FIG. 5B is a diagram illustrating an example of the spatial video table T111. As shown in FIG. 5B, a space ID field F111 for storing a space ID, a space configuration file name field F112 for storing a space configuration file name corresponding to the space ID, and a video file corresponding to the space ID. A video file name field F113 for storing a name is provided.

  FIG. 5C shows an example of the avatar position table T121. As shown in FIG. 5C, the table T121 includes a time field F121 for storing the time at which the position coordinate data is received, and a space field F122 for storing the ID of the space displayed on the display means of the client at that time. And a position coordinate field F123 for storing the position coordinate value of the avatar in the space.

  FIG. 5D is a diagram illustrating an example of another avatar position table T131. Similar to the table T121, the table T131 also includes a time field F131, a space field F132, and a position coordinate field F133.

  In the chat log file 317, the date and time of speech, the speech user ID, the handle name, the space ID, the IP address, the chat text, and the reception user ID are added as a log for each user speech.

  The utterance date is the date and time when the utterance was made by the user. The speech user ID is an ID that identifies the user who made the speech. The handle name is the handle name of the user who made the statement, and is the handle name displayed in the 3D space.

  The space ID is an ID that specifies a 3D space displayed on the display unit of the client computer, and is, for example, an alphanumeric character that specifies an HTML file necessary for displaying the 3D space.

  The IP address is an IP (Internet Protocol) address of the speaking user, and is used to identify the speaking user. The chat text is a character string indicating the content of the message, for example, “You are okay”.

  The received user ID is the ID of the user who has received the message, and is listed in the log by the number of received users. For example, when the user A's message is received by the users B, C, and D, the user ID of the user B, the user ID of the user C, and the user ID of the user D are recorded as the receiving user ID.

  FIG. 6 is a diagram illustrating an example of the user management information file 319. As shown in FIG. 6, the user management information file 319 includes user basic information and avatar configuration information. The basic user information includes, for example, a user ID, user name, gender, age, handle name, language code, email address, user image file name, self-introduction sentence, encrypted user password, and user authority ID. Avatar composition information includes, for example, hair style, hair color, face pattern, skin color, outerwear pattern, pants / skirt pattern, shoe pattern, head item, right hand item, left hand item, etc. It is.

  Based on the avatar configuration information in the 3D space display file 311, the moving image file 313, and the user management information file 319, 3D space, moving images, and avatars can be displayed on the display means of each client 1. For example, as shown in FIGS. 3A and 3B and FIGS. 4A and 4B, each display unit of the clients 1a to 1b includes a common 3D space, a moving image and avatars avt1 to 2, Avatar remarks 12 to 15 are displayed.

  Hereinafter, specific description will be given based on examples.

  Based on FIG.7 and FIG.8, the flow of the process in the server 3 regarding space ID comparison and position information transmission / reception, and the information transmitted / received between the server 3, the client 1a, and the client 1b are demonstrated.

FIG. 7 shows a process flow in the server 3 regarding the space ID comparison, and information transmitted and received between the server 3, the client 1a, and the client 1b.
FIG. 8 shows a flow of processing in the server 3 regarding transmission / reception of position information, and information transmitted / received among the server 3, the client 1a, and the client 1b.

  As a precondition, the client 1a stores only the first avatar configuration information, the client 1b stores only the second avatar configuration information, and the server 3 stores the first avatar configuration information and the second avatar configuration information. It is assumed that both pieces of information are already stored.

  First, comparison of space IDs will be described with reference to FIG.

  The server 3 receives the space ID from the client 1a (S101), associates and stores the space ID and the user ID of the client 1a (S102), and stores the space configuration information and video information corresponding to the space ID in the client 1a. (S103).

  FIG. 5A shows an example of a user space table that stores a user ID and a space ID in association with each other. When the server 3 receives the space ID “K001” from the client 1a, the server 3 stores the user ID of the client 1a in the user ID field F101 of the record R101 of the table T101, and stores the space ID “K001” in the space ID field F104 of the record R101. Store. The IP address field F102 of each record stores the IP address of each client, and the port number field F103 stores the port number of each client.

  FIG. 5B shows an example of a spatial video table that stores a spatial ID, a spatial configuration file that is spatial configuration information, and a video file that is video information in association with each other. In the first embodiment, as shown in FIG. 5B, it is assumed that the space and the video have a one-to-one relationship. Therefore, as shown in the table T111 of FIG. 5B, K001 is stored in the space ID field F111 and 1. in the space configuration file name field F112 of the record R111. html, 1. in the video file name field F113. Each mpeg is stored. In such a case, if the space ID received from the client 1a is K001, 1. html is 1. mpeg is transmitted to the client 1a.

  Next, the server 3 receives the position information of the first avatar from the client 1a (S105), and stores the received position information of the first avatar (S106).

  For example, as shown in FIG. 5 (c), the space ID transmitted to the client 1a in the space ID field F122 is the time TM101 at which the position information is received from the client 1a in the time field F121 of the record R121 of the user position table T121. “K001” is stored in the position field F123, and the position coordinate data “x11, y11, z11” of the first avatar in the 3D space is stored.

  Next, the server 3 receives the space ID from the client 1b (S107), associates and stores the space ID and the user ID of the client 1b (S108), and space configuration information and video information corresponding to the space ID. Is transmitted to the client 1b (S109).

  For example, when receiving the space ID “K001” from the client 1b, the server 3 stores the user ID of the client 1b in the user ID field F101 of the record R102 of the table T101, and stores the space ID “K001” in the space ID field F104 of the record R102. "Is stored.

  Next, the server 3 compares the space ID received from the client 1b with the space ID transmitted to the client 1a (S111), and determines whether both space IDs are the same.

  For example, the space ID stored in the space ID field F104 of the record R101 of the table T101 is compared with the space ID stored in the space ID field F104 of the record R102.

  When both space IDs are the same, the configuration information of the first avatar and the position information of the first avatar are transmitted to the client 1b (S113). If the two space IDs are not the same, the server 3 returns to the space ID reception waiting state.

  Further, the position information of the first avatar is read from the position field F123 of the record R121 of the table T121.

  Thereby, the 2nd avatar which is a self-avatar and the 1st avatar of the client 1a can be displayed on the display means of the client 1b.

  Next, the server 3 receives the position information of the second avatar from the client 1b (S115), and stores the position information of the second avatar (S116).

  For example, as shown in FIG. 5D, the time “TM201” at which the position information is received from the client 1b is transmitted to the time field F131 of the user position table T131 for the client 1b, and the space ID field F132 is transmitted to the client 1b. And the coordinate data “x21, y21, z21” of the second avatar in the virtual space are stored in the position field F133.

  Next, the server 3 transmits the configuration information and position information of the second avatar to the client 1a (S117).

  By the processing so far, the first avatar as the own avatar and the second avatar of the client 1b can be displayed on the display means of the client 1a. The display means of the client 1b can display the second avatar that is the own avatar and the first avatar of the client 1a.

Next, transmission / reception of position information will be described with reference to FIG.
The server 3 periodically receives position information regarding each client's avatar from each client, stores the position information, and transmits the position information to other clients viewing the same 3D space.

  For example, when the position information of the first avatar is received from the client 1a (S119), the position information is stored (S120), and the position information is transmitted to the client 1b (S121). For example, when the position information “x12, y12, z12” of the first avatar is received from the client 1a, the position information and the reception time “TM102” are recorded in the record R122 of the table T121, and the position information is transmitted to the client 1b. To do.

  Similarly, when the server 3 receives the position information “x22, y22, z22” of the second avatar from the client 1b (S123), the server 3 records the position information and the reception time “TM202” in the table T131 (S124), The position information is transmitted to the client 1a (S125).

  According to the first embodiment, it is possible to record in the tables T121 and T131 which and when avatars exist at which positions in which 3D space. The user attribute of each avatar is stored as basic user information in the user management information file. When the 3D space is specified, the image displayed in the 3D space is specified based on the table T111. For this reason, it is possible to know when and what attribute the user having what kind of image was viewed.

  In the second embodiment, not only the space ID and the position information (spatial coordinate value) but also the line-of-sight information indicating where each avatar is looking in the space is subject to transmission / reception.

  Specifically, when the server 3 receives the position information of the first avatar from the client 1a (S105), the server 3 also receives the line of sight information of the first avatar and stores the position information (S106). It also stores information.

  As shown in FIG. 9A, for example, the time TM211 when the position information is received in the time field F222 of the table T221, the space ID “K001” in the space ID field F223, and the position ID in the 3D space in the position field F224. Position coordinates data “x211, y211, z211” of one avatar, viewpoint center coordinates “x215, y215, z215” of the first avatar in the viewpoint center field F225, and data indicating the line-of-sight direction of the first avatar in the line-of-sight field F226 “Sh2261” is stored in the viewing angle field F227.

  The viewpoint center coordinates and the viewing angle will be described with reference to FIG. FIG. 13 is a view of the avatar's head avthd as viewed from directly above the avatar. As shown in FIG. 13, the viewpoint center coordinate value may be a coordinate value of an avatar's eye midpoint (denoted as “viewpoint center sc1”), or a point 3 m behind the viewpoint center sc1 (“viewpoint”). The coordinate value may be expressed as “center sc2”. Furthermore, the viewing angle is set to a vertex of the viewpoint center sc1 or sc2, and is a fixed value of 53 ° in this embodiment.

  Note that FIG. 3 is not an image displayed on the display means of each client. If the viewpoint center is between the eyes of the avatar, the user's own avatar is not displayed on the display means. That is, the avatar avt1 is not displayed on the display unit of the client 1a, and the avatar avt2 is not displayed on the display unit of the client 1b. When the viewpoint center is behind the avatar, the position where the back of the user's own avatar is displayed is approximately equidistant from the left and right ends of the screen of the display means and near the lower end of the screen. In other words, the video of the avatar avt1 seen from the back is displayed in the middle of the screen of the display means of the client 1a and near the lower end of the screen, and the video of the avatar avt2 seen from the back is displayed on the client 1b. It is displayed in the middle of the screen of the means and near the lower end of the screen.

  The center point of the image displayed on the display means of each client is determined from the viewpoint center coordinates and the line-of-sight direction. For example, the arrival point of the line of sight obtained from the viewpoint center coordinates and the line-of-sight direction is displayed at substantially the center of the screen of the display means. For example, when the arrival point of the line of sight extending in the viewpoint direction from the viewpoint center coordinates of the avatar avt1 is the player's feet on the right side in the video playback area 10 shown in FIG. 3, the player's feet are displayed on the client 1a. It is displayed at the center of the display screen. On the other hand, when the arrival point of the line of sight extending in the viewpoint direction from the viewpoint center coordinates of the avatar avt2 is the head of the player on the left side in the video playback area 10 shown in FIG. 3, the head of the player is the client 1b. The image is displayed almost at the center of the display screen.

  The field of view is determined by the distance from the viewpoint center to the line-of-sight arrival point and the viewing angle. If the viewing angle is the same, the shorter the distance from the viewpoint center to the line of sight arrival point, the narrower the field of view, and the longer the distance, the wider the field of view. When the field of view is narrow, the object is viewed from a short distance, and the details of each object are displayed on the client's monitor, but only a narrow range is displayed. On the other hand, a state where the field of view is wide is a state where the object is viewed from a long distance, and details of each object are not displayed on the monitor, but a wide range is displayed.

  If the avatar moves in the 3D space, the viewpoint center coordinates change with the movement. For example, if the avatar moves on the XY plane in the 3D space by x1 in the X direction and y1 in the Y direction, the viewpoint center coordinates also move by x1 in the X direction and y1 in the Y direction. Even if the avatar does not move, the line of sight changes if the head of the avatar turns to the left, turns to the right, turns to the top, or turns to the bottom. For example, if the head of the avatar rotates 45 degrees to the right, the line-of-sight direction also rotates 45 degrees to the right. If the avatar's head faces 10 degrees, the line-of-sight direction also faces 10 degrees.

  Further, when the server 3 transmits the configuration information and the position information of the first avatar to the client 1b (S113), the server 3 also transmits the line-of-sight information of the first avatar.

  Thereby, the 2nd avatar which is a self-avatar and the 1st avatar of the client 1a can be displayed on the display means of the client 1b. Further, the direction in which the face of the first avatar faces is obtained based on the received line-of-sight direction of the first avatar, and is displayed on the display unit of the client 1b. From the orientation of the face of the first avatar displayed on the display unit of the client 1b, the approximate range of the 3D space displayed on the display unit of the client 1a can be estimated.

  Next, when the server 3 receives the position information of the second avatar from the client 1b (S115), the server 3 also receives the line-of-sight information of the second avatar and stores the position information (S116). Remember.

  As shown in FIG. 9B, for example, the time TM221 at which position information is received in the time field F232 of the table T231, the space ID “K001” in the space ID field F233, and the position ID in the 3D space in the position field F234. 2 The position coordinate data “x221, y221, z221” of the avatar, the coordinate data “x225, y225, z225” of the viewpoint center of the second avatar in the viewpoint center field F235, and the line-of-sight direction of the first avatar in the line-of-sight direction field F236 The viewing angle is stored in the viewing angle field F237 for the indicated data “sh2361”.

  Further, when the server 3 transmits the configuration information and position information of the second avatar to the client 1a (S117), the server 3 also transmits the line-of-sight information of the second avatar.

  After that, when the server 3 receives the position information and the line-of-sight information from each client, the server 3 transmits the information to other clients existing in the same 3D space. For example, when the position coordinates “x212, y212, z212”, the viewpoint center coordinates “x216, y216, z216” and the line-of-sight direction sh2262 of the first avatar are received from the client 1a, the position coordinates, the viewpoint center coordinates, the line-of-sight direction, etc. The reception time “TM212” is recorded in each field of the table T221, and the position coordinates, viewpoint center coordinates, line-of-sight direction, and viewing angle are transmitted to the client 1b.

  Similarly, when the server 3 receives the position coordinates “x222, y222, z222”, the viewpoint center coordinates “x226, y226, z226” and the viewing direction r2362 of the second avatar from the client 1b, the position coordinates, the viewpoint center coordinates, and The line-of-sight direction and the reception time “T222” are recorded in each field of the table T231, and the position coordinates, the viewpoint center coordinates, the line-of-sight direction, and the viewing angle are transmitted to the client 1a.

  According to the second embodiment, each of the avatars (that is, each user), when in which 3D space, and from which position in the 3D space, and in which direction the information is viewed from the tables T221 and T231. Can be recorded. For this reason, by comparing with information on where and what video was displayed when and in each 3D space, the user having what attribute when and what “what part of the video is centered” "To what range", how long it was viewed, and what was displayed in that range.

  For this reason, it is possible to grasp where the line of sight concentrates in the 3D space. For example, it is possible to set an advertisement insertion fee for an advertisement to be pasted at a position where such a line of sight concentrates.

  Based on FIG. 10, the flow of processing in the server 3 relating to transmission / reception of speech information, and data and information transmitted / received between the server 3, the client 1a, and the client 1b will be described.

  The difference between the third embodiment and the first embodiment is that, in the third embodiment, not only the position information but also what each avatar says is also subject to transmission / reception.

  The processing (S101 to S117) for comparing the space IDs and transmitting the configuration information and the like of each other's avatars to the clients that have transmitted the same space ID to the server 3 has already been performed. A certain 1st avatar and the 2nd avatar of the client 1b are displayed, and the 2nd avatar which is a self-avatar and the 1st avatar of the client 1a are displayed on the display means of the client 1b.

  Furthermore, the positional information transmission / reception process of receiving the position information of the first avatar from the client 1a, storing it, transmitting it to the client 1b, receiving the position information of the second avatar from the client 1b, storing it, and transmitting it to the client 1a ( It is assumed that S119 to S125) have already been performed.

  Similar to the first and second embodiments, also in the third embodiment, the server 3 receives the position information regarding each client's avatar “periodically” from each client, stores it, and forwards it to other clients.

  Further, in the third embodiment, the server 3 receives the message information of each client “as needed” from each client, transfers it to other clients, and stores the message information and its transfer destination. “As needed” means that message information is sent from any client.

  As shown in FIG. 10, for example, the utterance information of the first avatar is received from the client 1a (S127), the utterance information is transmitted to the client 1b (S129), and the utterance information and its transmission destination are stored (S130). ). Similarly, the message information of the second avatar is received from the client 1b (S131), the message information is transmitted to the client 1a (S133), and the message information and the transmission destination are stored (S134).

  When the server 3 receives the remark information from each client, the server 3 stores the following information as a chat log. For example, upon receiving the text data corresponding to "Hi" as the speech information of the first avatar from the client 1a, the date and time (DAYTIME) whose speech has been performed, the ID of a speaker user (UserID), remark The ID (WorldID) of the performed space, text data (ChatText) indicating the content of the message, and the ID (RecvUserID) of another client that has received the text data are stored as a chat log.

An example of the chat log format is shown below.
DayTime [\ t] UserID [\ t] WorldID [\ t] ChatText [\ t] RecvUserID ([\ t] RecvUserID ...) [\ r] [\ n]
When there are a plurality of other clients that receive the text data, the user IDs of all the clients that receive the text data are stored. Here, [¥ t] means a tab, [¥ r] means a return, and [¥ n] means a line feed.

  Furthermore, the chat log may include the handle name displayed in the 3D space, the IP address of the speaking user, and the like.

  As described above, the message information is received, stored, and transferred in the server 3 when the message information is transmitted from any client. On the other hand, reception, storage, and transfer of position information are performed periodically.

  According to the third embodiment as described above, in addition to the effects of the first and second embodiments, it is possible to record what is said while watching what is further viewed. Therefore, it is possible to know who and what kind of conversation has been exchanged in the 3D space while watching what the user having what attribute has.

  Since the chat log records the speaker, the speech time, and the content of the speech (ChatText), it is possible to know who said what and who said what. For this reason, even if the meaning of the first utterance content alone is unknown, it is possible to understand the meaning of the first utterance content by referring to the immediately preceding second utterance content.

  For example, the remark 13 “better when raising the cross” of the second avatar avt2 shown in FIG. 3B is a remark while looking at the two players, so it is It is not possible to specify whether the remarks are about players.

  However, from the content of the utterance 12 “Dribbling XX is cool” immediately before the first avatar avt1 illustrated in FIG. 3A, the utterance of the second avatar avt2 is also “Dribbling ○ ○ ”Can be specified as a comment about the player.

  In addition, it is impossible to specify what the utterance 15 of the second avatar avt2 illustrated in FIG. 4B agrees with the utterance content alone.

  However, from the content of the utterance “cool” immediately before the first avatar avt1 illustrated in FIG. 4A, the utterance of the second avatar avt2 can also be specified as an agreement regarding “cool”.

  In the description so far, in the third embodiment, the line-of-sight information is not the target of transmission / reception for the sake of simplification, but it goes without saying that the line-of-sight information may also be transmitted / received when the position information is transmitted / received as in the second embodiment. Yes.

  Accordingly, for example, the utterance 15 “sounds right” in FIG. 4B is different from the utterance 14 “cool” in FIG. By recording and examining the central coordinates, the statement 14 of the first avatar avt1 is a statement while looking at the feet of the dribbling player, while the statement 15 of the second avatar avt2 is dribbling. You can see that it is a comment while looking at the face of the player running on the left side of the player.

  And, for example, if the gender of the user of the first avatar avt1 is “male” and the gender of the user of the second avatar avt2 is “female”, the video of the player dribbling in the advertisement for the product for men Is more appealing to men who are consumers of the product, while in the advertising for women's products, it is better to use the video of the player running on the left side of the dribbling player It can be seen that the appeal to women as consumers is high.

  In addition, when an advertisement is put or decorated in a 3D space, what advertisement, which decoration, what avatar has what attribute, how many times, how long, what kind of remarks Information on whether or not the user has performed can be acquired, and such information can be used as marketing information.

  In particular, when a plurality of avatars are viewing the same advertisement in the same space, it is possible to collect information on what user has made what statement and how other users have responded to the statement. By analyzing this, it is possible to see what impressions are given according to the attributes of the user who made the statement. Furthermore, if it is combined with visual field information, it is possible to know where in the space you have spoken and to collect more detailed information.

  Based on FIG.11 and FIG.12, the flow of the process in the server 3 regarding a video ID comparison process, and the data and information transmitted / received between the server 3, the client 1a, and the client 1b are demonstrated.

  FIG. 11 is a sequence diagram illustrating a process flow in the server 3 regarding the video ID comparison process, and data and information transmitted / received between the server 3, the client 1a, and the client 1b.

  FIG. 12 is a table showing the correspondence between space IDs and video IDs, conditions for each video ID, and the like.

  In the first to third embodiments, the space ID and the video ID correspond to each other on a one-to-one basis. Therefore, if the space ID is selected, the video ID is specified without selecting the video ID. However, since the space ID and the video ID do not correspond one-to-one in the fourth embodiment, it is necessary to select the video ID separately from the selection of the space ID.

  As shown in FIG. 11, the server 3 receives the space ID from the client 1a (S201), records the client ID of the client 1a in association with the space ID transmitted to the client 1a (S202), and stores the space ID in the space ID. Space configuration information capable of displaying a 3D space in which any one of a plurality of pre-associated video titles can be selected on the client display means is transmitted to the client 1a (S203).

  As shown in FIGS. 12A and 12B, for example, when the server 3 receives the space ID “K401” from the client 1a, the server 3 sets the space ID “K401” in the space ID field F404 of the record R401 of the table T401. The space configuration file “401.html” stored and associated with the space ID “K401” is transmitted to the client 1a with reference to the table T411. It is assumed that tags linked to video files “401.mpeg”, “402.mpeg”,... Are embedded in the space configuration file “401.html”.

  For example, <A Href="http:/URL/401.mpeg"> video title name xxx </A>. Therefore, in the client 1a, the received HTML file is interpreted by the Web browser, and “video title name xxx” or the like is displayed in the 3D space displayed on the display means.

  Next, the server 3 receives the video ID from the client 1a (S205), and stores the received video ID in association with the user ID (S206).

  For example, when the server 3 receives the video ID “E401” from the client 1a, the server 3 stores the video ID “E401” in the video ID field F405 of the record R401 of the table T401.

  Next, the server 3 transmits video information such as a video file corresponding to the video ID to the client 1a (S207).

  For example, the user A corresponds to <A Href="http:/URL/401.mpeg"> video title name xxx </A> in the space configuration file “401.html” using a pointing device such as a mouse pointer. When the portion is clicked, the video file “401.mpeg” is transmitted to the client 1a.

  Next, the server 3 receives the space ID from the client 1b (S209), associates and stores the client ID of the client 1b and the space ID transmitted to the client 1b (S210), and is associated with the space ID in advance. Space configuration information capable of displaying a 3D space in which any one of a plurality of video titles can be selected on the display means of the client is transmitted to the client 1b (S211).

  For example, when the server 3 receives the space ID “K401” from the client 1b, the server 3 transmits the same space configuration file to the client 1b as the space configuration file transmitted to the client 1a.

  Next, the server 3 receives the video ID from the client 1b (S213), and stores the received video ID in association with the user ID (S214).

  For example, when the server 3 receives the video ID “E401” from the client 1b, the server 3 stores the video ID “E401” in the video ID field F405 of the record R402 of the table T401.

  Next, the server 3 transmits video information such as a video file corresponding to the video ID to the client 1b (S215).

  The server 3 compares the space ID received from the client 1a and stored in step S202 with the space ID received from the client 1b and stored in step S210, received from the client 1a, and stored in step S206. The video ID is compared with the video ID received from the client 1b and stored in step S214 (S216).

  Only when both space IDs are the same and both video IDs are the same, the first avatar configuration information is transmitted to the client 1b, and the second avatar configuration information is transmitted to the client 1a. Accordingly, the first avatar that is the own avatar and the second avatar of the client 1b can be displayed on the display means of the client 1a, and the second avatar that is the own avatar and the client 1a are displayed on the display means of the client 1b. The first avatar can be displayed.

  In the example of the table T401, the record R401 has the same space ID and video ID as the record R402. The record R403 matches the video ID, but does not match the space ID. The record R404 matches the space ID, but does not match the video ID. Therefore, the first avatar configuration information is not transmitted to clients other than the client 1b, and the second avatar configuration information is not transmitted to clients other than the client 1a.

  Thereafter, as shown in steps S119 to S125 of the first embodiment, the server 3 periodically receives and stores the position information of each avatar from each client, and receives the same space and the same video. Transfer the location information to the client. Furthermore, as shown in steps S127 to S134 of the third embodiment, the server 3 receives speech information of each avatar from each client as needed, records a chat log, and receives the same space and the same video. Forward the message information to other clients.

  According to the fourth embodiment, in addition to the effects of the first to third embodiments, the avatars who have selected the same image in the same space record what kind of conversation while watching which image is recorded in the log file. can do.

  According to the fourth embodiment, a movie preview can be held in the 3D space. Since the preview participants do not need to move in the real space, remote residents who could not participate in the conventional preview in the real space can easily participate in the preview held in the 3D space. be able to. For this reason, if it is a preview that is held in 3D space, it is easy to recruit participants from all over Japan, and there are very few opportunities to participate in the preview that was held in the actual space. You can get the impressions and reactions of residents on the islands.

  In addition, it is usually forbidden to speak during the screenings in the real space, and after the preview, the participants were asked to answer the questionnaire to obtain information. For this reason, there are many cases where each participant's answer is a vague impression of the whole movie, or it is not clear which scene the answer is. However, in the preview held in 3D space, it is not necessary to prohibit other participants from chatting, so it is not necessary to prohibit remarks during the screening. For this reason, participants can chat freely in real time even during the screening, and by recording the chat content in sequence, it is possible to accurately identify what each participant had for each scene. Can be acquired. And by analyzing such impressions, it becomes possible to decide the promotion policy after the preview and before the opening.

  Moreover, it is preferable to set conditions for presenting the video file as a selection candidate for each video file, and to determine whether to present each video file as a selection candidate or not based on the basic information of each user.

  For example, as shown in a table T431 in FIG. 12C, an age restriction field F435 is provided, and the age restriction is “present” for the video file corresponding to the video ID “E402”. In addition, it is assumed that “age: 18” is recorded in the user basic information of the client 1a. In such a case, when the server 3 receives the space ID “K401” from the client 1a in step S201, only the video files corresponding to the video IDs “E401” and “E403” are displayed as selection candidates in step S203. The video file corresponding to the video ID “E402” is changed so as not to be displayed as a selection candidate, and then the space configuration file “401.html” is transmitted to the client 1a.

  On the other hand, it is assumed that “year: 22” is recorded in the user basic information of the client 1b. In such a case, when the server 3 receives the space ID “K401” from the client 1b in step S209, in step S211, the server 3 receives not only the video files corresponding to the video IDs “E401” and “E403” but also the video ID “ The spatial configuration file “401.html” is transmitted to the client 1a while the video file corresponding to E402 ″ is also displayed as a selection candidate.

  By doing so, it becomes possible to transmit to the client a spatial configuration file in which only an appropriate video file can be selected from many selection candidates. By narrowing selection candidates in advance based on attributes such as the user's age in this way, titles of video files that the user should not select are no longer displayed. In addition, by changing the display order of the selection candidates, such as displaying the title of a video file for a specific gender and age group based on the gender and age of the user, the effort when the user selects a video title can be reduced. It is reduced.

It is a figure which shows the whole structure of the client server system used by this embodiment. It is a block diagram which shows the internal structure of the server used by this embodiment. (A) And (b) shows the conceptual diagram of 3D space displayed on the display means of each client 1. FIG. (A) And (b) shows the conceptual diagram of 3D space displayed on the display means of each client 1. FIG. (A) is a figure which shows an example of a user space table, (b) is a figure which shows an example of a space image table, (c) And (d) is a figure which shows an example of an avatar position table. It is a figure which shows an example of a user management information file. It is a sequence diagram which shows the flow of the process in the server regarding space ID comparison, and the information transmitted / received between a server and a client. It is a sequence diagram which shows the flow of the process in the server regarding positional information transmission / reception, and the information transmitted / received between a server and a client. 9 is an example of a table that stores time, space ID, position, viewpoint center, line-of-sight direction, and viewing angle in the second embodiment. It is a sequence diagram which shows the flow of the process in the server regarding speech information transmission / reception, and the data and information which are transmitted / received between a server and a client. It is a sequence diagram which shows the flow of the process in the server regarding a video ID comparison process, and the data and information which are transmitted / received between a server and a client. It is an example of a table showing a correspondence relationship between a space ID and a video ID, conditions for each video ID, and the like. It is a figure for demonstrating a viewpoint center coordinate and a viewing angle.

Explanation of symbols

301 ... Main control unit (CPU)
303 ... Storage device 305 ... Input / output control unit 307 ... Transmission / reception unit 311 ... 3D space display file 313 ... Movie file 317 ... Chat log file 319 ... User management information file

Claims (15)

A server computer capable of transmitting and receiving data to and from the first and second client computers;
Storing a space ID, space configuration information corresponding to the space ID, and video information;
When the space ID and the first position information of the first avatar are received from the first client computer, the first user ID of the first user, the space ID, the first position information, and the first time information are associated with each other. And storing the first location information to the second client computer,
When the space ID and the second position information of the second avatar are received from the second client computer, the second user ID of the second user, the space ID, the second position information, and the second time information are associated with each other. The avatar information transmitting / receiving method of storing and transmitting the second position information to the first client computer. When the server computer further receives the first line-of-sight information of the first avatar from the first client computer, the server computer stores the first user ID and the first line-of-sight information in association with each other to the second client computer. Send first line of sight information,
When the second line-of-sight information of the second avatar is received from the second client computer, the second user ID and the second line-of-sight information are stored in association with each other, and the second line-of-sight information is transmitted to the first client computer. The avatar information transmitting / receiving method according to claim 1. When the server computer further receives the first message information of the first avatar from the first client computer, the server computer stores the first user ID and the first message information in association with each other, and stores the first message information in the second client computer. Send the first message information,
When the second message information of the second avatar is received from the second client computer, the second user ID and the second message information are stored in association with each other, and the second message information is transmitted to the first client computer. The avatar information transmission / reception method according to claim 1 or 2. The server computer further comprises:
A plurality of video IDs and a plurality of the video information are stored in association with one space ID,
Upon receiving the space ID from the first client computer, the plurality of video IDs associated with the space ID are transmitted as selection candidates to the first client computer, and the video selected from the selection candidates Upon receiving the ID from the first client computer, the video information associated with the selected video ID is transmitted to the first client computer,
Upon receiving the space ID from the second client computer, the plurality of video IDs associated with the space ID are transmitted as selection candidates to the second client computer, and the video selected from the selection candidates The avatar information transmission / reception according to any one of claims 1 to 3, wherein when receiving an ID from the second client computer, the video information associated with the selected video ID is transmitted to the second client computer. Method. The server computer further stores first and second user attribute information in association with the first and second user IDs, and stores target user conditions in association with the video information;
When the space ID is received from the first client computer, the target user condition is satisfied by comparing the target user condition of the plurality of video IDs associated with the space ID with the first user attribute information. Only the selected video ID is transmitted as the selection candidate to the first client computer,
When the space ID is received from the second client computer, the target user condition is satisfied by comparing the target user condition of the plurality of video IDs associated with the space ID with the second user attribute information. The avatar information transmitting / receiving method according to claim 4, wherein only the video ID that has been set is transmitted as the selection candidate to the second client computer. A server computer capable of transmitting and receiving data to and from the first and second client computers;
Storing space ID, space configuration information corresponding to the space ID, and video information;
When the space ID and the first position information of the first avatar are received from the first client computer, the first user ID of the first user, the space ID, the first position information, and the first time information are associated with each other. Storing the first position information to the second client computer;
When the space ID and the second position information of the second avatar are received from the second client computer, the second user ID of the second user, the space ID, the second position information, and the second time information are associated with each other. An avatar information transmission / reception program for storing and transmitting the second position information to the first client computer. When the server computer further receives the first line-of-sight information of the first avatar from the first client computer, the server computer stores the first user ID and the first line-of-sight information in association with each other, and the second client computer stores the first line-of-sight information. Send the first line-of-sight information,
When the second line-of-sight information of the second avatar is received from the second client computer, the second user ID and the second line-of-sight information are stored in association with each other, and the second line-of-sight information is transmitted to the first client computer. The avatar information transmitting / receiving program according to claim 6. When the server computer further receives the first message information of the first avatar from the first client computer, the server computer stores the first user ID and the first message information in association with each other, and the second client computer stores the first message information. Send 1 remark information,
When the second message information of the second avatar is received from the second client computer, the second user ID and the second message information are stored in association with each other, and the second message information is transmitted to the first client computer. The avatar information transmission / reception program according to claim 6 or 7. In addition to the server computer,
A plurality of video IDs and a plurality of the video information are stored in association with one space ID,
Upon receiving the space ID from the first client computer, the plurality of video IDs associated with the space ID are transmitted as selection candidates to the first client computer, and the video selected from the selection candidates When the ID is received from the first client computer, the first client computer is caused to transmit the video information associated with the selected video ID,
When the space ID is received from the second client computer, a plurality of the video IDs associated with the space ID are transmitted as selection candidates to the second client computer, and the video selected from the selection candidates The avatar information transmission / reception according to any one of claims 6 to 8, wherein when the ID is received from the second client computer, the video information associated with the selected video ID is transmitted to the second client computer. program. The server computer further stores the first and second user attribute information in association with the first and second user IDs, and stores the target user condition in association with each of the video information,
When the space ID is received from the first client computer, the target user condition of the plurality of video IDs associated with the space ID is compared with the first user attribute information, and the target user condition is satisfied. And sending only the video ID as the selection candidate to the first client computer,
When the space ID is received from the second client computer, the target user condition of the plurality of video IDs associated with the space ID is compared with the second user attribute information, and the target user condition is satisfied. The avatar information transmission / reception program according to claim 9, wherein only the video ID is transmitted to the second client computer as the selection candidate. Storage means for storing a space ID, space configuration information corresponding to the space ID, and video information;
Receiving means for receiving the space ID and the first position information of the first avatar from the first client computer, and receiving the space ID and the second position information of the second avatar from the second client computer;
Transmitting means for transmitting the second position information to the first client computer and transmitting the first position information to the second client computer;
When the receiving unit receives the space ID and the first location information from the first client computer, the storage unit stores the first user ID, the space ID, the first location information, and the first location information of the first user. 1 time information is associated and stored, and the transmission means transmits the first location information to the second client computer,
When the receiving unit receives the space ID and the second location information from the second client computer, the storage unit stores the second user ID, the space ID, the second location information, and the second location information of the second user. An avatar information transmitting / receiving apparatus comprising: control means for storing two-time information in association with each other, and causing the transmission means to transmit the second position information to the first client computer. When the receiving means receives the first line-of-sight information of the first avatar from the first client computer, the control means associates the first user ID and the first line-of-sight information with the storage means. Storing, causing the transmission means to transmit the second line-of-sight information to the first client computer,
When the receiving means receives the second line-of-sight information of the second avatar from the second client computer, the storage means associates and stores the second user ID and the second line-of-sight information, and the transmitting means The avatar information transmitting / receiving apparatus according to claim 11, wherein the first line-of-sight information is transmitted to the second client computer. The control means further stores the first user ID and the first message information in association with each other when the receiving means receives the first message information of the first avatar from the first client computer. And causing the transmission means to transmit the second message information to the first client computer,
When the receiving means receives the second speech information of the second avatar from the second client computer, the storage means associates and stores the second user ID and the second speech information, and the transmitting means The avatar information transmitting / receiving apparatus according to claim 11, wherein the first utterance information is transmitted to the second client computer. The control means further includes
The storage means stores a plurality of video IDs and a plurality of the video information in association with one space ID,
When the reception unit receives the space ID from the first client computer, the transmission unit causes the plurality of video IDs associated with the space ID to be transmitted as selection candidates to the first client computer, and When receiving means receives the video ID selected from the selection candidates from the first client computer, the transmitting means associates the selected video ID with the selected video ID to the first client computer. Send video information,
When the receiving unit receives the space ID from the second client computer, the transmitting unit causes the plurality of video IDs associated with the space ID to be transmitted as selection candidates to the second client computer, and When the receiving unit receives the video ID selected from the selection candidates from the second client computer, the receiving unit transmits the video information associated with the selected video ID to the second client computer. The avatar information transmitting / receiving apparatus according to any one of claims 11 to 13. The control means further comprises a comparison means,
The storage means stores the first and second user attribute information in association with the first and second user IDs respectively, and stores the target user condition in association with each of the video information,
When the receiving unit receives the space ID from the first client computer, the comparing unit receives the target user condition of the plurality of video IDs associated with the space ID and the first user attribute information. Let the transmission means transmit only the video ID that satisfies the target user condition as the selection candidate to the first client computer,
When the receiving means receives the space ID from the second client computer, the comparing means sends the target user condition and the second user attribute information of the plurality of video IDs associated with the space ID. The avatar information transmitting / receiving apparatus according to claim 14, wherein the avatar information transmitting / receiving apparatus causes the transmitting unit to transmit only the video ID satisfying the target user condition as the selection candidate to the second client computer.

Images