JP3122576B2 - 3D virtual space sharing device - Google Patents
3D virtual space sharing deviceInfo
- Publication number
- JP3122576B2 JP3122576B2 JP06079994A JP7999494A JP3122576B2 JP 3122576 B2 JP3122576 B2 JP 3122576B2 JP 06079994 A JP06079994 A JP 06079994A JP 7999494 A JP7999494 A JP 7999494A JP 3122576 B2 JP3122576 B2 JP 3122576B2
- Authority
- JP
- Japan
- Prior art keywords
- user
- virtual space
- dimensional virtual
- terminal
- face image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Lifetime
Links
Description
【０００１】[0001]
【産業上の利用分野】本発明は、利用者が自分の意志で
自由に移動できるような３次元仮想空間と当該３次元仮
想空間内に他の利用者の分身とを表現できる端末を複数
台、通信網を介してスター型に接続し、端末から受信し
た利用者の顔映像と３次元仮想空間内の位置情報とを他
の端末に分配することによって、複数の利用者が同一の
３次元仮想空間を遠隔地で共有し、各利用者端末に他の
利用者の顔映像がマッピングされた分身を表現できる仮
想空間共有技術に関するものである。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move on his / her own will and an alter ego of another user in the three-dimensional virtual space. A plurality of users can connect to the same three-dimensional network by connecting to a star through a communication network and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals. The present invention relates to a virtual space sharing technology capable of sharing a virtual space at a remote place and expressing an alter ego in which a face image of another user is mapped to each user terminal.
【０００２】[0002]
【従来の技術】一般に複数の端末間で映像を相互に送り
あう場合、使用するネットワークによっていくつかの方
式がある。2. Description of the Related Art In general, there are several methods for mutually transmitting images between a plurality of terminals, depending on the network used.
【０００３】（１）ＬＡＮ（例えばイーサネット）を使
用する場合 （ａ）論理的メッシュ接続方式 本方式は、端末間を論理的にメッシュ接続する方式であ
る。そのトポロジを図７に示す。本方式では、各端末１
が自分の映像をパケット化し、相手の端末１の宛先を指
定して、接続端末数分コピーして送信する。同時に通信
する端末１の台数をｎ、映像の単位時間当たりのデータ
量をｍとすると、端末１から見て送信用の必要回線容
量、受信用の必要回線容量は共に、ｍ×（ｎ−１）であ
る。本方式は一番簡易な方式であり、同時に通信する端
末１の台数がＬＡＮ２の輻輳のない範囲なら本メッシュ
構成で問題はない。(1) When a LAN (for example, Ethernet) is Used (a) Logical Mesh Connection Method This method is a method for logically mesh-connecting terminals. FIG. 7 shows the topology. In this method, each terminal 1
Packetizes its own video, designates the destination of the partner terminal 1, and copies and transmits the same number of connected terminals. Assuming that the number of terminals 1 communicating at the same time is n and the data amount of video per unit time is m, both the required line capacity for transmission and the required line capacity for reception are m × (n−1). ). This method is the simplest method, and there is no problem in the present mesh configuration as long as the number of terminals 1 communicating at the same time is within a range where the LAN 2 is not congested.
【０００４】（ｂ）論理的スター接続方式 輻輳を緩和する方式として、端末間を論理的にスター接
続する方式がある。そのトポロジを図８に示す。本方式
は、ＬＡＮ２に映像サーバ３を設けて、各端末１が自分
の映像を映像サーバ３に送信し、映像サーバ３が他の端
末１に分配する方式である。本方式では、端末１から見
て送信用の必要回線容量はｍで、受信用の必要回線容量
はｍ×（ｎ−１）となり、上記メッシュ接続方式より輻
輳を緩和できる。(B) Logical star connection method As a method for alleviating congestion, there is a method in which terminals are logically star connected. FIG. 8 shows the topology. This method is a method in which a video server 3 is provided on the LAN 2, each terminal 1 transmits its own video to the video server 3, and the video server 3 distributes the video to other terminals 1. In this method, the required line capacity for transmission is m and the required line capacity for reception is m × (n−1) as seen from the terminal 1, and congestion can be reduced more than in the mesh connection method.
【０００５】（２）公衆網（例えばＩＮＳ６４）を使用
する場合 （ａ）物理的メッシュ接続方式 本方式は、公衆網により端末間を物理的にメッシュ接続
する方式である。そのトポロジを図９に示す。本方式で
は、各端末１がｎ−１本の回線５を収容し、自分の映像
をパケット化して接続端末数分コピーし、公衆網４の回
線５に送信する。本方式では、接続端末数分の回線５を
使用するので、輻輳は問題にはならない （ｂ）物理的スター接続方式 収容回線を減らす方式として、公衆網により端末間を物
理的にスター接続する方式がある。そのトポロジを図１
０に示す。本方式では、映像サーバ３を設けて、各端末
１は回線５と公衆網４を通して自分の映像を映像サーバ
３に送信し、映像サーバ３が他の端末１に公衆網４を通
して分配する方式である。本方式では各端末は１回線で
よい。しかし、公衆網４では上りと下りの回線容量は同
一で、たとえばＩＮＳ６４では６４ｋｂｉｔ／秒である
ので、端末１から６４ｋｂｉｔ／秒の映像を映像サーバ
３に送ると、映像サーバ３は６４×（ｎ−１）ｋｂｉｔ
／秒の下りの回線容量が必要になり、送信できないとい
う問題が生じる。この問題を回避するには、下りの回線
容量が６４ｋｂｉｔ／秒となるように、上りの映像のデ
ータ量を減らす方法がある。例えば、９台の端末１が同
時接続されている場合、各端末１は６４÷（９−１）＝
８ｋｂｉｔ／秒の映像を映像サーバ３に送る。映像サー
バ３は他の８台の端末１から受信した８ｋｂｉｔ／秒の
映像をパケット多重して８×８＝６４ｋｂｉｔ／秒のデ
ータを各端末１に送信する。(2) When using a public network (for example, INS64) (a) Physical mesh connection method This method is a method in which terminals are physically mesh-connected by a public network. FIG. 9 shows the topology. In this system, each terminal 1 accommodates n-1 lines 5, packetizes its own video, copies the number of connected terminals, and transmits it to the line 5 of the public network 4. In this method, congestion is not a problem because the number of lines 5 is equal to the number of connected terminals. (B) Physical star connection method As a method for reducing the number of accommodated lines, a method in which terminals are physically star-connected by a public network. There is. Figure 1 shows the topology
0 is shown. In this method, a video server 3 is provided, and each terminal 1 transmits its own video to the video server 3 through the line 5 and the public network 4, and the video server 3 distributes the video to other terminals 1 through the public network 4. is there. In this method, each terminal may be one line. However, in the public network 4, the uplink and downlink line capacities are the same, for example, INS64 is 64 kbit / sec. Therefore, when the terminal 1 sends a 64 kbit / sec video to the video server 3, the video server 3 receives 64 × (n -1) kbit
/ S requires a downstream line capacity, and the transmission cannot be performed. In order to avoid this problem, there is a method of reducing the data amount of the upstream video so that the downstream channel capacity is 64 kbit / sec. For example, when nine terminals 1 are connected simultaneously, each terminal 1 has 64 ÷ (9-1) =
The video of 8 kbit / sec is sent to the video server 3. The video server 3 packet-multiplexes 8 kbit / sec video received from the other eight terminals 1 and transmits data of 8 × 8 = 64 kbit / sec to each terminal 1.
【０００６】[0006]
【発明が解決しようとする課題】複数の端末間で相互に
映像を送り合う上記従来の方式では、それぞれ、以下の
ような問題点があった。In the above-mentioned conventional systems in which a plurality of terminals mutually transmit images, there are the following problems, respectively.
【０００７】（１）ＬＡＮ（例えばイーサネット）を使
用する場合 （ａ）論理的メッシュ接続方式 本方式は一番簡易な方式であり、先に述べたとおり同時
に通信する端末の台数がＬＡＮが輻輳しない範囲なら本
メッシュ構成で問題はない。しかし、端末数が多くなる
と輻輳が問題になる。(1) In the case of using a LAN (for example, Ethernet) (a) Logical mesh connection method This method is the simplest method, and as described above, the number of terminals communicating simultaneously does not cause congestion in the LAN. There is no problem with this mesh configuration within the range. However, as the number of terminals increases, congestion becomes a problem.
【０００８】（ｂ）論理的スター接続方式 本方式は、上記メッシュ接続方式より輻輳を緩和でき
る。しかし、接続端末数がさらに増えて、ＬＡＮの輻輳
が問題になる場合には、本スター接続方式でも解決でき
ないという問題がある。(B) Logical star connection method This method can reduce congestion more than the mesh connection method. However, when the number of connected terminals is further increased and congestion of the LAN becomes a problem, there is a problem that the present star connection method cannot solve the problem.
【０００９】（２）公衆網（例えばＩＮＳ６４）を使用
する場合 （ａ）物理的メッシュ接続方式 本方式は接続端末数分の回線を使用するので、輻輳は問
題にはならないが、通信料が収容回線数に比例して高く
なるので、端末数が多くなると実用的でない。(2) When a public network (for example, INS64) is used (a) Physical mesh connection method Since this method uses lines for the number of connection terminals, congestion does not matter, but communication charges are accommodated. Since the number increases in proportion to the number of lines, it is not practical if the number of terminals increases.
【００１０】（ｂ）物理的スター接続方式 この方式では、接続端末数が増えるにつれて映像の品質
が画一的に劣化するとう問題がある。(B) Physical star connection method In this method, there is a problem that the image quality is uniformly degraded as the number of connected terminals increases.
【００１１】本発明は、上記の問題点を解決するために
なされたものであり、その目的は、接続端末数が多い場
合に有利なスター接続型の映像サーバにおいて、各端末
から受信した顔画像を他の端末に分配する時に、映像品
質の画一的な劣化を生じることなく、経済的に公衆網に
適用可能とし、ＬＡＮ等における網輻輳を回避すること
にある。SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and an object of the present invention is to provide a star connection type video server which is advantageous when the number of connected terminals is large. Is to economically apply to a public network without causing a uniform deterioration in video quality when distributing to other terminals, and to avoid network congestion in a LAN or the like.
【００１２】[0012]
【課題を解決するための手段】上記の目的を達成するた
め、請求項１の発明では、利用者が自分の意志で自由に
移動できるような３次元仮想空間と当該３次元仮想空間
内に他の利用者の分身とを表現できる端末を複数台、通
信網を介してスター型に接続し、前記端末から受信した
利用者の顔映像と前記３次元仮想空間内の位置情報とを
他の端末に分配することによって、複数の利用者が同一
の３次元仮想空間を遠隔地で共有できる３次元仮想空間
共有装置であって、端末から受信する各利用者の分身の
位置情報から顔映像の分配先利用者と他の利用者との３
次元仮想空間内の距離を計算する手段と、前記距離が近
い利用者の顔映像から順に解像度もしくはフレーム数ま
たはそれら両方を多く割り当てて前記顔映像の分配先利
用者の端末に送信する手段と、を有することを特徴とす
る３次元仮想空間共有装置を手段とする。In order to achieve the above object, according to the first aspect of the present invention, there is provided a three-dimensional virtual space in which a user can freely move by his / her own will and another three-dimensional virtual space in the three-dimensional virtual space. A plurality of terminals capable of expressing the alter ego of the user are connected in a star through a communication network, and the face image of the user received from the terminal and the positional information in the three-dimensional virtual space are transmitted to another terminal. Is a three-dimensional virtual space sharing device that allows a plurality of users to share the same three-dimensional virtual space at a remote location by distributing the facial images from the positional information of each user's alter ego received from the terminal. 3 between the first user and other users
Means for calculating a distance in the three-dimensional virtual space, and means for allocating a large number of resolutions or the number of frames in order from the face image of the user whose distance is short, and transmitting both to the terminal of the distribution destination user of the face image, A three-dimensional virtual space sharing apparatus characterized by having:
【００１３】また、請求項２の発明では、利用者が自分
の意志で自由に移動できるような３次元仮想空間と当該
３次元仮想空間内に他の利用者の分身とを表現できる端
末を複数台、通信網を介してスター型に接続し、前記端
末から受信した利用者の顔映像と前記３次元仮想空間内
の位置情報とを他の端末に分配することによって、複数
の利用者が同一の３次元仮想空間を遠隔地で共有できる
３次元仮想空間共有装置であって、端末から受信する各
利用者の分身の位置情報から顔映像の分配先利用者と他
の利用者との３次元仮想空間内の視線の一致度を計算す
る手段と、前記視線の一致度が大きい利用者の顔映像か
ら順に解像度もしくはフレーム数またはそれら両方を多
く割り当てて前記顔映像の分配先利用者の端末に送信す
る手段と、を有することを特徴とする３次元仮想空間共
有装置を手段とする。[0013] In the invention of claim 2, a plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at his / her own will and an alter ego of another user in the three-dimensional virtual space are provided. A plurality of users are connected in the form of a star via a communication network and distribute the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals so that a plurality of users Is a three-dimensional virtual space sharing device capable of sharing a three-dimensional virtual space at a remote place, and a three-dimensional virtual space sharing device between a destination user of a face image and another user based on positional information of each user's alter ego received from a terminal. Means for calculating the degree of coincidence of the line of sight in the virtual space, and assigning a larger resolution or number of frames or both in order from the face image of the user with the higher degree of coincidence of the line of sight to the terminal of the distribution destination user of the face image Means for transmitting And means a three-dimensional virtual space sharing apparatus characterized by.
【００１４】また、請求項３の発明では、利用者が自分
の意志で自由に移動できるような３次元仮想空間と当該
３次元仮想空間内に他の利用者の分身とを表現できる端
末を複数台、通信網を介してスター型に接続し、前記端
末から受信した利用者の顔映像と前記３次元仮想空間内
の位置情報とを他の端末に分配することによって、複数
の利用者が同一の３次元仮想空間を遠隔地で共有できる
３次元仮想空間共有装置であって、端末から受信する各
利用者の分身の位置情報から顔映像の分配先利用者と他
の利用者との３次元仮想空間内の距離と視線の一致度を
計算する手段と、前記距離と視線の一致度の両方を評価
してその評価が高い利用者の顔映像から順に解像度もし
くはフレーム数またはそれら両方を多く割り当てて前記
顔映像の分配先利用者の端末に送信する手段と、を有す
ることを特徴とする３次元仮想空間共有装置を手段とす
る。[0014] In the invention of claim 3, a plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at his / her own will and an alter ego of another user in the three-dimensional virtual space are provided. A plurality of users are connected in the form of a star via a communication network and distribute the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals so that a plurality of users Is a three-dimensional virtual space sharing device capable of sharing a three-dimensional virtual space at a remote place, and a three-dimensional virtual space sharing device between a destination user of a face image and another user based on positional information of each user's alter ego received from a terminal. Means for calculating the degree of coincidence between the distance and the line of sight in the virtual space, and assigning a larger number of resolutions or frame numbers or both in order from the face video of the user with the higher evaluation by evaluating both the degree of coincidence between the distance and the line of sight Of the face image And means a three-dimensional virtual space sharing apparatus characterized by having a means for transmitting to the user terminal.
【００１５】さらに、請求項４の発明では、上記の３次
元仮想空間共有装置において、送信する手段が、距離の
評価値として該距離に逆比例する値を与え視線一致度の
評価値として視線の角度に逆比例するような値を与えそ
れらの評価値の積が大きい利用者の顔映像から順に解像
度もしくはフレーム数またはそれら両方を多く割り当て
て顔映像の分配先利用者の端末に送信するものであるこ
とを特徴とする３次元仮想空間共有装置を手段とする。Further, in the invention according to claim 4, in the three-dimensional virtual space sharing apparatus, the transmitting means gives a value inversely proportional to the distance as an evaluation value of the distance, and obtains an evaluation value of the line of sight as the evaluation value of the eye-gaze coincidence. A value that is inversely proportional to the angle is given, and the resolution and / or the number of frames or both are assigned to the user's face image in order from the user whose face value is larger and the product is transmitted to the terminal of the user to whom the face image is distributed. A three-dimensional virtual space sharing apparatus characterized in that there is a means.
【００１６】[0016]
【作用】本発明では、接続端末数が多い場合に網輻輳の
点で有利なスター接続型とし、各端末から受信した映像
と３次元仮想空間内の位置情報を他の端末に分配する時
に、端末から受信する各利用者の分身の位置情報から、
顔映像の分配先利用者と他の利用者との仮想空間内の距
離と視線の一致度を計算し、距離が近く、もしくは視線
の一致度が大きい、またはそれら両方が大きい利用者の
顔映像から順に、解像度やフレーム数を多く割り当てる
ような間引き処理を適用することにより、例えば、自分
との距離が近い人により品質のよい映像を与えて、距離
が遠い人の映像の品質を下げたり、また自分の方を向い
ている人に品質のよい映像を与えて、自分の方を向いて
いない人の映像の品質を下げたりすることで、映像品質
の画一的な劣化を生じさせることなく、経済的に公衆網
に適用可能とし、ＬＡＮ等における網輻輳を回避する。According to the present invention, when the number of connected terminals is large, the star connection type is advantageous in terms of network congestion, and when the video received from each terminal and the position information in the three-dimensional virtual space are distributed to other terminals, From the location information of each user's alter ego received from the terminal,
Calculates the distance between the user to whom the face image is to be distributed and the other user in the virtual space and the degree of coincidence of the line of sight, and the face image of the user whose distance is close, the degree of coincidence of the line of sight is large, or both are large. By applying a thinning process such as assigning a large number of resolutions or frames in order from the beginning, for example, by giving a better quality image to a person who is closer to yourself, reducing the quality of the image of a person who is farther away, Also, by giving high-quality images to people who are facing you and reducing the quality of images of people who are not facing you, without causing uniform degradation of image quality It is economically applicable to a public network and avoids network congestion in a LAN or the like.
【００１７】[0017]
【実施例】本発明の実施例を図１、図２、図３、図４、
図５、図６に示す。FIG. 1, FIG. 2, FIG. 3, FIG.
These are shown in FIGS.
【００１８】すべての端末は仮想空間を共有するものと
する。そのために、例えば、各端末で同一のソフトウェ
アを用いるなどして、同一の仮想空間モデルを保有す
る。各利用者は、マウスなどを用いてオブジェクトを操
作することで自分の意志で自由に仮想空間内を移動で
き、顔の向きを設定できる。他の利用者も同じ仮想空間
内を移動し顔の向きを設定できるので、それを認知する
ため、映像サーバとして仮想空間共有装置を設け、各端
末を接続端末数が多い場合に網輻輳の点で有利なスター
型に接続し、３次元仮想空間内に各端末の利用者の分身
を用意する。各利用者は、ビデオカメラで撮影した自分
の顔映像と位置情報（仮想空間内の位置座標と顔の向
き）を常時送信する。３次元仮想空間共有装置は、受信
した各利用者の位置情報から、仮想空間内の該当位置に
当該利用者の分身を移動させ、当該利用者の映像を顔の
向きを考慮して分身にマッピングする。仮想空間共有装
置は、各端末へ、その端末以外の他の端末の仮想空間内
での位置情報と顔画像を分配する時、顔画像に関して、
当該端末とそれ以外の端末との距離およびその分身の視
線の一致度に応じて特殊な間引き処理を用い、フレーム
数や解像度を変えることにより、映像品質を画一的に劣
化させることなく他の端末の顔画像の分配を行う。It is assumed that all terminals share a virtual space. For this purpose, each terminal has the same virtual space model by using the same software, for example. Each user can freely move in the virtual space by himself / herself by operating the object using a mouse or the like, and can set the direction of the face. Since other users can move in the same virtual space and set the direction of the face, a virtual space sharing device is provided as a video server to recognize this, and if each terminal has a large number of connected terminals, network congestion points To create an advantageous star type, and prepare a copy of the user of each terminal in the three-dimensional virtual space. Each user always transmits his / her own face image captured by a video camera and position information (position coordinates in virtual space and face direction). The three-dimensional virtual space sharing apparatus moves the alter ego of the user to a corresponding position in the virtual space from the received position information of each user, and maps the image of the user to the alter ego in consideration of the face direction. I do. The virtual space sharing apparatus distributes, to each terminal, position information and a face image in a virtual space of another terminal other than the terminal,
By using a special thinning process according to the distance between the terminal and other terminals and the degree of coincidence of the line of sight of the alternation, and by changing the number of frames and resolution, the other Distribute the face image of the terminal.
【００１９】本実施例では、通信網としてＩＮＳ６４を
例にとり、全部で５人の利用者が同一の仮想空間を共有
する場合について説明する。ＩＮＳ６４の伝送ビットレ
ートは上り下りとも６４ｋｂｉｔ／秒である。各利用者
は自分の映像をビデオカメラで撮影し、パケット化して
６４ｋｂｉｔ／秒で仮想空間共有装置に送信する。仮想
空間共有装置は各端末に対して、送信先の利用者以外の
４人分の映像をパケット多重して送信するが、このまま
では６４ｋｂｉｔ／秒×４＝２５６ｋｂｉｔ／秒とな
り、下りの回線容量６４ｋｂｉｔ／秒を越えてしまう。
そこで、４人分の映像パケットの合計が６４ｋｂｉｔ／
秒になるように間引き処理を行う。間引き処理として、
送信先の利用者と他の利用者との距離、視線の一致度を
利用する。In this embodiment, a case will be described in which INS 64 is used as an example of a communication network, and a total of five users share the same virtual space. The transmission bit rate of INS64 is 64 kbit / sec for both uplink and downlink. Each user captures his or her own video with a video camera, packetizes the video, and transmits the packet to the virtual space sharing device at 64 kbit / sec. The virtual space sharing apparatus transmits to each terminal four packets of video other than the transmission destination user by packet multiplexing. In this state, 64 kbit / sec × 4 = 256 kbit / sec, and the downstream line capacity is 64 kbit. Per second.
Therefore, the total of the video packets for four people is 64 kbit /
Perform the thinning process so that it becomes seconds. As a thinning process,
The distance between the user of the transmission destination and another user and the degree of matching of the line of sight are used.
【００２０】図１は仮想空間内の自分と他の利用者との
距離を４段階に分ける例を示している。自分からの距離
が近い利用者から順に、４，３，２，１の値を与える。
これは距離に逆比例するような評価値を与える例である
が、自分と他の利用者の距離の二乗に逆比例するような
評価値を与えても良い。FIG. 1 shows an example in which the distance between oneself and another user in the virtual space is divided into four stages. The values of 4, 3, 2, and 1 are given in order from the user whose distance from the user is short.
Although this is an example of giving an evaluation value that is inversely proportional to the distance, an evaluation value that is inversely proportional to the square of the distance between the user and another user may be given.
【００２１】図２は、自分の視線の向きに対して他の利
用者の顔の向きを４段階に分ける例を示している。自分
の視線と他の利用者の視線に重なりがある場合には、そ
の利用者に値３を与える。重なりがない場合には、他の
利用者の視線を回転させる。FIG. 2 shows an example in which the direction of the face of another user is divided into four stages with respect to the direction of the line of sight. If the user's line of sight and the line of sight of another user overlap, a value of 3 is given to that user. If there is no overlap, the gaze of another user is rotated.
【００２２】図３は、ある２人の利用者を上から見た図
で、上記の４段階により視線一致度を評価する一例を示
す図である。本例では、着目する利用者Ｕ１の視野角を
α、他の利用者Ｕ２の視野角をβとした場合、利用者Ｕ
１の顔が利用者Ｕ２の視野に入るまで、利用者２の顔の
向きを回転させ、その回転角θの大小により、回転角が
０＜θ≦４５度なら値２を、４５＜θ≦９０度なら値１
を、９０度＜θ＜１８０度なら値０を与える。FIG. 3 is a diagram showing two users viewed from above, and is a diagram showing an example of evaluating the degree of eye-gaze coincidence according to the above four steps. In this example, when the viewing angle of the user U1 of interest is α and the viewing angles of the other users U2 are β,
The direction of the face of the user 2 is rotated until the face of the user 1 enters the visual field of the user U2, and the value 2 is set if the rotation angle is 0 <θ ≦ 45 degrees, and 45 <θ ≦ 90 degrees, value 1
, And a value 0 if 90 degrees <θ <180 degrees.
【００２３】図４は、距離と視線一致度の両方を合わせ
て評価する場合の一例を説明するための図である。自分
に対する距離と向きを上記の値の積で表した値を示して
いる。例えば、ある利用者から見た仮想空間内の他の利
用者の距離と顔の向きが図５である場合、自分からの距
離が近い人から順に、値１２，６，２，３が与えられ
る。この値で比例配分して合計が６４ｋｂｉｔ／秒にな
るようにする。すなわち、自分からの距離が近い人から
順に、 ６４×１２／（１２＋６＋２＋３）＝３３．４ｋｂｉｔ
／秒 ６４× ６／（１２＋６＋２＋３）＝１６．７ｋｂｉｔ
／秒 ６４× ２／（１２＋６＋２＋３）＝ ５．６ｋｂｉｔ
／秒 ６４× ３／（１２＋６＋２＋３）＝ ８．３ｋｂｉｔ
／秒 の伝送ビットレートを与えるように間引きする。間引き
はフレーム数／秒を減らすか、解像度を減らすか、両方
減らすかのいずれかの手段をとる。FIG. 4 is a diagram for explaining an example of a case in which both the distance and the eye-gaze coincidence are evaluated. It shows a value that represents the distance and direction to oneself by the product of the above values. For example, when the distance and the face direction of another user in the virtual space viewed from a certain user are as shown in FIG. 5, values 12, 6, 2, and 3 are given in order from a person who is closer to the user. . This value is proportionally distributed so that the total becomes 64 kbit / sec. That is, 64 × 12 / (12 + 6 + 2 + 3) = 33.4 kbit
/ Sec 64 × 6 / (12 + 6 + 2 + 3) = 16.7 kbit
/ Sec 64 × 2 / (12 + 6 + 2 + 3) = 5.6 kbit
/ Sec 64 × 3 / (12 + 6 + 2 + 3) = 8.3 kbit
Per second to provide a transmission bit rate of. Decimation either reduces the number of frames per second, reduces the resolution, or reduces both.
【００２４】図６は仮想空間共有装置の構成例を示して
いる。この構成例では簡単のため、仮想共有装置が３台
の端末を収容する場合について示している。図におい
て、１０は仮想空間共有装置、１１，１２，１３は回線
インタフェース部、１４は位置情報分配部、１５は距離
計算部、１６は視線一致度計算部、１７は映像間引き率
決定部、１８は映像間引き・分配部、１９，２３，２７
は映像受信用内部バス、２０，２４，２８は映像送信用
内部バス、２１，２５，２９は位置情報受信用内部バ
ス、２２，２６，３０は位置情報送信用内部バス、３１
は距離計算結果転送用内部バス、３２は視線一致度計算
結果転送用内部バス、３３は映像間引き率通知用内部バ
ス、３４，３５，３６は通信回線を示す。FIG. 6 shows a configuration example of the virtual space sharing apparatus. For the sake of simplicity, this configuration example shows a case where the virtual sharing apparatus accommodates three terminals. In the figure, 10 is a virtual space sharing device, 11, 12 and 13 are line interface units, 14 is a position information distribution unit, 15 is a distance calculation unit, 16 is a gaze coincidence calculation unit, 17 is a video thinning rate determination unit, 18 Are image thinning / distribution units, 19, 23, 27
Is an internal bus for receiving video, 20, 24, 28 are internal buses for transmitting video, 21, 25, 29 are internal buses for receiving positional information, 22, 26, 30 are internal buses for transmitting positional information, 31
Denotes an internal bus for transferring a distance calculation result, 32 denotes an internal bus for transferring a gaze coincidence calculation result, 33 denotes an internal bus for notifying a video thinning rate, and 34, 35, and 36 denote communication lines.
【００２５】仮想空間共有装置１０は、端末とはＩＮＳ
６４、回線３４，３５，３６を介して映像と位置情報の
送受信を行う。まず、回線３４，３５，３６から受信し
たデータは、それぞれ回線インタフェース部１１，１
２，１３で受信する。回線インタフェース部１１，１
２，１３は、受信したデータを解析し、映像であれば、
内部バス１９，２３，２７を介して映像を映像間引き・
分配部１８へ転送する。回線インタフェース部１１，１
２，１３は、受信したデータが位置情報であれば、内部
バス２１，２５，２９を介して位置情報を位置情報分配
部１４、距離計算部１５、視線一致度計算部１６へ転送
する。位置情報分配部１４は内部バス２１から受けた位
置情報をコピーして内部バス２６，３０を介して回線イ
ンタフェース部１２，１３へ転送する。また、位置情報
分配部１４は内部バス２５から受けた位置情報をコピー
して内部バス２２，３０を介して回線インタフェース部
１１，１３へ転送する。また、位置情報分配部１４は内
部バス２９から受けた位置情報をコピーして内部バス２
２，２６を介して回線インタフェース部１１，１２へ転
送する。距離計算部１５は内部バス２１，２５，２９を
介して受けた位置情報から、相互の距離ｄを計算する。
その距離が仮想空間の奥行きの長さＬと比較し、０＜ｄ
≦Ｌ／４なら値４を、Ｌ／４＜ｄ≦Ｌ／２なら値３を、
Ｌ／２＜ｄ≦３Ｌ／４なら値２を、３Ｌ／４≦ｄ≦Ｌな
ら値１を与え、内部バス３１を介して映像間引き率決定
部１７へ転送する。視線一致度計算部１６は内部バス２
１，２５，２９を介して受けた位置情報から、利用者間
の視線の交差角度θを計算する。ある一人の利用者の視
野と、他の利用者の視野に重なりがある場合にはその利
用者に値３を、重なりがない場合には、０＜θ≦４５度
なら値２を、４５度＜θ≦９０度なら値１を、９０度＜
θ＜１８０度なら値０を与え、内部バス３２を介して映
像間引き率決定部１７へ転送する。映像間引き率決定部
１７は上述した方法により、ｄとθによる値の積を求め
て転送ビットレートの配分を決定し、内部バス３３を介
して映像間引き・分配部１８へ転送する。映像間引き・
分配部１８は、内部バス２０には内部バス２３，２７か
ら受けた映像を、内部バス２４には内部バス１９，２７
から受けた映像を、内部バス２８には内部バス１９，２
３から受けた映像を、それぞれ映像間引き率決定部１７
より内部バス３３を介して受けた伝送ビットレート配分
に基づいて間引き処理を行い転送する。回線インタフェ
ース部１１，１２，１３は、内部バス２２，２６，３０
から受けた位置情報と、内部バス２０，２４，２８から
受けた映像を回線３４，３５，３６へ送出する。The virtual space sharing apparatus 10 is connected to the terminal by INS
64, transmission and reception of video and position information via the lines 34, 35, 36. First, the data received from the lines 34, 35, and 36 are transmitted to the line interface units 11, 1 respectively.
Received in 2 and 13. Line interface unit 11, 1
2 and 13 analyze the received data, and if it is a video,
The video is thinned out via the internal buses 19, 23 and 27.
Transfer to the distribution unit 18. Line interface unit 11, 1
If the received data is position information, the position information is transferred to the position information distribution unit 14, the distance calculation unit 15, and the gaze coincidence calculation unit 16 via the internal buses 21, 25, and 29. The position information distribution unit 14 copies the position information received from the internal bus 21 and transfers it to the line interface units 12 and 13 via the internal buses 26 and 30. Further, the position information distribution unit 14 copies the position information received from the internal bus 25 and transfers it to the line interface units 11 and 13 via the internal buses 22 and 30. The position information distribution unit 14 copies the position information received from the internal bus 29 and
2 and 26 to the line interface units 11 and 12. The distance calculator 15 calculates the mutual distance d from the position information received via the internal buses 21, 25, 29.
The distance is compared with the depth L of the virtual space, and 0 <d
If ≤L / 4, value 4; if L / 4 <d≤L / 2, value 3;
If L / 2 <d ≦ 3L / 4, a value of 2 is given, and if 3L / 4 ≦ d ≦ L, a value of 1 is given, and the value is transferred to the video thinning rate determination unit 17 via the internal bus 31. The line-of-sight coincidence calculating unit 16 is connected to the internal bus
From the position information received through 1, 25, and 29, the intersection angle θ of the line of sight between the users is calculated. If there is an overlap between the field of view of a certain user and the field of view of another user, the user has a value of 3; otherwise, a value of 2 if 0 <θ ≦ 45 degrees and 45 degrees. <Θ ≦ 90 degrees, value 1; 90 degrees <
If θ <180 degrees, a value of 0 is given, and the value is transferred to the video thinning rate determination unit 17 via the internal bus 32. The video thinning rate determining unit 17 determines the distribution of the transfer bit rates by calculating the product of the values of d and θ by the above-described method, and transfers the distribution to the video thinning / distributing unit 18 via the internal bus 33. Video thinning
The distribution unit 18 stores the video received from the internal buses 23 and 27 on the internal bus 20 and the internal buses 19 and 27 on the internal bus 24.
The video received from the internal bus 28 is sent to the internal buses 19 and 2.
3 from the video decimation rate determination unit 17
It performs a thinning process based on the transmission bit rate distribution received via the internal bus 33 and transfers the data. The line interface units 11, 12, and 13 are connected to the internal buses 22, 26, 30.
And the video received from the internal buses 20, 24, 28 to the lines 34, 35, 36.
【００２６】本実施例では、複数の利用者が共有できる
３次元仮想空間を対象にしており、仮想空間共有装置が
映像サーバに該当する。各利用者は自分の意志で自由に
仮想空間内を移動できるため、自分と相手の位置関係や
顔の向きが常時変化する。この位置情報を利用して自分
との距離が近い人により品質の良い映像を与えて、距離
が遠い人の映像の品質を下げたり、また自分の方を向い
ている人に品質のよい映像を与えて、自分の方を向いて
いない人の映像の品質を下げたりすることにより、映像
品質の画一的な劣化を生じさせることなく、経済的に公
衆網に適用可能とし、スター型接続と相俟ってＬＡＮ等
における網輻輳を回避する。In the present embodiment, a three-dimensional virtual space that can be shared by a plurality of users is targeted, and the virtual space sharing device corresponds to a video server. Since each user can freely move in the virtual space with his / her own will, the positional relationship between himself and the other party and the direction of his face constantly change. This location information is used to give better quality images to people who are closer to you, to reduce the quality of images for people who are farther away, and to provide better quality images to people who are facing you. By giving the image quality of a person who is not facing you to lower the quality of the image, it can be economically applied to the public network without causing a uniform deterioration of the image quality. Together, network congestion in a LAN or the like is avoided.
【００２７】[0027]
【発明の効果】以上説明したように、請求項１の発明に
よれば、接続端末数が多い場合に有利なスター接続型の
仮想空間共有装置において、各端末から受信した映像を
他の端末に分配する時に、端末から受信する各利用者の
分身の位置情報から顔映像の分配先利用者と他の利用者
との仮想空間内の距離を計算し、距離が近い利用者の顔
映像から順に、解像度、フレーム数を多く割り当てるよ
うな間引き処理を適用しているので、画一的な劣化を生
じさせることなく自分に近い利用者の顔画像ほど映像品
質の良い顔画像が得られ、経済的に公衆網に適用可能と
なり、ＬＡＮ等における網輻輳を回避することができ
る。As described above, according to the first aspect of the present invention, in a star connection type virtual space sharing apparatus advantageous when the number of connected terminals is large, a video received from each terminal is transmitted to another terminal. When distributing, the distance in the virtual space between the destination user of the face image and the other user is calculated from the position information of each user's alter ego received from the terminal, and the face images of the users whose distances are shortest in order , The resolution and the number of frames are allotted, so the face image of a user closer to the user can be obtained with better image quality without causing uniform degradation, and economical Thus, the present invention can be applied to a public network, and network congestion in a LAN or the like can be avoided.
【００２８】また、請求項２の発明によれば、接続端末
数が多い場合に有利なスター接続型の仮想空間共有装置
において、各端末から受信した映像を他の端末に分配す
る時に、端末から受信する各利用者の分身の位置情報か
ら顔映像の分配先利用者と他の利用者との視線の一致度
を計算し、視線の一致度の大きい利用者の顔映像から順
に、解像度、フレーム数を多く割り当てるような間引き
処理を適用しているので、画一的な劣化を生じさせるこ
となく自分の視線方向に近い利用者の顔画像ほど映像品
質の良い顔画像が得られ、経済的に公衆網に適用可能と
なり、ＬＡＮ等における網輻輳を回避することができ
る。According to the second aspect of the present invention, in a star connection type virtual space sharing apparatus which is advantageous when the number of connected terminals is large, when a video received from each terminal is distributed to other terminals, Calculates the degree of coincidence of the line of sight between the user to whom the face image is to be distributed and the other user from the position information of each user's alter ego that receives the image. Since a thinning process that allocates a large number is applied, the face image of the user closer to the user's line of sight can be obtained with better image quality without causing uniform degradation, and economically. The present invention can be applied to a public network, and network congestion in a LAN or the like can be avoided.
【００２９】また、請求項３の発明によれば、接続端末
数が多い場合に有利なスター接続型の仮想空間共有装置
において、各端末から受信した映像を他の端末に分配す
る時に、端末から受信する各利用者の分身の位置情報か
ら顔映像の分配先利用者と他の利用者との仮想空間内の
距離と視線の一致度を計算し、距離が近く視線の一致度
の大きい利用者の顔映像から順に、解像度、フレーム数
を多く割り当てるような間引き処理を適用しているの
で、画一的な劣化を生じさせることなく自分に近くかつ
視線方向に近い利用者の顔画像ほど映像品質の良い顔画
像が得られ、経済的に公衆網に適用可能となり、ＬＡＮ
等における網輻輳を回避することができる。According to the third aspect of the present invention, in a star connection type virtual space sharing device which is advantageous when the number of connected terminals is large, when a video received from each terminal is distributed to other terminals, Calculates the distance between the user to whom the facial image is distributed and the other user in the virtual space and the degree of eye-gaze coincidence from the received positional information of each user's alter ego. Since the thinning process that assigns a larger number of resolutions and frames is applied in order from the face image of the user, the face quality of the user's face image closer to the user and closer to the line of sight without causing uniform deterioration Good face image, economically applicable to public networks, LAN
Network congestion can be avoided.
【００３０】さらに、請求項４の発明によれば、特に、
上記の顔映像の分配先利用者と他の利用者との仮想空間
内の距離と視線の一致度の計算、および、顔画像の画一
的でない分配のためになされる評価であってそれら両方
を合わせた評価が容易になる。Further, according to the invention of claim 4, in particular,
Calculation of the degree of matching between the distance in the virtual space and the line of sight between the user to whom the facial image is to be distributed and another user, and an evaluation made for non-uniform distribution of the facial image, and both. The evaluation can be made easier.
【図１】本発明の一実施例における利用者間距離の分割
例を示す図FIG. 1 is a diagram showing an example of dividing a distance between users according to an embodiment of the present invention.
【図２】上記実施例における利用者間視線一致度の分割
例を示す図FIG. 2 is a diagram showing an example of division of a degree of eye-gaze coincidence between users in the embodiment.
【図３】上記実施例における視野角度の計測例を示す図FIG. 3 is a diagram showing a measurement example of a viewing angle in the embodiment.
【図４】上記実施例の顔画像分配における利用者間優先
度づけの例を示す図FIG. 4 is a diagram showing an example of prioritization between users in the distribution of face images according to the embodiment.
【図５】上記実施例における利用者の配置モデルの例を
示す図FIG. 5 is a diagram showing an example of a user placement model in the embodiment.
【図６】上記実施例の仮想空間共有装置の装置構成例を
示す図FIG. 6 is a diagram showing an example of a device configuration of a virtual space sharing device according to the embodiment.
【図７】端末の論理的メッシュ接続例を示す図FIG. 7 is a diagram showing an example of a logical mesh connection of a terminal;
【図８】端末の論理的スター接続例を示す図FIG. 8 is a diagram showing an example of a logical star connection of terminals.
【図９】端末の物理的メッシュ接続例を示す図FIG. 9 is a diagram showing a physical mesh connection example of a terminal;
【図１０】端末の物理的スター接続例を示す図FIG. 10 is a diagram showing a physical star connection example of a terminal;
１０…仮想空間共有装置 １１，１２，１３…回線インタフェース部 １４…位置情報分配部 １５…距離計算部 １６…視線一致度計算部 １７…映像間引き率決定部 １８…映像間引き・分配部 １９，２３，２７…映像受信用内部バス ２０，２４，２８…映像送信用内部バス ２１，２５，２９…位置情報受信用内部バス ２２，２６，３０…位置情報送信用内部バス ３１…距離計算結果転送用内部バス ３２…視線一致度計算結果転送用内部バス ３３…映像間引き率通知用内部バス ３４，３５，３６…通信回線 DESCRIPTION OF SYMBOLS 10 ... Virtual space sharing apparatus 11, 12, 13 ... Line interface part 14 ... Position information distribution part 15 ... Distance calculation part 16 ... Eye-gaze coincidence calculation part 17 ... Video thinning rate determination part 18 ... Video thinning / distribution part 19, 23 , 27 ... Internal bus for video reception 20, 24, 28 ... Internal bus for video transmission 21, 25, 29 ... Internal bus for position information reception 22, 26, 30 ... Internal bus for position information transmission 31 ... For transfer of distance calculation result Internal bus 32: Internal bus for transferring the result of gaze coincidence calculation result 33: Internal bus for notifying the video thinning rate 34, 35, 36: Communication line
───────────────────────────────────────────────────── フロントページの続き (51)Int.Cl.7 識別記号 ＦＩ Ｈ０４Ｌ 12/44 Ｈ０４Ｌ 11/00 ３４０ (58)調査した分野(Int.Cl.7，ＤＢ名) H04N 7/10 H04N 7/14 - 7/173 H04N 7/20 - 7/22 ──────────────────────────────────────────────────の Continuation of the front page (51) Int.Cl. 7 identification code FI H04L 12/44 H04L 11/00 340 (58) Field surveyed (Int.Cl. 7 , DB name) H04N 7/10 H04N 7 / 14-7/173 H04N 7/20-7/22
Claims (4)
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の距
離を計算する手段と、 前記距離が近い利用者の顔映像から順に解像度もしくは
フレーム数またはそれら両方を多く割り当てて前記顔映
像の分配先利用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。1. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at his / her own will and an alter ego of another user in the three-dimensional virtual space via a communication network. By connecting to a star type and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals, a plurality of users can remotely control the same three-dimensional virtual space. This is a 3D virtual space sharing device that can be shared on the ground, and calculates the distance in the 3D virtual space between the face image distribution destination user and other users from the positional information of each user's alter ego received from the terminal. Means for allocating a larger number of resolutions and / or the number of frames in order from the face video of the user whose distance is shorter, and transmitting it to the terminal of the user to whom the face video is distributed. 3D virtual space sharing device.
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の視
線の一致度を計算する手段と、 前記視線の一致度が大きい利用者の顔映像から順に解像
度もしくはフレーム数またはそれら両方を多く割り当て
て前記顔映像の分配先利用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。2. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at his / her own will and an alter ego of another user in the three-dimensional virtual space via a communication network. By connecting to a star type and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals, a plurality of users can remotely control the same three-dimensional virtual space. An apparatus for sharing a three-dimensional virtual space that can be shared on the ground, wherein the gaze in the three-dimensional virtual space between the user to whom the facial image is distributed and another user is determined based on the positional information of each user's alter ego received from the terminal. Means for calculating a degree, and means for allocating a larger number of resolutions and / or the number of frames in order from the face image of the user having a higher degree of eye-gaze coincidence and transmitting the face image to the terminal of the user to whom the face image is to be distributed. Three-dimensional Virtual space sharing device.
ような３次元仮想空間と当該３次元仮想空間内に他の利
用者の分身とを表現できる端末を複数台、通信網を介し
てスター型に接続し、前記端末から受信した利用者の顔
映像と前記３次元仮想空間内の位置情報とを他の端末に
分配することによって、複数の利用者が同一の３次元仮
想空間を遠隔地で共有できる３次元仮想空間共有装置で
あって、 端末から受信する各利用者の分身の位置情報から顔映像
の分配先利用者と他の利用者との３次元仮想空間内の距
離と視線の一致度を計算する手段と、 前記距離と視線の一致度の両方を評価してその評価が高
い利用者の顔映像から順に解像度もしくはフレーム数ま
たはそれら両方を多く割り当てて前記顔映像の分配先利
用者の端末に送信する手段と、 を有することを特徴とする３次元仮想空間共有装置。3. A plurality of terminals capable of expressing a three-dimensional virtual space in which a user can freely move at his / her own will and an alter ego of another user in the three-dimensional virtual space via a communication network. By connecting to a star type and distributing the face image of the user received from the terminal and the position information in the three-dimensional virtual space to other terminals, a plurality of users can remotely control the same three-dimensional virtual space. A three-dimensional virtual space sharing device that can be shared on the ground, wherein a distance and a line of sight between a destination user of a facial image and another user in a three-dimensional virtual space are determined based on positional information of each user's alter ego received from a terminal. Means for calculating the degree of coincidence of the face image, and evaluating both the distance and the degree of coincidence of the line of sight and assigning a larger resolution or frame number or both in order from the face image of the user with the higher evaluation, and distributing the face image Means of sending to the user's terminal , 3-dimensional virtual space sharing apparatus characterized by having a.
において、送信する手段が、距離の評価値として該距離
に逆比例するような値を与え視線一致度の評価値として
視線の角度に逆比例するような値を与えそれらの評価値
の積が大きい利用者の顔映像から順に解像度もしくはフ
レーム数またはそれら両方を多く割り当てて顔映像の分
配先利用者の端末に送信するものであることを特徴とす
る３次元仮想空間共有装置。4. The three-dimensional virtual space sharing apparatus according to claim 3, wherein said transmitting means gives a value which is inversely proportional to the distance as an evaluation value of the distance, and sets an angle of the line of sight as an evaluation value of the line-of-sight coincidence. The resolution and / or the number of frames, or both, should be assigned in order from the user's face video given a value that is inversely proportional and the product of the evaluation values is large, and transmitted to the terminal of the face video distribution destination user. A three-dimensional virtual space sharing apparatus characterized by the following.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP06079994A JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP06079994A JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JPH07288791A JPH07288791A (en) | 1995-10-31 |
| JP3122576B2 true JP3122576B2 (en) | 2001-01-09 |
Family
ID=13705863
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP06079994A Expired - Lifetime JP3122576B2 (en) | 1994-04-19 | 1994-04-19 | 3D virtual space sharing device |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP3122576B2 (en) |
Families Citing this family (26)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH11177628A (en) * | 1997-12-15 | 1999-07-02 | Mitsubishi Electric Corp | Three-dimension virtual space common share system for broad area environment |
| JP3315363B2 (en) | 1998-03-18 | 2002-08-19 | 松下電器産業株式会社 | Moving image reproduction quality control device and control method thereof |
| JP2012230525A (en) * | 2011-04-26 | 2012-11-22 | Nippon Hoso Kyokai <Nhk> | Content management device, client terminal, content management program, and content generation program |
| JP6724110B2 (en) | 2018-10-31 | 2020-07-15 | 株式会社ドワンゴ | Avatar display system in virtual space, avatar display method in virtual space, computer program |
| US10952006B1 (en) | 2020-10-20 | 2021-03-16 | Katmai Tech Holdings LLC | Adjusting relative left-right sound to provide sense of an avatar's position in a virtual space, and applications thereof |
| US11457178B2 (en) | 2020-10-20 | 2022-09-27 | Katmai Tech Inc. | Three-dimensional modeling inside a virtual video conferencing environment with a navigable avatar, and applications thereof |
| US10979672B1 (en) | 2020-10-20 | 2021-04-13 | Katmai Tech Holdings LLC | Web-based videoconference virtual environment with navigable avatars, and applications thereof |
| US11095857B1 (en) | 2020-10-20 | 2021-08-17 | Katmai Tech Holdings LLC | Presenter mode in a three-dimensional virtual conference space, and applications thereof |
| US11070768B1 (en) | 2020-10-20 | 2021-07-20 | Katmai Tech Holdings LLC | Volume areas in a three-dimensional virtual conference space, and applications thereof |
| US11076128B1 (en) | 2020-10-20 | 2021-07-27 | Katmai Tech Holdings LLC | Determining video stream quality based on relative position in a virtual space, and applications thereof |
| US20240087091A1 (en) * | 2021-01-12 | 2024-03-14 | Sony Group Corporation | Server device and network control method |
| US11184362B1 (en) | 2021-05-06 | 2021-11-23 | Katmai Tech Holdings LLC | Securing private audio in a virtual conference, and applications thereof |
| US11743430B2 (en) | 2021-05-06 | 2023-08-29 | Katmai Tech Inc. | Providing awareness of who can hear audio in a virtual conference, and applications thereof |
| US11928774B2 (en) | 2022-07-20 | 2024-03-12 | Katmai Tech Inc. | Multi-screen presentation in a virtual videoconferencing environment |
| US11876630B1 (en) | 2022-07-20 | 2024-01-16 | Katmai Tech Inc. | Architecture to control zones |
| US11651108B1 (en) | 2022-07-20 | 2023-05-16 | Katmai Tech Inc. | Time access control in virtual environment application |
| US11741664B1 (en) | 2022-07-21 | 2023-08-29 | Katmai Tech Inc. | Resituating virtual cameras and avatars in a virtual environment |
| US11700354B1 (en) | 2022-07-21 | 2023-07-11 | Katmai Tech Inc. | Resituating avatars in a virtual environment |
| US11682164B1 (en) | 2022-07-28 | 2023-06-20 | Katmai Tech Inc. | Sampling shadow maps at an offset |
| US11593989B1 (en) | 2022-07-28 | 2023-02-28 | Katmai Tech Inc. | Efficient shadows for alpha-mapped models |
| US11562531B1 (en) | 2022-07-28 | 2023-01-24 | Katmai Tech Inc. | Cascading shadow maps in areas of a three-dimensional environment |
| US11776203B1 (en) | 2022-07-28 | 2023-10-03 | Katmai Tech Inc. | Volumetric scattering effect in a three-dimensional virtual environment with navigable video avatars |
| US11704864B1 (en) | 2022-07-28 | 2023-07-18 | Katmai Tech Inc. | Static rendering for a combination of background and foreground objects |
| US11711494B1 (en) | 2022-07-28 | 2023-07-25 | Katmai Tech Inc. | Automatic instancing for efficient rendering of three-dimensional virtual environment |
| US11956571B2 (en) | 2022-07-28 | 2024-04-09 | Katmai Tech Inc. | Scene freezing and unfreezing |
| US11748939B1 (en) | 2022-09-13 | 2023-09-05 | Katmai Tech Inc. | Selecting a point to navigate video avatars in a three-dimensional environment |
-
1994
- 1994-04-19 JP JP06079994A patent/JP3122576B2/en not_active Expired - Lifetime
Also Published As
| Publication number | Publication date |
|---|---|
| JPH07288791A (en) | 1995-10-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3122576B2 (en) | 3D virtual space sharing device | |
| JPH11177628A (en) | Three-dimension virtual space common share system for broad area environment | |
| USRE39135E1 (en) | Method and apparatus for allocating bandwidth in teleconferencing applications using bandwidth control | |
| Nahrstedt et al. | The qos broker [distributed multimedia computing] | |
| US5003593A (en) | Teleconferencing method for a secure key management system | |
| US7013354B1 (en) | Channel protocol for IEEE 1394 data transmission | |
| JPH10107895A (en) | Multi-media information service access | |
| CN106385587A (en) | Method, device and system for sharing virtual reality view angle | |
| JPS61117944A (en) | Synchronous method in multi-point communication system | |
| JP3931531B2 (en) | Hierarchical coded video distribution system | |
| JP3488096B2 (en) | Face image control method in three-dimensional shared virtual space communication service, three-dimensional shared virtual space communication device, and program recording medium therefor | |
| JPH08161249A (en) | Virtual space data transfer method | |
| JP3193254B2 (en) | 3D virtual space sharing system | |
| JPH099222A (en) | Virtual space sharing system | |
| JP3257459B2 (en) | Shared virtual space simple two-dimensional interface realizing method, client system having the interface, and storage medium storing the interface program | |
| JP4277365B2 (en) | Video distribution system | |
| JP3449520B2 (en) | 3D virtual space display method | |
| JPH09325991A (en) | Three-dimensional virtual world display system | |
| JPH02159847A (en) | Data terminal equipment among decentralized multi-point | |
| JPH099230A (en) | Resolution controller | |
| US20070172043A1 (en) | Ultimedia conference system | |
| JP2001209606A (en) | Virtual space sharing system | |
| JP3184028B2 (en) | People image display system | |
| JP2003179910A (en) | Image-distribution system | |
| JP3320601B2 (en) | Image display method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20071020 Year of fee payment: 7 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20081020 Year of fee payment: 8 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20091020 Year of fee payment: 9 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20101020 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20101020 Year of fee payment: 10 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20111020 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20111020 Year of fee payment: 11 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121020 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20121020 Year of fee payment: 12 |
|
| FPAY | Renewal fee payment (event date is renewal date of database) |
Free format text: PAYMENT UNTIL: 20131020 Year of fee payment: 13 |
|
| S531 | Written request for registration of change of domicile |
Free format text: JAPANESE INTERMEDIATE CODE: R313531 |
|
| R350 | Written notification of registration of transfer |
Free format text: JAPANESE INTERMEDIATE CODE: R350 |
|
| EXPY | Cancellation because of completion of term |