CN1273656A

CN1273656A - Virtual environment viewpoint control

Info

Publication number: CN1273656A
Application number: CN99800233A
Authority: CN
Inventors: J·鲁特格斯
Original assignee: Koninklijke Philips Electronics NV
Current assignee: Koninklijke Philips NV
Priority date: 1998-01-09
Filing date: 1999-01-07
Publication date: 2000-11-15
Anticipated expiration: 2019-01-07
Also published as: JP4276704B2; WO1999035597A2; US6241609B1; KR100597329B1; WO1999035597A3; GB9800397D0; KR20000076066A; EP0966716A2; CN1132117C; JP2001515630A

Abstract

A multi-user interactive virtual environment system wherein each user is provided with data to generate a respective image of the virtual environment and characters therein, including an assigned character (100) particular to that individual user, from a respective virtual camera (110) viewpoint (A, B, C) determined at least partially by the user-directed motion of their assigned character. Each character has an interaction zone of predetermined size and shape maintained about its current virtual environment location. When the respective interaction zones of two or more user-assigned characters (100, 130) overlap, their respective virtual cameras (110) are controlled to move from first- to third-person (A-C) viewpoints for as long as the overlap remains. In a refinement (FIGURE 17), at least one further interaction zone at a given location within the virtual environment, and independent of any particular character within the virtual environment, takes control of all character virtual cameras as those characters enter the zone.

Description

Virtual environment viewpoint control

The present invention relates to resemble online game and virtual reality or share (multi-user) virtual environment system such provide the interactive environment system of virtual environment view for a user, user's virtual presence that computing machine produces wherein appears, and can be optionally and the characteristic interaction of other similar user's virtual presence and environment itself.Particularly, the present invention relates to such system, it has the device that is used for controllably changing viewpoint, and from this device reproducing environment image (being used for showing the user), this characteristic is known as " virtual gamma camera " control at this.

The system of the virtual environment (or CyberSpace) that a kind of long-distance user of providing can visit has been provided in European patent application EP-A-0 697 613 (Sony).Described this system comprises a server that virtual reality space is provided, and the user terminal that is connected to server by high-speed communicating network (using optical fiber or similar circuit).In when work, server keeps a plurality of virtual environments and by supporting a plurality of different terminals at the switch target between information object and the ownership goal: switch target between each configuration of each terminal type and the virtual environment supported forward backward communication the individual treated conversion is provided.

At each user terminal, the bidimensional image of observed three-dimensional virtual environment offers the user on user's oneself that will be from three-dimensional environment the certain view, and will represent that offer user as the icon (representation) that is produced by computing machine of other Any user that is in the virtual environment same area of observing the user this moment.Rather than produce all or part of icon by the observation user in the seen image of this user, EP-A-0 697 613 systems use the first view (i.e. " eyes " seen image of the symbol that produces by subscriber computer) and the cursor of an operable simple arrowhead form of user are provided, by cursor in the bidimensional image of shown environment on/bottom left/move right, perhaps come from virtual environment indication or select option, thereby between two users, begin dialogue or carry out that other is mutual by the virtual sign of clicking next user.EP-A-0 697 613 these used technology are the improvement to given prior art systems, the symbol that uses the central authorities always appear at the image that offers the user to reproduce in prior art systems comes representative of consumer, thereby makes the user observe their icon with the 3rd people's angle in virtual environment.

Strengthened the sensation that the user is melted into virtual environment though reproduce from the first visual angle, but carrying out when mutual when the virtual icon with other user then is not to make us very satisfied, and the 3rd people visual angle can be in relevant mode for offering user's more information alternately.It will be of great value can selecting the viewpoint (virtual camera position) of relative yourself's icon, but require to do like this and will become an overtime amusement.

Therefore, an object of the present invention is to propose a kind of system that is designed to adjust automatically the virtual camera position, thus in multiple factor according to user's virtual appearance and whether taking place alternately between user's the icon in addition, a suitable viewpoint is provided.

The multiusers interaction virtual environment system that provides according to a first aspect of the invention comprises: first data-carrier store that comprises the defining virtual environmental data; Second data-carrier store that comprises the data of the external performance that defines a plurality of symbols; With a processor, it is used for receiving input command and arranging visit first and second storeies from a plurality of separate users, and determine a specific viewpoint with position and direction in the virtual environment of determining by the movable part ground of the user of user-specified character indication at least, for each user produces in the virtual environment image and symbol separately, comprising the special symbol of specifying this individual consumer, it is characterized in that: the interaction area generation device is used for being the area coordinate separately of each symbol maintenance renewal that this coordinate is used to represent the corresponding pre-sizing of current relatively virtual environment position and the zone of shape; And the supervising device that links to each other with regional generation device, be used for determining that the corresponding interaction area of two or more user's designated symbols is when overlapping and it is notified to described processor, as long as exist overlappingly, then the pre-defined rule collection that provides based on processor to small part is determined viewpoint position and direction separately for each such user's designated symbols.

By providing interaction area (it is suitable for not seen by the user) to provide a trigger mechanism to be used to switch user's camera position.As described in the example of back, when not having interaction area (not having region overlapping), virtual camera can be followed its symbol simply also effectively from " its shoulder in the past " on a position, and then rotates to the 3rd people's view so that the image that has more two interactive icons information is provided.

Along with the raising of the ability that realizes complicated user's virtual presence, the size and/or the complexity of virtual world that can modeling also will increase, and be same, can the given while time accesses virtual world the different user quantity of a same part also will increase.Its influence is on than the zonule the overlapping of interaction area to be taken place on a large scale, produces the unacceptable load of processor when causing the computing camera position.For avoiding this potential problem, processor suitably keeps at least one further interaction area in a fixed position of virtual environment, and fixedly interaction area or zone are independent of any special symbol in the virtual environment to make this.By providing these fixed area on the normal and/or crowded position in virtual environment, and by controlling the ad hoc rules collection of camera location, can be for all sign conventions in the zone cover this regional panorama camera view, so that avoid calculating the single camera position.This characteristic can preset (irrelevant with this locational symbol/cursor quantity) for the ad-hoc location in the virtual environment or goes up at an arbitrary position when the interaction area of for example determining 5 or more symbols is overlapping and dynamically use this characteristic.

By improving, these fixedly interaction area can constitute by being provided with one heart of at least two subregions, when a symbol interaction area only with the subregion of outside when overlapping processor the part of rule set only is provided.In other words, when near the inside of subregion (having the panorama camera location), moving the degree of determining the respective symbol mobile camera moving by symbol will reduce.

By below reading to the description of the preferred embodiments of the present invention, further characteristic of the present invention and advantage will more obvious, institute does the description general and only provides with the form of example, and the following accompanying drawing of reference:

Fig. 1 is the schematic block diagram of data processing equipment that is suitable for constituting the configuration of a user terminal that embodies feature of the present invention;

Fig. 2 represents the User by the virtual environment of the shoulder of star user icon or cursor;

Fig. 3 represents a vision cone, by its highlighted direction indication of Fig. 2 cursor;

Fig. 4 represents the possible relative positioning of the subregion of camera view in cursor and virtual camera and the screen area;

Fig. 5 represents the technology that the virtual camera tracking cursor rotates;

Fig. 6 represents motionless cursor and moving cursor display position different on screen;

Fig. 7 represents to have a pair of cursor of corresponding interaction area;

The a pair of interaction area of Fig. 8 presentation graphs 7 overlapping;

Fig. 9 represents that the cursor outside is divided into the nominal subregion in a plurality of discontinuous zones;

Figure 10 and a pair of cursor of 11 expressions are initial mutual by the vision cone;

Two of Figure 12 to 15 expressions and three mutual virtual cameras of cursor move;

Figure 16 is illustrated in mutual in two or three discontinuous group of a plurality of cursors in the virtual environment; With

Figure 17 represents to be fit to the fixedly interaction area of big mutual cursor group.

The network virtual environmental system that Fig. 1 provides comprises a user data disposal system 2, people's computing machine one by one for example, and it is as the main frame of application software, is configured to be used for the browser of the data of defining virtual environment.Connection by network 8 obtains data from remote source 4, and other user 6 with similar data handling system is connected to source 4 equally.Custom system 2 comprises a central processing unit (CPU) 10, and is connected to storage (RAM) and read-only (ROM)

storage arrangement

14,16 at random by address and data bus 12.By for this system provides from additional memory device, the device that reads such as CD-ROM (not shown) for example can improve the ability of these storage arrangements.

By first and second

user input apparatus

18,20 in addition that bus 12 links to each other with CPU 10, they can comprise cursor control and the selecting arrangement that keyboard and mouse or tracking ball are such.The audio frequency output of system is to realize by earphone or one or more loudspeaker 22 that Audio Processing platform 24 drives; Except amplification was provided, the Audio Processing platform also was designed to provide signal handling capacity under the control of CPU 10, so that allow to increase the acoustic processing resemble the echo in existing voice data.According to custom system ability and from the source 4 data layouts that provide, the video output of system can be at the continuous two-dimensional image that passes through under the driving of display driver platform 28 on the display screen 26, and perhaps the continuous three-dimensional image on automatic stereoscopic display device or three-dimensional head-mounted display (not shown) is realized.

As mentioned above, another data source of system is by online connections such as for example Internets, comprises as the data source of defining virtual environment and the server 4 controlled being connected to remote site.For this purpose, will offer system by the network interface 30 that bus 12 links to each other with CPU 10.The precision architecture of interface is not a fundamental characteristics of the present invention, but will recognize that, the structure of interface will depend on the type of the data network 8 that links to each other with network: for example, system is used for individual domestic consumer, and the data link generally is connected to the local service provider by phone.In this case, to be suitable for be a modulator-demodular unit to interface 30.For the link of the data of other type, resemble ISDN and connect, then configuration interface correspondingly.

In operation, the User of virtual environment is produced by virtual camera, do not having under the situation of other movement directive, the symbol of the representative of consumer virtual presence that the position of supposing this camera produces at computing machine or the back of cursor 100, this position be in icon a little above a bit or a side (resembling the effect of looking) from its " on the shoulder " provide and be almost the first viewpoint.In the example of back, the symbol that subscriber computer produces, and other user's symbol in the same environment, all be that star is embodied, it is not only as user's virtual presence, the function of cursor also is provided, wherein for the user provides not only and other this class (other user's) cursor, and with virtual environment in the further feature that may occur and the device of target interaction.Being embodied in the back and will being called as cursor of these symbols.

Reach shown in Figure 2ly as mentioned above, basic camera viewpoint is by cursor 100 " on the shoulders ", thereby gives the view of a continual relatively virtual environment 102 of user, keeps visual minimum the existence to help user's orientation simultaneously.Camera position, convergent-divergent and other effect as eyeglass selection etc. are all determined automatically by the moving of cursor operations performance, action and profile (back will be described this), thereby are made the user not pass through UID (18,20; Fig. 1) camera is directly controlled in operation.

As shown in Figure 3, cursor 100 has " a vision cone " 104, indicates its intention by it: the relative cursor in visual field has 90 ° angle, and the main shaft 106 of vision cone extends perpendicular to the general closed planar cursor in other words.In operation, the image reconstruction device that produces environmental image for the user notice the position of the relative environment of vision cone and relatively external object with the level of more detailed (or focusing) object in the vision cone is reproduced so that the intuition focusing of the cursor point of paying close attention to is provided.

The view of virtual camera (offers user's view on screen 26; Fig. 1) cut apart in screen area, this zone user can't see, and determines the reorientating automatically of camera (back will be described) by the position of vision cone on different screen areas.Fig. 4 is the plan view of virtual camera 110 and cursor 100, and the expression from be split into the different screen zone (A.1, B.1 ..., the view 112 that virtual camera inside E.5) is seen.Along with visual light target direction upwards, down, left or right moves, camera 110 moves along with visual direction.In fact, if cursor 100 continuously changes visual direction, for example left, then camera and cursor will finally move and get back to the view of virtual environment initial part along a circle.Fig. 5 represents along with the vision cone moves on to the central screen region exterior (at 2 of this front elevation by rotation, 3 and 4) time, how camera 110 oneself is reorientated and will be reproduced viewpoint and refer to what light echo mark 100 focused on, by three step (A of the position of vision cone main shaft 106 indications, B, C).Interval between camera and the vision cone allows to accept cursor because the minute movement that the uncertain operation of user's control brings, thereby avoids the corresponding shake from the image of virtual camera.

On the shoulders the composition of passing through of the cursor of representing with A among Fig. 6 100 is illustrated in settling position when cursor is static in the virtual environment.When cursor 100 motion, camera position changes automatically and provides more the 3rd people's viewpoint, for example for the user provide more navigation instruction based on ambient Property.When cursor was static, its cursor part visible part appeared at the edge of displayed image; When mobile (direction shown in Fig. 6 view B arrow 114), cursor speed is fast more, and it will approach the central authorities of image more.Move the 3rd people's view (that is, cursor fully as seen in screen) that the direction that changes the vision cone simultaneously will cause cursor, in the crooked angle of determining by rotation direction and size of icon of this view cursor.

Forward mutual between the different user cursor now to, as shown in Figure 7, cursor 100 has an effect or interaction area circle 200, and in multi-user environment, each cursor 100,120 has interaction area 200,220 separately.In three-dimensional virtual environment, the zone that surrounds cursor can be spherical or it can be one or more direction elongations, and for example the part that its volume is bigger generally is being arranged in vision cone main shaft (106; It is avette that cursor Fig. 3) is located previously.The size of interaction area 200 decision cursor 100 may and/or be ready and the mutual degree of other cursor because when interaction area merges as shown in Figure 8 or is overlapping can only cursor to or group between take place alternately.Its regional affected cursor to each, the merging of two or more interaction area or overlappingly also the control of its camera is exerted an influence, as will be described below.

The user can arrange or influence one's profession or economic status in his/her user profile demonstration (having the data structure that different access requirements comprise nested form information).In a preferred embodiment, the value volume and range of product of information can determine the size of interaction area during profile showed.For example, a cursor comprises bulk information in (public) layer outside its profile shows, then trend towards also may having bigger interaction area alternately.

Information during the user profile of cursor shows can be by other cursor access: scan another cursor outside by the vision cone (scan cursor and detect this vision) with it, then as seen the user profile information of cursor will become.The outside of cursor is divided into a plurality of regional 121-125, the data (for example elemental user particulars and right of priority) of the common layer that profile shows are pressed predetermined arranged distribution in a plurality of zones, and zone line 126 comprises cursor user's more a plurality of people and private data, as shown in Figure 9.Response to the scanning of other cursor, some (particularly perimeter 121-125) is than other zone " sensitivity " more in these zones, just be easy to provide their content: for example, personal data in the zone line 126 can not provide automatically, but require clear and definite release and/or sent by the user of cursor.The degree of the convergent-divergent that the camera of the susceptibility decision spotting scaming cursor in zone provides, for example, if in the scanning area of the information in the scanning area corresponding to maintenance of scanning cursor or searching, then coupling identification will make the camera of spotting scaming cursor dwindle the visual angle on the match information source.The method of another kind of control convergent-divergent is to move a special region by the cursor that may scan towards possible scanning cursor, and dwindles the visual angle by area triggering cursor camera.

Do not having under the overlapping situation of interaction area, the vision cone still can make cursor mutual.Open uni directional communication channel and make two cursor commanders vision cone each other.This uni directional communication channel allows cursor to send data segment from their common user's profile demonstration, and this data segment may be a sound, view data etc.Figure 10 has provided a pair of cursor 100,103, and their vision cones 104,134 separately separately, thereby have only the one-way channel to exist on another cursor and their interaction area 200,230th between them.When two cursors are close to each other, their interaction area is overlapping as shown in figure 11, and trigger from the unidirectional conversion to bi-directional communication links 150 between two cursors 100,130, wherein scan cursor and can not only obtain data from the dark profile layer of the cursor that is scanned from outside common layer.

Figure 12 to 15 has further provided the structure of overlapping interaction area.The camera position that constitutes handled User is by the interaction area definition that merges.Any camera position of two cursors of demonstration all is arranged in half of shown in Figure 12 regional 160 and by merging the interaction area definition, this zone is got by 180 ° of space cinematographies.The camera position that two cursors 100,130 reproduce is by 180 ° of definition spaces, strictly uses this technology and avoided the influence of getting lost, otherwise will get lost when cursor one side switches to opposite side when viewpoint.

After the merging interaction area had defined 180 ° of spaces 160, this space then was divided into two 1/4th (both sides of line 162), makes the virtual camera of each cursor can only be positioned at its corresponding 1/4th zones.Each cursor has its camera curve in this 1/4th zone, and it is used to locate its camera.Figure 13 provides camera 110 and is the whole diagrammatic sketch of cursor 100 to the figure left positioner.Camera can move on the curve of 1/4th edges of regions glossily.Pass this curve, camera can be from the 3rd people's viewpoint C, through passing through the skew of viewpoint B on the shoulders, move on to the first viewpoint A: notice in the first viewpoint, for avoiding hiding interacted light target view, the User of their cursors may remove from reproduce view in some embodiments.

When two cursors 100,130 met, as mentioned above, their camera curve will be toward each other.As shown in figure 14, the 3rd cursor 170 of outside, 180 ° of spaces will be passive when initial, to the not influence of other two cursors.Yet, as shown in figure 15, when one in the 3rd cursor 170 and first cursor 100 or second cursor 130 when mutual, 180 ° of spaces 160 will be transformed to surround three cursors alternately to 100,170, and turn back to and be used for original cursor to 100,130 o'clock initial position (supposing that two cursors all move therein) and recover mutual.

Except simply meet with other user (or optionally with virtual environment in other characteristic meet), show from user profile, perhaps from being included in partly (zone line 126 of cursor body " software "; Swap date Fig. 9) in the more individual data also will cause the change of camera position.If in two cursors, transmit bulk information, will control they separately camera position make it from the first or shift to the 3rd people's view gradually or apace by view on the shoulders.The passivity of a cursor also may produce the change of camera diagrammatic sketch: if having bi-directional communication links between a pair of cursor, but have only a cursor to be in to send data and/or preparation to be used for the state of activation of reading of data, the camera of following the tracks of passive cursor so will focus on the activation cursor.

If a plurality of cursors are arranged in virtual environment, generally will be as mentioned above according to whether existing overlapping interaction area and/or control vision cone to control their camera positions separately.Yet, say that practically system handles and speed ability have provided the restriction of simultaneously mutual cursor quantity.For example, for merge the necessity of carrying out in the zone calculate system is slowed to make the insufferable degree of user before, may limit and have only 5 overlapping interaction area of while, yet, in single environment, as shown in figure 16, can provide many combinations and the cursor group of cursor to forming with three cursors.

Among the virtual environment set that the user can use, some environment may attract a large number of users (by their cursor), if become " congested " then may not need the modification of some forms because attempting mutual immediately too many cursor in these zones.This can realize by their camera control protocol is provided for these zones: in fact, these zones are the fixedly interaction area that are not attached to a cursor., shear automatic specified camera choreography according to the area part at cursor place, fade out rhythm, color and gating effect.Provided among Figure 17 and had concentric regions A, B, the space of C, wherein concentric regions has determined to give each camera control level of each cursor, its scope is from as the mutual comprehensive control of two or three cursors the previously described perimeter C, and the nothing that the viewpoint that cursor all comprised of the single regional body in the interior zone A generates is controlled separately.It can only be to stay regional center or leave that user's control is selected.

Show and exchange subscriber aspect the profile information at regional A internally, agreement is fit to make the common layer (skin of all cursors from them, the layer that is easier to access of internal data store structure) " leakage " some information, the information of revealing can be obtained by other cursor in this zone, if they are to its interested words.In case obtained an information, then notice cursor and two cursors 302,304 of revealing it are shifted to the first frontier district B, support therein by viewpoint on the shoulders reproduce mutual, thereby give between two cursors exchange secret to a certain degree.Based on this exchange, if determine two cursors to wish to exchange more personal data, they are moved out to zone C by area B, merge the restriction that does not have based on the zone for camera control or interaction area there, shown in cursor 306,308.

Though the example of front concentrates on emphasis the robotization of virtual camera location, but for a person skilled in the art, by with the position of virtual camera with orientation replaces with virtual microphone or stereophony microphone is right, the audio frequency control that aforementioned techniques is applied to virtual environment is readily appreciated that, thereby produces bidimensional or three-dimensional sound field (24 by the audio platform of system; Fig. 1).

Except the mutual generation sound of directly other user from user and virtual environment or target (passing through cursor), can also there be background sound, thereby the prompting or the relevant information of further exploration are provided for the user from Controlling Source.For example, when when sending the virtual environment zone of loud noise very, then point out this position of user may comprise and a large amount of other mutual the users of other cursor.Can discern composition according to obtaining from background sound, the user can also determine the type or the purposes of this part in the environment, and if do not meet his/her hobby then can avoid it.Can hear sound but the place that begins but to can't see by from the stereo audio of cursor angle control (in virtual environment, the source should be monophony and change the sound size according to the distance of leaving cursor separately) user can being moved at least in virtual environment.

Though claims are illustrated particular combinations into each feature at this application has, but should be appreciated that, no matter whether relate to and state identical invention with current claim, perhaps whether relax any as the present invention or all same technical matters, the application scope of disclosure also comprises the characteristic of disclosed herein or obvious or implicit any novelty, perhaps property combination.The applicant draws attention at this, characteristic that can be like this process of any further application of understanding the application or obtaining from the application or like this characteristic constitute new claims.

Claims

1. a multiusers interaction virtual environment system comprises: first data-carrier store that comprises the defining virtual environmental data; Second data-carrier store that comprises the data of the external performance that defines a plurality of symbols; With a processor, it is used for receiving input command and arranging visit first and second storeies from a plurality of isolated users, and determine a specific viewpoint with position and the direction determined by the movable part ground of the user symbol of user's appointment at least, for each user produces in the virtual environment image and symbol separately, special symbol comprising specifying this individual consumer is characterized in that:

The interaction area generation device is used to each symbol to keep the area coordinate separately that upgrades, and this coordinate is used to represent the corresponding pre-sizing of current relatively virtual environment position and the zone of shape;

And with the continuous supervising device of regional generation device, be used for determining that the corresponding interaction area of two or more user symbols is when overlapping and it is notified to described processor, as long as exist overlappingly, then the pre-defined rule collection that provides based on processor to small part is determined viewpoint position and direction separately for each such user symbol.

2. system according to claim 1, wherein the fixed position of processor in virtual environment keeps at least one further interaction area, and described fixedly interaction area is independent of any specific character in the virtual environment.

3. system according to claim 2, wherein at least one further interaction area comprises the zone of at least two dwell of cams, and when the symbol interaction area when only the perimeter is overlapping processor the part of rule set only is provided.

4. system according to claim 1, wherein in the virtual environment zone of selecting, processor provides a further interaction area at least, and described further interaction area is independent of any special symbol in the virtual environment, but the symbol that is positioned at predetermined quantity is specified on the overlapping definite position of interaction area.

5. system according to claim 4, wherein processor provides a described further interaction area on the overlapping definite position of interaction area of 5 or more symbol appointments.