KR102419919B1 - User image data display method in metaverse based office environment, storage medium in which a program executing the same, and user image data display system including the same - Google Patents

Abstract

The present invention relates to a user image data display method in a metaverse-based office environment, in which, when constructing an office environment in a three-dimensional virtual space based on a metaverse, the current circumstance of a participant (user) corresponding to a character that has accessed the correspondent office environment can be filmed in real time to be overlapped on the virtual image, thereby significantly increasing the social bonding in the virtual space which is sought after by the metaverse. In particular, according to the present invention, the top priority is given to a user who is currently participating in a chat or a user who has participated in the last chat among users participating in a conversation group, and the image filming the correspondent user is arranged at the uppermost layer, thereby improving concentration of the correspondent conversation group. Furthermore, according to the present invention, the image data of the video camera filmed at a remote point may be received to be located in a two-dimensional shape at the location of the head of a character in a three-dimensional virtual space, thereby replacing the face of the character with the image data of the user which has been filmed in real time, and thus simultaneously delivering additional information by means of the facial expression and behavior of a partner without being simply limited to the conversation based on the text. Therefore, the present invention may improve reliability and competitiveness in the metaverse field, the virtual reality field, the virtual office field and other fields similar to or related to the same. To this end, the present invention comprises: a user image matching step; a priority determination step; and a user image display step.

Description

A method for displaying user image data in a metaverse-based office environment, a storage medium having a program executing the same, and a user image data display system including the same the same, and user image data display system including the same}

The present invention relates to a method of displaying user image data in a metaverse-based office environment, and more particularly, in constructing an office environment in a three-dimensional virtual space based on metaverse, a character (avatar) connected to the office environment By filming the current situation of the corresponding participant (user) in real time and superimposing it on the virtual image, it is possible to greatly improve the social ties in the virtual space pursued by the metaverse.

In particular, the present invention gives the highest priority to the user who is currently chatting or the user who has the last chat among users participating in the conversation group, and improves the concentration of the conversation group by placing an image of the user in the uppermost layer It relates to a method of displaying user image data in a metaverse-based office environment that can

Metaverse It is a compound word of the English word 'meta' meaning 'virtual' and 'transcendence' and 'universe' meaning the universe. say

Metaverse is a concept that has evolved one step further than virtual reality (VR, a cutting-edge technology that enables people to experience real-world experiences in a virtual world created by a computer). It has the characteristic of being able to engage in social and cultural activities among members (avatars) like real reality.

On the other hand, virtual reality refers to an interface between a human and a computer that makes a specific environment or situation into a computer and makes it as if the person using it is interacting with the actual surrounding situation and environment.

Such virtual reality is mainly for showing and manipulating an environment that is difficult for people to experience on a daily basis without directly experiencing it. These include surface exploration, exploration data analysis, and scientific visualization.

As a result, the metaverse can be seen to mean that a specific environment or situation is created by a computer, and social ties between users can be continued more actively in this environment or situation.

Recently, as telecommuting has been activated due to various reasons such as IT infrastructure, social development, and health crisis, methods for performing work in such a metaverse-based virtual office environment are being developed.

The following prior art document, Republic of Korea Patent Publication No. 10-2019-0062045, 'Virtual Conference Implementation Method and Apparatus' (hereinafter referred to as 'prior art') overlaps a part of the user's body in an image in which a virtual conference is in progress. This is to implement a virtual conference space with increased realism by displaying it.

However, since the image of the user overlapping in the prior art is an image such as a still state photo, it is unreasonable to say that improved information (information by expression or action, etc.) beyond text is transmitted in the course of user conversation.

In general, conversation, which is one of the most important things in communication between members (persons) in the real world, is more accurate by checking visual information such as facial expressions, tones, and gestures in addition to the voice information of the conversation itself. information will be conveyed.

For this reason, in a text-based conversation such as chatting, since only the sentence itself can cause misunderstanding, various emoticons are used together to communicate.

In other words, there is a problem in that the prior art stays at the level of simply talking online through text, and does not improve the bond between members like the real world.

Moreover, the prior art simply overlaps the images of each user with the background of the office image on the computer, and does not use the virtual space as the background, so it is unreasonable to say that the technical field is based on virtual reality.

Republic of Korea Patent Publication No. 10-2019-0062045 'Virtual Conference Implementation Method and Apparatus'

In order to solve the above problems, the present invention establishes an office environment in a three-dimensional virtual space based on a metaverse, real-time monitoring of the current situation of a participant (user) corresponding to a character (avatar) connected to the office environment. The purpose of this is to provide a method for displaying user image data in a metaverse-based office environment that can greatly improve social ties in the virtual space pursued by Metaverse by superimposing it on a virtual image.

In particular, the present invention gives the highest priority to the user who is currently chatting or the user who has the last chat among users participating in the conversation group, and improves the concentration of the conversation group by placing an image of the user in the uppermost layer The purpose of this is to provide a method for displaying user image data in a metaverse-based office environment.

In addition, the present invention receives the image data of the video camera photographed at a remote point, places it in a two-dimensional shape at the position of the character's head in the three-dimensional virtual space, and replaces the character's face with the user's image data taken in real time. The purpose of this is to provide a method for displaying user image data in a metaverse-based office environment that can simultaneously deliver additional information based on the other person's facial expressions or actions without being limited to text-based conversations.

In order to achieve the above object, the method for displaying user image data in a metaverse-based office environment according to the present invention is to display a user image captured in real time by the group user on the avatar of each group user included in the conversation group. matching user image matching step; a priority determining step of setting, as a highest priority, a user image of a user who is currently chatting or a user who has recently talked when at least a portion of the at least two user images overlap; and a user image display step of sequentially arranging and displaying each user image from the uppermost layer according to the set priority.

In addition, the priority determining step may include: a chat confirmation step of confirming whether to transmit at least one chat data among voices and texts of group users included in the chat group; and a prioritization step of giving priority in a descending order according to an order in which chat data is transmitted with the current time as the top priority.

In addition, in the prioritization step, when the chat data is voice, when the received voice is larger than the set reference size, it is determined that the group user from whom the corresponding voice was received has a conversation, and prioritizes the chat data. can be given

In addition, in the prioritization step, if the reception of the video of the group user determined to have a conversation is maintained, it is determined that the corresponding group user continues the conversation, and a priority may be given to the corresponding chatting data.

In addition, the user image display step may be displayed by sequentially adjusting the brightness of each user image according to a set priority.

In addition, in the step of displaying the user image, when there is no conversation for a predetermined time or more, the user image of the group user may be blinded with a semi-transparent effect.

In addition, the user image matching step may include: a target coordinate checking step of confirming the two-dimensional coordinates on which the head position of the corresponding avatar is projected in the virtual image of the camera coordinate system on which the virtual space of the three-dimensional coordinate system is projected; and a user image overlapping step of overlapping the corresponding user image on the two-dimensional coordinates of the corresponding virtual image.

In addition, the target coordinate checking step may include: an avatar location checking step of checking the location of the corresponding avatar in a three-dimensional virtual space; a relative position checking step of calculating the relative position of the head in the skeletal structure of the corresponding avatar; a head position checking step of calculating the 3D coordinates of the head by applying the relative position to the 3D coordinates of the corresponding avatar; and a projection coordinate confirmation step of confirming the two-dimensional coordinates on which the head position of the corresponding avatar is projected.

In addition, before the user image matching step, confirming the camera viewpoint of the target user in the virtual space, and a conversation group confirmation step of confirming whether a conversation group for users included in the virtual image of the corresponding camera viewpoint is included; can do.

In addition, the chat group checking step may include: a spatial area checking step of checking a spatial area partitioned for each setting in the virtual space; and a conversation group determination step of judging a user located in the same spatial area as the target user as a conversation group.

In addition, in the conversation group determination step, a conversation group participation restriction is set in at least a partial spatial area including the security area of the virtual space, and a user whose conversation participation right is removed from among users located in the corresponding spatial area is the corresponding conversation group can be excluded from

In addition, the present invention includes a storage medium in which a program for executing the method for displaying user image data in the metaverse-based office environment is recorded.

In addition, the present invention includes a system for displaying user image data including the storage medium in a metaverse-based office environment.

By means of the above solution, the present invention provides real-time information on the current situation of a participant (user) corresponding to a character (avatar) connected to the office environment in building an office environment in a three-dimensional virtual space based on the metaverse. By filming and overlapping the virtual image, it has the advantage of greatly improving the social ties in the virtual space pursued by the metaverse.

In particular, the present invention gives the highest priority to the user who is currently chatting or the user who has the last chat among users participating in the conversation group, and improves the concentration of the conversation group by placing an image of the user in the uppermost layer There are advantages to doing it.

In addition, the present invention has an advantage in that the concentration of the corresponding conversation group can be further improved by giving differentiation (brightness and contrast, etc.) to the user image of the corresponding group user according to the assigned priority.

In addition, the present invention receives the image data of the video camera photographed at a remote point, places it in a two-dimensional shape at the position of the character's head in the three-dimensional virtual space, and replaces the character's face with the user's image data taken in real time. It has the advantage of being able to simultaneously deliver additional information based on the other person's facial expressions or actions without being limited to text-based conversations.

Through this, the present invention has the advantage of being able to deliver information with a more accurate meaning by additionally checking visual information such as facial expressions, tones, and gestures between users as well as voice information of the conversation itself.

As a result, in the present invention, although each member (user) is online, it is possible to provide the same level of conversation as meeting and talking directly in the real world, and through this, the bond between members can be greatly improved. have.

In addition, the present invention sets up a conversation group that satisfies a certain condition among users accessing the virtual space, and enables conversation only within the conversation group, thereby avoiding problems such as information leakage occurring in the process of information delivery. has the advantage of preventing

In particular, even in the real world, there are cases in which other people hear the contents of the conversation, so information is leaked and spread, and in severe cases, rumors are created. However, in the present invention, this problem can be fundamentally prevented.

Accordingly, reliability and competitiveness can be improved in the metaverse field, virtual reality field, and virtual office field, as well as similar or related fields.

1 is a flowchart illustrating an embodiment of a method for displaying user image data in a metaverse-based office environment according to the present invention.
FIG. 2 is a flowchart illustrating a specific embodiment of step 'S200' shown in FIG. 1. Referring to FIG.
3 is a flowchart illustrating another embodiment of FIG. 1 .
4 is a flowchart illustrating a specific embodiment of FIG. 1 .
5 is a flowchart illustrating a specific embodiment of step 'S100' shown in FIG. 1 .
6 is a flowchart showing a specific embodiment of step 'S110' shown in FIG.
7 is a flowchart illustrating a specific embodiment of step 'S10' shown in FIG. 3 .
FIG. 8 is a view for explaining a process in which a display of a user image is changed according to FIG. 1 .

Examples of the method for displaying user image data in the metaverse-based office environment according to the present invention can be variously applied, and the most preferred embodiment will be described below with reference to the accompanying drawings.

First, the method for displaying user image data in the metaverse-based office environment of the present invention can be operated in a server/client system on the Internet, and the configuration for executing the method includes a desktop, a workstation, or a It may be any one of the stationary computing devices such as a server, and in addition to this, a smart phone, a laptop, a tablet, a phablet, a portable multimedia player , PMP), personal digital assistants (PDA), or portable computing devices such as E-book readers.

In addition, the method for displaying user image data in the metaverse-based office environment of the present invention may be executed in at least one configuration of a server or a client in a server/client system, and the process according to the method while at least two components are interlocked can be divided and distributed according to the operation method. In this case, of course, the client may include a user terminal used by the user as well as an administrator terminal excluding the server.

In addition, technical terms used in the process of describing the present invention should be interpreted as meanings generally understood by those of ordinary skill in the art to which the present invention belongs, unless otherwise defined in particular, It is natural that it should not be interpreted in a very comprehensive sense or in an excessively reduced meaning.

In addition, when the technical term used while describing the present invention is an incorrect technical term that does not accurately express the spirit of the present invention, it should be understood by being replaced with a technical term that can be correctly understood by those skilled in the art.

In addition, general terms used in the present invention should be interpreted as defined in advance or according to the context before and after, and should not be interpreted in an excessively reduced meaning.

Also, the singular expression used in describing the present invention may include the plural expression unless the context clearly dictates otherwise.

In addition, terms such as 'consisting' or 'having' should not be construed as necessarily including all of several elements or several steps, some of which may not be included, or It should be construed that additional components or steps may be further included.

In addition, terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various components, but the components should not be limited by the terms, and the terms may refer to one component as another component. It goes without saying that it is used only for the purpose of distinguishing it from an element.

For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

In addition, when it is said that a certain component is 'connected' or 'connected' to another component, it may be directly connected or connected to the other component, but other components may exist in between. have.

On the other hand, when it is mentioned that a certain element is 'directly connected' or 'directly connected' to another element, it should be understood that there is no other element in the middle.

Hereinafter, in describing the present invention with reference to the accompanying drawings, the same or similar components are assigned the same reference numerals regardless of reference numerals, and redundant description thereof will be omitted.

In addition, in describing the present invention, if it is determined that a detailed description of a related known technology may obscure the gist of the present invention, the detailed description thereof may be omitted.

In addition, the accompanying drawings are only for easy understanding of the spirit of the present invention, and should not be construed as limiting the spirit of the present invention by the accompanying drawings, and the spirit of the present invention includes all changes other than the accompanying drawings. , should be construed as extending to equivalents or substitutes.

1 is a flowchart illustrating an embodiment of a method for displaying user image data in a metaverse-based office environment according to the present invention.

Referring to FIG. 1 , the method for displaying user image data in a metaverse-based office environment includes a user image matching step ( S100 ), a priority determination step ( S200 ), and a user image display step ( S300 ).

First, in the present invention, in a metaverse-based office environment, a process of identifying users (group users) who can interact with a target user (the person) is checked, the camera viewpoint of the target user is confirmed in a virtual space, and the camera viewpoint is virtual You can check whether the chat group is included for the users included in the video.

The user image matching step (S100) is a process of matching the avatar of each group user included in the conversation group with the user image shot in real time of the group user. More specifically, as shown in FIG. You can match the user image of the corresponding user.

In the priority determination step (S200), as shown in FIG. 8 , in the process of displaying the user images of the group users participating in the conversation group, when at least some of the at least two user images overlap, the current conversational user or the most recent conversational user The user image of the user who has done it is set as the highest priority (eg, the user image indicated by the red box-shaped arrow in FIG. 8).

Thereafter, in the user image display step ( S300 ), as shown in the lower part of FIG. 8 , each user image may be sequentially arranged from the uppermost layer according to the set priority.

As described above, in addition to the sequential arrangement of layers according to priorities, the brightness of each user image may be sequentially adjusted and displayed according to the set priorities.

For example, a user image of a group user currently having a conversation may be displayed brighter than other group users.

As another example, the border of the user image of the group user currently chatting may be brightened or displayed in a different color.

And, when there is no conversation for a certain period of time or more, the user image of the corresponding group user is blindly processed with a semi-transparent effect, so that the user image of the group user displayed brightly can be focused.

FIG. 2 is a flowchart illustrating a specific embodiment of step 'S200' shown in FIG. 1. Referring to FIG.

Referring to FIG. 2 , the priority determination step ( S200 ) may include a chatting confirmation step ( S210 ) and a prioritization step ( S220 ).

First, in the chatting confirmation step ( S210 ), it is possible to check in real time whether or not chat data of at least one of the voices and texts of group users included in the corresponding chat group is transmitted.

Thereafter, according to the confirmed result, the current time may be given the highest priority, and the priority may be given in descending order according to the order in which the chat data is transmitted (S220).

For example, if there is a current chatting user, the highest priority may be given to the user image of the corresponding group user.

As another example, if there is no current chatting user, the highest priority may be given to the user image of the last chatting group user.

As a result, after giving the highest priority to a group user who is currently chatting, the current state can be maintained until another group user starts chatting.

As another example, according to the order of chatting from the past to the present time, the present time may be given the highest priority, and the priority may be given in descending order.

3 is a flowchart illustrating another embodiment of FIG. 1 .

Referring to FIG. 3 , before the user image matching step ( S100 ), the conversation group confirmation step ( S10 ) may be performed.

As described above, the conversation group confirmation step (S10) is a step of confirming users (group users) who can talk with the target user (the person) in the metaverse-based office environment, and confirms the target user's camera point of view in the virtual space It is a process of confirming whether a conversation group for users included in the virtual image of the corresponding camera point of view is included.

Here, the camera viewpoint may be based on the target user's avatar or the rear upper part of the target user's avatar, the virtual space may be formed based on a three-dimensional coordinate system, and the virtual image shown in FIG. 7 based on the camera viewpoint As an image output to the user's terminal as shown, it refers to an image in which three-dimensional coordinates of a virtual space are projected in two dimensions.

As a result, in the chat group confirmation step S10 , at least some users to be included in the chat group may be identified according to a predetermined condition among the avatars displayed on the terminal of the target user.

4 is a flowchart illustrating a specific embodiment of FIG. 1 .

First, in the process of moving the target user's avatar, image data (user image) of the plurality of users (remote users) included in the camera view of the corresponding avatar may be received (S11). In this case, the image data may be matched to the ID of the corresponding user.

Thereafter, after confirming whether the corresponding user is a conversational group with the target user (B) (S12), the corresponding image data may be discarded (S13) if not in the chatting group.

If the user is a conversation group of the target user (S12), select an avatar matching (indexed) the ID of the user, calculate the relative position and 3D position of the target (head), and then based on this It is possible to calculate the two-dimensional position of the virtual image to be projected, and to overlap the image data received at the corresponding position.

In other words, for users located in a specific space (or included in the camera view) in the metaverse-based office environment, after receiving the image data of each user, if the user is a conversation group, the image data is overlapped and if it is not a conversation group, the corresponding image data can be discarded.

Of course, it is natural that after checking whether the chat group is included, user images of users included in the chat group may be received and overlapped with the corresponding avatar.

These methods can be performed by selecting and applying an optimal method according to construction information (size, resolution, complexity, etc.) of the corresponding office environment, data processing method, and the needs of those skilled in the art.

In addition, in the process of matching the user image to the head of the avatar, when an image of a remote user is received, the user image is processed to image the necessary part as shown in FIG. 8 centered on the head of the user. It can be extracted, and the extracted image can be matched to the head of the corresponding avatar. In other words, by removing unnecessary images such as a background, the amount of data of a transmitted image can be minimized.

In this case, in extracting the image corresponding to the user's head, a certain image region may be extracted centering on the set feature points (eg, eyes or nose). When the image is extracted based on the feature point in this way, compared to the method of extracting the image based on the boundary line of the face, the amount of data calculation during image processing can be greatly reduced.

In this way, when the image area is extracted for the first time by the feature point, the extracted image area is fixed and overlapped regardless of the user's movement afterwards, so that the user's facial expression change and behavior (head movement, etc.) can be easily confirmed, Through this, more accurate meaning of conversation can be conveyed.

Thereafter, for group users included in the chat group, if the chat data is voice rather than text, it is checked whether sound (sound) data is received in real time, and when the sound data is received, the size is calculated (S201) ), when the received voice is greater than the set reference size (S202), it is determined that the group user from whom the corresponding voice is received has a conversation, and priority can be given to the corresponding chatting data (S204).

If the received sound data is smaller than the reference level (S202), it is determined that the corresponding sound is a noise sound, and the received sound data may be discarded (S13).

In addition, when the video reception of the group user determined to have been chatted is maintained (S203), it is determined that the group user continues the conversation, and priority can be given to the chatting data (S204), and the video reception is terminated If it is (S203), it is determined that the corresponding group user has departed, and the received sound data can be discarded (S13).

5 is a flowchart illustrating a specific embodiment of step 'S100' shown in FIG. 1 .

Referring to FIG. 5 , the user image matching step ( S100 ) includes a target coordinate checking step ( S110 ) and a user image overlapping step ( S120 ).

In the target coordinate confirmation step (S110), the virtual space of the three-dimensional coordinate system in which the metaverse-based office environment is constructed is projected on the display of the user terminal used by the user, in the virtual image of the camera coordinate system, the head position of the corresponding avatar is projected The process of confirming the two-dimensional coordinates that become

For example, as shown in FIG. 8 , when the user image of the corresponding user is overlapped with the head of the avatar, in the target coordinate check step S110, the 3D corresponding to the head of the avatar located in the 3D virtual space Two-dimensional coordinates are calculated by converting the coordinates into a two-dimensional coordinate system of a virtual image that is a projected flat image.

Thereafter, in the user image overlap step (S120), the user image is overlapped on the two-dimensional coordinates of the virtual image.

For example, if a user image is matched to the avatar head in a virtual space and then displayed, many calculations are required to adjust the size of the user image according to the movement of the avatar. If the dimensional coordinates are converted into two-dimensional coordinates and the user image is matched to the corresponding two-dimensional coordinates, only the coordinate transformation is calculated in the process, so the amount of data computation can be greatly reduced. can make it possible

Hereinafter, the process of converting 3D coordinates into 2D coordinates will be described in more detail.

6 is a flowchart showing a specific embodiment of step 'S110' shown in FIG.

First, when the target user accesses the metaverse-based office environment, the location of the avatar matched to the target user can be checked in the three-dimensional virtual space (S111).

In this case, the initial position of the avatar upon login may be the position at the time of previous logout or may include a set fixed position (eg, the front door of the virtual office, etc.).

Then, in the skeleton structure of the avatar, the reference position of the avatar and the relative position of the head are calculated (S112), and the 3D coordinates of the head can be calculated by applying the relative position to the 3D coordinates of the avatar (S113).

Meanwhile, the avatar may be set in various forms by the target user.

Accordingly, in the present invention, before the target coordinate checking step S110, the avatar setting information checking step of checking the setting information for the avatar of the corresponding group user confirmed in the chat group checking step S10 can be performed.

In other words, for the group user identified as the chat group in the chat group confirmation step ( S10 ), the set information of the corresponding group user is checked to confirm the appearance characteristics (skeleton) of the matched avatar, and based on this, the head of the avatar is checked. It is possible to calculate a relative position with respect to (S112).

Thereafter, the 3D coordinates of the head position of the corresponding avatar are checked (S113), the 2D coordinates on which the head position of the corresponding avatar is projected, and the position of the head (target) of the avatar displayed in the virtual image can be checked. (S114).

7 is a flowchart illustrating a specific embodiment of step 'S10' shown in FIG. 3 .

Referring to FIG. 7 , the talk group confirmation step S10 may include a spatial area confirmation step S15 and a talk group determination step S16 .

First, in the spatial area confirmation step S15, it is possible to check the spatial area partitioned for each setting in the virtual space. For example, in the space of the virtual office, it is possible to check the space area divided by use (conference room, hallway, lounge, etc.). As another example, the space of the virtual office may be divided into an area included in the camera view point and an area not included in the camera view point.

When the space in which the target user is located is identified and identified as described above, in the conversation group determination step S16, a user located in the same spatial area as the target user may be determined as the conversation group.

On the other hand, since the purpose of the metaverse-based office environment of the present invention is to build similarly to the real world, a single building created in a virtual space can be used by one company or, in some cases, a large number of companies or individuals can use it together. can

Accordingly, in the present invention, in forming a conversation group, basically, all users belonging to the entire space (the whole building) are given the right to form a conversation group (the right to participate in the conversation), and the conversation is performed by the method described above. You can join or leave the group.

However, in the area set as the security area of a specific company or individual, by granting the right to participate in the conversation only to users who are permitted to use the security area, even if a user without the right to participate in the conversation is located in the space, You can prevent them from participating in the conversation.

For example, in a meeting room of a specific company, by granting the right to participate in the conversation only to users who are employees of the company or users who are business partners, the contents of conversations are prevented from leaking to users unrelated to work and can improve security through this.

In other public spaces (for example, in a lounge or hallway), the right to participate in the conversation can be given so that all users can participate in the conversation, just like in the real world.

In other words, in the state that basically all users are given the right to participate in the conversation for all spaces, the conversation group participation limit is set in the area set as the secure area, and the conversation of the remaining users except for users who are matched by a specific team or affiliation, etc. By removing the participation right, only users of the team matched with the target user can participate in the conversation.

The method of displaying the user's image data in the metaverse-based virtual office environment described above may be implemented as a computer-readable code on a computer-readable recording medium.

Here, the computer-readable recording medium includes all types of recording devices in which data readable by the computer system is stored. For example, the computer-readable recording medium may include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In addition, the computer-readable recording medium may be distributed in a network-connected computer system, and the computer-readable code may be stored and executed in a distributed manner.

In addition, functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the technical field to which the present invention pertains.

In addition, the technical configuration of the present invention will be understood by those skilled in the art to which the present invention pertains to be implemented in other specific forms without changing the technical spirit or essential characteristics of the present invention.

Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (13)

In the process where users connected to a virtual space set as an office environment move through each spatial area of the virtual space partitioned into a plurality of spatial areas, a virtual corresponding to the camera view point of the target user among users located in the same spatial area as the target user a user image matching step of confirming whether the chat group for the users included in the video is included, and matching the avatar of each group user included in the chat group with the user video shot in real time of the group user;
a priority determining step of setting, as a highest priority, a user image of a user who is currently chatting or a user who has recently talked when at least a portion of the at least two user images overlap; and
A user image display step of sequentially arranging and displaying each user image from the top layer according to a set priority; a method for displaying user image data in a metaverse-based office environment, comprising: a.
The method of claim 1,
The prioritization step is
a chat confirmation step of confirming whether at least one chat data among voices and texts of group users included in the corresponding chat group is transmitted; and
A method for displaying user image data in a metaverse-based office environment, comprising: a prioritization step of giving priority in descending order according to the order in which the chat data is transmitted with the current time as the top priority.
3. The method of claim 2,
The prioritization step is
Metaverse-based, characterized in that when the chat data is voice and the received voice is larger than the set reference size, it is determined that the group user who received the corresponding voice has a conversation, and prioritizes the chat data A method of displaying user image data in the office environment of
4. The method of claim 3,
The prioritization step is
If the reception of the video of the group user determined to have a conversation is maintained, it is determined that the group user continues the conversation, and priority is given to the chatting data. Displaying user image data in a metaverse-based office environment Way.
The method of claim 1,
The user image display step,
A method for displaying user image data in a metaverse-based office environment, characterized in that the brightness of each user image is sequentially adjusted and displayed according to a set priority.
6. The method of claim 5,
The user image display step,
A method for displaying user image data in a metaverse-based office environment, characterized in that the user image of the corresponding group user is blindly processed with a semi-transparent effect when there is no conversation for a certain period of time.
The method of claim 1,
The user image matching step is,
a target coordinate checking step of confirming the two-dimensional coordinates on which the head position of the corresponding avatar is projected in the virtual image of the camera coordinate system on which the virtual space of the three-dimensional coordinate system is projected; and
A method for displaying user image data in a metaverse-based office environment, comprising: a user image overlap step of overlapping the corresponding user image on the two-dimensional coordinates of the virtual image.
8. The method of claim 7,
The target coordinate confirmation step is,
an avatar location checking step of checking the location of the corresponding avatar in a three-dimensional virtual space;
a relative position checking step of calculating the relative position of the head in the skeletal structure of the corresponding avatar;
a head position checking step of calculating the 3D coordinates of the head by applying the relative position to the 3D coordinates of the corresponding avatar; and
A method for displaying user image data in a metaverse-based office environment, comprising: a projection coordinate checking step of confirming the two-dimensional coordinates on which the head position of the corresponding avatar is projected.
The method of claim 1,
The user image matching step is,
setting a conversation group participation restriction in at least some spatial areas including a security area among the virtual spaces;
A method of displaying user image data in a metaverse-based office environment, characterized in that, among users located in the corresponding spatial area, users whose conversation participation rights have been removed are excluded from the corresponding conversation group.
A storage medium in which a program for executing the method of displaying user image data in the metaverse-based office environment of any one of claims 1 to 9 is recorded.
A system for displaying user image data in a metaverse-based office environment including the storage medium of claim 10 . delete delete

Images