KR20240054150A - Display apparatus and method for establishing private connections between users - Google Patents

Abstract

A method is provided for a display device to establish a private connection between users. The method displays a virtual space accessed by a plurality of users, wherein the virtual space includes a first avatar of the first user and a second avatar of the second user connected to the virtual space, and 1 Receive an image of the screen of the display device from the user's first terminal, the image includes the second avatar, and obtain identification information of the second avatar based on the image, Based on the identification information of the second avatar, a private connection request between the first terminal and the second terminal is transmitted to the second terminal of the second user, and acceptance of the private connection request is received from the second terminal. Based on this, it may include operations for establishing private communication between the first terminal and the second terminal.

Description

{DISPLAY APPARATUS AND METHOD FOR ESTABLISHING PRIVATE CONNECTIONS BETWEEN USERS}

A display device providing a virtual space service, a system providing a virtual space service, and a method for establishing a private connection in a virtual space service are provided.

Various technologies/techniques that display virtual spaces using computer graphics, such as virtual reality and augmented reality, are being developed. Users can be provided with a visually immersive virtual space through a display device, and can also use their avatar to participate in activities in the virtual space. Accordingly, various UX/UI and various algorithms that allow users to communicate using avatars in virtual space have recently been used. When multiple users use a virtual space, a method is needed to set up private communication for specific users in an intuitive and convenient way.

According to one aspect of the present disclosure, a method for a display device to establish a private connection between users may be provided. The method may include displaying a virtual space accessed by a plurality of users. The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space. The method may include receiving an image of a screen of the display device from the first terminal of the first user. The image may include the second avatar. The method may include obtaining identification information of the second avatar based on the image. The method may include transmitting a private connection request between the first terminal and the second terminal to the second terminal of the second user based on the identification information of the second avatar. The method may include establishing private communication between the first terminal and the second terminal based on receiving acceptance of a private connection request from the second terminal.

According to one aspect of the present disclosure, a display device that establishes a private connection between users may be provided. The display device includes a communication interface; display; a memory storing one or more instructions; and at least one processor executing the one or more instructions. The at least one processor may display a virtual space accessed by a plurality of users on the screen of the display by executing the one or more instructions. The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space. The at least one processor may receive an image of the screen of the display device from the first terminal of the first user through the communication interface by executing the one or more instructions. The image may include the second avatar. The at least one processor may obtain identification information of the second avatar based on the image by executing the one or more instructions. The at least one processor, by executing the one or more instructions, sends a private connection request between the first terminal and the second terminal to the second user through the communication interface, based on the identification information of the second avatar. Can be transmitted to the second terminal. The at least one processor may establish private communication between the first terminal and the second terminal based on receiving an acceptance of a private connection request from the second terminal by executing the one or more instructions.

According to one aspect of the present disclosure, a server that establishes a private connection between users may be provided. The server includes a communication interface; a memory storing one or more instructions; and at least one processor executing the one or more instructions. The at least one processor may transmit media content representing a virtual space accessed by a plurality of users to a display device by executing the one or more instructions. The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space. The at least one processor may receive an image of the screen of the display device from the first terminal of the first user through the communication interface by executing the one or more instructions. The image may include the second avatar. The at least one processor may obtain identification information of the second avatar based on the image by executing the one or more instructions. The at least one processor, by executing the one or more instructions, sends a private connection request between the first terminal and the second terminal to the second user through the communication interface, based on the identification information of the second avatar. Can be transmitted to the second terminal. The at least one processor may establish private communication between the first terminal and the second terminal based on receiving an acceptance of a private connection request from the second terminal by executing the one or more instructions.

According to one aspect of the present disclosure, a display device may provide a computer-readable recording medium on which a program for executing any one of the above and below-described methods for establishing a private connection between users is recorded.

FIG. 1 is a diagram schematically showing a display device providing a virtual space service according to an embodiment of the present disclosure.
Figure 2 is a diagram for explaining a private connection between user terminals according to an embodiment of the present disclosure.
FIG. 3 is a flowchart illustrating a method by which a display device establishes private communication according to an embodiment of the present disclosure.
Figure 4 is a flowchart for explaining the operation of a system for establishing a private connection between user terminals using a virtual space, according to an embodiment of the present disclosure.
FIG. 5 is a diagram illustrating a method for establishing a private connection between users in a virtual space, according to an embodiment of the present disclosure.
FIG. 6A is a diagram illustrating an operation of a display device receiving a private connection request from a first user terminal according to an embodiment of the present disclosure.
FIG. 6B is a diagram illustrating an operation of determining a second user avatar by a display device according to an embodiment of the present disclosure.
FIG. 7 is a diagram illustrating an operation in which a display device searches for an avatar by performing similarity analysis according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating the operation of a system for establishing a private connection between user terminals using a virtual space, according to an embodiment of the present disclosure.
FIG. 9 is a diagram illustrating an operation of a display device receiving private connection request acceptance information from a second user terminal according to an embodiment of the present disclosure.
FIG. 10 is a diagram for explaining an avatar scan mode of a user terminal according to an embodiment of the present disclosure.
FIG. 11 is a diagram illustrating an operation of a user terminal identifying an avatar using an avatar scan mode according to an embodiment of the present disclosure.
FIG. 12 is a diagram illustrating an operation of a user terminal selecting another user to request a private connection according to an embodiment of the present disclosure.
FIG. 13 is a diagram illustrating an operation of a display device acquiring identification information of a plurality of avatars according to an embodiment of the present disclosure.
Figure 14 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.
Figure 15 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.
Figure 16 is a block diagram showing the configuration of a server according to an embodiment of the present disclosure.
Figure 17 is a block diagram showing the configuration of an electronic device according to an embodiment of the present disclosure.
FIG. 18 is a diagram illustrating a system for providing a virtual space according to an embodiment of the present disclosure.

In the present disclosure, the expression “at least one of a, b, or c” refers to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b and c", or variations thereof.

The terms used in this disclosure are general terms that are currently widely used as much as possible while considering the functions in this disclosure, but this may vary depending on the intention or precedent of a person working in the art, the emergence of new technology, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the relevant description. Therefore, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of this disclosure, rather than simply the name of the term.

Singular expressions may include plural expressions, unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as generally understood by a person of ordinary skill in the technical field described herein. Additionally, terms including ordinal numbers such as 'first' or 'second' used in this specification may be used to describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When it is said that a part "includes" a certain element throughout the specification, this means that, unless specifically stated to the contrary, it does not exclude other elements but may further include other elements. Additionally, terms such as “unit” and “module” used in the specification refer to a unit that processes at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software.

Below, with reference to the attached drawings, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily implement the present invention. However, the present disclosure may be implemented in many different forms and is not limited to the embodiments described herein. In order to clearly explain the present disclosure in the drawings, parts that are not related to the description are omitted, and similar parts are given similar reference numerals throughout the specification. In addition, the reference numerals used in each drawing are only for explaining each drawing, and the different reference numerals used in each of the different drawings are not intended to indicate different elements. Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

FIG. 1 is a diagram schematically showing a display device providing a virtual space service according to an embodiment of the present disclosure.

Referring to FIG. 1, a display device 2000 according to one embodiment may display a virtual space. Media content representing a virtual space can be received from the server. The display device 2000 may include, but is not limited to, a TV, smart monitor, tablet PC, laptop, digital signage, large display, 360-degree projector, etc.

Virtual space refers to a virtual environment that users can access and experience using internet-connected devices such as computers, mobile devices, and virtual reality headsets. Users connected to the virtual space can explore the virtual space in various ways and interact with each other. The virtual space may be simulated as a two-dimensional world, or it may be simulated as a three-dimensional world.

In a virtual space, users can create an avatar, a digital representation of themselves, and interact with other avatars within the virtual environment. For example, users can move and explore virtual spaces, participate in events, communicate with other people, and perform various activities. For example, a first user may be active in a virtual space through a first user avatar, and a second user may be active in a virtual space through a second user avatar.

In one embodiment, the display device 2000 may establish a private connection between users using a virtual space. The display device 2000 may receive a private connection request for a second user from the first user terminal 110 and transmit the private connection request to the second user terminal 120. When private connection request acceptance information is received from the second user terminal 120, the display device 2000 may establish a private connection between the first user terminal 110 and the second user terminal 120.

Meanwhile, the virtual space provided by the display device 2000 may be various types of virtual space services.

In one embodiment, the display device 2000 may be a large display. A plurality of users can use the virtual space displayed on the display device 2000 together in the space where the display device 2000 is installed, or they can use the virtual space in their respective spaces where the display device 2000 is installed. For example, in cases such as seminars, exhibitions, group fitness, parties, conferences, etc., multiple users can participate in the displayed virtual space using avatars. Alternatively, other users located in another space may participate in the virtual space using an avatar.

In one embodiment, the user can control the avatar using the user terminal. Alternatively, the display device 2000 may photograph the user, track the user's movements, and allow the avatar to move.

Specific operations by which the display device 2000 establishes and provides a private connection between users using a virtual space will be described in more detail through drawings and descriptions described later.

Figure 2 is a diagram for explaining a private connection between user terminals according to an embodiment of the present disclosure.

In one embodiment, users using a virtual space can establish a private connection between user terminals and engage in private communication using the user terminal. Private communication is a type of conversation that takes place between two users in a secure and confidential manner. For example, when a private connection is established between a first user and a second user, a private communication conversation between the first user and the second user is displayed on the first user terminal 110 and the second user terminal. On the other hand, open communication between users in a virtual space may be displayed on the display device 2000.

Users using virtual spaces can send and receive various types of data, including text, images, voice messages, videos, and files, through private connections.

In the present disclosure, a first user requests a private connection from a second user through the first user terminal 110 and the display device 2000, and the second user requests a private connection through the second user terminal 120 and the display device 2000. Accepting a private connection through will be explained as an example. However, this is only an example for convenience of explanation, and the same inference can be applied to a second user requesting a private connection from a first user.

FIG. 3 is a flowchart illustrating a method by which a display device establishes private communication according to an embodiment of the present disclosure.

In step S310, the display device 2000 displays a virtual space accessed by a plurality of users.

In this disclosure, the avatar of the first user accessing the virtual space will be referred to as the first avatar, and the avatar of the second user will be referred to as the second avatar. Additionally, when the display device 2000 sets up private communication between users, an example in which the first user requests a private connection from the second user and the second user accepts the private connection will be described.

In step S320, the display device 2000 receives an image including a second avatar from the first user terminal 110.

In one embodiment, the display device 2000 may receive an image of an avatar from a terminal of a user using a virtual space. For example, a first user accessing a virtual space operates in the virtual space through a first avatar. When the first user wants to chat with another user in a virtual space through a private connection, the first user can capture a second avatar on the screen of the display device 2000 using the first user terminal 110. . Here, the second avatar refers to the avatar of the second user.

In step S330, the display device 2000 obtains identification information of the second avatar based on the image.

The display device 2000 may identify the second avatar included in the image received from the first user terminal 110. The avatar's identification information may include various information that can identify the avatar. Avatar identification information may include, for example, avatar profile information including an avatar name, avatar identification number, avatar appearance, etc., and user profile information, but is not limited thereto.

When the display device 2000 receives an image including a second avatar from the first user terminal 110, the display device 2000 may analyze the image and determine which avatar in the virtual space the avatar in the image corresponds to. The operation of the display device 2000 to analyze an image will be further described with reference to FIGS. 6A to 6B and FIG. 7 .

When the display device 2000 obtains the identification information of the second avatar received from the first user terminal 110, it identifies the second user who is the owner of the second avatar, and displays the second user terminal 120 of the second user. You can obtain information related to . For example, the display device 2000 obtains information necessary for a communication connection with the second user terminal 120, such as the IP address, MAC address, protocol, port number, authentication information, etc. can do.

In step S340, the display device 2000 transmits a private connection request to the second user terminal 120 of the second user based on the identification information of the second avatar.

The display device 2000 may transmit a private connection request to the second user terminal 120 to notify the second user that the first user has requested a private connection. As the second user terminal 120 receives a private connection request from the display device 2000, it may display an interface notifying the second user that a private connection request has been received from the first user. The second user may accept or reject the private connection in response to the received private connection request. The operation of the second user terminal 120 upon receiving a private connection request from the first user will be further described with reference to FIGS. 9 to 11.

When the second user accepts or rejects the private connection request, the second user terminal 120 may transmit a response to the private connection request to the display device 2000.

In step S350, the display device 2000 establishes private communication between the first user terminal 110 and the second user terminal 120 based on acceptance of the private connection request being received from the second user terminal 120. do.

The display device 2000 may operate as a communication intermediary between the first user terminal 110 and the second user terminal 120. For example, when the first user terminal 110 sends a message, it is transmitted to the display device 2000, and the display device 2000 can transmit the message to the second user terminal 120.

Alternatively, the display device 2000 may allow the first user terminal 110 and the second user terminal 120 to communicate through a server. The display device 2000 may send information about the first user terminal 110 and the second user terminal 120 to the server. In this case, the server may operate as an intermediary for private communication between the first user terminal 110 and the second user terminal 120.

In one embodiment, private communication between the first user and the second user may not be displayed on the display device 2000. That is, private communication between the first user and the second user can be displayed only on the first user terminal 110 and the second user terminal 120.

In one embodiment, open communication between a plurality of users, including a first user and a second user, connected to the virtual space may be displayed on the display device 2000.

In one embodiment, the display device 2000 may display the communication availability status of a plurality of avatars in a virtual space. For example, the display device 2000 may display a communication availability status corresponding to each avatar. For example, when a first user wants to request private communication from a second user, an indicator may be displayed on the second user avatar indicating that the private communication request is currently not possible. Indicators may be expressed in colors, icons, text, etc., but are not limited thereto. Specifically, if the second user is currently using private communication with another user, an indicator indicating that private communication cannot be requested or private communication is in use may be displayed on the second user avatar. Alternatively, if the second user has set a setting to reject private communication, an indicator indicating that private communication requests are not possible may be displayed on the second user avatar. Alternatively, when the second user is in a state in which private communication can be requested, an indicator indicating that private communication can be requested may be displayed on the second user avatar.

Figure 4 is a flowchart for explaining the operation of a system for establishing a private connection between user terminals using a virtual space, according to an embodiment of the present disclosure.

In one embodiment, a system implementing a virtual space may include at least a first user terminal 110, a second user terminal 120, a display device 2000, and a server 3000.

In one embodiment, the display device 2000 can display a virtual space. The first user may establish a connection between the display device 2000 and the device using the first user terminal 110 (S402). Additionally, the second user may establish a connection between the display device 2000 and the device using the second user terminal 120 (S404). Each user can operate in the virtual space using his or her own terminal. For example, the user can use the terminal to move the user's avatar within the virtual space, or use the terminal to communicate within the virtual space (eg, public chat).

The first user may request a private connection to a second user, another user using the virtual space. In this case, the first user terminal 110 transmits a private connection request to the display device 2000 (S406). The private connection request may include an image in which the first user captures the avatar of the user for whom the private connection is to be requested. For example, an image of a second avatar of a second user may be transmitted to the display device 2000.

Based on the private connection request being received from the first user terminal 110, the display device 2000 may search for an avatar that is the target of the private connection request in the virtual space (S408). For example, the display device 2000 may analyze an image including a second avatar and search for the second avatar in a virtual space. When a second avatar is searched in a virtual space, the display device 2000 may obtain identification information of the second avatar. Accordingly, the display device 2000 may obtain identification information of the second user terminal 120 using the virtual space through the second avatar.

The display device 2000 may transmit a private connection request to the second user terminal 120 (S410). The display device 2000 may transmit information related to the first user requesting a private connection to the second user terminal 120 while transmitting a request for a private connection to the second user terminal 120 . For example, the display device 2000 may transmit profile information of the first user and/or information related to the first avatar of the first user to the second user terminal 120 .

As a private connection request is received from the display device 2000, the second user terminal 120 may display an interface notifying the second user that a private connection request has been received from the first user. Using the second user terminal 120, the received private connection request can be accepted or rejected (S412).

The second user terminal 120 may transmit private connection request acceptance (or rejection) information to the display device 2000 (S414). The display device 2000 may transmit private connection acceptance information to the first user terminal 110 (S416). Alternatively, the second user terminal 120 may transmit private connection request acceptance information to the first user terminal 110 for peer-to-peer connection.

If the second user accepts the private connection request, the first user terminal 110 and the second user terminal 120 may enter the private connection mode, respectively (S418, S420). The first user terminal 110 and the second user terminal 120 may perform private communication through mutual private mode connection (S422).

Meanwhile, the display device 2000 according to one embodiment may communicate with the server 3000. The display device 2000 can transmit and receive data used in the above-described operations with the server 3000. In this case, at least part of the data processing performed in the above-described operations may be performed in the server 3000.

FIG. 5 is a diagram illustrating a method for establishing a private connection between users in a virtual space, according to an embodiment of the present disclosure.

The display device 2000 according to one embodiment may display a virtual space. In one embodiment, the display device 2000 that displays one virtual space may mean a plurality of display devices located in multiple spaces. For example, the display device 2000 may be located in the first space, and one or more users including the first user may use the virtual space through the display device 2000 located in the first space. Additionally, the display device 2000 may be located in the second space, displaying the same virtual space as the display device 2000 located in the first space, and one or more users including the second user may be located in the second space. The virtual space can be used through the displayed display device 2000.

Referring to FIG. 5 , the first screen 501 represents a virtual space screen displayed on the display device 2000 in real space where the first user is located. The first user can access the virtual space using the first user terminal 110. Additionally, the first user may be active in the virtual space through the first user avatar 510.

If there is an avatar with which he or she wishes to make a private connection among the avatars in the virtual space, the first user can apply for a private connection by taking a photo of the avatar using the first user terminal 110. For example, the first user may photograph the second user avatar 520 on the first screen 501. In this case, the display device 2000 may identify the avatar in the image received from the first user terminal 110 and transmit a private connection request to the second user who is the avatar owner.

The second screen 502 represents a virtual space displayed on the display device 2000 in a real space where the second user is located. The real space where the second user is located may be the same space as the real space where the first user is located, or it may be a different space.

When the second user terminal 120 receives a private connection request from the display device 2000, the second user terminal 120 may display a notification interface 530 notifying that the private connection request has been received. The notification interface 530 may be, but is not limited to, an icon, a notification window, or a portrait of an avatar requesting a private connection.

In one embodiment, the second user may accept the private connection request through the second user terminal 120. For example, the second user may select the notification interface 530 displayed on the second user terminal 120 and accept the private connection. Alternatively, the second user may scan the first user avatar 510 on the second screen 502. The second user scans the avatars displayed on the second screen 502 using the camera, clicks the first user avatar 510 that requested a private connection, or photographs the first user avatar 510 to accept the private connection. can do.

FIG. 6A is a diagram illustrating an operation of a display device receiving a private connection request from a first user terminal according to an embodiment of the present disclosure.

Referring to FIG. 6A, the first user may use the first user terminal 110 to photograph the second user avatar 610 displayed on the screen of the display device 2000 for which a private connection is requested. . The display device 2000 may receive an image 620 including a second user avatar 610 from the first user terminal 110.

In one embodiment, the first user may input a user input of touching the second user avatar 610 to the first user terminal 110 to specify the second user avatar 610. When a user input for the second user avatar 610 is received, the first user terminal 110 may transmit data related to the user input to the display device 2000. For example, the display device 2000 may obtain touch information 630 when the user touches the screen of the first terminal 110. Touch information may include, for example, screen touch coordinates, the size of the touch area, etc., but is not limited thereto.

The display device 2000 selects a second user within the virtual space displayed on the screen of the display device 2000 based on at least one of the image 620 and the screen touch information 630 received from the first user terminal 110. The avatar 610 can be identified. This is further described with reference to the following drawings.

FIG. 6B is a diagram illustrating an operation of a display device determining a second user avatar according to an embodiment of the present disclosure.

Referring to FIG. 6B, the display device 2000 may receive an image 620 and touch information 630 including a second user avatar. The display device 2000 may determine the avatar for which the first user requested a private connection within the screen of the display device 2000 based on the image 620 and the touch information 630.

The display device 2000 may analyze the similarity between the image 620 and the virtual space image displayed on the screen of the display device 2000. In one embodiment, the image 620 including the second user avatar received from the first user terminal 110 is an image captured using the camera of the first user terminal 110 rather than a screen capture image. . Therefore, unlike images obtained through screen capture, the shooting angle, shooting distance, etc. may be different for each shooting attempt. Accordingly, in order to search for which avatar the image 620 including the second user avatar is, the display device 2000 may perform similarity analysis.

Meanwhile, when the image 620 is captured and received from the first user terminal, the display device 2000 captures the entire screen image of the virtual space, collects location information for each avatar, and displays the display device 2000 and/or the server. It can be saved at (3000). The full screen image and location information for each avatar can be used in the process of determining the avatar.

The display device 2000 may search for an avatar area within the screen of the display device 2000 based on the image 620 received from the first terminal 110. That is, the display device 2000 can obtain information indicating which area of the screen of the display device 2000 was captured by the first terminal 110. For example, the display device 2000 may obtain global coordinates 640 of an area corresponding to the image 620 within the screen of the display device 2000 using similarity analysis. Specific examples of similarity analysis are further described with reference to FIG. 7.

The display device 2000 may obtain the coordinates of the second user avatar 610 on the screen of the display device 2000 using the global coordinates 640 and the touch coordinates 650. Touch coordinates 650 may be included in touch information 630.

For example, in the image displayed on the screen of the display device 2000, the global coordinates 640 of the area corresponding to the image 620 are (X _g , Y _g ), and the first user touches the image 620. When the touch coordinates 650 of the area are (X _i , Y _i ), ( It can be calculated as the sum of (650) (X=X _g +X _i , Y=Y _g +Y _i ). The display device 2000 may calculate the coordinates (X, Y) of the second user avatar 610 on the screen of the display device 2000 and convert them into real coordinates in the virtual space. For example, the display device 2000 can acquire 3D real coordinates within a virtual space for a 3D virtual space, and can acquire 2D real coordinates within a virtual space for a 2D virtual space.

The display device 2000 may determine the second user avatar 610 based on the acquired real coordinates in the virtual space. For example, the display device 2000 may determine the second user avatar 610 based on the location information of the virtual space and the actual coordinates of the second avatar in the virtual space. When the second user avatar 610 is determined, the display device 2000 may obtain identification information of the second user avatar 610. Avatar identification information may include, for example, avatar profile information including an avatar name, avatar identification number, avatar appearance, etc., and user profile information, but is not limited thereto.

When the second user avatar 610 is determined, the display device 2000 displays the second terminal 120 of the second user who is the owner of the second avatar 610 based on the identification information of the second user avatar 610. You can send a private connection request to .

FIG. 7 is a diagram illustrating an operation in which a display device searches for an avatar by performing similarity analysis according to an embodiment of the present disclosure.

In one embodiment, the display device 2000 may extract features in the image using the image feature extractor 730. The feature extractor 730 may be an artificial intelligence model that receives an image as input, extracts features in the image, and outputs them. The feature extractor 730 may be, for example, an artificial intelligence model using a deep learning algorithm such as a convolutional neural network, but is not limited thereto. The convolutional neural network of the feature extractor 730 may be implemented using various known deep learning architectures (e.g., VGG, ResNet, Inception, etc.) or through variations of various known deep learning architectures. Feature extractor 730 may be a software module that uses an algorithm to extract features from an image. The feature extractor 730 may use, for example, an algorithm such as Scale-Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), or Oriented FAST and Rotated BRIEF (ORB), but is not limited thereto.

The display device 2000 may input an image 710 including an avatar into the feature extractor 730 and extract avatar features 700. Avatar features may be, for example, features related to the appearance of the avatar that the user can customize. Specifically, the avatar features 700 may include, but are not limited to, hairstyle, hair color, skin color, worn items (eg, clothes, shoes, glasses, etc.). The display device 2000 may extract the features 740 of the search target avatar from the image 710 including the avatar using the feature extractor 730.

The display device 2000 may compare the features 740 of the search target avatar with previously stored avatar features 750. The pre-stored avatar features 750 may be saved when the user accesses a virtual space and creates an avatar, or may be saved when the user changes the features of the avatar.

The display device 2000 may perform similarity calculation 760 to determine the final avatar 770.

In one embodiment, the display device 2000 may obtain global coordinates of an area corresponding to the final avatar 770 in the virtual space displayed on the screen of the display device 2000. The display device 2000 may determine the final avatar 770 as the second user avatar based on the global coordinates and the touch coordinates received from the first terminal 110 and obtain avatar identification information. Since this was described above in FIG. 6B, repeated description will be omitted.

In one embodiment, if location information in the virtual space of the determined final avatar 770 can be obtained from the server 3000, the display device 2000 determines the final avatar 770 as the second user avatar and provides avatar identification information. You can obtain it right away.

When the display device 2000 obtains avatar identification information of the second user avatar, it may transmit a private connection request to the second user terminal 120.

FIG. 8 is a diagram illustrating the operation of a system for establishing a private connection between user terminals using a virtual space, according to an embodiment of the present disclosure.

In one embodiment, the display device 2000 may transmit a private connection request to the second user terminal 120 (S802). Since step S802 may correspond to step S410 of FIG. 4, repeated description is omitted.

As a private connection request is received from the display device 2000, the second user terminal 120 may display an interface notifying the second user that a private connection request has been received from the first user. For example, the second user terminal 120 may display an icon notifying that there is a private connection request on the screen of the second user terminal 120 (S804). Alternatively, the second user terminal 120 may display a notification window, a portrait of an avatar (first user avatar) requesting a private connection, etc., but is not limited thereto.

In one embodiment, the second user may accept the private connection request. Acceptance of the second user's private connection request may mean that the private request is immediately accepted by selecting an icon. Alternatively, the second user's acceptance of the private connection request may mean that the private connection request is accepted by selecting an icon and clicking an accept button. If the second user accepts the private connection, the second user terminal 120 may transmit private connection request acceptance (or rejection) information to the display device 2000 (S810). The display device 2000 may transmit private connection acceptance information to the first user terminal 110 (S812). Alternatively, the second user terminal 120 may transmit private connection request acceptance information to the first user terminal 110 for peer-to-peer connection. Additionally, if the second user accepts the private connection, the second user terminal 120 may enter the private connection mode (S816).

Alternatively, the second user may not immediately accept the private connection, but may execute a scan mode to search for the first user avatar. The second user may scan the avatar displayed on the screen of the display device 2000 using the second user terminal 120 (S806).

The second user terminal 120 may execute a scan mode to highlight the first user avatar when the user scans the screen of the display device 2000 (S808). When receiving a private connection request from the display device 2000, the second user terminal 120 may also receive information about the first user who requested a private connection. The first user's information may be, for example, profile information such as name, nickname, gender, age, nickname, hobbies, etc., but is not limited thereto. Additionally, when the second user terminal receives a private connection request from the display device 2000, it may also receive the features of the first user avatar that requested the private connection. Features of the first user avatar may include, but are not limited to, hairstyle, hair color, skin color, worn items (eg, clothes, shoes, glasses, etc.). While the second user executes the scan mode and the user scans the screen of the display device 2000, the second user terminal 120 executes the scan mode based on the image acquired through the camera preview screen and the features of the first user avatar. The first user avatar can be identified. In this case, the similarity analysis operation described above in FIG. 7 may be performed in the second user terminal 120. When the first user avatar is identified on the screen of the display device 2000, the second user terminal 120 may highlight the first user avatar to facilitate identification of the avatar of the first user requesting a private connection. The second user terminal 2000 may highlight the first user avatar and display information about the first user on the screen.

In one embodiment, the second user may accept the private connection request. Acceptance of the second user's private connection request may mean that the private request is immediately accepted by selecting the first user avatar found through scanning. Alternatively, accepting the second user's private connection request may mean accepting the private connection request by selecting the first user avatar and clicking an accept button.

If the second user accepts the private connection, the second user terminal 120 may transmit private connection request acceptance (or rejection) information to the display device 2000 (S810). The display device 2000 may transmit private connection acceptance information to the first user terminal 110 (S812). Alternatively, the second user terminal 120 may transmit private connection request acceptance information to the first user terminal 110 for peer-to-peer connection. Additionally, if the second user accepts the private connection, the second user terminal 120 may enter the private connection mode (S816).

Meanwhile, when private connection request acceptance information indicating that the second user has accepted the private connection request is received, the first user terminal 110 may enter the private connection mode (S814).

The first user terminal 110 and the second user terminal 120 may perform private communication through a private mode connection (S818).

FIG. 9 is a diagram illustrating an operation of a display device receiving private connection request acceptance information from a second user terminal according to an embodiment of the present disclosure.

Referring to FIG. 9 , when the second user terminal 120 receives a private connection request from the display device 2000, it may display a notification interface 900 notifying that the private connection request has been received. For example, the notification interface 900 may be an icon of a user avatar requesting a private connection, but is not limited thereto.

In one embodiment, the second user who has received a private connection request may accept the private connection request by selecting the notification interface 900 displayed on the screen of the second user terminal 120.

In one embodiment, the second user may not immediately accept the private connection request, but may check the avatar of the first user who requested the private connection, or check the first user's information and accept the private connection request. In this case, the second user 2000 may execute the avatar scan mode. Avatar scan mode can be implemented in a variety of ways.

For example, the second user may click an avatar scan mode execution button separately displayed on the second user terminal 120 to cause the second user terminal 120 to enter the scan mode. For example, the second user touches the notification interface 900 displayed on the second user terminal 120 for longer than a preset time or swipes the notification interface 900 so that the second user terminal 120 You can enter scan mode. The scan mode of the second user terminal 120 will be further described with reference to FIG. 10.

FIG. 10 is a diagram for explaining an avatar scan mode of a user terminal according to an embodiment of the present disclosure.

In one embodiment, the second user may execute a scan mode and scan the screen of the display device 2000 to accept the first user's private connection request.

The second user can move the second user terminal 120 left and right and scan the avatar displayed on the screen of the display device 2000. In this case, the second user terminal 120 may identify the first user avatar 1010 that requested a private connection based on the preview image obtained through the camera.

When the first user avatar 1010 is identified, the second user terminal 120 highlights the first user avatar 1010, allowing the second user to recognize the avatar of the first user who requested a private connection. You can.

A specific operation by which the second user terminal 120 identifies the first user avatar 1010 will be further described with reference to FIG. 11 .

FIG. 11 is a diagram illustrating an operation of a user terminal identifying an avatar using an avatar scan mode according to an embodiment of the present disclosure.

Referring to FIG. 11, when transmitting a private connection request to the second user terminal 120, the display device 2000 provides an avatar feature 1102 and first user information 1104 of the first user requesting a private connection. 2 Can be transmitted together to the user terminal 120.

The first user's avatar features 1102 may be features related to the appearance of the avatar. For example, it may include, but is not limited to, hairstyle, hair color, skin color, worn items (e.g., clothes, shoes, glasses, etc.).

The first user information 1104 may be, for example, profile information such as name, nickname, gender, age, nickname, and hobby, but is not limited thereto.

In one embodiment, the second user terminal 120 may identify the first user avatar while scanning the screen of the display device 2000 through a scan mode. The second user terminal 120 may obtain a virtual space image displayed on the screen of the display device 2000 from the display device 2000 and perform similarity analysis with the camera image 1110 acquired through the camera.

The second user terminal 120 may extract features of an avatar existing in the camera image 1110 from the camera image 1110 .

For example, the second user terminal 120 may extract features of the avatar in the camera image 1110 using an artificial intelligence model using a deep learning algorithm such as a convolutional neural network. Examples of convolutional neural networks may be VGG, ResNet, Inception, etc., but are not limited thereto.

For example, the second user terminal 120 may extract the features of the avatar in the camera image 1110 using an algorithm for extracting features from the image. Examples of feature extraction algorithms may include Scale-Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), and Oriented FAST and Rotated BRIEF (ORB), but are not limited thereto.

The second user terminal 120 may determine the first user avatar by performing similarity analysis between the avatar features extracted from the camera image 1110 and the avatar features 1102 of the first user received from the display device 2000. there is. For example, the second user terminal 120 may calculate the similarity between features and, if the similarity is greater than or equal to a preset value, determine that the avatar existing in the camera image 1110 is the first user avatar.

When the second user terminal 120 determines the first user avatar, it may generate a highlight image 1120 to highlight the first user avatar. The second user terminal 120 may overlap the highlight image 1120 on the first user avatar, allowing the second user to recognize the first user avatar. In this case, the second user terminal 120 may also display the first user public information 1130. Elements of the first user public information 1130 may be different for each user. For example, when the first user sets at least part of the first user information 1104 to private, only information excluding the private information among the first user information 1104 will be included in the first user public information 1130. You can.

The second user may check the avatar of the first user who requested a private connection, or check the first user's information and accept the private connection request. In this case, private connection request acceptance information may be transmitted to the display device 2000.

FIG. 12 is a diagram illustrating an operation of a user terminal selecting another user to request a private connection according to an embodiment of the present disclosure.

In one embodiment, the first user who wishes to request a private connection is an avatar who wishes to request a private connection on the screen of the display device 2000 using the first user terminal 110, as described in the previous drawings. You can initiate a private connection request by shooting . In some cases, when the first user captures the screen of the display device 2000, avatars may overlap. For example, Avatar A (1210), Avatar B (1220), and Avatar C (1230) may overlap. In this case, the first user terminal 110 may display an avatar list 1240. In this case, the first user terminal 110 can additionally receive a user input for selecting one of a plurality of avatars and confirm the other party with whom the user wishes to make a private connection.

In one embodiment, the display device 2000 obtains identification information of a plurality of avatars in order to enable the first user terminal 110 to display the avatar list 1240, and sends the identification information of the plurality of avatars to the first user. It can be transmitted to the terminal 110. In this case, the first user terminal 110 may generate and display an avatar list 1240 based on identification information of a plurality of avatars. The display device 2000 may determine a second avatar to establish a private connection based on a user input for selecting one of a plurality of avatars. The operation of the display device 2000 to obtain identification information of a plurality of avatars will be further described with reference to FIG. 13 .

In one embodiment, identification information of a plurality of avatars may be obtained by the first terminal 110. The first terminal 110 may obtain pre-stored avatar features from the display device 2000, extract the avatar features from the image captured by the first terminal 110, and calculate the degree of similarity between the avatar features. The first terminal may obtain identification information of a plurality of avatars by performing similarity analysis of avatar features. For example, the first terminal 110 may obtain identification information of avatar A (1210), identification information of avatar B (1220), and identification information of avatar C (1230). The first terminal 110 may generate and display an avatar list 1240 based on identification information of a plurality of avatars. In this case, the display device 2000 may determine a second avatar to establish a private connection based on a user input for selecting one of a plurality of avatars.

FIG. 13 is a diagram illustrating an operation of a display device acquiring identification information of a plurality of avatars according to an embodiment of the present disclosure.

Referring to FIG. 13, the display device 2000 may receive an image 1310 and touch information 1320 including a second user avatar. The display device 2000 may determine the avatar for which the first user requested a private connection within the screen of the display device 2000 based on the image 1310 and the touch information 1320.

The display device 2000 may analyze the similarity between the image 1310 and the virtual space image displayed on the screen of the display device 2000. In one embodiment, the image 1310 including the second user avatar received from the first user terminal 110 may include a plurality of avatars of other users in addition to the second user avatar. Hereinafter, for convenience of explanation, the second user avatar and a plurality of avatars of other users are collectively referred to as a plurality of avatars 1302, 1304, and 1306. When the image 1310 includes a plurality of avatars 1302, 1304, and 1306, the display device 2000 uses a plurality of avatars to determine a second user avatar among the plurality of avatars 1302, 1304, and 1306. Identification information of the avatars 1302, 1304, and 1306 may be obtained and transmitted to the first user terminal 110.

Meanwhile, when the image 1310 is captured and received from the first user terminal, the display device 2000 captures the entire screen image of the virtual space, collects location information for each avatar, and displays the display device 2000 and/or the server. It can be saved at (3000). The full screen image and location information for each avatar can be used in the process of determining the avatar.

The display device 2000 may search for an avatar area within the screen of the display device 2000 based on the image 1310 received from the first terminal 110. That is, the display device 2000 can obtain information indicating which area of the screen of the display device 2000 was captured by the first terminal 110. For example, the display device 2000 may obtain global coordinates 1330 of an area corresponding to the image 1310 within the screen of the display device 2000 using similarity analysis. Since the specific operation of the similarity analysis was described above in the description of FIG. 7, repeated descriptions are omitted for brevity.

The display device 2000 can obtain the coordinates of an area corresponding to the image received from the first user terminal 110 within the screen of the display device 2000 using the global coordinates 1330 and the touch coordinates 1340. there is. Touch coordinates 1340 may be included in touch information 1320.

For example, in the image displayed on the screen of the display device 2000, the global coordinates 1330 of the area corresponding to the image 1310 are (X _g , Y _g ), and the area touched by the first user in the image 1310 is When the touch coordinates 1340 of the area are (X _i , Y _i ), (X, Y), which are the area coordinates selected by the first user based on the screen of the display device 2000, are the global coordinates 1330 and the touch coordinates It can be calculated as the sum of (1340) (X=X _g +X _i , Y=Y _g +Y _i ). The display device 2000 may calculate the coordinates (X, Y) of the area selected by the first user based on the screen of the display device 2000 and convert them into real coordinates in virtual space. For example, the display device 2000 can acquire 3D real coordinates within a virtual space for a 3D virtual space, and can acquire 2D real coordinates within a virtual space for a 2D virtual space.

The display device 2000 may obtain identification information of a plurality of avatars 1302, 1304, and 1306 based on the actual coordinates within the acquired virtual space. For example, the display device 2000 may determine a plurality of avatars 1302, 1304, and 1306 based on location information in virtual space and actual coordinates in virtual space of the area selected by the first user. When the plurality of avatars 1302, 1304, and 1306 are determined, the display device 2000 may obtain identification information of the plurality of avatars 1302, 1304, and 1306. Avatar identification information may include, for example, avatar profile information including an avatar name, avatar identification number, avatar appearance, etc., and user profile information, but is not limited thereto.

When the display device 2000 obtains the identification information of the plurality of avatars 1302, 1304, and 1306, the display device 2000 may transmit the identification information of the plurality of avatars 1302, 1304, and 1306 to the first user terminal 110. . In this case, the first user terminal 110 creates a list of the plurality of avatars 1302, 1304, and 1306 based on the identification information of the plurality of avatars 1302, 1304, and 1306. can be displayed on the screen.

The display device 2000 may receive information representing a user input for selecting one of a plurality of avatars 1302, 1304, and 1306 from the first user terminal 110. The display device 2000 may determine a second avatar to establish a private connection based on the user input received from the first user terminal 110. In this case, the display device 2000 may transmit a private connection request to the second terminal 120 of the second user who is the owner of the second avatar.

Figure 14 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

In one embodiment, the display device 2000 may include a communication interface 2100, a display 2200, a memory 2300, and a processor 2400.

The communication interface 2100 may include a communication circuit. The communication interface 2100 may include, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, ZigBee, Wi-Fi Direct (WFD), and infrared communication (IrDA). infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet, Wibro), WiMAX (World Interoperability for Microwave Access, WiMAX), SWAP (Shared Wireless Access Protocol), WiGig It may include a communication circuit capable of performing data communication between the display device 2000 and other devices using at least one of data communication methods including (Wireless Gigabit Alliances, WiGig) and RF communication.

The communication interface 2100 can transmit and receive data for performing the operation of the display device 2000 with an external electronic device. For example, the display device 2000 transmits various data that the display device 2000 uses to establish a private connection between user terminals to an external electronic device (e.g., a user terminal, a server) through the communication interface 2100. etc.) can be sent and received.

The display 2200 may output an image signal on the screen of the display device 2000 under the control of the processor 2400. For example, the display device 2000 may output media content representing a virtual space through the display 2200.

The memory 2300 may store instructions, data structures, and program codes that the processor 2400 can read. There may be more than one memory 2300. In the disclosed embodiments, operations performed by the processor 2400 may be implemented by executing instructions or codes of a program stored in the memory 2300.

The memory 2300 includes read-only memory (ROM) (e.g., programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)), and flash memory. Non-volatile memory such as (Flash memory) (e.g., memory card, solid-state drive (SSD)) and analog recording types (e.g., hard disk drive (HDD), magnetic tape, optical disk), and RAM It may include volatile memory such as random-access memory (e.g., dynamic random-access memory (DRAM), static random-access memory (SRAM)).

The processor 2400 may control overall operations of the display device 2000. For example, the processor 2400 executes one or more instructions of a program stored in the memory 2300, thereby controlling the overall operations of the display device 2000 to establish a private connection between user terminals. . There may be more than one processor 2400.

The processor 2400 may perform the operations of the above-described embodiment. For example, when a private connection request is received from the first user terminal 110, the processor 2400 may identify the second user avatar that is the target of the private connection and transmit the private connection request to the second user terminal 120. . In order to identify the second user avatar, the processor 2400 extracts the features of the avatar in the image based on the image received for the private connection request from the first user terminal 110 and performs similarity analysis between the avatar features. can do. Since the specific operations of the processor 2400 have been described above, repeated descriptions are omitted for brevity.

One or more processors 2400 may include a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), and a Neural Processing Unit (NPU). It can contain at least one. One or more processors 2400 may be implemented in the form of an integrated system-on-chip (SoC) including one or more electronic components. Each of the one or more processors 2400 may be implemented as separate hardware (H/W).

When the method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one processor 2400 or may be performed by a plurality of processors 2400. For example, when the first operation, the second operation, and the third operation are performed by the method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor. , the first operation and the second operation may be performed by a first processor (eg, a general-purpose processor) and the third operation may be performed by a second processor (eg, an artificial intelligence-specific processor). Here, an example of the second processor may be an artificial intelligence-specific processor, and the artificial intelligence-specific processor may perform operations for training/inference of an artificial intelligence model. However, embodiments of the present disclosure are not limited thereto.

One or more processors 2400 according to the present disclosure may be implemented as a single-core processor or a multi-core processor.

When the method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core or by a plurality of cores included in one or more processors 2400. .

Figure 15 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

In one embodiment, the display device 2000 includes a communication interface 2100, a display 2200, a memory 2300, a processor 2400, a camera 2500, a video processing module 2600, and an audio processing module 2700. , may include a power module 2800 and an input/output interface 2900.

The communication interface 2100, display 2200, memory 2300, and processor 2400 of FIG. 15 are respectively connected to the communication interface 2100, display 2200, memory 2300, and processor 2400 of FIG. 14. Since they correspond, repeated descriptions are omitted.

The camera 2500 may acquire video and/or images by photographing a space and/or an object. There may be more than one camera 2500. The camera 2500 may include, for example, an RGB camera, a depth camera, an infrared camera, etc., but is not limited thereto.

In one embodiment, the display device 2000 may use the camera 2500 to identify a user using the display device 2000 and create an avatar for the user. The display device 2000 may use the camera 2500 to place the user's avatar created based on the identified user in a virtual space. Since the specific type and detailed functions of the camera 2500 can be clearly deduced by a person skilled in the art, descriptions are omitted.

The video processing module 2600 processes video data played by the display device 2000. The video processing module 2600 can perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on video data. The display 2200 may generate a driving signal by converting the image signal, data signal, OSD signal, and control signal processed by the processor 2400, and display the image according to the driving signal.

The audio processing module 2700 performs processing on audio data. In the audio processing module 2700, various processes such as decoding, amplification, noise filtering, etc. may be performed on audio data. Meanwhile, the audio processing module 2700 may include a plurality of audio processing units to process audio corresponding to a plurality of contents.

The power module 2800 supplies power input from an external power source to components within the display device 2000 under the control of the processor 2400. Additionally, the power module 2800 may supply power output from one or more batteries (not shown) located inside the display device 2000 to internal components under the control of the processor 2400.

The input/output interface 2900 receives video (e.g., video, etc.), audio (e.g., voice, music, etc.), and additional information (e.g., EPG, etc.) from the outside of the display device 1200. Receive. The input/output interface 2900 includes HDMI (High-Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, and VGA (Video Graphics Array). ) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), component jack, or PC port. The display device 2900 may be connected to one or more speakers through the input/output interface 2900.

Figure 16 is a block diagram showing the configuration of a server according to an embodiment of the present disclosure.

In one embodiment, the server 3000 may include a communication interface 3100, a memory 3200, and a processor 3300.

The communication interface 3100 may include a communication circuit. The communication interface 3100 may be used among long-distance data communication methods including, for example, wired LAN, wireless LAN, Wi-Fi, Long-Term Evolution (LTE), 5G, satellite communication, and radio communication. It may include a communication circuit capable of performing data communication between the server 3000 and other devices using at least one. For example, the server 3000 may perform data communication with the display device 2000 and/or the user terminal.

The memory 3200 includes read-only memory (ROM) (e.g., programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)), and flash memory. Non-volatile memory such as (Flash memory) (e.g., memory card, solid-state drive (SSD)) and analog recording types (e.g., hard disk drive (HDD), magnetic tape, optical disk), and RAM It may include volatile memory such as random-access memory (e.g., dynamic random-access memory (DRAM), static random-access memory (SRAM)).

The processor 3300 can control the overall operations of the server 3000. For example, the processor 3300 can control overall operations for the display device 2000 to establish a private connection between user terminals by executing one or more instructions of a program stored in the memory 3200. . There may be more than one processor 3300.

The processor 3300 may provide a virtual space to the display device 2000 and/or the user terminal. In this case, the display device 2000 and/or the user terminal may have a client application installed to provide a virtual space.

In one embodiment, the operations of the display device 2000 described above may be performed in a server. The server 3000 may obtain an image of the screen of the display device 2000. An image of the screen of the display device 2000 may be obtained from the display device 2000 and/or the first user terminal 110. An image captured on the screen of the display device 2000 indicates that the first user has requested a private connection from the second user. Accordingly, the image acquired by the server 3000 may include a second user avatar.

The server 3000 may obtain identification information of the second user avatar based on the image including the second user avatar. The server 3000 may analyze the image to extract features and obtain identification information of the avatar in the image.

The server 3000 sends a private connection request for establishing a private connection between the first user terminal 110 and the second user terminal 120 to the display device 2000 and/or based on the identification information of the second user avatar. It can be transmitted to the second user terminal 120.

The server 3000 may establish private communication between the first user terminal 110 and the second user terminal 120 based on receiving acceptance of the private connection request from the second user terminal 120. In this case, the server 3000 may operate as a communication intermediary between the first user terminal 110 and the second user terminal 120.

Other additional and detailed operations for the server 3000 to establish a private connection between users using the virtual space can be applied in the same manner as the operations of the display device 2000 and/or the user terminal described in the previous drawings, thereby ensuring brevity. For this reason, repeated explanations are omitted.

Figure 17 is a block diagram showing the configuration of an electronic device according to an embodiment of the present disclosure.

In one embodiment, the electronic device 4000 may include a communication interface 4100, a display 4200, a camera 4300, a memory 4400, and a processor 4500. The electronic device 4000 corresponds to the user terminal described in the above drawings. The electronic device 4000 may be, for example, a desktop, laptop, smartphone, tablet, virtual reality headset, etc., but is not limited thereto.

The communication interface 4100 may include a communication circuit. The communication interface 4100 includes, for example, wired LAN, wireless LAN, Wi-Fi, Bluetooth, ZigBee, Wi-Fi Direct (WFD), and infrared communication (IrDA, infrared Data Association), BLE (Bluetooth Low Energy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet, Wibro), WiMAX (World Interoperability for Microwave Access, WiMAX), SWAP (Shared Wireless Access Protocol), WiGig Data communication between the electronic device 4000 and other devices (e.g., display device 2000, server 3000) using at least one of data communication methods including (Wireless Gigabit Alliances, WiGig) and RF communication. It may include a communication circuit that can perform.

The display 4200 may output an image signal on the screen of the electronic device 4000 under the control of the processor 4500. For example, the electronic device 4000 may output media content representing a virtual space through the display 4200.

The camera 4300 may obtain an image by photographing an avatar on the screen of the display device 2000. For example, the user of the electronic device 4000 may use the camera 4300 to photograph another user's avatar displayed on the screen of the display device 2000 in order to request a private connection with another user. There may be more than one camera 4300. Since the specific type and detailed functions of the camera 4300 can be clearly deduced by a person skilled in the art, descriptions are omitted.

The memory 4400 may store instructions, data structures, and program codes that the processor 4500 can read. There may be more than one memory 4400. In the disclosed embodiments, operations performed by the processor 4500 may be implemented by executing instructions or codes of a program stored in the memory 4400.

The memory 4400 includes read-only memory (ROM) (e.g., programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM)), and flash memory. Non-volatile memory such as (Flash memory) (e.g., memory card, solid-state drive (SSD)) and analog recording types (e.g., hard disk drive (HDD), magnetic tape, optical disk), and RAM It may include volatile memory such as random-access memory (e.g., dynamic random-access memory (DRAM), static random-access memory (SRAM)).

The processor 4500 may control overall operations of the electronic device 4000. For example, the processor 4500 can control overall operations for the electronic device 4000 to request/accept a private connection between users by executing one or more instructions of a program stored in the memory 4400. there is. There may be more than one processor 4500. Operations for the electronic device 4000 to request/accept a private connection between users have been described above in the description of the user terminal in the previous drawings, so repeated descriptions will be omitted.

FIG. 18 is a diagram illustrating a system for providing a virtual space according to an embodiment of the present disclosure.

Referring to FIG. 18, a virtual space providing system according to an embodiment may include a display device 2000, a server 3000, and an electronic device 4000. There may be one or more display devices 2000 and electronic devices 4000.

The display device 2000 according to one embodiment may be one or more devices connected to a virtual space service provided by the server 3000. The virtual space service provided by the server 3000 according to one embodiment can be displayed on the display device 2000, and a plurality of users can participate in the virtual space service using their electronic devices 4000. In this case, the server 3000 that provides the virtual space may be connected to the display device 2000 and/or the electronic device 4000.

Each of the display devices 2000 connected to the virtual space service may display the same virtual space and may be located in different real spaces. Additionally, each user of the electronic devices 4000 may be located in a real space where each display is located.

The virtual space provision system according to one embodiment may establish a private connection between users using the virtual space service according to the above-described embodiment. Since the specific operations of the display device 2000, the server 3000, and the electronic device 4000 have been described above, repeated descriptions will be omitted.

The present disclosure provides a method for establishing a private connection between users for a plurality of users using a virtual space. The technical problems to be achieved in the present disclosure are not limited to those mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description of this specification. There will be.

According to one aspect of the present disclosure, a method for a display device to establish a private connection between users may be provided.

The method may include displaying a virtual space accessed by a plurality of users.

The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space. The method may include receiving an image of a screen of the display device from the first terminal of the first user.

The image may include the second avatar.

The method may include obtaining identification information of the second avatar based on the image.

The method may include transmitting a private connection request between the first terminal and the second terminal to the second terminal of the second user based on the identification information of the second avatar.

The method may include establishing private communication between the first terminal and the second terminal based on receiving acceptance of a private connection request from the second terminal.

The method may include receiving a user input about the second avatar in the image from the first terminal.

Obtaining identification information of the second avatar may include obtaining identification information of the second avatar based on the user input.

Obtaining identification information of the second avatar may include extracting features of the second avatar in the image.

Obtaining identification information of the second avatar may include determining the second avatar by comparing features of the second avatar with features of previously stored avatars.

The features of the pre-stored avatars may be stored when the user's avatar accesses the virtual space.

The step of transmitting the private connection request to the second terminal of the second user may include transmitting information about the first user who requested the private connection to the second terminal.

Transmitting the private connection request to the second terminal of the second user may include transmitting features of the first avatar to the second terminal.

Obtaining identification information of the second avatar may include obtaining identification information of a plurality of avatars in the image.

Obtaining identification information of the second avatar may include transmitting identification information of the plurality of avatars to the first terminal.

Obtaining identification information of the second avatar may include determining the second avatar based on a user input selecting one of the plurality of avatars from the first terminal.

The private communication may be displayed only on the first terminal and the second terminal.

Public communications of the plurality of users may be displayed on the display device.

The method may include displaying a communication availability status of a plurality of avatars in the virtual space.

According to one aspect of the present disclosure, a display device that establishes a private connection between users may be provided.

The display device includes a communication interface; display; a memory storing one or more instructions; and at least one processor executing the one or more instructions.

The at least one processor may display a virtual space accessed by a plurality of users on the screen of the display by executing the one or more instructions.

The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space.

The at least one processor may receive an image of the screen of the display device from the first terminal of the first user through the communication interface by executing the one or more instructions.

The image may include the second avatar.

The at least one processor may obtain identification information of the second avatar based on the image by executing the one or more instructions.

The at least one processor, by executing the one or more instructions, sends a private connection request between the first terminal and the second terminal to the second user through the communication interface, based on the identification information of the second avatar. Can be transmitted to the second terminal.

The at least one processor may establish private communication between the first terminal and the second terminal based on receiving an acceptance of a private connection request from the second terminal by executing the one or more instructions.

The at least one processor may receive a user input for the second avatar in the image from the first terminal by executing the one or more instructions.

The at least one processor may obtain identification information of the second avatar based on the user input by executing the one or more instructions.

The at least one processor may extract features of the second avatar in the image by executing the one or more instructions.

By executing the one or more instructions, the at least one processor may determine the second avatar by comparing features of the second avatar with features of previously stored avatars.

The features of the pre-stored avatars may be stored when the user's avatar accesses the virtual space.

The at least one processor may transmit information about the first user requesting the private connection to the second terminal through the communication interface by executing the one or more instructions.

The at least one processor may transmit the features of the first avatar to the second terminal through the communication interface by executing the one or more instructions.

The at least one processor may obtain identification information of a plurality of avatars in the image by executing the one or more instructions.

The at least one processor may transmit identification information of the plurality of avatars to the first terminal by executing the one or more instructions.

The at least one processor may determine the second avatar based on a user input for selecting one of the plurality of avatars from the first terminal by executing the one or more instructions.

According to one aspect of the present disclosure, a server that establishes a private connection between users may be provided. The server includes a communication interface; a memory storing one or more instructions; and at least one processor executing the one or more instructions.

The at least one processor may transmit media content representing a virtual space accessed by a plurality of users to a display device by executing the one or more instructions.

The virtual space may include a first avatar of the first user and a second avatar of the second user connected to the virtual space.

The at least one processor may receive an image of the screen of the display device from the first terminal of the first user through the communication interface by executing the one or more instructions.

The image may include the second avatar.

The at least one processor may obtain identification information of the second avatar based on the image by executing the one or more instructions.

The at least one processor, by executing the one or more instructions, sends a private connection request between the first terminal and the second terminal to the second user through the communication interface, based on the identification information of the second avatar. Can be transmitted to the second terminal.

The at least one processor may establish private communication between the first terminal and the second terminal based on receiving an acceptance of a private connection request from the second terminal by executing the one or more instructions.

The at least one processor may receive a user input for the second avatar in the image from the first terminal by executing the one or more instructions.

The at least one processor may obtain identification information of the second avatar based on the user input by executing the one or more instructions.

The at least one processor may extract features of the second avatar in the image by executing the one or more instructions.

By executing the one or more instructions, the at least one processor may determine the second avatar by comparing features of the second avatar with features of previously stored avatars.

The features of the pre-stored avatars may be stored when the user's avatar accesses the virtual space.

The at least one processor may transmit information about the first user requesting the private connection to the second terminal through the communication interface by executing the one or more instructions.

The at least one processor may transmit the features of the first avatar to the second terminal through the communication interface by executing the one or more instructions.

The at least one processor may obtain identification information of a plurality of avatars in the image by executing the one or more instructions.

The at least one processor may transmit identification information of the plurality of avatars to the first terminal by executing the one or more instructions.

The at least one processor may determine the second avatar based on a user input for selecting one of the plurality of avatars from the first terminal by executing the one or more instructions.

Meanwhile, embodiments of the present disclosure may also be implemented in the form of a recording medium containing instructions executable by a computer, such as program modules executed by a computer. Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and non-volatile media, removable and non-removable media. Additionally, computer-readable media may include computer storage media and communication media. Computer storage media includes both volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data. Communication media typically may include computer-readable instructions, data structures, or other data, such as modulated data signals, or program modules.

Additionally, computer-readable storage media may be provided in the form of non-transitory storage media. Here, 'non-transitory storage medium' only means that it is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is semi-permanently stored in a storage medium and temporary storage media. It does not distinguish between cases where it is stored as . For example, a 'non-transitory storage medium' may include a buffer where data is temporarily stored.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. A computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store or between two user devices (e.g. smartphones). It may be distributed in person or online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) is stored on a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

The foregoing description of the present disclosure is for illustrative purposes, and a person skilled in the art to which the present disclosure pertains will understand that the present disclosure can be easily modified into another specific form without changing its technical idea or essential features. will be. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. For example, each component described as single may be implemented in a distributed manner, and similarly, components described as distributed may also be implemented in a combined form.

The scope of the present disclosure is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present disclosure. do.

Claims (20)

In a method for a display device to establish a private connection between users,
A step (S310) of displaying a virtual space accessed by a plurality of users, wherein the virtual space includes a first avatar of a first user and a second avatar of a second user accessing the virtual space;
Receiving an image of the screen of the display device from the first terminal of the first user, wherein the image includes the second avatar (S320);
Obtaining identification information of the second avatar based on the image (S330);
Based on the identification information of the second avatar, transmitting a private connection request between the first terminal and the second terminal to the second terminal of the second user (S340); and
A method comprising establishing private communication between the first terminal and the second terminal based on receiving acceptance of a private connection request from the second terminal (S350).
According to paragraph 1,
The method is:
Further comprising receiving, from the first terminal, a user input for the second avatar in the image,
The step of obtaining identification information of the second avatar is:
Method comprising obtaining identification information of the second avatar based on the user input.
According to paragraph 1,
The step of obtaining identification information of the second avatar is:
extracting features of the second avatar within the image; and
Comparing features of the second avatar with features of pre-stored avatars to determine the second avatar.
According to paragraph 3,
The features of the previously stored avatars are,
A method, wherein the user's avatar is stored when accessing the virtual space.
According to any one of claims 1 to 4,
The step of transmitting the private connection request to the second terminal of the second user is,
Method comprising transmitting information of the first user requesting the private connection to the second terminal.
According to any one of claims 1 to 5,
The step of transmitting the private connection request to the second terminal of the second user,
Method comprising transmitting features of the first avatar to the second terminal.
According to any one of claims 1 to 6,
The step of obtaining identification information of the second avatar is:
Obtaining identification information of a plurality of avatars in the image;
Transmitting identification information of the plurality of avatars to the first terminal; and
A method comprising determining, from the first terminal, the second avatar based on a user input selecting one of the plurality of avatars.
According to paragraph 1,
The method wherein the private communication is displayed only on the first terminal and the second terminal.
According to clause 8,
and wherein public communications of the plurality of users are displayed on the display device.
According to paragraph 1,
The above method is,
The method further comprising displaying a communication availability status of a plurality of avatars in the virtual space.
In the display device,
Communication interface 2100;
display(2200);
A memory 2300 that stores one or more instructions; and
Comprising at least one processor 2400 that executes the one or more instructions,
The at least one processor 2400 executes the one or more instructions,
A virtual space accessed by a plurality of users is displayed on the screen of the display, wherein the virtual space includes a first avatar of the first user and a second avatar of the second user accessed the virtual space,
Through the communication interface, an image of a screen of the display device is received from the first terminal of the first user, wherein the image includes the second avatar,
Obtain identification information of the second avatar based on the image,
Through the communication interface, based on the identification information of the second avatar, transmitting a private connection request between the first terminal and the second terminal to the second terminal of the second user,
A display device that establishes private communication between the first terminal and the second terminal based on receiving acceptance of a private connection request from the second terminal.
According to clause 11,
The at least one processor executes the one or more instructions,
Receiving a user input for the second avatar in the image from the first terminal,
A display device that obtains identification information of the second avatar based on the user input.
According to clause 11,
The at least one processor executes the one or more instructions,
extract features of the second avatar in the image,
A display device that determines the second avatar by comparing features of the second avatar with features of pre-stored avatars.
According to clause 13,
The features of the previously stored avatars are,
A display device where the user's avatar is stored when accessing the virtual space.
According to any one of claims 11 to 14,
The at least one processor executes the one or more instructions,
A display device that transmits information about the first user who requested the private connection to the second terminal through the communication interface.
According to any one of claims 11 to 15,
The at least one processor executes the one or more instructions,
A display device that transmits the features of the first avatar to the second terminal through the communication interface.
According to any one of claims 11 to 16,
The at least one processor executes the one or more instructions,
Obtain identification information of a plurality of avatars in the image,
Transmitting identification information of the plurality of avatars to the first terminal,
A display device that determines the second avatar based on a user input selecting one of the plurality of avatars from the first terminal.
According to clause 11,
The display device wherein the private communication is displayed only on the first terminal and the second terminal.
According to clause 18,
A display device, wherein public communications of the plurality of users are displayed on a screen of the display.
A computer-readable recording medium recording a program for executing the method of any one of claims 1 to 10 on a computer.

Images