KR20210067599A - Xr device and method for controlling the same - Google Patents

Abstract

The present invention relates to an XR device and to a control method thereof. More particularly, the present invention is applicable to all fields of 5G communication technology, robot technology, autonomous driving technology, and artificial intelligence (AI) technology. The method includes the steps of: storing ID information and body size information of each of a plurality of users in a memory; storing information on each of a plurality of clothes included in the XR device in the memory; recognizing a first user located around the XR device using a camera; extracting information on at least one clothes corresponding to the recognized first user and included in the XR device with reference to the memory; and displaying a virtual avatar based on the body size information stored in the memory and a graphic image of the extracted clothes.

Description

XR DEVICE AND METHOD FOR CONTROLLING THE SAME

The present invention relates to an XR device and a method for controlling the same, and more particularly, is applicable to all fields of 5G communication technology, robot technology, autonomous driving technology, and AI (Artificial Intelligence) technology.

VR (Virtual Reality) technology provides only CG (Computer Graphic) images of objects or backgrounds in the real world, and AR (Augmented Reality) technology provides CG images created virtual on top of real objects, and MR (Mixed Reality) ) technology is a computer graphics technology that mixes and combines virtual objects in the real world. The aforementioned VR, AR, MR, and the like are all simply referred to as XR (extended reality) technology.

In particular, recently, clothing-related devices to which digital functions are applied are emerging. The above-described clothing-related device refers to, for example, a product capable of dry cleaning, drying, sterilizing, deodorizing, or wrinkling of clothes, and is mainly installed at home. Of course, it is also possible to install it elsewhere. However, some companies call a device that functions like this a styler, and some companies call it an air dresser.

Furthermore, a technology for grafting the aforementioned XR technology to the clothing-related device is being discussed.

However, the prior art clothes-related device (eg, a styler, etc.) simply provides a basic function of managing the condition of clothes, and does not have a function of recommending clothes optimized for each user.

In addition, various family members typically live in a house in which clothing-related devices are installed. However, there is no discussion about AI technology that recommends clothes optimized for a plurality of users.

More specifically, for example, when a styler is shared by a plurality of users, when another user goes out wearing clothes recommended for one specific user, there is a problem in that the above-mentioned specific one user has to search for the desired clothes again. .

An embodiment of the present invention is intended to provide a technique for recommending clothes optimized for a plurality of users when a styler provides a virtual fitting.

Another embodiment of the present invention is to provide a technique for recommending a combination of clothes suitable for a plurality of family members (eg, a couple or parents and children) using a styler.

Further, another embodiment of the present invention is to provide a technology for automatically recommending a size of clothes that family members can wear together when purchasing clothes in an online shopping mall.

However, it is not limited only to the above-mentioned purpose, and the scope of the present invention may be extended for other purposes that those skilled in the art can infer based on the entire contents of the present specification.

A method of controlling an XR device capable of managing a plurality of clothes according to an embodiment of the present invention for achieving the above object and the like includes the steps of: storing ID information and body size information of each of a plurality of users in a memory; , storing information on each of a plurality of clothes included in the XR device in the memory (information on each of the clothes is mapped to at least one of the IDs); Recognizing one user; extracting information about at least one clothes corresponding to the recognized first user and included in the XR device with reference to the memory; and body size information stored in the memory and displaying the graphic image of the extracted clothes and the virtual avatar based on the .

An XR device capable of managing a plurality of clothes according to another embodiment of the present invention includes a memory for storing ID information and body size information of each of a plurality of users (the memory includes a plurality of clothes included in the XR device) information of each of the clothes), a camera for recognizing a first user located around the XR device, and at least one corresponding to the recognized first user and included in the XR device with reference to the memory a controller for extracting information on clothes of the person; and a display module for displaying a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes.

According to one of the various embodiments of the present invention, when a styler provides a virtual fitting, a technique for recommending clothes optimized for a plurality of users, respectively, is provided.

According to another embodiment of the present invention, there is provided a technology for recommending a combination of clothes suitable for a plurality of family members (eg, a couple or parents and children) using a styler.

And, according to another embodiment of the present invention, when purchasing clothes in an online shopping mall, a technology for automatically recommending a size of clothes that family members can wear together is provided.

However, it is not limited only to the above-described technical effects, and the scope of the present invention may be extended to other technical effects that can be inferred by those skilled in the art based on the entire contents of the present specification.

1 illustrates a case in which an XR device according to an embodiment of the present invention is implemented as an HMD type.
2 illustrates a case in which the XR device according to an embodiment of the present invention is implemented as an AR glass type.
3 shows a case in which an embodiment of the present invention is applied to a clothing-related device.
4 shows an example of a flowchart illustrating a process for controlling an XR device according to an embodiment of the present invention.
5 shows an example of an external appearance of an XR device and a DB (database) stored in a memory according to an embodiment of the present invention.
6 illustrates a solution when the XR device recognizes one user according to an embodiment of the present invention.
7 illustrates an example of a solution when the XR device according to an embodiment of the present invention recognizes a plurality of users.
8 illustrates a service in which the XR device recommends different clothes according to a specific schedule according to an embodiment of the present invention.
9 illustrates a service for recommending sizes for a plurality of users when the XR device uses an online shopping mall according to an embodiment of the present invention.
10 shows another example of a DB (database) stored in the memory of the XR device according to an embodiment of the present invention.
11 shows another example of a flowchart illustrating a process for controlling an XR device according to an embodiment of the present invention.
12 and 13 show another example of a solution when the XR device according to an embodiment of the present invention recognizes a plurality of users.
And, FIG. 14 shows another example of a DB (database) stored in the memory of the XR device according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for the components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have a meaning or role distinct from each other by themselves. In addition, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Of course, the following examples of the present invention are not intended to limit or limit the scope of the present invention only to embody the present invention. What an expert in the technical field to which the present invention pertains can easily infer from the detailed description and embodiments of the present invention is construed as belonging to the scope of the present invention.

The above detailed description should not be construed as restrictive in all respects, but rather as illustrative. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

The extended reality described in this specification collectively refers to virtual reality (VR), augmented reality (AR), and mixed reality (MR). VR technology provides only CG images of objects or backgrounds in the real world, AR technology provides virtual CG images on top of images of real objects, and MR technology is a computer that mixes and combines virtual objects in the real world. graphic technology.

MR technology is similar to AR technology in that it shows both real and virtual objects. However, there is a difference in that in AR technology, a virtual object is used in a form that complements a real object, whereas in MR technology, a virtual object and a real object are used with equal characteristics.

XR technology can be applied to HMD (Head-Mount Display), HUD (Head-Up Display), mobile phone, tablet PC, laptop, desktop, TV, digital signage, etc. can be called

However, recently, VR, AR, and MR technologies are sometimes called XR (extended reality) technologies rather than clearly distinguishing them. Accordingly, embodiments of the present invention are applicable to all of VR, AR, MR, and XR technologies.

Meanwhile, as hardware (HW)-related element technologies applied to VR, AR, MR, and XR technologies, for example, wired/wireless communication technologies, input interface technologies, output interface technologies, and computing device technologies exist. In addition, as software (SW)-related element technologies, for example, tracking and matching technology, voice recognition technology, interaction and user interface technology, location-based service technology, search technology, AI (Artificial Intelligence) technology, and the like exist.

In particular, embodiments of the present invention, by using the above-described HW/SW-related element technology, etc., communication problems with other devices, efficient memory use problems, problems of lowering data processing speed due to inconvenient UX/UI, image problems , at least one of acoustic problems, motion sickness, or other problems.

1 illustrates a case in which an XR device according to an embodiment of the present invention is implemented as an HMD type. Various embodiments to be described later may be implemented in the HMD type shown in FIG. 1 .

The HMD type XR device 100a shown in FIG. 1 includes a communication unit 110 , a control unit 120 , a memory unit 130 , an I/O unit 140a , a sensor unit 140b , and a power supply. unit 140c and the like. In particular, the communication unit 110 in the XR device 10a performs wired/wireless communication with the mobile terminal 100b.

And, FIG. 2 shows a case in which the XR device according to an embodiment of the present invention is implemented as an AR glass type. Various embodiments to be described later may be implemented with the AR glass type shown in FIG. 2 .

As shown in FIG. 2 , the AR glasses may include a frame, a control unit 200 , and an optical display unit 300 .

As shown in FIG. 2 , the frame may have a form of glasses worn on the face of the user 10 , but is not necessarily limited thereto, and may be in the form of goggles worn in close contact with the face of the user 10 . may have

Such a frame may include a front frame 110 and first and second side frames.

The front frame 110 has at least one opening and may extend in a first horizontal direction (x), and the first and second side frames are disposed in a second horizontal direction (y) crossing the front frame 110 . It can be extended and extended side by side with each other.

The controller 200 may generate an image to be displayed to the user 10 or an image in which images are continuous. The controller 200 may include an image source for generating an image, a plurality of lenses for diffusing and converging light generated from the image source, and the like. As described above, the image generated by the control unit 200 may be output to the optical display unit 300 through the guide lens P200 positioned between the control unit 200 and the optical display unit 300 .

Such a control unit 200 may be fixed to any one of the first and second side frames. For example, the control unit 200 may be fixed inside or outside any one of the side frames, or may be integrally formed by being built into the inside of any one of the side frames.

The optical display unit 300 may serve to display the image generated by the control unit 200 to the user 10 , and while allowing the image to be shown to the user 10 , the external environment may be viewed through the opening. In order to do so, it may be formed of a translucent material.

The optical display unit 300 is inserted and fixed into the opening included in the front frame 110, or is located on the rear surface of the opening (ie, between the opening and the user 10) and is fixed to the front frame 110. can be provided. In the present invention, as an example, a case in which the optical display unit 300 is positioned on the rear surface of the opening and fixed to the front frame 110 is illustrated as an example.

In such an XR device, as shown in FIG. 2 , when the control unit 200 injects an image for an image into the incident region S1 of the optical display unit 300 , the image light is transmitted through the optical display unit 300 . , may be emitted to the emission area S2 of the optical display unit 300 , and the image generated by the control unit 200 may be displayed to the user 10 .

Accordingly, the user 10 can simultaneously view the image generated by the controller 200 while viewing the external environment through the opening of the frame 100 .

3 shows a case in which an embodiment of the present invention is applied to a clothing-related device.

Embodiments of the present specification can be applied not only to the XR device but also to various clothing-related devices.

Further described in relation to an embodiment of the present invention, as shown in FIG. 3 , when the user 100 approaches a clothing-related device (eg, a styler, an air dresser, etc.), a camera or sensor installed in the clothing-related device to recognize user access.

In addition, the display 200 installed on the front of the clothing-related device displays the recognized user-related avatar, and additionally displays a graphic in which the user 100 wears the desired clothes, hat, and the like. As shown in FIG. 3 , although the real user 100 does not wear a hat, it can be confirmed that the avatar displayed on the display 200 is wearing a virtual hat. Furthermore, the display 200 may operate as a mirror when the user is not recognized.

Finally, in FIG. 3 , it is assumed that the display 200 is exposed on the front of the clothing-related device, but designing the display to be located inside when the user 100 opens the door of the clothing-related device is also an example of the present invention. belong to the scope of the right.

In particular, it is sufficient that the XR device to be described in the drawings to be described later has a display function.

4 shows an example of a flowchart illustrating a process for controlling an XR device according to an embodiment of the present invention.

First, the XR device according to an embodiment of the present invention may be a styler type capable of managing a plurality of clothes, as previously shown in FIG. 3 . The appearance of the styler will be described again with reference to FIG. 5 below.

As shown in FIG. 4 , the XR device according to an embodiment of the present invention stores ID information and body size information of each of a plurality of users in a memory (S2510). For example, a user's face is photographed using a camera installed in an XR device, and an ID is assigned based on the characteristic information. Furthermore, by using the same camera or another camera described above, the user's body is photographed and body size numerical information is stored in the memory.

Then, the XR device stores information on each of the plurality of clothes included in the XR device in the memory ( S2520 ). The information on each of the clothes is mapped with the ID obtained in step S2510. This is a unique feature of an embodiment of the present invention in which ownership (priority) is automatically given to each garment in the XR device, which will be described in more detail below with reference to FIG. 5 .

The XR device recognizes the first user located around the XR device using the camera (S2530). Furthermore, with reference to the memory, the XR device extracts information on at least one clothes corresponding to the recognized first user and included in the XR device ( S2540 ). The memory will be described later in more detail with reference to FIG. 5 .

Then, the XR device displays a virtual avatar based on the body size information stored in the memory and a graphic image of the extracted clothes together (S2550). In this regard, it will be described later in more detail with reference to FIG. 5 .

However, although a solution for recognizing only one user is described in FIG. 4 , a solution for recognizing a plurality of users will be described in more detail below with reference to FIG. 7 .

Meanwhile, the flowchart shown in FIG. 4 can be applied to various XR devices, and a case where it is applied to the styler shown in FIG. 3 will be described as follows.

A styler, which is an example of an XR device, includes at least a memory, a camera, a controller, and a display module.

The memory stores ID information and body size information of each of a plurality of users. Furthermore, the memory additionally stores information on each of a plurality of clothes included in the XR device. The XR device (eg, a styler, etc.) may recognize basic information of clothes from tags of clothes inside, or a user may directly input information about each clothes.

The camera recognizes a first user located in the vicinity of the XR device. Accordingly, the XR device may additionally include a user face recognition algorithm.

The controller, with reference to the memory, extracts information on at least one piece of clothing corresponding to the recognized first user and included in the XR device.

In addition, the display module displays a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes. In this regard, it will be described later in more detail with reference to FIGS. 5 and 6 .

5 shows an example of an external appearance of an XR device and a DB (database) stored in a memory according to an embodiment of the present invention.

The appearance of a styler, which is an example of an XR device capable of handling the process of FIG. 4 described above, is shown in FIG. 5A .

As shown in FIG. 5A , the XR device 2600 according to an embodiment of the present invention includes a camera 2601 . Accordingly, it is possible to recognize the user 2610 around the XR device 2600 by using the camera 2601 .

Furthermore, recommended clothes 2602 optimized for the recognized user 2610 are displayed. In order to extract the recommended clothes 2602 optimized for the user 2610, for example, the database DB shown in FIG. 5B is used. The DB may be stored in the memory of the XR device 2600, but in some cases, it is also possible to receive and update the related data from the server.

The XR device shown in FIG. 5A refers to the database shown in FIG. 5B. Clothes A, B, C, and D shown in FIG. 5B are all built in the XR device (eg, a styler). Information on each clothes may be recognized using tag information attached to each clothes, and it may be determined whether the clothes are located in the XR device.

Furthermore, as shown in (b) of FIG. 5 , each of the clothes is given priority (or ownership, ID) to a specific user. The priority (or ownership, ID) may be set according to a user's designation or may be automatically determined. For example, when the XR device recognizes the specific user and the number of times the specific clothes are separated from the XR device is the largest, it is automatically set that the specific user has the priority (ownership) of the specific clothes.

For example, if there is a history of wearing clothes B the most by user a during a specific period, the priority (ID) for clothes B is automatically set to user a.

For example, if there is a history of user b wearing clothes C the most during a specific period, the priority (ID) for clothes C is automatically set to user b.

For example, if there is a history of user c wearing D clothes the most during a specific period, the priority (ID) for D clothes is automatically set to c user.

Therefore, the ID mapped with the first clothes at the first time point and the ID mapped with the first clothes at the second time point different from the first time point may be changed, which will be described in more detail below with reference to FIG. 10 . .

On the other hand, as shown in (b) of FIG. 5 , another feature of an embodiment of the present invention is that a new ID of “Random clothes” is assigned to the database. This is a solution for solving a case in which a dispute may arise due to clothes preferred by a plurality of users, particularly when a styler is installed in a home and a plurality of users share the styler. In this regard, it will be described later in more detail in 7 below. However, Fig. 6, which is an embodiment when there is no possibility of dispute due to a plurality of users, will be described first.

6 illustrates a solution when the XR device recognizes one user according to an embodiment of the present invention.

As shown in (a) of FIG. 6 , it is assumed that one user 2710 exists in the vicinity of the XR device 2700 . It is assumed that the camera 2701 installed on the upper end of the XR device 2700 is capable of facial recognition as well as the presence of the user 2710 . Meanwhile, in FIG. 6A , the camera 2701 is illustrated as being located on the upper end of the XR device 2700 , but the scope of the present invention is not limited.

When the XR device 2700 recognizes the specific user 2710 , the virtual avatar 2702 is displayed based on the body information of the specific user 2710 stored in the memory.

Of course, outputting an actual image of the specific user 2710 instead of the virtual avatar 2702 also falls within the scope of the present invention.

Further, as shown in (b) of Figure 6, the XR device is a specific clothing 2713 given priority (ownership or ID) to the user recognized with reference to the memory (eg, (b) of Figure 5) ) is displayed together with the virtual avatar 2712 .

Therefore, there is an advantage in that the user can immediately recommend the clothes he usually wears from among various clothes (not only clothes that fit him but also clothes of other family members) inside the XR device every time.

Of course, in FIG. 6(b), only one clothes having priority is recommended to the user, but an advantage of reducing the user's clothes selection time by displaying all of the plurality of clothes having priority to the user is also expected. will be.

Meanwhile, in FIG. 6 , it is assumed that only one family member exists around the XR device, but when a plurality of family members are recognized, another solution is required. In this regard, it will be described later in more detail with reference to FIG. 7 .

7 illustrates an example of a solution when the XR device according to an embodiment of the present invention recognizes a plurality of users.

5 and 6, only one user is recognized around the XR device, and a service for recommending clothes optimized for the user is illustrated. However, even if ownership (priority) is granted to only one specific person with respect to specific clothes, other users having similar preferences may exist.

For example, if the first user has a history of selecting No. 5 for clothes A during a specific period, but there is also a history of selecting No. 4 by the second user corresponding thereto, priority for clothes A is given to the first user. . Therefore, from the perspective of the second user, it can be seen that the preference for the clothes A is never low, and the first user and the second user are highly likely to have a dispute with the clothes A in the future. 7 is a solution for solving this problem.

First, the XR device 2800 according to an embodiment of the present invention uses the camera 2801 to determine whether a plurality of users 2810. 2820 exist in the vicinity.

If only the first user 2810 exists at the first time point, only the virtual avatar 2802 corresponding to the first user 2810 is displayed as shown in FIG. 7A .

However, when the second user 2820 is recognized at the second time point after a predetermined time has elapsed from the first time point, the XR device as shown in FIG. The display of the virtual avatar is stopped, and only the graphic image 2830 of random clothes extracted from the memory is displayed. In (b) of FIG. 7 , an indicator 2840 indicating that the currently displayed clothes are random clothes is also displayed, but not displaying this also falls within the scope of the present invention.

That is, when a plurality of users are recognized around the XR device, information about random clothes that do not correspond to the recognized plurality of users is automatically displayed with reference to the memory shown in FIG. 5B extracted with As previously described with reference to FIG. 5 , the random clothes stored in the memory mean clothes that do not belong to any user's priority.

However, although not shown in FIG. 7 , if another user 2820 leaves, as shown in FIG. 6 ( b ), clothes with ownership (ID) to a specific user 2810 are normally displayed together with a virtual atava. indicate

Therefore, only when a plurality of users exist around the XR device, there is an advantage in that it is possible to prevent the possibility of a dispute between a plurality of users by displaying random clothes in advance.

However, FIG. 7 is an example in which it is assumed that the first user is recognized and the second user is recognized together after a predetermined time has elapsed. However, when a plurality of users are recognized at the same time, there is little possibility of a dispute even if clothes optimized for each user are directly recommended. A related embodiment will be described later in more detail with reference to FIGS. 12 and 13 .

On the other hand, as shown in FIG. 7 , a new mode according to an embodiment of the present invention that recommends clothes irrelevant to the first user when another face is recognized while one user is viewing recommended clothes is a private view It is defined as, and is particularly necessary when a styler installed at home is shared by multiple family members.

8 illustrates a service in which the XR device recommends different clothes according to a specific schedule according to an embodiment of the present invention.

In the previous embodiments, a service for recommending clothes optimized for a specific user based on ownership (ID or priority) of each clothes has been described. However, embodiments of the present invention may recommend clothes using more various factors.

For example, as shown in FIG. 8 , the virtual avatar 2910 is wearing specific clothes. However, since the XR device can be connected to a network such as the Internet, it is possible to receive weather information for each date.

Accordingly, when the user selects a specific date from the calendar 2920 displayed on the display of the XR device, the XR device that has received the weather information on the date is the clothes suitable for the weather from among the clothes (owned by the user) in the XR device. recommend

More specifically, for example, the XR device (EX: styler) includes a variety of clothes that give priority to user A. Among them, clothes a suitable for a rainy day and clothes b suitable for a snowy day are included. assume that there is

At this time, as shown in FIG. 8 , the XR device receiving the weather information predicted to rain on August 15, the date selected by user A, is designed to preferentially recommend clothes a among clothes a and clothes b. .

Therefore, there is a technical effect of reducing the possibility that the user accidentally selects the wrong clothes on a specific day.

9 illustrates a service for recommending sizes for a plurality of users when the XR device uses an online shopping mall according to an embodiment of the present invention.

As described above, the conventional styler has only a function of simply managing clothes externally. However, as also briefly described in FIG. 8, the XR device (ex: styler) according to an embodiment of the present invention additionally has an Internet network function.

Accordingly, the user can also start a service such as an online shopping mall using the XR device according to an embodiment of the present invention.

According to the prior art, as shown in (a) of FIG. 9 , based on the body size information of user A 3000 , only clothes 3010 of a small size, which are a specific size suitable for the body of user A 3000 , are used. I'm just recommending it. However, a service that considers the body sizes of a plurality of family members together is not currently provided.

On the other hand, as shown in (b) of FIG. 9 , when user A selects specific clothes for online purchase, considering not only the body size of user A 3000 but also the body size of other family members 3040, other It is also possible to output the related message 3030 while displaying the clothes 3020 of the medium size, which is the size.

However, in order to implement this, it is assumed that the information on the body size of the family member is previously photographed by the XR device through a camera or received from another device.

10 shows another example of a DB (database) stored in the memory of the XR device according to an embodiment of the present invention.

Previously, in FIG. 5, a database for generating information about random clothes has been mainly described. On the other hand, FIG. 10 shows an embodiment in which ownership (priority, ID) of specific clothes is changed according to a viewpoint.

As shown in FIG. 10 , as of November 1, 2019, user a has priority over clothes A, user b has priority over clothes B, and user c has priority over clothes C as of November 1, 2019. , D No one has priority over clothes. Here, users a to c are, for example, family members who share an XR device. In addition, the priority is automatically determined according to whether each clothes is selected the most during a specific period (eg, a month). Of course, as described above, it will be said that the user's direct designation falls within the scope of the present invention.

However, from November 1 to November 30, 2019, the history of clothes selected by family members may be changed. That is, as of December 1, 2019, since user b selected clothes B the most, the priority is changed, and since user a selected clothes C the most, the priority is also changed. Furthermore, clothes A and D are automatically switched to a random state, that is, they do not have ownership because no one selects them.

Finally, the history of clothing selected by family members during the month from December 1, 2019 to December 31, 2019 is also reflected. Therefore, as of January 1, 2020, user c has priority for only D clothes, and all other clothes are changed to random status. As such, a more specific embodiment in which the priority is changed will be described later with reference to FIG. 11. FIG. 11 is another example of a flowchart illustrating a process for controlling an XR device according to an embodiment of the present invention.

The XR device according to an embodiment of the present invention counts the number of times a specific user is separated from the XR device by a predetermined distance or more while a specific user is recognized through the camera (S3210).

Based on the counting result, an ID corresponding to the specific clothes is mapped (S3220). That is, the simple selection has a problem in that it is not possible to accurately determine whether the user actually wears the displayed recommended clothes. In order to solve this problem, it is designed to count for ownership determination only when the selected clothes deviate more than a certain distance using a tag attached to each clothes and a sensor in the XR device that can recognize them. Such a result is reflected in the database of the above-mentioned memory in real time.

However, there may exist a case in which a user goes out wearing clothes that are not recommended to him, that is, to which ownership (priority or ID) is not given to him, and this needs to be addressed.

Accordingly, as shown in FIG. 11 , in a state in which a user other than the user corresponding to the mapped ID is recognized, it is determined again whether the specific clothes have departed from the XR device by a predetermined distance or more ( S3230 ).

And, when the result of the determination (S3230) is deviated, it is designed to transmit a related message to the mobile device of the user who is the original owner (S3240).

Meanwhile, in FIG. 7 , an embodiment in which only one user is recognized and a plurality of users are automatically switched to the private view mode after a predetermined time has elapsed has been described.

However, when a plurality of users are recognized at almost the same time, a service for appropriately recommending clothes recommended to a plurality of users is more required rather than executing the private view mode. In this regard, it will be described later in more detail with reference to FIGS. 12 and 13 .

12 and 13 show another example of a solution when the XR device according to an embodiment of the present invention recognizes a plurality of users.

12 and 13, it is assumed that a plurality of users are recognized together within a preset time difference (eg, 1 to 2 seconds), unlike the previous embodiment of FIG. 7 .

12 , when the XR device 3300 simultaneously recognizes the first user 3310 and the second user 3320 together, the first virtual avatar 3311 corresponding to the first user 3310 and a second virtual avatar 3321 corresponding to the second user 3320 are all displayed.

However, it is assumed that the distance between the XR device 3300 and each user is different from each other. In consideration of this, it is also within the scope of the present invention to change the plurality of virtual avatars to positions displayed on the screen of the XR device.

Furthermore, the XR device refers to the database and automatically extracts a combination of clothes that are suitable for a plurality of users to wear together. The related DB will be described later with reference to FIG. 14 .

Using the database shown in FIG. 14 , the XR device outputs white-collar clothes 3410 among clothes owned by the first user, and also among clothes owned by the second user, as shown in FIG. 13 . The white-collar clothes 3420 are outputted. FIG. 14 shows another example of a DB (database) stored in the memory of the XR device according to an embodiment of the present invention.

The first recognized or closest user to the XR device becomes the reference user.

14 , it is assumed that user a is a reference user.

If user a arbitrarily selects the first clothes, clothes information of users b, c, d, and e that can be matched with the first clothes of user a is extracted. And, according to whether the recognized users in FIGS. 12 and 13 are users b to e, corresponding clothes are displayed.

Meanwhile, when user a arbitrarily selects the second clothes, clothes information of users b, c, d, and e that can match the second clothes of user a is extracted. And, according to whether the recognized users in FIGS. 12 and 13 are users b to e, corresponding clothes are displayed.

Finally, when user a arbitrarily selects the third clothes, clothes information of users b, c, d, and e that can be matched with the third clothes of user a is extracted. And, according to whether the recognized users in FIGS. 12 and 13 are users b to e, corresponding clothes are displayed.

Of course, in FIG. 14 , the matching was determined mainly by color, but determining whether to match according to the type and type of clothes also falls within the scope of the present invention.

On the other hand, although the present specification has been described with reference to the accompanying drawings, this is only an embodiment and is not limited to a specific embodiment, and various contents that can be modified by those of ordinary skill in the art to which the present invention belongs are also claimed. It is within the scope of rights according to In addition, such modifications should not be separately understood from the spirit of the present invention.

110: communication unit (communication unit)
120: control unit (control unit)
130: memory unit (memory unit)
140a: I/O unit
140b: sensor unit
140c: power supply unit

Claims (15)

In the control method of an XR device capable of managing a plurality of clothes,
storing ID information and body size information of each of a plurality of users in a memory;
storing information on each of a plurality of clothes included in the XR device in the memory, wherein information on each of the clothes is mapped to at least one of the IDs;
recognizing a first user located around the XR device using a camera;
extracting information on at least one clothes corresponding to the recognized first user and included in the XR device with reference to the memory; And
Displaying a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes together
Control method of an XR device comprising a. According to claim 1,
determining whether a plurality of users are recognized around the XR device;
as a result of the determination, when a plurality of users are recognized around the XR device, extracting information about random clothes that do not correspond to the plurality of recognized users with reference to the memory;
stopping the display of the virtual avatar; And
Displaying only graphic images of the extracted random clothes
Control method of an XR device comprising a. According to claim 1,
The ID is a control method of an XR device, characterized in that it is set or automatically determined according to a user's designation. According to claim 1,
The method of controlling an XR device, characterized in that the ID mapped with the first garment at a first time point and the ID mapped with the first garment at a second time point different from the first time point are changed. According to claim 1,
counting the number of times the specific clothes are separated from the XR device by more than a preset distance while the specific user is recognized through the camera; And
Based on the counting result, mapping the ID corresponding to the specific clothes
Control method of the XR device, characterized in that it further comprises. 6. The method of claim 5,
determining whether the specific clothes have deviated from the XR device by more than a preset distance in a state where a user other than the user corresponding to the mapped ID is recognized; And
Transmitting a related message to the user's mobile device when the deviation occurs as a result of the determination
Control method of the XR device, characterized in that it further comprises. According to claim 1,
The XR device is
A control method of an XR device, characterized in that it is applied to at least one of a styler product, a signage, or a TV. In the XR device capable of managing a plurality of clothes,
a memory for storing ID information and body size information of each of a plurality of users, wherein the memory additionally stores information on each of a plurality of clothes included in the XR device;
a camera for recognizing a first user located around the XR device;
a controller corresponding to the recognized first user and extracting information about at least one clothes included in the XR device with reference to the memory; And
A display module for displaying a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes together
XR device comprising a. 9. The method of claim 8,
The information of each of the clothes stored in the memory,
XR device, characterized in that it is mapped to at least one of the ID. 10. The method of claim 9,
The controller is
Determining whether a plurality of users around the XR device are recognized,
As a result of the determination, when a plurality of users are recognized around the XR device, information about random clothes that do not correspond to the recognized plurality of users is extracted with reference to the memory,
stopping the display of the virtual avatar by controlling the display module; and
By controlling the display module, XR device, characterized in that the control to display only the graphic image of the extracted random (random) clothes. 10. The method of claim 9,
XR device, characterized in that the ID is set or automatically determined according to a user's designation. 10. The method of claim 9,
The XR device, characterized in that the ID mapped with the first clothes at a first time point and the ID mapped with the first clothes at a second time point different from the first time point are changed. 10. The method of claim 9,
The controller is
In a state in which a specific user is recognized through the camera, counting the number of times that specific clothes have departed from the XR device by more than a preset distance, and
Based on the counting result, the XR device, characterized in that mapping the ID corresponding to the specific clothes. 14. The method of claim 13,
The controller is
In a state in which a user other than the user corresponding to the mapped ID is recognized, it is determined whether the specific clothes have deviated from the XR device by more than a preset distance, and
XR device, characterized in that for controlling the communication module to transmit a related message to the user's mobile device when the deviation is determined as a result. 9. The method of claim 8,
The XR device is
An XR device, characterized in that it is applied to at least one of a styler product, a signage, or a TV.

Images