KR102650348B1 - Xr device and method for controlling the same - Google Patents

Abstract

The present invention relates to an XR device and its control method, and more specifically, is applicable to the 5G communication technology field, robot technology field, autonomous driving technology field, and AI (Artificial Intelligence) technology field.

Description

XR device and its control method {XR DEVICE AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to an XR device and its control method, and more specifically, is applicable to the 5G communication technology field, robot technology field, autonomous driving technology field, and AI (Artificial Intelligence) technology field.

VR (Virtual Reality) technology provides objects and backgrounds in the real world only as CG (Computer Graphics) images, while AR (Augmented Reality) technology provides virtually created CG images on top of images of real objects, and MR (Mixed Reality) technology provides ) technology is a computer graphics technology that mixes and combines virtual objects in the real world. The aforementioned VR, AR, MR, etc. are all simply referred to as XR (extended reality) technologies.

In particular, clothing-related devices with digital functions have been appearing recently. The above-described clothing-related devices are, for example, products that can dry clean, dry, sterilize, remove odor, or treat wrinkles for clothes, and are mainly installed at home. Of course, it is also possible to install it elsewhere. However, some companies name devices that perform the same function as stylers, while others name them air dressers.

Furthermore, technology for incorporating the above-described XR technology into the clothing-related devices is being discussed.

However, conventional clothing-related devices (e.g., stylers, etc.) simply provide basic functions for managing the condition of clothes and do not have a function for recommending clothes optimized for each user.

And, typically, various family members live in a house where clothing-related devices are installed. However, there is no discussion at all about AI technology that recommends optimized clothes to multiple users.

More specifically, for example, when a styler is shared by multiple users, if another user has already worn the clothes recommended to a specific user and gone out, there is a problem in which the above-mentioned specific user has to search again for the desired clothes. .

One embodiment of the present invention seeks to provide a technology for recommending optimized clothes to a plurality of users when a styler provides virtual fitting.

Another embodiment of the present invention seeks to provide a technology for recommending a combination of clothes that match a plurality of family members (for example, a couple or a parent and a child, etc.) using a styler.

Another embodiment of the present invention seeks to provide technology that automatically recommends sizes of clothes that family members can wear together when purchasing clothes at an online shopping mall.

However, it is not limited to the above-described purpose, and the scope of the present invention may be expanded to other purposes that can be inferred by a person skilled in the art based on the entire contents of this specification.

A control method of an XR device capable of managing a plurality of clothes according to an embodiment of the present invention to achieve the above-mentioned object, etc. includes the steps of storing ID information and body size information of each of a plurality of users in a memory; , storing information on each of a plurality of clothes included in the XR device in the memory (information on each of the clothes is mapped to at least one of the IDs), and using a camera to Recognizing one user, referring to the memory, extracting information about at least one piece of clothing corresponding to the recognized first user and included in the XR device, and body size information stored in the memory It includes displaying a virtual avatar based on and a graphic image of the extracted clothes together.

An XR device capable of managing a plurality of clothes according to another embodiment of the present invention has a memory that stores ID information and body size information of each of a plurality of users (the memory includes a plurality of clothes included in the XR device). additionally storing information on each piece of clothing), a camera that recognizes a first user located around the XR device, and, with reference to the memory, at least one device corresponding to the recognized first user and included in the XR device. It includes a controller that extracts information about clothes, and a display module that displays a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes.

According to one embodiment of various embodiments of the present invention, a styler provides technology for recommending optimized clothes to a plurality of users when providing virtual fitting.

According to another embodiment of the present invention, a technology for recommending a combination of clothes that match a plurality of family members (for example, a couple or a parent and a child, etc.) using a styler is provided.

And, according to another embodiment of the present invention, when purchasing clothes at an online shopping mall, technology is provided that automatically recommends sizes of clothes that family members can wear together.

However, it is not limited to only the technical effects described above, and the scope of the present invention may be expanded to other technical effects that can be inferred by a person skilled in the art based on the entire contents of this specification.

Figure 1 shows a case where an XR device according to an embodiment of the present invention is implemented as an HMD type.
Figure 2 shows a case where the XR device according to an embodiment of the present invention is implemented as an AR glass type.
Figure 3 shows a case where an embodiment of the present invention is applied to a clothing-related device.
Figure 4 shows an example of a flow chart illustrating a process for controlling an XR device according to an embodiment of the present invention.
Figure 5 shows an example of the appearance of an XR device and a DB (database) stored in memory according to an embodiment of the present invention.
Figure 6 shows a solution when an XR device recognizes one user according to an embodiment of the present invention.
Figure 7 shows an example of a solution when an XR device recognizes multiple users according to an embodiment of the present invention.
Figure 8 shows a service in which an XR device recommends different clothes according to a specific schedule according to an embodiment of the present invention.
Figure 9 shows a service in which an XR device recommends sizes for multiple users when using an online shopping mall according to an embodiment of the present invention.
Figure 10 shows another example of a DB (database) stored in the memory of an XR device according to an embodiment of the present invention.
Figure 11 shows another example of a flow chart showing a process for controlling an XR device according to an embodiment of the present invention.
Figures 12 and 13 show another example of a solution when an XR device recognizes multiple users according to an embodiment of the present invention.
And, Figure 14 shows another example of a DB (database) stored in the memory of an XR device according to an embodiment of the present invention.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the attached drawings. However, identical or similar components will be assigned the same reference numbers regardless of reference numerals, and duplicate descriptions thereof will be omitted. The suffixes “module” and “part” for components used in the following description are given or used interchangeably only for the ease of preparing the specification, and do not have distinct meanings or roles in themselves. Additionally, in describing the embodiments disclosed in this specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed descriptions will be omitted. In addition, the attached drawings are only for easy understanding of the embodiments disclosed in this specification, and the technical idea disclosed in this specification is not limited by the attached drawings, and all changes included in the spirit and technical scope of the present invention are not limited. , should be understood to include equivalents or substitutes.

Of course, the following examples of the present invention are only intended to embody the present invention and do not limit or limit the scope of the present invention. Anything that can be easily inferred by an expert in the technical field to which the present invention belongs from the detailed description and embodiments of the present invention will be interpreted as falling within the scope of the rights of the present invention.

The above detailed description should not be construed as limiting in any respect and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

Extended reality described in this specification collectively refers to virtual reality (VR), augmented reality (AR), and mixed reality (MR). VR technology provides objects and backgrounds in the real world only as CG images, AR technology provides virtual CG images on top of images of real objects, and MR technology provides computer technology that mixes and combines virtual objects in the real world. It is a graphic technology.

MR technology is similar to AR technology in that it shows real objects and virtual objects together. However, in AR technology, virtual objects are used to complement real objects, whereas in MR technology, virtual objects and real objects are used equally.

XR technology can be applied to HMD (Head-Mount Display), HUD (Head-Up Display), mobile phones, tablet PCs, laptops, desktops, TVs, digital signage, etc., and devices with XR technology applied are called XR Devices. It can be called.

However, recently, rather than clearly distinguishing between VR, AR, and MR technologies, they are sometimes referred to as XR (extended reality) technologies. Accordingly, embodiments of the present invention are applicable to all VR, AR, MR, and XR technologies.

Meanwhile, hardware (HW)-related element technologies applied to VR, AR, MR, and XR technologies include, for example, wired/wireless communication technology, input interface technology, output interface technology, and computing device technology. In addition, software (SW)-related element technologies include, for example, tracking and matching technology, voice recognition technology, interaction and user interface technology, location-based service technology, search technology, and AI (Artificial Intelligence) technology.

In particular, embodiments of the present invention use the above-described HW/SW related element technologies, etc. to solve problems such as communication problems with other devices, efficient memory use problems, slow data processing speed due to inconvenient UX/UI, and video problems. , it seeks to solve at least one of the following: acoustic problems, motion sickness, or other problems.

Figure 1 shows a case where an XR device according to an embodiment of the present invention is implemented as an HMD type. Various embodiments to be described later may be implemented with the HMD type shown in FIG. 1.

The HMD type XR device 100a shown in FIG. 1 includes a communication unit 110, a control unit 120, a memory unit 130, an I/O unit 140a, a sensor unit 140b, and a power supply. Includes unit 140c, etc. In particular, the communication unit 110 in the XR device 10a establishes wired and wireless communication with the mobile terminal 100b.

And, Figure 2 shows a case where the XR device according to an embodiment of the present invention is implemented as an AR glass type. Various embodiments to be described later can also be implemented with the AR glass type shown in FIG. 2.

As shown in FIG. 2, AR glasses may include a frame, a control unit 200, and an optical display unit 300.

As shown in FIG. 2, the frame may have the form of glasses worn on the face of the user 10's body, but is not necessarily limited thereto, and may be in the form of goggles, etc., worn in close contact with the face of the user 10. You can also have

Such a frame may include a front frame 110 and first and second side frames.

The front frame 110 has at least one opening and may extend in a first horizontal direction (x), and the first and second side frames extend in a second horizontal direction (y) that intersects the front frame 110. They can be extended and extended parallel to each other.

The control unit 200 may generate an image to be shown to the user 10 or an image containing a series of images. Such a control unit 200 may include an image source that generates an image and a plurality of lenses that diffuse and converge light generated from the image source. In this way, the image generated by the control unit 200 may be output to the optical display unit 300 through the guide lens P200 located between the control unit 200 and the optical display unit 300.

This control unit 200 may be fixed to either the first or second side frames. For example, the control unit 200 may be fixed to the inside or outside of one of the side frames, or may be built into the inside of one of the side frames and formed integrally.

The optical display unit 300 may play a role in allowing the image generated by the control unit 200 to be displayed to the user 10, and while allowing the image to be displayed to the user 10, the external environment can be viewed through the opening. In order to do so, it may be formed of a translucent material.

This optical display unit 300 is inserted into and fixed to the opening included in the front frame 110, or is located on the back of the opening (i.e. between the opening and the user 10) and fixed to the front frame 110. It can be provided. In the present invention, as an example, a case where the optical display unit 300 is located on the back of the opening and is fixed to the front frame 110 is shown as an example.

As shown in FIG. 2, in such an XR device, when the control unit 200 makes an image incident on the incident area (S1) of the optical display unit 300, the image light passes through the optical display unit 300. , the image generated by the control unit 200 can be displayed to the user 10 by being emitted to the emission area S2 of the optical display unit 300.

Accordingly, the user 10 can view the external environment through the opening of the frame 100 and simultaneously view the image generated by the control unit 200.

Figure 3 shows a case where an embodiment of the present invention is applied to a clothing-related device.

Embodiments of this specification can be applied not only to XR devices but also to various clothing-related devices.

To further explain in relation to an embodiment of the present invention, as shown in FIG. 3, when the user 100 approaches a clothing-related device (ex: styler, air dresser, etc.), a camera or sensor installed in the clothing-related device Recognizes user access.

Additionally, the display 200 installed on the front of the clothing-related device displays an avatar related to the recognized user, and additionally displays graphics showing the user 100 virtually trying on the desired clothing, hat, etc. As shown in FIG. 3, it can be confirmed that the actual user 100 is not wearing a hat, but the avatar displayed on the display 200 is wearing a virtual hat. Furthermore, the display 200 can also operate as a mirror when the user is not recognized.

Lastly, in FIG. 3, it is assumed that the display 200 is exposed to the front of the clothing-related device, but the present invention is also designed so that the display is located inside when the user 100 opens the door of the clothing-related device. falls within the scope of rights.

In particular, the XR device that will be described in the drawings below is sufficient as a device with a display function.

Figure 4 shows an example of a flow chart illustrating a process for controlling an XR device according to an embodiment of the present invention.

First, the XR device according to an embodiment of the present invention may be a styler type capable of managing a plurality of clothes, as previously shown in FIG. 3. The appearance of the styler will be described again in Figure 5 below.

As shown in FIG. 4, the XR device according to an embodiment of the present invention stores ID information and body size information of each of a plurality of users in memory (S2510). For example, using a camera installed on an XR device, the user's face is photographed and an ID is assigned based on characteristic information. Furthermore, using the same camera or another camera described above, the user's body is photographed and body size numerical information is stored in memory.

Then, the XR device stores information on each of the plurality of clothes included in the XR device in the memory (S2520). Information on each of the clothes is mapped with the ID obtained in step S2510. This is a unique feature of an embodiment of the present invention that automatically grants ownership (priority) to each piece of clothing in the XR device, which will be described in more detail in FIG. 5 below.

The XR device uses a camera to recognize the first user located around the XR device (S2530). Furthermore, the XR device refers to the memory and extracts information about at least one piece of clothing that corresponds to the recognized first user and is included in the XR device (S2540). The memory will be described in more detail with reference to FIG. 5 below.

Then, the XR device displays a virtual avatar based on the body size information stored in the memory and a graphic image of the extracted clothes (S2550). This will be described in more detail in Figure 5 below.

However, Figure 4 explains the solution when only one user is recognized, but the solution when multiple users are recognized will be described in more detail in Figure 7 below.

Meanwhile, the flow chart shown in FIG. 4 can be applied to various XR devices, and a case where it is applied to the styler shown in FIG. 3 will be described as follows.

The Styler, an example of an XR device, includes at least memory, a camera, a controller, and a display module.

The memory stores ID information and body size information for each of a plurality of users. Furthermore, the memory additionally stores information on each of a plurality of clothes included in the XR device. The XR device (e.g., styler, etc.) may recognize basic information about the clothes from tags of the clothes inside, or the user may directly input information about each piece of clothing.

The camera recognizes the first user located around the XR device. Accordingly, the XR device may additionally be equipped with a user face recognition algorithm.

The controller refers to the memory and extracts information about at least one piece of clothing that corresponds to the recognized first user and is included in the XR device.

And, the display module displays a virtual avatar based on the body size information stored in the memory and a graphic image of the extracted clothes. This will be described in more detail in FIGS. 5 and 6 below.

Figure 5 shows an example of the appearance of an XR device and a DB (database) stored in memory according to an embodiment of the present invention.

The appearance of a styler, which is an example of an XR device capable of processing the process of FIG. 4 described above, is shown in (a) of FIG. 5.

As shown in (a) of FIG. 5, the XR device 2600 according to an embodiment of the present invention includes a camera 2601. Therefore, it is possible to recognize the user 2610 around the XR device 2600 using the camera 2601.

Furthermore, recommended clothes 2602 optimized for the recognized user 2610 are displayed. In order to extract recommended clothes 2602 optimized for the user 2610, for example, the database DB shown in (b) of FIG. 5 is used. The DB may be stored in the memory of the XR device 2600, but in some cases, it is also possible to update it by receiving related data from the server.

The XR device shown in (a) of FIG. 5 refers to the database shown in (b) of FIG. 5. Clothes A, Clothes B, Clothes C, and Clothes D shown in (b) of Figure 5 are all built into the XR device (e.g., styler). Using the tag information attached to each piece of clothing, information about each piece of clothing can be recognized and it can be determined whether the piece of clothing is located within the XR device.

Furthermore, as shown in (b) of FIG. 5, each piece of clothing is given priority (or ownership, ID) to a specific user. The priority (or ownership, ID) may be set according to user designation or may be determined automatically. For example, when the XR device recognizes a specific user, if specific clothes are removed from the XR device the most times, the specific user is automatically set to have priority (ownership) of the specific clothes.

For example, if there is a history of user A wearing B clothes the most during a specific period, the priority (ID) for B clothes is automatically set to user A.

For example, if there is a history of user B wearing C clothes the most during a specific period, the priority (ID) for C clothes is automatically set to user B.

For example, if there is a history of user c wearing D clothes the most during a specific period, the priority (ID) for D clothes is automatically set to user c.

Therefore, the ID mapped to the first clothes at the first point of view and the ID mapped to the first clothes at a second point of view different from the first point of view may be changed, and this will be described in more detail in FIG. 10 below. .

Meanwhile, as shown in (b) of FIG. 5, another feature of one embodiment of the present invention is that a new ID called “Random Clothes” is assigned to the database. This is a solution to resolve cases where disputes may arise due to clothes preferred by multiple users, especially when a styler is installed in the home and multiple users share the styler. This will be described in more detail in Section 7 below. However, FIG. 6, which is an embodiment in which there is no possibility of dispute due to multiple users, will be described first.

Figure 6 shows a solution when an XR device recognizes one user according to an embodiment of the present invention.

As shown in (a) of FIG. 6, it is assumed that one user 2710 exists around the XR device 2700. It is assumed that the camera 2701 installed on the top of the XR device 2700 is capable of recognizing the face as well as the presence of the user 2710. Meanwhile, in Figure 6(a), the camera 2701 is shown as being located on top of the XR device 2700, but this does not limit the scope of the present invention.

When the XR device 2700 recognizes a specific user 2710, it displays a virtual avatar 2702 based on the body information of the specific user 2710 stored in memory.

Of course, outputting the actual image of the specific user 2710 instead of the virtual avatar 2702 also falls within the scope of the present invention.

Furthermore, as shown in (b) of FIG. 6, the XR device refers to a memory (e.g., (b) of FIG. 5) to select specific clothes 2713 with priority (ownership or ID) given to the recognized user. ) graphic image is displayed together with the virtual avatar (2712).

Therefore, users have the advantage of being able to immediately receive recommendations for the clothes they usually wear among the various clothes (including clothes that fit them as well as clothes of other family members) inside the XR device every time.

Of course, in Figure 6 (b), only one clothes with priority is shown to be recommended to the user, but the advantage of reducing the user's clothes selection time is expected by displaying all the plural clothes with priority to the user. will be.

Meanwhile, in Figure 6, it is assumed that only one family member exists around the XR device, but if multiple family members are recognized, a different solution is needed. This will be described in more detail below with reference to FIG. 7.

Figure 7 shows an example of a solution when an XR device recognizes multiple users according to an embodiment of the present invention.

5 and 6 described above show a service that recognizes only one user around the XR device and recommends clothes optimized for that user. However, even if ownership (priority) is granted to only one specific person for specific clothes, there may be other users with similar preferences.

For example, for clothes A, if the first user has a history of selecting number 5 during a specific period, but the second user also has a history of selecting number 4, priority for clothes A is given to the first user. . Therefore, from the second user's perspective, it can be seen that the preference for clothes A is at all low, and there is a high possibility that a dispute will arise in the future between the first user and the second user regarding clothes A. Figure 7 is a solution to solve this problem.

First, the XR device 2800 according to an embodiment of the present invention uses the camera 2801 to determine whether a plurality of users 2810 and 2820 exist nearby.

If only the first user 2810 exists at the first point of view, as shown in (a) of FIG. 7, only the virtual avatar 2802 corresponding to the first user 2810 is displayed.

However, when the second user 2820 is recognized at a second time after a certain time has elapsed from the first time, as shown in (b) of FIG. 7, the XR device is shown in (a) of FIG. 7. The display of the virtual avatar is stopped, and only the graphic image 2830 of random clothes extracted from the memory is displayed. In (b) of FIG. 7, an indicator 2840 indicating that the currently displayed clothes are random clothes is displayed, but not displaying this is also within the scope of the present invention.

That is, when a plurality of users are recognized around the XR device, information about random clothes that do not correspond to the recognized plurality of users is automatically generated by referring to the memory shown in (b) of FIG. 5. Extract with As previously explained in FIG. 5, random clothes stored in memory refer to clothes that do not belong to any user's priorities.

However, although not shown in FIG. 7, if another user 2820 leaves, the clothes with ownership (ID) of the specific user 2810 are normally returned along with the virtual ataba, as shown in (b) of FIG. 6. Display.

Therefore, there is an advantage in that the possibility of a dispute occurring between multiple users can be prevented in advance by displaying random clothes only when there are multiple users around the XR device.

However, Figure 7 is an embodiment assuming that after the first user is recognized, the second user is also recognized after a certain period of time. However, when multiple users are recognized at the same time, there is little possibility of dispute even if clothes optimized for each user are immediately recommended. Embodiments related to this will be described in more detail in FIGS. 12 and 13 below.

On the other hand, as shown in FIG. 7, when another face is recognized while one user is appreciating recommended clothes, a new mode according to an embodiment of the present invention that recommends clothes unrelated to the first user is called private view. It is defined as, and is especially necessary when multiple family members share the styler installed at home.

Figure 8 shows a service in which an XR device recommends different clothes according to a specific schedule according to an embodiment of the present invention.

In previous embodiments, a service for recommending clothes optimized for a specific user based on the ownership (ID or priority) of each clothes has been described. However, embodiments of the present invention are also capable of recommending clothes using more diverse factors.

For example, as shown in Figure 8, virtual avatar 2910 is wearing specific clothes. However, the XR device can be connected to a network such as the Internet, so it is possible to receive weather information for each date.

Therefore, when the user selects a specific date from the calendar 2920 displayed on the display of the XR device, the XR device that has received the weather information for that date selects clothes suitable for the weather from among the clothes (owned by the user) in the XR device. I recommend.

More specifically, for example, the XR device (EX: Styler) contains various clothes that are prioritized for user A, and in particular includes clothes A suitable for rainy days and clothes B suitable for snowy days; Assume that there is.

At this time, as shown in Figure 8, the XR device, which received weather information predicted to rain on August 15, the date selected by user A, is designed to preferentially recommend clothes a among clothes a and clothes b. .

Therefore, there is a technical effect that reduces the possibility of a user accidentally choosing the wrong clothes on a particular day.

Figure 9 shows a service in which an XR device recommends sizes for multiple users when using an online shopping mall according to an embodiment of the present invention.

As described above, conventional stylers only have the function of managing the appearance of clothes. However, as briefly explained in FIG. 8, the XR device (ex: styler) according to an embodiment of the present invention is additionally equipped with an Internet network function.

Accordingly, the user can also start services such as an online shopping mall using the XR device according to an embodiment of the present invention.

According to the prior art, as shown in (a) of FIG. 9, only small size clothes 3010, which are a specific size suitable for the body of user A 3000, are used based on the body size information of user A 3000. I'm just recommending it. However, a service that considers the body sizes of multiple family members is currently not provided.

On the other hand, as shown in (b) of FIG. 9, when user A selects specific clothes to purchase online, not only the body size of user A (3000) but also the body sizes of other family members (3040) are taken into consideration, It is also possible to display a related message (3030) while displaying medium-sized clothes (3020).

However, in order to implement this, it is assumed that the XR device captures information about the body size of family members in advance through a camera or receives it from another device.

Figure 10 shows another example of a DB (database) stored in the memory of an XR device according to an embodiment of the present invention.

Previously, in Figure 5, the database that generates information about random clothes was mainly explained. On the other hand, Figure 10 shows an embodiment in which the ownership (priority, ID) of specific clothes changes depending on the point in time.

As shown in Figure 10, as of November 1, 2019, user a has priority for clothes A, user b has priority for clothes B, and user c has priority for clothes C. , D No one has priority when it comes to clothes. Here, users a to c are, for example, family members who share an XR device. In addition, priority is automatically determined depending on whether each piece of clothing was selected the most during a specific period (e.g., a month). Of course, as described above, the user's direct designation also falls within the scope of the present invention.

However, the history of clothes chosen by family members may change during the month from November 1 to November 30, 2019. In other words, as of December 1, 2019, the priority is changed because B clothes were selected the most by user B, and since C clothes were selected most often by user A, the priorities are also changed. Furthermore, clothes A and D have no ownership because no one has selected them, that is, they are automatically converted to a random state.

Lastly, the history of clothes chosen by family members during the month from December 1, 2019 to December 31, 2019 is also reflected. Therefore, as of January 1, 2020, user c has priority only for D clothes, and all other clothes are changed to a random state. In this way, a more specific embodiment in which priority is changed will be described later with reference to FIG. 11. FIG. 11 shows another example of a flow chart showing a process for controlling an XR device according to an embodiment of the present invention.

The XR device according to an embodiment of the present invention counts the number of times that specific clothes deviate from the XR device by a preset distance or more while a specific user is recognized through a camera (S3210).

Based on the counting result, the ID corresponding to the specific clothes is mapped (S3220). In other words, there is a problem in that simply selecting the clothes does not accurately determine whether the user actually wore the recommended clothes displayed. To solve this problem, a tag attached to each piece of clothing and a sensor in an XR device that can recognize the tag are designed to count to determine ownership only when the selected piece of clothing deviates by a certain distance or more. These results are reflected in real time in the aforementioned memory database.

However, there may be cases where some users go out wearing clothes other than those recommended to them, that is, clothes for which they have not been given ownership (priority or ID). This needs to be resolved.

Therefore, as shown in FIG. 11, in a state where a user other than the user corresponding to the mapped ID is recognized, it is determined again whether the specific clothes have deviated from the XR device by a preset distance or more (S3230).

And, if the determination result (S3230) is deviant, a related message is designed to be transmitted to the mobile device of the user who is the original owner (S3240).

Meanwhile, in FIG. 7, an embodiment in which only one user is recognized and a plurality of users are recognized after a certain period of time is automatically switched to the private view mode has been described.

However, when multiple users are recognized at almost the same time, a service that appropriately recommends clothes to multiple users is required rather than executing a private view mode. This will be described in more detail with reference to FIGS. 12 and 13 below.

Figures 12 and 13 show another example of a solution when an XR device recognizes multiple users according to an embodiment of the present invention.

Unlike the previous embodiment of FIG. 7, FIGS. 12 and 13 assume a case where multiple users are recognized together within a preset time difference (eg, 1 to 2 seconds).

As shown in FIG. 12, when the XR device 3300 recognizes the first user 3310 and the second user 3320 at the same time, the first virtual avatar 3311 corresponding to the first user 3310 and the second virtual avatar 3321 corresponding to the second user 3320 are all displayed.

However, it is assumed that the distance between the XR device 3300 and each user is different. In consideration of this, it also falls within the scope of the present invention to allow a plurality of virtual avatars to change to positions displayed on the screen of the XR device.

Furthermore, the XR device refers to the database and automatically extracts combinations of clothes that look good when worn by multiple users. The DB related to this will be described later in Figure 14.

Using the database shown in FIG. 14, the XR device outputs white-collared clothes 3410 among the clothes owned by the first user and also outputs white-collared clothes 3410 among the clothes owned by the second user, as shown in FIG. 13. White-collar clothes 3420 are output. And, Figure 14 shows another example of a DB (database) stored in the memory of an XR device according to an embodiment of the present invention.

The user recognized first or closest to the XR device becomes the reference user.

As shown in Figure 14, it is assumed that user a is the reference user.

If user a randomly selects the first clothes, information on clothes for users b, c, d, and e that can match user a's first clothes is extracted. Then, corresponding clothes are displayed depending on whether the users recognized in FIGS. 12 and 13 are users b to e.

Meanwhile, when user a randomly selects the second clothes, information on the clothes of users b, c, d, and e that can be matched with the second clothes of user a is extracted. Then, corresponding clothes are displayed depending on whether the users recognized in FIGS. 12 and 13 are users b to e.

Finally, when user a randomly selects third clothes, information on clothes for users b, c, d, and e that can match user a's third clothes is extracted. Then, corresponding clothes are displayed depending on whether the users recognized in FIGS. 12 and 13 are users b to e.

Of course, in Figure 14, matching is determined based on color, but determining matching depending on the type and type of clothes is also within the scope of the present invention.

Meanwhile, although this specification has been described with reference to the attached drawings, these are only examples and are not limited to specific examples, and various modifications that can be made by those skilled in the art in the technical field to which the invention pertains are also included in the claims. falls within the scope of rights. Additionally, such modified implementations should not be understood individually from the technical spirit of the present invention.

110: communication unit
120: control unit
130: memory unit
140a: I/O unit
140b: sensor unit
140c: power supply unit

Claims (15)

In the control method of an XR device capable of managing a plurality of clothes,
Storing ID information and body size information of each of a plurality of users in a memory;
Storing information on each of a plurality of clothes included in the XR device in the memory - information on each of the clothes is mapped to at least one of the IDs -;
Recognizing a first user located around the XR device using a camera;
Referring to the memory, extracting information about at least one piece of clothing corresponding to the recognized first user and included in the XR device;
Displaying a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes together;
Determining whether to recognize a plurality of users around the XR device;
As a result of the determination, when a plurality of users are recognized around the XR device, extracting information about random clothes that do not correspond to the plurality of recognized users by referring to the memory;
stopping display of the virtual avatar; and
A step of displaying only the graphic images of the extracted random clothes.
A control method of an XR device comprising: delete In the control method of an XR device capable of managing a plurality of clothes,
Storing ID information and body size information of each of a plurality of users in a memory;
Storing information on each of a plurality of clothes included in the XR device in the memory - information on each of the clothes is mapped to at least one of the IDs -;
Recognizing a first user located around the XR device using a camera;
Referring to the memory, extracting information about at least one piece of clothing corresponding to the recognized first user and included in the XR device; and
A step of displaying together a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes,
A method of controlling an XR device, characterized in that the ID is set according to user designation or automatically determined. According to paragraph 1,
A method of controlling an XR device, characterized in that the ID mapped to the first clothes at a first point of view and the ID mapped to the first clothes at a second point of view different from the first point of view are changed. In the control method of an XR device capable of managing a plurality of clothes,
Storing ID information and body size information of each of a plurality of users in a memory;
Storing information on each of a plurality of clothes included in the XR device in the memory - information on each of the clothes is mapped to at least one of the IDs -;
Recognizing a first user located around the XR device using a camera;
Referring to the memory, extracting information about at least one piece of clothing corresponding to the recognized first user and included in the XR device;
Displaying together a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes;
When a specific user is recognized through the camera, counting the number of times specific clothes deviate from the XR device by a preset distance or more; and
Based on the counting result, mapping the ID corresponding to the specific clothes.
A control method for an XR device comprising: According to clause 5,
In a state where a user other than the user corresponding to the mapped ID is recognized, determining whether the specific clothes have deviated from the XR device by a preset distance or more; and
If the determination results in deviation, transmitting a related message to the user's mobile device.
A control method for an XR device, further comprising: According to paragraph 1,
The XR device,
A control method for an XR device, characterized in that it is applied to at least one of a styler product, signage, or TV. In the XR device that can manage multiple clothes,
A memory that stores ID information and body size information for each of a plurality of users - the memory additionally stores information for each of a plurality of clothes included in the XR device -;
A camera that recognizes a first user located around the XR device;
A controller that refers to the memory and extracts information about at least one piece of clothing corresponding to the recognized first user and included in the XR device; and
It includes a display module that displays a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes,
The information on each of the clothes stored in the memory is,
is mapped to at least one of the above IDs,
The controller is,
Determine whether a plurality of users are recognized around the XR device,
As a result of the determination, when a plurality of users are recognized around the XR device, the memory is referred to to extract information about random clothes that do not correspond to the recognized plurality of users,
By controlling the display module, stop display of the virtual avatar, and
An XR device, characterized in that by controlling the display module, only the graphic images of the extracted random clothes are displayed. delete delete In the XR device that can manage multiple clothes,
A memory that stores ID information and body size information for each of a plurality of users - the memory additionally stores information for each of a plurality of clothes included in the XR device -;
A camera that recognizes a first user located around the XR device;
A controller that refers to the memory and extracts information about at least one piece of clothing corresponding to the recognized first user and included in the XR device; and
It includes a display module that displays a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes,
The information on each of the clothes stored in the memory is,
is mapped to at least one of the above IDs,
The ID is set according to user designation or is automatically determined. According to clause 8,
An XR device characterized in that the ID mapped to the first clothes at a first point of view and the ID mapped to the first clothes at a second point of view different from the first point of view are changed. In the XR device that can manage multiple clothes,
A memory that stores ID information and body size information for each of a plurality of users - the memory additionally stores information for each of a plurality of clothes included in the XR device -;
A camera that recognizes a first user located around the XR device;
A controller that refers to the memory and extracts information about at least one piece of clothing corresponding to the recognized first user and included in the XR device; and
It includes a display module that displays a virtual avatar based on body size information stored in the memory and a graphic image of the extracted clothes,
The information on each of the clothes stored in the memory is,
is mapped to at least one of the above IDs,
The controller is,
When a specific user is recognized through the camera, the number of times specific clothes deviate from the XR device by more than a preset distance is counted, and
An XR device characterized in that it maps an ID corresponding to the specific clothes based on the counting result. According to clause 13,
The controller is,
In a state where a user other than the user corresponding to the mapped ID is recognized, determine whether the specific clothes have deviated from the XR device by more than a preset distance, and
XR device, characterized in that controlling the communication module to transmit a related message to the user's mobile device when the determination result is deviant. According to clause 8,
The XR device,
An XR device characterized by being applied to at least one of a styler product, signage, or TV.

Images