KR102136223B1 - Large format display apparatus and control method thereof - Google Patents

Abstract

Disclosed is a large format display (LFD) device. The LFD device acquires profile information of a user recognized through a display, a sensing unit that recognizes a user, and a sensing unit, determines a clothing model and recommended clothing corresponding to the obtained profile information, and clothing in a state in which recommended clothing is worn And a processor that controls the display to display the model. Accordingly, purchasing convenience of a user using the LFD device may be increased.

Description

LFD (large format display) device and its control method {LARGE FORMAT DISPLAY APPARATUS AND CONTROL METHOD THEREOF}

The present invention relates to an LFD device and a control method thereof, and more particularly, to an LFD device and a control method thereof providing various information and user interaction using a large display.

Due to the development of electronic technology, various types of electronic products are developed and distributed, and electronic devices equipped with various information providing functions are used. Furthermore, electronic products previously used only indoors are installed and used on streets.

Among them, a large format display (LFD) device is a commercial large display that is installed and operated for the purpose of publicity and information transmission, and the LFD device is a video wall connecting a stand alone consisting of one panel and multiple panels. (video wall). In addition, the LFD device is installed in the corporate lobby for brand and corporate promotion, or used for various purposes such as interior of a store, menu board, and the like. Recently, as the use of LFD devices has increased, various problems have occurred.

1 is a view for explaining the problems of the prior art.

Conventional LFD devices display pre-stored content according to a preset method, and thus it is difficult to provide flexible content according to a user and environment. For example, when the LFD device displays the toy advertisement, there is a problem that only the toy advertisement is continuously displayed even if an adult is in front of the LFD device. That is, the user could not change the content provided by the LFD device or view it again.

In addition, as the LFD device is installed in various places, there is a problem that the user's interest is lowered and the advertising effect is deteriorated.

This conventional problem is that the content displayed on the LFD device is provided in a fixed manner, and a need for an LFD device that can cause more user attention has emerged.

The present invention is to solve the above-mentioned problems, the object of the present invention is to obtain the profile information for the user using the LFD device, and the LFD device and a control method for determining and displaying the clothing model displayed on the LFD device and recommended clothing In providing.

The LFD (large format display) device according to an embodiment of the present invention for achieving the above object acquires a display, a detection unit for recognizing a user, and profile information of a user recognized through the detection unit, and the obtained And a processor that determines a clothing model and recommended clothing corresponding to the profile information, and controls the display to display the clothing model while wearing the recommended clothing.

In addition, the sensing unit recognizes the user's movement, and the processor may control the movement state of the clothing model so that the clothing model corresponds to the recognized user's movement.

Then, the processor displays a background image distinguished from the clothing model, and changes the background image based on the movement direction of the user when the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized. In addition, when the movement of the user whose vertical distance from the LFD device is changed is recognized, the background image may be maintained.

In addition, the processor may determine the clothing model based on the user's age and gender information, and determine the recommended clothing based on information about the clothing worn by the user.

In addition, the processor may determine a recommended accessory based on at least one of the user's clothing purchase record and accessory purchase record, and display the clothing model while wearing the recommended accessory.

In addition, if the distance between the display and the user is within a predetermined distance, the processor provides a query for receiving the type of clothing desired by the user, and determines the recommended clothing based on the user's response to the query Can.

In addition, the processor obtains at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information, and based on the obtained profile information and the user's response, the recommendation You can decide on clothing.

In addition, when the preset motion is recognized by the user, the processor may control the clothing model to make a gesture in response to the preset motion, or display an animation effect corresponding to the preset motion.

And, when a plurality of users are recognized through the sensing unit, the processor may include at least one of a visit history, a purchase record, interest in the LFD device, a distance from the display, and a distance from the center of the display when the plurality of users are recognized. A main user may be determined among the plurality of users based on the display, and the clothing model corresponding to the main user may be displayed.

In addition, the processor may measure interest in the LFD device based on at least one of the direction of the user's face and the time the user gazes at the display.

Meanwhile, according to an embodiment of the present invention, a control method of a large format display (LFD) device may include recognizing a user, obtaining profile information of the recognized user, and a clothing model corresponding to the obtained profile information. And determining the recommended clothing and displaying the clothing model while wearing the recommended clothing.

In addition, the step of recognizing recognizes the user's movement, and the step of displaying may control the movement state of the clothing model such that the clothing model corresponds to the recognized user's movement.

And, the displaying step displays a background image distinct from the clothing model, and when the user's movement in the left and right directions in which a vertical distance from the LFD device is maintained is recognized, the background image is based on the user's movement direction. When the movement of the user in which the vertical distance from the LFD device is changed is recognized, the background image may be maintained.

In addition, the determining step may determine the clothing model based on the user's age and gender information, and determine the recommended clothing based on information about the clothing the user is wearing.

In the determining, the recommended accessory is determined based on at least one of the user's clothing purchase record and accessory purchase record, and the displaying step can display the clothing model while wearing the recommended accessory. .

In addition, if the distance between the LFD device and the user is within a preset distance, further comprising providing a query for receiving the type of clothing desired by the user, and the determining step includes the user's response to the query Based on this, it is possible to determine the recommended clothing.

And, the acquiring step acquires at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information, and the determining step comprises the obtained profile information and the user The recommended clothing may be determined based on the response.

In addition, in the displaying, when the preset motion is recognized by the user, the clothing model may be controlled to make a gesture in response to the preset motion, or an animation effect corresponding to the preset motion may be displayed.

And, when a plurality of users is recognized, the plurality of users based on at least one of the visit history, purchase history, interest in the LFD device, the distance from the LFD device and the distance from the center of the LFD device Further comprising the step of determining the main user of the user, the displaying step may display the clothing model corresponding to the main user.

In addition, the determining of the main user may measure an interest in the LFD device based on at least one of a direction of the user's face and a time when the user gazes at the LFD device.

According to various embodiments of the present invention as described above, the LFD device displays a clothing model and recommended clothing corresponding to the user's profile information to induce the user's interest, and provides various recommended clothing to facilitate clothing desired by the user By purchasing, the user's convenience is improved.

1 is a view for explaining the problems of the prior art.
2 is a block diagram showing the configuration of a large format display (LFD) device according to an embodiment of the present invention.
3 is a block diagram of a software structure used by an LFD device according to an embodiment of the present invention.
4 is a view for explaining a method of obtaining user's profile information according to an embodiment of the present invention.
5 is a diagram for explaining displaying a clothing model and recommended clothing according to an embodiment of the present invention.
6 is a view for explaining a display state according to a user's movement according to an embodiment of the present invention.
7 is a view for explaining a method of using a user's purchase record according to an embodiment of the present invention.
8 is a view for explaining an animation effect according to an embodiment of the present invention.
9 is a view for explaining a case in which a plurality of users is detected according to an embodiment of the present invention.
10 is a view for explaining providing a query according to an embodiment of the present invention.
11 is a view for explaining the operation of the LFD device according to an embodiment of the present invention.
12 is a view for explaining the operation of the LFD device having a mirror display according to an embodiment of the present invention.
13 is a view for explaining a method of providing statistical information according to an embodiment of the present invention.
14 is a flowchart illustrating a control method of an LFD device according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram showing the configuration of a large format display (LFD) device 100 according to an embodiment of the present invention.

According to FIG. 2A, the LFD device 100 includes a display 110, a sensing unit 120, and a processor 130.

On the other hand, Figure 2a, for example, when the LFD device 100 is a device having various functions such as a display function, a detection function, and a control function, for example, shows various components in a comprehensive manner. Accordingly, depending on the embodiment, some of the components illustrated in FIG. 2A may be omitted or changed, and other components may be further added.

The display 110 may display a clothing model and recommended clothing under the control of the processor 130. For example, the display 110 may display a clothing model wearing recommended clothing. However, the present invention is not limited thereto, and the display 110 may display only recommended clothing. In addition, the display 110 may display accessories, fashion accessories, etc. in addition to clothing.

In addition, the display 110 may be implemented by a liquid crystal display panel (LCD), organic light emitting diodes (OLED), or the like, but is not limited thereto. In addition, the display 110 may be implemented as a flexible display, a transparent display, and the like in some cases.

The detector 120 may recognize a user located in front of the LFD device 100. Here, the sensing unit 120 may determine the relationship between the gender, the age group, and the user based on characteristics of the user's face and body, clothing, gait, and pose. In addition, the sensing unit 120 may recognize the user's face and determine the user from a pre-stored face image. Alternatively, the sensing unit 120 may detect only the user's motion.

The sensing unit 120 may be mainly composed of a camera. The camera is a component for capturing a still image or video. In particular, the camera can be used to photograph a user located in front of the LFD device 100. However, the present invention is not limited thereto, and the sensing unit 120 may include a Kinect, a depth camera, and an ultrasonic sensor.

Meanwhile, the sensing unit 120 may communicate with the electronic device possessed by the user to obtain the user's profile information. In this case, the LFD device 100 may communicate with an electronic device possessed by the user using WiFi, NFC, or the like.

The processor 130 acquires profile information of the user recognized through the sensing unit 120, determines a clothing model and recommended clothing corresponding to the obtained profile information, and displays a clothing model in a state where the recommended clothing is worn The display 110 can be controlled. Here, the clothing model may be classified into a male model and a female model, and among male models, a youth model, a middle-aged model, and the like.

In addition, the processor 130 may control the movement state of the clothing model so that the clothing model corresponds to the user's movement recognized by the sensing unit 120. Here, the processor 130 may change and display not only the clothing model but also recommended clothing worn by the clothing model to correspond to the movement state of the clothing model.

Then, the processor 130 displays a background image distinguished from the clothing model, and changes the background image based on the movement direction of the user when the user's movement in the left and right directions in which the vertical distance from the LFD device 100 is maintained is recognized. In addition, when a user's movement in which a vertical distance from the LFD device 100 is changed is recognized, the background image may be maintained. At this time, the processor 130 may change the clothing model and the background image differently even if there is a movement of the same user.

In addition, the processor 130 may determine a clothing model based on the user's age and gender information, and determine recommended clothing based on information about the clothing the user is wearing.

In addition, the processor 130 may determine the recommended accessory based on at least one of the user's clothing purchase record and accessory purchase record, and display a clothing model in a state where the recommended accessory is worn.

In addition, if the distance between the display 110 and the user is within a preset distance, the processor 130 provides a query for inputting a type of clothing desired by the user, and determines recommended clothing based on the user's response to the query Can.

Then, the processor 130 obtains at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information, and determines recommended clothing based on the obtained profile information and the user's response Can.

In addition, when a preset motion is recognized by the user, the processor 130 may control the clothing model to make a gesture in response to the preset motion, or display an animation effect corresponding to the preset motion.

Then, when a plurality of users are recognized through the sensing unit 120, the processor 130 may record visits, purchase records, interest in the LFD device 100, distances from the display 110, and displays ( The main user among the plurality of users may be determined based on at least one of the distances from the center of 110, and a clothing model corresponding to the main user may be displayed.

In addition, the processor 130 may measure an interest in the LFD device 100 based on at least one of the direction of the user's face and the time the user gazes at the display 110.

2B is a block diagram showing an example of a detailed configuration of the LFD device 100. According to FIG. 2B, the LFD device 100 includes a display 110, a sensing unit 120, a processor 130, a storage 140, a communication unit 150, a user interface unit 155, an audio processing unit 160, It includes a video processing unit 170, a speaker 180, a button 181, a microphone 182. Of the components illustrated in FIG. 2B, detailed descriptions of components overlapping with those illustrated in FIG. 2A will be omitted.

The processor 130 controls the overall operation of the LFD device 100 using various programs stored in the storage 140.

Specifically, the processor 130 includes a RAM 131, a ROM 132, a main CPU 133, a graphics processor 134, first to n interfaces 135-1 to 135-n, and a bus 136. Includes.

The RAM 131, the ROM 132, the main CPU 133, the graphic processing unit 134, and the first to n interfaces 135-1 to 135-n may be connected to each other through the bus 136.

The first to n interfaces 135-1 to 135-n are connected to various components described above. One of the interfaces may be a network interface connected to an external device through a network.

The main CPU 133 accesses the storage 140 to boot using the O/S stored in the storage 140. Then, various operations are performed using various programs stored in the storage 140.

The ROM 132 stores a set of instructions for booting the system and the like. When a turn-on command is input and power is supplied, the main CPU 133 copies the O/S stored in the storage 140 to the RAM 131 according to the command stored in the ROM 132, and executes the O/S to operate the system. Boot it. When the booting is completed, the main CPU 133 copies various application programs stored in the storage 140 to the RAM 131 and executes the application programs copied to the RAM 131 to perform various operations.

The graphic processing unit 134 generates a screen including various objects, such as icons, images, and text, by using a calculation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates attribute values such as coordinate values, shapes, sizes, colors, etc. to be displayed according to the layout of the screen based on the received control command. The rendering unit (not shown) generates screens of various layouts including objects based on attribute values calculated by the calculation unit (not shown). The screen generated by the rendering unit (not shown) is displayed in the display area of the display 110.

Meanwhile, the operation of the above-described processor 130 may be performed by a program stored in the storage 140.

The storage 140 stores various data such as an operating system (O/S) software module for driving the LFD device 100, clothing model information, clothing information, accessory information, and user purchase history information.

In this case, the processor 130 may display the clothing model and recommended clothing based on the information stored in the storage 140.

The communication unit 150 may communicate with external devices according to various types of communication methods.

The communication unit 150 includes various communication chips such as a Wi-Fi chip 151, a Bluetooth chip 152, and a wireless communication chip 153. The Wi-Fi chip 151 and the Bluetooth chip 152 perform communication using a WiFi method and a Bluetooth method, respectively. The wireless communication chip 153 refers to a chip that performs communication according to various communication standards such as IEEE, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), and LTE (Long Term Evoloution).

Meanwhile, the communication unit 150 may perform one-way communication or two-way communication with the electronic device. When performing unidirectional communication, the communication unit 150 may receive a signal from an electronic device. When performing two-way communication, the communication unit 150 may receive a signal from an electronic device or transmit a signal to the electronic device.

The user interface unit 155 receives various user interactions. Here, the user interface unit 155 may be implemented in various forms according to an implementation example of the LFD device 100. When the LFD device 100 is implemented as a digital TV, the user interface unit 155 may be implemented as a remote control receiver that receives a remote control signal from a remote control device, a camera that detects user motion, and a microphone that receives user voice. Also, when the LFD device 100 is implemented as a touch-based electronic device, the user interface unit 155 may be implemented in the form of a touch screen that forms a mutual layer structure with the touchpad. In this case, the user interface unit 155 can be used as the above-described display 110.

The audio processing unit 160 is a component that performs processing on audio data. The audio processing unit 160 may perform various processes such as decoding or amplification of audio data, noise filtering, and the like.

The video processing unit 170 is a component that performs processing on video data. The video processing unit 170 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on video data.

The speaker 180 is a component that outputs not only various audio data processed by the audio processing unit 160 but also various notification sounds or voice messages.

The button 181 may be various types of buttons, such as mechanical buttons, touch pads, wheels, etc., formed in an arbitrary region such as a front portion, a side portion, or a rear portion of the body exterior of the LFD device 100.

The microphone 183 is configured to receive a user voice or other sound and convert it into audio data.

Hereinafter, a basic configuration and various embodiments will be described to help understanding of the present invention.

3 is a block diagram of a software structure used by the LFD device 100 according to an embodiment of the present invention.

The software of FIG. 3 may be stored in the storage 140, but is not limited thereto, and may be stored in various types of storage means used in the LFD device 100. According to FIG. 3, software including an OS 181, a kernel 182, middleware 183, and an application 184 may be stored in the LFD device 100.

The operating system (OS, 181) controls and manages the overall operation of the hardware. That is, the OS 181 is a layer in charge of basic functions such as hardware management, memory, and security.

The kernel 182 serves as a path for transmitting various detected signals to the middleware 183.

The middleware 183 includes various software modules that control the operation of the LFD device 100. According to FIG. 3, the middleware 183 includes a UI framework 183-1, a window manager 183-2, a model creation module 183-3, a security module 183-4, and a system manager 183-5 ), connection manager 183-6, X11 module 183-7, APP manager 183-8, multimedia framework 183-9.

The UI framework 183-1 is a module for providing various UIs. The UI framework 183-1 includes an image compositor module that composes various objects, a coordinate composer that calculates coordinates to display the object, a rendering module that renders the constructed object to the calculated coordinates, in 2D or 3D form. And a 2D/3D UI toolkit that provides a tool for constructing a UI.

The window manager 183-2 may detect various input events such as a control signal transmitted from a remote control device, a user touch input to the display 110, and a button operation provided in the LFD device 100. When such an event is detected, the window manager 183-2 transmits an event signal to the UI framework 183-1 to perform an operation corresponding to the event. Specifically, when an event in which a user touches an area of the display 110 occurs, the UI framework 183-1 is notified. The UI framework 183-1 may display selected clothing based on the user's touch area.

As described above, the model generation module 183-3 may determine the clothing model and recommended clothing based on the user's profile information. In addition, the model generation module 183-3 may determine the recommended accessory based on the user's purchase record.

The security module 183-4 is a module that supports hardware certification, request permission, and secure storage.

The system manager 183-5 monitors the status of each component in the LFD device 100, and provides the monitoring results to other modules. For example, when a battery level is low, an error occurs, a communication connection state is disconnected, etc., the system manager 183-5 provides the monitoring result to the UI framework 183-1 to receive a notification message. I can output a notification sound.

The connection manager 183-6 is a module for supporting wired or wireless network connection. The connection manager 183-6 may include various detailed modules such as a DNET module and a UPnP module.

The X11 module 183-7 is a module that receives various event signals from various hardware provided in the LFD device 100. Here, the event may be variously set, such as an event in which a user manipulation is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 183-8 is a module that manages execution states of various applications installed in the storage 140. When an event in which an application execution command is input is detected from the X11 module 183-7, the APP manager 183-8 calls and executes an application corresponding to the event. That is, when an event in which at least one object is selected is detected, the APP manager 183-8 performs an operation of calling and executing an application corresponding to the object.

The multimedia framework 183-9 is a module for playing multimedia content stored in the LFD device 100 or provided from an external source. The multimedia framework 183-9 may include a player module, a camcorder module, and a sound processing module. Accordingly, an operation of generating and playing screens and sounds by playing various multimedia contents may be performed.

Since the software structure shown in FIG. 3 is only an example, it is not necessarily limited thereto. Therefore, it is needless to say that some may be omitted, modified, or added as necessary. For example, the storage 140 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an email program, and a telephone information collector. Various programs such as (Call Info Aggregator) program module, VoIP module, and web browser module may be additionally provided.

4 is a view for explaining a method of obtaining user's profile information according to an embodiment of the present invention.

According to FIG. 4A, the processor 130 may acquire profile information of a recognized user through the sensing unit 120 including the camera 410. For example, the processor 130 may recognize the user's face from the image photographed by the camera 410, and may acquire the user's profile information based on the stored information. However, the present invention is not limited thereto, and if the user's facial image does not match the stored information, the processor 130 may analyze the facial image to extract information about age, gender, and the like. In addition, the processor 130 may acquire information such as clothing worn by the user through the whole body image as well as the user's face.

According to FIG. 4B, the processor 130 may acquire the user's profile information through the electronic device 420 owned by the user. When the user enters within a certain distance from the LFD device 100, the processor 130 may communicate with the electronic device 420 owned by the user through wireless communication such as NFC, Bluetooth, and Beacon. Then, the processor 130 may receive the user's profile information from the electronic device 420 owned by the user. Alternatively, the processor 130 receives and stores minimal information (eg, name, mobile phone number, user ID, etc.) that identifies the user from the electronic device 420 that the user has, and stores the customer relationship (CRM). management) information from a user may be obtained.

In the above, the method of using the camera 410 and the method of communicating with the electronic device 420 are described as separate, but may be used together. For example, the processor 130 may receive the user's age, gender, and the like from the electronic device 420, and may obtain clothing information worn by the user using the camera 410.

In addition, the processor 130 may acquire a user's profile information using a Kinect, a depth camera, and an ultrasonic sensor in addition to the camera 410.

5 is a diagram for explaining displaying a clothing model and recommended clothing according to an embodiment of the present invention.

According to FIG. 5A, the processor 130 may determine a clothing model corresponding to the obtained profile information. In particular, the processor 130 may determine the clothing model based on the user's age and gender information. For example, the processor 130 may determine the clothing model of a woman in her twenties when the user obtains profile information that the woman is in her twenties. However, the present invention is not limited thereto, and the processor 130 may determine the clothing model based on the user's purchase history, not the user's age and gender information. For example, the processor 130 may determine a clothing model of a man in his twenties, even if the user is a woman in his twenties and has a lot of histories of purchasing male clothes in his twenties.

The processor 130 may determine recommended clothing corresponding to the obtained profile information. In particular, the processor 130 may determine the recommended clothing based on information on clothing worn by the user. For example, the processor 130 may acquire the black dress worn by the user as profile information, and determine a dress similar to the black dress as recommended clothing. That is, the processor 130 may determine the recommended clothing by acquiring the type, fashion image, color, and pattern of clothing the user is wearing. However, the present invention is not limited to this, and the processor 130 may determine a recently fashionable clothing as a recommended clothing regardless of clothing worn by the user.

In the above, only the dress has been described, but the same can be applied to other types of clothing such as a classic suit or sporty knit. Alternatively, the processor 130 may determine clothing associated with clothing that the user is wearing as recommended clothing. For example, when the user is wearing a classic suit, the processor 130 may determine a shirt as recommended clothing. Also, the processor 130 may additionally display not only a shirt but also formal shoes.

According to FIG. 5B, the processor 130 may determine the color of clothing in consideration of the skin tone of the user. For example, when the user's skin tone is bright, the processor 130 may determine bright clothing as recommended clothing. In addition, when the user's skin tone is dark, the processor 130 may determine dark clothing as recommended clothing. However, the present invention is not limited thereto, and the processor 130 may determine clothing having a color opposite to the skin tone of the user as recommended clothing. The matching information of the user's skin tone and clothing color may be stored in the storage 140.

Referring to FIG. 5A again, the processor 130 may display a clothing model in a state in which recommended clothing is worn. For example, the processor 130 may display a clothing model of a woman in her twenties wearing a dress. However, the present invention is not limited thereto, and the processor 130 may separately display a clothing model and recommended clothing.

Meanwhile, the processor 130 may change and display at least one of a clothing model and recommended clothing when the user's gaze does not face the display 110 for a predetermined time or more. For example, if the user does not see the display 110 for more than 20 seconds, the processor 130 may change the recommended clothing from the clothing of a woman in her twenties to that of a woman in her twenties. However, the present invention is not limited thereto, and the processor 130 may change from casual clothes to office-looking clothes or to change the clothing model to male. Also, the processor 130 may change at least one of the clothing model and the recommended clothing by touch input or the like without reference to the user's gaze.

6 is a view for explaining a display state according to a user's movement according to an embodiment of the present invention.

According to FIG. 6A, the sensing unit 120 recognizes the user's movement, and the processor 130 may control the movement state of the clothing model so as to correspond to the recognized user's movement. For example, the sensing unit 120 may recognize that the user is approaching the display 110, and the processor 130 may modify the clothing model to approach the user like a mirror image when the user approaches the display 110 Can be displayed. However, the present invention is not limited thereto, and the processor 130 may simply display a large clothing model when the user approaches the display 110. Also, the processor 130 may display different resolutions of the clothing model and the recommended clothing.

Meanwhile, when the user approaches the display 110, the processor 130 may enlarge or deform only the clothing model, but is not limited thereto. For example, the processor 130 may display both the clothing model and the background enlarged.

6A illustrates that the posture of the user and the clothing model is the same, but is not limited thereto. For example, the processor 130 does not sense the distance between the display 110 and the user and the user's posture as shown in FIG. 6A and displays the clothing model the same, but displays the clothing model based only on the user's distance. It might be.

Also, the processor 130 may display the user to lift the right arm and lift the left arm of the clothing model. However, the present invention is not limited thereto, and the processor 130 may not display it like a mirror image, but may display it to lift the right arm of the clothing model in response to the user's right arm. In addition, the processor 130 not only lifts the user's arm, but also shakes the arm, the pointing posture, the walking posture, the jumping posture, the running posture, the posture with the arms folded and the posture with open arms, or It can be displayed to pose.

In addition, the processor 130 can freely control not only the arms of the clothing model, but also the legs, head, feet, and hands. In particular, when the shape of the clothing model is changed, the processor 130 may change and display the recommended clothing that is being worn.

On the other hand, in the above, the processor 130 is described as changing and displaying the clothing model and the recommended clothing, and specifically, the processor 130 renders and displays the clothing model and the recommended clothing in response to a user's movement. However, the present invention is not limited thereto, and the processor 130 may simply display pre-stored pictures. Hereinafter, rendering and modification are used in the same sense.

According to FIG. 6B, the processor 130 displays a background image distinguished from the clothing model, and when the user's movement in the left and right directions in which the vertical distance from the LFD device 100 is maintained is recognized, the background is based on the user's moving direction. When an image is changed and a movement of a user whose vertical distance from the LFD device 100 is changed is recognized, the background image may be maintained. For example, when the processor 130 detects that the user moves from the left side to the right side after passing through the LFD device 100, the processor 130 displays the handbag stand 610 displayed on the right side of the display 110 on the left side of the display 110. You can move it to display. However, the processor 130 may not change the background image even when the user approaches the LFD device 100.

FIG. 6B illustrates that only the background image is changed for convenience of description, but is not limited thereto. For example, as described in the previous figure, the processor 130 may change the display as a clothing model and display it according to a user's movement. In addition, as illustrated in FIG. 6C, the processor 130 may display only the clothing model to be moved without changing the background image, and a detailed description thereof will be omitted because it overlaps with the above.

Meanwhile, in FIG. 6, it has been described that the background image is changed only when the user's movement in the left and right directions in which the vertical distance from the LFD device 100 is maintained is recognized, but is not limited thereto. For example, the processor 130 may change and display the background image even if the user's movement in which the vertical distance from the LFD device 100 is changed is recognized.

7 is a view for explaining a method of using a user's purchase record according to an embodiment of the present invention.

According to FIG. 7, the processor 130 may determine a recommended accessory based on at least one of a user's clothing purchase record and accessory purchase record, and display a clothing model in a state where the recommended accessory is worn. For example, if there is a record of the user purchasing the bag, the processor 130 may display a clothing model wearing the same bag 710 as the user purchased bag. However, the present invention is not limited thereto, and the processor 130 may display a subsequent design bag or a new product bag, not a bag purchased by the user. In addition, the processor 130 may display a bag and a belt released as a set purchased by the user.

In addition, the processor 130 may determine the recommended accessory from the user's clothing purchase record. For example, if there is a record that the user purchases casual clothes, the processor 130 may determine the sneakers as recommended accessories.

8 is a view for explaining an animation effect according to an embodiment of the present invention.

According to FIG. 8A, when the preset motion is recognized by the user, the processor 130 may control the clothing model to make a gesture in response to the preset motion, or display an animation effect corresponding to the preset motion. For example, when the user makes a heart shape using two arms, the processor 130 may control the clothing model to make a gesture of winking in response to this, or display an animation in which the heart is enlarged. However, the present invention is not limited thereto, and the processor 130 may output a voice such as "Thank you!" when the user makes a heart shape using both arms.

According to FIG. 8B, when a predetermined operation is recognized by the user, the processor 130 may change at least one of the clothing model and the recommended clothing. For example, when the processor 130 recognizes the operation of raising the user's right arm, the processor 130 may change the gender of the clothing model. However, the present invention is not limited thereto, and the processor 130 may change the type of recommended clothing. Further, the processor 130 may change at least one of the clothing model and the recommended clothing by recognizing the user's applause action.

In the above, the operation of the processor 130 according to the preset operation of the user has been described, but is not limited thereto. For example, the processor 130 may recognize a voice other than a user's preset operation and perform an operation corresponding thereto.

9 is a view for explaining a case in which a plurality of users is detected according to an embodiment of the present invention.

According to FIG. 9A, when a plurality of users are recognized through the sensing unit 120, the processor 130 may record visits, purchase records, interest in the LFD device 100, and distances from the display 110 when a plurality of users are recognized. And determining a main user among a plurality of users based on at least one of a distance from the center of the display 110 and displaying a clothing model, product, advertisement, etc. corresponding to the main user. For example, the processor 130 may determine the main user based on the user having the most purchase record among the plurality of users. Alternatively, the processor 130 may determine the main user based on the user with the highest interest among the plurality of users. Since the operation after the main user is determined is omitted, it is omitted.

Here, the processor 130 may measure an interest in the LFD device 100 based on at least one of the direction of the user's face and the time the user gazes at the display 110. For example, the processor 130 may determine that the higher the time looking at the display 110, the higher the interest.

9B is a flowchart for determining a main user according to an embodiment of the present invention.

First, the processor 130 may recognize a plurality of users through the sensing unit 120 (S910). When a plurality of users are recognized, the processor 130 determines a relationship between the plurality of users and determines whether it is a family or a couple (S920). For example, the processor 130 may determine that the couple is a couple within a predetermined distance or in a body connection state. In addition, when the male and female adults holding the child are detected, the processor 130 may determine that it is a family. Alternatively, the processor 130 may determine whether the family is based on the similarity of facial features through facial recognition.

When it is determined that the plurality of users are a family or a couple, the processor 130 may select an adult woman as the main user (S930). As described above, the processor 130 may display a clothing model and recommended clothing corresponding to the main user. However, the present invention is not limited thereto, and the processor 130 may correspond to a main user and may determine recommended clothing by reflecting that it is a family or a couple. For example, when it is determined that a plurality of users are a couple, the processor 130 may determine a couple look style among clothes associated with clothes worn by the main user as recommended clothes.

If it is determined that the plurality of users are not a family or a couple, the processor 130 selects a main user using the main user selection method (S940). This will be described in FIG. 9C.

According to FIG. 9C, the processor 130 may compare visit records of each of the recognized plurality of users and select a user with a large number of visit records as a main user (S950 ). The visit record may be included in the user's profile information. If there is no stored record among the recognized plurality of users, the processor 130 may process the visit record of the user as 0.

Also, the processor 130 may use only visit records within a certain period. For example, the processor 130 may select the main user based on the visit history within the last year.

When the visit history of a plurality of users is the same, the processor 130 may compare the purchase history and select a user with a large purchase history as the main user (S960). For example, the processor 130 may select a main user based on the number of purchases among purchase details. However, the present invention is not limited thereto, and the processor 130 may select a main user based on the total purchase amount among purchase details. Also, the processor 130 may use only the purchase history within a certain period.

When the purchase history of a plurality of users is the same, the processor 130 may compare interest levels of the LFD device 100 to select a user with high interest as a main user (S970). The processor 130 may measure an interest in the LFD device 100 based on at least one of the direction of the user's face and the time the user gazes at the display 110.

When the interests of the plurality of users are the same, the processor 130 may compare the distances from the display 110 to select a user with high interest as the main user (S980). When the distances from the display 110 of the plurality of users are the same, the processor 130 may select a user with high interest as a main user by comparing the distances from the center of the display 110 (S990). Through this process, the processor 130 may select a main user (S995).

However, the present invention is not limited thereto, and the processor 130 may select a main user by changing the order of visit history and purchase history. In addition, the processor 130 may select a main user by weighting visit history and purchase history.

The processor 130 may also select a plurality of main users. For example, when there are three clothing models that can be simultaneously displayed by the LFD device 100, the processor 130 may select three main users. The number of clothing models that the LFD device 100 can simultaneously display may be determined due to hardware limitations.

In addition, when a plurality of users are recognized, the processor 130 may select the first recognized user among the plurality of users as the main user.

10 is a view for explaining providing a query according to an embodiment of the present invention.

According to FIG. 10, when the distance between the display 110 and the user is within a predetermined distance, the processor 130 may provide a query for receiving a type of clothing desired by the user. For example, when the distance between the display 110 and the user is within 50 cm, the processor 130 may ask, "When and where do you find clothes to wear?" Or you can display a query like "What kind of clothes are you looking for?" However, the present invention is not limited thereto, and the processor 130 may provide a query by voice.

The processor 130 may receive the user's response to the query by voice, or provide a new UI to receive the user's response.

The processor 130 may determine recommended clothing based on the user's response to the query. For example, when the processor 130 answers that the user wants golf clothing, the processor 130 may determine golf clothing as recommended clothing.

In addition, the processor 130 acquires at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information, and determines recommended clothing based on the obtained profile information and the user's response It might be. For example, if the user's response is a swimsuit and the user is a female user in 20's, the processor 130 determines a bikini as recommended clothing, and if the user's response is a swimsuit and the user is a female user in 40's, a general swimsuit You can decide on recommended clothing.

11 is a view for explaining the operation of the LFD device 100 according to an embodiment of the present invention.

According to FIG. 11A, when the user is not recognized, the processor 130 may display a preset advertisement. 11A displays a clothing model wearing specific clothing, but is not limited thereto. For example, the processor 130 may display a brand name without a clothing model, or display a TV advertisement.

According to FIG. 11B, the processor 130 may display various menus when a user's touch manipulation or a user is detected. 11B, the promotion menu, the best seller menu, the entire product menu, and the like are displayed, but this can be changed as much as possible. In addition, as previously described with reference to FIG. 11, the clothing model and recommended clothing corresponding to the recognized user may be displayed.

In FIG. 11B, it has been described that a menu screen is displayed instead of displaying a clothing model and recommended clothing corresponding to a recognized user in order to describe various embodiments. Here, in order to display the clothing model and recommended clothing corresponding to the recognized user, it is possible to select My Style on the menu screen.

According to FIG. 11C, when the user selects My Style on the menu screen, the processor 130 may display a guide screen to accurately recognize the user. However, the present invention is not limited thereto, and the processor 130 may display the clothing model and recommended clothing corresponding to the recognized user immediately without displaying the guide screen.

According to FIG. 11D, the processor 130 may display a clothing model and recommended clothing. The processor 130 may display a plurality of recommended clothes, but is not limited thereto. For example, the processor 130 may determine one recommended clothing and may further display clothing or accessories associated with the recommended clothing.

The processor 130 may display a menu screen when the user touches the home button 1110. Then, when the user touches the previous screen button 1120, the processor 130 may display the previous screen. Also, when the user touches the category button 1130, the processor 130 may display a screen for selecting a category such as a clothing category, an accessory category, and the like. The processor 130 may display categories and detailed categories in a pop-up manner.

Also, the processor 130 may display the focus 10. The focus 10 may be displayed by a user's touch, or the user's right hand index finger tip may be tracked and displayed. However, the present invention is not limited thereto, and the LFD device 100 includes a mouse or the like, and may display the focus 10 of the mouse.

According to FIG. 11E, the processor 130 may display a detailed screen for the product when there is an input of a user selecting the first product on the screen of FIG. 11D. The processor 130 may change and display the operation of the clothing model wearing the selected clothing according to the user's movement. However, the present invention is not limited thereto, and when the LFD device 100 is not equipped with a means for detecting a user, the processor 130 displays the clothing model wearing the selected clothing and does not change the operation of the clothing model. It may not.

12 is a view for explaining the operation of the LFD device 100 with a mirror display according to an embodiment of the present invention.

A mirror display means a display that normally operates like a mirror, but can use a certain area as a display according to user's manipulation. That is, if a mirror display is used, the user can use it as a mirror or as a display for retrieving information.

FIG. 12A is a diagram showing a mirror display in a standby state in which a user is not detected. According to FIG. 12A, the processor 130 may control the brand name to be displayed on one area of the mirror display and the other area to be used as a mirror. have. Then, when the preset time elapses, the processor 130 may display an advertisement on the mirror display. The processor 130 may display a brand name or display an advertisement at a predetermined time period.

According to FIG. 12B, when the user is recognized, the processor 130 displays recommended clothing in one area of the mirror display, and the other area is used as a mirror to reflect the reflected image of the user.

The processor 130 may firstly obtain gender, age, and the like from the recognized user to provide the first recommended clothing 1210. In addition, the processor 130 may obtain colors, patterns, categories, and the like from clothes worn by the user, and provide second recommended clothes 1211-1 and 1211-2. The detailed method of selecting recommended clothing is described above, and thus is omitted.

12B, the primary recommended clothing 1210 and the secondary recommended clothing 1211-1 and 1211-2 are shown as having a difference in time displayed, but this is only an example, and may be simultaneously displayed.

According to FIG. 12C, the processor 130 may display detailed clothing of the selected clothing when the user selects one of the recommended clothing. For example, the processor 130 may display a top, outerwear, and hat as recommended clothing, and when a user selects outer clothing, various outer clothing may be displayed as recommended clothing.

When the user selects any one of the detailed clothes, the processor 130 may display the detailed clothes in a more enlarged area 1220 so that the user can check the details. In this case, the area used as a mirror of the mirror display may be partially reduced.

According to FIG. 12D, when the user touches the enlarged area 1220 once again, the processor 130 may display selected clothing and detailed information on the entire screen. In this case, the entire area of the mirror display is used as a display area for providing information, and may not be used as a mirror.

The processor 130 may display the GUI 1230 for providing information about the product location. However, the present invention is not limited thereto, and the processor 130 may display information on the product location together with the selected clothing.

Although only the product is shown in FIG. 12D, it is not limited thereto. For example, the processor 130 may display the clothing model wearing the selected product, and change and display the operation of the clothing model to correspond to the user's movement.

According to FIG. 12E, when the user touches the GUI 1230 for providing information about a product location, the processor 130 may display a store map for indicating the product location. The processor 130 may display the current location and product location on the store map. However, the present invention is not limited thereto, and the processor 130 may display a store map through a pop-up method on the screen of FIG. 12D and inform the user of the product location using voice.

The LFD device 100 using a general display and a mirror display has been described above, but is not limited thereto. For example, the LFD device 100 may be formed of a display wall or autostereoscopic 3D display. In this case, when the LFD device 100 is formed of a display wall, the display wall may be configured in a triangle or pyramid shape as well as a square.

13 is a view for explaining a method of providing statistical information according to an embodiment of the present invention.

According to FIG. 13A, the processor 130 may display a cumulative distribution of users in a store on a store map. For example, a plurality of cameras may be provided on the ceiling of the store, and the processor 130 may use the plurality of cameras for a month to store accumulated movement data based on data that stores movements of a plurality of users in the store. It can be displayed in addition to the store map. The processor 130 may display a dark color when there is a lot of data accumulated at a specific point.

According to FIG. 13B, the processor 130 may display the number of times of recognition of a plurality of users by age group for a week. This may be information by one LFD device 100, but is not limited thereto. For example, when a plurality of LFD devices 100 are disposed in a store, data may be collected from the plurality of LFD devices 100 to display accumulated data.

In addition, the processor 130 may not only display the recognized user, but may also select and display only the user actively using the LFD device 100 such as a user's touch manipulation as a statistical sample.

According to FIG. 13C, the processor 130 may provide statistical values by distinguishing men and women among visitors. 13C is illustrated as displaying using a bar graph, but is not limited thereto, and the processor 130 may provide information using any other type of graph or numerical value.

14 is a flowchart illustrating a control method of an LFD device according to an embodiment of the present invention.

First, the LFD device recognizes the user (S1410). Then, profile information of the recognized user is obtained (S1420). Then, a clothing model and recommended clothing corresponding to the obtained profile information are determined (S1430). Then, a clothing model in a state in which recommended clothing is worn is displayed (S1440).

Further, in step S1410 of recognizing a user's movement, the step of displaying S1440 may control the movement state of the clothing model so that the clothing model corresponds to the recognized user's movement.

Then, in the displaying (S1440), the background image distinguished from the clothing model is displayed, and when the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the movement direction of the user. , When the user's movement in which the vertical distance from the LFD device is changed is recognized, the background image may be maintained.

In addition, the determining step S1430 may determine the clothing model based on the user's age and gender information, and determine the recommended clothing based on the information about the clothing the user is wearing.

In addition, the determining step S1430 determines a recommended accessory based on at least one of the user's clothing purchase record and accessory purchase record, and the displaying step S1440 displays a clothing model in a state where the recommended accessory is worn. have.

In addition, if the distance between the LFD device and the user is within a preset distance, the method further includes providing a query for inputting a type of clothing desired by the user, and the determining step (S1430) is based on the user's response to the query. You can decide the recommended clothing.

And, the obtaining step (S1420) is to obtain at least one of the user's gender, age, clothing attributes, skin tone, body shape and fashion image as the user's profile information, and determining (S1430) is the obtained profile information and the user Recommended clothing may be determined based on the response.

In addition, in operation S1440 of displaying, when a preset motion is recognized by the user, the clothing model may be controlled to make a gesture in response to the preset motion, or an animation effect corresponding to the preset motion may be displayed.

And, when a plurality of users is recognized, the main user of the plurality of users based on at least one of the visit history, purchase history, interest in the LFD device, the distance from the LFD device and the distance from the center of the LFD device Further comprising the step of determining, and displaying (S1440) may display the clothing model corresponding to the main user.

Also, the determining of the main user may measure an interest in the LFD device based on at least one of the direction of the user's face and the time the user gazes at the LFD device.

According to various embodiments of the present invention as described above, the LFD device displays a clothing model and recommended clothing corresponding to the user's profile information to induce the user's interest, and provides various recommended clothing to facilitate clothing desired by the user By purchasing, the user's convenience is improved.

Meanwhile, the LFD device has been described above as storing CRM information, but is not limited thereto. For example, the LFD device may transmit information on the recognized user to the server, and may receive corresponding clothing models and recommended clothes from the server device.

On the other hand, the control method of the LFD device according to various embodiments of the present invention described above is implemented by a program code executable in a computer so that it can be executed by a processor in a state stored in various non-transitory computer readable medium. Each server or device may be provided.

For example, recognizing a user, obtaining profile information of a recognized user, determining a clothing model and recommended clothing corresponding to the obtained profile information, and displaying a clothing model in a state where the recommended clothing is worn A non-transitory computer readable medium in which a program that sequentially executes is stored may be provided.

The non-transitory readable medium means a medium that stores data semi-permanently and that can be read by a device, rather than a medium that stores data for a short time, such as registers, caches, and memory. Specifically, the various applications or programs described above may be stored and provided in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

100: LFD device 110: display
120: detection unit 130: processor
140: storage 150: communication unit
155: user interface unit 160: audio processing unit
170: video processing unit 180: speaker
181: button 182: microphone

Claims (20)

In a large format display (LFD) device,
display;
A sensing unit that recognizes a user; And
Acquiring the user's profile information recognized through the detection unit,
Of the plurality of clothing models stored in the LFD device determines a clothing model corresponding to the purchase history included in the acquired profile information,
The recommended clothing is determined based on the obtained profile information,
And a processor that controls the display to display the clothing model while wearing the recommended clothing. According to claim 1,
The sensing unit,
Recognizing the movement of the user,
The processor,
And controlling the movement state of the clothing model so that the clothing model corresponds to the recognized movement of the user. According to claim 2,
The processor,
Display a background image that is distinct from the clothing model,
When the user's movement in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the user's moving direction, and the user's movement in which the vertical distance from the LFD device is changed is If recognized, the LFD device characterized in that to maintain the background image. According to claim 1,
The processor,
And determining the clothing model based on the user's age and gender information, and determining the recommended clothing based on information about clothing worn by the user. According to claim 1,
The processor,
And determining a recommended accessory based on at least one of the user's clothing purchase record and accessory purchase record, and displaying the clothing model while wearing the recommended accessory. According to claim 1,
The processor,
If the distance between the display and the user is within a predetermined distance, a query for receiving a type of clothing desired by the user is provided, and the recommended clothing is determined based on the user's response to the query. LFD device. The method of claim 6,
The processor,
Acquiring at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information,
And determining the recommended clothing based on the obtained profile information and the user's response. According to claim 1,
The processor,
LFD device characterized in that when the predetermined motion is recognized by the user, the clothing model controls to make a gesture in response to the preset motion, or displays an animation effect corresponding to the preset motion. According to claim 1,
The processor,
When a plurality of users is recognized through the sensing unit, the plurality of users may be based on at least one of visit history, purchase records, interest in the LFD device, distance from the display, and distance from the center of the display. And determining a main user among users of the user, and displaying the clothing model corresponding to the main user. The method of claim 9,
The processor,
And measuring an interest in the LFD device based on at least one of a direction of the user's face and a time when the user gazes at the display. In the control method of a large format display (LFD) device,
Recognizing a user;
Obtaining profile information of the recognized user;
Determining a clothing model corresponding to a purchase history included in the acquired profile information among a plurality of clothing models stored in the LFD device;
Determining recommended clothing based on the obtained profile information; And
And displaying the clothing model while wearing the recommended clothing. The method of claim 11,
The step of recognizing,
Recognizing the movement of the user,
The displaying step,
And controlling the movement state of the clothing model such that the clothing model corresponds to the recognized movement of the user. The method of claim 12,
The displaying step,
Display a background image that is distinct from the clothing model,
When the user's movement in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the user's moving direction, and the user's movement in which the vertical distance from the LFD device is changed is Control method characterized in that to keep the background image when recognized. The method of claim 11,
The determining step,
And determining the clothing model based on the user's age and gender information, and determining the recommended clothing based on information about the clothing the user is wearing. The method of claim 11,
The determining step,
The recommended accessory is determined based on at least one of the user's clothing purchase record and accessory purchase record,
The displaying step,
And displaying the clothing model while wearing the recommended accessory. The method of claim 11,
Further comprising a step of providing a query for receiving the type of clothing desired by the user if the distance between the LFD device and the user is within a predetermined distance;
The determining step,
And determining the recommended clothing based on the user's response to the query. The method of claim 16,
The obtaining step,
Acquiring at least one of the user's gender, age, clothing attributes, skin tone, body shape, and fashion image as the user's profile information,
The determining step,
And determining the recommended clothing based on the obtained profile information and the user's response. The method of claim 11,
The displaying step,
If a predetermined motion is recognized by the user, a control method characterized in that the clothing model is controlled to make a gesture in response to the preset motion, or an animation effect corresponding to the preset motion is displayed. The method of claim 11,
When a plurality of users are recognized, the plurality of users are based on at least one of visit history, purchase records, interest in the LFD device, distance from the LFD device, and distance from the center of the LFD device. Determining the main user of the; further comprising,
The displaying step,
And displaying the clothing model corresponding to the main user. The method of claim 19,
Determining the main user,
And measuring interest in the LFD device based on at least one of a direction of the user's face and a time when the user gazes at the LFD device.

Images