KR20170021707A - Large format display apparatus and control method thereof - Google Patents

Abstract

The present invention relates to a large format display (LFD) device. The LFD device comprises: a display unit; a sensing unit which recognizes a user; and a processor which obtains profile information of the user recognized through the sensing unit, determines a clothing model and a recommendation clothing corresponding to the obtained profile information, and controls the display unit to display the clothing model wearing the recommendation clothing. Accordingly, the present invention can increase the purchase convenience of the user using the LFD device.

Description

[0001] LARGE FORMAT DISPLAY APPARATUS AND CONTROL METHOD THEREOF [0002]

The present invention relates to an LFD apparatus and a control method thereof, and more particularly, to an LFD apparatus and a control method thereof that provide various information and user interaction using a large display.

Various types of electronic products have been developed and popularized by the development of electronic technology, and electronic devices having various information providing functions are used. Furthermore, in the past, electronic products used only in the room have been installed on the streets and the like.

Among them, LFD (large format display) device is a commercial large display installed and operated for the purpose of publicity and information transmission. The LFD device is a stand alone device composed of one panel and a video wall (video wall). In addition, the LFD device is installed in a corporate lobby to promote a brand and a company, or is used for various purposes such as a store interior, a menu board, and the like. In recent years, various problems have arisen as the use of LFD devices has increased.

1 is a view for explaining a problem of the prior art.

The conventional LFD device displays pre-stored contents according to a predetermined method, and it is difficult to provide contents that are flexible according to users and environment. For example, when an LFD device displays a toy advertisement, there is a problem that only a toy advertisement is continuously displayed even if an adult is in front of the LFD device. That is, the user could not change or view the contents provided by the LFD device.

Further, since the LFD device is installed in various places, there is a problem that interest of the user is lowered and advertisement effect is lowered.

The conventional problem is that the contents to be displayed in the LFD device are provided in a fixed manner, and the necessity of an LFD device capable of causing more user's interest has been brought about.

An object of the present invention is to provide an LFD device for obtaining profile information for a user using an LFD device to determine and display a garment model and a recommended garment to be displayed on the LFD device, .

According to an aspect of the present invention, there is provided an LFD (Large Format Display) device, including a display, a sensing unit for recognizing a user, and a user's profile information recognized through the sensing unit, Determining a clothing model and a recommended garment corresponding to the profile information, and controlling the display to display the garment model while wearing the recommended garment.

In addition, the sensing unit recognizes the movement of the user, and the processor can control the movement state of the clothing model so that the clothing model corresponds to the movement of the recognized user.

The processor displays a background image distinct from the clothing model, and when the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed And may maintain the background image if the movement of the user whose vertical distance from the LFD device is changed is recognized.

Further, the processor may determine the clothing model based on the age and gender information of the user, and may determine the recommended clothes based on the information on the clothes worn by the user.

Then, the processor can determine a recommended accessory based on at least one of the user's clothing purchase record and accessory purchase record, and display the clothing model in a state wearing the recommended accessory.

If the distance between the display and the user is within a predetermined distance, the processor may provide a query for inputting a type of the desired clothes, and determine the recommended clothes based on a user's response to the inquiry .

The processor obtains at least one of the sex, age, clothing attribute, skin tone, figure, and fashion image of the user as profile information of the user, and based on the obtained profile information and the user's response, Apparel can be determined.

In addition, when the predetermined operation is recognized from the user, the processor may control the garment model to perform a gesture responsive to the predetermined operation, or may display an animation effect corresponding to the predetermined operation.

When a plurality of users are recognized through the sensing unit, the processor determines at least one of a visit record of the plurality of users, a purchase record, an interest in the LFD device, a distance from the display, and a distance from a center of the display A main user among the plurality of users can be determined based on the main user, and the clothing model corresponding to the main user can be displayed.

The processor may also measure an interest in the LFD device based on at least one of a direction of the face of the user and a time the user stare at the display.

Meanwhile, according to an embodiment of the present invention, a control method of an LFD (large format display) device includes a step of recognizing a user, a step of acquiring profile information of the recognized user, And a step of determining a recommended garment and displaying the garment model in a state wearing the recommended garment.

In addition, the recognizing step recognizes the movement of the user, and the displaying step may control the movement state of the clothing model so that the clothing model corresponds to the movement of the recognized user.

In addition, the displaying step may display a background image distinguished from the clothing model, and when the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, And maintains the background image when the movement of the user whose vertical distance from the LFD device is changed is recognized.

The determining step may determine the apparel model based on the age and gender information of the user, and may determine the recommended apparel based on the information on the apparel worn by the user.

And, the determining step may determine a recommended accessory based on at least one of the user's clothing purchase record and the accessory purchase record, and the displaying step may display the clothing model wearing the recommended accessory .

If the distance between the LFD device and the user is within a predetermined distance, the method further comprises providing a query for inputting the type of clothing desired by the user, wherein the determining step comprises: The recommendation clothes can be determined based on the recommendation information.

The acquiring step acquires at least one of the sex, age, clothing attribute, skin tone, figure and fashion image of the user as the profile information of the user, and the determining step acquires the profile information and the user information It is possible to determine the recommended garment based on the response of the user.

In addition, the displaying step may control the garment model to perform a gesture responsive to the preset operation, or to display an animation effect corresponding to the preset operation, when a predetermined operation is recognized from the user.

When a plurality of users are recognized, the plurality of users are identified based on at least one of a visit record of the plurality of users, a purchase record, an interest degree of the LFD device, a distance from the LFD device, and a distance from the center of the LFD device. Further comprising the step of determining a main user among the users of the main user, wherein the displaying step can display the clothing model corresponding to the main user.

In addition, the step of determining the main user may measure the degree of interest in the LFD device based on at least one of a direction of the face of the user and a time when the user stare at the LFD device.

According to various embodiments of the present invention as described above, the LFD device displays the clothing model and the recommended clothes corresponding to the user's profile information to induce the user's interest, and provides various recommended clothes to facilitate the user's desired clothes The convenience of the user is improved.

1 is a view for explaining a problem of the prior art.
2 is a block diagram showing a configuration of an LFD (large format display) apparatus according to an embodiment of the present invention.
3 is a block diagram of a software architecture used by an LFD device in accordance with an embodiment of the present invention.
4 is a diagram for explaining a method of acquiring profile information of a user according to an embodiment of the present invention.
5 is a view for explaining display of a garment model and a recommended garment according to an embodiment of the present invention.
6 is a view for explaining a display state according to a user's movement according to an embodiment of the present invention.
7 is a diagram for explaining a method of using a purchase record of a user according to an embodiment of the present invention.
8 is a diagram for explaining an animation effect according to an embodiment of the present invention.
9 is a view for explaining a case where a plurality of users are detected according to an embodiment of the present invention.
10 is a diagram for explaining providing a query according to an embodiment of the present invention.
11 is a view for explaining the operation of the LFD apparatus according to an embodiment of the present invention.
12 is a view for explaining the operation of an LFD apparatus having a mirror display according to an embodiment of the present invention.
13 is a view for explaining a method of providing statistical information according to an embodiment of the present invention.
14 is a flowchart illustrating a method of controlling an LFD apparatus according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram showing a configuration of an LFD (large format display) apparatus 100 according to an embodiment of the present invention.

2A, the LFD device 100 includes a display 110, a sensing unit 120, and a processor 130. [

FIG. 2A is a schematic diagram illustrating various components of the LFD device 100 as an example of a device having various functions such as a display function, a sensing function, and a control function. Therefore, depending on the embodiment, some of the components shown in Fig. 2A may be omitted or changed, and other components may be further added.

The display 110 may display the garment model and the recommended garment under the control of the processor 130. For example, the display 110 may display a garment model wearing a recommended garment. However, the present invention is not limited thereto, and the display 110 may display only the recommended garment. In addition, the display 110 may display accessories, fashion accessories, etc. in addition to the clothes.

The display 110 may be implemented as an LCD (Liquid Crystal Display Panel), an OLED (Organic Light Emitting Diodes), or the like, but is not limited thereto. In addition, the display 110 may be implemented as a flexible display, a transparent display, or the like as the case may be.

The sensing unit 120 may recognize a user located in front of the LFD device 100. [ Here, the sensing unit 120 may determine the sex, age, and the relationship between the user based on features of the user's face, body, dress, gait, pose, and the like. In addition, the sensing unit 120 recognizes the user's face and can identify the user from the stored face image. Or the sensing unit 120 may sense only the motion of the user.

The sensing unit 120 may be mainly composed of a camera. The camera is a configuration for capturing still images or moving images. In particular, the camera can be used to photograph a user located in front of the LFD device 100. However, the present invention is not limited thereto, and the sensing unit 120 may include a key knot, a depth camera, and an ultrasonic sensor.

Meanwhile, the sensing unit 120 may acquire profile information of a user by communicating with an electronic device of the user. In this case, the LFD device 100 can perform communication with the electronic device owned by the user using WiFi, NFC, or the like.

The processor 130 obtains the profile information of the user recognized through the sensing unit 120, determines the clothing model and the recommended clothing corresponding to the obtained profile information, and displays the clothing model in a state wearing the recommended clothing The display 110 can be controlled. Here, the clothing model is divided into male model and female model, and male model can be classified into a young model and a middle-age model.

In addition, the processor 130 may control the movement state of the clothing model so that the processor 130 corresponds to the movement of the user recognized by the sensing unit 120. [ Here, the processor 130 may change not only the clothing model but also the recommended clothes worn by the clothing model so as to correspond to the movement state of the clothing model, and display the changed clothes.

The processor 130 displays a background image distinguished from the clothing model. When the movement of the user in the left and right directions in which the vertical distance from the LFD device 100 is maintained is recognized, the processor 130 changes the background image And the background image can be maintained when the movement of the user whose vertical distance from the LFD device 100 is changed is recognized. At this time, the processor 130 may change the clothing model and the background image differently even if the same user moves.

In addition, the processor 130 can determine the clothing model based on the age and gender information of the user, and can determine the recommended clothes based on the information on the clothes worn by the user.

The processor 130 can then determine a recommended accessory based on at least one of the user's apparel purchase record and the accessory purchase record, and display the apparel model wearing the recommended accessory.

In addition, if the distance between the display 110 and the user is within a predetermined distance, the processor 130 provides a query for inputting the type of the desired clothing, and determines a recommended garment based on the user's response to the query .

The processor 130 acquires at least one of the user's sex, age, clothing attributes, skin tone, body shape, and fashion image with the user's profile information, and determines the recommended apparel based on the obtained profile information and the user's response .

In addition, when the predetermined operation is recognized from the user, the processor 130 may control the garment model to perform a gesture responsive to the predetermined operation, or may display an animation effect corresponding to the predetermined operation.

When a plurality of users are recognized through the sensing unit 120, the processor 130 determines whether a plurality of users' visit records, purchase records, interest in the LFD apparatus 100, distance from the display 110, 110), and display a garment model corresponding to the main user.

The processor 130 may also measure the degree of interest in the LFD device 100 based on at least one of the orientation of the user's face and the time the user is staring at the display 110. [

2B is a block diagram showing an example of a detailed configuration of the LFD device 100. As shown in FIG. 2B, the LFD device 100 includes a display 110, a sensing unit 120, a processor 130, a storage 140, a communication unit 150, a user interface unit 155, an audio processing unit 160, A video processing unit 170, a speaker 180, a button 181, and a microphone 182. [ Details of the components shown in FIG. 2B that overlap with those shown in FIG. 2A will not be described in detail.

The processor 130 generally controls the operation of the LFD device 100 using various programs stored in the storage 140.

Specifically, the processor 130 includes a RAM 131, a ROM 132, a main CPU 133, a graphics processing unit 134, first through n interfaces 135-1 through 135-n, .

The RAM 131, the ROM 132, the main CPU 133, the graphics processing unit 134, the first to n interfaces 135-1 to 135-n, etc. may be connected to each other via the bus 136. [

The first to n-th interfaces 135-1 to 135-n are connected to the various components described above. One of the interfaces may be a network interface connected to an external device via a network.

The main CPU 133 accesses the storage 140 and performs booting using the O / S stored in the storage 140. [ Then, various operations are performed using various programs stored in the storage 140. [

The ROM 132 stores a command set for booting the system and the like. The main CPU 133 copies the O / S stored in the storage 140 to the RAM 131 according to the instruction stored in the ROM 132, executes the O / S, . When the booting is completed, the main CPU 133 copies various application programs stored in the storage 140 to the RAM 131, executes the application program copied to the RAM 131, and performs various operations.

The graphic processing unit 134 generates a screen including various objects such as an icon, an image, and a text using an operation unit (not shown) and a rendering unit (not shown). The operation unit (not shown) calculates an attribute value such as a coordinate value, a shape, a size, and a color to be displayed by each object according to the layout of the screen based on the received control command. The rendering unit (not shown) creates screens of various layouts including the objects based on the attribute values calculated by the operation unit (not shown). The screen generated in the rendering unit (not shown) is displayed in the display area of the display 110.

Meanwhile, the operation of the processor 130 described above may be performed by a program stored in the storage 140. [

The storage 140 stores various data such as an operating system (O / S) software module for driving the LFD device 100, clothing model information, clothing information, accessory information, and user purchase history information.

In this case, the processor 130 may display the garment model and the recommended garment based on the information stored in the storage 140.

The communication unit 150 can perform communication with an external device according to various types of communication methods.

The communication unit 150 includes various communication chips such as a Wi-Fi chip 151, a Bluetooth chip 152, and a wireless communication chip 153. The Wi-Fi chip 151 and the Bluetooth chip 152 communicate with each other using WiFi or Bluetooth. The wireless communication chip 153 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution)

Meanwhile, the communication unit 150 can perform unidirectional communication or bidirectional communication with the electronic device. When performing unidirectional communication, the communication unit 150 can receive a signal from the electronic device. When performing bidirectional communication, the communication unit 150 may receive a signal from the electronic device or transmit the signal to the electronic device.

The user interface unit 155 receives various user interactions. Here, the user interface unit 155 may be implemented in various forms according to an embodiment of the LFD device 100. [ When the LFD device 100 is implemented as a digital TV, the user interface unit 155 may be implemented as a remote control receiver for receiving a remote control signal from a remote control device, a camera for sensing user motion, or a microphone for receiving user voice. In addition, when the LFD device 100 is implemented as a touch-based electronic device, the user interface unit 155 may be implemented as a touch screen having a mutual layer structure with the touch pad. In this case, the user interface unit 155 can be used as the display 110 described above.

The audio processing unit 160 is a component that performs processing on audio data. In the audio processing unit 160, various processes such as decoding and amplification of audio data, noise filtering, and the like may be performed.

The video processing unit 170 is a component that performs processing on video data. The video processing unit 170 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, and the like on the video data.

The speaker 180 is a component for outputting various kinds of audio data processed by the audio processing unit 160, as well as various kinds of notification sounds and voice messages.

The button 181 may be various types of buttons such as a mechanical button, a touch pad, a wheel, and the like formed in an arbitrary area such as a front or a side part of a body exterior of the LFD device 100,

The microphone 183 is a configuration for receiving a user voice or other sound and converting it into audio data.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a basic configuration and various embodiments for facilitating understanding of the present invention will be described.

3 is a block diagram of a software architecture used by the LFD device 100 according to an embodiment of the present invention.

The software of FIG. 3 may be stored in storage 140, but is not limited thereto, and may be stored in various types of storage means used within LFD device 100. 3, software including an OS 181, a kernel 182, a middleware 183, an application 184, and the like may be stored in the LFD device 100. [

An operating system (OS) 181 controls and manages the overall operation of the hardware. That is, the OS 181 is a layer that performs basic functions such as hardware management, memory, and security.

The kernel 182 serves as a path for transmitting various signals to be sensed to the middleware 183.

The middleware 183 includes various software modules for controlling the operation of the LFD device 100. 3, the middleware 183 includes a UI framework 183-1, a window manager 183-2, a model generation module 183-3, a security module 183-4, a system manager 183-5 A connection manager 183-6, an X11 module 183-7, an APP manager 183-8, and a multimedia framework 183-9.

The UI framework 183-1 is a module for providing various UIs. The UI framework 183-1 includes an image composer module for composing various objects, a coordinate synthesizer for calculating coordinates to be displayed on the object, a rendering module for rendering the configured objects in the calculated coordinates, A 2D / 3D UI toolkit that provides a tool for constructing a UI, and the like.

The window manager 183-2 can detect various input events such as a control signal transmitted from a remote control device, a user touch input to the display 110, a button operation provided in the LFD device 100, and the like. When this event is detected, the window manager 183-2 transmits an event signal to the UI framework 183-1 to perform an operation corresponding to the event. Specifically, if an event occurs in which the user touches one area of the display 110, the fact is notified to the UI framework 183-1. The UI framework 183-1 can display the selected clothes based on the touch area of the user.

The model generation module 183-3 can determine the clothing model and the recommended clothes based on the profile information of the user as described above. In addition, the model generation module 183-3 may determine a recommended accessory based on the purchase history of the user.

The security module 183-4 is a module that supports authentication for hardware, permission permission, and secure storage.

The system manager 183-5 monitors the status of each component in the LFD device 100 and provides the monitoring result to other modules. For example, when the remaining battery power is low, an error occurs, a communication connection state is lost, or the like, the system manager 183-5 provides the monitoring result to the UI framework 183-1, You can also output a notification sound.

The connection manager 183-6 is a module for supporting a wired or wireless network connection. The connection manager 183-6 may include various detailed modules such as a DNET module, a UPnP module, and the like.

The X11 module 183-7 is a module for receiving various event signals from various hardware provided in the LFD device 100. [ Here, the event can be variously set, such as an event in which a user operation is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 183-8 is a module for managing execution states of various applications installed in the storage 140. [ When the application manager 183-8 detects an event that an application execution command is input from the X11 module 183-7, the application manager 183-8 calls and executes the application corresponding to the event. That is, when at least one object is selected, the APP manager 183-8 performs an operation of calling and executing an application corresponding to the object.

The multimedia framework 183-9 is a module for reproducing multimedia contents stored in the LFD device 100 or provided from an external source. The multimedia framework 183-9 may include a player module, a camcorder module, a sound processing module, and the like. Accordingly, various multimedia contents can be reproduced to generate and reproduce a screen and sound.

The software structure shown in Fig. 3 is merely an example, and is not necessarily limited to this. Therefore, it goes without saying that parts may be omitted, modified, or added as necessary. For example, the storage 140 may include a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a Short Message Service (SMS) & Multimedia Message Service (MMS) program, an email program, (Call Info Aggregator) program module, a VoIP module, a web browser module, and the like.

4 is a diagram for explaining a method of acquiring profile information of a user according to an embodiment of the present invention.

According to FIG. 4A, the processor 130 can acquire the recognized user's profile information through the sensing unit 120 including the camera 410. FIG. For example, the processor 130 can recognize the face of the user from the image photographed by the camera 410, and obtain the profile information of the user based on the stored information. However, the present invention is not limited thereto, and the processor 130 may analyze the facial image to extract information on the age, gender, and the like, if the facial image of the user does not match the stored information. In addition, the processor 130 can acquire information such as clothes that the user wears through the whole body image as well as the face of the user.

According to FIG. 4B, the processor 130 may obtain the user's profile information via the electronic device 420 that the user has. When the user enters the LFD device 100 within a certain distance, the processor 130 can perform communication with the electronic device 420 of the user through wireless communication such as NFC, Bluetooth, or Beacon. The processor 130 may then receive the user's profile information from the electronic device 420 that the user has. Alternatively, the processor 130 may receive a minimum amount of information (e.g., name, mobile phone number, user ID, etc.) that identifies the user from the electronic device 420 that the user has, management information of the user.

Although the method of using the camera 410 and the method of communicating with the electronic device 420 have been described above as being distinct, they can be used any number of times. For example, the processor 130 may receive the age, sex, etc. of the user from the electronic device 420, and the clothing information that the user wears may be acquired using the camera 410. [

In addition to the camera 410, the processor 130 may acquire profile information of a user using a keyboard, a depth camera, and an ultrasonic sensor.

5 is a view for explaining display of a garment model and a recommended garment according to an embodiment of the present invention.

According to FIG. 5A, the processor 130 may determine a garment model corresponding to the obtained profile information. In particular, the processor 130 may determine the garment model based on age and gender information of the user. For example, the processor 130 may determine a twenties female garment model when the user obtains profile information of a twenties female. However, the present invention is not limited thereto, and the processor 130 may determine the clothing model based on the purchasing history of the user rather than the age and gender information of the user. For example, the processor 130 may determine the clothing model of a male in his twenties if the user has a history of purchasing male clothes in his twenties even if the user is a female in his twenties.

The processor 130 may determine a recommended garment corresponding to the obtained profile information. In particular, the processor 130 may determine a recommended garment based on information about the garment worn by the user. For example, the processor 130 may obtain a black dress that the user wears as profile information, and may determine a dress similar to a black dress as a recommended garment. That is, the processor 130 can determine the recommended clothing by acquiring the type of clothing, the fashion image, the color, and the pattern of the wearer. However, the present invention is not limited to this, and the processor 130 may determine the recently-popular clothes as the recommended clothes regardless of the clothes the user wears.

Although the dress has been described above, it is equally applicable to other types of clothing such as classic suits or sporty knits. Alternatively, the processor 130 may determine the garment associated with the garment worn by the user as the recommended garment. For example, the processor 130 may determine a shirt as a recommended garment if the user is wearing a classic suit. In addition, the processor 130 may further display a shirt, as well as a formal dress, etc.

According to FIG. 5B, the processor 130 may determine the color of the garment considering the user's skin tone. For example, the processor 130 may determine a bright apparel as a recommended apparel when the user's skin tone is bright. In addition, when the user's skin tone is dark, the processor 130 can determine the dark-colored clothing as a recommended garment. However, the present invention is not limited thereto, and the processor 130 may determine a garment having a color opposite to the user's skin tone as a recommended garment. Matching information of the user's skin tone and clothing color may be stored in the storage 140.

Referring back to FIG. 5A, the processor 130 can display a garment model wearing a recommended garment. For example, the processor 130 may display a twenties woman's clothing model wearing a dress. However, the present invention is not limited thereto, and the processor 130 may separately display the garment model and the recommended garment.

Meanwhile, the processor 130 may change and display at least one of the clothing model and the recommended garment when the user's gaze does not face the display 110 for a predetermined time or more. For example, the processor 130 may change the recommended garment from a 20's to a 10's if the user does not see the display 110 for 20 seconds or more. However, the present invention is not limited to this, and the processor 130 may change from a casual garment to an office-look garment or a garment model to a male. Further, the processor 130 may change at least one of the clothing model and the recommended clothes by touch input or the like without referring to the user's line of sight.

6 is a view for explaining a display state according to a user's movement according to an embodiment of the present invention.

According to FIG. 6A, the sensing unit 120 recognizes the movement of the user, and the processor 130 can control the movement state of the clothing model so as to correspond to the motion of the user who recognizes the clothing model. For example, the sensing unit 120 may recognize that the user is approaching the display 110, and when the user approaches the display 110, the processor 130 may modify the garment model to approach the user, such as a mirror image, Can be displayed. However, the present invention is not limited thereto, and the processor 130 may simply display the garment model largely when the user approaches the display 110. In addition, the processor 130 may display the resolution of the garment model and the recommended garment differently.

Alternatively, the processor 130 may modify, but not limited to, expanding or approaching only the garment model as the user approaches the display 110. [ For example, the processor 130 may cause both the clothing model and the background to be magnified and displayed.

6A shows that the attitude of the user and the clothing model are the same, but the present invention is not limited thereto. For example, the processor 130 may display the clothing model based on only the distance of the user, rather than displaying the clothes model in the same manner by sensing the distance between the display 110 and the user and the user's attitude as shown in FIG. 6A It is possible.

In addition, the processor 130 may display the left arm of the garment model to be lifted when the user holds the right arm. However, the present invention is not limited thereto, and the processor 130 may display the right arm of the garment model in response to the user's right arm, instead of displaying the mirror image. In addition, the processor 130 may perform not only the operation of lifting the user's arm, but also the operation corresponding to the operation of shaking the arm, the pointing posture, the walking motion, the jumping motion, the running motion, the arm- It can be displayed to take a posture.

In addition, the processor 130 can freely control not only the arm of the clothing model but also the legs, the head, the feet, and the hands. In particular, the processor 130 may change and display a recommended garment worn when the shape of the garment model is changed.

In the above description, the processor 130 changes and displays the clothing model and the recommended clothes. Specifically, the processor 130 renders the clothes model and the recommended clothes to correspond to the movement of the user and displays the same. However, the present invention is not limited thereto, and the processor 130 may simply display the stored photograph. Hereinafter, rendering and modification are used in the same sense.

6B, the processor 130 displays a background image distinct from the clothing model, and when the movement of the user in the left and right directions, in which the vertical distance from the LFD device 100 is maintained, is recognized, The background image can be maintained when the user changes the image and recognizes the movement of the user whose vertical distance from the LFD device 100 is changed. For example, when the processor 130 senses that the user is moving from the left side to the right side through the LFD device 100, the processor 130 displays the handbag shelf 610 displayed on the right side of the display 110 on the left side of the display 110 So that the display can be displayed. However, the processor 130 may not change the background image even if the user approaches the LFD device 100. [

In FIG. 6B, only the background image is shown as being changed for convenience of explanation, but the present invention is not limited thereto. For example, as described in the previous figures, the processor 130 may change and display the garment model according to the movement of the user. In addition, as shown in FIG. 6C, the processor 130 can display only the clothing model to be moved without changing the background image, and it is a part overlapping with the above-described one, so a detailed description will be omitted.

6, the background image is changed only when the vertical movement distance from the LFD device 100 is maintained. However, the present invention is not limited thereto. For example, the processor 130 may change and display the background image even if the user's movement is changed, in which the vertical distance from the LFD device 100 is changed.

7 is a diagram for explaining a method of using a purchase record of a user according to an embodiment of the present invention.

According to Fig. 7, the processor 130 may determine a recommended accessory based on at least one of the user's apparel purchase record and the accessory purchase record, and display the apparel model wearing the recommended accessory. For example, the processor 130 may display a clothing model wearing the same bag 710 as the bag that the user purchased, if there is a record that the user has purchased the bag. However, the present invention is not limited thereto, and the processor 130 may display a bag of a subsequent design or a new merchandise bag other than the bag that the user has purchased. In addition, the processor 130 may display a bag that the user has purchased and a belt or the like which is released as a set.

The processor 130 may also determine a recommended accessory from the user's apparel purchase record. For example, the processor 130 may determine the sneaker to be a recommended accessory if the user has a record of purchasing the casual wear.

8 is a diagram for explaining an animation effect according to an embodiment of the present invention.

According to FIG. 8A, when the predetermined operation is recognized from the user, the processor 130 may control the garment model to perform a gesture responsive to a predetermined operation, or may display an animation effect corresponding to a predetermined operation. For example, the processor 130 may display an animation in which the garment model is responsive to a winking gesture or a heart-widening animation, when the user creates a heart shape using both arms. However, the present invention is not limited thereto, and the processor 130 may output a voice such as "Thank you!" If the user makes a heart shape using the two arms.

8B, the processor 130 may change at least one of the garment model and the recommended garment if the predetermined operation is recognized from the user. For example, processor 130 may change the gender of the garment model if it recognizes the user's right-hand raising action. However, the present invention is not limited to this, and the processor 130 may change the type of the recommended garment. In addition, the processor 130 may recognize at least one of the clothing model and the recommended garment by recognizing the applause operation of the user.

Although the operation of the processor 130 according to the predetermined operation of the user has been described above, the present invention is not limited thereto. For example, the processor 130 may recognize a voice that is not a predetermined operation of the user and perform a corresponding operation.

9 is a view for explaining a case where a plurality of users are detected according to an embodiment of the present invention.

Referring to FIG. 9A, when a plurality of users are recognized through the sensing unit 120, the processor 130 determines whether a plurality of users' visit records, purchase records, interest in the LFD apparatus 100, distance from the display 110 And the distance from the center of the display 110, and may display a garment model, merchandise, advertisement, etc. corresponding to the main user. For example, the processor 130 may determine a main user based on a user having the highest purchase record among a plurality of users. Alternatively, the processor 130 may determine a main user based on a user having the highest interest among a plurality of users. Since the operation after the main user has been determined has been described above, it is omitted.

Here, the processor 130 may measure the degree of interest in the LFD device 100 based on at least one of the orientation of the user's face and the time the user stare at the display 110. For example, the processor 130 may determine that the longer the time taken to view the display 110, the greater the interest.

9B is a flowchart for determining a main user according to an embodiment of the present invention.

First, the processor 130 can recognize a plurality of users through the sensing unit 120 (S910). If a plurality of users are recognized, the processor 130 determines whether the user is a family member or a couple (S920). For example, the processor 130 may determine that a couple is a couple if a pair of men and women are within a predetermined distance or in a body-connected state. In addition, the processor 130 can determine that a family member is detected when a male adult or a female adult holding a child is detected. Alternatively, the processor 130 may determine whether the patient is a family member according to the degree of similarity of the facial features through facial recognition.

If it is determined that the plurality of users is a family member or a couple, the processor 130 may select the adult user as the main user (S930). The processor 130 may display the garment model and the recommended garment corresponding to the main user as described above. However, the present invention is not limited thereto, and the processor 130 may correspond to the main user, and may determine the recommended clothes in consideration of the family or the couple. For example, if the processor 130 determines that the plurality of users is a couple, the main user may determine the couples style among the clothes associated with the clothes he / she is wearing as the recommended clothes.

If it is determined that the plurality of users is not a family or a couple, the processor 130 selects a main user using the main user selection method (S940). This is described in FIG. 9C.

Referring to FIG. 9C, the processor 130 may compare a visit record of each of a plurality of recognized users to select a user having a large visit record as a main user (S950). The visit history may be included in the user's profile information. If there is no stored record among a plurality of recognized users, the processor 130 may process the visited record of the user as zero.

In addition, the processor 130 may use only a visit record within a predetermined period. For example, the processor 130 may select a main user based on a visit record within the past one year.

When a plurality of users' visit records are identical, the processor 130 compares purchase details and selects a user having a large purchase history as a main user (S960). For example, the processor 130 may select a main user based on the number of purchases in the purchase history. However, the present invention is not limited thereto, and the processor 130 may select a main user based on the total purchasing amount of purchase history. In addition, the processor 130 may use only the purchase history within a predetermined period.

If the purchase details of a plurality of users are the same, the processor 130 may compare a degree of interest with respect to the LFD apparatus 100 to select a user having a high degree of interest as a main user (S970). The processor 130 may measure the degree of interest for the LFD device 100 based on at least one of the orientation of the user's face and the time the user is viewing the display 110. [

The processor 130 may compare the distances from the display 110 to select a user having a high degree of interest as a main user when the interests of the plurality of users are the same (S980). If the distance from the display 110 of the plurality of users is the same, the processor 130 may compare the distance from the center of the display 110 to select a user having a high degree of interest as a main user (S990). After this process, the processor 130 can select a main user (S995).

However, the present invention is not limited to this, and the processor 130 may change the order of the visit record, purchase history, and the like to select the main user. In addition, the processor 130 may assign a weight to the visit record, purchase history, and the like to select the main user.

The processor 130 may select a plurality of main users. For example, if there are three apparel models that the LFD device 100 can simultaneously display, the processor 130 may select three main users. The number of garment models that the LFD device 100 can simultaneously display can be determined due to hardware limitations.

In addition, when a plurality of users are recognized, the processor 130 may select the first recognized user among the plurality of users as the main user.

10 is a diagram for explaining providing a query according to an embodiment of the present invention.

According to FIG. 10, if the distance between the display 110 and the user is within a preset distance, the processor 130 may provide a query for inputting a type of clothing desired by the user. For example, if the distance between the display 110 and the user is within 50 cm, the processor 130 determines "When and where to wear clothes?" Or "What kind of clothes are you looking for?". However, the present invention is not limited thereto, and the processor 130 may provide a query as a voice.

Processor 130 may receive the user's response to the query by voice and may provide a new UI to receive the user's response.

Processor 130 may determine a recommended garment based on a user's response to the query. For example, the processor 130 may determine the golf apparel as a recommended apparel if the user replies that he desires the golf apparel.

In addition, the processor 130 acquires at least one of the user's sex, age, clothing attributes, skin tone, body shape, and fashion image with the user's profile information, and determines the recommended apparel based on the obtained profile information and the user's response It is possible. For example, the processor 130 may determine that the bikini is a recommended garment if the user's response is a swimwear and the user is a twenty female user, and if the user's response is a swimsuit and the user is 40 female users, It can be decided by recommended clothing.

11 is a view for explaining the operation of the LFD device 100 according to an embodiment of the present invention.

According to FIG. 11A, the processor 130 may display a predetermined advertisement if the user is not recognized. In Fig. 11A, a garment model wearing a specific garment is displayed, but the present invention is not limited thereto. For example, the processor 130 may display the brand name without the clothing model, and may display the TV advertisement.

According to Fig. 11B, the processor 130 can display various menus when a user touch operation or a user is detected. In FIG. 11B, a promotion menu, a Best Seller menu, an overall merchandise menu, and the like are displayed. Also, as described previously with reference to Fig. 11, it is also possible to display a garment model and a recommended garment corresponding to the recognized user.

11B illustrates that a menu screen is displayed instead of displaying a garment model and a recommended garment corresponding to a recognized user to explain various embodiments. Here, in order to display a garment model and a recommended garment corresponding to the recognized user, it is possible to select My Style on the menu screen.

Referring to FIG. 11C, the processor 130 may display a guidance screen to correctly recognize a user when the user selects My Style on the menu screen. However, the present invention is not limited thereto, and the processor 130 may display the clothing model and the recommended clothing corresponding to the recognized user immediately without displaying the guidance screen.

According to Fig. 11D, the processor 130 may display a garment model and a recommended garment. The processor 130 may display a plurality of recommended garments, but is not limited thereto. For example, the processor 130 may determine one recommended garment and additionally display a garment or accessory associated with the recommended garment.

The processor 130 may display a menu screen when the user touches the home button 1110. [ When the user touches the previous screen button 1120, the processor 130 can display the previous screen. In addition, the processor 130 can display a screen for selecting a category such as a clothing category, an accessory category, and the like, when the user touches the category button 1130. [ Processor 130 may display the categories and subcategories in a pop-up fashion.

In addition, the processor 130 may display the focus 10. The focus 10 may be displayed by a touch of a user or may be displayed by tracking a user's right hand index finger tip. However, the present invention is not limited thereto, and the LFD device 100 may include a mouse or the like, and may display the focus 10 of the mouse.

Referring to FIG. 11E, the processor 130 may display a detailed screen for a corresponding item if there is an input from a user who selects the first item in the screen of FIG. 11D. The processor 130 may change the operation of the garment model wearing the selected garment according to the movement of the user and display it. However, the present invention is not limited thereto, and if the LFD device 100 does not have a means for detecting the user, the processor 130 displays the clothing model wearing the selected clothing, changes the operation of the clothing model .

FIG. 12 is a diagram for explaining the operation of the LFD apparatus 100 having a mirror display according to an embodiment of the present invention.

A mirror display means a display that can act as a mirror in a normal situation but can be used as a display area according to a user's operation. That is, with a mirror display, the user can use it as a mirror or as a display for searching information.

12A shows a mirrored display in a standby state in which a user is not sensed. According to FIG. 12A, the processor 130 can display the brand name in one area of the mirror display and control the other area to be used as a mirror have. Then, the processor 130 may display an advertisement on the mirror display after a predetermined time has elapsed. The processor 130 may display the brand name or display the advertisement at a predetermined time interval.

According to FIG. 12B, when the user is recognized, the processor 130 displays the recommended garment in one area of the mirror display, and the other area is used as a mirror to reflect the user's reflected appearance.

The processor 130 may first obtain the gender, age, etc. from the recognized user and provide the primary recommendation garment 1210. The processor 130 may acquire colors, patterns, categories, and the like from the clothes worn by the user and provide secondary recommendation clothes 1211-1 and 1211-2. The specific method of selecting the recommended garment has been described above, so it is omitted.

In Fig. 12B, there is shown a difference in the display time of the primary recommended garment 1210 and the secondary recommended garments 1211-1 and 1211-2, but this is only an example and may be displayed at the same time.

According to FIG. 12C, the processor 130 may display a detailed garment of the selected garment when the user selects one of the recommended garments. For example, the processor 130 may display the tops, outerwear, and hats as recommended garments, and when the user selects the outerwear, various outerwear may be displayed as recommended garments.

The processor 130 may display the detailed garment in the enlarged area 1220 to allow the user to confirm the detail, if the user selects any of the detailed garments. In this case, the area used as a mirror of the mirror display can be partially reduced.

According to FIG. 12D, the processor 130 may display the selected clothing and detail information on the full screen when the user touches the enlarged area 1220 one more time. In this case, the entire area of the mirror display is used as a display area for providing information, and may not be used as a mirror.

The processor 130 may display the GUI 1230 for providing information about the goods location. However, the present invention is not limited thereto, and the processor 130 may display information on the goods position together with the selected clothes.

In Fig. 12D, only the product is shown as being displayed, but the present invention is not limited thereto. For example, the processor 130 may display a garment model wearing the selected product, and may change and display the operation of the garment model so as to correspond to the movement of the user.

According to FIG. 12E, the processor 130 may display a store map for indicating a merchandise location when the user touches the GUI 1230 for providing information on the merchandise location. The processor 130 may display the current location and the goods location in the store map. However, the present invention is not limited thereto, and the processor 130 may display the shop map through the pop-up method on the screen of FIG. 12D, and inform the user of the product position using the voice.

Although the LFD device 100 using the general display and the mirror display has been described above, the present invention is not limited thereto. For example, the LFD device 100 may be formed of a display wall or an ophthalmic 3D display. In this case, when the LFD device 100 is formed as a display wall, the display wall may be configured in a triangle, pyramid shape as well as a square.

13 is a view for explaining a method of providing statistical information according to an embodiment of the present invention.

According to FIG. 13A, the processor 130 may display a cumulative distribution of users in a store on a store map. For example, the store ceiling may have a plurality of cameras, and the processor 130 may use the plurality of cameras for a month to accumulate the copper wire data based on the data of the copper wires stored in the stores. Can be displayed in addition to the store map. The processor 130 may display a dark color when there is a large amount of accumulated data at a specific point.

According to FIG. 13B, the processor 130 may display the number of times of recognition of a plurality of users by age group for a week. This may be information by one LFD device 100, but is not limited thereto. For example, when a plurality of LFD apparatuses 100 are arranged in a store, data may be collected from a plurality of LFD apparatuses 100 and accumulated data may be displayed.

In addition, the processor 130 may display only a user who actively uses the LFD device 100, such as a touch operation of the user, as a statistical sample, instead of displaying only the recognized user.

According to FIG. 13C, the processor 130 can provide statistics by dividing men and women among visitors. 13C shows a display using a bar graph, but the present invention is not limited thereto, and the processor 130 can provide information using any other type of graph or numerical value.

14 is a flowchart illustrating a method of controlling an LFD apparatus according to an embodiment of the present invention.

First, the LFD device recognizes the user (S1410). Then, the profile information of the recognized user is acquired (S1420). Then, the apparel model and the recommended apparel corresponding to the obtained profile information are determined (S1430). Then, the garment model in a state wearing the recommended garment is displayed (S1440).

In addition, the recognition step S1410 recognizes the movement of the user, and the displaying step S1440 may control the movement state of the clothing model so as to correspond to the movement of the user who recognizes the clothing model.

The display step S1440 displays a background image distinguished from the clothing model, and when the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the direction of movement of the user , The background image can be maintained when the user's movement in which the vertical distance from the LFD device is changed is recognized.

In addition, the determining step S1430 may determine the apparel model based on the user's age and gender information, and determine the recommended apparel based on the information on the apparel worn by the user.

And, the step of determining (S1430) may determine the recommended accessories based on at least one of the user's apparel purchase record and the accessory purchase record, and the step of displaying (S1440) may display the apparel model wearing the recommended accessories have.

If the distance between the LFD device and the user is within a preset distance, the method further includes a step of providing a query for receiving a type of the user's desired garment, and the step of determining (S1430) So that the recommended garment can be determined.

The acquiring step S1420 of acquiring and determining at least one of the user's sex, age, clothing attributes, skin tone, figure, and fashion image as the profile information of the user and determining (S1430) It is possible to determine the recommended clothes based on the response of the user.

In addition, the displaying step S1440 may control the garment model to perform a gesture responsive to a predetermined operation or display an animation effect corresponding to a predetermined operation, when a predetermined operation is recognized by the user.

Then, when a plurality of users are recognized, based on at least one of a visit history of a plurality of users, a purchase record, an interest in the LFD device, a distance from the LFD device, and a distance from the center of the LFD device, , And displaying (S1440) may display the garment model corresponding to the main user.

In addition, the step of determining the main user may measure the degree of interest in the LFD device based on at least one of a direction of the face of the user and a time when the user stare at the LFD device.

According to various embodiments of the present invention as described above, the LFD device displays the clothing model and the recommended clothes corresponding to the user's profile information to induce the user's interest, and provides various recommended clothes to facilitate the user's desired clothes The convenience of the user is improved.

In the above description, the LFD device stores CRM information, but the present invention is not limited thereto. For example, the LFD device may transmit information about the recognized user to the server and receive a corresponding apparel model and recommended apparel from the server device.

Meanwhile, the control method of the LFD apparatus according to various embodiments of the present invention described above may be implemented in a computer-executable program code and executed by a processor in a state stored in various non-transitory computer readable media. And may be provided to each server or devices.

For example, a step of recognizing a user, acquiring profile information of a recognized user, determining a clothing model and a recommended garment corresponding to the obtained profile information, and displaying a garment model wearing a recommended garment A non-transitory computer readable medium may be provided.

A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: LFD device 110: display
120: sensing unit 130: processor
140: Storage 150:
155: user interface unit 160: audio processing unit
170: video processor 180: speaker
181: button 182: microphone

Claims (20)

In an LFD (large format display) device,
display;
A sensing unit recognizing a user; And
Acquires the profile information of the user recognized by the sensing unit, determines a clothing model and a recommendation garment corresponding to the obtained profile information, and controls the display to display the garment model in a state wearing the recommendation garment A LFD device comprising: a processor; The method according to claim 1,
The sensing unit includes:
Recognizes the movement of the user,
The processor comprising:
And controls the movement state of the clothing model so that the clothing model corresponds to the movement of the recognized user. 3. The method of claim 2,
The processor comprising:
Displaying a background image distinct from the clothing model,
When the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the moving direction of the user, and the movement of the user, in which the vertical distance from the LFD device is changed, And if it is recognized, maintains the background image. The method according to claim 1,
The processor comprising:
Determines the apparel model based on the age and gender information of the user, and determines the recommended apparel based on the information on the apparel worn by the user. The method according to claim 1,
The processor comprising:
Determines a recommended accessory based on at least one of the clothing purchase record of the user and the accessory purchase record, and displays the clothing model in a state wearing the recommended accessory. The method according to claim 1,
The processor comprising:
When the distance between the display and the user is within a preset distance, the user is provided with a query for inputting the type of the desired clothing, and the recommended clothing is determined based on the user's response to the inquiry LFD device. The method according to claim 6,
The processor comprising:
Acquiring at least one of the sex, age, clothing attribute, skin tone, figure, and fashion image of the user as profile information of the user,
And determines the recommendation garment based on the obtained profile information and the response of the user. The method according to claim 1,
The processor comprising:
Wherein when the predetermined operation is recognized by the user, the garment model controls the gesture to respond to the predetermined operation, or displays the animation effect corresponding to the predetermined operation. The method according to claim 1,
The processor comprising:
Wherein when a plurality of users are recognized through the sensing unit, based on at least one of a visit record of the plurality of users, a purchase record, an interest degree of the LFD device, a distance from the display and a distance from a center of the display, Determines a main user among the users of the LFD device, and displays the clothing model corresponding to the main user. 10. The method of claim 9,
The processor comprising:
Wherein the LFD device measures an interest for the LFD device based on at least one of a direction of the face of the user and a time when the user stare at the display. A method of controlling an LFD (large format display)
Recognizing the user;
Obtaining profile information of the recognized user;
Determining a clothing model and a recommended garment corresponding to the obtained profile information; And
And displaying the garment model in a state wearing the recommended garment. 12. The method of claim 11,
Wherein the recognizing comprises:
Recognizes the movement of the user,
Wherein the displaying comprises:
And controlling the movement state of the clothing model so that the clothing model corresponds to the movement of the recognized user. 13. The method of claim 12,
Wherein the displaying comprises:
Displaying a background image distinct from the clothing model,
When the movement of the user in the left and right directions in which the vertical distance from the LFD device is maintained is recognized, the background image is changed based on the moving direction of the user, and the movement of the user, in which the vertical distance from the LFD device is changed, And if it is recognized, the background image is maintained. 12. The method of claim 11,
Wherein the determining comprises:
Determines the apparel model based on the age and gender information of the user, and determines the recommended apparel based on the information on the apparel worn by the user. 12. The method of claim 11,
Wherein the determining comprises:
Determining a recommendation accessory based on at least one of the user's apparel purchase record and accessory purchase record,
Wherein the displaying comprises:
And displays the garment model in a state wearing the recommended accessories. 12. The method of claim 11,
If the distance between the LFD device and the user is within a predetermined distance, providing a query for the user to input the type of clothing desired,
Wherein the determining comprises:
Wherein the recommendation appara- tus is determined based on a user's response to the inquiry. 17. The method of claim 16,
Wherein the acquiring comprises:
Acquiring at least one of the sex, age, clothing attribute, skin tone, figure, and fashion image of the user as profile information of the user,
Wherein the determining comprises:
And the recommendation appara- tus is determined based on the obtained profile information and the response of the user. 12. The method of claim 11,
Wherein the displaying comprises:
Wherein when the predetermined operation is recognized by the user, the garment model controls the gesture to respond to the predetermined operation, or displays the animation effect corresponding to the predetermined operation. 12. The method of claim 11,
Wherein when a plurality of users are recognized, based on at least one of a visit record of the plurality of users, a purchase record, an interest degree of the LFD device, a distance from the LFD device and a distance from the center of the LFD device, Determining a main user among the plurality of users,
Wherein the displaying comprises:
And displays the clothing model corresponding to the main user. 20. The method of claim 19,
Wherein the step of determining the main user comprises:
Wherein the measure of interest for the LFD device is based on at least one of a direction of the face of the user and a time the user is staring at the LFD device.

Images