KR101885669B1 - System for intelligent exhibition based on transparent display and method thereof - Google Patents

System for intelligent exhibition based on transparent display and method thereof Download PDF

Info

Publication number
KR101885669B1
KR101885669B1 KR1020160182702A KR20160182702A KR101885669B1 KR 101885669 B1 KR101885669 B1 KR 101885669B1 KR 1020160182702 A KR1020160182702 A KR 1020160182702A KR 20160182702 A KR20160182702 A KR 20160182702A KR 101885669 B1 KR101885669 B1 KR 101885669B1
Authority
KR
South Korea
Prior art keywords
customer
information
transparent display
interest
display
Prior art date
Application number
KR1020160182702A
Other languages
Korean (ko)
Other versions
KR20180077881A (en
Inventor
조경은
치옥용
박지선
김준오
Original Assignee
동국대학교 산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 동국대학교 산학협력단 filed Critical 동국대학교 산학협력단
Priority to KR1020160182702A priority Critical patent/KR101885669B1/en
Publication of KR20180077881A publication Critical patent/KR20180077881A/en
Application granted granted Critical
Publication of KR101885669B1 publication Critical patent/KR101885669B1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce, e.g. shopping or e-commerce
    • G06Q30/02Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
    • G06Q30/0241Advertisement
    • G06Q30/0251Targeted advertisement
    • G06Q30/0261Targeted advertisement based on user location
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce, e.g. shopping or e-commerce
    • G06Q30/02Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce, e.g. shopping or e-commerce
    • G06Q30/02Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
    • G06Q30/0241Advertisement
    • G06Q30/0251Targeted advertisement
    • G06Q30/0255Targeted advertisement based on user history
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce, e.g. shopping or e-commerce
    • G06Q30/02Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
    • G06Q30/0241Advertisement
    • G06Q30/0277Online advertisement
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • G09F27/005Signs associated with a sensor
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • G09F2027/001Comprising a presence or proximity detector

Abstract

The intelligent product display system based on the transparent display according to an embodiment of the present invention includes a rotation display unit for displaying at least two goods on a rear surface of a transparent display by rotating and rotating a predetermined specific product, A customer information obtaining unit for obtaining at least one of the image of the customer, the electronic equipment owned by the customer, and the gesture of the customer as customer information, If the customer in front of the transparent display is recognized according to the reception of the recognition signal, the customer information obtained through the customer information obtaining unit is analyzed to estimate the customer's interest product group, and the recommended product information mapped in advance to the interest product group is extracted, Projected through a transparent display. A control unit for controlling the driving of the rotary jeonsidae.

Description

TECHNICAL FIELD [0001] The present invention relates to an intelligent product display system based on transparent display,
More particularly, the present invention relates to an intelligent product display unit based on a transparent display, and more particularly, to a display unit for analyzing customer preferences of a customer in front, estimating a customer's interest product group, And more particularly, to a display device for intelligent products based on a transparent display and a method for controlling the display device.
Digital signage is a convergence platform that utilizes digital technology to display images and information on a display screen or projector and to remotely manage the information on a network. Digital signage with this function has the character of convergence media that provides digital information display and remotely manageable over the network in a public place or a commercial space and provides various information and advertisement in real time.
Digital signage advertising, which provides consumers with a user experience, has emerged as the blue ocean of outdoor advertising. The development of creative contents is becoming more important than ever in a situation where software technology is developed with customized using multi-screen platform, terrestrial using sensor, and mobile advertisement combining smartphone and digital signage.
The government also announced the 'Smart Media Industry Promotion Plan (2015 ~ 2020)' in order to realize a smart media powerhouse, and digital signage is one of the industrial areas targeted for upbringing.
As such, digital signage is highly likely to be selected as a major area of the smart media industry, and digital signage, which attracts attention as the fourth screen media after televisions, computers and mobile phones, is attracting attention as a next-generation growth engine for the advertising market .
Korean Patent No. 10-1390360 (" Online Video Contents Providing System for Transparent Display Showcase "), 2012.01.30., The V Co.,
SUMMARY OF THE INVENTION The present invention provides a display device for intelligent products based on a transparent display that analyzes a customer's taste to estimate a group of products of interest and outputs a recommended product selected according to the estimation to a transparent display, will be.
It is another object of the present invention to provide a transparent display device capable of selectively displaying a recommended product selected according to a customer's taste and displaying products on a transparent display And a method of the same.
The intelligent product display system based on a transparent display according to an embodiment of the present invention includes a rotation display unit for displaying at least two products on a rear surface of a transparent display by rotating and rotating a selected specific product, A customer information acquiring unit having at least one of a camera and a Bluetooth to acquire at least one of the image of the customer, the electronic equipment owned by the customer and the gesture of the customer as customer information, If the customer in front of the transparent display is recognized according to the receipt of the customer recognition signal, the customer information analyzing unit analyzes the customer information acquired through the customer information obtaining unit to estimate a group of products of interest of the customer, Extracts the recommended product from the transparent disc In order to display to the projection ray through a control unit for controlling the driving of the rotary jeonsidae.
The control unit according to another embodiment of the present invention may further include an interest product group estimation module for extracting a group of interest products mapped in advance according to the analyzed customer information from a database, a recommendation product extraction module for extracting a specific product, And a controller for controlling the rotation of the rotary plate so as to face the transparent display on which the specific product is mounted so as to recommend the extracted specific product to the customer and analyzing the customer gesture input from the recognition sensor unit, And a transparent display control module for outputting interactive data corresponding to the gesture of the customer to the transparent display together with the projection of the specific product, .
The interest product group estimation module according to another embodiment of the present invention determines whether to acquire at least one of the image of the customer and the information about the electronic equipment owned by the customer according to the product group to be sold in the store.
In the case where the customer's image acquisition is determined, the interest product group estimation module according to another embodiment of the present invention executes the camera to photograph the front of the transparent display, extracts a customer image from the captured image, Color and size of at least one of clothing and accessories worn by a customer, and estimates a product group of interest according to the analysis.
In the case of analyzing color of at least one of a customer's clothes and ornaments, the at least one color of at least one of the customer's clothing and ornaments may be classified into HSV (Hue, Saturation, Value) It is determined by the color and the similar color within the range of 20 degrees as a standard.
The recommendation product extraction module according to another embodiment of the present invention grasps at least one of the clothing and jewelry of the similar color and the skin color of the customer so that the value of the HSV is mapped to the skin color of the customer in advance When the difference between the hue values of the corresponding product and the hue of the customer image is greater than a preset reference value, the difference between the hue values of the products having the complementary color and the hue values of the two colors, And when at least one of the products having a similar color is smaller than a predetermined reference, extracts at least one of the products having a similar color as the recommended product.
The interest product group estimation module according to another embodiment of the present invention analyzes at least one of a color, a design, and a material of the jewelry, clothes and non-jewelry to be worn by the customer, The recommended product extraction module corresponds to at least one of the color, design, and material of at least one of the analyzed ornaments and garments, and at the same time extracts information about the ornaments corresponding to the non-attached ornaments from the database as recommended products.
The interest product group estimation module according to another embodiment of the present invention may be configured such that the electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices confirmed in the Bluetooth mounted on the transparent display Estimates information about at least one of the type, model, brand, and maker information of the estimated electronic device, and estimates a product group of interest according to the analysis.
In another aspect of the present invention, the module for estimating a product category of interest analyzes a customer-owned electronic device and a wearable electronic device that is smiling, and the recommended product extraction module analyzes at least one of brands and manufacturers of the analyzed customer- And at the same time extracts information about the electronic equipment corresponding to the wearable electronic equipment as a recommended product from the database.
According to another aspect of the present invention, there is provided a rotary display stand including a rotary plate for mounting a plurality of products at a predetermined interval, a rotary shaft provided at the center of the rotary plate, and a control unit for rotating the rotary shaft by 360 degrees, And driving means for disposing the display means to face the back surface of the transparent display.
The rotating plate according to another embodiment of the present invention includes a separate rotating table capable of individually rotating 360 degrees and moving up and down and left and right for each stationary portion of each commodity.
The rotation plate and the individual swivel according to another embodiment of the present invention are controlled in accordance with the gesture of the customer when the gesture of the customer to further check additional information about the selected specific product occurs.
The customer information obtaining unit according to another embodiment of the present invention is configured of the camera for photographing the front of the transparent display and the camera for outputting the photographed image and the Bluetooth for identifying the electronic devices close to the transparent display, Electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices recognized in the Bluetooth are estimated as electronic devices owned by the customer.
The step of extracting the recommended product information previously mapped to the product group of interest according to another embodiment of the present invention may include extracting recommended product information previously mapped to the product group of interest according to another embodiment of the present invention by grasping at least one product among clothing and / When a difference between a product corresponding to a value mapped in advance to a skin color and a hue value of two colors having a larger specific gravity among hues of the customer image is larger than a predetermined reference, a product having a complementary color, When the difference of the hue value of the color is smaller than a preset reference, at least one of the products having a similar color is extracted as the recommended product.
The step of analyzing the customer information of the customer according to another embodiment of the present invention and estimating a group of products of interest of the customer may include a step of estimating a customer's interest product group based on the color, design and material of the wearing ornaments and clothes, Wherein the step of extracting recommended product information previously mapped to the item of interest includes at least one of color, design and material of at least one of the analyzed ornaments and clothing, From the database as recommended products.
The step of estimating a customer's interest product group by analyzing the customer information of the other embodiment of the present invention may include estimating a customer's interest product group by analyzing customer information of the electronic device corresponding to the intensity or rank of the preset signal among the activated peripheral devices, And the step of extracting the recommended product information previously mapped to the product group of interest analyzes information on at least one of the type, the model, the brand, and the manufacturer information of the estimated electronic device , And estimates the customer's interest product group according to the analysis.
The step of analyzing the customer information and analyzing the customer information of the customer according to another embodiment of the present invention may include analyzing the customer-owned electronic device and the wearable electronic device smiled by the customer, analyzing the recommended product information Extracts information about the electronic equipment corresponding to at least one of the brand and the manufacturer of the analyzed customer-owned electronic device and the electronic equipment corresponding to the smiley wearable electronic device as a recommended product from the database.
According to the transparent display-based intelligent product display unit and the method thereof according to the embodiment of the present invention, the customer's preference product group is analyzed by analyzing the taste of the customer in front, and the recommended product selected according to the estimation is projected on the transparent display Customized product advertisements and their information can be delivered.
In addition, according to the transparent display-based intelligent product display unit and method thereof according to the embodiment of the present invention, various commodities are selectively displayed on a transparent display in a rotating display to display customized recommended commodities for each customer, It is possible to promote the desire to purchase the product to the consumer.
1 is a block diagram showing a schematic configuration diagram of an intelligent merchandise display system based on a transparent display according to an embodiment of the present invention.
2 is a perspective view of an intelligent merchandise display system according to an embodiment of the present invention.
3 is a diagram showing an example of an execution screen of a transparent display according to an embodiment of the present invention.
4 is a block diagram illustrating a configuration of a control unit of an intelligent merchandizing display based on a transparent display according to an embodiment of the present invention.
Figure 5 illustrates the HSV color space utilized in an embodiment of the present invention.
6 is a flowchart illustrating an intelligent product display method based on a transparent display according to an exemplary embodiment of the present invention.
Hereinafter, embodiments of the present invention for solving the above-mentioned technical problems will be described in detail with reference to the drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It is to be noted that the same components are denoted by the same names and reference numerals as possible throughout the drawings.
FIG. 1 is a block diagram showing a schematic configuration diagram of an intelligent merchandise display system based on a transparent display according to an embodiment of the present invention. FIG. 2 is a block diagram showing an intelligent merchandise display system according to an embodiment of the present invention. FIG. 3 is a view showing an example of an execution screen of a transparent display according to an embodiment of the present invention.
1, a transparent display based intelligent product display system according to an embodiment of the present invention includes a rotation display 100, a transparent display 200, a recognition sensor 300, a customer information acquisition unit 400, A control unit 500 and a database 600.
As shown in FIG. 2, the rotary display stand 100 rotates through at least two commodities and rotates, and displays the selected specific commodities on the rear surface of the transparent display 200 to be displayed. That is, the product to be projected on the transparent display 200 can be changed through the rotation of the rotary display stand 100.
The rotary display platform 100 includes a rotary plate 130 for mounting a plurality of products at a predetermined interval, a rotary shaft 120 provided at the center of the rotary plate 130, and a rotary shaft 120, And a drive means for rotating the display device 360 by 360 degrees to dispose the selected specific product so as to face the back surface of the transparent display 200. At this time, the rotary plate 130 includes a plurality of individual rotary tables 111 to 116 that can rotate 360 degrees and move vertically and horizontally individually for each of the stationary parts.
The rotation plate 130 and the individual rotation tables 111 to 116 are set such that the driving is controlled according to the default setting by the controller 500 and the gesture of the customer who wishes to further check the additional information And if so, the drive may be designed to be controlled in accordance with the gesture of the customer.
The commodity transportation passage 600 may further be provided to transmit various commodities 700 from the commodity transport passage to the revolving display stand 100.
3, the transparent display 200 is installed on the front surface of the rotary display station 100 to project a specific product placed on the rotary display stand 100 and to display information 210 and 220 on a specific product, And interactive data corresponding to the customer gesture. The article placed on the rotary display stand 100 is disposed at a position where it can be overlapped with the screen of the transparent display 200. [ In the transparent display 200, the advertisement moving image 220 and the introduction message 210 related to the product can be visualized without blocking the corresponding product. The advertisement video 220 and the introduction message 210 include information including a price, an event, etc. of the product.
The user may perform a gesture in front of the transparent display 200 to convert the displayed commodity into another commodity, or rotate a specific commodity to observe the commodity at various angles.
The transparent display 200 may be configured by mounting a recognition sensor unit 300 and a customer information acquisition unit 400 on the inside or outside front or back side. 2 shows an example in which the Bluetooth 220 is installed inside the transparent display 200, the camera 210 is provided at the rear, and the keyboard 310 is provided at the front.
Referring again to FIG. 1, the recognition sensor unit 300 recognizes a customer in front of the transparent display 200, generates a customer recognition signal, and outputs the generated customer recognition signal to the control unit 500. The recognition sensor unit 300 may include at least one of an operation recognizing sensor, a line recognizing sensor, a position recognizing sensor, and a voice recognizing sensor. Accordingly, the customer recognizing signal may include an operation recognizing signal, a line recognizing signal, And a signal.
The motion recognition sensor senses the infrared ray signal reflected from the human body after transmitting the infrared ray to the human body within the recognition range, and can display the important joint region of the human body as a plurality of points, thereby recognizing the movement, speed and position of the human body can do. In addition, the motion recognition sensor may include a depth sensor and may recognize the distance between the motion recognition sensor and the detected human body. The motion recognition sensor can separate one person by recognizing the person at the nearest distance when several persons are located within the recognition range.
As an example, the motion recognition sensor may be implemented by a Microsoft Kinect device capable of motion capture and speech recognition, and the motion recognition sensor may detect a person at a distance of approximately 40 centimeters to 4 meters It can have a recognition range. On the other hand, the motion recognition signal generated by the motion recognition sensor is digital data for indicating the motion and position of the human body detected by the motion recognition sensor. For example, the motion recognition signal includes position information of a plurality of points expressing the important joint region of the human body Depth information.
 The line-of-sight recognition sensor is a sensor that tracks a person's pupil and recognizes the direction of the user's line of sight. The sensor detects a customer in front of the transparent display 200 and displays information about the customer's line of sight Direction, a time at which the customer's gaze is maintained, and the like).
The position recognition sensor is a sensor for recognizing the position of the customer in front of the transparent display 200, and may be realized by an infrared ray position sensor or the like as known to a person skilled in the art. The position recognition sensor can detect a customer in front of the transparent display 200 and generate a position recognition signal including information on the position of the customer (a standing position of the customer, a time when the customer stands at the current position, and the like).
The speech recognition sensor may be implemented by a speech recognition sensor known to a person skilled in the art as a sensor capable of recognizing speech uttered by a customer in front of the transparent display 200. [ The speech recognition sensor can recognize a speech of the customer in front of the transparent display 200 and generate a speech recognition signal.
In addition, the recognition sensor unit 300 may be provided as a 2D camera or the like behind the transparent display 200 so as to acquire information on the products stored in the rotary display unit 100 and transmit the acquired information to the control unit 500. The control unit 500 may generate a control signal for rotating the display unit 100 to face a specific commodity on the back side of the transparent display 200. [ In addition, the control unit 500 recognizes the size of the product through the information obtained from the camera provided behind the transparent display 200, and automatically adjusts the size and position of the UI of the product on the screen of the transparent display 200 .
The recognition sensor unit 300 may include at least one of an operation recognition sensor, a visual recognition sensor, a position recognition sensor, and a speech recognition sensor. The recognition sensor unit 300 may include various recognition sensors And the motion recognition sensor, the sight recognition sensor, the position recognition sensor, and the voice recognition sensor may be variously changed within a range known to the ordinary artisan.
The customer information obtaining unit 400 may include at least one of a camera for photographing the front of the transparent display and a camera for outputting the photographed image and a Bluetooth for identifying the electronic apparatuses close to the transparent display so that the image of the customer, And acquires at least one of the gestures of the customer as customer information.
Here, among the activated peripheral devices recognized by the Bluetooth, the electronic devices corresponding to the intensity or rank of the signal preset by the controller 500 are estimated by the customer's own electronic device.
If the customer is recognized in front of the transparent display according to the receipt of the customer recognition signal, the control unit 500 analyzes the customer information acquired through the customer information acquisition unit 400 to estimate the customer's interest product group, The controller 500 controls the rotation of the rotary display unit 100 in order to extract recommended product information previously mapped to the product group of interest from the database 500 and project the recommended product through the transparent display 200 for display.
4 is a block diagram illustrating a configuration of a control unit of an intelligent merchandizing display based on a transparent display according to an embodiment of the present invention.
The control unit 500 may be implemented by a central processing unit such as a CPU processor, which controls various components of the display unit based on the transparent display and processes various data according to an embodiment of the present invention, The operation of the control unit as described above can be performed by executing the program stored in the control unit 500 or the memory.
4, the control unit 500 includes an interest product group estimation module 510 for extracting an interest product group previously mapped according to the analyzed customer information from a database, A recommended product extracting module 530 for extracting a specific product from the database 600, and a recommendation module 530 for extracting a specific rotation of one of the individual rotation tables 111 to 116, The customer gesture input from the recognition sensor unit 300 is analyzed to determine whether the customer gesture is displayed on the rotary display stand 100 and the individual display stands 111 to 116 according to the customer gesture, A rotation display unit control module 550 for controlling the driving of the customer, information about the recommended product, and interactive data corresponding to the gesture of the customer, It is configured to include a transparent display control module 570 for outputting to the transparent display 200 with a projection of a particular product.
The interested product group estimation module 510 can determine whether to acquire at least one of the image of the customer and the information about the electronic equipment owned by the customer according to the product group to be sold in the store.
For example, in the case of a store selling electronic devices, the interested product group estimation module 510 may be preset by the seller or the designer to acquire information on the electronic equipment owned by the customer as customer information. Alternatively, in the case of a store selling garments or ornaments, the interested product group estimation module 510 may be preset by the seller or the designer to acquire information on the image of the customer as customer information.
When the interest product group estimation module 510 is set to acquire the customer image as the customer information, the camera is executed to photograph the front of the transparent display 200, extract the customer image from the captured image, Color and size of at least one of clothing and accessories worn by a customer, and estimates a product group of interest according to the analysis.
Herein, in analyzing the color of at least one of the customer's clothes and ornaments, the customer's product category estimation module 510 may determine at least one color of the customer's clothing and ornaments as 20 degrees (hue, saturation, It can be decided by the color corresponding to the range within the range. FIG. 5 illustrates the HSV color space utilized in this interest product group estimation module 510.
The recommended product extraction module 530 determines at least one of the clothing and the jewelry corresponding to the similar color and the skin color of the customer so that the product corresponding to the value mapped in the Value value of the HSV to the customer's skin color, When the difference between the hue values of the two colors having a larger specific gravity among the colors of the image is larger than the preset reference, the difference between the hue values of the two colors having a larger specific gravity among the colors of the product having the complementary color and the customer image is smaller than the preset reference , And at least one of the products having a similar color can be extracted as the recommended product.
Here, even when a commodity having a complementary color or a similar color is extracted as a recommended commodity, the color of the commodity suitable for the customer can be determined by adjusting the V value of the HSV according to the color of the customer. In addition, the method of extracting the product according to the customer's skin color is based on the assumption that the lower the value, the more suitable for the darker skin and the opposite, the better for the bright skin.
It is obvious to those skilled in the art that the product of the above-mentioned products can be determined in advance by the person in charge of the display system or the designer of the store and can be changed.
More specifically, the interested product group estimation module 510 may analyze at least one of the color, design, and material of the ornaments, clothing, and non-wearing accessories that the customer wears, the wearing accessories, and the clothes in the customer image.
The recommended product extraction module 530 corresponds to at least one of color, design, and material of at least one of the analyzed ornaments and garments, and information about the ornaments corresponding to the unadorned ornaments is referred to as a recommended product from the database 600 Can be extracted. This can be based on the tendency that the customer's already-owned ornaments are not likely to be purchased again at the store. Such a premise can set priorities for each product according to season or weather conditions, And can be variously changed in the operable range.
Meanwhile, when the interested product group estimation module 510 is set to acquire information on the electronic equipment owned by the customer as the customer information, It is possible to estimate the electronic devices corresponding to the intensity or rank of the set signal to the customer's own electronic device. Then, information on at least one of the type, the model, the brand, and the manufacturer information of the estimated electronic device is analyzed, and the customer's interest product group can be estimated according to the analysis.
More specifically, the interest product group estimation module 510 may analyze customer-owned electronic equipment and smiling wearable electronic equipment. The recommended product extraction module 530 corresponds to at least one of the brand and the manufacturer of the analyzed customer-owned electronic device, and at the same time, the information about the electronic device corresponding to the smiled wearable electronic device is referred to as a recommended product, .
At this time, it is possible to apply the wearable electronic device to a configuration for recommending the wearable electronic device by applying the above-described product interest estimation technique related to the customer's interest clothing and ornaments.
On the other hand, if the customer's own electronic device is not detected, the customer's product category estimation module 510 can detect that the customer wears jewelry and set the wearable electronic device corresponding to the jewelry to be recommended in priority order.
The rotation display unit control module 550 displays any one of the individual rotation tables 111 to 116 on which the specific commodity is mounted in order to recommend the specific commodity extracted by the recommended commodity extraction module 530 to the transparent display 200 And controls the rotation of the rotary display stand 100 to analyze the customer gesture inputted from the recognition sensor unit 300 and to drive the rotary display stand 100 and the individual display stands 111 to 116 according to the customer gesture As shown in FIG. At this time, the result of recognizing the customer gesture can be converted into a signal for controlling the driving of the rotating display stand 100 and the individual display stands 111 to 116 through, for example, the Arduino communication module.
The transparent display control module 570 outputs the interactive data corresponding to the gesture of the customer to the transparent display 200 together with the projection of the specific product as shown in FIG. To this end, the transparent display control module 570 can generate a control signal for controlling the rotation display unit 100 and the individual rotation units 111 to 116 corresponding to the gesture of the customer recognized through the recognition sensor unit 300 . In addition, it is possible to generate a screen control signal of a transparent display pre-mapped to a customer's behavior indicating a specific product and voice data in which the customer speaks a related word of a specific product.
The database 600 may store product images corresponding to customer gestures. In other words, the transparent display 200 can be projected to store image, image, and text information of a related product corresponding to a specific product displayed. The product images stored in the database 600 may be a three-dimensional image, and may store information on recommended products mapped in advance according to the product group of interest based on the mapping table. Such a database 600 may be implemented in various types of storage devices known to those of ordinary skill in the art, such as HDD, EEPROM, flash memory, and SSD.
6 is a flowchart illustrating an intelligent product display method based on a transparent display according to an exemplary embodiment of the present invention.
Referring to FIG. 6, a method of displaying an intelligent product based on a transparent display according to an embodiment of the present invention will be described.
A method of displaying an intelligent product based on a transparent display according to an embodiment of the present invention is a method of displaying a product using a rotary display unit which displays at least two goods on a rear surface of a transparent display, In this case,
First, the customer in front of the transparent display is recognized and a customer recognition signal is output (S610). To this end, it is possible to drive at least one of the motion recognition sensor, the line-of-sight recognition sensor, the position recognition sensor, and the speech recognition sensor.
Next, at least one of the image of the customer, the electronic equipment owned by the customer, and the gesture of the customer is acquired as customer information through at least one of the camera mounted on the transparent display and the Bluetooth (S620).
Here, it is possible to determine whether to acquire at least one of the image of the customer and the information about the electronic equipment owned by the customer according to the product group to be sold in the store.
The step of acquiring the image of the customer may include the steps of photographing the front of the transparent display by running the camera, extracting a customer image from the photographed image, and extracting a customer image from among the clothes and accessories And analyzing at least one of at least one kind, color, and size.
The step of analyzing at least one color of at least one of the customer's clothes and the ornaments may include the step of analyzing color of at least one of the customer's clothing and ornaments with a color within a range of 20 degrees based on HSV (Hue, Saturation, Value) It can be decided by a similar color.
Also, the step of acquiring the customer-owned electronic device as the customer information may estimate the electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices recognized by the Bluetooth as the customer's own electronic device.
Next, the customer information is analyzed to estimate the product group of interest of the customer (S630). In analyzing the customer image, at least one of color, design, and material of the jewelry, the clothing and the non-wearing jewelry, the wearing jewelry, and the clothes may be analyzed. In the case of analyzing the electronic equipment owned by the customer, it is possible to estimate the electronic equipment corresponding to the intensity or rank of the preset signal among the activated peripheral devices confirmed in the Bluetooth mounted on the transparent display to the customer's own electronic equipment .
Next, the recommended product information previously mapped to the group of interest products is extracted (S640).
Herein, in order to extract recommended product information on the customer image, at least one of the clothing and the ornament corresponding to the similar color and the skin color of the customer are grasped and the value of HSV is mapped to a value mapped in advance to the skin color of the customer When the difference between the hue values of the corresponding product and the hue of the customer image is greater than a preset reference value, the difference between the hue values of the products having the complementary color and the hue values of the two colors, If it is smaller than a preset reference, at least one of the products having similar colors can be extracted.
Here, even when a commodity having a complementary color or a similar color is extracted as a recommended commodity, the color of the commodity suitable for the customer can be determined by adjusting the V value of the HSV according to the color of the customer. In addition, the method of extracting the product according to the customer's skin color is based on the assumption that the lower the value, the more suitable for the darker skin and the opposite, the better for the bright skin.
It is obvious to a person skilled in the art that a product to be extracted as a recommended product can be determined in advance by the person in charge of the exhibition system or the designer of the store and can be changed.
More specifically, it analyzes at least one of a color, a design, and a material of the wearing ornaments and clothes ornaments, clothes, and accessories to be worn by a customer in the customer image, and analyzes at least one of the analyzed ornaments and clothes Design and material of the article, and at the same time, information about the ornament corresponding to the non-attachable ornaments can be extracted from the database as a recommended article. This can be based on the tendency that the customer's already-owned ornaments are not likely to be purchased again at the store. Such a premise can set priorities for each product according to season or weather conditions, And can be variously changed in the operable range.
In order to extract recommended product information related to the customer-owned electronic device, information on at least one of the type, model, brand, and manufacturer information of the estimated electronic device is analyzed and the customer's interest product group is estimated according to the analysis . Specifically, the customer-owned electronic device and the wearable electronic device smiled by the customer are analyzed, and at least one of the brand and manufacturer of the analyzed customer-owned electronic device corresponds to at least one of the electronic devices corresponding to the smiley wearable electronic device Information about the device can be extracted from the database as a recommendation product.
On the other hand, when the electronic equipment owned by the customer is not detected, it is possible to detect the accessory worn by the customer and to set the wearable electronic equipment corresponding to the accessory to be recommended in priority order.
Next, in step S650, the rotation of the rotary display unit is controlled to display the recommended product on the recommended product information through the transparent display.
Here, the rotating display unit includes an individual rotating unit capable of individually rotating 360 degrees and moving up and down and left and right for each stationary portion of each commodity,
The rotation display unit and the individual rotation unit may further include a step of controlling the driving according to the gesture of the customer when the gesture of the customer is generated to further check additional information about the selected specific commodity.
Specifically, in order to recommend the extracted specific product to the customer, the rotation of the rotating display is controlled so that any one of the individual rotating tables on which the specific product is mounted faces the transparent display, and the customer gesture is analyzed, Thereby controlling the driving of the rotating display stand and the individual display stand. At this time, the recognition result of the customer gesture can be converted into a signal for controlling the driving of the rotating display stand and the individual display stand, for example, through the Arduino communication module.
As described above, according to the transparent display-based intelligent product display unit and method according to the embodiment of the present invention, it is possible to estimate the customer's interest product group by analyzing the customer's taste in the front, By projecting and displaying on the display, customized product advertisements and their information can be delivered.
In addition, various commodities are displayed on a transparent display selectively on a rotating display to display customized recommended commodities for each customer, so that the desire to purchase commodities can be improved by intelligently recommending the user's preferred commodities.
Meanwhile, the embodiments of the present invention can be embodied as computer readable codes on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.
Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like. In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers skilled in the art to which the present invention belongs.
The present invention has been described above with reference to various embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.
100: Rotating display stand
200: Transparent display
300: recognition sensor unit
400: customer information obtaining unit
500:
600: Database

Claims (20)

  1. A rotary display unit for displaying at least two goods by rotating and rotating the selected specific goods on the back surface of the transparent display;
    A recognition sensor unit for recognizing a customer in front of the transparent display and outputting a customer recognition signal and acquiring information about a product placed on the rotary display through a rear camera provided on a back surface of the transparent display;
    A customer information acquiring unit having at least one of a front camera and a Bluetooth to acquire at least one of the image of the customer, the electronic equipment owned by the customer and the gesture of the customer as customer information; And
    If the customer in front of the transparent display is recognized according to the receipt of the customer recognition signal, the customer information analyzing unit analyzes the customer information acquired through the customer information obtaining unit to estimate a group of products of interest of the customer, And a control unit for controlling the driving of the rotary display unit to project and display the recommended product through the transparent display,
    Wherein,
    Information on the recommended product recognized by the backside camera and interactive data corresponding to the gesture of the customer are output to the transparent display together with projection of the specific product, and the size of the recommended product recognized through the backside camera Wherein the UI on the transparent display screen is automatically adjusted and displayed based on the transparent display.
  2. The method according to claim 1,
    Wherein,
    An interest product group estimation module for extracting an interest product group previously mapped by the analyzed customer information from a database;
    A recommendation product extraction module for extracting a specific product previously mapped to the interest product group from a database; And
    Controls the rotation of the rotating display unit so as to face the transparent display unit on which the specific product is mounted to recommend the extracted specific product to the customer, analyzes the customer gesture input from the recognition sensor unit, A rotation display unit control module for controlling driving of the rotation plate according to the rotation state of the rotation plate; A display device for intelligent goods based on a transparent display.
  3. 3. The method of claim 2,
    The interest product group estimation module includes:
    And determines whether to acquire at least one of the customer's image and the electronic equipment owned by the customer according to the product group sold in the store.
  4. 3. The method of claim 2,
    The interest product group estimation module includes:
    The image display device according to claim 1, wherein when the image acquisition of the customer is determined, the front camera is taken to photograph the transparent display front, a customer image is extracted from the photographed image, and at least one kind , Color and size, and estimates a customer's interest product group according to the analysis.
  5. 5. The method of claim 4,
    The interest product group estimation module includes:
    In analyzing color of at least one of a customer's clothes and accessories, at least one color of the customer's clothing and ornaments is determined as a color and a similar color within a range of 20 degrees based on HSV (Hue, Saturation, Value) Intelligent products display system based on transparent display.
  6. 6. The method of claim 5,
    The recommendation product extraction module,
    At least one of clothing and accessories corresponding to the similar color, color of the customer's skin, a product corresponding to a value in which a Value value of the HSV is mapped in advance to the color of the customer's skin, When the difference between the Hue values of the colors is larger than a predetermined reference and the difference between the hue values of the two colors having a larger specific gravity among the colors of the product having the complementary color and the customer image is smaller than a preset reference, And displaying one as a recommended product.
  7. 3. The method of claim 2,
    The interest product group estimation module may analyze at least one of a color, a design, and a material of the jewelry, the clothing and the non-wearing jewelry, the wearable jewelry,
    Wherein the recommendation product extraction module extracts from the database as information about the ornaments corresponding to at least one of color, design, and material of at least one of the analyzed ornaments and garments, Intelligent Product Display System.
  8. 3. The method of claim 2,
    The interest product group estimation module includes:
    And estimates the electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices recognized in the Bluetooth mounted on the transparent display as the customer's own electronic device, And information on at least one of manufacturer information, and estimating a group of products of interest according to the analysis.
  9. 3. The method of claim 2,
    The interest product group estimation module analyzes customer-owned electronic equipment and smiley wearable electronic equipment,
    Wherein the recommendation product extraction module extracts information about the electronic equipment corresponding to at least one of the brand and the manufacturer of the analyzed customer-owned electronic device as a recommended product from the database, Based intelligent product display system.
  10. The method according to claim 1,
    The rotating display unit includes:
    A rotating plate for mounting a plurality of commodities at a predetermined interval;
    A rotating shaft provided at the center of the rotating plate; And
    And driving means for rotating the rotary shaft by 360 degrees by the control unit and arranging the selected specific product so as to face the back surface of the transparent display.
  11. 11. The method of claim 10,
    The rotating plate includes:
    And an individual swivel unit capable of individually rotating 360 degrees and moving vertically and horizontally for each portion where each commodity is mounted.
  12. 12. The method of claim 11,
    The rotating plate and the individual rotating table,
    And the driving is controlled according to the gesture of the customer when the gesture of the customer to further check additional information about the selected specific product occurs.
  13. The method according to claim 1,
    The customer information obtaining unit obtains,
    A front camera for photographing a front of the transparent display and outputting a photographed image, and the Bluetooth for grasping electronic devices close to the transparent display,
    Wherein the controller estimates the electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices recognized by the Bluetooth as an electronic device owned by the customer.
  14. A method for displaying a product using a rotating display stand which displays at least two or more products on a rear surface of a transparent display by rotating a selected specific product,
    Recognizing a customer in front of the transparent display and outputting a customer recognition signal, and acquiring information on a product placed in the rotary display through a back camera provided on a back surface of the transparent display;
    Acquiring, as customer information, at least one of the image of the customer, the electronic equipment owned by the customer, and the gesture of the customer through at least one of the front camera mounted on the transparent display and the Bluetooth;
    Analyzing the customer information to estimate a product group of interest of the customer;
    Extracting recommended product information previously mapped to the group of interest products;
    Controlling the rotation of the rotary display unit so that the recommended product information is projected through the transparent display so as to be displayed on the transparent display; And
    Information on the recommended product recognized by the backside camera and interactive data corresponding to the gesture of the customer are output to the transparent display together with projection of the specific product, and the size of the recommended product recognized through the backside camera And automatically adjusting and displaying the UI on the transparent display screen based on the displayed information.
  15. 15. The method of claim 14,
    Wherein acquiring the image of the customer comprises:
    Executing the front camera and photographing the front of the transparent display;
    Extracting a customer image from the photographed image; And
    And analyzing at least one of at least one of a type, a color, and a size of at least one of clothing and accessories worn by a customer in the extracted customer image.
  16. 16. The method of claim 15,
    The step of analyzing color of at least one of the customer's clothing and ornaments comprises:
    Wherein the color of at least one of the customer's clothes and ornaments is determined as a color and a similar color within a range of 20 degrees based on HSV (Hue, Saturation, Value).
  17. 17. The method of claim 16,
    The step of extracting recommended product information previously mapped to the group of interest products,
    At least one of clothing and accessories corresponding to the similar color, color of the customer's skin, a product corresponding to a value in which a Value value of the HSV is mapped in advance to the color of the customer's skin, When the difference between the Hue values of the colors is larger than a predetermined reference and the difference between the hue values of the two colors having a larger specific gravity among the colors of the product having the complementary color and the customer image is smaller than a preset reference, And displaying one of the items as the recommended product.
  18. 15. The method of claim 14,
    Analyzing the customer information and estimating a group of products of interest of the customer,
    And analyzing at least one of a color, a design, and a material of the jewelry, clothing and non-jewelry to be worn by the customer,
    The step of extracting recommended product information previously mapped to the group of interest products,
    Designing and material of at least one of the analyzed ornaments and garments and at the same time extracting information about the ornaments corresponding to the unadorned ornaments from the database as a recommended product.
  19. 15. The method of claim 14,
    Analyzing the customer information and estimating a group of products of interest of the customer,
    Owned by the customer, electronic devices corresponding to the intensity or rank of the preset signal among the activated peripheral devices recognized in the Bluetooth mounted on the transparent display,
    The step of extracting recommended product information previously mapped to the group of interest products,
    Analyzing information on at least one of the type, the model, the brand, and the manufacturer information of the estimated electronic device, and estimating a group of products of interest according to the analysis.
  20. 20. The method of claim 19,
    Analyzing the customer information and estimating a group of products of interest of the customer,
    The customer-owned electronic device and the wearable electronic device smiled by the customer are analyzed,
    The step of extracting recommended product information previously mapped to the group of interest products,
    And displaying information on the electronic device corresponding to at least one of the brand and manufacturer of the analyzed customer-owned electronic device and corresponding to the smiley wearable electronic device as a recommended product from the database. .
KR1020160182702A 2016-12-29 2016-12-29 System for intelligent exhibition based on transparent display and method thereof KR101885669B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160182702A KR101885669B1 (en) 2016-12-29 2016-12-29 System for intelligent exhibition based on transparent display and method thereof

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160182702A KR101885669B1 (en) 2016-12-29 2016-12-29 System for intelligent exhibition based on transparent display and method thereof
PCT/KR2017/013214 WO2018124476A1 (en) 2016-12-29 2017-11-21 Transparent display-based intelligent product display system and method therefor

Publications (2)

Publication Number Publication Date
KR20180077881A KR20180077881A (en) 2018-07-09
KR101885669B1 true KR101885669B1 (en) 2018-09-10

Family

ID=62711030

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160182702A KR101885669B1 (en) 2016-12-29 2016-12-29 System for intelligent exhibition based on transparent display and method thereof

Country Status (2)

Country Link
KR (1) KR101885669B1 (en)
WO (1) WO2018124476A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101212949B1 (en) * 2012-05-22 2012-12-18 삼일씨티에스(주) Apparatus for display goods
KR101392877B1 (en) 2013-09-16 2014-05-09 (주)엘케이지오 Digital showcase, digital showcase system and marketing method with the smae

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101390360B1 (en) 2012-01-30 2014-05-07 주식회사 더브이 On-line image contents providing system for show case having transmissive display
KR101464273B1 (en) * 2013-03-06 2014-11-24 (주)피엑스디 Apparatus for displaying interactive image using transparent display, method for displaying interactive image using transparent display and recording medium thereof
EP2973304B1 (en) * 2013-03-13 2017-07-05 Intel Corporation System and method to provide location-based digital signage services
KR20140124087A (en) * 2013-04-16 2014-10-24 허명구 System and method for recommending hair based on face and style recognition
KR101494445B1 (en) * 2013-06-10 2015-02-23 (주)피엑스디 Apparatus and method for displaying promotion image using transparent display, and recording medium thereof
KR20160144277A (en) * 2015-06-08 2016-12-16 (주)엘앤케이랩 Codi Service Providing System, Server and Device, and Method using them

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101212949B1 (en) * 2012-05-22 2012-12-18 삼일씨티에스(주) Apparatus for display goods
KR101392877B1 (en) 2013-09-16 2014-05-09 (주)엘케이지오 Digital showcase, digital showcase system and marketing method with the smae

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
네이버 블로그, "[PMC] 증강현실 피팅 거울~ IoT 기술로 태어난 에프엑스미러 가상 피팅 체험존 운영! IT뉴스" (2016.06.21.) <URL: http://blog.naver.com/pmccorp5088/220741933629>*

Also Published As

Publication number Publication date
WO2018124476A1 (en) 2018-07-05
KR20180077881A (en) 2018-07-09

Similar Documents

Publication Publication Date Title
CN104090973B (en) A kind of information demonstrating method and device
US10482724B2 (en) Method, computer program product, and system for providing a sensor-based environment
Hwangbo et al. Use of the smart store for persuasive marketing and immersive customer experiences: A case study of Korean apparel enterprise
CN107493319A (en) A kind of intelligent interaction Multimedia System and its implementation
US20120140069A1 (en) Systems and methods for gathering viewership statistics and providing viewer-driven mass media content
CN105339969A (en) Linked advertisements
CN103226774A (en) Information exchange system
KR20130057148A (en) Cosmetics information providing method and apparatus
KR101620938B1 (en) A cloth product information management apparatus and A cloth product information management sever communicating to the appartus, a server recommending a product related the cloth, a A cloth product information providing method
US20180033045A1 (en) Method and system for personalized advertising
US10643270B1 (en) Smart platform counter display system and method
KR20150000026A (en) Smart mobile digital signage using customer recognition technologies and control method thereof
US20180232799A1 (en) Exhibition device, display control device and exhibition system
KR101885669B1 (en) System for intelligent exhibition based on transparent display and method thereof
WO2018190773A1 (en) Method and system for targeted advertising based on personal physical characteristics
CN104581317A (en) Playing system and method of image information
US20150100464A1 (en) Information displaying apparatus and method of object
CN110874133A (en) Interaction method based on intelligent display device, intelligent display device and storage medium
US20170358135A1 (en) Augmenting the Half-Mirror to Display Additional Information in Retail Environments
KR101432055B1 (en) display device and commercial content delivery methods
Bule et al. Interactive augmented reality marketing system
KR20200004014A (en) Digital signage system for clothing fitting and method for displaying items using thereof
KR101431804B1 (en) Apparatus for displaying show window image using transparent display, method for displaying show window image using transparent display and recording medium thereof
Murtadho et al. Design and implementation of smart advertisement display board prototype
KR20210132915A (en) Advertising curation system using face recognition and IoT technology

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant