KR102268045B1 - An apparatus and method for proceeding information of products being displayed in the show window - Google Patents

Abstract

The present invention is to provide information on products displayed in a show window. In a show window accommodating a plurality of products, a scan unit for scanning the show window and the periphery of the show window, and an image on at least a part of the show window a display unit for projecting information, and a gesture of a user located around the show window is detected based on the scanned result, and image information related to at least one of the plurality of products is displayed on the show window based on the gesture. and a control unit for controlling the display unit to be displayed.

Description

Apparatus and method for providing product information of products displayed in the show window {AN APPARATUS AND METHOD FOR PROCEEDING INFORMATION OF PRODUCTS BEING DISPLAYED IN THE SHOW WINDOW}

The present invention is to provide information on products displayed in a show window.

In general, in large department stores or shopping malls, sample products or actual products are displayed inside a highly transparent structure (show window) such as glass. In this case, passers-by may visually check the products through the show window, and thus may be converted into potential customers due to an increase in purchase desire.

Meanwhile, a method for increasing the synergistic effect of such a purchase desire using developed information and communication technology is being actively studied. For example, currently, information and communication technology is used to more actively provide desired information to a user. To this end, currently, information on digitized products, such as digital signage, is provided to the user, and a method for interacting with the user is also emerging.

However, such a digital signage method has a limitation in that it can provide only a digital image, not an actual product or sample, to the user, and in the implementation of digital signage, the larger the area of the display panel, the higher the cost. There is a problem that a lot of cost is consumed by requiring Accordingly, there is an urgent need for a method capable of providing a user with an actual product sample and providing a variety of information related to the product to the user at a lower cost.

SUMMARY OF THE INVENTION An object of the present invention is to provide an apparatus and method for providing information desired by a user by interacting with the user while showing an actual product or an actual product sample to the user.

Another object of the present invention is to provide an apparatus and method for minimizing costs while interacting with a user to provide desired information to the user.

According to one aspect of the present invention to achieve the above or other object, the product information providing apparatus according to an embodiment of the present invention, in a show window accommodating a plurality of products, scans the show window and the periphery of the show window A scanning unit, a display unit for projecting image information on at least a portion of the show window, and detecting a gesture of a user located in the vicinity of the show window based on the scanned result, based on the gesture, among the plurality of products and a control unit controlling the display unit so that at least one related image information is displayed on the show window.

In an embodiment, the controller controls the scan unit to scan a specific location inside the showcase where information related to any one product corresponding to the gesture is displayed among the plurality of products, and the scanned image is characterized in that the display unit is controlled to be projected.

In an embodiment, the control unit controls the scan unit to scan a specific position where at least one advertisement is displayed within the show window, and controls the display unit to project the scanned image.

In an embodiment, the controller controls the display unit to change at least one of a location and a size at which the scanned image is projected, based on a gesture of the head with respect to the scanned image.

In one embodiment, further comprising a memory in which information related to each of the products is stored, wherein the control unit reads information related to a product to any one of the products corresponding to the gesture from the memory to display the show window It is characterized in that the display unit is controlled to be projected on at least a partial area of the .

In an embodiment, the control unit controls the display unit to receive information related to any one of the products corresponding to the gesture from a wireless chip attached to the product and project the information to at least a partial area of the show window. characterized in that

In an embodiment, the scan unit scans an image of a user reflected on the show window, and the control unit detects a distance to the user and a gesture of the user using the scanned result.

In an embodiment, the image information is characterized in that it is information including at least one of information on an event related to the product, information searched for on the product, and information on another product related to the product.

In an embodiment, the control unit controls the display unit so that a selection area for receiving at least one of the plurality of products to be selected by a user is displayed on the show window, and based on the user's gesture sensed on the selection area to control the display unit to project image information related to at least one of the products.

In an embodiment, the selection area is formed in at least a portion of the show window so that at least one product accommodated in the show window is reflected, and among the reflected products, at least one corresponding to a user's gesture It is characterized as an area where the products of the product are displayed separately from other products.

In an embodiment, the controller further detects a user's gaze direction from a result of scanning the user's image reflected on the show window, and sets the selection area based on the user's gaze direction. .

In an embodiment, the control unit selects any one of the products visible through the selection area based on the user's gaze direction and controls the display unit to distinguish the selected product from other products, and the selected product When a user's gesture is detected, the display unit is controlled so that information related to the selected product is displayed on at least a part of the selection area.

In an embodiment, the controller determines the position of the image information projected on the show window based on the user's gaze direction and the detected user's gesture.

In an embodiment, the controller determines a position on the show window to which the image information is projected and a size of the image information based on the height of the user and the position of the user.

In an embodiment, the control unit controls the display unit to display at least one graphic object allowing a user to control some operations of the scanning unit to be displayed in the show window, and the graphic object is scanned by the scanning unit. It is characterized in that it is related to a position inside the show window and a zoom-in or zoom-out operation of the scan unit.

In an embodiment, the control unit controls the display unit to further display a graphic object for transmitting information about a product corresponding to the gesture to a specific mobile terminal in the show window, and controls the user's response to the graphic object. When a gesture is detected, the information is transmitted to the user's mobile terminal.

In an embodiment, the scan unit scans the show window and the periphery of the show window by using a laser scan method.

In an embodiment, the control unit is, in a state in which the image information is displayed, detects whether the same user is in the vicinity of the show window based on an image of the user reflected on the show window, and based on the detection result, the It is characterized in that the display of image information is stopped.

In an embodiment, the scan unit scans the show window to further scan a temperature distribution on the show window, and the control unit is a point at which the user's touch is sensed on the show window based on the scanned result. is detected, and image information related to at least one of the plurality of products is displayed on the show window based on the sensed point.

According to an aspect of the present invention in order to achieve the above or other objects, the method for providing product information according to an embodiment of the present invention includes, in a show window in which a plurality of products are accommodated, scanning the show window and the surroundings of the show window. detecting a gesture of a user located in the vicinity of the show window based on the scanned result; receiving at least one of the plurality of products selected from the user based on the detected gesture; and, and projecting image information related to at least one product onto at least a partial area of the show window.

The effect of the product information providing apparatus and the method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the present invention can provide product information of a product based on a user's gesture through the show window, so that the user can check the actual product and sample, while allowing the user to It has the advantage of providing a variety of information.

According to at least one of the embodiments of the present invention, the present invention scans the show window to detect the user's gesture, and allows product information corresponding thereto to be projected on the show window, so that the user can interact with the user while using the general show window. It has the advantage that it works so that the information desired by the user can be provided.

1 is a block diagram illustrating a configuration of an apparatus for providing product information according to an embodiment of the present invention.
2 is a flowchart illustrating an operation process of an apparatus for providing product information according to an embodiment of the present invention.
3 is a flowchart illustrating in more detail an operation process of selecting any one display item corresponding to a user's gesture.
4 is a flowchart illustrating in more detail an operation process in which any one display item is selected based on the user's gaze direction and the user's gesture.
5A and 5B are exemplary views showing an example in which a product information providing apparatus according to an embodiment of the present invention is installed and an example of image information displayed on a show window according to an embodiment of the present invention.
6A and 6B are exemplary views illustrating an example in which the position of image information displayed on a show window is determined differently according to a user's position and a user's height in the product information providing apparatus according to an embodiment of the present invention.
7 is an exemplary diagram in which image information is provided based on a change in a user's gaze direction and a user's gesture in the device for providing product information according to an embodiment of the present invention.
8 is an exemplary diagram in which an image related to a specific advertisement is projected on a show window according to a user's selection in the device for providing product information according to an embodiment of the present invention.
9 is an exemplary diagram showing examples of graphic objects capable of controlling a state in which image information is displayed and functions performed accordingly in the device for providing product information according to an embodiment of the present invention.

It should be noted that technical terms used herein are used only to describe specific embodiments, and are not intended to limit the present invention. Also, as used herein, the singular expression includes the plural expression unless the context clearly dictates otherwise. As used herein, "consisting of." or "includes." The term such as etc. should not be construed as necessarily including all of the various components or steps described in the specification, and some components or some steps may not be included, or additional components or steps may not be included. It should be construed as being able to include more.

In addition, in describing the technology disclosed in the present specification, if it is determined that a detailed description of a related known technology may obscure the gist of the technology disclosed in this specification, the detailed description thereof will be omitted.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings.

First, in order to help a complete understanding of the present invention, the basic principle of the present invention will be described. In the present invention, a general show window, not a touch screen, is used in interaction with a user to actively provide desired information. in order to be able to To this end, in the present invention, when a person (hereinafter referred to as a 'user') is located in the show window within a certain distance, the user's gesture is sensed using the image of the user reflected through the show window, and the user Information related to a specific product or sample corresponding to the gesture of can be projected on at least a partial area of the show window. Accordingly, the present invention can detect a user's gesture, such as a user's touch, and provide information related to a specific product accordingly, even though the entire show window is not configured as a touch screen.

To this end, the present invention may include means for detecting the user's gesture and means for scanning products or samples displayed in the show window and information on the products or samples. . Here, the sensing means may be various. For example, the sensing means may be an infrared sensor or a laser sensor installed around the show window. Alternatively, the sensing means and the scanning means may be a single scanner. This is because the scanner may scan the user's image reflected on the show window to detect the distance between the user and the show window and the user's gesture.

1 is a diagram illustrating the configuration of an apparatus for providing product information according to an embodiment of the present invention. In the following description, it is assumed that one scanner, that is, a case in which the sensing means and the scanning means are configured as one scanner.

Referring to FIG. 1 , the device 100 for providing product information according to an embodiment of the present invention is connected to the scan unit 104 and the display unit 106 and the scan unit 104 and the display unit 106, and each connected It may be configured to include a control unit 102 for controlling the components.

Here, the display unit 106 may display information related to at least one of a plurality of products accommodated in the show window in the form of image information on the show window. For example, the display unit 106 is implemented in the form of a beam projector, and image information related to at least one product among a plurality of products accommodated in the show window is projected onto at least a part of the show window. )can do. In this case, the user located outside the show window selects the product selected by the user through image information projected on the back side of the show window, that is, the side in the direction in which the products or samples (hereinafter referred to as display items) are displayed (hereinafter referred to as the inner side). related information can be found.

The scan unit 104 may scan around the show window. For example, the scan unit 104 may scan the display items located inside the show window according to a laser scanning method to generate an image related to each of the display items. Alternatively, the control unit 102 scans a specific position within the show window, for example, a position where information related to displays accommodated in the show window is displayed or a position where an advertisement is displayed inside the show window, and is displayed at the scanned position. It is also possible to create an image containing information. Also, the image scanned by the scan unit 104 may be projected on at least a partial area of the show window through the display unit 106 under the control of the control unit 102 .

Meanwhile, the scan unit 104 may scan the show window and generate an image related to an image reflected on the show window. In this case, the scan unit 104 may detect a distance between the user and the show window through an image related to the user's image reflected on the show window. In addition, the scan unit 104 may recognize the direction in which the user's gaze is directed by recognizing the user's pupils from the user's image reflected on the show window.

Meanwhile, the scan unit 104 may scan the show window in various ways. For example, as described above, by simply scanning the image of the user reflected on the show window, the height of the user, the direction of the user's gaze, or the gesture the user is taking may be detected. In addition, the scan unit 104 may scan the show window to search for a point in the show window where the change in temperature abruptly changes over a certain level. In this case, the scan unit 104 determines whether the user is touching a point of the show window based on the user's image reflected on the show window and a point at which the temperature change abruptly occurs on the show window, and the It is also possible to detect a point on the show window where a touch is applied.

Meanwhile, the controller 102 may control each component connected as described above, that is, the display unit 106 and the scan unit 104 . Here, the control unit 102 may detect the gaze of the user looking at the show window and the distance to the user from the scan result of the scan unit 104 scanning the show window. In addition, a user's gesture including a touch on the show window may be detected from a result of scanning the show window.

The controller 102 may detect the user's gesture and determine whether the user's gesture is for selecting any one of the display items displayed in the show window. And when it is determined that the gesture is for selecting any one of the display items, the controller 102 controls the display unit 106 so that image information related to the display item corresponding to the gesture is displayed on at least a part of the show window. can control

Here, the control unit 102 may display the image information on the show window based on the user's image projected on the show window. For example, the controller 102 may detect a height of the user and a distance between the show window and the user based on the user's image. In addition, the control unit 102 may display the image information based on the sensed height of the user and the distance. Accordingly, the position or size of the image information may change when the height of the user changes or when the distance between the user and the show window changes.

Meanwhile, the image information may be information scanned by the scanning unit 104 . For example, the image information may be an image scanned directly by the scanning unit 104 of the display item, or may be an image scanned by the scanning unit 104 at a specific location where information related to the display unit is displayed. .

Alternatively, when the user selects a specific display item, the image information may be information stored in advance corresponding to the display item. In this case, the previously stored information may be information stored in the memory 108 .

Alternatively, the image information may be information received from a tag attached to the display product. In this case, the tag attached to the display product may include a radio frequency (RF) chip or a near field communication (NFC) chip in which various information related to the corresponding product is stored.

Meanwhile, the control unit 102 may display, as the image information, a result of a web search, etc. in addition to the previously stored or pre-specified information as described above. For example, the controller 102 may search for information such as event information related to a display item corresponding to the current user's gesture or evaluation of netizens according to the user's selection, and display the retrieved information as the image information. You may. Alternatively, the control unit 102 may display various information related to the display product, such as an expert opinion or suggestion related to the display product, as the image information. To this end, it goes without saying that the product information providing apparatus 100 according to an embodiment of the present invention may further include a communication means (not shown) connectable to an external server.

Also, the controller 102 may display an image scanned at a specific point inside the show window as the image information based on a user's gesture detected through the show window. For example, the control unit 102 may scan a position where an advertisement light displayed inside the show window is displayed based on a user's gesture, and enlarge and display the scanned information according to a user's selection or a user's selection It can also be displayed in a position on the show window that Here, the user's selection may be made by a user's gesture including a user's touch applied to the show window.

Meanwhile, the controller 102 may use various methods for selecting at least one of the display items based on the user's gesture detected on the show window. For example, the control unit 102 determines the user's location from the user's image projected on the show window, and selects an area (hereinafter referred to as a selection area) in which a user's gesture can be detected based on the user's location. It can be formed in a part on the window.

The selection area may be used to more accurately select any one for which the user desires related information among the displayed items. For example, when the selection area is formed, the controller 102 may display any one display item corresponding to the user's gaze or gesture among the products reflected through the selection area to be distinguished from other display items. In addition, according to a user's selection, the display unit 106 may be controlled so that image information related to any one display item displayed separately is projected on at least a part of the show window.

In this case, the selection area may be set to correspond to the position where the user is standing on the current show window, and may be formed based on the user's arm length (about 1 m) around the user's position. Such a selection area may or may not be displayed on the show window, and may be an area whose position is moved according to the user's gaze direction.

Meanwhile, the memory 108 stores data supporting various functions of the product information providing apparatus 100 according to an embodiment of the present invention. The memory 108 may store a plurality of application programs driven in the device 100 for providing product information according to an embodiment of the present invention, or data and instructions for operation of applications. At least some of these application programs may be downloaded from an external server through wireless communication.

In addition, information related to each of the display items may be previously stored in the memory 108 as described above, and in this case, information related to any one of the display items may be applied to the controller 102 . In this case, the control unit 102 may display information pre-stored in the memory 108 in addition to the images scanned around the show window by the scan unit 104 on at least a portion of the show window according to a user's selection.

2 is a diagram illustrating an operation process of an apparatus for providing product information according to an embodiment of the present invention.

Referring to FIG. 2 , the controller 102 of the product information providing apparatus 100 according to an embodiment of the present invention controls the scan unit 104 to scan the show window and the vicinity of the show window ( S200 ). . In step S200, the scan unit 104 scans the display items displayed inside the show window or a specific point inside the show window at a preset time period and applies the scanned result to the control unit 102 in the form of an image. . Also, the scan unit 104 may scan the show window and apply the scanned result to the control unit 102 in the form of an image. In addition, the scan unit 104 may scan the show window and apply an image related to the heat distribution of the show window to the control unit 102 .

Meanwhile, the control unit 102 analyzes the scan result in step S200, and detects whether there is a user located around the show window and a gesture of the user (S202). For example, the controller 102 may detect whether there is a user around the show window from the image reflected on the show window, and may estimate a distance between the show window and the user.

For example, the control unit 102 determines whether the user has a small body (eg, a small child) based on the respective proportions of the user's body from the image of the user reflected on the show window, or the position where the user is more than a certain distance away from the show window It can be determined whether in

Alternatively, the controller 102 may use a result of scanning the heat distribution for the show window for this determination. In this case, in the case of a user who is close to the show window, the portion where the user's image is reflected on the show window may have a higher temperature than other portions.

Meanwhile, the controller 102 may detect the user's gesture from the user's image reflected on the show window. For example, the controller 102 may analyze the user's image reflected on the show window to distinguish the user who is looking at the show window, and may recognize the divided user's arm or finger. In addition, by detecting the recognized movement of the user's arm or finger, it may be determined whether the user has made a gesture for designating any one of the displayed products.

Meanwhile, when a user's gesture for designating any one of the display items displayed in the show window is detected in step S202, the controller 102 may select a display item corresponding to the detected gesture (S204). For example, the controller 102 may select a display item located in a direction to which the user's fingertip is directed as designated by the user's gesture. Here, the controller 102 may determine, from the user's image reflected on the show window, that the display item positioned in the direction to which the user's fingertip faces is selected by the user.

Alternatively, the controller 102 may select a display item corresponding to the user's gesture by using the images of the display items reflected in the show window. For example, on the inner surface of the show window (in the following description, the side in the direction in which displays are displayed in the show window will be referred to as the inner surface, and the other surface will be referred to as the outer surface) of the display products displayed inside the show window. images of them may be reflected. And the reflected image may be scanned by the scanning unit 104 .

In this case, the controller 102 may find a reflected image of any one display item corresponding to the direction in which the user's fingertip points from the image reflected inside the show window, and the display item corresponding to the reflected image is the user's It may be determined that the selection is made by a gesture.

Meanwhile, such a gesture may include a user's touch on the show window. For example, when the user applies a touch to the show window, the controller 102 may determine that any one of the display items is selected in response to the touch. In this case, the controller 102 may select the reflected image of the display item corresponding to the touch from among the images of the display items reflected in the show window, and determine that the display item corresponding to the selected image is designated by the user. .

Meanwhile, the user's touch applied to the show window may be sensed in various ways. For example, the control unit 102 scans a temperature distribution state on the show window through the scan unit 104 , and detects a point where a user's touch is applied on the show window based on a result of scanning the temperature distribution state You may. This is because, when the user touches a point on the show window, the temperature of the corresponding point will increase by a certain level or more.

Meanwhile, when a specific display item is selected based on the user's gesture as described above, the controller 102 may project image information related to the selected display item on the show window ( S206 ). Here, the projected image information may be an image scanned directly from the selected display item or an image scanned from a specific location in the show window in which information related to the selected display item is displayed. Alternatively, the image information may be pre-stored information received from the memory 108 or an RF chip attached to a tag of the display product.

Alternatively, the image information may be information showing a web search result, such as evaluation information of a netizen or another user on the selected display product. Alternatively, the image information may be information on opinions of experts or suggestions of other users. That is, when the selected display item is a handbag, the controller 102 may display information about other clothes or other accessories matching the handbag from fashion designers or other users as the image information. And it goes without saying that at least one such image information may be displayed on the show window according to a user's selection.

Meanwhile, the time during which the image information is projected on the show window may be determined based on the time the user stays around the show window. For example, when image information is projected in step S206 , the controller 102 may scan an image of a user reflected through the show window to detect whether the user is in the vicinity of the show window. In addition, if there is no user around the show window, the projection of the image information may be stopped immediately or when a predetermined time has elapsed.

And when there is a user around the show window, the control unit 102 may determine whether to maintain a state in which the image information is displayed on the show window based on whether the user is the same user. That is, when it is determined that the user located in the vicinity of the current show window is the same person as the user who selected to output the currently projected image information, the controller 102 may maintain a state in which the current image information is projected on the show window. Also, if the user moves around the show window, it goes without saying that the controller 102 may change the location where the image information is projected based on the user's moved location.

However, when it is determined that the users located around the show window are not the same user, the control unit 102 may stop the projection of the image information. In this case, the controller 102 terminates the operation of providing image information according to the previous user's gesture, and allows new image information to be output on the show window based on the new user's gesture.

On the other hand, the product information providing apparatus 100 according to an embodiment of the present invention. A partial area on the show window may be set as a selection area, and a specific display item may be selected based on a user's gesture detected on the selection area. Even when the user touches the same point on the show window or makes a gesture to select the same direction (for example, a gesture of pointing a finger in the direction in which a specific display item is located), the user's position, the user's eye height, or This is because different display items may be selected according to the user's gaze direction and the angle formed by the show window.

FIG. 3 shows an operation process of selecting any one display item corresponding to a user's gesture by setting a predetermined area as a selection area in this way, among the operation process shown in FIG. 2 .

Referring to FIG. 3 , when the user's gesture is detected in step S202 , the controller 102 may set the selection area ( S300 ). Here, the control unit 102 may control the display unit 106 to project a graphic object for displaying a boundary of the selection area on the show window so that the set selection area can be distinguished on the show window.

Meanwhile, when the selection area is set as described above, the control unit 102 may select any one of the display items based on the user's gesture sensed on the selection area ( S302 ). For example, the control unit 102 may divide the selection area into a plurality of items corresponding to the number of display items currently displayed in the show window. In addition, a display item corresponding to an area selected by the user's gesture may be selected from among the plurality of partitioned selection areas.

Here, the control unit 102 may set a specific display item to correspond to each of the plurality of regions based on the current user's position and the user's eye height or the user's gaze direction. For example, when the user is looking at the front of the show window, the control unit 102 divides the selection area into a plurality based on the images of display items reflected in the inside of the show window, and divides the selection area into a plurality of areas corresponding to the divided areas. You can decide which items to display.

On the other hand, when the user is looking at the side of the show window, the control unit 102 may divide the selection area differently from the case in which the user is looking at the front. For example, the control unit 102 divides the selection area into a plurality of areas of different sizes based on the gaze direction of the user in which the user is facing the side, and the plurality of items in the order of display items close to the location of the user. It is also possible to set each region partitioned by . In this case, the control unit 102, even if a gesture (eg, a touch) is detected at a point on the same show window, when the user's gaze direction is different, different display items are selected and different image information is displayed. It may be displayed on a window.

On the other hand, when a selection area is set in a partial area on the show window, the control unit 102 may display any one of the display items in the show window visible through the selection area according to the user's selection to be displayed separately from other display items. You may. In addition, image information related to the displayed items can be projected on at least a portion of the show window based on the user's gesture (eg, touch). And here, the user's selection may be the user's gaze. In this case, the controller 102 may set the selection area based on the user's gaze direction and select a display item corresponding to the user's gaze direction, and accordingly, information related to the display item corresponding to the user's gaze direction is displayed in the show. It may be displayed on a window.

4 illustrates in more detail an operation process in which any one product is selected based on the user's gaze direction and the user's gesture in this case.

Referring to FIG. 4 , when the user's gesture is detected in step S202, the control unit 102 of the product information providing apparatus 100 according to an embodiment of the present invention is a part of the show window based on the user's gaze direction. An area may be set as the selection area (S400). For example, the control unit 102 recognizes the direction the user's pupils face from the user's image reflected through the show window, and based on the user's eye level and the recognized direction, a region of a certain size, for example, a general user An area corresponding to the length of the arm (about 1 m) may be set as the selection area.

In addition, the control unit 102 may display the display items corresponding to the user's gaze direction from among the display items reflected through the set selection area ( S402 ). For example, the controller 102 may recognize the user's gaze direction from the user's pupil reflected in the show window, and may select a display item corresponding to the recognized user's gaze direction. In addition, the controller 102 may control the display unit 106 so that an area on the selection area where display items corresponding to the user's gaze direction are displayed can be distinguished from other areas of the selection area.

For example, the controller 102 may recognize an area in which the display item corresponding to the user's gaze direction is displayed in the show window by using the images of the display items reflected on the inner surface of the show window. In addition, the controller 102 may control the display unit 106 to display a graphic object such as a guide line in the recognized area. In this case, the display unit 106 displays the boundary of the selection area under the control of the control unit 102 and at the same time displays a guide line around the recognized area, so that the displayed items visible in the recognized area are displayed. You can indicate to the user that it is currently selected.

As such, when one area within the selection area is displayed to be distinguished from other areas, the control unit 102 detects whether a user has selected an area on the separately displayed show window (S404). Here, the user's selection may be made through a user's touch on the region or a user's gesture. And if there is a user's selection as a result of the detection in step S404, the control unit 102 proceeds to step S206, and displays the display item corresponding to the separately displayed area, that is, the display item corresponding to the user's gaze direction. The display unit 106 is controlled so that related image information is projected on the show window.

However, as a result of the detection in step S404, if there is no user selection for the separately displayed area, the controller 102 may further detect whether the user's gaze direction is changed (S406). If the user's gaze direction is not changed as a result of the detection in step S406, the process proceeds to step S404 to detect whether the user selects the separately displayed area.

However, as a result of the detection in step S406, if the user's gaze direction is changed, the controller 102 may display the display items corresponding to the changed user's gaze direction to be distinguished from other display products on the selection area. (S408). Then, the control unit 102 proceeds to step S404, and detects again whether there is a user's detection of an area on the currently displayed show window to be distinguished.

Here, the controller 102 is configured to, if the display item corresponding to the changed user's gaze is displayed in an area on the show window that is out of the currently set selection area, the selection area based on the change in the user's gaze direction Of course, you can change the location of the . For example, the controller 102 may determine this based on a result of scanning the show window. That is, the controller 102 responds to the changed gaze direction based on whether an image of a display product corresponding to the changed user's gaze is reflected within the area of the inner surface of the show window corresponding to the currently set selection area. It may be determined whether the position at which the displayed items are displayed is out of the currently set selection area.

In the above description, the configuration of the device for providing product information according to an embodiment of the present invention and the operation process of the device have been described in detail.

In the following description, an example in which the product information providing apparatus according to an embodiment of the present invention is installed and an example in which image information related to a display item selected by a user is displayed on a show window according to an embodiment of the present invention will be described with reference to the drawings. Let's take a closer look.

First, FIG. 5A shows an example in which an apparatus for providing product information according to an embodiment of the present invention is installed.

As shown in FIG. 5A , when there is a gesture of the user 500 detected outside the show window 520 , the product information providing apparatus 100 according to an embodiment of the present invention, based on the gesture, the show window ( 520) Image information related to the display items 510 displayed therein may be projected onto one area of the inner surface of the show window 520 . Here, the user's gesture may be detected based on a result of scanning the user's image reflected through the show window 520 or a result of scanning the temperature distribution on the show window 520 as described above.

As such, when the user's gesture is detected, the control unit 102 selects display items corresponding to the sensed gesture and enables image information related to the selected display item to be displayed on the show window 520 . Here, in order to select a display item corresponding to the user's gesture, the control unit 102 uses the image of the display item 510 reflected on the inner surface of the show window 520 or on the show window 520 . You can also use the set selection area.

In addition, the image information may be an image scanned directly from the display product 510 or a scanned image of a specific location around the show window 520 in which information related to the display product 522 is displayed, or the display product 520 . ), various information such as a web search result may be the image information.

FIG. 5B shows an example of image information displayed on the show window 520 as described above.

The product information providing apparatus 100 according to an embodiment of the present invention may display image information 570 related to a specific display item corresponding to a user's gesture on at least a partial area of the show window 520 . In this case, the image information may be projected on at least a partial area of the show window 520 as shown in FIGS. 5A and 5B . As such, in the present invention, a user's gesture is sensed and the user's desired information is projected using a laser scanning/projector (Laser Scanning/Projector) method, so that despite using a show window of a general material such as glass, not a touch screen, and various related information on a specific display item corresponding to the user's gesture can be provided to the user.

Meanwhile, it goes without saying that the product information providing apparatus 100 according to an embodiment of the present invention may be downsized by using a high-density integration method using a micro electro mechanical system (MEMS). In addition, in the description of FIGS. 5A and 5B, it is assumed that there is one product information providing apparatus according to an embodiment of the present invention for convenience of explanation, but not only one but also a plurality of product information providing apparatuses 100 Of course, it may be provided inside the show window. In this case, the provided plurality of devices can cooperate with each other to exchange information with each other, and in this case, the user's gesture can be detected more accurately and the display item corresponding to the user's gesture can be detected more accurately and quickly. is of course

Meanwhile, FIGS. 6A and 6B are exemplary views showing an example in which the position of information displayed on the show window is determined differently according to the position of the user and the height of the user's height in the device for providing product information according to an embodiment of the present invention.

As mentioned in the above description, the control unit 102 of the product information providing apparatus 100 according to an embodiment of the present invention based on the user's image projected through the show window, the distance between the show window and the user can be estimated. For example, the controller 102 may be configured to control a distance between the user and the show window from a result of estimating a proportion of a body or a 3D depth of the scanned image from the image of the user reflected on the show window. can be estimated.

In this case, the controller 102 may change the size and position of the image information displayed on the show window based on the estimated distance between the user and the show window. 6A shows an example of such a case.

For example, when the distance between the user 600 and the show window is close, the controller 102 of the product information providing apparatus 100 according to an embodiment of the present invention has the same size as that shown in (a) of FIG. 6A . The raw image information 602 can be displayed on the show window.

However, if the user is located at a greater distance than shown in (a) of FIG. 6A, the controller 102 may change the size of the image information displayed on the show window based on this distance. . In this case, as shown in (b) of FIG. 6A , the controller 102 may display larger image information 612 on the show window based on the distance away from the user 610 .

In addition, the product information providing apparatus 100 according to an embodiment of the present invention may change the position at which the image information is displayed according to the height of the user. 6B shows such an example.

First, FIG. 6B (a) shows an example in which the control unit 102 displays the image information 652 at a position determined based on the height of the user 650 . For example, the controller 102 may detect the height of the user's height based on the user's image reflected on the show window, and determine a position on the show window where the image information is projected based on the detected height of the key. can Accordingly, as shown in (a) of FIG. 6B , the image information 652 may be displayed at a position corresponding to the user's 650's head height or eye height.

Similarly, when a small user, for example, a user such as a child, makes a gesture on a specific display item, the control unit 102 detects the height of the child's height and determines the position where the image information is displayed accordingly. can be changed Accordingly, as shown in (b) of FIG. 6B , image information 662 may be displayed at a position on the show window corresponding to the head height or eye height of the child 660 .

Meanwhile, in the description of FIG. 6B described above, it is described that the position at which the image information is displayed is determined based on the height of the user's height. Of course, it is also possible to determine a position on the show window corresponding to .

Meanwhile, according to the above description of FIG. 4 , the product information providing apparatus 100 according to an embodiment of the present invention sets a predetermined area of the show window as a selection area based on the user's gaze direction, and selects the selection area. The operation process of displaying image information based on the user's gesture sensed through the above has been described.

7 illustrates an example in which product information is provided based on a user's gaze direction change and a user's gesture in the product information providing apparatus according to an embodiment of the present invention in this case.

The controller 102 of the product information providing apparatus 100 according to an embodiment of the present invention may recognize the user's gaze direction from the user's pupil image reflected on the show window, and based on the user's gaze direction, the show window A certain area of the image may be set as a selection area (step S300 above).

In this case, the controller 102 may display an area in which the display item corresponding to the user's gaze direction is displayed on the selection area to be distinguished from other areas. 7A shows an example in which the selection area 700 set by the user's gaze direction and the area in which a specific display item is displayed within the selection area are displayed through guide lines 712 as described above.

Meanwhile, in this state, the controller 102 may detect whether the user's gaze direction is changed. For example, as a result of scanning the show window, the controller 102 may determine that the user's gaze direction is changed when the direction to which the user's pupils face is changed. In this case, the controller 102 may change the position of the selection area 700 based on the change in the user's gaze direction. 7B shows an example in which the position of the selection area 700 is changed by the change of the user's gaze direction as described above.

Meanwhile, when the user's gaze direction is changed as described above, the display items corresponding to the user's gaze direction may also be changed to another one. In this case, the control unit 102 may select a display item corresponding to the changed gaze direction of the user, and may display a partial area on the selection area in which the display product corresponding to the changed gaze direction is displayed through the guideline 712 . have. Accordingly, as shown in (b) of FIG. 7 , the guideline 712 may be displayed in an area on the show window where other display items are displayed.

Meanwhile, in this state, when a gesture for the display item currently selected by the user is detected, the controller 102 may detect it. In addition, the control unit 102 may display image information 718 related to the currently selected display item on a partial area of the show window based on the detected gesture. For example, the user's gesture may be a user's touch input for a specific region that is distinguished and displayed on the show window. 7 (c) and (d) show such an example.

Meanwhile, in the above description, any one of the display items reflected through the show window is selected according to the user's gaze direction, and the selected display item is selected based on the user's gesture with respect to an area on the show window in which the selected display item is displayed. Although an example in which image information related to is displayed has been described, it goes without saying that a method other than this may be used.

For example, when the selection area is set, the controller 102 may recognize that a specific display item is selected based on a specific gesture of the user rather than a change of the user's gaze direction. That is, the control unit 102 controls the display unit 106 to display a plurality of graphic objects such as cursors on at least a part of the selection area, and based on the user's gesture (for example, touch) on the graphic object, a specific display product. may be recognized as selected.

In this way, when a partial area on the show window is set as a selection area and any one of the displays reflected through the selection area is selected by the user, the user can more precisely select a desired specific display item, and You can check the information on the show window.

Meanwhile, according to the above description, the product information providing apparatus 100 according to an embodiment of the present invention scans an area where other advertisements located around the show window are displayed, and displays the scanned image as image information according to a user's selection. As mentioned above, it can also be displayed on the show window.

FIG. 8 shows an example in which an image related to a specific advertisement is projected on a show window according to a user's selection in the product information providing apparatus according to an embodiment of the present invention in this case.

The product information providing apparatus 100 according to an embodiment of the present invention may recognize that an area in which a specific advertisement is displayed as well as display items displayed in the show window is selected based on the user's gesture. For example, as shown in FIG. 8 , when a user's gesture is detected for a point on the show window where an area in which a specific advertisement is displayed in the show window is detected, the control unit 102 sets the user's gesture as the It may be recognized as for a specific advertisement, and image information related thereto may be displayed on the show window.

For example, when the user's gesture is detected, the controller 102 may detect that the gesture is for a region where a specific advertisement is displayed inside the show window, using an image reflected on the inner surface of the show window. In this case, as shown in FIG. 8 , the controller 102 controls the scanning unit 104 to scan an area 810 in which a specific advertisement corresponding to the user's gesture is displayed, and displays the scanned result as image information 812 . ) may be displayed on at least a partial area of the show window. In this case, the size and location of the scanned result, that is, the scanned image of the area 810 in which the specific advertisement is displayed, may be determined based on the height of the user and the distance between the user and the show window.

On the other hand, when the image information 812 is displayed in a partial area on the show window as described above, the controller 102 can freely change the size or position of the image information 812 displayed. For example, the controller 102 may detect a user's touch on an area on the show window where the image information 812 is displayed, and detect a user's drag gesture input detected following the touch.

In this case, the controller 102 may change the position at which the image information 812 is displayed based on the detected user's drag gesture. The image information 814 displayed in FIG. 8 shows an example in which the position is changed based on the user's drag gesture as described above. Also, likewise, the size of the image information displayed on the show window may also be changed based on a user's gesture.

On the other hand, in FIG. 8 , when an image scanned in an area in which a specific advertisement is displayed is displayed as image information, an example is shown in which the position at which the image information is displayed on the show window and the size of the image information are changed. Needless to say, it is not limited to a case in which image information related to a specific advertisement is displayed. That is, it goes without saying that the size or position of various image information displayed on the show window in relation to a specific display item may also be changed based on the user's gesture input.

Meanwhile, in this case, the controller 102 may change the output state of the image information based on the user's gesture input or further display a graphic object capable of providing various functions on the show window. to be. In this case, the controller 102 may change the size or position of the image information or perform various related functions based on the user's gesture with respect to the graphic objects displayed on the show window.

FIG. 9 shows examples of graphic objects capable of controlling a state in which image information is displayed and functions performed accordingly in the product information providing apparatus according to an embodiment of the present invention.

First, referring to Fig. 9 (a), Fig. 9 (a) shows an example of displaying various graphic objects capable of controlling the state in which image information is displayed in the show window as described above. .

For example, when a user's gesture for selecting a specific display item is detected, the controller 102 may display a plurality of graphic objects 900 , 910 , 912 , 914 corresponding to different functions on the show window. can be displayed. In this case, the controller 102 may control a state in which the image information 920 related to the specific display item is displayed based on the user's gesture with respect to at least one of the graphic objects.

For example, the controller 102 may determine a size at which the image information is displayed on the show window based on the user's gesture with respect to the graphic object 'zoom' 910 . Also, the controller 102 may change the position of the image information 920 displayed on the show window based on a user's gesture with respect to at least one of the cursor-shaped graphic objects 900 .

In addition, the controller 102 may control functions related to display of the image information or recognition of a gesture through the graphic objects. For example, when the user makes a gesture for selecting the graphic object 'gesture' 914 , the controller 102 responds to the user's gesture with other gestures except for the gesture on the graphic object 914 . It is also possible to turn off the function to recognize In this case, the control unit 102 may turn off the function of recognizing the user's gesture until the user selects the graphic object 914 again, a predetermined time elapses, or another user is detected.

Meanwhile, the controller 102 of the product information providing apparatus 100 according to an embodiment of the present invention may transmit the image information to a connectable peripheral device. For example, when the user selects the graphic object 'mms' 912 in FIG. 9A , the controller 102 controls a preset short-range communication means, for example, Bluetooth™, Radio Frequency Identification (RFID). ), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, NFC (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technologies Information corresponding to the image information 920 may be transmitted to a connectable peripheral device using at least one of them.

In this case, as shown in FIG. 9(b), information corresponding to the image information 920 displayed in the show window may be transmitted to the user's mobile terminal 960, and in this case, the user's mobile terminal 960 ), you can also check information related to the display item you have selected.

Meanwhile, in the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. In particular, in the embodiment of the present invention, it has been described assuming that one scanner, that is, the sensing means and the scanning means are configured as one scanner, but the present invention is not limited thereto, and accordingly, the Of course, it is not limited to the embodiment. That is, although the scanner can detect the user's position and user's gesture, it is natural that additional sensing means may be further used to more accurately determine the gesture and the distance.

In addition, in the above-described embodiment of the present invention, for convenience of explanation, it has been described that any one of the plurality of display items is selected by the user's gesture. Of course, at least one image information selected by and related to the selected displays may be displayed on at least a portion of the show window.

Therefore, those of ordinary skill in the art to which the present invention pertains will be able to make various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

Claims (20)

In the show window in which a plurality of products are accommodated,
a scanning unit that scans the show window and a periphery of the show window;
a display unit for projecting image information on at least a portion of the show window; and;
A controller configured to detect a gesture of a user located around the show window based on the scanned result, and control the display unit to display image information related to at least one of the plurality of products on the show window based on the gesture. includes.
The control unit is
controlling the display unit so that at least one graphic object allowing a user to control some operations of the scan unit is displayed on the show window;
When a user's gesture with respect to the preset graphic object is detected, the information is transmitted to the user's mobile terminal.
According to claim 1, wherein the control unit,
controlling the scan unit to scan a specific position inside the show window where information related to any one product corresponding to the gesture among the plurality of products is displayed, and controlling the display unit to project the scanned image A device for providing product information. delete delete delete delete According to claim 1,
The scan unit,
Scan the user's image reflected in the show window,
The control unit is
The device for providing product information, characterized in that by detecting the distance to the user and the user's gesture by using the scanned result.
delete According to claim 1, wherein the control unit,
controlling the display unit so that a selection area for receiving at least one selection from the plurality of products is displayed on the show window;
and controlling the display unit to project image information related to at least one of the products based on a user's gesture detected on the selection area.
10. The method of claim 9, wherein the selection area,
It is formed in at least a portion of the show window so that at least one product accommodated in the show window is reflected,
The apparatus for providing product information, characterized in that, among the reflected products, at least one product corresponding to a user's gesture is displayed to be distinguished from other products.
delete 10. The method of claim 9, wherein the control unit,
Selecting any one of the products visible through the selection area based on the user's gaze direction and controlling the display unit so that the selected product is distinguished from other products,
When a user's gesture with respect to the selected product is detected, the product information providing apparatus according to claim 1, wherein the display unit is controlled to display information related to the selected product on at least a portion of the selection area. delete delete According to claim 1, wherein the graphic object,
The device for providing product information, characterized in that it further comprises a position within the show window scanned by the scan unit and a graphic object related to a zoom-in or zoom-out operation of the scan unit.
delete delete delete According to claim 1,
The scan unit,
scan the show window to further scan the temperature distribution on the show window;
The control unit is
detecting a point where the user's touch is sensed on the show window based on the scanned result, and displaying image information related to at least one of the plurality of products on the show window based on the detected point Characterized product information providing device.
In the show window in which a plurality of products are accommodated,
scanning the show window and its surroundings;
detecting a user's gesture located around the show window based on the scanned result;
receiving a selection from a user of at least one of the plurality of products based on the sensed gesture; and;
Projecting image information related to the at least one selected product on at least a partial area of the show window,
The recall information is
Further comprising a graphic object related to the transmission of image information related to the selected at least one product,
The step of projecting the image information,
and transmitting image information related to the selected at least one product to the user's mobile terminal when the user's gesture with respect to the graphic object is detected.

Images