KR102188929B1 - Display device, method and server for providing augmented reality, virtual reality or mixed reality contents - Google Patents

Abstract

A display device that provides augmented reality, virtual reality or mixed reality content related to a product includes a first photographing unit for photographing a product through a first camera provided in the display device, and a user through a second camera provided in the display device. A second photographing unit for photographing a face of a person, a measurement unit for measuring the angle of the display device, a transmission unit for transmitting information on the photographed product and information on the photographed user's face to a server, and analysis from the server A receiving unit for receiving recognition information related to at least one of information on the product and information on the user's face, and an output unit for outputting content related to the recognition information, wherein the output unit is the measured angle of the display device The output position of the content is adjusted based on.

Description

A display device, method, and server that provides augmented reality, virtual reality, or mixed reality content {DISPLAY DEVICE, METHOD AND SERVER FOR PROVIDING AUGMENTED REALITY, VIRTUAL REALITY OR MIXED REALITY CONTENTS}

The present invention relates to a display device, a method, and a server for providing augmented reality, virtual reality or mixed reality content.

Augmented Reality (AR) refers to a technology that displays a single image by superimposing a 3D virtual image on a real image or background. Augmented reality has the advantage of providing a user with better realism and additional information than the real environment by providing a mixed image of reality and virtual.

In relation to such augmented reality service, Korean Patent Publication No. 2017-0054146, which is a prior art, discloses a method of providing an augmented reality.

Recently, various services using augmented reality have been provided. However, these conventional services need to use a smartphone or a head mounted display (HMD).

That is, there are not many commercialized services as conventional services require a smart phone or HMD.

Augmented reality, virtual reality, or mixed reality content related to the product that allows users to intuitively grasp the appearance and detailed information of the product by photographing the product and outputting the product-related content in augmented reality, virtual reality or mixed reality. It is intended to provide a display device, a method, and a server to be provided.

Augmented reality, virtual reality, or mixed reality content related to a product that recognizes the user by photographing the user's face and determines and provides the optimal content to be provided to the user using the recognized user information among a plurality of content related to the product It is an object to provide a display device, a method, and a server providing a.

Augmented reality, virtual reality, or mixed reality content related to a product in which the angle of the display device is adjusted based on the user's gaze and the output position of the content is adjusted so that the user can view the content according to the adjusted angle of the display device. It is intended to provide a display device, a method, and a server to be provided.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention provides a first photographing unit for photographing a product through a first camera provided in a display device, and a user through a second camera provided in the display device. A second photographing unit for photographing a face of a person, a measurement unit for measuring the angle of the display device, a transmission unit for transmitting information on the photographed product and information on the photographed user's face to a server, and analysis from the server A receiving unit for receiving recognition information related to at least one of information on the product and information on the user's face, and an output unit for outputting content related to the recognition information, wherein the output unit is the measured angle of the display device It is possible to provide a display device that adjusts the output position of the content based on the display.

In another embodiment of the present invention, photographing a product through a first camera provided in a display device, photographing a user's face through a second camera provided in the display device, and measuring an angle of the display device The step of, transmitting information on the photographed product and information on the photographed user's face to a server, related to at least one of information on the product analyzed from the server and information on the user's face Receiving recognition information and outputting content related to the recognition information, wherein the outputting of the content comprises adjusting an output position of the content based on the measured angle of the display device. Can provide a way.

Another embodiment of the present invention, another embodiment of the present invention, a receiving unit for receiving information about the product and the face of the user photographed by the display device from the display device, the received product An analysis unit that analyzes information and information on the user's face, extracts product recognition information based on the analyzed product information, and extracts user recognition information based on the analyzed information on the user's face Unit, and a transmission unit for transmitting recognition information including the extracted product recognition information and user recognition information to the display device, wherein content related to the product is output from the display device based on the recognition information, and the content May provide a server wherein the output position is adjusted based on the angle of the display device measured by the display device.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, by photographing a product and outputting the content related to the product as augmented reality, the augmented reality related to the product allows the user to intuitively grasp the appearance and detailed information about the product. , A display device, a method, and a server for providing virtual reality or mixed reality content may be provided.

Augmented reality, virtual reality, or mixed reality content related to a product that recognizes the user by photographing the user's face and determines and provides the optimal content to be provided to the user using the recognized user information among a plurality of content related to the product It is possible to provide a display device, a method, and a server providing a.

Augmented reality, virtual reality, or mixed reality content related to a product in which the angle of the display device is adjusted based on the user's gaze and the output position of the content is adjusted so that the user can view the content according to the adjusted angle of the display device. A display device, a method, and a server may be provided.

It is possible to provide a display device and a method for providing content related to a product that provides content corresponding to a content scenario according to the state of the product.

1 is a block diagram of a content providing system according to an embodiment of the present invention.
2A and 2B are exemplary views showing a display device according to an exemplary embodiment of the present invention.
3 is a configuration diagram of a display device according to an embodiment of the present invention.
4A to 4E are exemplary diagrams for explaining a process of providing content related to a product in a display device according to an embodiment of the present invention.
5 is a flowchart of a method of providing content related to a product in a display device according to an embodiment of the present invention.
6 is a configuration diagram of a server according to an embodiment of the present invention.
7 is a flowchart of a method of providing content related to a product from a display device in a server according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, or two or more units may be realized using one hardware.

In the present specification, some of the operations or functions described as being performed by the terminal or device may be performed instead by a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal or device connected to the server.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a content providing system according to an embodiment of the present invention. Referring to FIG. 1, the content providing system 1 may include a display device 110 and a server 120. The display device 110 and the server 120 exemplarily show components that can be controlled by the content providing system 1.

Each component of the content providing system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1, the display device 110 may be connected to the server 120 at the same time or at a time interval.

A network refers to a connection structure that enables information exchange between nodes such as terminals and servers, and is a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired/wireless data communication networks, telephone networks, wired/wireless television networks, etc. Examples of wireless data networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, and ultrasound. Communication, Visible Light Communication (VLC), LiFi, etc. are included, but are not limited thereto.

The display device 110 may photograph the product 100 through the first camera 111 provided in the display device 110.

The display device 110 may capture a user's face through the second camera 112 provided in the display device 110.

The display device 110 may measure the angle of the display device 110.

The display device 110 may transmit information on the photographed product 100 and information on the photographed user's face to the server 120.

The display device 110 may receive recognition information related to information on the product 100 analyzed from the server 120 and information on a user's face. Here, the recognition information may include user recognition information including member information, past purchase history, preference products and preference information, and product recognition information including an identifier of the product 100.

The display device 110 may determine content to be output based on user recognition information and product recognition information. For example, the display device 110 may determine an optimal content based on a past purchase history, a preference product, and preference information among a plurality of contents for the product 100.

The display device 110 may change content to be output as the state of the product 100 changes.

The display device 110 may output content related to recognition information. In this case, the display device 110 may adjust the output position of the content based on the measured angle of the display device 110. For example, the display device 110 may adjust the output position of the content based on the measured angle of the display device 110 and the position of the user derived from the image of the user's face photographed from the second photographing unit 112. I can.

The display device 110 may receive a touch command or a voice command from a user for displayed content.

The display device 110 may store various contents for each product through a database. Various contents may include, for example, contents for promotions, contents for advertisements, contents for functions, and augmented reality contents.

Such a display device 110 is located in front of a plurality of products on a display stand on which a plurality of products are displayed, and moves forward of any one of the plurality of products through a moving mechanism provided in the display device 110 on the rail 130. Can be moved.

The server 120 may receive information on a photographed product and information on a photographed user's face from the display device 110.

The server 120 may extract related recognition information by analyzing the received product information and the user's face information. Here, the recognition information may include member information, past purchase history, user recognition information including preferred products and preference information, and product recognition information including an identifier of a product.

The server 120 may transmit the extracted recognition information to the display device 110.

2A and 2B are exemplary views showing a display device according to an exemplary embodiment of the present invention. Here, the display device 110 is located in front of the plurality of products on a display stand on which the plurality of products are displayed.

2A is a front view of a display device according to an embodiment of the present invention. Referring to FIG. 2A, the display device 110 may include a first camera 111, a second camera 112, a display module 113, a microphone 114, and a moving mechanism 115.

The first camera 111 is provided on the rear side of the display apparatus 110 to take pictures of the product 100 located at the rear of the display apparatus 110.

The second camera 112 is provided on the front side of the display device 110 to capture a face of a user viewing the display device 110.

The display module 113 may output content related to the product 100 through a display panel.

The display module 113 is equipped with a touch sensor and may receive a touch input for content output from a user.

The microphone 114 may receive a voice input for content output from a user.

The moving mechanism 115 may cause the display device 110 to move to the front of any one of a plurality of products. For example, the display device 110 may be moved to the front of any one of a plurality of products by a user through the moving mechanism 115 on the rail 130.

2B is a side view of a display device according to an embodiment of the present invention. 2A and 2B, the display device 110 may further include a hinge 116. Here, the hinge 116 may be an electronic or mechanical hinge.

The hinge 116 may allow the inclination of the display device 110 to be manually or automatically adjusted. This is because the user's gaze angle is also changed according to the height difference for each user, so that the inclination of the display device 110 is manually or automatically adjusted through the hinge 116 so that the user's gaze is in front of the display device 110 It is to be able to take a look.

For example, when the inclination of the display device 110 corresponds to a first angle (eg, 0°), the user's gaze through the hinge 116 gazes at the front of the display device 110 The inclination of the display device 110 may be adjusted 117 to a second angle (eg, 60°) so as to be appropriate.

3 is a configuration diagram of a display device according to an embodiment of the present invention. Referring to FIG. 3, the display device 110 includes a first photographing unit 310, a second photographing unit 320, a measuring unit 330, a transmission unit 340, a receiving unit 350, and a content determining unit 360. ), an output unit 370, an input unit 380, and a database 390.

The first photographing unit 310 may photograph the product 100 through the first camera 111 provided in the display device 110. Here, the first camera 111 is installed on the rear side of the display device 110, and the first photographing unit 310 is the first camera 111 installed on the rear side of the display device 110 You can shoot the front.

The second photographing unit 320 may photograph a user's face through the second camera 112 provided in the display device 110. Here, the second camera 112 is installed in front of the display device 110, and the second photographing unit 320 is capable of photographing the user's face through the second camera 112 installed in front of the display device 110. I can.

The measurement unit 330 may measure the angle of the display device 110. For example, the measurement unit 330 may measure the angle of the display device 110 after adjusting the tilt so that the screen of the display device 110 corresponds to the user's gaze. Here, the angle of the display device 110 may mean an angle formed between the display rack and the display panel of the display device 110.

The measurement unit 330 may measure the angle of the display device 110 based on a position where the display panel is supported by the hinge 116 (see FIG. 2 ).

The transmission unit 340 may transmit information on the photographed product and information on the photographed user's face to the server 120. Here, the information on the photographed product and the information on the photographed user's face may be a product image and a face image.

The receiving unit 350 may receive recognition information related to at least one of information on the product 100 analyzed from the server 120 and information on a user's face. Here, the recognition information may include user recognition information including member information, past purchase history, preference products and preference information, and product recognition information including an identifier of the product 100.

The content determination unit 360 may determine content to be output based on user recognition information and product recognition information.

For example, the content determination unit 360 may determine an optimal content based on a past purchase history, a preferred product, and preferred information (eg, preferred color, preferred design, etc.) among a plurality of contents for the product 100. have.

For example, the content determination unit 360 may change the content to be output as the state of the product 100 changes. Here, the change in the state of the product 100 may include a change in the shape of the product 100, a change in function, and the like.

For example, when the door provided in the product 100 is closed (for example, when the user does not open the product 100), the content determination unit 360 determines the content related to the appearance or basic function of the product 100 It can be determined as the optimal content. On the other hand, when the door provided in the product 100 is opened (for example, when the user opens the product 100), the content determination unit 360 may perform the internal configuration, operation process, and internal functions of the product 100. Related content can be determined as the optimal content.

The output unit 370 may output content related to recognition information. In this case, the output unit 370 may adjust the output position of the content based on the measured angle of the display device 110.

For example, the output unit 370 determines the output position of the content based on the measured angle of the display device 110 and the user's viewing position derived from the image of the user's face photographed from the second photographing unit 112. Can be adjusted.

That is, the display device 110 derives the user's viewing position (including the user's gaze angle) from the image of the user's face photographed by the second photographing unit 112, and the angle of the display device 110 and the user The output position of the content can be adjusted in consideration of the viewing position of.

This is to ensure that the content is output at a location corresponding to each user's gaze by adjusting the output position of the content so that it is suitable for the user's viewing of the content in consideration of the gaze angle of each user, since there is a difference in height for each user. . In particular, as will be described later, since the content of the present invention includes augmented reality content, in determining the output position of the augmented reality content displayed on the product 100 projected on the display device 110, the user's gaze angle is It must be considered.

The input unit 380 may receive a touch command or a voice command from a user for the displayed content. For example, the input unit 380 may receive a touch command for the displayed content from a user through a touch sensor provided in the display. For another example, the input unit 380 may receive a voice command for displayed content from a user through a microphone. Here, the touch command or voice command may include a next operation command according to a content scenario, a command for explaining each detailed function of the product 100, an advertisement or promotion output command, and the like.

The database 390 may store various contents for each product. Various contents include, for example, contents for promotions, contents for advertisements, contents for functions, and the like, and such various contents may be expressed as augmented reality, virtual reality, or mixed reality contents. This may provide an advantage that a user can intuitively check information related to a product by providing content related to a product through augmented reality, virtual reality or mixed reality content.

4A to 4E are exemplary diagrams for explaining a process of providing content related to a product in a display device according to an embodiment of the present invention.

4A is an exemplary diagram for explaining a process of recommending a product model based on user recognition information in a display device according to an embodiment of the present invention. Referring to FIG. 4A, when only the user's face is photographed without photographing a product through a camera provided in the display device 110, the display device 110 includes content related to user recognition information (eg, recommended product, recommendation Model, etc.) can be printed. The user recognition information may include, for example, a member number, past purchase history, preferred products and preferred information.

The display device 110 may output content to the display device 110 based on user recognition information. For example, the display device 110 outputs user information in the first area 400 of the screen, outputs a chat window in the second area 410 of the screen, and related content in the third area 420 of the screen. Can be printed. User information such as age, purchased products, and products of interest may be output in the first area 400. A chat window capable of chatting between the chatbot and the user may be displayed in the second area 410. For example, if the chatbot asks a question "What product are you looking for" and then the user responds with "Recommended rice cooker", the chatbot can provide a message saying "I will recommend you as shown on the right." A recommendation model related to a product desired by the user (eg, a model of a user's preferred color) may be output in the third area 420.

4B to 4E are exemplary views in which promotional content related to a product is output from a display device according to an embodiment of the present invention.

The display device 110 may output content related to the product 100. For example, the display device 110 is located in front of a plurality of products on a display stand in which a plurality of products are displayed on the rail 130, and is placed on the rail 130 by a user through a moving mechanism provided in the display device. An augmented reality, virtual reality, or mixed reality content related to the product 100 that is moved to the front of any one of the products and photographed at the moved location may be output. For another example, the display device 110 may output augmented reality, virtual reality, or mixed reality content related to the model selected by the user from the recommended model output in FIG. 4A.

Hereinafter, a description will be given of a case in which the display device 110 outputs content related to recognition information on the product and the user's face by photographing the product and the user's face through a camera.

Referring to FIG. 4B, the display device 110 may output content related to the appearance of a product. For example, the display device 110 may output augmented reality, virtual reality, or mixed reality content related to the product 100. For example, the display device 110 may rotate and output the exterior of the product 100 by 360 degrees so that the user can check the exterior of the product.

Referring to FIG. 4C, the display device 110 may output augmented reality, virtual reality, or mixed reality content related to a product function. For example, the display device 110 may receive an output of content related to a function of the product 100 from a user through a touch command or a voice command and output augmented reality, virtual reality, or mixed reality content related to the function. . The function may include, for example, a model name, size, weight, power consumption, capacity, etc. of the product 100.

Referring to FIG. 4D, the display device 110 receives an output of content related to the internal configuration of the product 100 through a touch command or a voice command from a user and displays augmented reality, virtual reality, or mixed reality content related to the internal configuration. Can be printed. In contrast, when the user controls the product 100 (eg, when the product 100 is opened), the display device 110 may output augmented reality, virtual reality, or mixed reality content related to the internal configuration. .

Referring to FIG. 4E, the display device 110 receives an output of content related to the operation of the product 100 from a user through a touch command or a voice command and outputs augmented reality, virtual reality, or mixed reality content related to the operation. I can. For example, when a product photographed through the display device 110 is a rice cooker, the display device 110 may output augmented reality, virtual reality, or mixed reality content related to the operation of the rice cooker.

5 is a flowchart of a method of providing augmented reality, virtual reality, or mixed reality content related to a product in a display device according to an embodiment of the present invention. A method of providing augmented reality, virtual reality, or mixed reality content related to a product in the display device 110 shown in FIG. 5 is time-series by the content providing system 1 according to the embodiment shown in FIGS. 1 to 4E. It includes steps that are processed as. Therefore, even if omitted below, it is also applied to a method of providing augmented reality, virtual reality, or mixed reality content related to a product in the display device 110 according to the exemplary embodiment illustrated in FIGS. 1 to 4E.

In operation S510, the display device 110 may take a picture of the product 100 through the first camera 111 provided in the display device 110.

In operation S520, the display device 110 may capture a user's face through the second camera 112 provided in the display device 110.

In step S530, the display device 110 may measure the angle of the display device 110.

In operation S540, the display device 110 may transmit information on the photographed product and information on the photographed user's face to the server 120.

In operation S550, the display device 110 may receive recognition information related to at least one of information on the analyzed product 100 and information on the user's face from the server 120.

In step S560, the display device 110 may output content related to the recognition information. In this case, the content includes augmented reality, virtual reality, or mixed reality content, and the display device 110 may adjust the output position of the content based on the measured angle of the display device 110.

In the above description, steps S510 to S560 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be switched.

6 is a configuration diagram of a server according to an embodiment of the present invention. Referring to FIG. 6, the server 120 may include a reception unit 610, an analysis unit 620, an extraction unit 630, and a transmission unit 640.

The receiving unit 610 may receive information on the product 100 photographed by the display device 110 and information on the user's face from the display device 110.

The analysis unit 620 may analyze information on the received product 100 and information on a user's face. For example, the analysis unit 620 may analyze the outline, color, etc. of the product 100 on the basis of the received information on the product 100. For another example, the analysis unit 620 may analyze the user's facial feature points based on the received information on the user's face.

The extraction unit 630 may extract product recognition information based on the analyzed product information, and extract user recognition information based on the analyzed user's face information.

The transmission unit 640 may transmit recognition information including the extracted product recognition information and user recognition information to the display device 110.

7 is a flowchart of a method for providing augmented reality, virtual reality, or mixed reality content related to a product in a display device in a server according to an embodiment of the present invention. A method of providing augmented reality, virtual reality, or mixed reality content related to a product in the server 120 shown in FIG. 7 is time-series by the content providing system 1 according to the embodiment shown in FIGS. 1 to 6. It includes the steps to be processed. Therefore, even if omitted below, it is also applied to a method of providing augmented reality, virtual reality, or mixed reality content related to a product in the server 120 according to the embodiment illustrated in FIGS. 1 to 6.

In step S710, the server 120 may receive information on a product photographed by the display device 110 and information on a user's face from the display device 110.

In step S720, the server 120 may analyze information on the received product and information on the user's face.

In step S730, the server 120 may extract product recognition information based on the analyzed product information, and extract user recognition information based on the analyzed user's face information.

In step S740, the server 120 may transmit recognition information including the extracted product recognition information and user recognition information to the display device 110.

In the above description, steps S710 to S740 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be switched.

A method of providing augmented reality, virtual reality, or mixed reality content related to a product in a display device and a server described through FIGS. 1 to 7 includes a computer program stored in a medium executed by a computer or instructions executable by a computer It can also be implemented in the form of a recording medium. In addition, the method of providing augmented reality, virtual reality or mixed reality content related to a product in a display device and a server described through FIGS. 1 to 7 may be implemented in the form of a computer program stored in a medium executed by a computer. have.

Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include a computer storage medium. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: commodity
110: display device
111: first camera
112: second camera
113: display module
114: microphone
115: movement mechanism
116: hinge
120: server
130: rail
310: first photographing unit
320: second photographing unit
330: measuring unit
340: transmission unit
350: receiver
360: content decision unit
370: output
380: input
390: database

Claims (20)

In a display device for providing content related to a product,
A first photographing unit for photographing a product through a first camera provided in the display device;
A second photographing unit for photographing a user's face through a second camera provided in the display device;
A measuring unit measuring an angle of the display device;
A transmission unit for transmitting information on the photographed product and information on the photographed user's face to a server;
A receiver configured to receive recognition information related to at least one of information on the product and information on the user's face analyzed from the server; And
Including an output unit for outputting the content related to the recognition information,
The output unit adjusts the output position of the content based on the measured angle of the display device,
The display device is located in front of the plurality of products on a display stand on which a plurality of products are displayed,
The display device includes a moving mechanism for moving the display device to the front of any one of the plurality of products,
When the display device is moved to the front of any one of the plurality of products through the moving mechanism, the receiving unit includes product recognition information including an identifier of a specific product photographed from the server at a location where the display device is moved, and Receiving user recognition information including the user's preference information,
The output unit outputs the optimal content determined based on the user's preference information among a plurality of contents related to the specific product determined based on the identifier of the specific product.
The method of claim 1,
The user recognition information further includes at least one of member information of the user, a past purchase history, and a preferred product.
The method of claim 2,
The display device further comprising a content determination unit that determines content to be output based on the user recognition information and the product recognition information.
The method of claim 3,
The content determination unit further determines the optimal content by further considering at least one of the past purchase history and the preferred product among a plurality of contents for the product.
The method of claim 1,
Each product further includes a database storing various contents,
The various contents include at least one of contents for promotion, contents for advertisement, and contents for function.
The method of claim 5,
The various contents will include augmented reality, virtual reality, or mixed reality contents.
The method of claim 3,
The content determination unit is to change the content to be output according to the state of the product is changed.
The method of claim 1,
The display device further comprising an input unit receiving at least one of a touch command or a voice command from a user for the output content.
delete The method of claim 1,
The output unit adjusts the output position of the content based on the measured angle of the display device and the position of the user derived from the image of the user's face photographed by the second photographing unit.
In a method of providing content related to a product in a display device,
Photographing a product through a first camera provided in the display device;
Capturing a user's face through a second camera provided in the display device;
Measuring an angle of the display device;
Transmitting information on the photographed product and information on the photographed user's face to a server;
Receiving recognition information related to at least one of information on the product and information on the user's face analyzed from the server; And
Including the step of outputting the content related to the recognition information,
The step of outputting the content is adjusting the output position of the content based on the measured angle of the display device,
The display device is located in front of the plurality of products on a display stand on which a plurality of products are displayed,
The display device includes a moving mechanism for moving the display device to the front of any one of the plurality of products,
Receiving the recognition information,
When the display device is moved to the front of any one of the plurality of products through the moving mechanism, product identification information including an identifier of a specific product photographed at a location where the display device is moved from the server, and the user's Receiving user recognition information including preference information,
The step of outputting the content,
And outputting an optimal content determined based on preference information of the user among a plurality of contents related to the specific product determined based on the identifier of the specific product.
The method of claim 11,
The user recognition information further includes at least one of member information of the user, a past purchase history, and a preferred product.
The method of claim 12,
And determining the content to be output based on the user recognition information and the product recognition information.
The method of claim 13,
The determining of the content further comprises determining the optimal content by further considering at least one of the past purchase history and the preferred product among a plurality of contents for the product.
The method of claim 11,
Various contents are stored for each product in the database,
The various contents include at least one of contents for promotion, contents for advertisement, and contents for function.
The method of claim 15,
The various contents will include augmented reality, virtual reality or mixed reality contents.
The method of claim 13,
The determining of the content includes changing the content to be output as the state of the product changes.
The method of claim 11,
The content providing method further comprising receiving at least one of a touch command or a voice command from a user for the output content.
The method of claim 11,
The outputting of the content includes adjusting the output position of the content based on the measured angle of the display device and the location of the user derived from the image of the user's face taken from the second photographing unit, How to provide content.
In a server that provides content related to a product,
A receiving unit configured to receive information on a product photographed by the display device and information on a user's face from a display device;
An analysis unit for analyzing information on the received product and information on a user's face;
An extraction unit for extracting product recognition information based on the analyzed product information, and extracting user recognition information based on the analyzed user's face information;
Including a transmission unit for transmitting recognition information including the extracted product recognition information and user recognition information to the display device,
Content related to the product is output from the display device based on the recognition information,
The content is output position is adjusted based on the angle of the display device measured by the display device,
The display device is located in front of the plurality of products on a display stand on which a plurality of products are displayed,
The display device includes a moving mechanism for moving the display device to the front of any one of the plurality of products,
When the display device is moved to the front of any one of the plurality of products through the moving mechanism, the transmission unit includes product identification information including an identifier of a specific product photographed at the position where the display device is moved, and the user's Transmitting user recognition information including preference information to the display device,
The server, wherein the optimal content determined based on the user's preference information among a plurality of contents related to the specific product determined based on the identifier of the specific product is output from the display device.

Images