KR101950504B1 - Method for providing product usage instruction service by identifying product with phone - Google Patents

Abstract

Provided is a method for providing a product usage instruction service by product identification. And the method for providing a product usage instruction service by product identification comprises: a step in which a device to be inspected including a product is connected with a wireless or wired manner and scanned or read; a step of accessing an uploaded address of a usage information content of the product using the identification code of the device being scanned or read; a step of streaming and outputting the usage information content; a step of deriving a photographing means of a user terminal to photograph a user as a photographing object in a direction opposite to the user terminal; and a step of outputting the photographed image in real time on a screen of the user terminal together with the usage information content.

Description

TECHNICAL FIELD [0001] The present invention relates to a method of providing a product using information,

The present invention relates to a method of providing a product use information service through product recognition, and a method of providing a product use information service through product recognition, in which content is streamed by information obtained by scanning the product wirelessly, and a mirror region is arranged on one screen using a camera, Provide a method.

In recent years, the demand for skin beauty products has been continuously increasing due to the improvement of economic level and life span and well-being trend, and the global beauty equipment market is expected to grow steadily. On the other hand, since the existing skin cosmetics market has grown to include functional cosmetics as a product and beauty shops or beauty cosmetics as a service, it has been expensive to spend a lot of time or spend a lot of time, As the demand for consumer products is gradually widening, it is necessary to develop various types of products to meet consumer needs.

In this case, Korean Patent Laid-Open Publication No. 2013-0127713 (published on November 25, 2013), which is a prior art related to this, developed beauty device in cooperation with a smart terminal so that it can be managed and controlled by a smart terminal. It is possible to transmit and receive data by using the connective technology between the skin care device and the smartphone, to control the skin care device by using the smart phone, to transmit the data operated by the skin care device to the smartphone, And an individual usage status and a schedule can be managed through the Internet.

However, unlike functional cosmetics, which have a limited time and space constraints, they have developed a personal skin beauty device that can be used semi-permanently. However, in the process of using by non-specialists, By not knowing how to use properly, it is possible to reduce the effect of using the device, so that the user does not blame himself in the end, but he believes that the device is ineffective. Therefore, the reliability of the manufacturer or distributor There is a problem in that the temperature is rapidly decreased.

In an embodiment of the present invention, a device to be recognized including a product is easily recognized by a user terminal by scanning, photographing, reading, and the like. So that the user can learn the device driving method easily by seeing the user directly driving while watching the explanation video by outputting the method by streaming and outputting the result of photographing the user by driving the camera of the user terminal together A method of providing a product use information service through product recognition can be provided. It should be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

As a technical means for achieving the above technical object, an embodiment of the present invention relates to a method of controlling a device, including a step in which a device to be inspected including a product is wirelessly or wiredly connected and scanned or read, Accessing the use information contents of the product with the uploaded address, streaming and outputting the usage information contents, driving the photographing means of the user terminal, and photographing the user as the photographing object facing the user terminal And outputting the captured image in real time on the screen of the user terminal together with the usage information content.

According to any one of the above-mentioned objects of the present invention, it is possible to allow the user terminal to easily recognize the device to be inspected including the product by scanning, photographing, reading, etc., The method of streaming and outputting the method of driving the product by accessing and driving the camera of the user terminal together and outputting the result of shooting the user together on one screen, And how to use it.

1 is a view for explaining a product use information service providing system through product recognition according to an embodiment of the present invention.
2 is a block diagram illustrating a user terminal included in the system of FIG.
3 is a diagram for explaining an embodiment in which a product use information service through product recognition according to an embodiment of the present invention is implemented.
4 is a diagram illustrating a process in which data is transmitted and received between the components included in the product use information service providing system through the product recognition of FIG. 1 according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a product use information service through product recognition according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

The terms "about "," substantially ", etc. used to the extent that they are used throughout the specification are used in their numerical value or in close proximity to their numerical values when the manufacturing and material tolerances inherent in the stated meanings are presented, Accurate or absolute numbers are used to help prevent unauthorized exploitation by unauthorized intruders of the referenced disclosure. The word " step (or step) "or" step "does not mean" step for. &Quot;

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by a terminal, a device, or a device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed in a terminal, device or device connected to the server.

In this specification, some of the operations or functions described in the mapping or matching with the terminal are used for mapping or matching the unique number of the terminal or the identification information of the individual, which is the identification data of the terminal . ≪ / RTI >

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view for explaining a product use information service providing system through product recognition according to an embodiment of the present invention. Referring to FIG. 1, a product use information service providing system 1 through product recognition may include a user terminal 100, a product use information service providing server 300, and at least one perceived device 400 have. However, since the product use information service providing system 1 through the product recognition of FIG. 1 is only an embodiment of the present invention, the present invention is not limited to FIG.

At this time, the respective components of FIG. 1 are generally connected through a network 200. For example, as shown in FIG. 1, the user terminal 100 may be connected to the product use information service providing server 300 through the network 200. Also, the user terminal 100 may be connected to at least one device 400 through the network 200. [ The product use information service providing server 300 may be connected to the user terminal 100 and at least one device 400 through the network 200. [ The at least one device 400 may be connected to the product use information service providing server 300 or the user terminal 100 through the network 200.

Here, the network means a connection structure in which information can be exchanged between each node such as a plurality of terminals and servers. Examples of such a network include RF, 3rd Generation Partnership Project (3GPP) network, Long Term A Wide Area Network (WAN), a Wireless Local Area Network (WLAN), a Wide Area Network (WAN), and a Wide Area Network (WAN) , A Personal Area Network (PAN), a Bluetooth network, an NFC network, a satellite broadcast network, an analog broadcast network, a DMB (Digital Multimedia Broadcasting) network, and the like.

In the following, the term at least one is defined as a term including the singular and plural, and even though the term " at least one " does not exist, it is to be understood that each constituent may exist singly or plurally, It will be self-evident. It is to be noted that the constituent elements may be provided singularly or plurally in various manners depending on the embodiment.

The user terminal 100 may be a device that scans, reads, or photographs the device 400 to be inspected by using a web page, an application page, a program, or an application related to the product use information service through product recognition and reads the identification code have. The user terminal 100 directly accesses the address mapped to the identification code or transmits the identification code to the product use information service providing server 300, receives the address by the feedback, and accesses the received address Terminal. The user terminal 100 may be a terminal that outputs a content describing usage information of the device 400, and the content may include any one or a combination of images, text, and moving images . In addition, the user terminal 100 can record the result obtained by photographing, in real time, the place where the user terminal 100 is opposed to another area divided from the area where the content is reproduced while streaming and reproducing the content, So as to perform a role of a mirror. When the life of the product is short or the replacement time is short, the user terminal 100 compares the registration time with the registration time at the product use information service providing server 300 or checks the contents or replacement parts, It may be a terminal for outputting and determining whether the user is to purchase or not. If the photographed object can not follow the motion or the process of the description object, that is, if the user can not use the product, such as the product model, the user terminal 100 performs the following operations: backward, Increase, decrease, or decrease the size of the product to adjust the speed or increase or decrease the size so that the user can use the product properly. In this case, when the networking resources or the computing resources of the user terminal 100 do not satisfy the reference value, the operations for comparing the motion of the descriptive object with the motion of the photographed object are performed by the product use information service providing server 300, And transmit the result to the user terminal 100. [ Of course, if the network resource or the computing resource of the user terminal 100 is sufficient to drive the process, the above-described process may be performed in the user terminal 100. [

Here, the user terminal 100 may be implemented as a computer capable of connecting to a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a notebook computer equipped with a web browser (WEB Browser), a desktop, a laptop, and the like. At this time, the user terminal 100 may be implemented as a terminal capable of connecting to a remote server or terminal through a network. The user terminal 100 may be, for example, a wireless communication device with guaranteed portability and mobility, such as a navigation system, a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC) Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wibro (Wireless Broadband Internet) A handheld based wireless communication device such as a smartphone, a smartpad, a tablet PC, and the like.

The product use information service providing server 300 may be a server that provides a product use information service web page, an app page, a program, or an application through product recognition. When the user terminal 100 transmits the identification code (Req) of the device 400 to the user use information service providing server 300, the product use information service providing server 300 provides a response (Ack) And may be a server that allows the terminal 100 to access content describing the product. At this time, the product use information service providing server 300 can map and store the identification code and the address, and when the contents describing the product are changed and the address is changed, the product use information service providing server 300 updates the address to the changed address, Feedback can be provided. When the user-customized service is selected in the user terminal 100, the product-use-information-service providing server 300 analyzes the description object and the shooting object and performs processing such as partial playback speed, repeatability, enlargement or reduction And may be a server that transmits and shares the information to the user terminal 100 in real time. The product use information service providing server 300 analyzes a result of detecting the state of the device 400 by the user terminal 100 to determine the replacement time or the refill time, 100), thereby confirming whether the user is replaced or refilled, and performing ordering and ordering.

Here, the product use information service providing server 300 may be implemented by a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation device, a notebook computer equipped with a web browser (WEB Browser), a desktop, a laptop, and the like.

At least one device 400 to be recognized may be a device that is connected to the user terminal 100 in a wired or wireless manner and is recognized by the user terminal 100 by being read, scanned, or photographed by the user terminal 100. At least one of the devices 400 to be recognized may be an apparatus including an element that is scanned or read by various identification codes such as a tag including an active element or a passive element, a QR code, a bar code, an NFC tag, . The at least one device 400 may be an infrared-related device, a high-frequency device, a galvanic current device, a paradigm current device, an air suction device, an ultrasonic device, or a lifting device. However, It will be appreciated that any device that requires explanation may be included.

The at least one recognized device 400 may include a light stimulating skin care device, an ultrasonic stimulating skin care device, a high frequency stimulation skin care device, a Galvanic potential skin care device, a crystal skin care device and the like. In this case, the light stimulus can be expected to heal skin and regenerate the cells, and ultrasound stimulation can expect micromassage, penetration of essence skin, and activation of metabolism of skin tissue through mechanical vibration of ultrasonic waves. It can be a device that can expect the effect of promoting skin regeneration and blood flow increase due to vibration and heat generated thereby. On the other hand, the galvanic potential of positive (+) polarity on the surface of the skin allows the sebum, waste and the like with anion to be discharged to the surface of the skin, while the galvanic potential of the negative polarity helps the nutritive substance of the anion penetrate into the skin And the crystal beauty device may be a device for removing keratin using minute pieces of natural crystal.

FIG. 2 is a block diagram for explaining a user terminal included in the system of FIG. 1, FIG. 3 is a flowchart illustrating an embodiment of a product use information service through product recognition according to an embodiment of the present invention. FIG.

2, the user terminal 100 includes a reading unit 110, an access unit 120, an output unit 130, a photographing unit 140, a picture providing unit 150, and a customizing unit 160 can do.

A product use information service providing server 300 according to an embodiment of the present invention or another server (not shown) operated in cooperation with the user terminal 100 may receive a product use information service application, a program, an app page, When transmitting a web page or the like, the user terminal 100 can install or open a product use information service application, a program, an app page, a web page, etc. through product recognition. In addition, the service program may be executed in the user terminal 100 by using a script executed in the web browser. Here, a web browser is a program that enables a WWW (World Wide Web) service, and is a program for receiving and displaying hypertext described in hypertext mark-up language (HTML), for example, Netscape (Netscape) An Explorer, chrome, and the like. Further, the application refers to an application on the terminal, for example, an app (app) running on a mobile terminal (smart phone).

Referring to FIG. 2, the reading unit 110 may be connected to the device 400, including the product, wirelessly or by wire to scan or read. For example, the NFC tag can be read wirelessly in the reading unit 110, and as a result, the identification code can be read.

The access unit 120 can access the address where the usage information content of the product is uploaded by using the identification code of the device 400 to be scanned or read. At this time, if the identification code is a shortened URL in which the address to which the usage information content is uploaded is converted, the access unit 120 may access the URL, or if the identification code is a code that simply identifies the product, Transmits the identification code to the information service providing server 300, receives the shortened URL or URL mapped to the identification code in response, and accesses the received URL to allow the usage information content to be streamed.

The output unit 130 can stream the usage information content and output it. At this time, the usage information content can be uploaded in a format having a resolution corresponding to the screen size of the user terminal 100, in which a plurality of formats can be uploaded. Thereafter, when enlargement is performed, the resolution may be changed to a higher format and streamed.

The photographing unit 140 may drive the photographing means of the user terminal 100 to photograph a user who is the photographing object in the direction in which the user terminal 100 faces. At this time, the image to be photographed may be an image of the image taken in the direction in which the user terminal 100 faces in real time on the screen of the user terminal 100.

At this time, the user terminal 100 can estimate and output the pore region, pigment deposit region, skin roughness degree through the captured image. First, the pore region belongs to the dark region along with the point and hair regions in the skin image distribution. The skin image binarization technique can be used for estimating the pore region. The noise is removed using a morphology technique in the pore candidate region estimated by binarization, and then the final pore region is estimated. The size of the pores, and the number of pores. Second, the estimation of the pigment deposition area indicates a region where the pigment is abnormally deposited at a specific site and appears to be different from the basic skin color. Since the pigmentation deposition often exhibits a higher saturation component than the basic skin color, By estimating and quantifying the size and extent of the area, it is possible to estimate the extent to which the pigment is deposited according to the size of the chroma component after performing the binarization technique like the pore. Finally, skin roughness is one of the important features that indicate the condition of skin. For skin roughness estimation, it is possible to use the distribution of skin area excluding pore area and pigment deposition area. The greater the degree of change in the skin distribution, the rougher the skin can be assumed, and the roughness can be estimated as smoothness and entropy. The estimated information can be overlaid on the area (mirror area) where the user's face is displayed, and the position and the information can be displayed on the face together to know which part the user should focus on.

The screen providing unit 150 can output the captured image in real time on the screen of the user terminal 100 at the same time as the usage information contents. At this time, the usage information contents and the images to be photographed may be output to the respective areas where the screen of the user terminal 100 is divided. In addition, the usage information content and the image to be photographed can be output to the respective regions of the user terminal 100 divided into two horizontally or vertically.

At this time, the user terminal 100 may be a smart mirror. When the smart terminal is implemented as a smart mirror, the usage information contents are output on the smart mirror, and the image taken by the user acts as a mirror itself It is possible. At this time, it is possible to divide the area by not using the user so that the user can view the process of using the product as a mirror, but outputting the usage information contents in the sight of the user. For example, if the image is a video describing the process of proceeding with how the product is a dye and how the usage information content is dyed, a location where the user's face and hair, etc., It should be able to be placed in the upper, lower, left, and right centered on the illuminated part. Alternatively, it is also possible to allow the user to follow the contents by outputting the usage information contents on a mirror in which the face of the user is illuminated in a lay-over manner, and various embodiments are possible.

At this time, the user terminal 100 and the device to be recognized 400 may be connected by any one or combination of NFC, RFID, and Bluetooth. In addition to this, beacon or Internet (IoT), etc., long distance wireless communication or wired communication will be possible.

The customizing unit 160 outputs the image captured by the screen providing unit 150 to the screen of the user terminal 100 in real time simultaneously with the usage information content and then displays the description object included in the usage information content, The direction and speed at which the shooting object included in one shooting content is moved, and the playback speed of the description object is increased or decreased or backwardly played based on the shooting object, and the size of the description object is increased or decreased . That is, the object of the streamed content and the shot object as the user are synchronized, and the reference can be based on the user.

For example, the explanatory model describes a process in which a description object drives the device -> rubbing the eyes. It is assumed that the user, the shooting object, has not turned on the device yet. At this time, since the device of the shooting object is not turned on, the device is rewound to drive the device. In addition, the explanation object, the massage method of rubbing the mouth, rotates 360 degrees while rotating 10 times in the rightward direction. If the user has only 5 times, it repeats the corresponding section until 10 times, or slowly The description object, that is, the streaming image, can be stopped or repeated. In addition, a description method of massage the eyes with the explanation object has been described. However, when the user is close to the eyes, the size of the shooting object may become large. At this time, if a region corresponding to the shooting object of the explanatory object, for example, the eyes of the shooting object, is enlarged, the eye portion of the shooting object can be detected and enlarged and reproduced. In this case, since the image may not be broken even if the high resolution format is streamed, the high resolution format can be automatically adjusted in the case of enlargement, and in the opposite case, the low resolution format can be automatically adjusted.

In this case, in order to observe the situation change that requires a long time, it is necessary to recognize the object and compare the previous image with the previous image, Jeffrey E technique for tracking the position of an object to be recognized in the background, and filtering the image that affects the background by the association between the background and the entire screen, and recognizing the objects according to the time, The Andrea Prati technique that distinguishes the same object, and the intelligent image detection method that sets up a variety of event types that can occur in images due to frequent appearances of various objects and models of event types can be used. At this time, performance of automatic image detection can be improved by using object recognition, learning recognition system and fluid approximation algorithm. In addition, it is most important to observe moving objects (objects) effectively, and to measure the frequency and change in time of setting objects. The changes are measured in terms of location, size, velocity in the image, and movement path. Variables that can be obtained through object recognition can be seen in terms of location, size, speed, and direction, and these values are independent or dependent on each variable. Each change amount can be monitored and compared with values over time. However, the present invention is not limited to the above-described method, and it will be obvious that various techniques can be used as long as the object can be detected from the image and the position and motion thereof can be extracted.

Hereinafter, an operation process according to the configuration of the product use information service providing server of FIG. 2 will be described in detail with reference to FIG. It should be apparent, however, that the embodiments are only examples of the various embodiments of the present invention.

Referring to FIG. 3, (a) the user terminal 100 reads out the identification code of the device 400 to be perceived after interlocking, reading, scanning or photographing the device 400 to be perceived wirelessly or wired , and (b) accesses the address mapped with the identification code to divide the screen, thereby streaming and reproducing usage description contents for product description. (C) The user terminal 100 photographs a user with a photographing means and outputs a result of photographing a user's face or the like in a non-reproduced area in real time to perform a mirror function.

(d) if the user does not follow the user correctly, he or she can customize the content of the usage description in the course of the user so that the user can correctly perform or understand the explanation process, and (e) To match the content. (F) When the user terminal 100 detects the replacement cycle or the contents should be refilled as a result of monitoring the device 400, the product use information service providing server 300 transmits the product usage information to the product use information service providing server 300 through the order payment interface. Or you can order it with the server that is connected to it.

2 and 3, a description of the method of providing the product use information service through the product recognition is the same as the description of the method of providing the product use information service through product recognition, And therefore, the following description will be omitted.

4 is a diagram illustrating a process in which data is transmitted and received between the components included in the product use information service providing system through the product recognition of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process of transmitting and receiving data between the respective components will be described with reference to FIG. 4. However, the present invention is not limited to such an embodiment, It is apparent to those skilled in the art that the process of transmitting and receiving data can be changed.

Referring to FIG. 4, the user terminal 100 may scan, read or photograph the device 400 (S4100), read the information (S4200), and directly or indirectly use the product use information service providing server (S4330, S4400), and accesses the uploaded address of the product use information content (S4500).

Then, the user terminal 100 displays the usage information content on the screen (S4600). When the mirror function is selected (S4610), the user terminal 100 drives the shooting means (S4620) One side uses the usage information contents and the other side outputs the mirror, that is, the image taken by the user in real time (S4630).

In addition, if the user-customized service is selected (S4700), the user terminal 100 increases / decreases the speed, size, etc. of the descriptive object based on the captured object and outputs it (S4710). On the other hand, the user terminal 100 recognizes the replacement cycle of the device 400 (S4800), receives feedback (S4810), transmits a feedback notification event to the product use information service providing server 300 (S4830 ), And performs an order or settlement by receiving an interface for ordering (S4850).

The order between the above-described steps S4100 to S4850 is only an example, but is not limited thereto. That is, the order among the above-described steps S4100 to S4850 may be mutually varied, and some of the steps may be executed or deleted at the same time.

4, a description of the method of providing the product use information service through the product recognition is the same as the description of the method of providing the product use information service through product recognition, And therefore, the following description will be omitted.

5 is a flowchart illustrating a method of providing a product use information service through product recognition according to an exemplary embodiment of the present invention. Referring to FIG. 5, the user terminal may scan or read the connected device by wireless or wire connection (S5100), and use the identification code of the scanned or read device to be used And accesses the uploaded address (S5200).

In addition, the user terminal streams the usage information content (S5300) and drives the image capturing means of the user terminal (S5400) to capture the user who is the image capturing object in the direction facing the user terminal.

At this time, the user terminal outputs the captured image in real time on the screen of the user terminal together with the usage information contents (S5500).

5, a description of the method of providing the product use information service through the product recognition is the same as the description of the method of providing the product use information service through product recognition, And therefore, the following description will be omitted.

The method of providing a product use information service through product recognition according to the embodiment described with reference to FIG. 5 may also be implemented in the form of a recording medium including an application executed by a computer or a command executable by a computer such as a program module . Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer readable medium may include both computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The method of providing a product use information service through product recognition according to an embodiment of the present invention may be applied to an application installed basically in a terminal (which may include a program included in a platform or an operating system basically installed in the terminal) And may be executed by an application (that is, a program) directly installed on a master terminal by a user via an application providing server such as an application store server, an application, or a web server associated with the service. In this regard, the method of providing a product use information service through product recognition according to an embodiment of the present invention is implemented in an application installed in a terminal or directly installed by a user (i.e., a program) Lt; RTI ID = 0.0 > readable < / RTI >

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

Claims (7)

A product use information service providing method executed by a user terminal,
A step in which the device to be inspected including the product is connected or scanned or read by wireless or wired connection;
Accessing an address at which the usage information content of the product is uploaded using the identification code of the device being scanned or read;
Streaming the usage information content and outputting the usage information content;
Driving a photographing means of the user terminal to photograph a user as a photographing object in a direction opposite to the user terminal;
Outputting the captured image in real time on the screen of the user terminal simultaneously with the usage information contents;
Determining a direction and a speed at which the descriptive object included in the usage information content and the shooting object included in the photographed content photographed by the user move;
Increasing or decreasing the playback speed of the explanatory object based on the shooting object, or playing back or forward the object; And
Increasing or decreasing the size of the descriptive object based on the size of the photographing object;
The method comprising the steps of:
The method according to claim 1,
Wherein the usage information content and the image to be photographed are output to respective areas of the screen of the user terminal.
The method according to claim 1,
Wherein the usage information content and the photographed image are output to respective areas divided into left and right or upper and lower portions of the screen of the user terminal.
The method according to claim 1,
Wherein the image to be photographed is a video image of a direction in which the user terminal is opposed to the user terminal, the image being output in real time to the screen of the user terminal.
The method according to claim 1,
Wherein the user terminal is a smart mirror.
The method according to claim 1,
Wherein the user terminal and the device to be recognized are connected by a combination of one or any combination of NFC, RFID, and Bluetooth.
delete

Images