KR20220025359A - Providing method of augmented reality in jewerly and system performing the method - Google Patents

Abstract

According to one aspect of the present invention, a method for providing augmented reality including a user terminal connected to an Internet network and a server for storing data related to a jewelry, comprises the steps of: transmitting, by a user terminal, first photo data obtained by photographing a jewelry to a server; recognizing, by the server, the first photo data, matching at least one of price information, metal content information, and related brand information on the jewelry on the basis of the recognized first photo data, and transmitting first augmented reality data to the user terminal; displaying, by the user terminal, the first augmented reality data together with the first photo data, and transmitting second photo data photographed by a user to the server; determining, by the server, clothes and a body size of the user on the basis of the second photo data, and transmitting second augmented reality data wearing the jewelery to the user terminal on the basis of a determination result; and combining, by the user terminal, the second augmented reality data with the second photo data, and displaying a combined image. Therefore, more convenient and useful data can be provided for a user.

Description

A method for providing augmented reality for jewelry and a system for implementing it

The present invention relates not only to an augmented reality image that provides information about jewelry, but also to a jewelry augmented reality providing method that provides an augmented reality image such as worn by a user, and a system for executing the same.

Unlike virtual reality (VR), where objects, backgrounds, and environments all use virtual images, augmented reality (AR) displays a single image by superimposing a three-dimensional virtual image on a real image or background. it is technology

Such augmented reality is being applied to a technology that not only displays a virtual image overlaid, but also provides the name, price, and detailed information of a photographed real object. For example, a user of a smart device can experience various experiences by using the augmented reality function. For example, if you are curious about the information of a book your friend is reading, you can take a picture of the cover of the book with your smart device. The augmented reality application in the smart device reads the shooting information, and the application may provide the recognized book author, publisher, bookstore rating, and price information.

On the other hand, such augmented reality can also be applied in the jewelry industry. However, conventional augmented reality only provides data such as the name of the photographed jewellery, jewel content, brand name, and price information, but cannot provide advanced information such as the degree of matching with the user's wearing and currently wearing clothes. there was

The present invention overcomes the limitations of augmented reality that simply provides basic data of data photographed by the user by recommending other jewelery other than jewelery photographed according to the user's clothes and body size, and representing it in augmented reality, and It can provide more convenient and useful data to

In order to achieve the object of the present invention as described above and to realize the characteristic effects of the present invention to be described later, the characteristic configuration of the present invention is as follows.

According to an aspect of the present invention, in an augmented reality providing method comprising a server for storing data about a user terminal connected to an Internet network and jewelry, the user terminal transmits the first photo data of the jewelry to the server transmitting; The server recognizes the first photo data, matches at least one of price information, metal content information, and related brand information of the jewelry based on the recognized first photo data, and uses the first augmented reality data transmitting to a user terminal; displaying, by the user terminal, first augmented reality data together with the first photo data, and transmitting second photo data of the user to the server; determining, by the server, the clothing and body size of the user based on the second photo data, and transmitting second augmented reality data in which the user wears the jewelry based on the determination result to the user terminal; The user terminal combines the second augmented reality data from the second photo data, and displaying the combined image.

In addition, according to another aspect of the present invention, the server; and a user terminal connected to the camera and the Internet network. The user terminal takes the jewelry based on a user's input command, and transmits the first photo data of the jewelry and the second photo data of the user to the server, the server, 1 Recognizes photo data, matches at least one of price information, metal content information, and related brand information of the jewelry based on the recognized first photo data, and transmits the first augmented reality data to the user terminal; , 2 Determine the clothes of the user based on the photo data, and transmit the second augmented reality data wearing the jewelry based on the determination result to the user terminal, the user terminal, the second photo data Combining the second augmented reality data, and displaying the combined image; is provided a system comprising a.

According to the present invention, the following effects are obtained.

The present invention recommends jewelry other than jewelry photographed according to the user's clothes and body size and presents it in augmented reality, thereby overcoming the limitation of augmented reality that simply provides basic data of data photographed by the user. .

The present invention has the effect of providing more convenient and useful data to the user.

1 is a diagram for explaining a system including a user terminal and a server and the operation of the system.
2 is a control block diagram of a user terminal according to an embodiment.
3 is a diagram for explaining an operation of a server according to an embodiment.
4 is a flowchart illustrating an augmented reality providing method according to an embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0012] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein with respect to one embodiment may be implemented in other embodiments without departing from the spirit and scope of the invention. In addition, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the detailed description set forth below is not intended to be taken in a limiting sense, and the scope of the present invention, if properly described, is limited only by the appended claims, along with all scope equivalents as those claimed. Like reference numerals in the drawings refer to the same or similar functions throughout the various aspects.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily practice the present invention.

1 is a diagram for explaining a system including a user terminal and a server and the operation of the system.

The system 1 according to the disclosed embodiment includes a user terminal 10 for displaying augmented reality data and a server 20 for generating augmented reality data and transmitting the generated augmented reality data to the user terminal 10 . do.

Specifically, the user terminal 10 takes the jewelry 2, and displays the photographed photo data (3, hereinafter first photo data) on the display. As in the example shown in FIG. 1 , the user may touch the first photo data 3 . The user terminal 10 transmits the first photo data 3 to the server 20 . Here, the jewelry 2 includes all kinds of jewelry having a property value by crafting materials such as gold, silver, diamonds, or natural gems.

The server 20 collects and stores a large amount of data that the user terminal 10 cannot accommodate. The data stored by the server 20 may vary, but the server 20 according to an exemplary embodiment may store various information such as price information, metal content information, and related brand information of the jewelry 2 . Specifically, price information, metal content information, and related brand information of the jewelry 2 may be collected from the operator who produced the jewelry 2 and may be updated through AI (Artificial Intelligence) technology. If there is no price information, metal content information, and related brand information of the jewelry 2 , the server 20 may request input of information through the user terminal 10 or another user terminal.

The server 20 recognizes the transmitted first photo data 3 . Specifically, as a method for the server 20 to recognize the first photo data 3 , an object recognition algorithm such as a Convolution Neural Network (CNN) may be used. The server 20 may use various object recognition algorithms other than CNN as a method for recognizing a photo or an image.

In addition to the technology for recognizing the first photo data 3 , the server 20 is based on at least one of a barcode, a Quick Response code (QR) code, or a Radio-Frequency Identification (RFID) recognition result provided by the user terminal 10 . The jewelry (2) can be distinguished. That is, the user terminal 10 may collect the barcode, QR code or RFID recognition result related to the jewelry 2 , and transmit it to the server 20 , and the server 20 may have the user terminal 10 in addition to photo recognition. The jewelry 2 may be recognized based on the provided data.

The server 20 matches at least one of price information, metal content information, and related brand information of the recognized jewelry 2 and the stored jewelry 2 . That is, the server 20 recognizes the real jewelry 2 through the first photo data 3, extracts the price information of the jewelry 2, etc. from the stored database, and then extracts the augmented reality data (4, hereinafter the first augmented reality). data) is created. The server 20 transmits the generated first augmented reality data 4 to the user terminal 10 .

The user terminal 10 that has received the first augmented reality data 4 may display the received first augmented reality data 4 together with the displayed first photo data 3 .

Meanwhile, the user terminal 10 may photograph the user U again and display the photographed second photo data 5 . At this time, the user terminal 10 transmits the second photo data 5 to the server 20 . Here, the second photo data means not only the result of photographing the still image of the user U, but also the entire image result including the movement of the user U.

The server 20 recognizes the received second photo data 5 and classifies the human body. If the body of the person included in the second photo data 5 includes the face, neck, and torso, the server 20 may insert the jewelry 2 whose type is determined into the photo area including the body. . For example, if the second photo data 5 is data including a human body, and the jewelry 2 is a necklace, the server 20 stores the jewelry 2 in the photo area including the neck. (5) can be created. As another example, if the second photo data is a human hand and the jewelry is a ring, the server 20 may generate augmented reality data in which the ring is inserted on the ring finger.

On the other hand, the server 20 generates the third augmented reality data 7 that recommends other jewelry 6 other than the jewelry 2 while generating the second augmented reality data 5 . Here, the criterion for recommending other jewelry is determined based on the clothes and body size of the user U recognized in the second photo data 5 . For example, based on the type, color, and material of the user's current clothes, the server 20 may recommend jewelry 6 other than the jewelry 2 . As another example, the server 20 may recommend similar jewelry 6 having a different shape or different size in consideration of the proportion of the user's neck in the body. The server 20 may include a plurality of pieces of jewelery 6 other than the jewelery 2 recommended by the server 20 .

The server 20 transmits the generated second augmented reality data 5 or the third augmented reality data 7 to the user terminal 10 . Specifically, the second augmented reality data 5 may include 3D modeling data based on the second photo data 5 . As described above, if the second photo data 5 is an image result of continuous frames in which the user's movement is captured, the second augmented reality data 5 is the image of the jewelry 5 also changes according to the user's movement. 3D modeling data. The server 20 transmits the 3D modeling data as the second augmented reality data 5 to the user terminal 10 .

On the other hand, the server 20 can easily process a large amount of 3D modeling data, but the user terminal 10 having a limited capacity may have difficulty in processing the transmitted 3D modeling data. The server 20 may convert the 3D modeling data transmitted according to the user terminal 10 into low-capacity data (low resolution) and then transmit it to the user terminal 10 . In this case, the size converted into low-capacity data may be set in various ways, and may be changed by the user U.

The user terminal 10 may receive the low-capacity data, and may acquire high-capacity data (high resolution) according to the user U's selection. For example, a plurality of pieces of jewelry 2 may be received as low-capacity data, and the user U may select any one of the plurality of pieces of jewelry 2 from the user terminal 10 .

The user terminal 10 may receive 3D modeling data of high capacity (high resolution) from the server 20 again for the selected jewelry. In this case, the user terminal 10 may receive not only the selected jewelry but also augmented reality data (high capacity) in which the user U wears the selected jewelry.

The user terminal 10 receives the generated second augmented reality data 5 or the third augmented reality data 7 . The user terminal 10 may display the second augmented reality data 5 in which the jewelry 2 is combined with the second photo data.

If the user touches the screen, the user terminal 10 may display the third augmented reality data 7 for recommending other jewelry 6 together. If the user clicks some of the jewelry in the third augmented reality data 7, the user terminal 10 replaces the jewelry 6 coupled to the second photo data 5 with other selected jewelry to receive new augmented reality data. can be displayed

Meanwhile, according to another embodiment, the user terminal 10 displays the second augmented reality data 5 including the shape of the user wearing the jewelry 2, and the third augmented reality data without the user's touch or other input. (7) may be indicated together.

The user terminal 10 transmits various data to the server 20 in order to implement augmented reality data. For example, the user terminal 10 transmits the first photo data or the second photo data, together with a GPS (Global Positioning System) signal indicating the location of the user terminal 10 and location data collected through a gravity sensor. send. The server 20 may be used to generate augmented reality data based on the collected location of the user terminal 10 .

The server 20 may utilize user data to recommend other jewelry. Specifically, the server 20 provides a plurality of clothes owned by the user U through an application in which the user terminal 10 is installed, and user data (hereinafter, referred to as first user data) including a plurality of clothes types, colors, and brands, and the user. User data (hereinafter, second user data) including at least one of income, residence, body size, gender, search history, and preference of (U) is collected. The server 20 may generate third augmented reality data based on the first user data and the second user data collected by the user terminal 10 .

2 is a control block diagram of a user terminal according to an embodiment.

Referring to Figure 2, the user terminal 10 is an input unit 11 for receiving a user's input command, a camera, a GPS sensor, a gravity sensor, a gyro sensor, and various sensors 12 necessary for the augmented reality providing method, such as an acceleration sensor, The server 20 or the communication unit 13 that communicates with the Internet network, the display unit 14 for displaying photo data and augmented reality data, the output unit 15 for outputting various data excluding image data such as sound and light, augmented reality It includes a storage unit 16 for storing augmented reality data provided by an application, an algorithm, or an algorithm required for operation or the server 20 and a control unit 17 for controlling the above-described configuration.

Specifically, the input unit 11 receives an input command from the user. The input unit 11 is a hardware device such as various buttons or switches, a keyboard, a mouse, a track-ball, various levers, a handle or a stick in order to receive a user's input command. may include The input unit 11 may include a graphical user interface (GUI) such as a touch pad, that is, a software device to receive a user's input command. The touch pad may be implemented as a touch screen panel (TSP) to form a layer structure with the display unit 14 . In the case of a touch screen panel (TSP) forming a layer structure with a touch pad, the display unit 14 may also be used as the input unit 11 .

The sensor 12 is a device for collecting various data necessary to provide augmented reality. Augmented reality identifies the location of the user terminal 10 and provides various augmented reality data corresponding to the location. Accordingly, the sensor 12 may include a GPS sensor, a gyro sensor, a gravity sensor, and an acceleration sensor necessary to determine the location of the user terminal 10 . Specifically, the GPS sensor is a device for receiving a GPS signal transmitted from an artificial satellite, and the gravity sensor is a sensor for detecting gravity so as to recognize whether the user terminal 10 is in a vertical or horizontal direction. The acceleration sensor is a sensor that measures the acceleration of the moving user terminal 10 and the strength of the impact. The gyro sensor measures the angular velocity and is a sensor that helps to recognize the 6 axes. In addition, the user terminal 10 may further include various sensors necessary to provide augmented reality.

Meanwhile, the user terminal 10 according to the disclosed embodiment may include a camera for photographing photo data. A camera is an image sensor used in general smart devices. The photo data captured by the camera and converted into an electrical signal is transmitted to the server 20 through the communication unit 13 to be described below or displayed through the display unit 14 after image processing.

The communication unit 13 is a communication interface that connects the server 20 and the user terminal 10 through an Internet network. The communication unit 13 transmits the photo data captured by the user terminal 10 through the camera, the user data collected through the input unit 11 and the sensor 12 to the server 20, and the server 20 transmits Receive augmented reality data. The communication unit 13 may include one or more components that enable transmission and reception of the aforementioned data, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

For example, in case it is provided at an event venue that can be connected to an Internet network through a wired communication port such as a wide area network (WAN), the user terminal 10 may include a wired communication module. As another example, in addition to a WiFi module and a wireless broadband module, in addition to a global system for mobile communication (GSM), code division multiple access (CDMA), WCDMA in case it is provided outdoors where a wired communication port is not provided. It may include a wireless communication module supporting various wireless communication schemes such as (Wideband Code Division Multiple Access), universal mobile telecommunications system (UMTS), time division multiple access (TDMA), and long term evolution (LTE).

The communication unit 13 includes a Bluetooth module, an infrared communication module, an RFID (Radio Frequency Identification) communication module, a WLAN (Wireless Local Access Network) communication module, an NFC communication module, which can be connected to the server 20 in addition to the above-described wired/wireless module. It may include a short-range communication module such as a (Zigbee) communication module. According to an embodiment, the communication unit 13 recognizes a barcode, a QR code, or performs RFID based on the short-distance communication module.

The display unit 14 is a display capable of displaying photo data and augmented reality data, and includes a digital light processing (DLP) panel, a plasma display panel, and a liquid crystal display (LCD) panel. , Electro Luminescence (EL) panel, Electrophoretic Display (EPD) panel, Electrochromic Display (ECD) panel, Light Emitting Diode (LED) panel or Organic Light It may be provided as an emitting diode (OLED) panel, but is not limited thereto.

The output unit 15 is a device that executes a function capable of operating an application provided in the user terminal 10, such as sound or light. For example, when the augmented reality application displays the first augmented reality data including the brand information of the photographed jewelry, and reproduces music symbolizing the brand, the output unit 15 is an acoustic device capable of playing music means

The storage unit 16 stores various data. The storage unit 16 not only stores the first photo data and the second photo data captured by the sensor 12 , but also temporarily stores sensor data collected by a GPS signal and a gravity sensor. The storage unit 16 stores the first augmented reality data to the third augmented reality data received from the server 20 . The first augmented reality data may include at least one of price information, metal content information, and related brand information of jewellery, and the second augmented reality data includes 3D modeling data in which jewelery is worn to fit the photographed user's body, . The third augmented reality data includes information about jewelry other than the photographed jewelry.

In addition, the storage unit 16 includes a plurality of clothes of the user and first user data related to the type, color, and brand of the user, and at least one of the user's income, residence, body size, gender, search history, and preference. 2 It may contain user data. The user data may be generated by data collected based on big data and information already collected by the user's input in connection with the server 20 in connection with the server 20 .

The storage unit 16 is a nonvolatile memory device or RAM such as a cache, read only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), and flash memory. It may be implemented as at least one of a volatile memory device such as (Random Access Memory), a hard disk drive (HDD), or a storage medium such as a CD-ROM, but is not limited thereto. The storage unit 16 may be a memory implemented as a separate chip from the processor described above with respect to the controller 17 , or may be implemented as a single chip with the processor.

The control unit 17 controls the overall user terminal 10 . The control unit 17 performs the above-described operation using a memory (not shown) that stores data for an algorithm or a program that reproduces an algorithm for controlling the operation of components in the user terminal 10, and the data stored in the memory. It may be implemented by a processor (not shown) that performs it.

When the user terminal 10 and the server 20 are connected through the Internet network, the control unit 17 displays the first photo data of the jewelry photographed on the display unit 14, the first photo data to the server 20, At least one of barcode, QR code, or RFID recognition result is transmitted. Upon receiving the first augmented reality data from the server 20 , the control unit 17 displays the first augmented reality data and the first photo data together on the display unit 14 . When the camera collects the second photo data of the user or person by the user's manipulation, the controller 17 transmits the second photo data to the server 20 .

When the communication unit 13 receives the second augmented reality data expressing the image worn by the jewelry, the control unit 17 displays the second augmented reality data together with the second photo data. In addition, the control unit 17 may receive the third augmented reality data transmitted by the server 20 . The third augmented reality data includes information about other jewelry selected by the server 20 based on the second photo data. The controller 17 may display the third augmented reality data together while displaying the second augmented reality data according to a user input or a predetermined program.

The controller 17 may transmit the first user data and the second user data together while transmitting the first photo data and the second photo data. For example, the controller 17 may transmit to the server 20 a plurality of pieces of clothing information already owned by the user and a type of jewelry frequently preferred by the user while transmitting the second photo data of the user. The user data selected by the controller 17 may be determined based on photographed jewelry and items set by the user.

The controller 17 may perform general operations of controlling and operating the user terminal 10 in addition to the augmented reality providing method.

The user terminal 10 may be implemented as a computer or portable terminal capable of accessing the server 20 through an Internet network. Here, the computer includes, for example, a laptop equipped with a web browser, a desktop, a laptop, a tablet PC, a slate PC, and the like, and the portable terminal has, for example, portability and mobility. As a covered wireless communication device, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) -2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), WiBro (Wireless Broadband Internet) terminals, all kinds of handheld based such as smart phone of wireless communication devices and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-devices (HMDs). The user terminal 10 may further include various configurations necessary for the augmented reality providing method in addition to the configuration described above in FIG. 2 .

3 is a diagram for explaining an operation of a server according to an embodiment.

Referring to FIG. 3 , the server 20 according to an embodiment recognizes the photo data receiving unit 21 that collects photo data transmitted by the user terminal 10 , the jewelry of the photo data, and increases information related to the recognized jewelry. Data matching unit 22 for matching real data, user data storage unit 23 for storing user data collected by the user terminal 10, and augmented reality data for storing augmented reality data required for the operation of data matching unit 22 It includes a reality data storage unit 24 and a recommended augmented reality data generation unit 25 for generating recommended augmented reality data, such as the above-described third augmented reality data.

Specifically, the photo data receiving unit 21 serves as a communication interface for receiving the first photo data and the second photo data from the user terminal 10 . As described above, the first photo data may be jewelry photographed by the user terminal 10 or a photographed image including a jewelry image. The second photo data may be a captured image including a user or another person. The server 20 collects the first photo data and the second photo data, and transmits augmented reality data corresponding to the photo data to the user terminal 10 .

On the other hand, when the photo data receiving unit 21 receives data including at least one of a barcode, a QR code, or an RFID recognition result in addition to the first photo data, it recognizes the jewelry based on the received data.

The data matching unit 22 matches the recognized jewelry and augmented reality data.

For example, according to the result of recognizing the jewelry in the first photo data based on the object recognition algorithm, the data matching unit 22 stores price information, metal content information and related brand information of the jewelry in the augmented reality data storage unit 24 . Match at least one of the recognized jewels. Data matched with the recognized jewelry becomes the first augmented reality data, and is transmitted to the user terminal 10 .

The data matching unit 22 recognizes an external shape of a person including a human hand based on the second photo data. One example. If the jewelry recognized in the first photo data is a ring, and the object recognized in the second photo data is a human hand, the data matching unit 22 converts the second augmented reality data in which the jewelry is worn on a person's finger to the second photo. match the data. The server 20 transmits the shape of the jewelry worn on the finger of the photo, that is, the second augmented reality data to the user terminal 10 . As another example, if the jewelry recognized in the second photo data is a necklace, and the object recognized in the second photo data is the appearance of a person wearing a dress, the data matching unit 22 is a second augmentation of a shape in which the necklace is worn on the dress. Match the real data with the second photo data.

The user data storage unit 23 includes at least one of a plurality of clothes, a plurality of clothes types, colors, and brands of the user, and at least one of the user's income, residence, body size, gender, search history, and preference. Stores second user data including Both the first user data and the second user data may be elements for generating the third augmented reality data.

The augmented reality data storage unit 24 includes first augmented reality data including at least one of price information, metal content information, and related brand information of the recognized jewelery, and a three-dimensional image displayed when worn by a user. Stores second augmented reality data including, 3D images of other jewelry that can be recommended to a user in addition to the recognized jewelry, and third augmented reality data including brand, metal content, and price information of other jewelry.

The second augmented reality data may include 3D modeling data of jewelry, and there is no limitation in data size.

The third augmented reality data may be updated by big data, and AI (Artificial Intelligence) technology including deep learning may be applied to continuously learn.

The recommendation data generator 25 generates new augmented reality data to be recommended to the user, and transmits it to the user terminal 10 . Elements necessary for the recommendation data generating unit 25 to generate the third augmented reality data are based on user information.

For example, the recommendation data generating unit 25 matches the recognized jewelry with other clothes included in the first user data as well as the user's clothes recognized in the second photo data. If it is determined that the currently recognized jewelry does not match the user's other clothes, the recommendation data generating unit 25 generates jewelry other than the recognized jewelry as the third augmented reality data.

As another example, the recommendation data generating unit 25 matches the recognized jewelry with other clothes included in the first user data as well as the user's clothes recognized in the second photo data. If it is determined that the currently recognized jewelry matches with the user's other clothes, the recommendation data generating unit 25 may generate third augmented reality data in which the recognized jewelry is worn on other clothes included in the first user data. .

As another example, the recommendation data generating unit 25 matches another jewelry according to a user's preference or search history included in the second user data with the second photo data. If the frequently searched and highly preferred category of jewelry is determined to be a recognized category of jewelry, for example, a necklace, the recommendation data generating unit 25 synthesizes jewelry other than the recognized jewelry with the second photo data. 3 Generate augmented reality data.

As another example, the recommendation data generator 25 may consider the user's income included in the second user data. If the currently recognized jewelry is determined to be a high price based on the user's income, the recommendation data generating unit 25 may generate the third augmented reality data with jewelry having a lower price than the recognized jewelry.

The recommendation data generator 25 may generate third augmented reality data based on various other user data in addition to the user data described above, and mix the first user data and the second user data to generate the third augmented reality data. You can also create

By transmitting the third augmented reality data generated by the recommendation data generating unit 25 to the user terminal 10, the server 20 overcomes the limitations of augmented reality that simply provides basic data of data photographed by the user, It can provide users with more convenient and useful data.

Meanwhile, each configuration of the server 20 described above in FIG. 3 is arbitrarily divided to explain the operation of the server 20 . That is, it is sufficient if the server 20 is provided as a processor and performs the operation described above in FIG. 3 through the Internet network.

4 is a flowchart illustrating an augmented reality providing method according to an embodiment.

Referring to FIG. 4 , the user terminal 10 executes an application and photographs the jewelry with a camera ( 100 ).

The application means software capable of displaying augmented reality data by the user terminal 10 . The application may be various, and the user interface included in the application may be various. The user terminal 10 transmits the first photo data generated by shooting to the server 20 .

The server 20 generates first augmented reality data based on the first photo data (110).

The first augmented reality data includes at least one of price information of jewelry, metal content information, and related brand information. The server 20 transmits the generated first augmented reality data to the user terminal 10 .

The user terminal 10 displays the first photo data and the received first augmented reality data ( 120 ).

A method of displaying the first augmented reality data may be various, and there is no limitation in the form. On the other hand, the user terminal 10 transmits the second photo data captured by the user to the server 20 by operating the camera while the application is running.

The server 20 generates second augmented reality data based on the second photo data (130).

The second augmented reality data includes an image of a type of jewelry recognized by the user in the first photo data worn by the user. The second augmented reality data may vary according to the photographed user's body and size, and may include 3D modeling data.

The server 20 generates third augmented reality data based on the user data (140).

As described above, the user data includes a plurality of clothes of the user and first user data including at least one of a type, color, and brand of the plurality of clothes, the user's income, residence, body size, gender, search history, and preference. and second user data including at least one of User data may be various in addition to the elements described above.

The user terminal 10 according to an embodiment may receive a user input through an application ( 150 ).

Specifically, the user input received by the input unit 11 relates to the third augmented reality data, and the user terminal 10 may not necessarily display the third augmented reality data together with the second augmented reality data. That is, the user terminal 10 may display the third augmented reality data after the user receives an input command for displaying the third augmented reality data. A user interface for inducing such a user input may be implemented in various forms on an application.

If the user input is received (Yes), the user terminal 10 displays the received third augmented reality data together with the second augmented reality data (160). If the user input is not received (No), the user terminal 10 may display only the second augmented reality data.

The method for providing augmented reality for jewelry disclosed through this and a system for implementing the same, by recommending jewelry other than jewelry photographed according to the user's clothes and body size, and displaying this in augmented reality, simply provide the basic information of the data photographed by the user. It can overcome the limitations of augmented reality that provides only data, and has the effect of providing more convenient and useful data to users.

The embodiments according to the present invention described above may be implemented in the form of program instructions that can be executed through various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of the computer-readable recording medium include hard disks, magnetic media such as floppy disks and magnetic tapes, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floppy disks. media), and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for carrying out the processing according to the present invention, and vice versa.

In the above, the present invention has been described with specific matters such as specific components and limited embodiments and drawings, but these are provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. , various modifications and variations can be devised from these descriptions by those of ordinary skill in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and not only the claims described below, but also all modifications equivalently or equivalently to the claims described below belong to the scope of the spirit of the present invention. will do it

1: system
10: user terminal
11: input
12: sensor
13: communication department
14: display unit
15: output unit
16: storage
17: control unit
20: server
21: photo data receiving unit
22: data matching unit
23: user data storage unit
24: Augmented reality data storage unit
25: recommended augmented reality data generation unit

Claims (13)

In the augmented reality providing method comprising a server for storing data about a user terminal and jewelery connected to the Internet network,
transmitting, by the user terminal, first photo data of the jewelry to the server;
The server recognizes the first photo data, matches at least one of price information, metal content information, and related brand information of the jewelry based on the recognized first photo data, and uses the first augmented reality data transmitting to a user terminal;
displaying, by the user terminal, first augmented reality data together with the first photo data, and transmitting second photo data of the user to the server;
determining, by the server, the clothing and body size of the user based on the second photo data, and transmitting second augmented reality data in which the user wears the jewelry based on the determination result to the user terminal;
The user terminal combining the second augmented reality data to the second photo data, and displaying the combined image; Augmented reality providing method comprising a. The method of claim 1,
Transmitting the first photo data to the server;
The user terminal transmitting at least one of a barcode, a QR code, or an RFID recognition result to the server; Augmented reality providing method comprising a. 3. The method of claim 2,
Transmitting the second augmented reality data to the user terminal;
The server transmitting the 3D modeling data of the jewelry to the user terminal based on at least one of the barcode, the QR code, or the RFID recognition result; Augmented reality providing method comprising a. 4. The method of claim 3,
Transmitting the second augmented reality data to the user terminal;
Augmented reality providing method comprising a; transmitting the 3D modeling data less than a preset resolution to the user terminal. The method of claim 1,
Transmitting the second augmented reality data to the user terminal;
A method of determining the location of the user based on a Global Positioning System (GPS) signal transmitted by the user terminal, and recommending jewelry other than the jewelry based on the determined color and texture of the clothes and the location of the user 3 Determining the augmented reality data; Augmented reality providing method further comprising. 6. The method of claim 5,
transmitting the second photo data to the server;
transmitting the plurality of clothes of the user collected in advance by the user terminal and first user data including at least one of a type, color, and brand of the plurality of clothes to the server together with the second photo data; Augmented reality providing method, including. 7. The method of claim 6,
Transmitting the third augmented reality data to the user terminal;
Augmented reality providing method further comprising; determining the third augmented reality data matching the plurality of clothes based on the first user data and the second photo data. 6. The method of claim 5,
Transmitting the second augmented reality data to the user terminal;
Transmitting, by the user terminal, second user data including at least one of the user's income, residence, body size, gender, search history, and preference, collected in advance, to the server together with the second photo data; How to provide augmented reality. 9. The method of claim 8,
Transmitting the third augmented reality data to the user terminal;
Based on the second user data and the second photo data, determining the third augmented reality data matching the user; Augmented reality providing method further comprising a. 6. The method of claim 5,
The user terminal,
Execute an application for taking the first photo data and the second photo data,
Augmented reality providing method for displaying the first augmented reality data together with the first photo data. 11. The method of claim 10,
receiving, by the user, an input command related to the third augmented reality data;
changing the second augmented reality data to the third augmented reality data based on the third augmented reality data; and
Displaying the modified third augmented reality data and the second photo data; Augmented reality providing method comprising a. 12. The method of claim 11,
Augmented reality providing method comprising a; changing the second photo data based on the changed third augmented reality data. server; and
and a camera and a user terminal connected to an Internet network.
The user terminal,
Taking jewelry based on a user's input command, and transmitting the first photo data of the jewelry and the second photo data of the user to the server,
The server is
Recognizes the first photo data, matches at least one of price information, metal content information, and related brand information of the jewelry based on the recognized first photo data, and transmits the first augmented reality data to the user terminal transmit, determine the clothes of the user based on the two photo data, and transmit the second augmented reality data wearing the jewelry based on the determination result to the user terminal,
The user terminal combines the second augmented reality data with the second photo data, and displays the combined image.

Images