KR20150141283A - Goods augmented reality system - Google Patents

Abstract

The present invention relates to a product augmented reality system applied with an application system to three-dimensionally realize different shapes of images of various products by using an information and telecommunication device. In the present invention, a manager system uploads data in a database of a main server, and an application is downloaded to an information and telecommunication device and executed. An image of a product is recognized through the information and telecommunication device, and various images such as movies and sounds of the recognized product are realized with a three-dimensional movie in the information and telecommunication device. A camera can be rotated by 180 degrees by taking the executed image, and the taken image is automatically stored. The application executing the processes, images, sounds, movies, and three-dimensional movies are applied to various products representing the images, sounds, movies, and three-dimensional movies registered in the main server.

Description

Product Augmented Reality System {GOODS AUGMENTED REALITY SYSTEM}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an application system and a product augmented reality system applied to various products so that an image having a different shape can be three-dimensionally displayed using an information communication device. More specifically, Images, sounds, videos, and other various types of characters, images, sounds, moving images, and three-dimensional (3D) stereoscopic moving images from various products through information communication devices, It is possible not only to capture and store such images, but also to automatically recognize characters, images, sounds, moving images, and 3D stereoscopic moving images stored in the database through a recognition system and transmission / reception system interlocked between the database and the application, Button functions allow you to adjust the size and The application system and the applied product enhancement related to the application of various products according to the diffusion of the electronic communication device by enhancing the value of the product and the sales effect by providing the educational function, the entertainment function and the sentimental function Lt; / RTI >

Generally speaking, the products on the earth have been required to be essential for daily life of people, and after they have performed their original functions, they have developed into a complex age, and decorative functions have also been importantly demanded. Beyond these ornamental functions, educational, fun and sentimental functions are also added.

Therefore, there has been a need to develop various products as products that can satisfy them in the current period in which not only the function as the original corresponding product but also the educational function, the entertainment function, and the sentimental function are required much. In addition, due to popularization and development of electronic communication devices, each system linked to it has been developed and used.

As an example, clothes of clothing, clothing and shelter have played a fundamental role in protecting people from the outside environment, but nowadays decorative functions are also important. In addition to the above decorative functions, entertainment functions are added. In this respect, the Korean Registered Utility Model No. 20-0256676 discloses a three-dimensional combination toy that can be changed in clothes.

However, since the method of simply assembling a piece of clothes composed of many pieces into a doll is limited, there is a drawback that accessories for carrying out an entertainment function are required. In addition, since the means of changing the clothes must also be passively performed, it is not only troublesome but also can not meet the needs of the consumer who expects the entertainment function with the monotony effect.

As a conventional technique which improves this, Patent Registration No. 10-1155178 discloses a method of downloading and executing an application to an information communication device, displaying a unique number input window at the top of the application and a dial at the bottom of the application, Comparing the unique number with the information of the web server, recognizing the image code of the clothing through the information communication device, displaying the body of the wearer on the information communication device as if it is a basketball goal, The user interacts with an application comprising a step of dragging the basketball ball displayed on the screen onto the basketball goal and a step of displaying the item list and the payment window when the menu item is clicked.

In addition, it has been published to include a recognition image, a code, and a unique number registered in the web server in association with the application, in association with the application performing the operation.

Accordingly, the present inventors have developed an application system having a complex function by combining each of these systems, and by combining it with a variety of applied products, the present inventor not only has a simple function as a corresponding product but also an educational function, an entertainment function, Based on the production of a product having a functional function.

Disclosure of the Invention The present invention has been made in view of the above circumstances, and it is an object of the present invention to provide a database and application system of a main server that can perform educational functions, entertainment functions and sentimental functions unlike existing products, And to provide a product augmented reality system that can be improved in performance.

It is another object of the present invention to provide a system and a system for displaying various characters, images, sounds, videos, 3D stereoscopic moving images, It is possible to easily provide various types of characters, images, sounds, moving images, and 3D stereoscopic moving images to the user by printing a unique recognition image or code that is linked to the application in the product.

It is a further object of the present invention to not only scale the displayed 3D stereoscopic moving image in the user information communication device but also realize the 3D stereoscopic feeling by moving the displayed image vertically and horizontally, So that it is possible to provide a function of not only listening and listening but also a function of mounting a camera function in an application and photographing and storing the camera as well as a function of rotating the camera by 180 degrees.

According to another aspect of the present invention, there is provided an information processing method including: uploading data to a database of a main server in an administrator system; downloading and executing an application to an information communication device; recognizing an image of the product through an information communication device; A variety of images such as a moving image and a sound are displayed on an information communication device as a 3D stereoscopic moving image, and the camera can be rotated 180 degrees and the photographed image is automatically stored; An application for performing the above process and an image, a sound, a moving image, and a 3D stereoscopic moving image are applied to various products that display an image, a sound, a moving image, a 3D stereoscopic moving image registered in a main server, and the like.

According to another specific feature of the present invention, an image transmitting apparatus and a receiving apparatus are mounted on a main server of a database, and an image or code transmitted from an application through an object recognition system of the main server is matched with an image or code registered in the database Extracts and transmits data, and converts the stereoscopic moving image into a three-dimensional image of a two-dimensional image, thereby giving various kinds of characters, images, sounds, moving images, and stereoscopic moving images to a database through a manager system Upload registration; Wherein the manager system receives the unique recognition image and the data after the code is provided through the data input unit, registers data using the object recognition system to the main server, and confirms whether the code matches between the manager system and the data input unit; Wherein the application includes an image transmitting apparatus and a receiving apparatus, and further comprises a view executing means, a view photographing means, and a unique recognition image and a code recognition system; And the view shooting unit of the application is configured to be connected to a storage unit of the information communication device.

As described above, according to the present invention, a product augmented reality system linked with an application system can perform an educational function, an entertainment function, and a sentimental function while performing a function of the product itself. It is possible to provide functions and convenience described above beyond the limit.

Since the image recognition or code adopted in the present invention in terms of these effects and functional aspects exerts a decorative function on the appearance of the product and is interlocked with the application, the image, sound, Video, and 3D stereoscopic video are displayed, it is possible to add educational functions, entertainment functions and sentimental functions by adding additional functions as well as the original functions of the product.

That is, the product augmented reality system of the present invention can perform educational functions, entertainment functions, and sentimental functions in addition to living necessities.

As a product augmented reality system interworking with an application system adopting such an effect in a practical aspect of the present invention, a method of performing educational functions, entertainment functions, and sentimental functions can be performed by an information communication device such as a user smart phone, It is possible to enjoy the stereoscopic effect of the device, so that the purchase cost of the device for the educational function, the entertainment function, and the sentimental function is reduced and the household economy is also helped.

In addition, the present invention is not limited to purchasing a separate product that exhibits an educational function, an entertainment function, or a sentimental function. Therefore, a product that can be actually used exhibits an educational function, an entertainment function, Not only that, but also practical.

As a result of examining the effects through the application system in terms of production, distribution, and value, the product including the recognized image or code adopted in the present invention exhibits the general function, the educational function, the entertainment function, and the sentimental function as the product Therefore, it is possible to control the appearance of counterfeit goods through execution through dedicated applications as well as the competitiveness of the products, and to contribute to diversity of products and establishment of fair trade order.

FIG. 1 is a diagram illustrating a product augmented reality system according to an embodiment of the present invention.
FIG. 2 is a driving flowchart showing the product augmented reality system of the present invention,
3 is a photograph for explaining a driving sequence of an application linked to a product of the present invention,
FIG. 4 is a photograph illustrating a product item effect according to an embodiment of the present invention,
FIG. 5 is a photograph illustrating a product item effect according to another embodiment of the present invention,
Figure 6 shows an exemplary product photo of the present invention in which the recognized image is printed,
FIG. 7 is a photograph illustrating a method of using a recognized image of a product according to an embodiment of the present invention,
FIG. 8 is a diagram illustrating an image, a sound, a moving image, a photograph for explaining a 3D stereoscopic moving image,
FIG. 9 is a view illustrating an image, a sound, a moving image, a method explaining a method of shooting a 3D stereoscopic moving image according to another embodiment of the present invention,
FIG. 10 is a view showing an image, a sound, a moving picture, a 3D stereoscopic moving picture according to another embodiment of the present invention,
FIG. 11 is a diagram illustrating photographs of various images, sounds, moving images, and 3D stereoscopic moving images displayed simultaneously according to another embodiment of the present invention,
FIG. 12 is a photograph for adjusting the size of a displayed 3D video with a finger touch.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

 FIG. 1 is a block diagram illustrating a product augmented reality system according to an embodiment of the present invention, and FIG. 2 is a driving flowchart illustrating a product augmented reality system of the present invention. The present invention as an application system and an applied product augmented reality system displays various images stored in the database 12 of the main server 10 by displaying images, sounds, and moving images linked with the application 100 in various products Images, sounds, moving images, and three-dimensional (3D) stereoscopic moving images can be displayed in various products through the information communication device 90 and can be photographed and stored, , The image, the sound, the moving image, and the 3D stereoscopic moving image can be automatically recognized through the recognition system and transmission / reception system interlocked between the database 12 and the application 100, and can be displayed and controlled by the touch function and the shooting button function. Educational, recreational, and sentimental functions are provided through photography and storage, resulting in increased product value and sales effects. And to deliver, to the application system and the applications augmented reality system relates to applications in a variety of products in accordance with the spread of information communication devices (90).

That is, the image transmitting apparatus 16 and the receiving apparatus 18 are mounted on the main server 10 of the database 12, and the image transmitting apparatus 16 and the receiving apparatus 18 transmitted from the application 100 via the object recognition system 14 of the main server 10 A function of extracting and transmitting data by reading an image or a code and an image or code registered in the database 12 and converting the image or code into a three-dimensional image of a two-dimensional image, Moving image, and 3D stereoscopic moving image to the database 12 of the main server 10 through the manager system 70, and registers and uploads the inherent image or code.

The manager system 70 receives the unique recognition image and the data after the code is input through the data input unit 80 and registers the data in the main server 10 using the object recognition system. The manager system 70 and the data input unit 80 confirm whether an image or a code is matched.

As shown in FIG. 2, it is possible to produce a basic image and a 3D video, insert characters and sounds, and edit and insert text and sound into a basic movie production. Thus, images, characters and sounds Can be produced. (Corresponding to the image and code to be displayed on the product) to the manager system 70 when the unique print and code are given to the produced image, sound, text animation, 3D stereoscopic video, ).

The application 100 includes an image transmission device 102 and a reception device 101 and is provided with a view execution means 103, a view shooting means 104 and a unique recognition image, a code recognition system 105 . The view shooting device 104 of the application 100 is configured to be networked with the storage unit 60 of the information communication device 90.

In the main server 10 and the application 100, after confirming a unique recognized image such as a registered image, a character, a sound, a moving image, a 3D stereoscopic video, and the like, You can extract and check the registered images and codes on the server.

 The application 100 having the image transmitting apparatus and the receiving apparatus system, the object recognizing system, the camera photographing means, the image storing means, the view image touch adjusting means, and the vertical / For example, the application 100 can be downloaded and executed through Google play and App Store.

In other words, the dedicated application down process 20 and the dedicated application execution process 30 are logged in using the play button. The application down install is performed by downloading from the Google play, App Store, Website).

The application can be executed by touching the play button through the automatic login of the application 100. [ The executed application 100 is recognized by recognizing a recognized image or code printed on the product.

The camera function is installed in the dedicated application (the 180-degree rotation function is installed) in the camera operation process 40 after selecting the view option on the application screen, and this is automatically stored in the information communication device folder after the camera shooting process 50 Perform step 60, and output the stored image.

Images, sounds, moving images, and 3D stereoscopic moving images displayed through the application 100 and stores images, sound, moving images, and 3D stereoscopic moving images photographed through the application 100, Images, sounds, moving images, 3D stereoscopic moving images, and unique recognition images and codes registered in the web dedicated server 10 in association with the application 100 to be performed.

Images, sounds, moving images, and 3D stereoscopic moving images through the information communication device 90 by printing the items of the products and including the display of the stereoscopic moving images.

The item is transmitted to the application 100 through the object recognition system 14 and the wireless transmitting and receiving means 16 and 18 by using the images, sounds, moving images, 3D stereoscopic moving images of various genres registered and uploaded through the manager system 70 And stores various data through the unique recognition image and the code registered in the database 12 of the main server 10 and transmits various kinds of data through the information communication device 90 at the same time It is equipped with functions that can be displayed.

The item is transmitted to the main server 10 through the application 100 interlocked with the wireless transmitting / receiving means 16 and 18 of the main server 10 and the database 12 on which the object recognition system 14 is mounted, A sound, a moving image, and a 3D stereoscopic moving image are executed through an application of the information communication device 90, and can be photographed and stored by a built-in camera.

The item can be an image, a sound, a moving image, or a 3D stereoscopic moving image through a recognition image and code of a product having a large amount of data stored in the database by executing an application having an automatic login system.

The item is executed by moving the 3D stereoscopic moving image displayed on the application through a view (VIEW) 120 ° up / down and left / right by the application, and the size of the image can be adjusted by the touch function.

The item can photograph the displayed image, sound, moving image, 3D stereoscopic moving image through the camera function mounted on the application after rotating 180 degrees.

The items are transmitted to the manager system 70 by giving a unique recognized image or code to the character, image, sound, moving image and 3D stereoscopic moving image produced through the data input unit 80 and transmitted to the database 12 of the main server 10 ) To upload various and vast amounts of data at all times.

The item is loaded with each wireless transmitting / receiving means and an object recognition system interlocked with the database 12 and the application 100 to confirm whether or not the recognized image or code matches with each other, and various types of characters, images, sounds, Stereoscopic image) is extracted and displayed through the view function of the application.

The item can be utilized for various products, and a unique recognized image or code is displayed on all the products to be applied to various products.

Accordingly, the present invention includes adjusting the size of a 3D stereoscopic moving image displayed through the application 100 by touching, and an image, a sound, a moving image, and a 3D stereoscopic moving image displayed through the application 100, And a 3D stereoscopic image may be displayed through the device 90 in the up, down, left, and right directions.

FIG. 3 is a picture for explaining a driving sequence of an application linked to a product of the present invention, and is displayed in the order of application execution, application being executed, 3D video being displayed, camera shooting, The rotation button, the shooting button, and the end button.

FIG. 4 is a photograph for explaining a product item effect according to an embodiment of the present invention, FIG. 5 is a photograph for explaining a product item effect according to another embodiment of the present invention, , 3D stereoscopic video (image, sound, moving image, 3D stereoscopic video after matching the recognized image) matches the recognized image or code.

FIG. 6 is a photograph of an exemplary product of the present invention in which a recognized image is printed, sequentially identifying the recognized image or code.

FIG. 7 is a photograph for explaining a method of using a recognized image of a product according to an embodiment of the present invention, wherein a dedicated application execution process 30 and a camera operation process 40 are shown after selecting an option on an application screen.

FIG. 8 is a picture for explaining an image, sound, moving picture, and 3D stereoscopic moving image according to another embodiment of the present invention. First, a recognized image or code is confirmed. 40).

FIG. 9 is a photograph illustrating a method of photographing an image, sound, moving image, and 3D stereoscopic moving image according to another embodiment of the present invention, in which a camera photographing process 50 is performed.

FIG. 10 is a photograph of an image, sound, moving image, and 3D stereoscopic moving image according to another exemplary embodiment of the present invention, which is stored in an information communication device folder.

FIG. 11 is a photograph showing various operations of an image, sound, moving picture, and 3D stereoscopic moving image according to another embodiment of the present invention, wherein the recognized image or code is identified.

FIG. 12 is a photograph for adjusting the size of a displayed 3D video with a finger touch. In this example, a database stored image, a sound, a moving image, a 3D stereoscopic video (an image displayed after matching a recognized image, a sound, Image or code.

As described above, a product that is three-dimensionally displayed through an information communication device is disclosed. The present invention includes a process of uploading data to a database, a process of downloading an application to an information communication device and executing the application, A process of recognizing an image through an information communication device, a process of displaying an image, a sound, a moving image, a 3D stereoscopic moving image in a recognized product, a process of shooting an executed image, and a process of automatically storing a captured image An image, a sound, a moving image, a 3D stereoscopic moving image, and a recognition image or code registered in the web server, in cooperation with an application made up of the application.

Therefore, the image, sound, moving image, 3D stereoscopic moving image and the like adopted in the present invention exert a decorative function on the appearance of the product and are linked with the application, so that the image, sound, It is a product augmented reality system that can be used for various contents such as entertainment function, education function, advertisement function as well as product function by executing 3D stereoscopic video and the like.

The operation sequence of the application interlocked with the product of the present invention is as follows.

The first step is to mount an image transmitting apparatus and a receiving apparatus system in a database, extract a data or an image transmitted from an application through an object recognition system and read an image or code registered in the database, Video production, and two-dimensional image into a three-dimensional image, thereby registering and uploading various characters, images, sounds, moving images, and stereoscopic moving images to a database through a manager system.

The second step is to create an application that includes an image transmission device and a receiving device system, an object recognition system, a camera shooting function, an image storage function, a view image touch control function, And the application 20 is downloaded and executed from the Google Play and the App Store in the information communication device.

The third process is an automatic execution process (30) through the play button after the application is clicked on the icon in the view window of the electronic communication device. In the fourth process, the image of the product, When recognized on the device's lens, text, image, sound, video, 3D stereoscopic video is displayed in the VIEW window of the running application.

When the image or code is matched with the stored image or code information stored in the web server through the image transmitting apparatus and the receiving apparatus system or the object recognizing system, the operations are automatically executed. If the stored image information of the web server is inconsistent with the stored image information , Images, sounds, movies, 3D stereoscopic movies are not displayed.

In the fifth and sixth steps, when the images match with the stored recognized image information of the web main server, the operations are automatically performed to display the displayed characters, images, sounds, moving images (including 3D stereoscopic images) (60). That is, the image of the original product, the image, the sound, the moving image (including the 3D stereoscopic image) and the like are displayed and displayed on the screen through the information communication device such as a smart phone.

As shown in Fig. 6, the recognized image or code is apparently displayed as a decorative print on the product, but is formed so as to be operatively connected with an application that actually performs the operation. The recognition image or code is displayed only when the image or code registered in the web server matches the printed recognition image or code of the product. It is executed only when the recognized image or code of the product is executed by the application's camera and matches the registration image of the web server.

Image, sound, moving image, 3D stereoscopic moving image or the like by detecting the camera of the application through the object recognition system by inserting a color or a character for printing the recognized image or code and displaying the displayed character, Sound, movie, 3D stereoscopic movie with camera.

Since the recognized image or code is for recognizing the displayed special image, various types of recognized images may be used through the information communication device. Anyone can run the application free of charge, but characters, images, sounds, movies, 3D stereoscopic videos, etc. through the application are recognized only when the recognition image is printed.

Images, sounds, and images must be matched with the registered image or code and the recognized image or code printed on the product by interlocking the system so that the registered image or code stored in the web server matches the recognized image or code printed on the product, Video, and 3D stereoscopic video are displayed.

Although the present invention has been described with reference to the preferred embodiments thereof, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as set forth in the appended claims. It will be understood that various modifications and changes may be made thereto by those skilled in the art.

10: Main server
12: Database
20 - 60: Each course
70: Administrator system
80: Data input unit
90: Information communication equipment
100: Application

Claims (13)

The manager system uploads the data to the database of the main server, downloads the application to the information communication device and executes it, recognizes the image of the product through the information communication device, and displays various images such as video, sound, Video is displayed on an information communication device, the executed image is taken, the camera can be rotated 180 degrees, and the photographed image is automatically stored;
The product augmented reality system according to claim 1, wherein the application, the image, the sound, the moving image, and the 3D stereoscopic video are applied to various products including images registered in the main server, sound, moving images, and 3D stereoscopic video.
The method according to claim 1,
Wherein the display is controlled by the finger touch of the information communication device, the direction of the 3D screen is adjusted, all the images stored in the data base are simultaneously executable, and the 3D image is automatically executed as the 3D image when moving up, system.
The method according to claim 1,
The item manages a large amount of data by extracting the data requested by the application by using the object recognition system and the wireless transmission / reception system of images, sounds, moving images, 3D stereoscopic moving images of various genres registered and uploaded through the manager system, And a function for storing various data through a code and displaying various kinds of information simultaneously through an information communication device is mounted on the product augmented reality system.
The method according to claim 1,
The item is executed through an application of a communication device by using a unique recognition image of the product, an image, a sound, a moving image, and a 3D stereoscopic moving image through an application interlocked with a database equipped with the wireless transmitting / receiving function and the object recognition system, And the camera is photographed and stored.
The method according to claim 1,
Characterized in that the item is a product augmented reality displaying an image, a sound, a moving image, and a 3D stereoscopic moving image through a product recognition image and a code, which store a large amount of data stored in a database by executing an application in which an automatic login system is mounted system.
The method according to claim 1,
The item is characterized in that the 3D stereoscopic moving image displayed through the VIEW mounted on the application is moved by 120 degrees vertically and horizontally, and is executed, and the size of the image can be adjusted by a touch function.
The method according to claim 1,
Wherein the item is photographed after rotating the displayed image, sound, moving image, 3D stereoscopic moving image through the camera function mounted on the application by 180 degrees.
The method according to claim 1,
The item is provided with a character recognition image, a sound, a moving image, and a 3D stereoscopic moving image produced through a data input unit, and transmits the unique recognized image or code to the manager system. A product augmented reality system.
The method according to claim 1,
The item is characterized by a function of confirming whether a recognized image or code is matched by mounting each wireless transmitting / receiving function and an object recognizing system interlocked with a database and an application. Various items of characters, images, sounds, videos (Including stereoscopic images) is extracted and displayed through a view function of an application.
The method according to claim 1,
The product augmented reality system according to claim 1, wherein the item can be utilized for various products, and a unique recognized image or code is displayed on all products applied to various products.
A main server of the database is loaded with an image transmitting apparatus and a receiving apparatus and the image transmitted from the application through the object recognition system of the main server is matched with the image or code registered in the database to extract and transmit data, Stereoscopic movie production, and two-dimensional image, thereby assigning a unique image or code to a database through a manager system to register and upload various characters, images, sounds, moving images, and 3D stereoscopic videos;
Wherein the manager system receives data after receiving a unique recognized image code through a data input unit and registers data using an object recognition system to a main server, and confirms whether or not a code is matched between the manager system and a data input unit;
Wherein the application includes an image transmitting apparatus and a receiving apparatus, and further comprises a view executing means, a view photographing means, and a unique recognition image and a code recognition system;
Wherein the view shooting unit of the application is configured to be connected to a storage unit of the information communication device.
12. The method of claim 11,
The main server and the application allow the user to login after confirming the registered image, character, sound, moving image, 3D stereoscopic moving image, unique recognition image, code matching, and wireless connection. And determining whether or not the image code matches the image code.
12. The method of claim 11,
An application equipped with an image transmission device and a receiving device system, an object recognition system, a camera photographing means, an image storing means, a view image touch adjusting means, and a vertical / And downloading and executing the application through the network.

Images