KR101587985B1 - Goods Augmented Reality System - Google Patents

Abstract

The present invention relates to a product augmented reality application system mounted with various additional functions. The application system installs an application to distinguish a service of a main server usage part from a service of an application storage usage part, distinguishes the main server usage part of a main menu part from the application storage usage part through a control unit, and uses a corresponding service through an execution menu part and an execution window. Therefore, the system obtains a variety of economical effects.

Description

[Technical Field] The present invention relates to a product Augmented Reality System

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a product augmented reality application system and various products using the augmented reality application system equipped with various additional functions. More particularly, the present invention relates to a product augmented reality application system including various products such as clothing, various industrial products, catalogs, magazines, The image, mark, and letters on the market such as curtains, carpets, wallpaper, calendars, sheets, quilts, mats, interior goods, stoppers and lids, containers, card diaries, magnetic diagonal, wooden diagonal, toys, Images, marks, and characters of different shapes on the images, marks, and characters of the cards that are provided in the exterior or tack of the displayable products or on the inside of the product are displayed on the screen in a three-dimensional (3D) manner using an electronic communication device The augmented reality system is integrated with main server and application system so that it can be stereoscopically displayed. It relates to the revocation system.

The products of household goods that exist on the earth have been performing essential functions from the necessities of ordinary people's daily life, and the decorative function has been importantly demanded by the consumer as it has developed into a complicated present digital age. In addition, the products from the suppliers have educational, fun, and sentimental functions beyond these decorative features.

Therefore, there has been a need to develop various products as products that can satisfy them in the digital age, in which educational, functional, and sentimental functions are required as well as functions as essential products. In addition, due to popularization and radical development of electronic communication devices, each system linked to it has been developed and used easily.

For example, while technology development for smart devices as electronic communication devices capable of changing or expanding functions substantially through application programs in the information age has been rapidly developing, typical electronic communication devices include smart phones and smart Pad.

Augmented reality, in which a camera and a display are mixed, is becoming popular, and the augmented reality is a technique in which a three-dimensional (D) virtual image is superimposed on a real image, And it is used as an augmented reality application.

In the electronic communication device, the registration problem for matching the augmented reality, the real object and the virtual object has been mainly made, and it has been studied to transmit the knowledge about the information that the user can not actually feel through simple display, Beyond the delivery function, research and development are underway for various applications such as education, design, tourism, and industrial fields.

On the other hand, in the case of conventional augmented reality application technology in an application field of a product, attempts to acquire an actual image using a camera in an electronic communication device and to design a new three-dimensional image while directly confirming the acquired actual image are variously implemented .

In contrast, the augmented reality application technology developed by the present inventor includes patent applications No. 2014-69644 (product augmented reality system) and No. 2014-94869 (product augmentation application of augmented reality application), No. 2014-0109805 (Integrated application system that is directed to a product that combines augmented reality), No. 2014-177611 (integrated application system equipped with augmented reality and various additional functions) Images, marks, and letters are displayed on the exterior of the product so that the augmented reality can be executed in the mark, image, or character of the augmented reality.

Here, the product is a product that displays images or marks, various industrial products, catalogs, magazines, flyers, books, curtains, carpets, wallpapers, calendars, sheets, quilts, mats, interior goods, stoppers, lids, , Images, markings, letters, etc. of the card, which are provided inside the product or in the appearance or tag of all products that can display images, marks, and letters on the market, such as wooden pens, toys, teaching materials and wrapping paper,

The present invention stores a variety of educational, amusing and emotional data in an augmented reality application and is connected to an Internet service through an image, a mark or a letter of the corresponding product, or is matched with an image, a mark, Image, text, video, 2D, and 3D video to be displayed on the screen of the electronic communication device.

 However, in the integrated application system developed by the inventor of the present invention, in which a product augmented reality system is combined with an augmented reality application, a product incorporating an augmented reality and an integrated In the application system, the system using the main server and the system using the storage of the application, the integrated system using the main server and the application, is an application system equipped with various additional functions through the Internet connection. In the product augmented reality system, It is possible to implement augmented reality and activate various services according to communication environment.

The augmented reality system equipped with the various additional functions of the present invention and various products that combine the augmented reality system of the present invention can be used in a variety of languages through various images, marks, and characters matched with images, marks, Patent Application No. 2014-69644 (Product Augmented Reality System) which can be used to access, access various contents, access various services, or use various additional functions related to displayed images, texts, moving pictures, 2D and 3D stereoscopic video, And 2014-0109805 (integrated application system directed to a product incorporating augmented reality), No. 2014-177611 (augmented reality system), Patent Application No. 2014-94869 And an integrated application system with various add-ons), we are able to offer a variety of services Thereby providing convenience and diversity to the user, and providing the service to the user through the continuous management of the advertisement effect and the sales increase to the provider.

Therefore, the present inventors have found that a product combining a product augmented reality system with an augmented reality application, a product augmented reality system, a product combining an augmented reality and an integrated application system equipped with various additional functions, By making an integrated system that has been improved to be displayable, it is possible to select a language, a content, and a service through images, marks, and letters displayed on a product in an electronic communication device through images, marks, and letters of the product, , Video, 2D and 3D stereoscopic video, as well as a variety of add-ons, games, language learning, content creation, and a variety of additional features.

By combining this with a variety of applied products, not only simple functions as a product but also continuity and diversity of educational functions, continuity and diversity of entertainment functions, continuity and diversity of auditory functions, as well as simple functions as a corresponding product, By providing various functions that can not be enumerated as well as functions and enhancing the satisfaction, providers can expect the role of advertiser through the users who use the product, thereby enhancing the competitiveness of the product, By offering products that can be combined with current and up-to-date IT environment, users who use smartphones or tablet PCs will be able to produce products that provide many services by continuously managing various effects such as advertising effect, It is considered to be based on .

Accordingly, the present invention has been made in view of the above circumstances, and it is an object of the present invention to provide an augmented reality realizing a service using a main server specified through augmented reality equipped with various additional functions, And augmented reality equipped with a variety of additional functions, and a variety of products that combine them, it is possible to display images or marks of cards, The user can directly connect to an Internet page through a character or perform simple installation so that the user can select a language, a content, and a service through an image, a mark, and letters displayed on the product through an image, a mark, , Associated images, text, video, 2D and 3D stereoscopic video It also combines various functions such as game play, language study, content creation, etc. through various add-ons which are combined with various applied products, so that not only the simple functions as the corresponding products but also the continuity and diversity of educational functions As well as continuity and diversity of entertainment functionality, continuity and diversity of sentimental functionality, as well as the lowest cost to the user.

It is an object of the present invention to provide a product that can expect a role of advertising through a user who uses a product to a provider, thereby enhancing the competitiveness of the product, enhancing the added value of the product, It is based on producing products that provide a lot of services by continuously managing various effects such as increase of advertisement effect and sales direction or improvement direction through users who use smart phone or tablet PC.

It is another object of the present invention to provide an augmented reality equipped with various additional functions and a variety of products that combine the augmented reality with a user's convenience and various services at low cost so that the education cost, And can provide the system and product that can reduce the burden of educational expenses and dramatically reduce exposure of harmful environment of communication device by making it possible to use this service easily at home and outside to provide services that can satisfy both children and parents have.

It is another object of the present invention to provide an image processing apparatus and method which allow a user to input an image, a mark, a character and an augmented reality image through an image, a mark, When the application is selected, it is automatically downloaded through the electronic communication application selection button. Various downloaded contents linked with images, marks and letters are automatically stored in the SD card of the application and the electronic communication device, It is possible to freely use various kinds of characters, images, sounds, moving pictures, and various buttons or touches linked with 2D and 3D stereoscopic moving images displayed through letters, regardless of the communication environment, (For example, in the mountains or in a foreign country) A variety of additional features and combines them with an augmented reality system to be used without the two limits can provide a variety of products.

It is still another object of the present invention to provide a method and system for displaying a 2D image on a screen of a product through the use of an electronic communication device through an application having various additional functions, 3D images can be displayed and animated by touching or adjusting the 3D stereoscopic movie to adjust various functions such as resizing, orientation, movement, rotation, and change of appearance. , 3D stereoscopic video can be selected and heard in various matching languages, and a variety of contents can be provided through one image, mark, and letter displayed on the product, so that users can purchase the same product A variety of contents can be provided.

In order to accomplish the above object, the present invention is characterized in that a service of a main server using unit and a service of an application storing and using unit are distinguished in a main menu through a function executing unit equipped with various additional functions and an electronic communication device In the application in which the function execution unit of the augmented reality equipped with various additional functions to be installed in the electronic communication device and the additional function to be added to various products combined with the function execution unit of the augmented reality installed in the application are installed in the application, And an application storing and using unit, and configured to use the corresponding service through an execution menu unit and an execution window; Through the images, marks, and letters displayed on the product, users can select language, content, service, and various additional functions that combine displayed image, text, video, 2D and 3D stereoscopic video with related Internet pages, Game, language study, content creation, and various functions of resizing, orienting, moving, rotating, and changing the appearance are displayed on the product by touching or adjusting the displayed 2D and 3D stereoscopic video. 2D and 3D in a lively manner.

In addition, you can select and listen to images, texts, videos, 2D and 3D stereoscopic videos displayed in the product in various languages that are matched with each other, and you can listen to various contents through a single image, So that the user can receive various contents from the same product without purchasing additional items.

Service use through the main server using part in the main menu part of the main server use part and application storage use part can use massive data without downloading but the communication environment must be supported; In the case of the application storage usage part, additional data other than the data initially loaded must be downloaded and used by the user. However, since the downloaded contents can be freely used regardless of the communication environment, the user can broaden the selection range, Various choices can be made depending on the device environment.

A variety of installation of selection buttons and selection buttons, various installation of checkboxes and checkboxes, installation of optional parts of the main server use part and application usage part by using the function execution part equipped with various additional functions of the main menu part, the execution menu part and the execution window Configured to use; By integrating augmented reality with the existing electronic communication devices and installing an integrated application system equipped with various additional functions, it is possible to connect directly to the Internet through applications mounted on images, marks and letters of various products, You can adjust the size, orientation, movement, rotation, and appearance by touching or adjusting the displayed 2D and 3D stereoscopic video by combining various functions such as game, language study, Through the various functions of the change, it is possible to realize live 2D and 3D displayed in the product.

In addition, you can select and listen to images, texts, videos, 2D and 3D stereoscopic videos displayed in the product in various languages that are matched with each other, and you can listen to various contents through a single image, So that the user can receive various contents from the same product without making additional purchases.

In the application, various buttons and checkboxes are added through images, marks and letters by using the function execution part equipped with various additional functions of the main menu part, the execution menu part and the execution window so that the user can easily and variously use the system So; You can use various installed checkboxes, select buttons to play games, study language, and create content. You can touch and adjust 2D, 3D stereoscopic videos to adjust size, , Rotate, and change the appearance of the product through a variety of functions, the live 2D and 3D can be implemented live.

In addition, you can select and listen to images, texts, videos, 2D and 3D stereoscopic videos displayed in the product in various languages that are matched with each other, and you can listen to various contents through a single image, Augmented reality system equipped with a variety of additional functions that provide various additional functions to allow users to receive various contents from the same product without making additional purchases, and various products that combine them.

Another specific feature of the present invention is to provide various additional functions directed to a product incorporating a product augmented reality in an electronic communication device such as a smart phone through images, marks, and letters of various types of images, When an integrated application with various additional functions installed in an electronic communication device is executed, an integrated screen application is created, and the user can immediately use the service through the button of the generated initial screen, The content to be stored in the application storage unit is downloaded through the selected selection button. When the downloaded content is used again later, the content is accessed by accessing the application storage unit without accessing the main server, Or modified content automatically Or you can choose to install if you use a content download untested is available via download after the selection box asking if you re-download or check boxes.

Automatic download installation or selective download is not supported in environments where communication is not supported, but existing downloaded contents can be used regardless of communication environment.

The present invention relates to an augmented reality system displaying a mark, an image and a character of different characteristics in various products, and a variety of 2D and 3D images displayed through a variety of products combining the augmented reality system with various additional functions, You can use various functions such as making, resizing, listening, and creating. You can add various functions such as language listening, viewing, conversation view and listening by selecting check boxes or selecting buttons. It also adds a checkbox function to allow users to simultaneously use newly updated content as well as existing content in the same product through frequent updates.

These additional functions are combined with the augmented reality system equipped with a variety of additional functions and the augmented reality system equipped with various additional functions for various purposes such as appearance of various products combined with the images, images, marks and letters displayed inside It is a variety of products.

The augmented reality system equipped with the various additional functions of the present invention and various products that combine the various augmented reality systems of the present invention not only improve the completeness of the system, but also widen the selection of the user and increase diversity and persistence, educational performance, education cost reduction, It is combined with augmented reality system equipped with a variety of additional functions to provide a variety of sales and management effects such as price enhancement, duplication management, product sustainability, diversity, and sales increase, as well as various use effects such as enhancement and interest inducement. There is a variety.

As described above, according to the present invention, since the recent communication environment is changing very rapidly, and electronic communication devices capable of making various selections by users are popularized, users can select various services according to their communication environment and situation The augmented reality system equipped with various functions and various additional functions of electronic communication devices and various products that combine these functions are expected to expand the choices of users while diversifying and continuing, It has various sales and management effects such as cost competitiveness enhancement, duplication management, product sustainability, diversity, sales increase, etc., as well as various use effects such as blocking against harmful environment, concentration strengthening and interest inducement, Functional, entertaining, and sentimental features, as well as a broader approach to product Power, Sales Effectiveness, reproduction management, can achieve a variety of economic benefits such as increase in diversity, for both users as well as providers will be beneficial to add a variety of product features and combines them with a variety of augmented reality system that can be together.

The present invention, in view of these effects, functional and service aspects, can be applied to a variety of products that show decorative features and products in the appearance of the product, and which are combined with augmented reality equipped with various additional functions It is linked with the augmented reality application of the application system equipped with the product and the various additional functions, and various image, sound, video, 2D and 3D stereoscopic video are displayed on the actual product through the electronic communication device, It also combines various functions such as game play, language study, content creation, etc. through various additional functions that are combined with various applied products, so that the continuity and diversity of educational functions as well as the simple functions as the corresponding products Of course, continuity and diversity of entertainment functionality, And versatility, as well as users can be provided through the budget.

In addition, it provides providers with the ability to anticipate their role in advertising through the users who use the product, thereby enhancing the competitiveness of the product, providing products that can add value to the product and combine with the current IT environment, Or tablet PC users, it is based on producing products that provide a lot of services by continuously managing various effects such as increase of advertisement effect, increase of sales, or improvement direction.

The various products incorporating the augmented reality application of the present invention are products that can perform educational functions, entertainment functions, and sentimental functions while being living goods, and they can be used for various images, sounds, movies, 2D and 3D stereoscopic The video is displayed, and various functions such as game, language study, contents creation are added through the various additional functions that are linked with the internet page which is linked to, and it is combined with various applied products. Not only continuity and diversity of educational functions, continuity and diversity of entertainment functions, continuity and diversity of sentimental functions, but also the lowest cost to users can be provided.

In addition, it provides providers with the ability to anticipate their role in advertising through the users who use the product, thereby enhancing the competitiveness of the product, providing products that can add value to the product and combine with the current IT environment, And tablet PC users, it is possible to provide users with a variety of services such as educational effects, entertainment functions, appreciation It has the effect of reducing the cost of education, cost of education, diversity of content, and enhancing competitiveness, increasing value added, advertising effect, and increasing sales for providers. Various production activities can be actively carried out through these systems.

In view of practicality, the present invention is applicable to augmented reality integrated with an application system that incorporates augmented reality equipped with various additional functions adopted as a variety of products, including education, entertainment, In addition to the effect of diversity of contents, providers can enhance competitiveness, increase value-added, advertisement effect, increase sales, and perform services by providing educational, entertainment, , The reduction of education costs, the effect of diversity of contents, and the effect of reducing the purchase price of equipment will be very helpful to the household economy.

The present invention is economical because it does not require purchasing a separate product that exhibits an educational function, an entertainment function, or a sentimental function, and a product that can be actually used exhibits an educational function, an entertainment function, and a sentimental function It is not only practical, but also provides a variety of information and services selected by a provider through augmented reality applications with various additional functions.

As a result of examining the effects of the products incorporating such augmented reality in terms of production, distribution, and value, images, marks, and letters adopted in the present invention use images, marks, and characters in existing products as they are, It is possible to suppress the appearance of counterfeit goods through the application of general functions, educational functions, entertainment functions and sentimental functions as products and various additional functions, and to contribute to diversity of products and establishment of fair trade order.

FIG. 1 is a diagram illustrating an application system for executing various products incorporating an augmented reality equipped with various additional functions for implementing the present invention.
FIG. 2 is a diagram for explaining an electronic communication device incorporating an augmented reality application according to an embodiment of the present invention in an application system equipped with various additional functions of the present invention;
FIG. 3 is a diagram illustrating an example of an application system for executing a variety of products incorporating augmented reality equipped with various additional functions manufactured in order to implement the present invention. A production diagram and an explanation for manufacturing a main server for an application system for executing various products incorporating an augmented reality equipped with an additional function,
FIG. 4 is an explanatory diagram for producing data for a main server and data of an application storage unit, which are produced for executing the present invention, in an application system for executing various products incorporating an augmented reality equipped with various additional functions of the present invention;
FIG. 5 is a flowchart illustrating a product display system incorporating an augmented reality application according to an embodiment of a product display system in an application system equipped with various additional functions of the present invention;
FIG. 6 is a driving flowchart for explaining an augmented reality system according to an embodiment of an application system for executing various products incorporating an augmented reality on which various various additional functions of the present invention are incorporated;
FIG. 7 is an explanatory view for explaining various functions adopted for using an alphabet menu in an application system equipped with various additional functions through various products that combine an augmented reality in an application system equipped with various additional functions of the present invention;
FIG. 8 is an explanatory diagram for explaining various functions adopted for using a Hangul menu in an application system equipped with various additional functions through various products that incorporate augmented reality in an application system equipped with various additional functions of the present invention;
FIG. 9 is an explanatory diagram for explaining various functions adopted for using a question and answer menu in an application system equipped with various additional functions through various products that combine augmented reality in an application system equipped with various additional functions of the present invention ,
FIG. 10 illustrates various functions adopted for using the basic, intermediate, and advanced conversation menus in an application system equipped with various additional functions through a variety of products incorporating augmented reality in an application system equipped with various additional functions of the present invention FIG.
FIG. 11 is an explanatory diagram for explaining various functions adopted for using an agitation dynamic menu in an application system equipped with various additional functions through a variety of products incorporating augmented reality in an application system equipped with various additional functions of the present invention ,
FIG. 12 is a view for explaining various functions adopted for using a menu together with a character in an application system equipped with various additional functions through a variety of products incorporating an augmented reality in an application system equipped with various additional functions of the present invention Degree,
FIG. 13 is an explanatory diagram for explaining various functions adopted for using a menu in an application system equipped with various additional functions through various products that incorporate an augmented reality in an application system equipped with various additional functions of the present invention to be.

Hereinafter, the contents of the patent application No. 2014-177611 of the present applicant (integrated application system equipped with augmented reality and various additional functions) will be described together, and the added contents will be described. An example will be described in detail with reference to an example figure.

Here, the product is a catalog, magazine, flyer, book, curtain, carpet, wallpaper, calendar, sheet, quilt, mat, interior goods, stopper and lid, Means images, marks, letters, etc. of the cards or images that are displayed on the market, such as diapers, toys, textbooks, wrapping paper, tags, etc.,

FIG. 1 is a block diagram illustrating an augmented reality application system equipped with various additional functions for implementing the present invention. An application 200 of an electronic communication device 400 is connected to a transmission device 202 The main server 100 is connected using the receiving device 204 and the object recognition system 201 so that the images, marks and characters displayed on the product 300 are targeted and recognized through the viewers .

The application 200 includes an application storage unit 203; A main menu part 220, an execution menu part 230 and an execution window 240 of the function execution part 205 having various additional functions are built in the main server 100. The main server 100 includes a database 130, (120) and a receiving apparatus (110).

FIG. 2 is a diagram illustrating an electronic communication device incorporating an augmented reality application according to an embodiment of the present invention in an application system equipped with various additional functions of the present invention. In the electronic communication device 400 connected to the Internet, The application 200 of the product 300 recognizes images, marks and characters displayed on the product 300 through the object recognition system 201. [

The control unit 210 is provided with a transmission unit 202, a reception unit 204, an object recognition system 201, an application storage unit 203, an SD (Secure Digital) card, a device 212, The storage unit 208 is connected to the function executing unit 205, the Internet connecting unit 207, the screen unit 206, the mounting function unit 208 which is various basic functions of the communication device, Gallery for photo storage and DCIM (Digital Camera IMAGES: 211) are connected.

3 is an explanatory diagram for producing data of the main server using unit and data of the application storage unit, which are produced to implement the present invention, and an application 200 in which various additional functions are installed in the electronic communication device 400 for executing the data .

The application 200 includes a function execution unit 205 having various additional functions, which includes a main menu unit 220 of the main server use unit 222 and an application storage usage unit 224; An execution menu portion 230 of the main menu 232, the submenu 234, the selected contents 236, and various menu buttons 238; And an application execution window 240 for the contents rotation button 242 and the reset button 244 for 360 degrees rotation.

The main menu 232 is a more content selection button along with an alphabet, a Hangul, a fairy tale and a shake check box, a dinosaur and an African animal, a question and answer, a beginner / intermediate / advanced conversation, Vegetable fruit, object 1, object 2, and more, and the selected contents 236 are buttons for 2D, 3D, and real image of buttons and contents of English, Chinese, Hangul and continuous listening of the language.

The update can be executed automatically or selected by the user. Free content can be used free of charge in real time by using the select button. Data used through additional purchase can be used as main server data after payment.

The menu button 238 activates and closes the camera, camera rotation, homepage, return, home screen, and exit menus. You can make various selections through the check box in the content execution, and in this case, only selected contents are selected and executed.

You can edit the color and shape of the content by touching it without touching for a few seconds. You can also touch it to move it vertically and horizontally, or adjust its size with two fingers.

The present invention configured as described above can be applied to a variety of products 300, that is, clothes, various industrial products, catalogs, magazines, handbags, books, curtains, carpets, wallpapers, calendars, All products that can display images, marks, and letters on the market, such as interior goods, caps, lids, containers, cardholder, magnetic diagonal, wooden diadem, toys, Various services can be used by using an electronic communication device as an image, a mark, or an image or a mark as a card of a provided card.

A variety of internet services can be utilized such as Patent Application No. 2014-177611 (integrated application system equipped with augmented reality and various additional functions), and a wide range of services can be provided through images, marks and letters of the product 300 The data of the augmented reality main server storage unit (not shown) and the data of the application storage unit 203 are combined with the product augmented reality system so that the information can be displayed stereoscopically and variously on the screen, And an application system equipped with various additional functions directed to the product 300 combining the augmented reality application 200 in the mobile terminal 400.

That is, the present invention can be applied to various products 300 or display an image, a mark, and characters displayed on the product 300, and to display the object recognition system 201 in the application 200 of the electronic communication device 400 Character, moving image, 2D, and 3D stereoscopic moving image, which are separately produced in association with the image, mark, and character recognized through the function execution unit 205, The user may select limited data of the application storage unit 203 in the electronic communication device 400 and use the various image data of the Internet image, Let text, video, 2D, and 3D stereoscopic video be displayed.

In addition, the present invention can use many services through the same image, mark, and letter through various selection boxes or check boxes in the application main menu 220, the execution menu 230, or the execution window 240, The user adjusts the size of the stereoscopic moving image by using the touch function of the screen unit 206 of the electronic communication device 400 and rotates the stereoscopic moving image vertically and horizontally when the user moves the stereoscopic moving image, You can exchange, image, ask and answer in images, mark, and letters. You can also study Hangul, and you can choose various content services from the same image or mark.

In addition, the data stored in the application 200 can be updated or unnecessary data can be deleted, services such as a question and answer and a role play can be recorded and reproduced, so that the service can be used more repeatedly and effectively, Entertainment function and sentimental function through the screen unit 206 in the electronic communication device 400, it is possible to increase the value of the product 300 and enhance the sales effect, It is possible to provide convenience to the user and to reduce the cost of education and diversity and at the same time to help the home economics and to enable the augmented reality to be displayed smoothly in the electronic communication device 400 through the selective service according to the communication environment, Augmented reality is applied to various products according to the spread of the communication device 400, In the application 200, which is directed to the combining augmented reality about what products to a new application system that combines a variety of additional features.

When the main server using section 222 of the main menu section 220 or the application storage use section 224 is selectively executed by the control section 210 in the application 200 executed in the electronic communication apparatus 400, The user can move to an internet page through a URL linked to an image or a mark on the screen 206 of the electronic communication device 400 through the image, mark, or letter displayed on the product 300, The video is being displayed.

At this time, it is possible to move to a service to be used through various menu buttons of the application main menu 220, the execution menu 230 and the execution window 400, and to the service moved to the execution menu 230, Checkboxes such as role play, character decoration, live view, and character view, and check boxes of languages such as English, Korean, Chinese, Japanese, , And 3D stereoscopic video.

In addition, it is an application 200 system that allows a user to select a service suitable for a communication environment of a user, as well as to utilize a large number of services that can not be counted in one product 300, thereby widening a selection range.

Accordingly, the present invention can be applied to an application (200 (1)) that displays images, marks, and characters separately made on the external appearance of a product (300) Through an image or mark of the product 300 recognized by the object recognition system 201 of the application 200 or an image or mark to be executed in the application 200 linked with the character, You can use the services you want through the management functions and the usage functions such as, below, update selection, automatic update, and deletion of downloaded data.

In addition, the augmented reality application 200 in which a variety of images, texts, moving images, 2D and 3D stereoscopic moving images of the selected contents 236 produced by the inventor can be added is installed in the augmented reality application 200, A check box such as a role play, a character decoration, an actual view, a character view, and a check box of a language area such as English, Korean, Chinese, Japanese, , Text, video, 2D, and 3D stereoscopic video are displayed, and various kinds of user can be used by connecting the displayed image, text, video, 2D and 3D stereoscopic video and various additional functions.

Various selection buttons and checkboxes that are not mentioned here can be changed in various forms according to the service to be provided. It can be updated frequently through the hidden menu or more menu, In addition, it can be continuously applied to the surrounding environment.

In addition, not only the displayed image, character, moving image, 2D and 3D stereoscopic moving image are captured and stored, the size is adjusted through the touch function of the screen unit 206, A large number of contents are displayed, each content can be adjusted through a touch, and a function to add various functions such as a recording / playback function according to a menu is added, thereby providing various complex effects can do.

It has educational effect, entertainment function and sentimental function as well as various additional effects and functions such as education cost reduction, continuity of education, and storytelling of the contents displayed. , Expansion of sales channels, and management of replicas.

The augmented reality is displayed smoothly in the electronic communication device 400 through the selective use of various services according to the communication environment and the augmented reality is applied and applied to various products according to the spread of the electronic communication device 400 (200) system equipped with a variety of additional functions directed to a product incorporating augmented reality related to the product, and various products combining the system.

When an application is executed in the electronic communication device 400, the main server use unit 222 of the main menu unit 220 is operated under the control of the control unit 210. [ And the application storage usage part 224 to move to the application execution menu part 230. [

After selecting the main server using unit 222 from the control unit 210 and selecting a menu to be used in the execution menu unit 230 of the electronic communication device 400, the object recognition system 201 installed in the application 200 is automatically executed The viewing function linked with the camera function of the electronic communication device 400 is automatically executed.

The control unit 210 of the application 200 recognizes an image, mark and character of the product 300 through the view and object recognition system 201 and acquires the target through the main server using unit 222 100) and transmitted to the application 200 to be executed. When the main server utilization unit 222 is used, the update item proceeds only by updating the pass menu item of automatic update and manual update.

When the user selects a menu to be used in the execution menu section 230, the control section 210 of the application 200 selects the application storage use section 224 of the main menu section 220, If the download is not confirmed after confirming that the item is downloaded to the storage unit, a download data request is made through the database 130 of the main server 100 and the download data is requested through the transfer device 120 of the main server 100 To the receiving apparatus 204, and the application receiving apparatus 204 stores it in the application storing unit 203 and prepares for use of the service.

When the download is confirmed in the application storage unit 203, the service is prepared to be available to the storage unit 203 after the download is confirmed. When the preparation for using the content is finished, the object recognizing system 201 and the viewer are automatically executed, and the image, mark, and character displayed on the product 300 are confirmed and acquired and the matched data of the storage unit 203 is extracted, ) To use the service.

When each service is selected in the execution menu window 230 when the application is executed, the update window is displayed on the pop-up window and the user can select and install the service through Yes or No. In addition, in the case of the automatic update, when the application 200 is executed, it can be automatically updated together with the guiding text to be executed.

Images, characters, moving images, 2D and 3D stereoscopic moving images are displayed through an image, a mark, and letters of the product 300, or are created by a job manager through a generated selection button or a check box The application control unit 210 can check and use the data of the main server storage unit or the application storage unit.

An application system equipped with various additional functions may be manufactured by mounting the main server use unit 222 and the application storage usage unit 224 of the main menu unit 220 or only the main server use unit 222 by the requester, Or application storage and use unit 224, and publish it to the Google Play Store or the Apple App Store so that users can download it for free and install it on the electronic communication device.

The augmented reality according to the image, mark, and character recognition of the product 300 may be installed so that the first screen is immediately executed when the application is executed, or the main server use button and the application use button are separately installed and selectively used so that the augmented reality is displayed When an application 200 having various additional functions is executed, an application-specific window is executed, and if an update item exists, an automatic update window is created so that a consumer can selectively install an update item. In addition, It is an application system with various add-ons.

Accordingly, the control unit 210 of the integrated application having various additional functions is divided into a main server use unit 222 of the main menu unit 220 and an application storage usage unit 224, And a check box is provided so that the user can use the service by using various additional functions through images, marks, and letters of the product 300 at the time of execution of the application 200 As shown in FIG.

The main server using unit 222 of the main menu unit 220 operates as the transmitting apparatus 202 and the receiving apparatus 204 and acquires the target through the recognition function of the object recognition system 201 to transmit and receive data The application storage usage unit 224 operates as the transmission device 202, the reception device 204 and the application storage unit 203 and receives the data selected by the control unit 210 and stores the received data in the application storage unit 203 And extracts the target data from the acquisition storage unit 203 through the object recognition system 201 and executes the extracted data.

Images, characters and characters displayed on the product 300 through the function execution unit 205 of the application 200 equipped with various additional functions, and images or characters , A moving image, a 2D and a 3D stereoscopic moving image, and the like, for example, a function executing unit 205 equipped with various additional functions.

A check box such as asking, answering, role playing, character decorating, actual view, character view, and a check box of a language area such as English, Korean, Chinese, Japanese, Images, texts, moving images, 2D and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400 through the display unit 205. The stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400, The user can use variously.

In addition, various selection buttons and checkboxes that are not mentioned can be changed in various forms according to the service to be provided. It can be updated frequently or can be used by the main server through a hidden menu or a more menu. In addition, it can be continuously applied to the surrounding environment.

The control unit 205 photographs and stores images, texts, moving images, 2D and 3D stereoscopic moving images displayed in the function executing unit 205 and controls the size of the stereoscopic moving images by using the touch function of the screen unit 206 in the execution window 240, And 360 degrees in the vertical, horizontal, and left directions. At the same time, a large number of contents are displayed and each content can be adjusted through a touch. By adding a function of recording and reproducing according to a menu, You can provide a variety of complex effects that do not end in a role.

The function execution unit 205 of the application having the various additional functions of the present invention will be described in detail. An application function execution unit 205 having various additional functions mounted on the application 200 is created and displayed on a Google play or App Store The main server use section 222 and the application storage use section 224 of the main menu section 220 are created on the initial screen and the main server application is created and posted to be executed, It is executed by making and publishing an application for storage use.

When the function execution unit 205 equipped with various additional functions of the present invention is executed, an update use unit is created on the first screen of the application execution of the main menu unit 220, and the user selects an update through yes or no, This is running automatically.

The main server using unit 222 of the main menu unit 220 is moved to the application execution menu unit 230. When the user selects the usage item in the execution menu unit 230, Marks, and characters displayed on the product 300 are sent to the control unit 210 through the object recognition system 201 of the application 200, and the images, marks, and characters recognized through communication with the database of the main server through the communication network, Characters that are directly connected to the Internet service through a URL or transmitted to an image, a character, a moving image, a 2D image or the like interlocked with a recognized image, mark, or letter are transmitted to the execution window 240 through the application control unit, 3D stereoscopic moving images and the like to the display execution window of the electronic communication device 400 through the control unit 210 and displays the screen 206 together with various additional functions of images, characters, moving images, 2D and 3D stereoscopic moving images, The manifestation of that document.

The user selects the application storage use unit 224 of the main menu unit 220 and moves to the application execution menu unit 230. When the content to be used in the execution menu unit 230 is selected, 203 and there is no content downloaded to the storage unit 203, the content is requested and downloaded through the main server application using unit through the communication network. The downloaded content is automatically stored in the application storage unit through the control unit 210 and prepared for use of the content.

Similarly, if there is a download item in the storage unit 203 through the control unit 210 after selecting the content to be used in the execution menu unit 230, the content in the storage unit 203 is activated and ready for content use. When the preparation for use is completed, the viewer and the object recognition system 201 are automatically executed to recognize images, marks, and characters displayed on the product 300 through the viewer and obtain the acquired images, marks and characters through the object recognition system 201 Is sent to the application execution window 240 to be displayed.

Text, video, 2D, 3D stereoscopic video, and the like displayed in the execution window 240 through the main server use unit or the application storage use unit of the main menu unit 220, , And the service can be used in connection with various additional functions created by linking images, texts, moving images, 2D and 3D stereoscopic moving images, and the like in the data production department in advance.

In the execution menu part 230, various additional functions include check boxes such as asking, answering, role playing, character decorating, real view, character view, and check boxes of languages such as English, Korean, Chinese, Japanese, Characters, moving images, 2D, and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400, and various contents displayed on the execution window 240 can be moved or resized, Rotation, recording and playback, download data management, and various other add-ons that are linked to various update items that have not been described.

The updated communication environment must be supported. The updated items are automatically installed in the application 200 equipped with various additional functions or automatically stored in the application storage unit 203, and the application items are automatically generated, The user can utilize the various services through the images, marks, and letters of the product 300 using the infinite data or the stored data regardless of the communication environment.

Therefore, the application 200 equipped with various additional functions not only can utilize vast amount of data in the communication environment, but also can freely use the downloaded data without supporting the communication environment. Various functions of a product incorporating an augmented reality and an application system equipped with various additional functions will be described in detail with reference to FIG. 3 and FIGS. 7 to 13, which will be described later.

The description of making the application storage unit 203 and the application system on which various additional functions are installed is not limited to the contents (e.g., content) linked to the image, mark, or letter of the product 300 produced by the data production unit And creates data to be linked to an application having various additional functions to be executed, and stores the data in the main server 100 through the manager system 500 shown in FIG.

Application storage By downloading data through the use section, we have created an application system equipped with a variety of products incorporating augmented reality and various additional functions to execute it, and posted on the Google Play store, Apple app store, and various stores as shown in FIG. So that the user can download it for free and automatically install it in the application 200 of the electronic communication device 400.

In the automatically installed application system, a dedicated icon is generated in the main window 206 of the screen 206 of the electronic communication device 400, and the created application is executed by touching the generated icon. When the application 200 is executed, the server common application asks whether the main server 220 uses the main server and whether application storage is available, moves to the execution menu 230 after selection, or immediately executes And moves to the menu unit 230.

When the detail menu is entered through the content selection button in the execution menu 230, the corresponding menu button is selected by using the main menu 232, the detailed menu 234, the selected contents 236, and various menu buttons 238 Services are available.

A check box is generated as the submenu 234 through the main menu 232. When the main menu 232 and the submenu 234 are selected after the check box is selected, The content to be used is checked in the application storage unit 203 and if there is the downloaded content in the storage unit 203, the application is immediately moved to the application execution window 240. If there is no downloaded data, ) Will be requested to use the data.

The main server 100 transmits the requested data through a communication network, and the control unit 210 of the application 200 downloads the data and stores the downloaded data in the application 200 automatically. When the download is completed, the data is activated and then moved to the application execution window 240.

When the application execution window 240 is executed, the viewer and the object recognition system 201 are automatically executed to prepare for execution of the service through the images, marks, and characters displayed on the product 300. When the image, mark, and character displayed on the product 300 are viewed through the viewer, the object recognition system 201 recognizes the object, acquires the matching content in the application storage unit 203 through the control unit 210, (240).

The application execution window 240 displays an image, a character, a moving image, a 2D image, a 3D stereoscopic moving image, and the like displayed through the check box exemplified in the detail item of FIG. 3 by various additional functions generated on the displayed screen part 206 . Details of various additional functions will be described in detail with reference to FIGS. 7 to 13. FIG.

The application storing unit of the main menu 220 can freely use the downloaded data regardless of the communication environment if the communication environment is supported only during the initial downloading. However, since only limited data is used, And can not use vast amounts of data.

Therefore, if the server use unit of the main menu unit 220 and the application storage use unit are simultaneously mounted to produce an application system equipped with various additional functions, the user can use various functions regardless of the communication environment, A wide variety of data can be used.

In addition, a product incorporating augmented reality and an application system equipped with a variety of additional functions can be applied to a variety of products 300, i.e., clothing, various articles of commerce, magazines, advertisements, books, curtains, carpets, It is possible to display images, marks and letters on the market such as wallpaper, calendar, sheet, quilt, mat, interior goods, stopper and lid, container, card diary, magnetic diagonal, wooden diagonal, toy, Text, video, 2D image directly connected to the Internet by directly connecting the image, mark, letter and URL of the card provided in the appearance or tag of all products or the card provided in the product, , And the displayed service linked to the various additional functions created by connecting the 3D stereoscopic moving image data in advance (refer to FIG. 4).

Here, the various additional functions include check boxes such as asking, answering, role playing, character decorating, real-time viewing, and character viewing in the function executing unit 205 and check boxes of language areas such as English, Korean, Chinese, Text, moving images, 2D and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400 via the communication unit 400. Various contents displayed on the screen can be moved, resized, rotated 360 degrees, Download data management, and various other additional functions that are not described in various update items.

3, a description of an application system equipped with various additional functions using the vast amount of data of the main server includes various additional functions associated with an image, a mark, and letters of a product manufactured by a data production unit (see FIG. 4) And creates data to be linked to the application having various additional functions to be executed thereon, stores it in the main server through the manager system, and realizes the augmented reality in real time without downloading the data through the main server utilization part An application system equipped with a variety of products and various additional functions to be executed thereon is produced and posted on a Google Play store, an Apple app store, and various stores so that a user can download it for free and automatically install it in an electronic communication device (refer to FIG. 5).

In the automatically installed application system, a dedicated icon is generated in the main window 206 of the screen 206 of the electronic communication device 400, and the created application is executed by touching the generated icon. When the application 200 is executed, the main server common application asks whether the main server 220 uses the main server and whether application storage is available, moves to the execution menu 230 after selecting it, And then moves to the immediate menu part 230. In the execution menu view 230, when a detail item is entered through the content selection button 236, a service can be used by selecting a submenu button.

A check box is created in the execution menu part 230 such as the main menu 232 and the detailed menu 234. When the check box is selected and the contents are selected in order of the main menu and the detailed menu selected, It is executed automatically. The automatically executed application 200 is automatically executed by the viewer and the object recognition system 201 to prepare for viewing and recognizing images, marks, and characters of the product 300.

When the image and the mark of the product 300 are recognized through the viewer and the object recognition system 201, the main server 100 transmits the target acquired through the control unit 210 to the main server 100, And transmits the matched content to the control unit 210 to be displayed in the application execution window 240. The application execution window 240 can utilize various displayed images, characters, moving images, 2D and 3D stereoscopic moving images, and the like through various additional functions created on the displayed screen through the check box illustrated in the detail item of FIG. 3 . Details of various additional functions will be described in detail with reference to FIGS. 7 to 13. FIG.

This application system using the main server utilization unit 222 must be supported in a communication environment and can not use this application system unless a communication environment is supported. Accordingly, if the main server use unit of the main menu unit 220 and the application storage use unit are mounted simultaneously to produce an application system equipped with various additional functions, the user can use various functions regardless of the communication environment, A wide variety of data can be used.

The data of the main server 100 additionally supports a large amount of data that can not be supported by the service using the application storage usage part 224 among products incorporating the augmented reality and application systems equipped with various additional functions, It can broaden the width and provide various kinds of services required by the user.

In addition, a product incorporating augmented reality and an application system equipped with a variety of additional functions can be applied to a variety of products 300, i.e., clothing, various articles of commerce, magazines, advertisements, books, curtains, carpets, It is possible to display images, marks and letters on the market such as wallpaper, calendar, sheet, quilt, mat, interior goods, stopper and lid, container, card diary, magnetic diagonal, wooden diagonal, toy, Images, characters, videos, 2D, 3D stereoscopic images that are directly connected to the Internet by directly connecting images, marks, letters and URLs of cards provided in the appearance or tag of all products or inside the product, It is possible to use the service that is linked with the various additional functions created by connecting the data production department in advance.

Various additional functions in the function execution unit 205 include check boxes such as asking, answering, role playing, character decorating, real inspection, character viewing, and check boxes for languages such as English, Korean, Chinese, Japanese, Text, moving images, 2D, and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400, and various contents displayed on the screen can be moved, resized, rotated 360 degrees, Data management, etc., and various additional functions interlocked with various update items not described.

FIG. 4 is an explanatory diagram for generating data for main server and data of an application storage unit, which are produced for executing the present invention, in an application system for executing various products incorporating the augmented reality equipped with the various additional functions of the present invention.

In other words, the data production department produces data matching images, marks, and letters, creates URL links matching images, marks, and letters, creates applications with various additional functions, and creates data for using various additional functions. Data compatible with applications loaded with various functions are produced and stored in the database 130 by the user.

The application 200 with various additional functions connected to the main server 100 can recognize an image, a mark and a character displayed on the product 300 through the function execution unit 205 or the object recognition system 201, Target is acquired.

FIG. 5 is a flowchart illustrating a product display system incorporating an augmented reality application according to an embodiment of a product display system in an application system equipped with various additional functions of the present invention. An augmented reality system according to an embodiment of an application system for executing various products incorporating a built-in augmented reality system.

The present invention as an application system incorporating an augmented reality product 300 and various additional functions includes an object recognition system 201 installed in an application system by displaying images, marks, and characters linked with application systems in various products A service combining various various images, characters, sounds, moving pictures, 2D and 3D stereoscopic moving picture data stored in the database 130 of the main server 100 and various additional functions matched with the dictionary can be used, ), An image, character, sound, moving picture, 2D, and 3D stereoscopic moving image data stored in the augmented reality through the information communication device 400 using a service combining various additional functions matched with the dictionary.

A product 300 incorporating augmented reality and an application system equipped with various additional functions can be applied to various products 300, that is, clothing, various articles of art, catalogs, magazines, handbags, books, curtains, carpets, You can display images, marks, and letters on the market such as wallpaper, calender, sheet, quilt, mat, interior goods, stopper, lid, container, card diary, magnetic diagonal, wooden diadem, toy, Images, characters, movies, and images displayed directly on the image or mark of the product 300 or directly connected to the Internet by directly connecting images, marks, letters, 2D and 3D stereoscopic moving images can be used in connection with various additional functions created in advance by connecting to the data production section (see FIG. 4).

Various additional functions in the function execution unit 205 include check boxes such as asking, answering, role playing, character decorating, real inspection, character viewing, and check boxes for languages such as English, Korean, Chinese, Japanese, Text, moving images, 2D, and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400, and various contents displayed on the screen can be moved, resized, rotated 360 degrees, Data management, etc., and various additional functions interlocked with various update items not described.

The present invention has various additional effects and functions such as education cost reduction, education continuity, and storytelling of the displayed content, as well as educational function, entertainment function and sentimental function, It can be economically effective by strengthening competitiveness, expanding sales, and managing replicas.

This allows augmented reality to be displayed smoothly in the electronic communication device 400 through selective use of various services according to the communication environment to the user, and to apply augmented reality to various products according to the spread of the electronic communication device 400, And application systems equipped with various additional functions related to application to various products due to the spread of various electronic communication equipments that are combined with the application system It is an augmented reality application system that displays various images and marks on products.

That is, various contents to be displayed in cooperation with the application 200 loaded with various additional functions to be stored in the main server 100 through the manager 400 (see FIG. 6) And then stores it in the database 130 by the manager system 500. The main menu 220 stores the service through the main server using unit and the service through the application storing unit The use should be divided and accessed.

The main server 100 of the database 130 installs a main server use unit and an application storage usage unit of the main menu unit 220 through a transmission device and a reception device by matching various contents produced by matching images, A database or the like via an image, a mark, a character, or a data request message transmitted from the application system through the object recognition system of the main server 100 interlocked with the object recognition system 201 installed in the control unit 210 of the application 200. [ And a function of extracting and transmitting data according to a request message, and a function of transmitting the data transmitted through the screen to a screen (not shown) of the application 200 of the information communication device 400 206, or stored in the application storage unit 203 and displayed, and the URL associated with the image, mark, or letter displayed on the product 300 And connected to internet service and linked with various additional functions created by connecting data production department to images, texts, videos, 2D and 3D stereoscopic videos displayed through images, marks, and letters of product 300 Can be used.

Various additional functions in the function execution unit 205 include check boxes such as asking, answering, role playing, character decorating, real inspection, character viewing, and check boxes for languages such as English, Korean, Chinese, Japanese, Text, moving images, 2D, and 3D stereoscopic moving images are displayed on the screen 206 of the electronic communication device 400, and various contents displayed on the screen can be moved, resized, rotated 360 degrees, Data management, etc., and various additional functions interlocked with various update items not described.

When the data production unit of FIG. 4 produces various contents to be linked with images, marks, and characters displayed on the product and inputs data, it is registered and stored in the main server 100 through the manager system 500 (see FIG. 6) And the data is divided into data of the main server using part and data of the application storing part.

 The control unit 210 of the application 200 describes the contents described in Application No. 2014-177611 (an integrated application system in which a product incorporating an augmented reality and a variety of additional functions are mounted), and an application The system can utilize the use portion of the application 200 more conveniently and variously, and the service of the main server use portion additionally includes various additional functions, thereby adding diversity and convenience of the application system equipped with various additional functions.

The data of the main server 100 is downloaded in order to use the application storage and use unit and the downloaded data is automatically stored in the dedicated application storage unit 203 installed in the electronic communication device 400 so that various additional functions And various buttons and check boxes are mounted on an application system equipped with various new functions to be newly produced and displayed in various displays through images, marks and letters displayed on the product 300. [

FIGS. 7 to 13 are explanatory diagrams illustrating various functions of various additional functions to be adopted in an application system equipped with various additional functions. The present invention will be described by exemplifying an application which is actually produced and loaded with various additional functions to be posted on a Google Play store, an Apple app store, and various stores.

 7 shows various contents usage lists when the application main menu unit 220 is executed through the main server use unit 222 and the application use unit 224. Herein, contents of various genres can be displayed, In the main menu 232 of the execution menu part 230, menus of various genres are mounted to show menus. When an alphabet is selected when the main menu is accessed through the main server use button, an execution window 240).

When selecting an animal in the submenu 234, a user selects an item to be used among the continuous, English, Korean, and Chinese items displayed at the bottom of the menu and then moves to the application execution window 240. Then, The recognition system is automatically executed.

When the images, marks, and letters displayed on the product 300 are viewed, the linked contents are displayed. If the check is made in the check box of the selected contents 236 and English and Hangul are checked, English pronunciation and Hangul pronunciation are continuously . In addition, if English, Hangul, and Chinese are checked after continuous check, English, Hangul and Chinese pronunciation are executed continuously.

Items checked in the menu of the execution menu unit 230 are executed in the execution window 240 with the English and Hangul checkmarked, or English, Hangul and Chinese are checked and executed. When a check mark is removed or a check mark is displayed on the display screen unit 206 to be executed, the check mark is displayed. If you do not check the continuation in the check screen, you can select one of English, Korean and Chinese check items and check it.

If the check box is selected from English to Chinese when content is executed in the execution window 240 after one selection, the English check mark disappears and the Chinese check mark is displayed and only the Chinese pronunciation is executed. Images, characters, moving images, 2D and 3D stereoscopic video contents displayed through the images, marks, and letters of the product 300 can be used in various ways such as forward and backward movement, You can also use additional services to record and play back the pronunciation you are listening to through the recording and playback functions.

 Further items of the submenu (234) are items that can display additional services that can not be displayed in the display window, show downloaded items, manage data, and delete old items.

The additional functions described can be manufactured in various languages and methods according to the area of the product or the request of the client, and the user can make a wide choice and use various services, Function. The approach of the alphabet contents is explained by the fact that it has the effect of versatility, usability, persistence, and iterative learning of the language, so that it exceeds the limits of the existing textbooks.

8 is a diagram illustrating an additional function added to the menu displayed in the submenu item 234 when the Hangul is selected in the main menu 232. When the Hangul is selected, the menu item is moved to the submenu item 234, Is created, and a continuous, listening, and learning check item is automatically generated at the bottom of the item.

 First, check the sequence and select listening and learning. Then, when the animal is selected, the content is displayed and the Hangul and the pronunciation are executed as "koto" .. "koto" .. "koto" .. "cat". If you check only Continuous and Listening, "Cat" .. "Cat" is running Hangul and Pronunciation consecutively. If you only check Continuous and Learn, ".." .. ".." .. ".." .. ".." Yang ".." This "is Hangul and pronunciation are executed continuously. If the user moves to the execution window 240 without checking the continuity, the service can be used by checking only one item.

Images, characters, moving images, 2D and 3D stereoscopic video contents displayed through the images, marks, and letters of the product 300 can be used in various ways such as forward and backward movement, You can also use additional services to record and play back the pronunciation you are listening to through the recording and playback functions.

Further items of the submenu (234) are items that can display additional services that can not be displayed in the display window, show downloaded items, manage data, and delete old items.

Although the illustrated explanations are based on Hangul, the inventive field can be selectively produced by a requestor as well as various languages to be supported on various categories. In addition to learning to listen to Korean, it can be changed to 2D or 3D view.

The additional functions described above can be produced in various languages and methods according to the area of the product or the request of the client, and it is possible to make the user widen the selection range and to use various services, Lt; / RTI > The approach of the Korean language contents exemplifies the fact that it has exceeded the limits of the existing textbooks because it has diversity and usability, persistence, and learning effect of language.

FIG. 9 is a diagram illustrating an additional function added to the menu displayed in the submenu item 234 when the user selects Ask and Answer in the main menu 232. When the user selects Ask and Answer, the menu item is moved to the submenu item. , A question and answer check item is automatically generated.

Check the consecutive check items created, check the answer, check the answer and then select the animal button. When the animal button is selected, the application execution window 240 is automatically executed to activate the viewer and the object recognition system. The viewer recognizes images, marks, and characters displayed on the product 300 through the viewer, ).

In the displayed screen, the matching contents appear with the character, and the animation of the scene where the conversation is performed is executed. At first, the characters start a simple conversation with the voice "Try it". Then the character a is what is this? b is This is a Cat. And the answer is executed.

The dialogue is displayed on the screen together with the voice, which is executed continuously. In the displayed screen, a question and answer check box is automatically generated. After checking continuously on the initial screen, if you check the answer, the question and answer is checked and displayed continuously on the current screen.

If you select the animal button after checking only after asking after continuous check, only the prompt on the screen is checked and a is what is this? The voice and the sentence are automatically created, but B only produces the sentence This is a Cat.

Likewise, if you select the animal button after checking the consecutive answers and check the answer, a is not voice what is this? If you ask, b is a service that replies with a voice saying "This is a Cat." Select the Continuous button on the initial screen, and then select "Ask" or "Answer". A check box is automatically created on the moved screen, and the selected item is automatically checked and the service is executed. In this case, the check box can be deselected or deselected if the user desires to execute differently from the service selected on the initial screen.

However, if you check all of the questions in the initial screen and check all the answers, you can freely deselect the check boxes in the execution screen. However, if you select one of the questions after selecting the sequence in the initial screen, It is possible to check only one of the questions and answers, and to select and check the continuation from the initial screen. When moving to the execution screen, only the function of selecting or canceling one of inquiry and answer can be executed.

The image, text, moving image, 2D and 3D stereoscopic video content displayed through the image, mark, and letter displayed on the product 300 can be displayed at the same time as the displayed image. You can use additional services that you can use or record and play back the pronunciation you follow through the recording and playback functions.

Although not shown in the detailed menu, when a view item is added, as shown in the example of FIG. 7 and FIG. 8, a service that can not be displayed in the display window can be additionally viewed or downloaded, This item can be deleted.

The additional functions described can be manufactured in various languages and methods according to the area of the product or the request of the client, and the user can make a wide choice and use various services, Function. It is explained that the approach to the question and answer contents exemplified is beyond the limits of the existing textbooks because it has diversity and usability of language, persistence, and iterative learning effect.

FIG. 10 relates to a menu displayed in the submenu item 234 when an elementary, intermediate, or advanced conversation is selected in the main menu 232. When the user selects an elementary, intermediate, or advanced conversation, Only the role play button may be generated and moved to the application execution window 240 directly.

When the role play button is selected, the application execution window 240 is automatically activated to activate the viewer and the object recognition system. On the first screen, the characters describe themselves and explain how to use the service, And then it is automatically executed.

The image, the mark, and the character displayed on the product 300 through the viewer are recognized and the matching data is displayed in the application execution window 240. In the displayed screen, the matching content appears with the character, and the animation of the scene that is in dialogue with each other is executed as shown in the example of Fig.

At first, we start a conversation with the character a, and the character a is what is this? b is This is a Cat. The voice is repeated a few times. Here, the conversation can be a two to three simple conversation, depending on beginner, intermediate, and advanced conversation.

After the dialogue with the sentence and voice is finished, the character can come out again and execute the service with the following message. "Now press the Record button to start the conversation. When the guidance "Bee ~~~" is finished, role play proceeds. When you select the Record button that was created with the displayed content, the character a is displayed as what is this? When you see the sentence and follow the voice conversation, b shows the sentence "This is a Cat." And follow the sentence to follow the voice conversation.

At this time, one voice conversation that follows is automatically stored in the application storage recording function, and the conversation contents automatically recorded in the recording function linked to the application are automatically reproduced by selecting the recording listening button.

The automatically recorded conversation contents are not stored in the storage unit but are automatically deleted when the contents use is stopped. The auto-generated role change button along with the displayed contents can change the roles of characters a and b to use the service, and when the parent and child share the same or peer-to-peer, they can use each other's roles.

 This enables role play to double the efficiency of learning and efficiency. In the scene that is first illustrated, the voice is executed with the sentence, and when the role play starts, only the sentence is displayed without the voice. As shown in FIG. 9, the consecutive, question and answer check boxes are generated in the question and answer button of the detail item (234). After checking the consecutive check items of the generated check items, checking the answer and selecting the question and answer button, Service is in progress.

When the user selects the Ask and Answer button, the application execution window 240 is automatically executed to activate the viewer and the object recognition system. The viewer recognizes images, marks, and characters displayed on the product 300 through the viewer, 240).

In the displayed screen, the matching contents appear with the character, and the animation of the scene where the conversation is performed is executed. At first, the characters start a simple conversation with the voice "Try it". The image, mark, and character displayed on the product are recognized by the viewer and the matching data is displayed in the application execution window 240.

In the displayed screen, the matching content appears with the character, and the animation of the scene that is in dialogue with each other is executed as shown in the example. At first, we start a conversation with the character a, and the character a is what is this? b is This is a Cat. The voice is repeated a few times. The conversation here is to have a simple conversation run two or three times according to beginner, intermediate, and advanced conversation.

You can use this service through the example question-and-answer function, and you can record and play the conversation through the recording function as shown in the role play. Here, the recording function can be selected at any time during a conversation, and the recorded conversation can also be played at any time. The image, text, moving image, 2D and 3D stereoscopic video content displayed through the image, mark, and letter displayed on the product 300 can be displayed at the same time as the displayed image. You can use additional services that you can use or record and play back the pronunciation you follow through the recording and playback functions.

Although not shown in the submenu 234, a more view item can be added. In addition, when the currently displayed content is lightly touched with the target tracking system, the content displayed through the viewer of the execution window 240 can be viewed You can add features to keep your content running even if you do not.

This function is a function of improving the difficulty to use for a long time through the images, marks, and letters displayed on the product 300 as the contents of the role play and the question and answer are recorded and reproduced as well as the contents of the conversation are lengthened. The reset function 244 may be used to re-enable the next service. The present invention demonstrates that services can be used by adding various additional functions to suit ages or by adding various functions that can be performed with parents.

FIG. 11 is a function for connecting to the Internet that enables various and advantageous Internet services to be utilized through an Internet connection. When the motion motion picture button is selected, a motion image listening button and a motion image view button are generated in the detailed menu 234.

When the generated button is selected, each application execution window 240 is automatically executed, the viewer and the object recognition system are activated, and the image, mark, and character displayed on the product are recognized through the viewer, and the URL is matched And stores it in the main server, and utilizes the Internet service matched with the image, mark, and letter displayed on the product 300.

In order to listen to the shake, the related shake of the free site, which is supported by the animation and the shake, can be executed immediately without going through the homepage. The user can use other contents after searching on the moved site, You can go back to other images, marks, and letters to hear other swayings straight away.

In the case of a fairy tale, a related story of a free site in which an animation and a fairy tale are supported together can be executed immediately without going through the homepage. Other contents can be used after a search in the moved site, And you can see and hear other fairy tales straight through other images, marks and letters.

Although not shown, a detailed item 234 for use of the Internet can be added, and various different Internet services can be used through the same image, mark, and letter through the selected detailed item .

FIG. 12 shows a menu where the detail item 234 is displayed when the user selects the item together with the character of the main menu 232 and an additional function to be added. When the item is selected together with the character, the detail item 234 is moved. You can install a view, a character view, or a variety of items.

If the user clicks on the actual view, the application execution window 240 is automatically executed to activate the viewer and the object recognition system. The viewer recognizes images, marks, and characters displayed on the product 300 through the viewer, ).

 The displayed content is animated by the task manager system into the actual appearance or character of the object in advance, and is matched with the image, mark, and character and stored in the main server. You can take advantage of the real-time content or character of the content displayed in the application through the automatically generated control mode and observation mode

The control mode and the observation mode check box that are generated as the content to be displayed can be displayed on the screen by moving the display contents such as a tiger's real image and characters, If you touch a part of the tiger, a detailed description of the tiger is supported with voice observation mode.

In the adjustment mode, the observation mode is basically installed and used together, but when the content is executed by selecting the observation mode, the adjustment mode is automatically stopped. This is a function that the observation mode touches a part of the actual image and shows another image on the real image screen, so that the system does not cause an error because it is overlapped with the control mode.

In the control mode and the observation mode, a plurality of real-life contents or characters matching through a plurality of images, marks, and characters are simultaneously displayed, and each of the contents can be simultaneously used through the control mode and the observation mode.

Changing the style created with the characters displayed through the character view displays a variety of decorating materials pre-designed by the administrator system, allowing the user to change clothes, change the hair style, and put a beard on the face. . The present invention is a statement for allowing users to experience another service by combining various learning effects and entertainment functions through realization and characterization of contents.

13 is a diagram illustrating a service addition item incorporating various additional functions described in FIGS. 7 to 12 by installing various contents that are not described in FIGS. 7 to 12 through downloading or updating.

Additional features of the displayed items can be displayed with a variety of additional functions such as crossword games, word matching games, weather correction, and number matching. When the user selects the more menu item, a main menu or a detailed item 234, which is not shown in FIGS. 7 to 12, which is not displayed through the hidden menu item, is displayed, thereby providing various and enormous services to a user using an application system equipped with various additional functions Can be used. It is explained that various additional contents exemplified in the present invention can be seen in a variety of items such as dinosaurs, African animals, water animals, livestock, mounts, numbers and prices, day and time, greetings and weather updates.

As described above, the various additional functions and menus and items described with reference to FIGS. 7 to 13 are various additional functions that can be used variously by using the main server or using the application storage unit.

It is possible to display not only the pure function of the product 300 through the electronic communication device 400 but also clothes and various industrial products, catalogs, magazines, handbills, books, curtains, You can display images, marks and letters on the market such as carpets, wallpapers, calendars, sheets, quilts, mats, interior goods, stoppers and lids, containers, cardstrips, magnetic parches, wooden parcels, toys, And images, marks, and letters of cards that are provided inside the product or inside the product.

In addition, the service using the main server displays a menu list and a detailed item list of the application and allows the application to be lightly installed and used in the electronic communication device by changing the menu and detail items of the application through the update, When using the service, the update can be selected and installed. Various contents can be used through the installed menu lease. However, the contents to be used can be downloaded through the main server before use and stored in the application storage unit before using the contents. This makes it possible to use this service even in a poor environment where the communication environment is not supported, thereby reducing the convenience of use and the communication cost to the consumer.

The present invention can be applied to a variety of products incorporating augmented reality by using a variety of internet services of Application No. 2014-177611 (a product incorporating augmented reality and an integrated application system equipped with various additional functions) The application system that incorporates the augmented reality through application system with various additional functions that can use new additional complex functions. The product which incorporates the application system with the contents that are directed to various products. The process of synthesizing and integrating various augmented reality products in augmented reality, the products that can be grafted, the additional functions, the functions and effects of the grafted products, Images, text, video, 2D, 3D stereoscopic video and main server or Apple Provides a wide variety of educational, entertainment and sentimental functions through Internet service by linking URLs to images, marks and letters, including images, marks and letters registered in the application, or through the screen on the electronic communication device As well as enhancing the value of the product and sales effect, it enhances the competitiveness and manages the reproduction of the product. It also provides convenient convenience for the user to reduce the education cost and provide diversity. At the same time, it helps the domestic economy, This is a new application system that combines augmented reality with augmented reality related to the application of augmented reality to a variety of products due to the spread of electronic communication devices, Application system. It includes a variety of products that combine augmented reality with the function of the company's promotional material through images, marks, and letters displayed on the product.

Therefore, images, sounds, texts, moving images, 2D and 3D stereoscopic moving images produced in conjunction with images, marks, and letters to be displayed on the external appearance or tack of the product adopted in the present invention or on the card inside the product are displayed on the appearance of the product Since an image, a mark and a letter exhibit a decorative function and are displayed in association with a main server or an augmented reality application, a URL is stored in an image, a mark, and a letter displayed on the exterior of the product, , It is possible to realize a variety of products with educational functions, entertainment functions and sentimental functions as well as simple functions as products by realizing the services equipped with the various additional functions described in the present invention by various practical products through electronic communication devices. Strengthens competitiveness and management of replicas, as well as sales effect. Providing convenient convenience and convenience to the home economics and providing an augmented reality to be displayed smoothly in electronic communication equipment through selective service according to communication environment, it is possible to provide augmented reality to various products due to the spread of electronic communication devices It is a new application system that combines a variety of additional functions in an application system directed to a product incorporating augmented reality related to grafting and application. It also provides a variety of products that combine augmented reality that can be used for various contents.

In the present invention, the configuration and the driving flowchart of the augmented reality and the various functions and concrete contents of the augmented reality are described in detail in Application No. 2014-177611 (integrated application system equipped with a product combining the augmented reality and various additional functions) The present invention has been completed through the detailed description of the application and the system equipped with various additional functions that are combined with a product combining specific augmented reality.

The augmented reality application can be run for free by anyone, but characters, images, sounds, videos, 2D and 3D stereoscopic videos through the augmented reality application are displayed only when the images, codes and letters of the marks are present in the printing product. In addition, various internet services using various products' images, marks, letters and dictionaries linked URLs, and contents usage of applications equipped with various additional functions are selectively installed and manufactured by the request of the requester, And can be made available to the user selectively.

Augmented Reality The images, marks, and characters stored in the main server or application are matched with the images, marks, and characters printed on the appearance or tag of the product or cards provided in the product (the matching rate of images or marks is 100 - 60%), it is possible to synchronize the system so that the images, marks, and characters printed on the product are matched with the characters, images, sounds, movies, 2D, 3D stereoscopic Contents such as video are displayed.

Although the embodiments of the present invention have been described with reference to the preferred embodiments, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

100: main server
200: Application
300: Products
400: Electronic communication device
500: Administrator system

Claims (22)

delete delete delete delete delete delete delete delete A variety of additional functions that are added to product augmented reality from electronic communication devices through images, marks, and letters of various types of images, marks, and letters, such as asking and answering, role playing, character decorating, , The character view check box, and the language area check box of English, Korean, Chinese, Japanese, learn, and listening, an integrated application with various additional functions installed in the electronic communication device will generate an initial screen ;
The service can be used immediately through the button of the created initial screen and the content to be stored in the application storage unit is downloaded through the selection button selected at the beginning of service use;
When the downloaded content is used again later, the content is accessed by accessing the application storage unit without accessing the main server;
In addition, if the downloaded contents are changed or modified contents are installed, they are automatically installed or selected and installed. If the downloaded contents are used, they are downloaded through a selection box or a check box asking whether to download again or not.
Wherein the automatic download installation or selective download is not supported in an environment in which communication is not supported, but the downloaded contents are used irrespective of the communication environment, and a product augmented reality application system equipped with various additional functions. 10. The method of claim 9,
As the above-mentioned products, there can be used clothes, paper, industrial products, catalogs, magazines, handbags, books, curtains, carpets, wallpapers, calendars, sheets, quilts, mats, interior goods, caps, lids, The products that display the image, mark, or letter of the card that is provided inside the product or the exterior of the product that can display the parish, wooden parish, toys, textbooks and wrapping paper, tack, image, Mark, image, and character,
The augmented reality with the check box of question, answer, role play, character decoration, real view, character view and language area check box of English, Korean, Chinese, Japanese, , Touch 3D images to move, rotate, resize, listen, and create. You can select various languages for listening, viewing, conversation, and listening through checkboxes or selection buttons Add the ability to study,
A product augmented reality application system equipped with various additional functions, which is provided with a function of selecting and checking a box to allow simultaneous use of newly updated contents as well as contents previously executed in the same product through frequent updating. 11. The method of claim 10,
The additional functions include augmented reality equipped with check boxes for questioning, answering, role playing, character decorating, real-time viewing, character viewing, checkboxes for English, Korean, Chinese, Japanese, It is augmented reality attached to the augmented reality mounted on the exterior or an additional function that can be selected and used by the user through the images, marks, and letters displayed on the inside, and a product or a product connected with the augmented reality, such as clothing, paper, industrial products, catalogs, magazines, , Books, curtains, carpets, wallpapers, calendars, sheets, quilts, mats, interior goods, stoppers and lids, containers, cardstrips, magnetic parchments, wood parcels, toys, textiles and wrapping paper Which is a product that displays an image, a mark, and a letter of a card that is provided inside or outside the product, Product augmented reality application system.
delete delete delete delete delete delete delete delete delete delete delete

Images