KR101581802B1 - Application system of goods augmented reality - Google Patents

Abstract

The present invention relates to an application system of goods augmented reality having the function of using displayed content and to various goods using the same and, more specifically, to an application system of goods augmented reality having the function of using displayed content, wherein an augmented reality system is applied to a main server and an application system to three-dimensionally display various goods on a screen using an electronic communication device. The present invention relates to an application system of goods augmented reality having a receiving device and a transmitting device of a main server, which extract or search for content from a database, are connected via a network to a transmitting device and a receiving device of an application for an electronic communication device having an object recognition system mounted thereon, wherein an execution window in the application is connected to the screen part of the electronic communication device and the execution window and the object recognition system are connected to an image or a mark or a letter target displayed on goods which can be recognized via view as a target and can be obtained as a target. The execution window is connected to a menu part for selecting a menu and a control part for requesting data to execute a selected function and executing the selected function. The control part is connected to an application storage part for checking and transmitting content. A search button and a stop button are generated in the execution window for initial augmented display and right and left slide buttons are generated after getting out of the target.

Description

TECHNICAL FIELD [0001] The present invention relates to an augmented reality application system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a product augmented reality application system equipped with a content utilization function and a variety of products using the augmented reality application system, and more particularly, The present invention relates to a product augmented reality application system including an augmented reality system in which a main server and an application system are combined and applied so that the augmented reality system can be displayed in three dimensions.

The content utilization function of the present invention can display various contents through an image, a mark, and a character target by sequentially connecting the images to be connected or by using a one-to-one matched image, A product augmented reality application system with an enabled content utilization function that enables the displayed contents to be recalled sequentially, and various products using the augmented reality application system.

The products of household goods that exist on the earth have been performing essential functions from the necessities of ordinary people's daily life, and the decorative function has been importantly demanded by the consumer as it has developed into a complicated present digital age. In addition, the products from the suppliers have educational, fun and sentimental functions beyond these decorative features.

Therefore, there has been a need to develop various products as products that can satisfy them in the digital age, in which educational, functional, and sentimental functions are required as well as functions as essential products. In addition, due to popularization and radical development of electronic communication devices, each system linked to it has been developed and used easily.

For example, while technology development for smart devices as electronic communication devices capable of changing or expanding functions substantially through application programs in the information age has been rapidly developing, typical electronic communication devices include smart phones and smart Pad.

Augmented reality, in which a camera and a display are mixed, is becoming popular, and the augmented reality is a technique in which a three-dimensional (D) virtual image is superimposed on a real image, And it is used as an augmented reality application.

In the electronic communication device, the registration problem for matching the augmented reality, the real object and the virtual object has been mainly made, and it has been studied to transmit the knowledge about the information that the user can not actually feel through simple display, Beyond the delivery function, research and development are underway for various applications such as education, design, tourism, and industrial fields.

On the other hand, in the case of conventional augmented reality application technology in an application field of a product, attempts to acquire an actual image using a camera in an electronic communication device and to design a new three-dimensional image while directly confirming the acquired actual image are variously implemented .

In contrast, the augmented reality application technology developed by the present inventor is disclosed in Patent Application No. 2014-69644 (product augmented reality system) and No. 2014-94891 (product augmented reality application), No. 2014-0109805 2014-177611 (integrated application system with augmented reality products and various additional functions), No. 2015-0099381 (including a variety of additional functions) Product augmented reality application system). However, such augmented reality application system does not have a method of storing and utilizing the displayed contents in various ways through images, marks, and letters.

Here, the product is a product that displays images, marks, letters, printed fabrics, advertising fabrics, paper, key chains, hats and bags of commodities, catalogs, magazines, flyers, books, curtains, carpets, wallpaper, calendars, The appearance or tag of a product which can display a mat, an interior article, a stopper or a lid, a container, a card diagonal, a magnetic diagonal, a wooden diagonal, a toy, a textbook and a wrapping paper, Means a product that displays an image, mark, or letter of a card.

The present invention stores a variety of educational, amusing and emotional data in an augmented reality application and is connected to an Internet service through an image, a mark or a letter of the corresponding product, or is matched with an image, a mark, Images, characters, moving pictures, 2D and 3D moving pictures can be displayed on the screen of the electronic communication device.

However, in the integrated application system developed by the inventor of the present invention, in which a product augmented reality system is combined with an augmented reality application, a product incorporating an augmented reality and an integrated In an application system, an augmented reality is implemented through images, marks, and letters, but augmented reality is not realized when images, marks, and characters are not present.

Therefore, the present inventor intends to solve this problem by using a product augmented reality application system equipped with a function of utilizing the displayed contents. In order to solve this problem, the inventor of the present invention can design the system according to the applicant's patent registration No. 10-1281314. However, in such an augmented reality system, various functions are combined with the limitation of the design due to the loss of the marker and the marker In order to overcome the limitation of utilizing only one function, the present inventor intends to solve this problem through an application system in an electronic communication device through an augmented reality system of a completely different method.

The present invention has been made in view of the above circumstances, and it is an object of the present invention to utilize augmented image, character, moving image, 2D and 3D stereoscopic moving image through various methods such as image, mark, It is possible to bring up various different contents through various buttons appearing like image, mark and character target of various image, character, video, 2D and 3D stereoscopic video, It is possible to recall various images, texts, moving images, 2D and 3D stereoscopic moving images sequentially in augmented order, so that all the functions installed in the application can be used equally without any image, mark or character target.

The present invention can also reinvigorate each image, text, video, 2D, 3D stereoscopic video enhanced through one-to-one matched images, marks, and text targets, You can use the same without a mark or a character target.

Yet another object of the present invention is to provide a user experience with a variety of experiences through a product augmented reality application system equipped with an enabled content utilization function, by implementing the application system easily while providing the above-described functions.

The augmented reality of the present invention is a combination of an image, a mark, a character image, a moving image, a 2D image, a 3D stereoscopic image, and the like produced through a character target, The present invention is to provide a system and a product and a method that combine the system and the system so that various functions can be used without departing from the existing monotonic function through the present invention.

According to an aspect of the present invention, a receiving apparatus and a transmitting apparatus of a main server extracting or searching contents from a database are connected to be networked in a transmitting apparatus and a receiving apparatus of an application for an electronic communication apparatus equipped with an object recognizing system, The execution window in the application is connected to the screen of the electronic communication device, and the execution window and the object recognition system are connected to the product augmented reality application system connected to the image, mark and character target displayed on the product Wherein the execution window is connected to a menu selection menu and a control unit for executing a function for requesting and selecting data to execute the selected function, and the control unit is connected to an application storage unit for checking contents and transmitting contents ; The search button and the stop button are generated in the execution window in which the initial enhancement is displayed, and the left and right slide buttons are generated after the target is moved out of the target.

Another specific feature of the present invention is that a receiving apparatus and a transmitting apparatus of a main server extracting or retrieving contents from a database are connected to be networked in a receiving apparatus and a transmitting apparatus of an application for an electronic communication apparatus equipped with an object recognition system, Wherein the execution window and the object recognition system are respectively connected to an image, a mark, and a character target displayed on a product recognizable and target obtainable through a view through a viewing window of an electronic communication device, Wherein the execution window is connected to a menu selection menu and a control unit for executing functions requested by the user to perform a selected function and for executing the selected function, and the control unit is connected to an application storage unit for checking contents and transmitting contents; A number of images, characters, videos, 2D and 3D stereoscopic video, navigation buttons, navigation buttons, images, text, video, 2D, 3D Enhanced images, text, video, 2D, and 3D stereoscopic video are automatically recalled and reused in the order in which they were displayed. A manual view slide button that can be used to display an image, a mark, an enhancement experience button displayed randomly as a target of unspecified image, mark, or letter without matching with a character target, and an image, mark, And a storage unit for storing images, text, moving images, and 2D and 3D stereoscopic moving images linked with the target.

According to still another aspect of the present invention, a receiving apparatus and a transmitting apparatus of a main server extracting or retrieving contents from a database are connected to be networked in a receiving apparatus and a transmitting apparatus of an application for an electronic communication apparatus equipped with an object recognition system, In the product augmented reality application system in which the execution window in the electronic communication device screen is connected to the image, the mark and the character target displayed on the product, , You can create images, texts, videos, 2D and 3D stereoscopic videos, create applications, publish published applications to the Google Store, App Store, and store published applications in the data production department. To a dedicated application to an electronic communication device After the application is executed, the image, the mark, and the character are recognized through the object recognition system, and then the image, text, moving image, 2D, and 3D stereoscopic video in the application storage unit are pre- And can be used with various functions such as a navigation button, a slide button, and the like created in association with an image, a character, a moving image, a 2D and a 3D stereoscopic video, and an unmatched unspecified image, mark, It is equipped with a function that can be pre-produced by the data production department through the target, and to enhance the experience of being able to randomly fetch images, texts, moving images, 2D and 3D stereoscopic video in the application storage part.

As described above, according to the present invention, the communication environment changes very rapidly, and electronic communication devices capable of making various selections by users are popularized, so that the user can select various services according to his / her communication environment and situation, The augmented reality system equipped with the various functions of the electronic communication equipment and the various additional functions and the various products that combine these functions will expand the choice of the users while carrying out the functions of the product and can provide diversity and sustainability, It is also possible to provide a variety of sales and management effects such as price competitiveness, duplication management, product sustainability, diversity, and sales increase, as well as various use effects such as blocking, Can have a variety of experience effects.

The present invention can provide a wide variety of economic effects such as product competitiveness, sales effect, reproduction control, diversity increase, educational effect, entertainment function, and sentimental function, And can provide a variety of products combining the augmented reality application system with the currently available content utilization function.

In view of these effects and functional and service aspects, the image, mark, and character target to be displayed on the external appearance of the adopted product show decorative functions and products on the appearance of the product, and simultaneously display the product augmented reality application System, it is possible to display a variety of images, sounds, videos, 2D and 3D stereoscopic moving images from real products through electronic communication devices, and experience the augmented reality easily and conveniently through onboard navigation, slide and augmentation experience functions Can be used.

In addition, these functions have a cost saving effect that can be greatly effected at a low cost, and there is an advantage that a user can experience various experiences and experiences.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram for explaining a product augmented reality application system equipped with a content utilization function in order to execute the present invention; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a product augmented reality application system with a content utilization function,
FIG. 3 is a basic structural view of a product augmented reality application system equipped with a content utilization function, which is produced to implement the present invention.
FIG. 4 is an explanatory diagram of a navigation function built and implemented for execution in a product augmented reality application system equipped with the content utilization function of the present invention. FIG.
Figure 5 is an explanatory view of an automatic and manual slide function built and implemented for execution in a product augmented reality application system with the content utilization function of the present invention.
Figure 6 illustrates the production and example of a built-in navigation and slide functionality for execution in a product augmented reality application system with the content usage function of the present invention.
FIG. 7 is an explanatory diagram of an augmented reality experience built in the product augmented reality application system with the content utilization function of the present invention.

Hereinafter, the present invention will be described with reference to the contents of Applicant's patent application No. 2015-0099381 (product augmented reality application system equipped with various additional functions) to describe the added contents, The detailed description will be made based on the illustrative drawings.

Here, the product is a product that displays images, marks, and letters, printed fabrics, advertising fabrics, paper, key chains, hats, articles of commerce, catalogs, magazines, flyers, books, curtains, carpets, wallpaper, calendars, , The appearance of a product that can display a tag, an image, a mark, or a letter, or an image of a card provided inside the product or a product, a mat, an interior article, a cap or a lid, a container, a magnetic parish, It is a product marked with a mark and a letter.

The present content utilizing function of the present invention can display various contents through an image, a mark, and a character target of one product. In order to display a plurality of contents, a connected image is sequentially called up or a one- And a variety of products using the product augmented reality application system with the content utilization function that is displayed so that the contents can be recalled sequentially.

FIG. 1 is a block diagram for explaining a product augmented reality application system equipped with a content utilization function in order to implement the present invention. The present invention is applicable to a product augmented reality application system equipped with a content utilization function, , Which allows an augmented reality system to be three-dimensionally displayed on a screen in three dimensions using an electronic communication device 400 in various products' images, marks, and character targets 300, This is a product augmented reality application system with embedded content usage function that is applied.

The main server 100 includes a database 130, a transmission device 120 and a reception device 110. The data extraction or update extraction from the database 130 is performed by the transmission device 120, And the data (content) retrieval or update retrieval is performed by the receiving apparatus 110 to the database 130, respectively.

The application 200 in the electronic communication device is connected to the receiving device 110 and the transmitting device 120 of the main server 100 by using the transmitting device 202 and the receiving device 204 under the control of the controller 210 (Content) request or update, or data (content) transmission or update transmission.

The image, mark and character target 300 displayed on the corresponding product 300 is recognized as a target through target acquiring and viewing using the object recognition system 201. The main menu 220 of the function execution unit 205, the execution menu 230 and the execution window 240 of the application storage unit 203, various additional functions, and the like are controlled by the control unit 210 of the application 200, This is being interconnected.

The storage unit 203 checks the matching data (contents) from the object recognition system 201 and extracts matching data (contents) with the menu selection execution menu unit 230. The receiving device 204 automatically stores the data (content) downloaded to the storage unit 203, and updates the main menu unit 220.

The main menu unit 220 selects the update to the transfer device 202 and automatically installs the menu selection or update item to the execution menu unit 230. The execution menu unit 230 makes a request for download data (content) in the absence of download data (content), and automatically executes or downloads (download) data if there is download data It is executed automatically after completion.

In the storage unit 203 and the execution window 240, if there is no download record, an execution window is automatically executed, and the presence or absence of the download record is confirmed or the matching data (content) is executed. The execution window 240 confirms whether or not the menu selected by the electronic communication device screen unit 400 is downloaded.

FIG. 2 is an explanatory diagram for producing data and an application that are produced for execution in a product augmented reality application system equipped with the content utilization function of the present invention. The data production unit 450 is directly connected to the application 200 via the main server 100 and each application 200 is provided with an image, a mark, a character target 300 and an electronic communication device screen unit 400, Respectively.

The application 200 is divided into a menu part 205 and an execution window 240 of a main menu part and a detailed menu part and includes a storage part 203 and a control part 210. The menu unit 205 is divided into a plurality of large menus as in the main menu unit, and the detailed menu unit has a detailed menu button for preparing the main menu unit for execution through the selected image, mark, and letter. The Experience function can be installed in the main menu or submenu.

The storage unit 203 produces data (contents) linked with search, a manual / automatic slide function, and an experience function, and generates and stores signals of the controller 210 in an enhanced state. The control unit 210 controls to send related data (contents) stored in the storage unit 203 to the execution window 240 by executing a search for an execution window, a manual / automatic slide function, and an experience function.

The menu unit 205 is provided with a menu such that the execution window 240 is installed by installing the selected various functions, the added search, the manual / automatic slide function, and the experience button.

The execution window 240 is an execution window where an image, a sound, a moving image, a 2D and a 3D stereoscopic moving image are displayed through an image, a mark, and a character target 300 of a product. In addition to the functions described above, It is an execution window that executes the experience function. Accordingly, the execution window 240 displays the contents in the electronic communication device screen unit 400 using the preceding various functions, the added search, the manual / automatic slide function, and the experience function.

That is, in addition to the contents described in Applicant's patent application No. 2015-0099381 (product augmented reality application system equipped with various additional functions) as seen by the data production unit 450, a newly added search function, a manual slide function, , And when the target is newly illuminated, it is displayed as a new enhancement, and data related to the search function and the slide function are newly executed.

It can be used as a product, such as clothing, printed fabric, advertising fabric, paper, key chains, hats, most articles, catalogs, magazines, flyers, books, curtains, carpets, wallpapers, calendars, The appearance or tag of a product that can display a quilt, a mat, an interior item, a stopper or a lid, a container, a magnetic diagonal, a wooden diagonal, a toy, a textbook and a wrapping paper, Mark, and character of the product displaying the image, the mark, and the character are produced and made compatible with the product augmented reality application system equipped with the content utilization function and stored in the database of the main server 100 .

Therefore, the data that is linked with the application having various additional functions, the navigation function, the slide function, and the experience function is produced and stored in the database by matching with the image, mark, and character displayed on the product.

In addition to the contents described in Applicant's patent application No. 2015-0099381 (product augmented reality application system equipped with various additional functions) by the data production unit 450, a newly added search function, a manual slide function, an automatic slide function , And an application 200 equipped with a search function and a slide function that are newly enhanced and newly activated when a target is newly displayed are produced.

The application 200 is described in Patent Application No. 2015-0099381, which is produced in cooperation with an image, a sound, a moving image, a 2D and a 3D stereoscopic moving image displayed through a product image, a mark, and a character target 300 With the features described in the on-board product augmented reality application system, navigation, manual slide function, automatic slide function, newly added enhancement display function, slide function and experience function, .

Therefore, we create applications with various add-ons, navigation, slide, and experience functions linked with data (content), and publish applications to the Play store and App store.

Therefore, in the application, a content which can utilize various kinds of functions such as a data request connected to various functions mounted in the execution window or a transmission and execution sub screen in the execution window is displayed.

FIG. 3 is a basic configuration diagram of a product augmented reality application system equipped with an enabled content utilization function, which is produced to implement the present invention, and includes a menu part 205 and an execution window 240. The menu part 205 A main menu part 220 for using a main server or an application storage part, and an execution menu part 230 for various buttons such as an alphabet --- animal, detail-ending, etc. in the detailed menu part.

Accordingly, the menu unit 205 has an upper check box for automatically and continuously executing the items of the lower check box, and executes the contents stored in the storage unit upon automatic download or menu selection when the menu is selected.

With the functions described in Patent Application No. 2015-0099381 (product augmented reality application system with various additional functions), the search function, slide function, automatic slide function of the present invention, A basic configuration according to an embodiment of an application equipped with a search function and an experience function newly operated.

An image of a single or one-to-one matching product, a mark character target 300, and an electronic communication device screen unit 400 are connected to the menu unit 205 through an execution window 240, Button 10, stop button 20, displayed screen 30, reset button 40, up / down left / right rotation button 50, left slide button 60 and right slide button 70, And the like.

The present invention relates to a method and apparatus for searching, a slide, and an automatic slide function, in which a patent application No. 2015-0099381 (a product augmented reality application system equipped with various additional functions) generated as an enhanced displayed image, sound, moving picture, 2D, It is designed to use all the various additional functions equally.

Here, the search button 10 and the stop button 20 are generated in the execution window in which the initial enhancement is displayed, and the left and right slide buttons 60 and 70 are one or one-to-one matched images, .

FIG. 4 is an explanatory diagram of a search function of a product augmented reality application system equipped with an enabled content utilization function, which is produced to implement the present invention. A one or one-to-one matched image, an image, a sound, a moving picture, a moving picture, a moving picture, a moving picture , And 3D stereoscopic video are sequentially displayed.

It is possible to pause and observe images, sound, moving images, 2D and 3D stereoscopic moving images displayed through the stop button 20. When one or one-to-one matched image, mark, or target 300 is missed, the slide function is automatically executed to display the last enhancement-displayed image, sound, moving image, 2D and 3D stereoscopic moving image. At this time, the left and right slide buttons 60 and 70 can be used.

Images, sounds, videos, 2D and 3D stereoscopic videos that are enhanced and displayed through a one-to-one matched image, mark, and character target (300) will have different images, sounds, videos, 2D and 3D stereoscopic videos The enhancement is being manifested.

Therefore, the search function is generated as a number of images, sounds, moving images, 2D and 3D stereoscopic moving images that are matched through a single image, mark, and character, and the created navigation button 10 is touched Touch to display the screen in order on the screen of the electronic communication device.

These search functions can pre-match multiple images, sounds, movies, 2D, and 3D stereoscopic videos to a single image, mark, or letter while creating data, store them in the application storage area, and display enhanced images, sounds, Touch the navigation function buttons created in conjunction with 2D and 3D stereoscopic videos to bring up the pre-matched images, sounds, movies, 2D and 3D stereoscopic videos in the matched order.

In this image, sound, video, 2D, and 3D stereoscopic video, the enhancement is maintained even when one image, mark, and character are out of the way, and the patent application No. 2015-0099381 (product augmented reality Application systems) that can be used continuously.

This means that the difficulty of using the target continuously when the infant / child uses it, and the difficulty of using the image, sound, video, 2D, 3D stereoscopic video in one image, mark, And experience a variety of images, sounds, videos, 2D and 3D stereoscopic video, and so on.

In addition, a large number of images, sounds, videos, 2D and 3D stereoscopic images from one image, mark or letter can be continuously displayed on a continuous basis to provide countless information, rather than providing only limited information through images, marks, As shown in Fig.

This may be done by means of any or all of the following: images, markings, letters or printed fabrics, advertising fabrics, paper, key chains, hats, bags of commodities, catalogs, magazines, flyers, books, curtains, carpets, wallpaper, calendars, The appearance or tuck of the product which can display the image, the mark, the character, the card which is provided in the inside of the product or the inside of the product, the interior goods, the stopper, the lid, the container, the card precinct, the magnetic parish, In addition to the functionality of the simple product as well as the various effects and functions described in patent application No. 2015-0099381 (product augmented reality application system with various add-ons) And provide more educational contents, as well as a variety of activities and effects are available.

When a plurality of images, sounds, moving images, 2D and 3D stereoscopic moving images are displayed through an image, mark, or letter, the navigation button 10 is created to store images, sound, moving images, 2D, 3D You can continue to recall stereoscopic video, use the slide function when you are away from the target, and add images, sounds, videos, 2D and 3D stereoscopic videos that have been enhanced to match one-on- Different images, sounds, movies, 2D, and 3D stereoscopic videos are displayed each time the image is changed. When the target is out of sight, the slide function can be used.

FIG. 5 is an explanatory view for explaining a slide function manufactured and mounted for execution in a product augmented reality application system equipped with the content utilization function of the present invention. Here, the slide function can be divided into a manual view (12) slide means and an automatic view (11) slide means. The image can be divided into an image, a character, a sound When a plurality of images, sounds, moving images, 2D and 3D stereoscopic moving images are out of the enhanced display image, mark, or character by using the navigation button 10 displayed on the product through the navigation function generated in the 2D and 3D stereoscopic moving images, Images, texts, sounds, videos, 2D and 3D stereoscopic videos stored in the application storage through the main server in advance, which are pre-produced by the production department, , The slide function buttons 60 and 70 are automatically generated while one 3D stereoscopic video remains unremoved.

Using the left and right slide buttons 60 and 70 generated at this time, images, texts, sounds, moving images, 2D and 3D stereoscopic moving images that were enhanced and displayed through images, marks and letters can be recalled in turn or in reverse order. In addition, an application pre-produced by a data operator generates an automatic view (11) or a manual view (12) button, which means that images, characters, sounds, movies, 2D, 3D stereoscopic If the video is out of target, you can use various methods of slide functionality.

Images, sounds, movies, 2D and 3D stereoscopic videos that start with a single image, mark, letter or one-to-one matched enhancement display can be set as manual slides when they are out of images, marks, or letters, Can be set.

FIG. 6 is a diagram illustrating the production and example of a search and slide function built and executed for execution in a product augmented reality application system equipped with the present content utilization function of the present invention.

The present invention relates to an application for an electronic communication device equipped with an object recognition system, an image or a mark of a product, a view that targets a character, a single image or a mark, a plurality of images, text, A navigation button for loading 3D stereoscopic video, an automatic view slide button for recalling a large number of images, characters, videos, 2D and 3D stereoscopic movies that have been displayed through navigation buttons, reusable images, marks, Enhancement of image, text, video, 2D, and 3D stereoscopic video that are matched one-on-one and displayed as enhancements. Manual view slide button that can be recalled and reused in the order in which they were displayed. Randomly displayed enhancement experience button that is targeted at Ima mark and letter, image created by manager system, Is composed of a storage for storing the images, text, video, 2D, 3D stereoscopic video in conjunction with target letters.

The search function in the execution window 240 is a function for enhancing and displaying a plurality of images, sounds, moving images, 2D and 3D stereoscopic moving images through one image, mark, and letter. It can be used, but in some cases it can be used as a unique function.

In the search function, images, sounds, moving images, 2D and 3D stereoscopic moving images are displayed through the execution window 240 of the previously created application, and the corresponding buttons are created. If you select a button, an arrow-shaped button will appear. If you select it, you will see a number of images, sounds, movies, 2D, 3D Stereoscopic video will be displayed in order of enhancement.

When the displayed screen 30 of the execution window 240 is moved out of one image, mark, or character, the image, sound, moving image, 2D, and 3D stereoscopic moving image, The slide function buttons 60 and 70 are created together with the 2D and 3D stereoscopic moving images.

When making data in advance, the data production department will increase the number of images, sounds, videos, 2D and 3D stereoscopic videos through a single image, mark, and letter, Finally, it will be possible to preserve the image, sound, movie, 2D, and 3D stereoscopic video displayed in advance.

Enhanced images, sounds, movies, 2D and 3D stereoscopic videos can be used with all of the previously filed functions. The images, sounds, videos, 2D and 3D stereoscopic videos can also be enhanced Can be used.

Not only can these functions provide more information to users, but existing application systems must continue to be illuminated with images, marks and letters to enhance new images, sound, video, 2D and 3D stereoscopic video. However, the navigation function can be applied to a variety of images, sounds, videos, 2D and 3D stereoscopic video images through a single image, mark or letter, , 3D stereoscopic moving image does not disappear, it can be used continuously and displayed.

In addition, a plurality of images, sound, moving images, 2D and 3D stereoscopic moving images can be displayed in a sequential order or a reverse order by using the slide function, so that the user can display a large number of enhanced images, , 2D, and 3D stereoscopic video.

The stop button 20 generated (optionally mounted) as the navigation button 10 temporarily stops the movement of the enhanced image, sound, moving image, 2D and 3D stereoscopic moving image, See you.

The navigation function allows multiple images, sounds, movies, 2D and 3D stereoscopic videos to be enhanced through one image, mark or letter, but this function can be used to display multiple images, sounds, Video, 2D, and 3D stereoscopic moving images can be enhanced and displayed. All the images, sound, moving images, 2D and 3D stereoscopic moving images can be displayed in order or in reverse order.

You should not change the execution screen. If you change image, mark, or text before changing the execution screen, the image, sound, movie, 2D and 3D stereoscopic video will be reloaded I can not.

The function set by the manual slide function shown in Figs. 4 and 5 will be described as an embodiment. A plurality of images, sounds, moving images, 2D and 3D stereoscopic moving images can be retrieved or one-to-one matching can be performed by touching the navigation buttons 10 generated as augmented and displayed image, sound, moving image, 2D, When the on-image, sound, moving image, 2D or 3D stereoscopic moving image is out of the target after the enhancement display, the automatic view button 11 is generated as shown in FIG. 5, On the manual view screen, the auto view (12) button is created and when you touch the button again, it returns to the manual view screen.

In the manual view screen, slide buttons 60 and 70, such as stop, backward, and forward views, are created as various additional functions in Patent Application No. 2015-0099381 (a product augmented reality application system with various additional functions) The stop button 20 pauses the image, sound, moving image, 2D, and 3D stereoscopic video displayed in the back view or the forward view, and then, in Patent Application No. 2015-0099381 (the product enhancement with various additional functions The user can touch the stop button 20 again or operate the forward view and forward view buttons 60 and 70 to display the other additional functions, You can import images, sounds, movies, 2D and 3D stereoscopic movies.

In addition, the Backward button is a function to recall enhanced images, sounds, movies, 2D, and 3D stereoscopic moving images in the reverse direction, and the Forward button is a function that can be called up in the order in which they were displayed.

The automatic view slide means is switched to the automatic screen and at the same time the manual button 12 and the quick button 21, the normal button 22, the slow button 23 and the stop button 20 are generated. Forward button is not generated. The fast, normal, slow, and stop buttons can be used to store data by presetting the interval that the operator slides when preparing the data.

These features not only utilize all the features of Patent Application No. 2015-0099381 (product augmented reality application system with various add-ons), but also provide a variety of effects and functions, as well as more information, There are many educational contents and effects and functions for various experience activities.

The slide function in the execution window 240 shown in Fig. 6 is divided into a manual view slide means and an automatic view slide means. The slide function recalls a plurality of images, sounds, moving images, 2D and 3D stereoscopic moving images that have been enhanced and displayed through navigation buttons, automatic search, and experience even when the displayed screen 30 of the execution window 240 is moved out of the target You can use all the features that are built into the application.

Slide function is data matching beforehand so that you can re-search image, sound, video, 2D and 3D stereoscopic video that was enhanced through navigation button, auto search and experience when creating application in data production department in advance through slide function After the work, store it in the storage unit.

The stored data can be enhanced and displayed on the screen of the electronic communication device by means of a navigation button or a navigation function mounted on the application, and the image, sound, moving image, 2D, 3D stereoscopic video, Videos are automatically linked with the application's slide functionality.

Images, sounds, moving images, 2D and 3D stereoscopic moving images that are sequentially enhanced and displayed are automatically stored in the slide function, and when the execution window 240 is moved out of the target, images, sounds, moving images, 2D and 3D stereoscopic images The slide function button is created while the movie is displayed on the screen. The generated slide buttons can be used to re-search images, sounds, moving images, 2D and 3D stereoscopic moving images that were displayed in order or in reverse order.

Regardless of the number of data stored in the storage unit, the slide function can search only images, sounds, moving images, 2D and 3D stereoscopic moving images that were displayed on the screen of the electronic communication device through the navigation buttons, .

When the execution window 240 is changed, the search button and the slide function are returned to the initial ready state and are not displayed on the screen. Here, changing the execution window means cutting the detailed menu portion before the execution window.

The slide function is divided into an automatic view slide means and a manual view slide means, and is installed in an application. The manual and automatic view slide means can be selected and produced automatically when the execution window is out of the target.

When the manual view slide means is executed, a button called automatic view is created at the top or a designated position of the screen, and a button called manual view is generated when the automatic view button is selected.

The manual view slide means allows the user to re-search images, sounds, moving images, 2D and 3D stereoscopic moving images that have been enhanced and displayed by touching the button in a sequential or reverse order. This function does not select a button, , Sound, moving picture, 2D, and 3D stereoscopic moving picture are fixedly displayed on the screen of the electronic communication device. This enhanced image, sound, movie, 2D, and 3D stereoscopic video can be used with all of the included functions.

The automatic view slide means is designed to automatically determine whether images, sounds, moving images, 2D and 3D stereoscopic moving images that have been displayed in advance by the manufacturer are automatically re-searched at intervals of several seconds, and then installed and installed in the application.

When the automatic viewing slide means is selected, the image, sound, moving image, 2D, and 3D stereoscopic moving image, which is enhanced and displayed like the manual viewing sliding means, are not fixed but displayed automatically at a predetermined time interval.

The automatic viewing slide means has the advantage of automatically displaying images, sounds, moving images, 2D and 3D stereoscopic moving images that have been enhanced and displayed, but it has a disadvantage in that it can be limited to use the functions installed in the application. Manual, automatic view Slide means must be created and executed automatically when the execution window is out of target.

FIG. 7 is an explanatory diagram of an augmented reality experience built in the product augmented reality application system with the content utilization function of the present invention. The enhancement experience function can be used to create images, texts, sounds, movies, 2D and 3D stereoscopic videos that are not previously matched with images, marks, letters, Text, sound, video, 2D, 3D stereoscopic video can be enhanced.

This means that products interlinked with the product augmented reality application system equipped with the utilization function of the present contents of the present invention, that is, the image or the mark, the garment or the printed fabric, the advertisement fabric, the paper, the key ring, It can be used as an article or a magazine or a magazine or a magazine or a book or a book or a curtain or a carpet or a wallpaper or a calendar or a sheet or a quilt or a mat or an interior ornament or a cap or a lid or a container or a card or a magic or a parish, It is possible to experience simple enhancement through unspecified image or mark letter even if there is no product that displays image, mark, or letter, or product that displays image, mark, or letter of card provided in product or inside of product It is equipped with the function to utilize the contents displayed through the enhancement experience function even when the product is not installed after the application is installed. Describe and experience products that work with the system.

The present invention can be used through an experience button installed in an application. When a button is executed, a screen is executed and a selection button is executed as shown in FIG. 7, and a screen is displayed in which an unmatched image or mark is highlighted, , Images, texts, sounds, moving images, 2D and 3D stereoscopic moving images stored in the application storage unit are randomly extracted and displayed in advance through the production server.

All of the functions exemplified in FIG. 6, such as all images, texts, sounds, moving images, navigation generated with 2D and 3D stereoscopic moving images, automatic viewing slides, manual viewing slide means, and the like are disclosed in Patent Application No. 2015-0099381 And augmented reality application systems (with built-in add-ons).

In addition, it is a reinforcement experience function that enables to experience both new search function and slide function that are newly displayed when a new target is displayed. However, in order to execute the enhancement experience, the experience button generated after executing the enhancement experience button 80 should be used.

As described above, a step of creating an application, an image, a character, a video, a 2D and a 3D stereoscopic video linked with an image, a mark, and a character target in an administrator system, a step of publishing the created application to a Google store and an app store , Downloading the published application from the store and installing a dedicated application in the electronic communication device, recognizing images, marks, and characters after executing the application through the object recognition system, Image, character, moving image, 2D and 3D stereoscopic video through the screen of the electronic communication device, a navigation button and a slice button generated in association with the enhanced displayed image, character, video, 2D and 3D stereoscopic video, No. 2015-0099381, filed by the same assignee as the present invention, Real-time application system), images, text, video, 2D, and 3D stereoscopic video images that are pre-manufactured by the administrator system through unmatched unspecified images, marks, and character targets And an enhancement experiential function stage which can be called up randomly.

In other words, the experience function in the execution window 240 can be applied to all the products invented by the present inventor until now. The application system includes a product or a printed fabric in which an image, a mark or a letter is displayed, , Paper, key chains, hats, bags, articles, catalogs, magazines, flyers, books, curtains, carpets, wallpapers, calenders, sheets, quilts, mats, interior goods, stoppers and lids, Images, marks, letters and dictionaries of products that display images, marks, and letters of cards, tabs, toys, textbooks, packaging, tags, images, Image, sound, video, 2D, and 3D stereoscopic videos produced by the production department are matched through the object recognition system through the matching operation. A moving image of a moving object, an image of a moving object, a moving image of a moving image, a 2D stereoscopic moving image, and a stereoscopic moving image prepared in advance by a manufacturing section are stored in an application storage section, Sound, video, 2D, and 3D stereoscopic video stored temporarily for matching with the target obtained by selecting the select button (the name of the button may be changed) And displayed on the screen of the electronic communication device.

At this time, the enhanced image, sound, moving image, 2D, and 3D stereoscopic moving image can be stored in a predetermined order or can be randomly extracted and displayed. If you press the Select button, the image, sound, movie, 2D and 3D stereoscopic video will be changed and displayed. If you do not click the select button, Enhancement The image, sound, movie, 2D, and 3D stereoscopic moving images that have been displayed are enhanced and displayed through the same image, mark, and letter. The experience function can also be installed in the application by connecting it with the slide function in advance by the maker.

According to the present invention, it is possible to search an image, a character, a moving image, a 2D and a 3D stereoscopic moving image which are one or one-to-one matched with an image, a mark and a character target displayed on the product, When the image, mark, and character target are recognized again, the linked image, text, moving image, 2D and 3D stereoscopic video are newly displayed and new navigation buttons and manual and automatic slide buttons can be used.

Although the present invention has been described with reference to the preferred embodiments of the present invention, it should be understood by those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the appended claims, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

100: main server
200: Application
300: Image, mark, and character target displayed on the product
400: Electronic communication device screen section
450:

Claims (12)

The reception device and the transmission device of the main server for extracting or retrieving contents from the database are network-communicated in the transmission device and the reception device of the application for the electronic communication device equipped with the object recognition system, and the execution window in the application is displayed on the electronic communication device screen Wherein the execution window and the object recognition system are respectively displayed on a screen area target of an image, a mark, and a character displayed on a product recognizable by a target of a screen area through a view and being able to acquire a target,
Wherein the execution window includes a menu portion for menu selection and a control portion for executing a function for requesting and selecting data to execute the selected function are mutually operated and the control portion is caused to mutually operate the application storage portion for checking contents and transmitting contents;
Products, such as clothing, printed fabrics, printed fabrics, paper, key chains, hats, bags, industrial products, catalogs, magazines, flyers, books, curtains, carpets, wallpaper, calendars, , The appearance of a product that can display a tag, an image, a mark, or a letter, or an image of a card provided inside the product or a product, a mat, an interior article, a cap or a lid, a container, a magnetic parish, Mark and character are displayed as the screen area target, the navigation buttons and the stop button are displayed on the execution window of the electronic communication device at the same time as the initial display is being displayed, and the left and right slide buttons are displayed on the screen area And the generated content augmented reality application system with the content utilization function. The method according to claim 1,
The image, sound, moving image, 2D and 3D stereoscopic moving image of the present screen in a single image mark are successively displayed in an enhancement state, enhanced image, sound, moving image, 2D and 3D stereoscopic moving image And stopping and observing the contents using a stop button. The present invention relates to a product augmented reality application system with a content utilization function. The method according to claim 1,
A plurality of images, sounds, moving images, 2D and 3D stereoscopic videos or one-to-one matched images, marks, and characters in a screen area target of one image, mark, and character in the execution window If the image, sound, movie, 2D, or 3D stereoscopic video beyond the target of the screen area is activated automatically, the slide function will be automatically activated so that the last enhancement image, sound, movie, 2D, And the left and right slide buttons are generated and used. The method according to claim 1,
The menu part of the execution window includes a main menu part and an execution menu part. The main menu part is divided into a plurality of large menus such as the main menu part, and the detailed menu part selects a main menu part and then executed through an image, mark, Augmented reality application system with a content utilization function, which is characterized in that the experience function is displayed on a main menu or a submenu in the augmented reality application system. 5. The method of claim 4,
In the execution window, images, marks, and characters displayed on the product are used as a screen region target. The image, sound, moving image, and 2D and 3D stereoscopic video enhanced by using the button are displayed in the screen region When the selection button is executed without leaving the target, the stored contents are displayed in a sequential or reverse order, and another or the same content is displayed in an enhanced state when a different target is acquired and then the screen area target is illuminated. Products with built-in augmented reality application systems. delete The reception device and the transmission device of the main server for extracting or retrieving contents from the database are network-communicated in the transmission device and the reception device of the application for the electronic communication device equipped with the object recognition system, and the execution window in the application is displayed on the electronic communication device screen Wherein the execution window and the object recognition system are respectively displayed on a screen area target of an image, a mark, and a character displayed on a product recognizable by a target of a screen area through a view and being able to acquire a target,
Wherein the execution window includes a menu portion for menu selection and a control portion for executing a function for requesting and selecting data to execute the selected function are mutually operated and the control portion is caused to mutually operate the application storage portion for checking contents and transmitting contents;
A navigation button that can bring in a large number of images, characters, moving images, 2D and 3D stereoscopic video images displayed in a screen area target of one image, mark, and letter,
An automatic view slide button for re-calling a plurality of images, texts, videos, 2D and 3D stereoscopic videos that have been displayed through the navigation buttons,
A manual view slide button that can reinitialize images, texts, videos, 2D, and 3D stereoscopic videos in a one-to-one match with image, mark, and character area targets,
An augmentation experience button that is randomly displayed as an image area, a non-specific image, a mark, or a letter as a screen area target,
A storage unit for storing an image, a mark, and an image, character, moving image, 2D, and 3D stereoscopic moving image linked with a character target, which are produced by a data production unit, are used mutually using a product augmented reality application system. delete 8. The method of claim 7,
A function for searching for images, characters, moving images, 2D and 3D stereoscopic moving images which are one or one-to-one matched with the screen area targets of images, marks and letters displayed on the product, and a function for manually and automatically sliding buttons Generated,
When the image area, the target of the mark, and the screen area of the character are recognized again, the linked image, character, moving image, 2D and 3D stereoscopic moving image are newly enhanced and displayed, and new navigation buttons and manual and automatic slide buttons are used. Augmented reality application system with content utilization function. 10. The method of claim 9,
The product may be a product or a product that displays an image, a mark or a letter, a printed fabric, an advertising fabric, a paper key chain, a hat, a product of a bag, a catalog, a magazine, a handbill, a book, a curtain, , The appearance of a product that can display a tag, an image, a mark, or a letter, or an image of a card provided inside the product or a product, a mat, an interior article, a cap or a lid, a container, a magnetic parish, A mark, and a character on the display screen of the product augmented reality application system. The reception device and the transmission device of the main server for extracting or retrieving contents from the database are network-communicated in the transmission device and the reception device of the application for the electronic communication device equipped with the object recognition system, and the execution window in the application is displayed on the electronic communication device screen Wherein the execution window and the object recognition system are respectively displayed on a screen area target of an image, a mark, and a character displayed on a product recognizable by a target of a screen area through a view and being able to acquire a target,
After the application is executed, the image, mark, and character are recognized through the object recognition system. Then, the image, text, moving image, 2D, and 3D stereoscopic moving image stored in the application storage unit are displayed through the screen of the electronic communication device,
Enhancement Using navigation buttons, slice buttons and various functions created in the screen area in conjunction with images, text, moving images, 2D and 3D stereoscopic video,
The screen area target of unmatched unspecified images, marks, and letters can be used to randomly recall images, text, moving images, 2D and 3D stereoscopic video in the application storage area,
In the execution window, a plurality of images, characters, moving images, 2D and 3D stereoscopic moving images can be retrieved from a single image, a mark, and a screen area target of a character, and a plurality of images , Text, video, 2D and 3D stereoscopic video and re-augment at regular intervals Automatically view slide buttons that are displayed one by one with the screen area target of images, marks, and letters, 2D, and 3D stereoscopic moving images by manually selecting the displayed images in order of appearance. Manual slide button to display the slide button, image, mark, or character image area without matching the screen area target, unspecified images, marks, and letters to the screen area target And an enhancement experience button displayed as a random enhancement is displayed. Product augmented reality application system. delete

Images