KR20120082622A - System and method for providing augmented reality service - Google Patents

Abstract

PURPOSE: An AR(Augmented Reality) service providing system and method thereof are provided to solve visual association shortage problems by stereoscopically converting a specific target image of a screen. CONSTITUTION: An AR content playback apparatus(100) stereoscopically converts target images within a specific effect application area of AR content according to one or more property information based on service realization information of an information providing apparatus(200). The AR content playback apparatus displays the converted states for the target images. The AR content playback apparatus changes a stereoscopic image object into a virtual object according to an AR service after the specific effect application time is exceeded.

Description

Augmented Reality Service Provision System and Method {SYSTEM AND METHOD FOR PROVIDING AUGMENTED REALITY SERVICE}

The present invention relates to a system and method for providing an augmented reality service, and more particularly, in providing an augmented reality service in which a virtual object is rendered, such that a specific target image in a screen gradually rises three-dimensionally in the augmented reality content playback device. Augmented reality service providing system that resolves the lack of visual relevance and unnaturalness by naturally appearing virtual objects in augmented reality service without additional animation work on virtual object model by performing stereoscopic conversion. And a method, an augmented reality content reproducing apparatus, and a method of operating the augmented reality content reproducing apparatus.

Augmented Reality (AR) is one of virtual reality that combines the real world that the user sees with the virtual world with additional information in one image. AR, a concept that complements the real world with a virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics serve to provide additional information needed for the real world. This means that the distinction between the real environment and the virtual screen is blurred by overlapping the 3D virtual image on the live image that the user sees.

The augmented reality service by the method of implementing such an augmented reality, unfolds the page of the printed book, photographed through the camera and the playback device displays the captured real-time image on the screen, a specific marker is recorded in the page As a result, when a specific marker is recognized within the captured image, there is a method of drawing a 3D graphic model connected to the marker on an actual image, ie, a captured image. Here, the marker is actually present on the two-dimensional plane, and provides information on the size, direction, and position in which the three-dimensional graphic model connected to it is drawn.

However, the conventional augmented reality service described above is unnatural due to the sudden appearance of a mapped three-dimensional graphic model, ie, a virtual object, on which a real-time photograph, that is, a three-dimensional graphic model is rendered, on a page screen. You look away. In order to make these parts more natural, we are trying to animate the virtual 3D graphic model itself to give dynamic activities or apply dynamic effects. However, this supplementary work is inconvenient to change or create a 3D graphic model and to animate it. As a result, the size of the 3D graphic model becomes large, such as an inefficient problem.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide specific service implementation information in which an information providing device implements a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service. An augmented reality service for storing augmented reality content by the augmented reality content reproducing apparatus and outputting an augmented reality content including a virtual object according to a preset augmented reality implementation function performed by the augmented reality content reproducing apparatus; In the providing, the stereoscopic conversion is performed on the target image in the specific effective area included in the augmented reality content according to the at least one attribute information set on the basis of the service implementation information to the target image according to the stereoscopic converting process. Display the deformation state of the Augmented reality service providing a system and method for providing augmented reality service for converting a stereoscopic image object according to the stereoscopic conversion after the transition to the virtual object according to the augmented reality service, without a separate animation work on the virtual object model It is to solve the lack of visual relevance and unnaturalness by appearing poetry virtual object naturally.

The present invention has been made in view of the above circumstances, and another object of the present invention is to store specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service, and When providing an augmented reality service that outputs augmented reality content including a virtual object according to an augmented reality implementation function, within a specific effective area included in the augmented reality content according to at least one attribute information set based on the service implementation information. Performing stereoscopic conversion on the target image to display the deformation state of the target image according to the stereoscopic converting process, and after a specific effective time elapses, the stereoscopic image object according to the stereoscopic converting according to the augmented reality service. Augmented reality that converts and displays virtual objects Provides a method of operation of a content reproducing apparatus, and AR contents reproducing device, is to solve such a separate animation work without augmented reality service when a virtual object to a natural appearance to the visual lack of relevance and unnatural for a virtual object model.

An augmented reality service providing system according to a first aspect of the present invention for achieving the above object comprises: an information providing apparatus for providing specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service; And storing the service implementation information from the information providing apparatus and providing augmented reality service outputting an augmented reality content including a virtual object according to the execution of a preset augmented reality implementation function, based on the service implementation information. Performs stereoscopic conversion on the target image in the specific effective application area included in the augmented reality content according to one attribute information to display the deformation state of the target image according to the stereoscopic converting process, and the specific effective time elapsed. And augmented reality content reproduction apparatus for converting and displaying a stereoscopic image object according to the stereoscopic converting into the virtual object according to the augmented reality service.

Augmented reality content playback device according to a second aspect of the present invention for achieving the above object, augmented reality service providing an augmented reality service for outputting augmented reality content including a virtual object according to performing a predetermined augmented reality implementation function Providing unit; And store specific service implementation information for implementing a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service, and provide the augmented service according to at least one attribute information set based on the service implementation information when the augmented reality service is provided. Performs stereoscopic conversion on the target image in the specific effective application area included in the real content to display the deformation state of the target image according to the stereoscopic conversion process, and after the specific effective time has elapsed And an effect function control unit for converting and displaying an image object into the virtual object according to the augmented reality service.

Preferably, the effect function control unit may store the service effect implementation information by reflecting the at least one attribute information set by a user with respect to an execution environment of the stereoscopic converting effect function.

Preferably, the at least one attribute information includes region designation information for designating the specific effective area, performance time information for designating an execution time for performing the stereoscopic conversion, and a texture applied in the process for performing stereoscopic conversion. ), Texture information specifying), transparency information specifying transparency applied in the process of performing the stereoscopic conversion, deformation characteristics applied to the target image according to the stereoscopic converting, and specifying the final size of the stereoscopic image object. It may include at least one of scale information, time designation information for designating the specific effective time.

Preferably, the effect function control unit, when providing the augmented reality service by the augmented reality service provider, when reaching the execution time according to the execution time information to the target image in the effective application area according to the region designation information The stereoscopic conversion is performed based on the texture information, the transparency information, and the scale information for the effective time according to the time designation information, so as to sequentially transform the target image displayed in the 2D form into the 3D image object in the 3D form. You can.

The augmented reality service providing method according to a third aspect of the present invention for achieving the above object, the information providing apparatus provides a specific service implementation information for implementing a three-dimensional converting effect function corresponding to the virtual object applied to the augmented reality service step; Storing, by the augmented reality content reproducing apparatus, the service implementation information from the information providing apparatus; When providing an augmented reality service outputting an augmented reality content including a virtual object in accordance with a preset augmented reality implementation function in the augmented reality content playback device, the augmented reality according to at least one attribute information set based on the service implementation information Displaying a deformation state of the target image according to the stereoscopic converting process by performing stereoscopic conversion on the target image in the specific effective area included in the real content; And converting, by the apparatus for reproducing augmented reality contents, a stereoscopic image object according to the stereoscopic converting after the specific effective time elapses into the virtual object for the augmented reality service.

A method of operating an augmented reality content playback apparatus according to a fourth aspect of the present invention for achieving the above object is a service for storing specific service implementation information for implementing a three-dimensional converting effect function corresponding to a virtual object applied to an augmented reality service Implementation information storage step; A symptom reality service execution step of providing an augmented reality service outputting an augmented reality content including a virtual object according to a preset augmented reality implementation function; When the augmented reality service is provided, the stereoscopic conversion is performed on a target image in a specific effective area included in the augmented reality content according to at least one attribute information set based on the service implementation information. A converting display step of displaying a deformation state of the target image; And a conversion display step of converting and displaying a stereoscopic image object according to the stereoscopic converting operation into the virtual object according to the augmented reality service after a specific effective time elapses.

Preferably, the service implementation information storing step may store the service effect implementation information by reflecting the at least one attribute information set by a user with respect to an execution environment of the stereoscopic converting effect function.

Preferably, the at least one attribute information includes region designation information for designating the specific effective area, performance time information for designating an execution time for performing the stereoscopic conversion, and a texture applied in the process for performing stereoscopic conversion. ), Texture information specifying), transparency information specifying transparency applied in the process of performing the stereoscopic conversion, deformation characteristics applied to the target image according to the stereoscopic converting, and specifying the final size of the stereoscopic image object. It may include at least one of scale information, time designation information for designating the specific effective time.

Preferably, in the converting display step, when the augmented reality service is provided, when the execution time according to the execution time information is reached, an effect according to the time designation information on the target image in the effective application area according to the area designation information. During the application time, the stereoscopic conversion may be performed based on the texture information, the transparency information, and the scale information to sequentially transform the target image displayed in the 2D form into the 3D image object in the 3D form.

Accordingly, according to the augmented reality service providing system and method of the present invention, in providing an augmented reality service in which a virtual object is rendered, the augmented reality content playback apparatus gradually rolls up a specific target image in the screen and comes up three-dimensionally. By converting and making it appear as a virtual object, it is possible to solve the lack of visual relevance and unnaturalness by naturally appearing the virtual object in the augmented reality service without any additional animation work on the virtual object model.

1 is a block diagram of an augmented reality service providing system according to a preferred embodiment of the present invention.
2 is a block diagram of an apparatus for reproducing augmented reality content according to a preferred embodiment of the present invention.
3 is an exemplary view showing a deformation state of a target image according to a stereoscopic converting process in the augmented reality content playback apparatus according to a preferred embodiment of the present invention.
4 is a flowchart illustrating a control flow of a method for providing augmented reality service according to a preferred embodiment of the present invention.
5 is a flowchart illustrating a method of operating an augmented reality content playback device according to a preferred embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a diagram illustrating an augmented reality service providing system according to a preferred embodiment of the present invention.

As shown in FIG. 1, the augmented reality service providing system according to the present invention includes an information providing apparatus 200 for providing specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service. And storing the service implementation information from the information providing apparatus 200 and providing augmented reality service outputting an augmented reality content including a virtual object according to performing a preset augmented reality implementation function, based on the service implementation information. Display the deformation state of the target image according to the process of performing the stereoscopic conversion by performing stereoscopic conversion on the target image in the specific effective area included in the augmented reality content according to the at least one attribute information set in advance. The augmented reality of the three-dimensional image object according to the three-dimensional conversion performed after the application time It includes an augmented reality content player 100 to display to switch to the virtual object according to the service.

The information providing apparatus 200 is a device for providing specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service.

The information providing apparatus 200 may provide the service implementation information to the augmented reality content playback device 100 upon request from the augmented reality content playback device 100 or when a specific provision period is reached.

Here, the service implementation information may include a service implementation program produced to implement a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service.

Thus, the augmented reality content playback device 100 stores the service implementation information provided from the information providing device 200.

The augmented reality content playback device 100 is a device for providing an augmented reality service for outputting augmented reality content including a virtual object in accordance with a preset augmented reality implementation function.

For example, the augmented reality content playback apparatus 100 may output augmented reality content including a virtual object by performing a preset augmented reality implementation function in playing the advertisement content stored from the outside or internally, or specific. Augmented reality may be output based on a photographed image of a printed book to output augmented reality content including a virtual object.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book.

That is, the augmented reality content playback apparatus 100 analyzes a photographed image of a specific page of a printed book (not shown) located in a specific photographing area and implements a preset augmented reality function corresponding to the analysis result (eg, 3D). Augmented reality by displaying augmented reality content (e.g., a photographed image + a virtual object) applying a specific virtual object (e.g., a 3D graphic model) to the photographed image according to performing a rendering of a graphic model). Can provide services.

The augmented reality content reproducing apparatus 100, when providing the augmented reality service as described above, according to at least one attribute information preset based on pre-stored service implementation information to the target image in the specific effective application area included in the augmented reality content Stereoscopic converting is performed to display the deformation state of the target image according to the stereoscopic converting process.

That is, the augmented reality content playback apparatus 100, the target image in the specific effective area included in the augmented reality content, that is, the specific target image in the page screen of the printed book (not shown) corresponding to the photographed image is gradually rolled out. Three-dimensional conversion is performed to make it come up three-dimensionally and gradually change from 2D form to 3D form. As such, a printed book (not shown) corresponding to the photographed image shows a visual deformation state in which a specific target image gradually changes from 2D form to 3D form. Can be displayed on the page screen.

The augmented reality content reproducing apparatus 100 may convert the stereoscopic image object according to the stereoscopic converting as described above into a corresponding virtual object according to the augmented reality service after the specific effective time elapses.

That is, the augmented reality content playback device 100, the result of the three-dimensional conversion of the specific target image in the page screen of the printed book (not shown) corresponding to the photographed image gradually transformed from the 2D form to the 3D form, that is, of the 3D form The three-dimensional image object can be displayed by switching to the corresponding virtual object according to the augmented reality service this time.

Thus, when the augmented reality content playback apparatus 100 according to the present invention provides augmented reality service, a specific target image in a real background screen is visually gradually displayed in a 2D form before displaying a virtual object according to augmented reality implementation function. By transforming and displaying the 3D image object into a virtual object according to the implementation of the augmented reality implementation function, the virtual object according to the provision of the augmented reality service can be naturally rendered / appeared on the screen.

Hereinafter, the augmented reality content playback apparatus 100 according to the present invention will be described in more detail with reference to FIG. 2.

 Augmented reality content playback device 100 according to the present invention, augmented reality service to provide augmented reality service by outputting the augmented reality content including the virtual object through the output unit 110 according to the performance of the preset augmented reality implementation function The provider 120 stores specific service implementation information for implementing a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service, and at least one preset based on the service implementation information when the augmented reality service is provided. Performs stereoscopic conversion on the target image in the specific effective area included in the augmented reality content according to the attribute information to display the deformation state of the target image according to the stereoscopic converting process, and after the specific effective use time has elapsed. The virtual object according to the augmented reality service to the stereoscopic image object according to the stereoscopic conversion It includes an effect function control unit 130 to switch to the sieve.

The output unit 110 outputs augmented reality content output by the augmented reality service providing unit 120 and displays a deformation state of the target image according to stereoscopic conversion performed by the effect function control unit 130. The display unit may include a display unit (not shown) for outputting a screen and / or a speaker unit (not shown) for outputting a sound.

The augmented reality service providing unit 120 is a function unit that provides an augmented reality service by outputting an augmented reality content including a virtual object through the output unit 110 according to a preset augmented reality implementation function.

For example, the augmented reality service providing unit 120 may output augmented reality content including a virtual object by performing a preset augmented reality implementation function in playing advertisement content stored from the outside or internally, or specific. Augmented reality may be output based on a photographed image of a printed book to output augmented reality content including a virtual object.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book.

That is, the augmented reality service provider 120 analyzes a photographed image of a specific page of a print book (not shown) located in a specific photographing area, and implements a preset augmented reality function corresponding to the analysis result (eg, 3D). Rendering augmented reality content (eg, a photographed image + a virtual object) applying a specific virtual object (eg, a 3D graphic model) to the photographed image according to performing the augmented reality rendering function). The augmented reality service can be provided by displaying through).

As such, the augmented reality service provider 120 may render / apply a virtual object to a captured image through various methods such as a marker-based, marker-free, or marker-less based. A general augmented reality service that outputs reality content may be provided.

The effect function control unit 130 stores specific service implementation information for implementing the stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service.

Here, the service implementation information stored in the effect function control unit 130 may be information provided / stored from the information providing server 200 mentioned above with reference to FIG. 1.

Such service implementation information may include a service implementation program designed to implement a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service.

That is, the service implementation information is based on at least one set of attribute information. The target image in the specific effective area included in the augmented reality content, that is, the specific target in the page screen of the printed book (not shown) corresponding to the photographed image. It is a program designed to perform stereoscopic conversion so that an image is gradually raised in three dimensions and visually changed from a 2D form to a 3D form.

When the augmented reality service providing unit 120 provides the augmented reality service by performing the preset augmented reality implementation function, the effect function control unit 130 may apply to at least one set of attribute information based on previously stored service implementation information. Accordingly, by performing stereoscopic conversion on the target image in the specific effective area included in the augmented reality content, the deformation state of the target image according to the stereoscopic converting process is displayed through the output unit 110.

In this case, the effect function control unit 130 requests the augmented reality service provider 120 to delay the display of the corresponding virtual object according to the execution of the augmented reality implementation function and causes the augmented reality service provider 120 to correspond to the captured image. For example, only the augmented reality content, that is, the captured image, which is not applied to the 3D graphic model may be output through the output unit 110.

More specifically, the effect function control unit 130 reflects the service effect implementation information by reflecting at least one attribute information set by the user with respect to the execution environment of the stereoscopic converting effect function in storing / managing the service implementation information. Can save / manage

Here, the at least one attribute information set by the user may include region designation information for designating the specific effective area, performance point information for designating an execution time for performing the stereoscopic conversion, and textures applied during the stereoscopic converting process. Texture information specifying (Texture), transparency information specifying transparency applied in the process of performing stereoscopic conversion, deformation characteristics applied to the target image according to the stereoscopic converting, and the final size of the stereoscopic image object. It is preferable to include at least one of the scale information to designate and the time designation information which designates the said specific effective use time.

That is, the user can select which position of the screen to apply stereoscopic conversion by setting region designation information that designates an effective application area to which stereoscopic conversion is applied. For example, the region designation information may include coordinate information designating a specific display region, or a display region in which the largest image is displayed through a recognition result according to a specific image recognition function for recognizing an image displayed on a screen. It may also include automatic setting information to automatically designate as the area designation information.

In addition, the user may select when to apply stereoscopic conversion by setting performance point information that specifies an execution point for performing stereoscopic conversion. For example, the performance time information is virtual as a result of performing the first performance time point information or the augmented reality implementation function to automatically perform stereoscopic conversion when the augmented reality service providing unit 120 performs the augmented reality implementation function. Second execution time information for automatically performing stereoscopic converting when it is recognized that an object is included, or third performing time information for performing stereoscopic converting when a manual input for executing the stereoscopic converting effect function is present by a user. It may include.

Also, the user can select texture to be applied to the surface of the target image in the process of performing the stereoscopic conversion on the target image by setting texture information specifying the texture applied in the process of performing the stereoscopic conversion. By setting transparency information such as start alpha value and end alpha value that specify the applied transparency, the transparency to be applied to the surface of the target image can be selected in the process of performing stereoscopic conversion on the target image.

In addition, the user sets the deformation characteristic applied to the target image and the scale information designating the final size of the stereoscopic image object according to the stereoscopic conversion, the characteristic information for rolling up vertically, the characteristic information for expanding the horizontal area, By setting the characteristic information to increase the volume, you can select how to transform the 2D object image into 3D shape, and choose the final size of the 3D object, that is, the 3D object. have.

In addition, the user can select how long to maintain the stereoscopic conversion by setting the time designation information designating the specific effective time.

Therefore, the effect function control unit 130, when providing augmented reality service by performing a preset augmented reality implementation function in the augmented reality service providing unit 120, based on the service effect implementation information reaches the execution time according to the performance time information In this case, three-dimensional conversion is performed on the target image in the effective area according to the area designation information based on the texture information, transparency information, and scale information during the effective use time according to the time designation information. It can be transformed into a stereoscopic image object of.

For example, the effect function control unit 130, if a virtual object exists when performing the augmented reality implementation function preset in the augmented reality service providing unit 120, based on the service effect implementation information (for example, performing second) Based on the viewpoint information, it recognizes that the execution point has been reached, recognizes the effective use area according to the area designation information, and the target image in the effective use area, that is, in the page screen of the printed book (not shown) corresponding to the photographed image. Performs stereoscopic conversion based on texture information, transparency information, and scale information for a specific target image according to time-specified time (e.g., 2 seconds), and displays the deformation state of the target image according to the stereoscopic conversion process. It can be displayed through the output unit 110.

In this case, the effect function control unit 130 requests the augmented reality service provider 120 to delay the display of the corresponding virtual object according to the execution of the augmented reality implementation function, thereby causing the augmented reality service provider 120 to correspond to the captured image. The subject according to the process of performing stereoscopic conversion on the captured image to which the virtual object is not applied by outputting only the augmented reality content, that is, the captured image, which is not applied to the object (eg, a 3D graphic model) through the output unit 110. The deformation state of the image can be displayed.

Therefore, referring to FIG. 3, in the augmented reality content playback apparatus 100 according to the present invention, only augmented reality content, that is, a photographed image 10a that does not apply a virtual object (eg, a 3D graphic model) is displayed. In the state A., according to the above-described stereoscopic conversion, the deformation state in which the target image 1 in the effective area is gradually changed from the 2D form to the 3D form will be displayed. That is, the page of the print book (not shown) corresponding to the photographed image shows the visual deformation state 2 of the specific target image 1 that is gradually rolled up and is raised three-dimensionally and gradually changed from 2D form to 3D form as shown in B. It can be displayed on the screen 10a.

In addition, the effect function control unit 130, after the specific effective time (for example, 2 seconds) elapses the three-dimensional image object according to the three-dimensional converting performed in the virtual reality augmented reality service provided by the augmented reality service providing unit 120 Switch to an object (eg a 3D graphic model) to display.

That is, referring to C. of FIG. 3, the effect function control unit 130, in conjunction with the augmented reality service provider 120, performs a printing book (not shown) corresponding to the photographed image according to performing stereoscopic conversion. The virtual object 20 from the augmented reality service providing unit 120 according to the augmented reality service in accordance with the augmented reality service, the result of the target image in the page screen is gradually transformed from the 2D form to the 3D form. Can be switched to display.

Thus, when the augmented reality content playback apparatus 100 according to the present invention provides augmented reality service, a specific target image in a real background screen is visually gradually displayed in a 2D form before displaying a virtual object according to augmented reality implementation function. By transforming and displaying the 3D image object into a virtual object according to the implementation of the augmented reality implementation function, the virtual object according to the provision of the augmented reality service can be naturally rendered / appeared on the screen.

As described above, in the augmented reality service providing system according to the present invention, in providing an augmented reality service in which a virtual object is rendered, a specific target image in a screen gradually rises three-dimensionally on the augmented reality content playback apparatus 100. By converting the image to a virtual object by performing stereoscopic conversion, it is possible to solve the lack of visual relevance and unnaturalness by naturally appearing the virtual object in the augmented reality service without any additional animation work on the virtual object model.

Hereinafter, a method of providing augmented reality service according to a preferred embodiment of the present invention will be described with reference to FIGS. 4 to 5. Here, for convenience of description, the components shown in FIGS. 1 to 3 will be described with reference to corresponding reference numerals.

First, the augmented reality service providing method of the present invention will be described with reference to FIG. 4.

The information providing apparatus 200 provides the augmented reality content playback apparatus 100 with specific service implementation information for implementing a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service (S10).

The information providing apparatus 200 may provide the service implementation information to the augmented reality content playback device 100 upon request from the augmented reality content playback device 100 or when a specific provision period is reached. Here, the service implementation information may include a service implementation program produced to implement a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service.

The augmented reality content reproducing apparatus 100 stores the service implementation information provided from the information providing apparatus 200 (S20).

The augmented reality content playback apparatus 100 may provide an augmented reality service by outputting an augmented reality content including a virtual object by performing a preset augmented reality implementation function (S30).

For example, the augmented reality content playback apparatus 100 may output augmented reality content including a virtual object by performing a preset augmented reality implementation function in playing the advertisement content stored from the outside or internally, or specific. Augmented reality may be output based on a photographed image of a printed book to output augmented reality content including a virtual object.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book.

That is, the augmented reality content playback apparatus 100 analyzes a photographed image of a specific page of a printed book (not shown) located in a specific photographing area and implements a preset augmented reality function corresponding to the analysis result (eg, 3D). Augmented reality by displaying augmented reality content (e.g., a photographed image + a virtual object) applying a specific virtual object (e.g., a 3D graphic model) to the photographed image according to performing a rendering of a graphic model). Can provide services.

The augmented reality content playback device 100, when performing the augmented reality implementation function to provide the augmented reality service as described above, the specific content included in the augmented reality content based on at least one attribute information preset based on the stored service implementation information By performing stereoscopic conversion on the target image in the effective area, the deformation state of the target image according to the stereoscopic conversion process may be displayed (S40).

That is, the augmented reality content playback apparatus 100, the target image in the specific effective area included in the augmented reality content, that is, the specific target image in the page screen of the printed book (not shown) corresponding to the photographed image is gradually rolled out. Three-dimensional conversion is performed to make it come up three-dimensionally and gradually change from 2D form to 3D form. As such, a printed book (not shown) corresponding to the photographed image shows a visual deformation state in which a specific target image gradually changes from 2D form to 3D form. Can be displayed on the page screen.

The augmented reality content playback apparatus 100 may convert the stereoscopic image object according to the stereoscopic converting as described above into a corresponding virtual object according to the augmented reality service after the specific effective time elapses (S50).

That is, the augmented reality content playback device 100, the result of the three-dimensional conversion of the specific target image in the page screen of the printed book (not shown) corresponding to the photographed image gradually transformed from the 2D form to the 3D form, that is, of the 3D form The three-dimensional image object can be displayed by switching to the corresponding virtual object according to the augmented reality service this time.

Thus, when the augmented reality content playback apparatus 100 according to the present invention provides augmented reality service, a specific target image in a real background screen is visually gradually displayed in a 2D form before displaying a virtual object according to augmented reality implementation function. By transforming and displaying the 3D image object into a virtual object according to the implementation of the augmented reality implementation function, the virtual object according to the provision of the augmented reality service can be naturally rendered / appeared on the screen.

Hereinafter, an operation method of the apparatus for reproducing augmented reality content according to the present invention will be described in detail with reference to FIG. 5.

The operation method of the apparatus for reproducing augmented reality content 100 according to the present invention stores specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service (S100).

Here, the stored service implementation information may be information provided / stored from the information providing server 200 mentioned above, in particular through FIG. 1.

Such service implementation information may include a service implementation program designed to implement a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service.

That is, the service implementation information is based on at least one set of attribute information. The target image in the specific effective area included in the augmented reality content, that is, the specific target in the page screen of the printed book (not shown) corresponding to the photographed image. It is a program designed to perform stereoscopic conversion so that an image is gradually raised in three dimensions and visually changed from a 2D form to a 3D form.

In addition, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention may store / manage service effect implementation information by reflecting at least one attribute information set by a user with respect to an execution environment of a stereoscopic converting effect function. There is (S110).

Here, the at least one attribute information set by the user may include region designation information for designating the specific effective area, performance point information for designating an execution time for performing the stereoscopic conversion, and textures applied during the stereoscopic converting process. Texture information specifying (Texture), transparency information specifying transparency applied in the process of performing stereoscopic conversion, deformation characteristics applied to the target image according to the stereoscopic converting, and the final size of the stereoscopic image object. It is preferable to include at least one of the scale information to designate and the time designation information which designates the said specific effective use time.

That is, the user can select which position of the screen to apply stereoscopic conversion by setting region designation information that designates an effective application area to which stereoscopic conversion is applied. For example, the region designation information may include coordinate information designating a specific display region, or a display region in which the largest image is displayed through a recognition result according to a specific image recognition function for recognizing an image displayed on a screen. It may also include automatic setting information to automatically designate as the area designation information.

In addition, the user may select when to apply stereoscopic conversion by setting performance point information that specifies an execution point for performing stereoscopic conversion. For example, the execution time information may be automatically performed when first execution point information for automatically performing stereoscopic converting when performing the augmented reality implementation function, or when the virtual object is included as a result of performing the augmented reality implementation function. And second performing time information for performing stereoscopic converting, or third performing time information for performing stereoscopic converting when a manual input for executing the stereoscopic converting effect function is present by the user.

Also, the user can select texture to be applied to the surface of the target image in the process of performing the stereoscopic conversion on the target image by setting texture information specifying the texture applied in the process of performing the stereoscopic conversion. By setting transparency information such as start alpha value and end alpha value that specify the applied transparency, the transparency to be applied to the surface of the target image can be selected in the process of performing stereoscopic conversion on the target image.

In addition, the user sets the deformation characteristic applied to the target image and the scale information designating the final size of the stereoscopic image object according to the stereoscopic conversion, the characteristic information for rolling up vertically, the characteristic information for expanding the horizontal area, By setting the characteristic information to increase the volume, you can select how to transform the 2D object image into 3D shape, and choose the final size of the 3D object, that is, the 3D object. have.

In addition, the user can select how long to maintain the stereoscopic conversion by setting the time designation information designating the specific effective time.

The operation method of the augmented reality content playback device 100 according to the present invention, by performing a preset augmented reality implementation function (S120), by augmented by outputting the augmented reality content including the virtual object through the output unit 110 Reality services can be provided.

For example, the operation method of the augmented reality content playback device 100 according to the present invention, by performing a preset augmented reality implementation function in playing the advertising content stored from the outside or internally to augmented reality content including a virtual object The augmented reality may be output based on a photographed image of a specific print book, and the augmented reality content including a virtual object may be output.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book.

That is, in the method of operating the augmented reality content playback apparatus 100 according to the present invention, a preset augmentation corresponding to an analysis result is obtained by analyzing a photographed image photographing a specific page of a print book (not shown) located in a specific photographing area. Augmented reality content (e.g., photographed image + virtual) that performs a reality implementation function (e.g. rendering a 3D graphic model) and applies a specific virtual object (e.g. 3D graphic model) to the captured image according to performing the augmented reality implementation function Augmented reality service can be provided by displaying the object) through the output unit 110.

In this case, in the method of operating the augmented reality content playback apparatus 100 according to the present invention, in the case of providing an augmented reality service by performing an augmented reality implementation function as described above, at least one attribute is set based on previously stored service implementation information. According to the information, a stereoscopic converting of the target image in the specific effective area included in the augmented reality content may be performed, and the deformation state of the target image according to the stereoscopic converting process may be displayed through the output unit 110.

In more detail, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention determines whether or not to reach a point in time of performing stereoscopic conversion based on service effect implementation information when performing an augmented reality implementation function (S130). For example, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention is based on performance time information (eg, second performance time information) when a virtual object exists when the augmented reality implementation function is performed. It can be recognized that it has arrived.

When reaching the point of time of performing stereoscopic conversion, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention recognizes an effective application area according to the area designation information based on service effect implementation information, and applies it to a target image in the effective application area. That is, three-dimensional converting is performed based on texture information, transparency information, and scale information for a specific target image in a page screen of a printed book (not shown) corresponding to a photographed image for an effective time according to time designation information (for example, 2 seconds). In operation S140, the deformation state of the target image may be displayed through the output unit 110.

At this time, the operation method of the augmented reality content playback device 100 according to the present invention, delay the display of the virtual object according to the implementation of the augmented reality implementation function to apply the virtual object (eg, 3D graphic model) to the captured image The deformation state of the target image according to the stereoscopic converting process may be displayed on the augmented reality content that is not performed.

Therefore, referring to FIG. 3, in the augmented reality content playback apparatus 100 according to the present invention, only augmented reality content, that is, a photographed image 10a that does not apply a virtual object (eg, a 3D graphic model) is displayed. In the state A., according to the above-described stereoscopic conversion, the deformation state in which the target image 1 in the effective area is gradually changed from the 2D form to the 3D form will be displayed. That is, the page of the print book (not shown) corresponding to the photographed image shows the visual deformation state 2 of the specific target image 1 that is gradually rolled up and is raised three-dimensionally and gradually changed from 2D form to 3D form as shown in B. It can be displayed on the screen 10a.

In addition, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention determines whether a specific effective use time (for example, 2 seconds) has elapsed (S150), and when it passes, a stereoscopic image object according to stereoscopic conversion is performed. According to the execution of the augmented reality implementation function to switch to the virtual object (eg, 3D graphic model) to display (S160).

That is, referring to C. of FIG. 3, the operation method of the apparatus for reproducing augmented reality content 100 according to the present invention may be performed in a page screen of a printed book (not shown) corresponding to a captured image according to performing stereoscopic conversion. The result of the specific target image gradually transforming from the 2D form into the 3D form, that is, the stereoscopic image object 2 of the 3D form may be converted into the corresponding virtual object 20 according to the AR service.

Thus, in the method of operating the augmented reality content playback apparatus 100 according to the present invention, when augmented reality service is provided, a specific target image in the actual background screen is visually displayed before displaying the virtual object according to the execution of the augmented reality implementation function. By gradually transforming the form into 3D form and converting / displaying the stereoscopic image object into the virtual object according to the implementation of the augmented reality implementation function, the virtual object according to the augmented reality service provision can be naturally rendered / appeared on the screen. have.

On the other hand, when the determination result of step S130 does not reach the point of time to perform stereoscopic conversion, the operation method of the augmented reality content playback device 100 according to the present invention, performing the augmented reality implementation function of step S120 without executing the stereoscopic converting effect function The augmented reality content (eg, a photographed image + a virtual object) applying a specific virtual object (eg, a 3D graphic model) to the photographed image may be displayed through the output unit 110 to provide a general augmented reality service. (S170).

As described above, in the augmented reality service providing method according to the present invention, in providing an augmented reality service in which a virtual object is rendered, a specific target image in the screen is gradually three-dimensionally on the augmented reality content reproduction apparatus 100 itself. By converting to a virtual object by performing three-dimensional converting to appear, it is possible to solve the lack of visual relevance and unnaturalness by naturally appearing the virtual object in the augmented reality service without any additional animation work on the virtual object model.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

In providing an augmented reality service in which a virtual object is rendered, the augmented reality content playback apparatus performs a stereoscopic conversion so that a specific target image in the screen gradually rises in three dimensions by itself to be converted into a virtual object so that it appears in the virtual object model. When applying augmented reality service providing system and method that solves the lack of visual relevance and unnaturalness by naturally appearing virtual objects in augmented reality service without additional animation work, it is very effective in terms of visual effect and user satisfaction of augmented reality service. It is possible to bring great advances, and the possibility of marketing or sales of the applied augmented reality content reproducing apparatus and service solution is not only sufficient, but also can be clearly implemented in reality.

100: augmented reality content playback device
200: information providing device

Claims (10)

An information providing device for providing specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service; And
At least one preset based on the service implementation information when storing the service implementation information from the information providing apparatus and providing augmented reality service for outputting augmented reality content including a virtual object according to a preset augmented reality implementation function; Performs stereoscopic conversion on the target image in the specific effective area included in the augmented reality content according to the attribute information of to display the deformation state of the target image according to the stereoscopic converting process, and after a specific effective use time has elapsed. And augmented reality content reproduction apparatus for converting and displaying a stereoscopic image object according to the stereoscopic converting into the virtual object according to the augmented reality service. An augmented reality service provider for providing an augmented reality service for outputting an augmented reality content including a virtual object according to a preset augmented reality implementation function; And
Stores specific service implementation information for implementing a stereoscopic converting effect function corresponding to a virtual object applied to an augmented reality service, and provides the augmented reality according to at least one attribute information based on the service implementation information when the augmented reality service is provided. Performs stereoscopic conversion on the target image in the specific effective area included in the content to display the deformation state of the target image according to the stereoscopic converting process, and after the specific effective time elapses, the stereoscopic image according to the stereoscopic converting. And an effect function control unit for converting and displaying an object into the virtual object based on the augmented reality service. The method of claim 2,
The effect function control unit,
And storing the service effect implementation information by reflecting the at least one attribute information set by a user with respect to an execution environment of the stereoscopic converting effect function. The method of claim 2,
The at least one attribute information,
Area designation information for designating the specific effective area, performance time information for designating an execution time for performing the stereoscopic conversion, texture information for designating a texture applied in the process for performing stereoscopic conversion, and the process for performing stereoscopic conversion Transparency information that specifies the transparency applied at, Deformation characteristics applied to the target image according to the stereoscopic conversion, Scale information specifying the final size of the stereoscopic image object, Time for specifying the specific effective time Augmented reality content playback device comprising at least one of the specified information. The method of claim 4, wherein
The effect function control unit,
When the augmented reality service is provided by the augmented reality service providing unit, when the execution time according to the execution time information is reached based on the service effect implementation information, the time for the target image in the effective application area according to the area designation information. The stereoscopic conversion is performed based on the texture information, the transparency information, and the scale information for an effective time according to designation information, so as to sequentially transform the target image displayed in the 2D form into the 3D image object in the 3D form. Augmented reality content playback device. Providing, by the information providing apparatus, specific service implementation information for implementing a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service;
Storing, by the augmented reality content reproducing apparatus, the service implementation information from the information providing apparatus;
When providing an augmented reality service outputting an augmented reality content including a virtual object in accordance with a preset augmented reality implementation function in the augmented reality content playback device, the augmented reality according to at least one attribute information set based on the service implementation information Displaying a deformation state of the target image according to the stereoscopic converting process by performing stereoscopic conversion on the target image in the specific effective area included in the real content; And
Augmented reality content reproducing apparatus after the specific effective time elapsed by converting the stereoscopic image object according to the three-dimensional conversion to the virtual object according to the augmented reality service, comprising the step of displaying augmented reality service providing method . A service implementation information storage step of storing specific service implementation information for implementing a stereoscopic converting effect function corresponding to the virtual object applied to the augmented reality service;
A symptom reality service execution step of providing an augmented reality service outputting an augmented reality content including a virtual object according to a preset augmented reality implementation function;
When the augmented reality service is provided, the stereoscopic conversion is performed on a target image in a specific effective area included in the augmented reality content according to at least one attribute information set based on the service implementation information. A converting display step of displaying a deformation state of the target image; And
And a conversion display step of converting and displaying a stereoscopic image object according to the stereoscopic conversion after performing a specific effective use time into the virtual object according to the augmented reality service. The method of claim 7, wherein
The service implementation information storage step,
And operating the service effect implementation information by reflecting the at least one attribute information set by a user with respect to an execution environment of the stereoscopic converting effect function. The method of claim 7, wherein
The at least one attribute information,
Region designation information for designating the specific effective area, performance point information for designating an execution time for performing the stereoscopic conversion, texture information for designating a texture applied in the process for performing stereoscopic conversion, and process for performing stereoscopic conversion Transparency information that specifies the transparency applied at, Deformation characteristics applied to the target image according to the stereoscopic conversion, Scale information specifying the final size of the stereoscopic image object, Time for specifying the specific effective time Operating method of the augmented reality content playback device comprising at least one of the specified information. The method of claim 9,
The converting display step,
When the augmented reality service is provided, when the execution time according to the execution time information is reached based on the service effect implementation information, the target image in the effective application area according to the area designation information is applied during the effective use time according to the time designation information. The stereoscopic conversion is performed based on the texture information, the transparency information, and the scale information to sequentially transform the target image displayed in the 2D form into the 3D image object in the 3D form. How it works.

Images