KR20130082530A - Augmented reality service providing apparatus, method and system for linking to social network service - Google Patents

Abstract

PURPOSE: An augmented reality (AR) service providing device which is connected to a social network service, a method thereof, and a system thereof are provided to enable a user to perform a virtual activity for an object, which is implemented on an AR, by connecting the social network service. CONSTITUTION: A context generation unit (100) generates context by converting information of a real space, which is collected for the application of AR, and information of a virtual space inputted from a user. A context management unit (200) shares a part of the context with a social network service (SNS) by connecting the SNS based on the generated context. An AR image generation unit (300) generates an AR image by using the context and an image which is inputted from a photographing image. [Reference numerals] (100) Context generation unit; (200) Context management unit; (210) SNS connection unit; (230) SNS information sharing unit; (231) SNS information search unit; (233) Information update unit; (300) AR image generation unit; (310) Image compensation information generation unit; (330) Rendering unit

Description

Augmented Reality Service Providing Apparatus, System and System Associated with Social Network Service TECHNICAL FIELD

The present invention relates to an apparatus, a method, and a system for providing augmented reality service, and more particularly, to an apparatus, a method, and a system for providing an augmented reality service including a virtual object linked to a social network service.

Augmented Reality is generally a term derived from virtual environment and virtual reality, and refers to a mixture of real world image and virtual image by inserting computer graphic image into the real environment. Real-world information may contain information that the user does not need, and sometimes the user may lack information. However, using computer-generated virtual environments, you can simplify or hide information you don't need. In other words, the augmented reality system combines the real world and the virtual world to allow interaction with the user in real time.

Recently, with the advent of Internet services such as facebook, youtube, and wikipedia, users are free to publish and share multimedia contents, and in the market shown by the second life research case of virtual reality. As can be seen from the rapid growth, the boundary between virtual and real space gradually disappears.

Meanwhile, the cloud computing service may be defined as an on demand outsourcing service of a computing resource through an information communication network such as the Internet. In a cloud computing environment, service providers consolidate data centers distributed across multiple locations into virtualization technologies to provide services that users need. Service users are not required to install and use necessary computing resources such as application, storage, operating system, OS, and security in each user's own terminal, The service in the virtual space can be selected and used as desired. The user does not pay for the purchase of each computing resource, but instead pays the price based on usage.

According to the cloud computing service, users can access a cloud network through a terminal that performs network connection and basic computation functions at any place, perform tasks requiring a large-capacity storage device and a high-performance computing resource, and provide advanced services There is an advantage to receive.

Conventional augmented reality technology has not shared information between both virtual and real space. Therefore, the user loses interest in the virtual space while performing only the social activities of the virtual space away from the information of the real space.

That is, the service using the conventional augmented reality centered on providing the user with only information on the real object existing in the real world. The present invention creates a virtual object in the augmented reality and enables the user to add the generated virtual object. It aims to provide opportunities for active activities.

An embodiment of the present invention for solving the above technical problem is a context for generating a context by converting the information of the collected virtual space and the information of the virtual space input from the user to apply augmented reality (AR) Generation unit; A context manager configured to share at least a portion of the generated context with an SNS in association with a social network service (SNS) based on the generated context; And an augmented reality generating unit configured to generate an augmented reality image using the generated context and the image input from the image capturing apparatus.

Another embodiment of the present invention for solving the above technical problem is an Augmented Reality (AR) service system using cloud computing, the data management unit for storing modeling data for implementing augmented reality; A resource manager for monitoring a resource for processing the modeling data and controlling the resource; And generating a context by converting information of a real space and information of a virtual space input from a user using the resource and applying Augmented Reality (AR), and generating a context based on the generated context. And augmented reality generating unit configured to share at least a part of the generated context with SNS, and to generate an augmented reality image by using the generated context and an image input from an imaging device. It may be characterized by providing an augmented reality service system characterized in.

Another embodiment of the present invention for solving the above technical problem is a context for generating a context by converting the information of the collected virtual space and the virtual space input from the user for applying augmented reality (AR) Generation step; A context management step of sharing at least a part of the generated context with an SNS in association with a social network service (SNS) based on the created context; And an augmented reality generation step of generating an augmented reality image by using the generated context and an image input from the image capturing apparatus.

Another embodiment of the present invention for solving the above technical problem is in the Augmented Reality (AR) service method using cloud computing, the key information and the key (model information) for implementing augmented reality It consists of a combination of value information corresponding to key information, mapping modeling data according to the key information, and reducing the mapped modeling data by filtering or sorting. A data management step; A resource management step of monitoring a resource for processing the modeling data and controlling the resource; And generating a context by converting information of a real space and information of a virtual space input from a user using the resource and applying Augmented Reality (AR), and generating a context based on the generated context. Augmented reality generation step comprising at least one augmented image generation step of sharing at least a portion of the generated context with the SNS, and generating an augmented reality image using the generated context and the image input from the imaging device; It may be characterized by providing an augmented reality service method characterized in that.

The present invention creates an augmented reality consisting of a real object and a virtual object, and provides a device, method and system that allows a user to perform a virtual activity in conjunction with a social network service for the object implemented in the augmented reality Provides the effect of various social activities in augmented reality.

1 is a block diagram illustrating an apparatus for generating augmented reality according to an embodiment of the present invention.
2 is a block diagram illustrating an augmented reality service system according to an embodiment of the present invention.
3 is a flowchart illustrating a method for generating augmented reality according to an embodiment of the present invention.
4 is a flowchart illustrating an augmented reality service method according to an embodiment of the present invention.

Basic techniques for implementing augmented reality include registration, tracking, and camera calibration. Registration refers to a process of registering a virtual object to be augmented and a position to reinforce a virtual object in a virtual environment. Typically, a marker (a two-dimensional marker, a three-dimensional image, or a two-dimensional image) representing a virtual object in a real environment is positioned for registration, and then the marker is identified. In general, three-dimensional coordinates of a certain point in the real world are required for registration, and these coordinates can be calculated as camera coordinates based on the camera. In order to obtain such three-dimensional coordinates, a singular point (i.e., a marker) is obtained from the camera input image and the three-dimensional coordinates of the singular point are tracked. This is called tracking, and it is possible to reinforce virtual graphic objects in image input of a moving camera by tracking the position of each image frame. On the other hand, in order to calculate the precise correlation between the singularity obtained from the camera input image and the camera, the camera parameters must be acquired. This process is called camera calibration. The camera calibration calculates internal parameters such as the focal length of the camera and external variables to form a camera model.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

The following embodiments are a combination of elements and features of the present invention in a predetermined form. Each component or feature may be considered to be optional unless otherwise stated. Each component or feature may be implemented in a form that is not combined with other components or features. In addition, some of the elements and / or features may be combined to form an embodiment of the present invention. The order of the operations described in the embodiments of the present invention may be changed. Some configurations or features of certain embodiments may be included in other embodiments, or may be replaced with corresponding configurations or features of other embodiments.

Embodiments of the invention may be implemented through various means. For example, embodiments of the present invention may be implemented by hardware, firmware, software, or a combination thereof.

For a hardware implementation, the method according to embodiments of the present invention may be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs) , Field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, and the like.

In the case of an implementation by firmware or software, the method according to embodiments of the present invention may be implemented in the form of a module, a procedure or a function for performing the functions or operations described above. The software code can be stored in a memory unit and driven by the processor. The memory unit may be located inside or outside the processor, and may exchange data with the processor by various well-known means.

Specific terms used in the following description are provided to help the understanding of the present invention, and the use of the specific terms may be modified in other forms without departing from the technical spirit of the present invention.

1 is a block diagram illustrating an apparatus for generating augmented reality according to an embodiment of the present invention. The apparatus for generating augmented reality according to an exemplary embodiment of the present invention includes a context generator 100, a context manager 200, and an augmented image generator 300.

The context generating unit 100 generates a context by converting the collected information of the real space and the information of the virtual space input from the user in order to apply Augmented Reality (AR). The context refers to information representing the state of an object such as a user or a place object required for interaction between a user and an application service.

In an embodiment of the present invention, the information on the real space may include image information, identification information, and location information indicating the location of the real space included in the real space in order to identify the space applied to the augmented reality. Information of the real space may be collected using a mobile terminal for viewing the real space and generating information of the real space.

The identification information of the real object may include angular velocity or angular displacement using a gyroscope sensor, a marker for augmentation, brightness information, and the like as meta information.

The image information of the real object refers to an image photographed in advance by using a terminal or a camera capable of capturing an image, and the real object refers to an object substantially present in the real world such as a building, a tree, or an overpass.

The location information includes the location of the area to which the device that transmits location information, such as a terminal, a wireless AP, or a repeater, including GPS information, and refers to information for knowing the location of the area.

The information in the virtual space includes at least one or more of the location of the object, the virtual ownership of the object, or the virtual price of the object required for augmented reality.

Information of the virtual space is obtained from an external storage device, a database (not shown), or the like.

The information of the virtual space includes information of the virtual object including the position, size, or structure of the object for augmenting a part of the image screen by overlapping the virtual object on the image screen for augmented reality. According to the embodiment of the present invention, the size of the virtual object, the position of the virtual object, the appearance of the virtual object, the internal structure of the virtual object, the internal and external display of the virtual object, and the like for augmenting the virtual object in augmented reality.

For example, when the virtual object is a building, the size, location, shape, exterior display, etc. of the building may be set. As another example, it may be set to include a virtual object to overlap at a specific position of the real object, and may be set to include information for overlapping at a specific position of the real object and external indicators of the overlapping object. As another example, it may be set to include a display, a decoration, or a billboard inside a building implemented in augmented reality, and display a billboard, a sculpture, etc. of a specific company when the user observes the inside of a specific object in the augmented reality. It can be set to.

In addition, the information of the virtual space includes the virtual ownership of the object, the virtual price of the object in order to be traded on the augmented reality of the virtual object. According to an embodiment of the present invention, the information of the virtual space is preset information from the user as necessary to be traded in the augmented reality, the virtual ownership of the object, the virtual price of the object, the virtual maintenance cost of the object, the virtual management fee of the object, Information such as the virtual rental revenue of the object. In addition, the information in the virtual space may be implemented to include subscription points for the virtual object, and if the subscription point does not fall within a certain limit according to the criteria set by the user, activities such as trading and construction of the virtual object This may include information that is impossible.

2 is a block diagram illustrating a context generator according to an embodiment of the present invention. The context generator 100 according to an embodiment of the present invention may include a tracker 110, a context integrator 130, and a context converter 150.

The tracker 110 tracks the object, which tracks the object based on the information of the collected real space. In this case, the object may be any target object included in the information of the real space, or may be a marker that is a standard of augmentation.

Alternatively, according to one embodiment of the present invention, the context integrator 130 integrates the information of the real space collected from the outside, thereby creating an integrated context, and the tracker 110 according to the context integrated in the context integrator Trace objects. For example, if the collected information of the real space is the location information, the object is tracked by referring to the location information, or if the collected information of the real space is the brightness information, that is, the illuminance, the sensitivity of the object tracking when the illumination is high In the case of low illumination and low illumination, the sensitivity of object tracking can be increased.

That is, the tracker 110 tracks the object based on the collected information of the real space, thereby more accurately tracking the object according to the state of the surrounding environment.

The context converting unit 150 receives the context integrated by the context integrating unit 130 and the information of the virtual space input from the user, and has a form suitable for the augmented reality image required by the application according to the tracker tracking the object. Converts to a context and transmits it to the context manager 200.

The context manager 200 may share at least some of the contexts generated by interworking with a social network service (SNS) based on the context generated by the context generator 150 with the SNS. The context manager may include an SNS interworking unit 210 and an SNS information sharing unit 230.

The SNS interworking unit 210 links the generated context with the social network service SNS based on the information of the virtual space included in the created context. That is, the SNS interworking unit links the context with the users who are related to the context among the SNS users based on the virtual ownership of the virtual object included in the generated context.

The SNS information sharing unit 230 shares at least a part of the generated context with the information on the SNS. The SNS information sharing unit 230 includes an SNS information retrieval unit 231 and an information update unit 233.

Information on SNS is to update a social network service when information for augmented reality virtual activity is set for an object implemented in augmented reality, or to update an object when information for virtual activity is set for an object on a social network service. Means the information used.

Virtual activities include events such as sale, lease, construction, or demolition generated by a user in augmented reality, and the like, for example, a user may sell to another user a specific object implemented in augmented reality. When a sale is made for a specific object, a context is created on the social network service that the owner of the specific object has changed, and the information on the social network service is synchronized. On the contrary, when a sale of an object between users is established on a social network service, information on SNS including change information of the owner or the like is transmitted to the augmented reality generating device in order to update the object in augmented reality. According to an embodiment of the present invention, when a user creates a context in augmented reality and sets the generated context to be created in the real world, the social network of another user related to the context implemented while updating the social network service is updated. You can update the service together. Therefore, the information on the SNS may be used to provide a service for matching a user who implements the virtual object with another user who can produce and produce the virtual object in reality.

By using the information on the SNS, not only the virtual activity on the objects in the augmented reality, but also the effect of providing a trading opportunity between users in the real world.

The SNS information retrieval unit 231 retrieves SNS image information corresponding to the generated context.

The information updater 233 compares the searched SNS-form information with the generation time of the generated context, and synchronizes the information based on a later generated information of the SNS-form information and the generated context. Therefore, the information and context on the SNS has the effect of always showing the latest information to the user.

The augmented image generator 300 generates an augmented reality image by using the generated context and an image input from the imaging apparatus. The augmented image generator includes an image correction information generator and a renderer.

The image correction information generator generates image correction information for correcting the position and the image of the object by using the identification information or the position information of the real space. According to an embodiment of the present invention, the image correction information generation unit may include an augmented space configuration unit and an augmented space image correction unit.

The augmented space configuration unit loads 3D data and map data stored in advance based on the identification information or the location information of the real space, and configures the augmented space using the loaded data. The pre-stored 3D data or map data may be stored in an external database, web server, etc. by the user. The 3D data may include information about the size, height, position, or appearance of an artificially generated object such as a building, a statue, an overpass, and the like, and may include image data photographed in advance so as to be realized in 3D from a user. The map data may include information about objects that are not artificially generated, such as rivers, ponds, mountains, or hills, which may be implemented in 2D, and may include bearing information on objects such as buildings. In addition, the map data may include additional information including a height or an angle. For example, the map data may include data indicating height, such as contour lines.

The augmented space image correction unit corrects an image of the augmented space based on previously stored image information. According to an embodiment of the present invention, the historical image information is stored in advance in an external storage device, a database, a web server, etc., and may be loaded when the image is corrected.

The renderer generates an augmented image by using image correction information, an image input from the image capturing apparatus, and a context converted by the context manager. The rendering unit includes a real space recognition unit, a registration unit, and an object rendering unit.

The real space recognition unit acquires location information and orientation information of an object included in the real space from an image input from the imaging device.

The registration unit registers a position to augment the virtual object and a virtual object to be augmented according to the converted context with respect to the real space.

The object rendering unit augments the virtual object in the real space and corrects and renders the angle of the object and the background of the real space according to the image correction information. The image of the virtual object is augmented based on a context including the position, size, composition, or appearance of the virtual object with respect to the augmented reality space. According to an embodiment of the present invention, when the virtual object is a building, the object rendering unit augments a virtual image of a white 5-story building when the building has a 5-floor size and the color of the building is white.

2 is a block diagram illustrating an augmented reality service system according to an embodiment of the present invention. The augmented reality service system according to an embodiment of the present invention may include a data manager 400, a resource manager 500, and an augmented reality generator 600.

The data manager 400 stores modeling data for implementing augmented reality, and may include a data constructor 410 and a distributed data constructor 430. The data manager 400 may configure the modeling data by using a cloud storage to ensure the MapReduce framework and scalability.

According to an exemplary embodiment, the data constructing unit 410 may configure the modeling data as a combination of key information and value information corresponding to the key information.

The distributed data constructing unit 430 may map modeling data according to each key information, and reduce the mapped data by filtering or sorting.

The resource manager 500 monitors a resource for processing modeling data and controls resources distributed to the augmented reality generator according to the monitoring result. For example, a resource refers to a computer resource used to process data, including a CPU processing data, a memory usage of a device such as a terminal, a memory usage, or the number of programs being processed. The resource manager 500 may include a resource allocator 510 and a resource status manager 530.

The resource allocator 510 allocates a resource for augmented reality to the augmented reality generator 600. According to an embodiment of the present invention, the augmented reality generator 600 includes at least one virtual machine, and the resource allocator 510 allocates resources for augmented reality to each virtual machine. That is, the augmented reality service system increases the system load when there are more users or a lot of data to be processed, thereby reducing the processing speed. The resource allocator 510 may maintain a continuity of services by balancing resources for augmented reality processing for a plurality of virtual machines.

The resource situation manager 530 manages a system load situation by monitoring a resource used by the augmented reality generator. The resource situation management unit 530 may include a system load warning unit 531 and a system load control unit 533.

The system load warning unit 531 monitors the augmented reality generating unit and notifies the resource allocation unit 510 of the excess situation when the system load for each virtual machine of the augmented reality generating unit exceeds a threshold upper limit. The upper threshold value means a limit value for a resource preset by a user, and the limit value for a resource means a value for efficiently using a resource such as memory occupancy, CPU occupancy, or processing speed. For example, when the threshold upper limit is set to 60% of the memory occupancy from the user, the system load warning unit virtualizes the resource allocator 510 when the memory occupancy of the virtual machine for processing augmented reality exceeds 60%. It sends a message about the excess situation not to distribute additional work to the machine, and the resource allocator can allocate more resources or stop the work allocation for virtual machines with more than 60% of the memory.

The system load controller 533 controls the system load with respect to the augmented reality generator. According to an embodiment of the present invention, the system load controller 533 may further generate a virtual machine when the system load exceeds a preset upper threshold for the augmented reality processor, and preset a system load for the augmented reality processor. If the load threshold is below the lower limit, you can shut down part of the virtual machine. The lower threshold value refers to a system load when a plurality of virtual machines are generated in proportion to the amount of data processed by the augmented reality processor, and refers to a numerical value for reducing the number of virtual machines.

The system load controller 533 further generates a virtual machine to reduce the system load when the system load exceeds the threshold upper limit for the augmented reality generator. According to the exemplary embodiment of the present invention, the system load controller is configured to generate a plurality of virtual machines in the augmented reality generating unit to perform data operations for augmented reality, so that the system load corresponding to the entire plurality of virtual machines is at an upper threshold value. Determine if it exceeds. The system load controller may terminate a part of the virtual machine when the system load is less than or equal to the threshold lower limit for the augmented reality generator. According to one embodiment of the present invention, a virtual machine whose end time for the processing job is preferentially terminated is selected, and the processing virtual machine is terminated when the processing job ends.

The augmented reality generating unit 600 generates a context by converting the information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR) using a resource, and based on the generated context The at least one augmented image generator may be configured to share at least a part of the generated context with an SNS in association with a social network service, and to generate an augmented reality image using the generated context and an image input from the imaging apparatus. Since the virtual machine may be implemented in the same manner as the configuration of the augmented reality generating device described above, the detailed description is replaced with the above description.

An augmented reality generating method according to an embodiment of the present invention will be described with reference to FIG. 3. Regarding the augmented reality generating method, the same content as the augmented reality generating device is replaced with the above description.

In operation S100, a context is generated by converting the collected information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR). According to an embodiment of the present invention, step S100 is a context integration step of integrating the collected information of the real space, creating a unified context, a tracking step of tracking an object according to the unified context, and from the unified context and the user. It may include a context conversion step of converting the input information of the virtual space into a context of the form required in the image generation step.

In step S110, at least a part of the context generated in association with the social network service is shared with the SNS based on the context generated in the context generating step.

According to an embodiment of the present invention, the SNS interworking step of interworking with the social network service (SNS) based on the information of the virtual space included in the generated context, and the SNS information sharing at least some of the generated context with the SNS information. Sharing step.

Preferably, in the SNS information sharing step, an SNS information retrieval unit for retrieving SNS information corresponding to the generated context and a creation time of the generated SNS information and the generated context are compared later by comparing the retrieved SNS information with the generated context. And updating the information based on the information.

Step S120 is an image correction information generation step of generating image correction information for correcting the position and the image of the object using the identification information or the position information of the real space and the image correction information, the image input from the image pickup device and the context management unit transforms And a rendering step of generating an augmented image using the generated context.

Preferably, the rendering step is a real space recognition step of acquiring the positional information and the orientation information of the object included in the real space from the image input from the imaging device, the position and augmentation of the virtual object according to the converted context with respect to the real space. And a registration step of registering a virtual object to be added and an object rendering step of augmenting the virtual object in the real space and correcting and rendering the angle of the object and the background of the real space according to the image correction information.

An augmented reality service method according to an embodiment of the present invention will be described with reference to FIG. 4. Regarding the augmented reality service method, the same content as that of the augmented reality service system is replaced with the above description.

In step S200, the modeling data for implementing augmented reality is composed of a combination of key information and value information corresponding to the key information, and the modeling data is configured according to the key information according to the key information. A distributed data constructing step of mapping and reducing mapped data by filtering or sorting may be included.

Step S210 monitors a resource for processing modeling data and controls the resource.

According to an embodiment of the present invention, the resource management step is a resource allocation step of allocating resources for augmented reality implementation to the augmented reality step and a resource situation management step of managing a system load situation by monitoring resources used in the augmented imaging step. It may include.

The resource situation management step monitors the augmented image generation step, and controls the system load for the system load warning step and the augmented image generation step informing the resource allocation step of the excess situation when the augmented image generation step exceeds a threshold upper limit. It may include a load control step.

In operation S220, a context is generated by converting the information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR) using a resource, and generating a context based on the generated context. And augmented reality generation step configured to share at least a part of the context generated by interworking with the SNS, and to generate an augmented reality image by using the generated context and the image input from the imaging device. have.

Embodiments according to the present invention can be written as a computer program. The code and code segments that make up this computer program can be easily deduced by a computer programmer in the field. In addition, the computer program is stored in a computer readable medium (Computer Readable Media), and the embodiment is implemented by being read and executed by a computer. The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium.

The present invention has been described above with reference to preferred embodiments. It will be understood by those skilled in the art that the present invention may be embodied in various other forms without departing from the spirit or essential characteristics thereof. Therefore, the above-described embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is shown not in the above description but in the claims, and all differences within the scope should be construed as being included in the present invention.

Claims (27)

A context generator configured to generate a context by converting the collected information of the real space and the information of the virtual space input from the user in order to apply Augmented Reality (AR);
A context manager configured to share at least a portion of the generated context with an SNS in association with a social network service (SNS) based on the generated context; And
And an augmented reality generator configured to generate an augmented reality image using the generated context and an image input from the image capturing apparatus. The method of claim 1, wherein the context management unit
An SNS interworking unit for interworking the generated context with a social network service (SNS) based on the information of the virtual space included in the created context; And
And an SNS information sharing unit which shares at least a part of the generated context with the SNS information. According to claim 2, wherein the SNS information sharing unit
An SNS information retrieval unit for retrieving the SNS information corresponding to the generated context; And
And an information updater configured to compare the searched SNS-form information with a generation time of the generated context, and to synchronize the SNS-form information with a late generated information among the generated contexts. The method of claim 1, wherein the information of the real space
An apparatus for augmented reality generation, characterized in that it comprises at least one or more information of the identification information or location information of the reality object. The method of claim 4, wherein the context generator
And a tracker for tracking an object based on the collected information of the real space. 6. The method of claim 5,
The context generator further includes a context integrator that integrates the collected information of the real space to generate an integrated context.
And the tracker tracks the object according to the integrated context. The method of claim 6, wherein the context generator
And a context converter configured to receive the integrated context and the information of the virtual space input from the user and convert the information into a context of a form required by the image generator. The method of claim 4, wherein the augmented image generating unit
An image correction information generator configured to generate image correction information for correcting the position and the image of the object by using the identification information or the position information of the real space; And
And a renderer configured to generate an augmented image using the image correction information, an image input from the image capturing apparatus, and a context converted by the context manager. The method of claim 8, wherein the image correction generator
An augmented space configuration unit configured to load pre-stored 3D data and map data based on the identification information or location information of the real space, and configure an augmented space using the loaded data; And
An augmented reality generating device comprising an augmented space image correction unit for correcting the image through the previously stored image of the augmented space in advance. The method of claim 8, wherein the rendering unit
A real space recognition unit for obtaining location information and orientation information of an object included in the real space from an image input from the imaging device;
A registration unit that registers a position to augment a virtual object and a virtual object to be augmented with respect to the real space according to the converted context; And
And an object rendering unit for augmenting a virtual object in the real space and correcting and rendering an angle of the object and a background of the real space according to the image correction information. The method according to claim 1,
The information of the real space is collected using a mobile terminal for viewing the real space and generating the information of the real space,
The information of the virtual space is augmented reality generation apparatus comprising at least one or more information of the location of the object, the virtual ownership of the object or the virtual price of the object required for augmented reality. In Augmented Reality (AR) service system using cloud computing,
A data manager to store modeling data for implementing augmented reality;
A resource manager for monitoring a resource for processing the modeling data and controlling the resource; And
Creates a context by converting the information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR) using the resource, and interwork with a social network service based on the generated context And augmented reality generator configured to share at least a part of the generated context with an SNS, and to generate an augmented reality image using the generated context and an image input from an imaging device. Augmented Reality Service System. The method of claim 12, wherein the data management unit
A data constructing unit configured to combine the modeling data with key information and value information corresponding to the key information; And
An augmented reality service system comprising: a mapping data unit configured to map the modeling data according to each key information and to reduce the mapped data using filtering or sorting. . The method of claim 12, wherein the resource management unit
A resource allocator configured to allocate a resource for augmented reality to the augmented reality generator; And
Augmented reality service system comprising a resource situation management unit for managing the system load situation by monitoring the resources used in the augmented reality generation unit. 15. The method of claim 14, wherein the resource status management unit
A system load warning unit that monitors the augmented reality generator and notifies the resource allocator of the excess situation when the system load for the augmented reality generator exceeds a threshold upper limit; And
Augmented reality service system comprising a system load control unit for controlling the system load for the augmented reality generation unit. The system load control system of claim 15, wherein
If the system load exceeds the preset load threshold upper limit for the augmented reality processing unit, and further creates a virtual machine,
The augmented reality service system, characterized in that for the augmented reality processor terminates some of the virtual machines already created when the system load is less than a predetermined load threshold lower limit. A context generation step of generating a context by converting the collected information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR);
A context management step of sharing at least a part of the generated context with an SNS in association with a social network service (SNS) based on the created context; And
And generating an augmented reality image by using the generated context and an image input from the imaging device. 18. The method of claim 17 wherein the context management step
An SNS interworking step of interworking with a social network service (SNS) based on the information of the virtual space included in the generated context; And
SNS information sharing step of sharing at least a portion of the generated context with the information on the SNS. The method of claim 17, wherein the SNS information sharing step
An SNS information retrieval unit for retrieving the SNS information corresponding to the generated context; And
And an information updating step of comparing the searched SNS-form information with a generation time of the generated context and synchronizing the SNS-form information with a late generated information among the generated contexts. . The method of claim 17,
The context creation step
A context integration step of integrating the collected information of the real space to generate an integrated context;
Tracking the object according to the unified context; And
And a context conversion step of receiving the integrated context and the information of the virtual space input from the user and converting the information into a context of a form required in the image generation step. The method of claim 20, wherein the augmented image generation step
Generating image correction information for correcting the position and the image of the object by using the identification information or the position information of the real space; And
And a rendering step of generating an augmented image by using the image correction information, an image input from the imaging device, and a context converted by the context manager. The method of claim 20, wherein the rendering step
A real space recognition step of obtaining position information and orientation information of an object included in the real space from an image input from the imaging device;
Registering a position to augment a virtual object and a virtual object to be augmented with respect to the real space according to the converted context; And
And augmenting a virtual object in the real space, and rendering an object by correcting and rendering an angle of the object and a background of the real space according to the image correction information. 23. A computer recording medium according to any one of claims 17 to 22, recorded on a computer so as to execute the augmented reality generating method according to any one of claims. In the Augmented Reality (AR) service method using cloud computing,
Modeling data for implementing augmented reality is composed of a combination of key information and value information corresponding to the key information, mapping the modeling data according to the key information, A data management step of reducing mapped modeling data using filtering or sorting;
A resource management step of monitoring a resource for processing the modeling data and controlling the resource; And
Creates a context by converting the information of the real space and the information of the virtual space input from the user to apply Augmented Reality (AR) using the resource, and interwork with a social network service based on the generated context And augmented reality generating step of sharing at least a part of the generated context with an SNS, and generating at least one augmented reality image using the generated context and an image input from an imaging device. Augmented reality service method, characterized in that. The method of claim 24, wherein the resource management step
A resource allocation step of allocating resources for augmented reality implementation to the augmented imaging step; And
And a resource situation management step of managing a system load situation by monitoring a resource used in the augmentation imaging step. 27. The method of claim 25, wherein the resource situation management step
A system load warning step of monitoring the augmented image generation step to notify the resource allocation step of an excess situation when the augmented image generation step exceeds a threshold upper limit; And
Augmented reality service method comprising the system load control step of controlling the system load for the step of generating an augmented image. 27. The computer recording medium according to any one of claims 24 to 26, wherein the augmented reality service method according to any one of claims 24 to 26 is recorded to be executable on a computer.

Images