KR20210078342A - Method for managing virtual object using augment reality, method for managing festival using augment reality and mobile terminal - Google Patents

Abstract

An object of the present invention is to manage events held in each region using augmented reality technology. The present invention relates to a method for managing a virtual object using augmented reality. More specifically, the method for managing a virtual object using augmented reality according to an embodiment of the present invention includes: a first augmented image display step; a transformation matching step; and a second augmented image display step.

Description

Virtual object management method using augmented reality, event management method using augmented reality, and mobile terminal

The present invention relates to a virtual object management method using augmented reality, an event management method using augmented reality, and a mobile terminal.

Augmented reality (AR) is a technology derived from one field of virtual reality (VR), and refers to a combination of the real world and a virtual experience. That is, it is a computer graphics technique that synthesizes virtual objects in the real environment and makes them look like objects existing in the original environment. Virtual reality interacts with the user by creating all environments as a virtual environment through a computer, but augmented reality has a feature that the user can interact with virtual objects based on the real world to provide an improved sense of reality. Accordingly, in augmented reality, the user recognizes the real environment in which he is located, and at the same time recognizes virtual information expressed on the real image. Such augmented reality technology is also widely used in the field of games and the like.

Currently, many events are being held in each region, and as a way to encourage participation in these events, work such as announcing the event contents through a mobile terminal is being performed.

Augmented reality technology can be applied to improve participation in these regional events.

Republic of Korea Patent Publication No. 10-2012-0009638 (published on February 02, 2012) Republic of Korea Patent Publication No. 10-2011-0071210 (published on June 29, 2011) Republic of Korea Patent Publication No. 10-2011-0004974 (published on January 17, 2011) Republic of Korea Patent Publication No. 10-2011-0104686 (published on September 23, 2011)

In the present invention, it is intended to use augmented reality technology as a way to manage events held in each region, for example, to improve participation. For example, in managing a virtual object check using augmented reality, it provides a virtual object management method using augmented reality and an event management method using augmented reality to manage virtual objects related to the event or to guide people around the event base. Furthermore, it is intended to provide a mobile terminal capable of performing such a method.

In order to achieve the above object, according to one aspect of the present invention, in a mobile terminal for displaying and storing an augmented reality image in which a virtual object related to an event in a specific area is combined with a real image related to a specific point related to the event area , a virtual object determined according to one or more of the natural environment information of a specific point and the growth or production of virtual objects at the first point in the event area, and determined according to one or more of the object involvement information performed in the mobile terminal a first augmented image display step of displaying and storing a first augmented reality image combining a first virtual image according to the first growth/stage production of ; With respect to the virtual growth/production phase of the virtual object corresponding to the set actual growth/production phase of the real object corresponding to the virtual object, mobile from the first point to the second point at the second point of the second point in the event area Growth/production stage interval from the first time point at which the first virtual image is generated during the virtual growth/production stage of the terminal movement to the second time point at which the second virtual image is generated according to the second growth/stage manufacturing of the virtual object Transform matching step of matching to correspond to; and in the mobile terminal at the second time point of the second point, natural environment information in the corresponding step section of the actual growth/production step of the real object set to correspond to the matched growth/production step section and the matched growth/production step section Displays a second augmented reality image that combines a second virtual image according to the second growth/stage production of a virtual object additionally grown/staged from after the first growth/stage production according to any one or more of the object involvement information of A virtual object management method using augmented reality comprising the step of displaying and storing a second augmented image is proposed.

At this time, in one example, the first and second points each include a set radius range at the set point, and in the conversion matching step, the point movement from the first point to the second point is to generate a first virtual image or The first residence time at the first point after the display of the first augmented reality image, the second residence time at the second point before the generation of the second virtual image or the display of the second augmented reality image or the first and If there is a stopover point between the second points, it may be determined as a point movement when the stay time at the stopover point is longer than the set time.

In addition, in one example, the real image that is combined with the virtual image of the virtual object to generate an augmented reality image is an image taken through a mobile terminal in or around the event area or the location of the mobile terminal in or around the event area. The image obtained through the setting app as a reference, and the image obtained through the setting app, is based on the initial growth/production time and first and second growth/stage production of the virtual object first acquired within the set period range on the mobile terminal. As an image of a specific point in each actual growth/production stage of the real object corresponding to each viewpoint, it is acquired individually or collectively to match each actual growth/production stage of the real object, and the real image is batched through the setting app. When acquired, an image matching each actual growth/production stage of the real object may be read when the augmented reality image is generated.

At this time, in one example, each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth is a stage by period according to a week, month or season, and the real image is mobile In the case of an image taken through a terminal, in at least one of the first and second augmented image display steps and the initial generation of the augmented reality image within the set period range, each substance of the real object is displayed in the background of the captured image. When it is confirmed that a changed background object is included in the background object confirmation process to check whether a changed background object that changes according to the growth stage is included, and in the background object confirmation process, an image corresponding to the changed background object among the captured images is displayed for each substance of the real object. a background object correction process of correcting to match the growth stage, and the background object confirmation process is performed by the user's setting or by the judgment of the background object according to the setting, or by a combination of both, and corresponding to the changed background object The image may be corrected with respect to at least one of color, flowering, fruit, fallen leaves, fallen fruit, snow, generation, and disappearance.

Also, in one example, the natural environment information as a factor determining each of the first and second growth is as past or forecast information about any one or more of ambient temperature, precipitation, and sunlight received from a big data server or an external server. In the corresponding step section of the real object, it is information about the value over time, the pattern, or the average value of the entire time elapsed, and as one factor determining each of the first and second growths, the object involvement information relates to the virtual object according to the touch input. It is information for performing any one or more of meteorological environment management, nutrition management, control / quarantine, reproduction management, transpiration management, production management, and surrounding environment management, and the first and second virtual images are natural in addition to the first and second growth. A real-time reaction is performed by environmental information, object involvement information, or both, but the real-time response is natural environment information received from a big data server or an external server, performed according to precipitation or wind, or touch input as object involvement information It may be performed according to any one or more of touching, shaking, pushing, or pulling a virtual object according to , breaking or picking a vegetable virtual object, and watering or feeding an animal virtual object.

In another example, the virtual object is related to the event theme or a specific region, the virtual object in which growth is made is a vegetable or animal virtual object, the virtual object in which the production is made is a virtual product, a virtual structure, or a virtual cultural event, and the first and the second point may be a point constituting any one of an exhibition space, an event viewing space, an experience space, and a food space related to the event.

Next, in order to achieve the above object, according to another aspect of the present invention, in a method for managing an event in a specific area using augmented reality, using augmented reality according to an example of the above-described invention The method of performing each step of the virtual object management method and managing the event is: In the mobile terminal, it is determined whether the virtual object obtained as a result of the repeated virtual object growth/stage production is grown/produced in accordance with the setting range. or a judgment/confirmation step of confirming the judgment result; and an incentive receiving step of receiving an incentive from a mobile terminal when the virtual object is grown/produced in accordance with a setting range. An event management method using augmented reality is proposed.

At this time, in one example, the event management method displays an incentive on a mobile terminal, and enters an exhibition space, an event viewing space, or an experience space related to the event, purchases tickets related to the event, purchases food, or purchases products. The method may further include an incentive use step in which incentives are scanned and used for any one or more purposes of payment for and exchange with souvenirs related to the event.

Subsequently, in order to achieve the above object, according to another aspect of the present invention, a camera unit for acquiring a real image of a specific point related to the event area; a location information obtaining unit for obtaining location information of the mobile terminal; a communication unit that communicates with the outside; a memory unit for storing an augmented reality image obtained by combining a virtual image of a virtual object and a real image acquired through a camera unit or a setting app with a real image; a touch interface unit for receiving a touch input for performing object involvement information involved in the growth or production of a virtual object, and displaying an augmented reality image; and a control unit for generating an augmented reality image by acquiring a virtual image of a virtual object related to an event in a specific area and combining it with the real image, wherein the set real growth/production stage of the real object corresponding to the virtual object is performed. The control unit is set to correspond to the virtual growth/production stage, and the control unit determines the first growth/stage production of the virtual object according to one or more of the natural environment information and the object involvement information at a first time point of the first point in the event area. obtains a first virtual image according to the , and the control unit determines the point movement of the mobile terminal from the first point to the second point in the event area from the location information, and virtualizes the point movement from the first point to the second point. Match the growth/production stage period from the first time point of generating the first virtual image of the object to the second time point of generating the second virtual image according to the second growth/stage manufacturing of the virtual object, and the control unit At the second point in time at the second point, natural environment information in the corresponding step section of the real growth/production step of the real object corresponding to the growth/production step section of the virtual object and object involvement in the growth/production step section of the virtual object According to any one or more of the information, a second virtual image of the virtual object additionally grown/staged is obtained from after the first growth/staged production, and the control unit combines each of the first and second virtual images with the real image. A mobile terminal is proposed, characterized in that each of the first and second augmented reality images are generated.

At this time, in one example, the first and second points each include a set radius range at the set point, and the control unit is configured to control the first virtual image at a first point after the generation or display of the first augmented reality image. If there is a second residence time at the second point before the first residence time, the generation of the second virtual image, or the display of the second augmented reality image, or if there is a waypoint between the first and second points, the stay at the waypoint If the time is longer than the set time, it is determined that the point moves from the first point to the second point.

Also in one example, the real image is an image taken through a camera unit in the event area or its surroundings, or an image obtained through the setting app based on the location of the mobile terminal in the event area or its surroundings, and through the setting app The acquired image is a specific point in each actual growth/production stage of the real object corresponding to the initial growth/production time of the first virtual object and the time according to the first and second growth/stage manufacturing within the set period range. When an augmented reality image is generated, each actual growth/production stage of a real object is acquired individually or collectively to match each actual growth/production stage of a real object as an image about An image matching to can be read.

At this time, in one example, each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth is a stage by period according to a week, month, or season, and the control unit, In at least one of the first generation of the augmented reality image and the generation of the first and second augmented reality images within the set period range, a change that changes according to each substantive growth stage of the real object in the background of the real image photographed through the camera unit Check whether the background object is included, and if it is confirmed that the changed background object is included, the image corresponding to the changed background object among the captured real images is corrected to match each real growth stage of the real object, and the confirmation of the background object is The correction of the image corresponding to the changed background object is performed by the setting of or by the judgment of the background object according to the setting, or a combination of both, and the correction of the image corresponding to the changed background object is at least one of color, flowering, fruit, fallen leaves, falling fruit, snow, creation, and extinction. It may be a correction for any one.

Also, in one example, the natural environment information as a factor determining each of the first and second growths is the past related to any one or more of ambient temperature, precipitation, and sunlight received from a big data server or an external server through a communication unit. As predictive information, it is the value over time in the corresponding step section of the real object, the average value information for the pattern or the entire time elapsed, and as one factor determining each of the first and second growth, the object involvement information is based on the touch input. Information for performing any one or more of weather environment management, nutrition management, control / quarantine, reproductive management, transpiration management, production management, and surrounding environment management for the virtual object, and the control unit is a natural environment in addition to the first and second growth First and second virtual images are generated that perform real-time reactions based on information, object involvement information, or both, but the real-time reactions are natural environment information received from a big data server or an external server according to precipitation or wind. To be performed or performed according to any one or more of touching, shaking, pushing, or pulling a virtual object according to a touch input, breaking or picking a vegetable virtual object, watering or feeding an animal virtual object as object involvement information can

In another example, the control unit determines whether or not the virtual object generated as a result of the repeated virtual object growth/stage production conforms to a set range or confirms the determination result, and the mobile terminal determines whether the virtual object is When grown/produced in accordance with the set range, incentives are received from an external server connected through the communication unit, and the incentives are for admission to exhibition space, event viewing space or experience space related to the event, ticket purchase related to the event, food purchase, or It can be used for any one or more purposes of payment for any one of product purchases and exchange with souvenirs related to the event.

According to an example of the present invention, augmented reality technology may be used as one of the ways to manage events held in each region, for example, to improve participation. In one example, in managing virtual objects using augmented reality, it is possible to arouse interest or increase participation by managing virtual objects related to events, and to manage virtual objects using augmented reality to cover the event base. You can increase participation in the event by inducing them to walk around.

According to various embodiments of the present invention, it is apparent that various effects not directly mentioned may be derived by those of ordinary skill in the art from various configurations according to the embodiments of the present invention.

1 is a flowchart schematically illustrating a virtual object management method using augmented reality according to an embodiment of the present invention.
2 is a flowchart schematically illustrating a virtual object management method using augmented reality according to another embodiment of the present invention.
3 is a flowchart schematically illustrating a part of a virtual object management method using augmented reality according to another embodiment of the present invention.
4 is a flowchart schematically illustrating an event management method using augmented reality according to another embodiment of the present invention.
5 is a flowchart schematically illustrating an event management method using augmented reality according to another embodiment of the present invention.
6 is a block diagram schematically illustrating a mobile terminal according to another embodiment of the present invention.
7 is a block diagram schematically illustrating a mobile terminal according to another embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention for achieving the above object will be described with reference to the accompanying drawings. In this description, the same reference numerals mean the same components, and in order to facilitate the understanding of the present invention to those of ordinary skill in the art, the secondary description may be omitted.

It should be noted that, although a singular expression is described in this specification, it may be used as a concept representing the whole of a plurality of components unless it is contrary to the concept of the invention or is clearly different or contradictory. In the present specification, descriptions such as 'comprising', 'having', 'comprising', 'comprising' and the like should be understood as the possibility of the presence or addition of one or more other elements or combinations thereof.

In this specification, 'first', 'second', etc. do not indicate the order or rank of each component, but are used to distinguish each component from each other.

[How to manage virtual objects using augmented reality]

First, a virtual object management method using augmented reality according to an aspect of the present invention will be described with reference to FIGS. 1 to 3 . Also, reference may be made to embodiments of a mobile terminal that performs virtual object management using augmented reality and big data, which will be described later, and FIGS. 6 and 7 .

1 is a flowchart schematically illustrating a virtual object management method using augmented reality according to an embodiment of the present invention, and FIG. 2 is a schematic diagram illustrating a virtual object management method using augmented reality according to another embodiment of the present invention. 3 is a flowchart schematically showing a part of a virtual object management method using augmented reality according to another embodiment of the present invention.

1 to 2, the virtual object management method using augmented reality according to an example is a first augmented image display step (S100, S100'), a transformation matching step (S200) and a second augmented image display step (S300) , S300'). First, in the first augmented image display step (S100, S100'), the mobile terminal 1 for displaying and storing an augmented reality image in which a virtual object related to an event in a specific area is combined with a real image related to a specific point related to the event area ), at the first point of the first point in the event area, the natural environment information of a specific point and the object involvement information performed in the mobile terminal 1 as artificially involved in the growth or production of virtual objects. The first augmented reality image in which the first virtual image according to the first growth/stage production of the virtual object determined according to the determined virtual object is combined is displayed and stored. In the transformation matching step ( S200 ), with respect to the virtual growth/production step of the virtual object corresponding to the set actual growth/production step of the real object corresponding to the virtual object, at the second point in time at the second point in the event area, the first A second virtual image is generated according to the second growth/step production of the virtual object from the first point of time when the first virtual image is generated during the virtual growth/production step of the point movement of the mobile terminal 1 from the point to the second point Match the growth/manufacturing stage period up to the second time point. And in the second augmented image display step (S300, S300'), in the mobile terminal 1 at the second time point of the second point, the actual growth/production phase of the real object set to correspond to the matched growth/production phase section The second growth/stage of the virtual object additionally grown/staged from after the first growth/stage production according to any one or more of the natural environment information in the corresponding stage section and the object involvement information in the matched growth/production stage section A second augmented reality image combined with a second virtual image according to production is displayed and stored.

In the present invention, the mobile terminal 1 is a terminal for displaying and storing an augmented reality image in which a virtual object related to an event in a specific area is combined with a real image related to a specific point related to the event area. For example, the mobile terminal 1 is a smart phone, a tablet PC, a notebook computer, a PDA, etc., but is not limited thereto, and a communication and portable information device is sufficient. The term "event" refers to, for example, an event that is performed in a specific area with respect to a special product or culture of a specific area, and for example, a local festival may be an example. The special products of a specific region may be representative agricultural products or aquatic products, and furthermore, plants such as flowers or animals such as butterflies are sufficient as long as they can represent a specific region, but are not limited thereto. The culture of a specific region may be a traditional culture, a market place, a song festival, etc., and further may have the theme of light, a building, a mountain, or a river, but is not limited thereto. The event area means an area where an event in a specific area is held, for example, it may mean including not only the area where the event itself is held but also a nearby parking lot, nearby restaurants, and the like.

A virtual object refers to an image formed virtual in contrast with a real image, and is mainly used as an image combined on a real image to implement an augmented reality image. A virtual image is an image of a virtual object. The augmented reality image refers to an image in which a virtual image of a virtual object is combined with a real image. In general, the augmented reality image refers to a moving image in which a virtual image is combined with a real image. For example, in one example, the virtual object is related to the event theme or a specific region, the virtual object in which growth is made is a virtual object of vegetable or animal origin, and the virtual object in which the production is made may be a virtual product, a virtual structure, or a virtual cultural event. .

In the present invention, the real image is a real image related to a specific point, and may be an image photographed in the mobile terminal 1 , or may be an image obtained through a setting app in the mobile terminal 1 . For example, the specific point may be a point at which virtual objects are combined. Accordingly, the real image used in the augmented reality image must be an image related to a specific point. For example, the specific point included in the real image and coupled with the virtual object may be a fixed point of a fixed virtual object such as a plant or a structure, or a range in which a movable virtual object such as an animal is active. For example, when a specific point is the activity range of the movable virtual object, it may mean the entire activity range in the case of a virtual object with limited mobility or a partial activity range in the case of a virtual object having high mobility.

For example, although not shown, the virtual object management method using augmented reality according to an example synthesizes the virtual object in the mobile terminal 1 before the first growth/stage production step with a real image related to a specific point to create an augmented reality image. It may further include an initial generation step of initially generating and storing. Since augmented reality image generation technology is already widely known, a detailed description thereof will be omitted. For example, the initial growth period of the virtual object may be a period according to the growth degree of the virtual object selected for the initial generation of the augmented reality image within a set period range. For example, the set period range may be an exercise period or a period including a part before and after the exercise period.

Hereinafter, each step will be described in detail.

First augmented image display step (S100, S100')

1 to 2, the first augmented image display step (S100, S100') will be looked at. In the first augmented image display step (S100, S100'), in the mobile terminal 1 for displaying and storing an augmented reality image related to a virtual object related to an event in a specific area, at a first point of view in the event area The first augmented reality image in which the first virtual image according to the first growth/stage production of the virtual object is combined is displayed and stored. Growth/stage production of a virtual object means growth when the virtual object is a growing virtual organism, or when the virtual object is an inanimate object, such as a product or structure, the manufacturing or production step in manufacturing or producing a virtual inanimate object. it means. In this specification, as in 'growth/stage production', "/" may be interpreted as meaning 'or'.

The first augmented reality image displayed on the mobile terminal 1 may be obtained by combining a first virtual image of a virtual object with a real image at a first viewpoint with respect to a specific point. For example, the first time point is a time point when the mobile terminal 1 obtains a first virtual image of a virtual object or generates a first augmented reality image, and is a time point when the mobile terminal 1 is at the first point.

For example, a virtual image of a virtual object, for example, a first virtual image and/or a real image that is combined with a second virtual image to be described later to generate an augmented reality image is photographed through the mobile terminal 1 in or around the event area. It may be an image or an image obtained through a setting app based on the location of the mobile terminal 1 in the event area or its surroundings. For example, acquisition based on the location of the mobile terminal 1 in the event area or its vicinity means that the mobile terminal 1 is in the event area or its surrounding location, and the acquisition of a reality image about a specific point through the setting app This means that it is possible. For example, the setting app is an app mounted on the mobile terminal 1 as an app that implements an augmented reality image for a specific point in the present invention.

For example, in one example, the first point in the event area and the second point to be described later may be points constituting any one of an exhibition space, an event viewing space, an experience space, and a food space related to the event. The first virtual image may be an image of the virtual object at the first viewpoint.

For example, the first point and the second point to be described later may each include a set radius range at the set point. That is, the first and second points need not be construed to mean only one specific point point.

In the first augmented image display step (S100, S100') to implement the first augmented reality image in the mobile terminal 1, the first virtual image of the virtual object coupled to the real image is the first viewpoint of the first point in the event area. It is an image generated according to the first growth/stage production of a virtual object.

In this case, the real image is a real image relating to a specific point in the actual growth/stage production period or section of the real object corresponding to the first growth/stage production of the virtual object. For example, the real image that is combined with the first virtual image of the virtual object to generate the first augmented reality image is an image taken through the mobile terminal 1 at the first time point in or around the event area or in the event area or its surroundings. It may be an image obtained through a setting app based on the location of the mobile terminal 1 of For example, the image acquired through the setting app is a substance corresponding to the initial growth/production time of the virtual object first acquired within the set period range in the mobile terminal 1 and the time point according to the first and second growth/stage production, respectively. As an image of a specific point in each substantive growth/production stage of the object, it may be acquired individually or collectively to match each substantive growth/manufacturing stage of the real object. The timing of the second growth or production step (step production) of the virtual object refers to the timing of generation or acquisition of a second virtual image of the virtual object, which will be described later. Since local events are often repeated annually, a time limit may be required to induce participation in the event by displaying an augmented reality image on a virtual object through the mobile terminal 1 . For example, in this case, within the set period range may mean a period including the exercise period, the exercise period, and a partial period before or/and after it. Since the virtual image of the virtual object is combined with the real image obtained through the setting app to realize the augmented reality image, in order to increase the reality of augmented reality, the real image obtained through the setting app is used to grow or produce a virtual image of a virtual object. It is necessary to adapt to the reality that fits the stage change. Therefore, the real image acquired through the setting app is the first generation or production start time of the virtual object, the first growth or production phase (step production) time, and the second growth or production phase (step production) time of the real object corresponding to each of the corresponding angles. It may be an image about a specific point at the time of actual growth or production (stage production). In this case, the image at each point in time of the real object corresponding to each point in time of image development of the virtual object may be acquired individually or collectively at each point in time of image development of the virtual object through the setting app. For example, an image related to a specific point in each actual growth or production stage (stage production) of a real object corresponding to each point in time of image development of a virtual object is an external server that is communicated with the mobile terminal 1 through a setting app It may be stored in, etc. For example, when real images are acquired in a batch through the setting app, images matching each real growth/production stage of a real object that match the growth/stage production of the virtual image of the virtual object that are combined when generating the augmented reality image are read. can

For example, in one example, when the virtual object is a living thing, each real growth stage of the real object corresponding to the first growth time, the first growth time, and the second growth time of the virtual object is in a week, month or season. It may be a step-by-step process. For example, when the virtual object is inanimate, each step of the real object corresponding to the initial production start time of the virtual object and the first and second production step times may be a process-specific step.

The first growth/stage production of the virtual object in the first augmented image display step (S100, S100') may be determined according to any one or more of natural environment information and object involvement information of a specific point. The object involvement information is artificially involved in the growth or production of a virtual object, and refers to something performed in the mobile terminal 1 according to, for example, a touch input.

For example, the natural environment information of a specific point may be temperature or seawater or river water temperature, precipitation amount such as rainfall or snow cover, weather information such as sunshine, wind, and humidity. The weather information may be in real time or according to the passage of time. In particular, as one of the factors determining the first growth or stage production of the virtual object, the natural environment information is the natural environment according to the lapse of time during the actual growth or production stage of the real object corresponding to the period of the first growth or stage production. It may be environmental information, or in the case of a virtual object such as a structure, it may be natural environment information for a specific time at the time of the production stage of the real object corresponding to the time of the first stage of production or the time of the first stage of manufacturing of the virtual object have. For example, the natural environment information of a specific point may be information obtained from an external server or a big data server. For example, the period (section) of the first growth or stage production means a period (interval) from the time point (time) of the previous growth or production stage of the virtual object to the time point (time) of the first growth or production stage.

For example, the object involvement information includes weather environment management such as temperature control for biological virtual objects according to a touch input from the mobile terminal 1, nutrition management such as watering, fertilization, and feeding, pest control or prevention such as pesticides It may be information for performing any one or more of quarantine management such as injection, reproductive management of plants or animals, production management such as thinning, production management such as harvesting, and environmental management such as cleaning or weed removal. In the case of an object, it may be information for performing at least one of a pre-preparation step such as material preparation and each step of manufacturing or manufacturing according to a touch input. For example, as one of the factors determining the first growth or stage production of the virtual object, the object involvement information includes the first growth during the period of the first growth or stage production, for example, from the time point (time) of the previous growth or production stage of the virtual object. It may be made according to a touch input during a period (section) from the time (period) to the time (period) of the manufacturing stage.

For example, the growth of the virtual object may include at least one or more of budding, length growth, growth of branches or leaves, flowering, fruit bearing, fruit growth, harvest, extinction, etc. in the case of a vegetable virtual object, and in the case of an animal virtual object It may include at least one or more of spawning, offspring, size growth, each stage of metamorphosis, regression, reproduction, harvest, extinction, and the like.

See FIG. 2 . Looking at the case where the virtual object is a growing biological virtual object, in one example, natural environment information as a factor determining each of the first growth and the second growth of the virtual object is received from a big data server or an external server. It may be past or forecast information about any one or more of ambient temperature, precipitation, and sunshine (S100', S300'). At this time, the natural environment information as one factor determining each of the first growth and the second growth is the value over time in each corresponding step section of the real object corresponding to the virtual object, the pattern or the average value information for the entire time elapsed. can In addition, as one factor determining each of the first growth and the second growth of the virtual object, the object involvement information is weather environment management, nutrition management, control/prevention, reproduction management, transpiration management, and production of the virtual object according to the touch input. It may be information for performing any one or more of management and surrounding environment management (S100', S300').

For example, referring to FIG. 2 , in one example, a first virtual image of a virtual object and a second virtual image to be described later are real-time responses by natural environment information, object involvement information, or both in addition to the first growth and second growth. can be performed (S150, S350). For example, when the virtual object is of a vegetable nature, the reaction of the virtual image may be at least one selected from shaking, pushing, pulling, bending, breaking, picking, falling leaves, falling leaves, and falling fruit of the virtual object, and in the case of an animal, touching, moving, It may be at least one selected from stopping, avoiding, eating water or food, and the like. In one example, the real-time reaction of the virtual object is performed according to precipitation or wind as natural environment information received from a big data server or an external server, or touching or shaking the virtual object according to a touch input as object involvement information. Alternatively, it may be performed according to any one or more of pushing or pulling, cutting or picking for a vegetable virtual object, and watering or feeding an animal virtual object. For example, the real-time reaction of the virtual object may be made by an artificial environment in the mobile terminal 1, for example, shaking, not natural environment information such as wind.

For example, the entire process of the first augmented image display step (S100, S100') may be performed in the mobile terminal (1). Alternatively, the mobile terminal 1 performs a process of generating, displaying, and storing the first augmented reality image in the first augmented image display step (S100, S100') in the mobile terminal 1, and through the mobile terminal 1 and a dedicated app It is also possible to generate a first virtual image of a virtual object in a connected external server and provide it to the mobile terminal 1 to combine the first virtual image with the real image in the mobile terminal 1 .

Conversion matching step (S200)

Subsequently, with reference to FIGS. 1 and 2 , the transformation matching step ( S200 ) will be described in detail. In the transformation matching step (S200), the movement of the mobile terminal 1 from the first point to the second point generates a second virtual image of the virtual object from the first point of time when the first virtual image of the virtual object is generated. Match the growth/production stage period up to the second time point. For example, the conversion matching step ( S200 ) may be performed in the mobile terminal ( 1 ). Through this process, the growth or production of the virtual object can be performed without the elapse of time required for each growth or production step of the real object corresponding to the growth or production step of the virtual object. In particular, unlike the case in which the flow of time of a real object is simply reduced to the time of the growth/production stage of a virtual object as in the prior art, the movement of space is matched with the concept of time or process stage to transform and match, for example, at events, etc. If applicable, participation in events, especially through space movement, can be differentiated and advantageous in that it guarantees and encourages various opportunities for participation. Accordingly, if the participants who participated in the event simply pass by like an eye-catcher, they do not participate in the event but move through various spaces to participate, thereby increasing the actual participation level and furthermore, it is beneficial and responsive to the event participants.

More specifically, in the transformation matching step ( S200 ), with respect to the virtual growth/production phase of the virtual object corresponding to the set actual growth/production phase of the real object corresponding to the virtual object, the second time point of the second point in the event area In the second point movement of the mobile terminal 1 from the first point to the second point according to the second growth/step production of the virtual object from the first point of time when the first virtual image is generated during the virtual growth/production step Matching is made in correspondence with the growth/production stage section up to the second time point of generating the virtual image. In this case, the second point is a point that is spaced apart from the first point and is visited after the first point in time. For example, the point movement of the mobile terminal 1 from the first point to the second point is determined by adding a residence time rather than simply determining the location movement, thereby increasing the effect of the application of the present invention or compared to the prior art. Differential effects can be expected.

For example, in one example, in the transformation matching step ( S200 ), the point movement from the first point to the second point is the first point at the first point after the generation of the first virtual image or the display of the first augmented reality image. 1 Residence time, the second residence time at the second point before the generation of the second virtual image or the display of the second augmented reality image, or if there is a stopover point between the first and second points, the stay time at the stopover point is If it is longer than the set time, it may be determined as a point movement. Accordingly, when it is applied to events, it can be differentiated and advantageous in that it can guarantee and encourage participation in events, in particular, various opportunities for participation through space movement. Accordingly, when the present invention is applied to an event, etc., the participants who participated in the event do not simply pass by like an eye candy, but stay and move in various spaces for a certain period of time or more, thereby increasing the actual level of participation, and furthermore, it is beneficial to the event participants and responsiveness can be increased.

For example, when the transformation matching step ( S200 ) is performed in the mobile terminal 1 , the generation of the first and second virtual images of the virtual object is also performed in the mobile terminal 1 or connected to the mobile terminal 1 by a dedicated app. This can be done on an external server.

Second augmented image display step (S300, S300')

Next, the second augmented image display step (S300, S300') will be described in detail with reference to FIGS. 1 and 2 . In the second augmented image display step (S300, S300'), in the mobile terminal 1 at the second point of view of the second point, a second augmented reality image in which a second virtual image of a virtual object is combined with a real image is displayed and save For example, the real image used for the second augmented reality image is a time point of the actual growth/production phase of the real object corresponding to the second growth/stage production of the virtual object, or the generation or acquisition time of the second virtual image, that is, the corresponding phase interval time. It is a real image about a specific point in . For a description of such a reality image, refer to the above bar.

At this time, in the second augmented image display step (S300, S300'), in the mobile terminal 1 of the second point of view at the second point, the virtual object corresponds to the growth/production phase section from the first point of view to the second time point. The second growth/stage of the virtual object according to any one or more of the natural environment information in the corresponding stage period of the real object and the object involvement information in the growth/production stage period from the first time point to the second time point of the virtual object A second augmented reality image is obtained by combining the second virtual image according to the production. In this case, as one of the factors determining the second growth/stage production of the virtual object, the range period of the natural environment information becomes the corresponding corresponding stage period among the real growth/production stages of the real object. That is, natural environment information in the corresponding step section of the real growth/production step of the real object set to correspond to the growth/production step section from the first time point to the second time point of the virtual object matched in the transformation matching step (S200) It becomes a selection factor that determines the second growth/stage production of the virtual object. In addition, as another optional factor for determining the second growth/stage production of the virtual object, the object involvement information is the growth/production stage interval from the first time point to the second time point of the virtual object matched in the transformation matching step ( S200 ). It is object involvement information in In this case, natural environment information on the corresponding stage period of the real object corresponding to the growth/production stage period from the first time point to the second time point of the virtual object and the growth/production stage from the first time point to the second time point of the virtual object A second in which a second virtual image according to the second growth/stage production of the virtual object additionally grown/staged after the first growth/stage production of the virtual object is combined according to any one or more of the object involvement information in the section The augmented reality image is displayed and stored on the mobile terminal 10 .

For example, the entire process of the second augmented image display step (S300, S300') may be performed in the mobile terminal (1). Alternatively, the mobile terminal 1 performs the process of generating, displaying, and storing the second augmented reality image in the second augmented image display step (S200), and the mobile terminal 1 and an external server connected through a dedicated app It is also possible to generate a second virtual image of a virtual object in the , and provide it to the mobile terminal 1 to combine the second virtual image with the real image in the mobile terminal 1 .

Check and correct background color

A virtual object management method using augmented reality according to another example of the present invention will be described with reference to FIG. 3 . At this time, at least one of the first generation process of the augmented reality image and the first and second augmented image display steps (S100 to S100', S300 to S300') is a background object confirmation process (S500a) and a background object correction process (S500b) may include. At this time, the background object confirmation process (S500a) and the background object correction process (S500b) are processes of checking whether the image of the background object included in the real image matches the time period corresponding to the virtual image of the virtual object, and correcting if it does not match. . Therefore, the present embodiment can be applied significantly only when a real image corresponding to the time corresponding to the virtual image for each generation or production stage of the virtual object is not secured. For example, when the real image is taken directly from the mobile terminal 1, the shooting time is related to the event time, and the actual growth or production stage of the real object corresponding to the virtual object is out of the event period. This embodiment can be applied to According to this embodiment, since the background object is corrected in time, the reality of the augmented reality image can be increased.

Referring to FIG. 3 , the background object checking process ( S500a ) and the background object correction process ( S500b ) may be applied when the real image used in the augmented reality image is an image captured through the mobile terminal 1 . At this time, the initial creation process of the augmented reality image and the first and second augmented image display steps (S100 to S100') within a set period range, for example, an event period, or a period including a partial period before or after the event period and the event period. , S300 to S300'), the background object confirmation process (S500a) and the background object correction process (S500b) may be performed in at least one of them.

In this case, in the background object checking process ( S500a ), it is checked whether the background of the photographed image includes a changed background object that changes according to each actual growth stage of the real object. For example, it is checked whether the changed background object is included in the mobile terminal 1 . For example, in this case, each actual growth stage of a real object, which is a criterion for determining whether a changed background object is included, may be a stage by period according to a week, month, or season. For example, each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth may be stages according to periods according to weeks, months, or seasons.

For example, the background object confirmation process ( S500a ) may be performed by a user's setting, or by determining a background object according to the setting, or a combination of both. For example, in the real image captured by the user in the mobile terminal 1, the user touches the changed background object that needs to be changed in light of the corresponding timing of each generation or production step of the real object corresponding to each growth or production step of the virtual object, etc. method and can be confirmed in the mobile terminal 1 according to the user's designation. Alternatively, a comparison having substantially the same view range obtained by shooting at a different time from the real image captured in the mobile terminal 1 in the mobile terminal 1 or in an external server linked with the mobile terminal 1 through a dedicated app By comparing images to determine a background object, or by judging a background object in a photographed real image using artificial intelligence (AI) technology, the mobile terminal ( 1) can be found. For example, when determining or confirming whether a changed background object is included by the determination of the background object of the real image, the determination may be performed according to the setting range of the comparison determination in advance. For example, when using artificial intelligence (AI) technology, various well-known technologies can be used immediately or can be easily changed and applied by a person skilled in the art, so a detailed description thereof will be omitted.

Next, in the background object correction process (S500b), when it is confirmed that the changed background object is included in the background object confirmation process (S500a), an image corresponding to the changed background object among the photographed images is matched to each real growth stage of the real object correct it so For example, the background object correction process ( S500b ) may be performed in the mobile terminal 1 or in an external server linked with the mobile terminal 1 through a dedicated app. In this case, the correction of the image corresponding to the changed background object may be correction regarding at least one of color, flowering, fruit, fallen leaves, falling fruit, snow, generation, and disappearance. For example, the leaves or fruits of plants change according to the season, the process of flowering and fruit-bearing according to the season, the process of falling leaves and fruits according to the season, snow cover according to the season, generation or extinction according to the season, etc. Correction of the image may be made in the process.

[How to manage events using augmented reality]

Next, an event management method using augmented reality according to another aspect of the present invention will be described with reference to FIGS. 4 to 5 . In addition, reference may be made to the above-described virtual object management method using augmented reality and embodiments of FIGS. 1 to 3 and a mobile terminal to be described later, and FIGS. 6 and 7 .

4 is a flowchart schematically illustrating an event management method using augmented reality according to another embodiment of the present invention, and FIG. 5 is a schematic diagram of an event management method using augmented reality according to another embodiment of the present invention. It is a flow chart showing

4 to 5 , an embodiment of the present invention relates to a method of managing an event in a specific area using augmented reality. In this case, the event management method using augmented reality is performed including each step of the virtual object management method using augmented reality according to an embodiment of the present invention. Although the steps of FIGS. 2 to 3 are not shown in FIGS. 4 to 5, it is natural that they may be applied.

4 to 5 , the event management method using augmented reality may further include a determination/confirmation step (S600) and an incentive receiving step (S700) in addition to each step of the virtual object management method. First, in the determination/verification step S600 , it is determined whether the virtual object obtained as a result of the repeated virtual object growth/step production is grown/manufactured to conform to a setting range or the determination result is checked. For example, the determination/confirmation step S600 may be performed in the mobile terminal 1 . For example, it is determined whether the virtual object is grown/produced in conformity with the setting range in the mobile terminal 1 and an external server linked through a dedicated app, and the determination result may be checked in the mobile terminal 1 .

Next, in the incentive receiving step ( S700 ), when the virtual object is grown/produced to meet the set range, the mobile terminal 1 receives an incentive. For example, the issuance of incentives may be performed on an external server connected to the mobile terminal 1 and a dedicated app (settings app) and received at the mobile terminal 1 through a dedicated app (settings app). For example, the incentive may include an identification code, and the like, but is not limited thereto. For example, the identification code may be a barcode or a two-dimensional code. In this case, an incentive can be used by recognizing the identification code. For example, the incentive may be a substitute currency, an exchange ticket, etc. that can be used as a payment substitute at an admission ticket, an event venue, and the like.

Next, another example will be described with reference to FIG. 5 . Referring to FIG. 5 , the event management method may further include an incentive use step ( S800 ). At this time, in the incentive use step ( S800 ), the incentive is displayed on the mobile terminal 1 to enter an exhibition space, an event viewing space, or an experience space related to the event, purchase tickets related to the event, purchase food, or purchase any product. Incentives may be scanned and used for any one or more of payment for one and exchange with souvenirs related to the event.

[mobile terminal]

Next, a mobile terminal according to another aspect of the present invention will be described with reference to FIGS. 6 to 7 . Also, reference may be made to the virtual object management method using augmented reality according to the above-described embodiment, the event management method using augmented reality according to the above-described embodiment, and FIGS. 1 to 5 . In this case, the overlapping description may be omitted.

6 is a block diagram schematically showing a mobile terminal according to another embodiment of the present invention, and FIG. 7 is a block diagram schematically showing a mobile terminal according to another embodiment of the present invention.

6 to 7 , the mobile terminal 1 includes a camera unit 10, a location information acquisition unit 20, a communication unit 30, a memory unit 40, a touch interface unit 50, and a control unit ( 60) may be included. For example, the mobile terminal is a smart phone, a tablet PC, a notebook computer, a PDA, etc., but is not limited thereto, and a communication and portable information device is sufficient. Let's look at each configuration in detail.

First, the camera unit 10 acquires a real image of a specific point related to the event area. For example, the real image for a specific point may be acquired through a purchase or update method through a setting app (dedicated app) installed in the mobile terminal 1 in addition to the camera unit 10 .

The location information obtaining unit 20 obtains location information of the mobile terminal 1 . For example, the location information acquisition unit 20 may include a GPS module.

Next, the communication unit 30 performs communication with the outside. For example, the natural environment information of a specific point may be acquired from an external server (not shown) through the communication unit 30 . For a detailed description of the natural environment information of a specific point, reference will be made to the description of the above-described embodiments. For example, the communication unit 30 may enable network connection with an external server through a setting app (dedicated app).

Next, the memory unit 40 stores the augmented reality image obtained by combining the virtual image of the virtual object and the real image obtained through the camera unit 10 or obtained through the setting app (dedicated app) to the real image. For example, the memory unit 40 may also store a virtual image of a virtual object. For example, the memory unit 40 may update and store a real image, a virtual image, and/or an augmented reality image. In this case, the augmented reality image may be a video.

Next, the touch interface unit 50 receives the user's input and displays an image. The touch interface unit 50 receives a touch input for performing object involvement information related to the growth or production of a virtual object. In this case, a detailed description of the object involvement information will be referred to as described above.

Next, with reference to FIGS. 6 to 7 , the control unit 60 is looked at. The control unit 60 acquires a virtual image of a virtual object related to an event in a specific area and combines it with a real image to generate an augmented reality image.

For example, at this time, the real image may be an image taken through the camera unit 10 in or around the event area or an image obtained through a setting app based on the location of the mobile terminal 1 in the event area or its surroundings. . For example, the image acquired through the setting app is the first growth/production time of the virtual object first created within the set period range, and each actual growth/production of the real object corresponding to the time according to the first and second growth/stage production, respectively. As an image of a specific point in the manufacturing stage, it may be acquired individually or collectively to match each actual growth/manufacturing stage of the real object. In addition, when real images are acquired in a batch through the setting app, images matching each real growth/production stage of a real object may be read when an augmented reality image is generated.

In the present invention, the control unit 60 generates an augmented reality image according to each growth or production stage of a virtual object by performing transformation matching of point movement into the concept of a viewpoint section. Accordingly, when another mobile terminal 1 is used in the present invention, for example, in an event, it can be differentiated and advantageous in that it can guarantee and encourage participation in an event, in particular, various opportunities for participation through space movement. At this time, if the mobile terminal users participating in the event simply pass by like an eye candy, they do not participate in the event, but move around and participate in various spaces, thereby increasing the actual participation level and furthermore, it is beneficial and responsive to the event participants.

For example, in the control unit 60, in order to transform and match the movement of a point into the concept of a viewpoint section and generate an augmented reality image accordingly, the set real growth/production step of the real object corresponding to the virtual object is performed in the virtual growth/production of the virtual object. It is set to correspond to the production stage.

For example, in one example, each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth may be stages according to periods according to weeks, months, or seasons.

More specifically, the control unit 60 controls the first growth/stage production of the virtual object determined according to one or more of natural environment information and object involvement information at a first time point of a first point in the event area. Acquire a virtual image. At this time, the natural environment information and the object involvement information will be understood with reference to the foregoing. For example, the control unit 60 may generate a first virtual image according to the first growth/stage production of the virtual object determined according to any one or more of the natural environment information and the object involvement information. Or in another example, the control unit 60 is provided with a first virtual image according to the first growth/stage production of a virtual object generated in an external server network-connected to the mobile terminal 1 and a dedicated app (settings app). 1 A first virtual image may be acquired for the purpose of generating an augmented reality image. For example, as one optional factor determining the progress of the first growth or production stage (stage production) of the virtual object, the natural environment information on a specific point includes the first growth or production stage (time) from the previous growth or production stage of the virtual object. It may be natural environment information during the period from the growth period of the real object to the period of the production stage corresponding to the period (section) up to the time (period) of the production stage. For example, in another example, when the virtual object is inanimate, the natural environment information may be natural environment information at the time point (time) of the production step of the real object corresponding to the time point (time) of the first production step of the virtual object. For example, as one optional element determining the progress of the first growth or production stage (stage production) of the virtual object, the object involvement information includes the period (section) of the first growth or stage production of the virtual object, for example, the previous growth of the virtual object. It may be provided according to a touch input through the touch interface unit 50 during a period (section) from the time (time) of the production step to the time (time) of the first growth or production step.

For example, in one example, the natural environment information as a factor determining each of the first and second growths of the virtual object is the ambient temperature, precipitation, and sunlight received from the big data server or the external server through the communication unit 30 . As the past or prediction information about any one or more of the above, it may be a value over time in a corresponding step section of a real object, a pattern or average value information for the entire time elapsed. In addition, as one factor determining each of the first and second growths of the virtual object, the object involvement information is weather environment management, nutrition management, control/prevention, reproductive management, transpiration management, production management related to the virtual object according to the touch input. And it may be information for performing any one or more of the surrounding environment management.

In addition, the control unit 60 determines the point movement of the mobile terminal 1 from the first point to the second point in the event area from the location information. The first and second points may be a concept including a set radius range at each set point. At this time, referring to FIGS. 6 to 7 , the control unit 60 performs the movement of the point from the first point to the second point, and the second growth/stage production of the virtual object from the first point of time when the first virtual image of the virtual object is generated. The growth/production stage section up to the second time point for generating the second virtual image according to , for example, is matched to correspond to the second growth/stage manufacturing section. 7 shows a transformation matching module 60b for matching the point movement from the first point to the second point to correspond to the second growth/stage manufacturing section. Accordingly, when another mobile terminal 1 is used in the present invention, for example, in an event, it can be differentiated and advantageous in that it can guarantee and encourage participation in an event, in particular, various opportunities for participation through space movement.

For example, referring to one example, the control unit 60 may determine the point movement from the first point to the second point by adding the concept of a residence time rather than the point movement itself from the first point to the second point. Accordingly, if the mobile terminal users who participated in the event simply pass by like an eye candy, they do not participate in the event, but move through various spaces to participate, thereby increasing the actual participation level and furthermore, it is beneficial and responsive to the event participants. For example, the control unit 60 may control the first residence time at the first point after the generation of the first virtual image or the display of the first augmented reality image, before the generation of the second virtual image or the display of the second augmented reality image. If there is a second residence time at the second point up to, or a stopover point between the first and second points, if the stay time at the stopover point is longer than the set time, it can be judged as a point movement from the first point to the second point. can

In addition, the control unit 60 in FIGS. 6 to 7 controls the natural environment in the corresponding stage of the real growth/manufacturing stage of the real object corresponding to the virtual object growth/production stage period at the second time point of the second point. A second virtual image of the virtual object additionally grown/produced from after the first growth/stage production is acquired according to at least one of information and object involvement information in the growth/production stage section of the virtual object. For example, in this case, the control unit 60 may generate the second virtual image of the virtual object determined according to one or more of the natural environment information and the object involvement information. Or in another example, the control unit 60 is provided with a second virtual image of a virtual object generated from an external server network-connected to the mobile terminal 1 and a dedicated app (settings app) to generate a second augmented reality image A second virtual image may be acquired for the purpose. For example, natural environment information, which is one optional factor determining the progress of the second growth or stage production of the virtual object that has been additionally grown or staged, from after the first growth or staged manufacturing, is the first growth or staged manufacturing time of the virtual object ( It may be natural environment information during the actual growth period to the production stage period of the real object corresponding to the period (interval) from the time) to the second growth or production stage time (period). For example, as one optional element that determines the progress of the second growth or stage production of the virtual object, the object involvement information includes the period (section) of the second growth or stage production of the virtual object, for example, the first growth or stage production of the virtual object. It may be provided according to a touch input through the touch interface unit 50 during a period (section) from the time point (time) to the second growth point (time point).

In addition, the control unit 60 in FIGS. 6 to 7 combines each of the first and second virtual images with the real image to generate the first and second augmented reality images, respectively. 7 shows an augmented image module 60a for generating an augmented reality image.

Let's look at another example of the present invention. In one example, the control unit 60 may generate first and second virtual images that perform a real-time reaction by natural environment information, object involvement information, or both in addition to the first and second growth. At this time, the real-time response is natural environment information received from the big data server or external server, which is performed according to precipitation or wind, or as object involvement information, touching, shaking, pushing, or pulling a virtual object according to a touch input, vegetable It may be performed according to any one or more of cutting or picking for the virtual object, watering or feeding the animal virtual object.

In addition, another example of the present invention will be considered. In one example, the control unit 60, the background of the reality image photographed through the camera unit in at least one of the first generation of the augmented reality image and the generation of the first and second augmented reality images within the set period range It can be checked whether the changed background object that changes according to each actual growth stage of the real object is included. In this case, the confirmation of the background object may be performed by the user's setting, or by determining the background object according to the setting, or a combination of both.

In addition, when it is confirmed that the changed background object is included, the control unit 60 may correct an image corresponding to the changed background object among the captured real images to match each real growth stage of the real object. In this case, the correction of the image corresponding to the changed background object may be correction regarding at least one of color, flowering, fruit, fallen leaves, falling fruit, snow, generation, and disappearance.

For example, each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth may be stages according to periods according to weeks, months, or seasons.

In addition, another example of the present invention will be looked at. In one example, the control unit 60 may determine whether the virtual object generated as a result of the repeated growth/stage production of the virtual object is grown/manufactured according to a setting range or may confirm the determination result. For example, the control unit 60 may determine whether the virtual object is grown/manufactured to conform to a setting range. In another example, the mobile terminal 1 and the external server connected through the dedicated app (setting app) determines whether the virtual object is grown/produced to meet the setting range, and the control unit 60 receives the determination result and confirms may be

In addition, the mobile terminal 1 may receive an incentive from an external server connected through the communication unit 30 when the virtual object is grown/produced to meet the setting range. For example, the incentive is one or more of the use of any one or more of an event-related exhibition space, event viewing space or experience space, payment for any one of ticket purchase, food purchase or product purchase related to the event, and exchange with a souvenir related to the event can be used as

In the above, the above-described embodiments and the accompanying drawings are illustratively described to help those of ordinary skill in the art for the present invention, rather than limiting the scope of the present invention. In addition, embodiments according to various combinations of the above-described configurations may be apparent to those skilled in the art from the above detailed descriptions. Accordingly, various embodiments of the present invention can be implemented in modified forms without departing from the essential characteristics of the present invention, and the scope of the present invention should be interpreted according to the invention described in the claims, and it is common in the art Various modifications, alternatives, and equivalents are included by those with knowledge of

1: mobile terminal 10: camera unit
20: location information acquisition unit 30: communication unit
40: memory unit 50: touch interface unit
60: control unit 60a: augmented image module
60b: conversion matching module

Claims (14)

In a mobile terminal for displaying and storing an augmented reality image in which a virtual object related to an event in a specific area is combined with a real image related to a specific point related to the event area, at a first point in the first point in the event area, the specific point The first virtual according to the first growth/stage production of the virtual object determined according to any one or more of the natural environment information and the object involvement information performed in the mobile terminal as artificially involved in the growth or production of the virtual object A first augmented image display step of displaying and storing a first augmented reality image combined with the image;
With respect to the virtual growth/production step of the virtual object corresponding to the set actual growth/production step of the real object corresponding to the virtual object, at a second time point of a second point in the event area, the first point at the first point To generate a second virtual image according to the second growth/stage production of the virtual object from the first time point at which the first virtual image is generated during the virtual growth/production step by moving the mobile terminal to the second point a transformation matching step of matching the growth/production stage period up to the second time point; and
In the mobile terminal at the second time point of the second point, the natural environment information in the corresponding step section of the actual growth/production step of the real object set to correspond to the matched growth/production step section and the matched The second according to the second growth/step production of the virtual object additionally grown/step-manufactured after the first growth/step production according to any one or more of the object involvement information in the growth/production step section A virtual object management method using augmented reality comprising a second augmented image display step of displaying and storing a second augmented reality image combined with a virtual image.
In claim 1,
The first and second points each include a set radius range at a set point,
In the transformation matching step, the movement of the point from the first point to the second point is a first residence time at the first point after the generation of the first virtual image or the display of the first augmented reality image. , If there is a second residence time at the second point before the generation of the second virtual image or the display of the second augmented reality image, or if there is a waypoint between the first and second points, the stay at the waypoint A virtual object management method using augmented reality, characterized in that it is determined that the point is moved when the time is longer than the set time.
In claim 1,
The real image that is combined with the virtual image of the virtual object to generate the augmented reality image is an image taken through the mobile terminal in or around the event area or the location of the mobile terminal in or around the event area. As a standard, it is an image acquired through the settings app,
The image acquired through the setting app is the substance corresponding to the first growth/production time of the virtual object first acquired within a set period range in the mobile terminal and the time point according to the first and second growth/stage manufacturing, respectively. An image about the specific point in each actual growth/production stage of an object is obtained individually or collectively to match each actual growth/production stage of the real object,
Virtual object management method using augmented reality, characterized in that when the real image is acquired in a batch through the setting app, an image matching each real growth/production step of the real object is read when the augmented reality image is generated .
In claim 3,
Each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth is a stage by period according to a week, month or season,
When the real image is an image captured through the mobile terminal, in at least one of the first generating process of the augmented reality image within the set period range, and the first and second augmented image display steps, the shooting In the background object checking process of checking whether the changed background object that changes according to each actual growth stage of the real object is included in the background of the image, and when it is confirmed that the changed background object is included in the background object checking process, the photographed image a background object correction process of correcting an image corresponding to the changed background object to match each real growth stage of the real object;
The background object confirmation process is performed by the user's setting or by determining the background object according to the setting, or by a combination of both,
The method for managing virtual objects using augmented reality, characterized in that the correction of the image corresponding to the changed background object is correction for at least one of color, flowering, fruit, fallen leaves, fallen fruit, snow, generation, and extinction.
In claim 1,
As one factor determining each of the first and second growths, the natural environment information is the past or forecast information about any one or more of ambient temperature, precipitation, and sunlight received from a big data server or an external server. In the corresponding step section, it is the value over time, the pattern, or the average value information for the entire time elapsed,
As one factor determining each of the first and second growths, the object involvement information is weather environment management, nutrition management, control/prevention, reproductive management, production management, production management and surroundings regarding the virtual object according to a touch input. Information for performing any one or more of environmental management,
The first and second virtual images perform a real-time reaction by the natural environment information, the object involvement information, or both in addition to the first and second growth, wherein the real-time reaction is obtained from the big data server or the external server. As the received natural environment information, it is performed according to precipitation or wind, or as the object involvement information, touching, shaking, pushing, or pulling on the virtual object according to a touch input, cutting or picking for a vegetable virtual object, animal nature A virtual object management method using augmented reality, characterized in that it is performed according to any one or more of watering and feeding for the virtual object.
In any one of claims 1 to 5,
The virtual object is related to the event theme or the specific area,
The virtual object in which the growth is made is a vegetable or animal virtual object, and the virtual object in which the production is made is a virtual product, a virtual structure, or a virtual cultural event,
The method for managing virtual objects using augmented reality, characterized in that the first and second points are points constituting any one of an exhibition space, an event viewing space, an experience space, and a food space related to the event.
In a method of managing an event in a specific area using augmented reality,
Performing each step of the virtual object management method using augmented reality according to any one of claims 1 to 5,
How to manage the above event:
a determination/confirmation step of determining, in the mobile terminal, whether the virtual object obtained as a result of repeated growth/step-production of the virtual object is grown/manufactured according to a setting range or confirming the determination result; and
The event management method using augmented reality, characterized in that it further comprises an incentive receiving step of receiving an incentive from the mobile terminal when the virtual object is grown/produced to meet a set range.
In claim 7,
By displaying the incentive on the mobile terminal, admission to an exhibition space, event viewing space or experience space related to the event, payment for any one of ticket purchase, food purchase, or product purchase related to the event, and related to the event Event management method using augmented reality, characterized in that it further comprises the step of using the incentive in which the incentive is scanned and used for any one or more purposes of exchange with a souvenir.
a camera unit for acquiring a real image of a specific point related to the event area;
a location information obtaining unit for obtaining location information of the mobile terminal;
a communication unit that communicates with the outside;
a memory unit for storing an augmented reality image obtained by combining the virtual image of the virtual object and the real image acquired through the camera unit or a setting app with the real image;
a touch interface unit for receiving a touch input for performing object involvement information involved in the growth or production of the virtual object, and displaying the augmented reality image; and
A control unit for generating the augmented reality image by acquiring the virtual image of the virtual object related to an event in a specific area and combining it with the real image,
The set real growth/production step of the real object corresponding to the virtual object is set to correspond to the virtual growth/production step of the virtual object,
The control unit is configured to control the first growth/stage production of the virtual object determined according to any one or more of the natural environment information and the object involvement information of the specific point at a first time point of the first point in the event area. 1 Acquire a virtual image,
The control unit determines a point movement of the mobile terminal from the first point to a second point in the event area from the location information, and performs the point movement from the first point to the second point of the virtual object. Matching the growth/production stage section from the first time point when the first virtual image is generated to the second time point at which the second virtual image is generated according to the second growth/step production of the virtual object;
The control unit is configured to: at the second time point of the second point, the natural environment information and the natural environment information in a corresponding step section of the real growth/production step of the real object corresponding to the growth/production step section of the virtual object Obtaining the second virtual image of the virtual object additionally grown/produced after the first growth/stage production according to any one or more of the object involvement information in the growth/production stage section of the virtual object,
wherein the control unit combines each of the first and second virtual images with the real image to generate first and second augmented reality images, respectively.
In claim 9,
The first and second points each include a set radius range at a set point,
The control unit is configured to: a first residence time at the first point after generation of the first virtual image or display of the first augmented reality image, generation of the second virtual image or display of the second augmented reality image If there is a second residence time at the second point before, or a stopover point between the first and second points, from the first point to the second point when the stay time at the stopover point is equal to or longer than a set time Mobile terminal, characterized in that determined by the movement of the point.
In claim 9,
The real image is an image taken through the camera unit in the event area or its surroundings, or an image obtained through the setting app based on the location of the mobile terminal in the event area or its surroundings,
The image acquired through the setting app is each substance of the real object corresponding to the first growth/production time of the virtual object initially created within the set period range and the time point according to the first and second growth/stage manufacturing. As an image of the specific point in the growth/production stage, it is acquired individually or collectively to match each actual growth/production stage of the real object,
When the real image is acquired in a batch through the setting app, when the augmented reality image is generated, an image matching each real growth/production stage of the real object is read.
In claim 11,
Each real growth stage of the real object corresponding to the initial growth time of the virtual object and the time according to the first and second growth is a stage by period according to a week, month or season,
In at least one of the first generation of the augmented reality image and the generation of the first and second augmented reality images within the set period range, the control unit is configured to display the background of the reality image captured through the camera unit. It is checked whether a changed background object that changes according to each actual growth stage of the real object is included, and when it is confirmed that the changed background object is included, an image corresponding to the changed background object among the captured real images is set to each of the real objects. Corrected to match the actual growth stage,
The confirmation of the background object is performed by the user's setting or by the judgment of the background object according to the setting, or by a combination of both,
The correction of the image corresponding to the changed background object is a correction for at least one of color, flowering, fruit, fallen leaves, fallen fruit, snow, generation, and extinction.
In claim 9,
As one factor determining each of the first and second growths, the natural environment information is past or forecast information about any one or more of ambient temperature, precipitation, and sunlight received from a big data server or an external server through the communication unit. In the corresponding step section of the real object as a value over time, a pattern or average value information for the entire time elapsed,
As one factor determining each of the first and second growths, the object involvement information is weather environment management, nutrition management, control/prevention, reproductive management, production management, production management and surroundings regarding the virtual object according to a touch input. Information for performing any one or more of environmental management,
The control unit generates the first and second virtual images for performing a real-time reaction based on the natural environment information, the object involvement information, or both in addition to the first and second growth, wherein the real-time reaction is the big data As the natural environment information received from the server or the external server, it is performed according to precipitation or wind, or as the object involvement information, touching, shaking, pushing, or pulling the virtual object according to a touch input, to a vegetable virtual object A mobile terminal, characterized in that it is performed according to any one or more of cutting or picking, watering or feeding for virtual virtual objects.
14. In any one of claims 9 to 13,
The control unit determines whether the virtual object generated as a result of the repeated growth/stage production of the virtual object is grown/manufactured in accordance with a set range or confirms the determination result,
The mobile terminal receives an incentive from an external server connected through the communication unit when the virtual object is grown/produced to meet a set range,
The incentive is any one of admission to an exhibition space, event viewing space or experience space related to the event, payment for any one of ticket purchase, food purchase, or product purchase related to the event, and exchange with a souvenir related to the event Mobile terminal, characterized in that used for the above purpose.

Images