KR102358875B1 - Efficient AR content provision method and apparatus through multiple markers - Google Patents

Abstract

The purpose of the present invention is to provide a method and device for efficiently providing AR content for content through a plurality of AR markers. The AR content providing method includes the steps of: receiving AR marker recognition information and first content information; recognizing an AR object; determining the number of AR objects; identifying the AR object type; determining as identification information about on AR object; transmitting second content request information to a content server; receiving second content information; providing the second content; transmitting second content providing confirmation information; receiving second content provision restriction information; confirming second content provision restriction information and the AR marker recognition information; recognizing an AR object; determining the number of AR objects; identifying the AR object type; providing a plurality types of AR content based on the order in which the AR objects are recognized; transmitting subsequent second content request information to the content server; receiving the subsequent second content information; providing the second content; and transmitting second content provision confirmation information.

Description

Efficient AR content provision method and apparatus through multiple markers

The present invention relates to an efficient AR content providing method and apparatus through a plurality of markers, and more particularly, an object of the present invention is to efficiently provide content through a separate AR content providing method when a plurality of markers are provided.

Augmented reality (AR) is a technology that superimposes virtual objects on the real world that a user sees with their eyes, and is a method of making objects appear as if they exist in an original environment.

AR content generates AR content by processing content that matches the image taken by the user using augmented reality technology, and matches the AR content to the real-time image taken by the user, so that the user can easily search for the desired information In addition to being able to do so, the efficiency of information provision is improved by providing information to users in a more immersive form using augmented reality.

In addition, AR technology can reinforce and provide additional information that is difficult to provide in the real world by synthesizing virtual objects on the basis of the real world. can be used in

However, as AR contents are diversified, the data size of contents information gradually increases in the method of providing them, and a method for efficiently providing AR contents becomes a problem.

An object of the present invention is to provide a method and apparatus for efficiently providing AR content for content through a plurality of AR markers.

Another object of the present invention is to provide a content server for efficiently providing AR content for content through a plurality of AR markers.

In a method for providing content through a plurality of AR markers to solve the above problems, AR marker recognition information and first content information are received from a content server, and based on the AR marker recognition information, information on the number of AR objects and confirming AR object type information, and when the number of AR objects is plural and the number of AR object types is plural, transmits second content request information to the content server, and receives second content information from the content server The second content is provided based on the obtained content information, second content provision confirmation information is transmitted to the content server, and second content provision restriction information is received from the content server.

In addition, in the apparatus for providing content through a plurality of AR markers, a transceiver for transmitting and receiving information with a content server, a content providing unit for providing content, and receiving AR marker recognition information and first content information from the content server, the AR marker Based on the recognition information, information on the number of AR objects and information on the types of AR objects are checked, and when the number of AR objects is plural and the types of AR objects are plural, second content request information is transmitted to the content server, and the content server control to receive second content information from, provide the second content based on the received content information, transmit second content provision confirmation information to the content server, and receive second content provision restriction information from the content server It is characterized in that it comprises a control unit.

According to an embodiment of the present invention, content can be provided by effectively recognizing a plurality of AR markers and AR objects.

1 is a flowchart illustrating a procedure for providing AR content.
2 is a flowchart illustrating a procedure for providing AR content using a plurality of AR markers according to an embodiment of the present invention.
3 is a flowchart illustrating a procedure for providing AR content when the second content is restricted according to an embodiment of the present invention.
4 is a block diagram illustrating an apparatus for providing AR content according to an embodiment of the present invention.
5 is a diagram illustrating recognition of AR content.
6 is a diagram illustrating AR content recognition using a plurality of AR markers according to an embodiment of the present invention.
7 is a block diagram illustrating a content server according to an embodiment of the present invention.

In describing the embodiments in the present specification, descriptions of technical contents that are well known in the technical field to which the present invention pertains and are not directly related to the present invention will be omitted. This is to more clearly convey the gist of the present invention without obscuring the gist of the present invention by omitting unnecessary description.

For the same reason, some components are exaggerated, omitted, or schematically illustrated in the accompanying drawings. In addition, the size of each component does not fully reflect the actual size. In each figure, the same or corresponding elements are assigned the same reference numerals.

Advantages and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

At this time, it will be understood that each block of the flowchart diagrams and combinations of the flowchart diagrams may be performed by computer program instructions. These computer program instructions may be embodied in a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, such that the instructions performed by the processor of the computer or other programmable data processing equipment are not described in the flowchart block(s). It creates a means to perform functions. These computer program instructions may also be stored in a computer-usable or computer-readable memory that may direct a computer or other programmable data processing equipment to implement a function in a particular manner, and thus the computer-usable or computer-readable memory. It is also possible that the instructions stored in the flow chart block(s) produce an article of manufacture containing instruction means for performing the function described in the flowchart block(s). The computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that instructions for performing the processing equipment provide steps for performing the functions described in the flowchart block(s).

Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). It should also be noted that in some alternative implementations it is also possible for the functions recited in blocks to occur out of order. For example, two blocks shown one after another may be performed substantially simultaneously, or the blocks may sometimes be performed in the reverse order according to a corresponding function.

At this time, the term '~ unit' used in this embodiment means software or hardware components such as FPGA or ASIC, and '~ unit' performs certain roles. However, '-part' is not limited to software or hardware. '~' may be configured to reside on an addressable storage medium or may be configured to refresh one or more processors. Thus, as an example, '~' refers to components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

AR contents according to an embodiment of the present invention may include images and videos having visual effects, information about objects, and contents related to products.

In addition, AR objects according to an embodiment of the present invention are all recognized from AR markers, and are not limited to, for example, various products in commerce, buildings, geographic locations, and the like. In principle, the AR recognition method in the present invention is recognized at the same or similar moment through a visual sensor such as a camera.

In addition, the AR content providing device according to an embodiment of the present invention is a device capable of providing AR content, and may include, for example, a smartphone, AR glasses, and various smart devices.

Augmented reality (AR) is a type of mixed reality that is an area between real and virtual. In augmented reality, a specific object is recognized and a 3D image of the recognized object is generated, Overlay the captured image. In general augmented reality technology, a marker having a specific image or image pattern is used as a reference in order to locate an object in an image obtained from a camera. Therefore, in order to implement a general augmented reality technology, an image registration program capable of recognizing location information or a marker to be overlaid with reality information needs to be built, etc. In advance, necessary information is registered in the database and connected with real information. This is essential.

Among them, the marker is a visual signal that triggers the display of virtual information, and may include, for example, a frame marker, an image marker, an NFT marker, a GPS marker, an object marker, and a tracking marker.

Accordingly, a method and apparatus for providing content by effectively recognizing a plurality of AR markers and AR objects through the present invention will be described later in detail based on drawings and descriptions of the invention.

1 is a flowchart illustrating a procedure for providing AR content.

Referring to FIG. 1 , the AR content providing apparatus may receive in advance AR recognition information and AR content information for AR recognition from the content server in step S101. In this case, the AR recognition information may be, for example, information for AR recognition, such as marker information for identification of a marker, individual information for identification of an entity, a list of recognized entities, and types of recognized entities. AR recognition information and AR content information may be provided, for example, through an application or may be provided in a web format.

The AR content providing apparatus may recognize the AR object based on the AR recognition information in step S103 . The AR content providing apparatus may identify the recognized AR object in step S105 and provide the content based on the AR content information received in advance. Alternatively, the content may be provided by identifying the recognized AR object, transmitting the recognition information to the content server, and receiving the AR content information to the content server.

The AR content providing method as described above is a generally provided method, and when AR recognition information and AR content information are received in advance, excessive data must be received from the content server in advance, in view of waste of data and user convenience. There was a problem.

In addition, in the case of a method of identifying a recognized AR object, transmitting recognition information to the content server, and receiving AR content information to the content server, the AR information that needs to be received in advance is small, but connection with the content server is essential after AR recognition. In addition, AR content information was received and provided late, so there was a problem in that the content provision speed was too slow.

2 is a flowchart illustrating a procedure for providing AR content using a plurality of AR markers according to an embodiment of the present invention to solve the above problem.

Referring to FIG. 2 , the AR content providing apparatus may receive in advance AR recognition information and first AR content information for AR recognition from the content server in step S201 . In this case, the AR recognition information may be, for example, information for AR recognition, such as marker information for identification of a marker, individual information for identification of an entity, a list of recognized entities, and types of recognized entities. Also, the first AR content information may be AR content information excluding data for a plurality of AR markers. Specifically, it may refer to information excluding content information triggered by recognizing a plurality of AR markers and AR entities as a single entity. AR recognition information and AR content information may be provided, for example, through an application or may be provided in a web format.

The AR content providing apparatus may recognize an AR object based on AR recognition information in step S203. Specifically, the AR content providing device may check the AR object, the number of AR objects, the types of AR objects, or the number of types of AR objects based on the AR recognition information.

The AR content providing apparatus may check whether there are a plurality of markers and what the recognized AR object is in step S205. Accordingly, if there are a plurality of AR objects recognized by the AR content providing apparatus and there are a plurality of types of objects, the process may proceed to step S207. In addition, when the AR object recognized by the AR content providing device is singular or the type of the object is singular, step S217 may be performed. If the AR entity and AR entity type are plural and singular, for example, when markers are attached to two identical products, the recognition entity may be plural, but the entity type may be singular.

The AR content providing apparatus may provide content corresponding to the AR object included in the first content received in advance from the content server in step S217 .

The AR content providing apparatus may transmit second content request information for requesting the second content information to the content server in step S207. In step S209, the second content information may be received from the content server. The second content information may be data information for a plurality of AR markers. Specifically, it may refer to content information triggered by recognizing a plurality of AR markers and AR objects as a single object. For example, when markers are attached to two separate products, it may be content information provided by acting as one identification ID. The AR content providing apparatus may provide the second content received from the content server in step S211.

Thereafter, the AR content providing apparatus may transmit second content provision confirmation information indicating that the second content has been provided to the user in step S213 to the content server. In operation S215 , the AR content providing apparatus may receive provision restriction information for restricting provision of the second content from the content server. In this case, the second content provision restriction information may place a constraint on the provision of content by placing a temporal and spatial limitation. For example, the second content provision restriction information may include timer information, location information, time information, and the like. The AR content providing apparatus may not provide the second content based on the second content provision restriction information.

3 is a flowchart illustrating a procedure for providing AR content when the second content is restricted according to an embodiment of the present invention.

Referring to FIG. 3 , the AR content providing apparatus may receive in advance AR recognition information for AR recognition and first AR content information from the content server in step S301 . Also, it is possible to receive provision restriction information for restricting provision of the second content from the content server.

The AR content providing apparatus may recognize the AR object based on the AR recognition information in step S303. Specifically, the AR content providing device may check the AR object, the number of AR objects, the types of AR objects, or the number of types of AR objects based on the AR recognition information.

The AR content providing apparatus may check whether there are a plurality of markers and what the recognized AR object is in step S305. Accordingly, if there are a plurality of AR objects recognized by the AR content providing device, there are a plurality of types of objects, and there is no restriction based on the second content restriction information, the process may proceed to step S307. In addition, when the AR object recognized by the AR content providing device is singular or the type of the object is singular, or when the second content is restricted based on the second content restriction information, step S317 may be performed. When the second content is restricted, for example, when the AR content providing device has already provided the second content and thus is restricted from the content server, when the content is not yet provided by a timer, or when the content is provided by location limitation This may be the case if it does not.

The AR content providing apparatus may provide content corresponding to the AR object included in the first content previously received from the content server in step S317 . In addition, if there are a plurality of AR objects and the AR types correspond to a plurality of AR objects, content corresponding to the AR object included in the first content received in advance may be provided respectively. In this case, the order of providing the provided content may correspond to the recognition order. For example, when markers are attached to two separate products, even if they act as one identification ID, the AR content providing apparatus may provide AR content for each.

The AR content providing apparatus may transmit second content request information for requesting the second content information to the content server in step S307. In step S309, second content information may be received from the content server. The second content information may be data information for a plurality of AR markers. Specifically, it may refer to content information triggered by recognizing a plurality of AR markers and AR objects as a single object. For example, when markers are attached to two separate products, it may be content information provided by acting as one identification ID. The AR content providing apparatus may provide the second content received from the content server in step S311.

Thereafter, the AR content providing apparatus may transmit second content providing confirmation information indicating that the second content has been provided to the user in step S313 to the content server. In step S315 , the AR content providing apparatus may receive provision restriction information for restricting provision of the second content from the content server. In this case, the second content provision restriction information may place a constraint on the provision of content by placing a temporal and spatial limitation. For example, the second content provision restriction information may include timer information, location information, time information, and the like. The AR content providing apparatus may not provide the second content based on the second content provision restriction information.

Through the above method, the AR content providing device receives information and content information for AR recognition in advance, but does not receive all content information, but receives data in a generally serviced area in advance, and receives a plurality of data by a plurality of AR markers. For a special situation, such as when an object is recognized, AR content can be provided more efficiently by receiving the content through a connection with the server later.

4 is a block diagram illustrating an apparatus for providing AR content according to an embodiment of the present invention.

The AR content providing apparatus 401 of FIG. 4 is illustrated as being configured by the transceiver 403 , the content providing unit 405 , and the controller 407 , but is not limited thereto. That is, the transceiver 403 , the content provider 405 , and the controller 407 may not be included in the content providing device 401 , and may each exist as one physically independent component. The transceiver 403 performs a function of transmitting and receiving information with a content server, and the content providing unit 405 performs a function of providing content to a user. For example, it is possible to provide visual AR content to the user through a configuration such as a display. The controller 407 may perform operations according to embodiments of the present disclosure by controlling states and operations of all components included in the device.

In more detail, the controller may receive in advance AR recognition information and first AR content information for AR recognition from the content server. In addition, it is controlled to receive the provision limit information for limiting the provision of the second content from the content server, and the AR object can be recognized based on the AR recognition information. Specifically, the AR content providing apparatus may control to check the AR object, the number of AR objects, the types of AR objects, or the number of types of AR objects based on the AR recognition information. In addition, the controller may control the AR content providing device to check whether there are a plurality of markers and what the recognized AR object is. Accordingly, the AR object included in the first content and corresponding content may be provided respectively.

In addition, the controller may control to transmit the second content request information for requesting the second content information to the content server. It is possible to control to receive the second content information from the content server.

In addition, the controller may control to transmit second content provision confirmation information indicating that the second content has been provided to the user to the content server. In step S315 , the AR content providing apparatus may receive provision restriction information for restricting provision of the second content from the content server. In this case, the second content provision restriction information may be controlled to restrict the provision of content by placing a temporal and spatial limitation.

5 is a diagram illustrating recognition of AR content.

The AR content providing apparatus 501 may recognize the AR object 521 based on the AR recognition marker 511 and AR recognition information and provide AR content to the user.

6 is a diagram illustrating AR content recognition using a plurality of AR markers according to an embodiment of the present invention.

The AR content providing apparatus 601 may recognize the plurality of AR objects 621 and 623 based on the plurality of AR recognition markers 611 and 613 and AR recognition information and provide AR content to the user.

In this case, the AR content providing apparatus 601 may determine a plurality of AR recognition markers as a single ID.

7 is a block diagram illustrating a content server according to an embodiment of the present invention.

Although the content server 701 of FIG. 7 is illustrated as being composed of a controller and a transceiver, it is not necessarily limited thereto. That is, the transceiver and the control unit may not be included in the content server, and may exist as one physically independent component. The transceiver performs a function of transmitting and receiving information to and from the content providing device, and the control unit may perform operations according to embodiments of the present invention by controlling states and operations of all components included in the device.

Specifically, the controller transmits AR content information and AR recognition information to the AR content providing device, receives second content provision confirmation information from the AR content providing device, transmits the second content information to the AR content providing device, and It is possible to control to transmit content provision restriction information.

Claims (6)

In the method of providing content through a plurality of AR markers,
Receiving AR marker recognition information and first content information from a content server;
recognizing an AR object based on the AR marker recognition information;
checking the number of AR entities based on the AR marker recognition information;
identifying an AR entity type based on the AR marker recognition information;
determining the number of AR objects as identification information about the AR objects when the number of AR objects is plural and the types of AR objects are plural;
transmitting second content request information to the content server based on the identification information;
receiving second content information from the content server;
providing the second content based on the received second content information;
transmitting second content provision confirmation information to the content server;
receiving second content provision restriction information including timer information, location information, and time information from the content server;
checking the second content provision restriction information and the AR marker recognition information;
recognizing an AR object based on the AR marker recognition information;
checking the number of AR entities based on the AR marker recognition information;
identifying an AR entity type based on the AR marker recognition information;
When the number of AR objects is plural, the types of AR objects are plural, and the provision of the second content is restricted by the second content provision restriction information, a plurality of AR objects corresponding to each of the plurality of AR objects included in the first content are provided. providing AR contents based on the order in which the AR objects are recognized;
When the number of AR objects is plural, the types of AR objects are plural, and the provision of the second content is not limited by the second content provision restriction information, subsequent second content request information to the content server based on the identification information transmitting;
receiving the subsequent second content information from the content server;
providing the second content based on the received subsequent second content information; and
and transmitting second content provision confirmation information to the content server.
delete delete In an apparatus for providing content through a plurality of AR markers,
a transceiver for transmitting and receiving information to and from the content server;
a content providing unit that provides content; and
Receive AR marker recognition information and first content information from the content server, recognize AR objects based on the AR marker recognition information, determine the number of AR objects based on the AR marker recognition information, and determine the number of AR markers Based on the recognition information, the AR object type is checked, and when the number of the AR objects is plural and the number of the AR object types is plural, the identification information about the AR object is determined, and based on the identification information, the content server is sent to the content server. transmits second content request information, receives second content information from the content server, provides the second content based on the received second content information, and provides second content provision confirmation information to the content server transmit, receive second content provision limitation information including timer information, location information, and time information from the content server, check the second content provision limitation information and the AR marker recognition information, and the AR marker recognition information based on the recognition of AR objects, the number of AR objects is determined based on the AR marker recognition information, and the type of AR objects is identified based on the AR marker recognition information, wherein the number of AR objects is plural and the AR When there are a plurality of object types and the provision of the second content is restricted by the second content provision restriction information, the AR object recognizes a plurality of AR contents corresponding to each of the plurality of AR objects included in the first content. If the number of AR objects is plural, the types of AR objects are plural, and the provision of the second content is not limited by the second content provision restriction information, the content server is based on the identification information. transmits subsequent second content request information to , receives the subsequent second content information from the content server, provides the second content based on the received subsequent second content information, and provides a second content to the content server Content delivery confirmation information Content providing apparatus through a plurality of AR markers, characterized in that it comprises a control unit for controlling the transmission. delete delete

Images