WO2015050288A1

WO2015050288A1 - Social augmented reality service system and social augmented reality service method

Info

Publication number: WO2015050288A1
Application number: PCT/KR2013/011758
Authority: WO
Inventors: 최종명
Original assignee: 목포대학교산학협력단
Priority date: 2013-10-01
Filing date: 2013-12-17
Publication date: 2015-04-09
Also published as: KR101600038B1; KR20150039233A

Abstract

A social augmented reality service system of the present invention comprises: a user terminal which accepts a participation request from another terminal when the other terminal requests participation while an augmented reality service according to marker information is used, and which receives an updated AR service augmented for the AR service with the other terminal; an AR server which provides an updated AR service augmenting resource information including objects on the basis of the number of AR service participants to the user terminal and the other terminal, when the AR server inquires about the user terminal whether to participate in the AR service and the user terminal accepts participation when an AR service participation request and the same marker information are received from the other terminal while the AR service according to the marker information is provided to the user terminal; and one or more other terminals which request participation in the AR service by transmitting, to the AR server, images of objects or landmarks, which are obtained by photographing marker information corresponding to the AR service in order to participate in the AR service used by the user terminal, and receive the updated AR service augmenting resource information including objects on the basis of the number of participants from the AR server according to whether or not the user terminal accepts participation.

Description

Social Augmented Reality Service System and Method

The present invention relates to an augmented reality service, and more particularly, when a user is using an augmented reality service through a mobile terminal such as a smart phone, other users around the same object or a marker or land through the mobile terminal. When the mark is recognized at the same time or asynchronously, the augmented reality service can be used by neighboring users by providing different augmented reality services according to the number of participants, participant information, or other participant's interaction on the mobile terminal of the recognized users. It relates to a social augmented reality service system and method.

Augmented reality is a field of virtual reality that is a computer graphics technique that synthesizes virtual objects or information in the real environment and looks like objects existing in the original environment.

It is also called Mixed Reality (MR) because it combines the virtual world with additional information in real time into one image. It is a hybrid VR system that converges the real environment and the virtual environment. Since the late 1990s, research and development has been focused on the US and Japan.

Augmented reality, a concept that complements the real world with the virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics play a role in providing additional information necessary for the real environment. This means that the distinction between the real environment and the virtual screen is blurred by overlapping the 3D virtual image on the live image that the user sees.

Virtual reality technology immerses the user in the virtual environment and cannot see the real environment. However, augmented reality technology, which is a mixture of real environment and virtual objects, allows the user to see the real environment, providing better realism and additional information. For example, when the camera is illuminated with a smartphone camera, information such as the location and phone number of a nearby store is displayed as a stereoscopic image.

It is used for remote medical diagnosis, broadcasting, architectural design, and manufacturing process management. Recently, with the widespread use of smartphones, the company has entered the commercialization stage and is developing various products in the game and mobile solution industry and education field.

The realization of augmented reality outdoors is a wearable computer. In particular, the computer display device in the form of a head makes augmented reality possible by displaying computer graphics and characters in real time as seen by the user.

Therefore, the research on augmented reality is mainly the development of wearable computer. The developed augmented reality system includes HMD (head mounted display) such as video method and optical method.

Augmented reality, which began to study based on the development of see-through HMD by Ivan Sutherland, has a different meaning from virtual reality as a field of virtual reality. Virtual reality technology generally allows users to immerse themselves in the virtual environment, while the user cannot see the real environment, whereas in augmented reality technology, the user can see the real environment, and a mixture of real environment and virtual objects is present. . In other words, virtual reality is shown to the user by replacing the real world, but augmented reality has the distinction of supplementing the real world to show the user by superimposing virtual objects in the real world. It has the feature of providing. What is most important is that augmented reality shows augmented reality by incorporating attributes that are absent in reality into real objects through virtual reality.

However, the conventional augmented reality system has a disadvantage in that when one user uses the augmented reality service, other users in the vicinity cannot immediately participate in the augmented reality service together. For example, the conventional augmented reality is executed when one user is playing augmented reality baseball game when other users in the vicinity want to see the appearance and participate together, forcibly terminate the game and reset the participant. As a result, there is a problem in that the continuity of the game is not guaranteed when the other users participate while enjoying the game.

An object of the present invention for solving the above problems is that when a user is using augmented reality service through a mobile terminal such as a smart phone, other users around the same object or a marker or land through the mobile terminal. When the mark is recognized at the same time or asynchronously, social augmented reality provides different augmented reality services according to the number of participants or participant information on the mobile terminals of the recognized users, and enables the participants to interact with each other through augmented reality. To provide a service system and method.

According to an aspect of the present invention for achieving the above object, when using augmented reality (AR) service according to the marker information, if there is a request for participation from the other terminal to accept the renewed AR service for the AR service to the other A user terminal provided with the terminal; While providing the AR service according to the marker information to the user terminal, when there is a request for participation in the AR service together with the same marker information from another terminal, the AR service when inquiring whether to participate in the user terminal is accepted. An AR server for providing an update AR service with augmented resource information including an object to the user terminal and another terminal according to the number of participants of the terminal; And requesting to participate in the AR service by transmitting an image of an object or landmark obtained by photographing marker information corresponding to the AR service to participate in the AR service used by the user terminal, to the AR server. A social augmented reality service system is provided that includes one or more other terminals that receive an updated AR service in which resource information, including an object, is increased from the AR server according to the number of participants from the AR server.

On the other hand, according to another aspect of the present invention for achieving the above object, a communication unit for transmitting and receiving data in a wired or wireless manner with the user terminal and one or more other terminals; A marker storage unit for storing marker information that is a basis of an AR service provided to the user terminal or the one or more other terminals; An object storage unit which stores the marker information or information of an AR object corresponding to the AR service; The marker information and the information of the AR object is relayed to be shared between the user terminal and the one or more terminals participating in the AR session, and updated AR service to augment resource information, including the object according to the number of participants of the AR service An AR providing unit provided to the user terminal and another terminal corresponding to a participant of the AR service; And when the AR service is provided to the user terminal based on the marker information, when there is a request for participation in the AR service together with the image of the marker information from the other terminal, inquires whether to participate in the user terminal. When the user terminal accepts, the controller includes a control unit for providing the user terminal and the other terminal that is accepted to participate in the AR service, the update AR service, including the object and augmented resource information according to the number of participants of the AR service A social augmented reality service server is provided.

Here, the marker information may be one of a QR code, an object image, and a landmark image.

When the request for participation in the AR service is received from the other terminal, the controller compares the marker information received from the other terminal with marker information of the AR service provided to the user terminal, and determines whether the same is the same. In this case, the number of participants participating in the AR service is calculated, and an AR service for generating AR objects and resource information corresponding to the number of participants is generated through the AR provider, thereby generating another AR corresponding to the user terminal and the participants of the AR service. It can be controlled to provide to the terminals.

On the other hand, according to another aspect of the present invention for achieving the above object, a communication unit for transmitting and receiving data with the AR server by wire or wireless; An AR sharing unit for sharing marker information on an AR service and information on an AR object with other terminals connected to an AR session through the AR server; A marker detector for detecting the marker information in a preview image obtained by photographing a subject; An AR engine unit for generating an AR object corresponding to the marker information using the information of the AR object and displaying the generated AR object together with the preview image; And an AR control unit configured to process an operation of the AR object according to AR execution, and to control the AR sharing unit to share an updated AR service including resource and augmented resource information according to the number of participants of the AR service through the AR sharing unit. A reality service terminal is provided.

The apparatus may further include a position acquisition unit configured to acquire a position of photographing the subject as GPS information, and the marker detector may detect the marker information by combining the acquired subject image photographing the subject with the GPS information.

The marker detector may detect the acquired subject image as marker information when the photographed subject image corresponds to a unique landmark.

In addition, the AR sharing unit may share the information of the AR object for the update AR service with the resource information, including the object according to the number of participants of the AR service with other terminals connected to the AR session.

In addition, when the AR controller receives an AR session participation request message of another terminal from the AR server, the AR controller transmits whether to allow the participation according to the user's selection to the AR server.

The AR control unit detects the marker information in the preview image through the marker detection unit and transmits an AR session participation request message requesting to participate in the AR session to the AR server, and grants AR participation from the AR server. After receiving the message, the AR server receives the information on the AR object for the updated AR service with the resource information, including the object according to the number of participants of the AR service.

On the other hand, according to another aspect of the present invention for achieving the above object, a social augmented reality service method of a system comprising a user terminal, at least one other terminal and an AR server, (a) the user terminal is the AR Receiving information of an AR object from a server, generating an AR object according to marker information, and using the AR service; (b) detecting, by the other terminal, the marker information and transmitting a participation request message along with the marker information to the AR server to request participation in the AR service; (c) the AR server forwarding an AR service participation request of the other terminal to the user terminal; (d) the user terminal transmitting an AR service participation acceptance message of the other terminal to the AR server; (e) calculating, by the AR server, the number of participants in the AR service, and providing the user terminal and the other terminal with an updated AR service that augments information and resource information of an AR object according to the number of participants; And (f) the user terminal and the other terminal receiving and using an update AR service from the AR server.

Here, the marker information may be one of a combination of a QR code, a thing image, a landmark image, a terminal location, and a thing image.

On the other hand, according to another aspect of the present invention for achieving the above object, a social augmented reality service method of the AR server for transmitting and receiving data to or from the user terminal and one or more other terminals in a wired or wireless manner, (a) the user Providing an AR service according to marker information to a terminal; (b) receiving a join request message of the AR service together with an image of the marker information from the other terminal; (c) forwarding an AR service participation request of the other terminal to the user terminal; (d) calculating the number of participants of the AR service when accepting the AR service from the user terminal; And (e) generating an updated AR service by augmenting information and resource information of an AR object according to the number of participants of the AR service and providing the updated AR service to the user terminal, the other terminal, and other terminals participating in the AR service. A social augmented reality service method of an AR server is provided.

And (f) controlling mutual interaction between the user terminal, the other terminal, and other terminals participating in the AR service through the update AR service.

On the other hand, according to another aspect of the present invention for achieving the above object, as a social augmented reality service method of the AR terminal for transmitting and receiving data with the AR server by wire or wireless, (a) the other terminal according to the marker information Photographing and obtaining the marker information when using an AR service; (b) transmitting a participation request message of an AR service to the AR server together with the obtained marker information; (c) receiving an AR service participation acceptance message of the other terminal from the AR server; (d) receiving, from the AR server, an updated AR service in which an AR object and resource information are updated according to the number of participants for an AR service according to the marker information; And (e) sharing the marker information on the updated AR service and the information of the AR object with other terminals connected to the AR session.

In addition, in the step (a), the position at which the marker information is photographed may be acquired as GPS information, and the marker information may be obtained by combining the image obtained by photographing with the GPS information.

In addition, in the step (a), when the image acquired by photographing corresponds to a unique landmark, the acquired landmark image may be acquired as the marker information.

And (f) performing interaction with the other terminals through an update AR service through the AR server.

According to the present invention, when a user uses an augmented reality service, other users in the vicinity may immediately participate in the augmented reality service together.

In addition, when a user is playing augmented reality games and other users in the vicinity want to participate together, the game is not continuously forcibly terminated and other users are not involved in the process of resetting the participant. Can be guaranteed.

In addition, it can be applied to combat type games using augmented reality in the form of several people working together to defeat the enemy.

In addition, participants may interact with each other through AR. For example, when a contestant finds a prize through augmented reality for the nearby tags, and a participant finds and wins a prize (find the prize tag, check it with augmented reality, click on the prize presented as augmented reality, etc. Acquired through the method), no other contestants will see the prize even if they see the same tag.

It can also be applied when information needs to be shared and collaborated using augmented reality. For example, if you have a notepad with augmented reality using tags or landmarks, you can leave a message here so other users can read it.

1 is a block diagram schematically showing a social augmented reality service system according to an embodiment of the present invention.

2 is a block diagram illustrating a functional block of an AR server according to an embodiment of the present invention.

3 is a functional block diagram schematically showing an internal configuration of a social augmented reality service terminal according to an embodiment of the present invention.

4 is a diagram illustrating an overall flowchart for explaining a social augmented reality service method of the system according to an embodiment of the present invention.

5 is a flowchart illustrating an operation for describing a social augmented reality service method of an AR server according to an exemplary embodiment of the present invention.

6 is a flowchart illustrating an operation of a social augmented reality service method of an AR terminal according to an embodiment of the present invention.

7 is a diagram illustrating an example of acquiring one of a QR code, an object, and a landmark image as marker information according to an exemplary embodiment of the present invention.

8 is a flowchart illustrating a case in which Participant A and Participant B interact with each other through an AR service according to an embodiment of the present invention.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to be limited to the particular embodiment of the present invention, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

An embodiment of a social augmented reality service system and method according to the present invention will be described in detail with reference to the accompanying drawings. In the description with reference to the accompanying drawings, the same or corresponding components will be given the same reference numerals and redundant description thereof will be omitted.

First, the concept of the present invention is that when the first user wants to participate with other users around the augmented reality service provided through a mobile terminal, such as a smart phone, each of the same object or marker (Marker) or When a landmark is recognized at the same time or asynchronously, the updated augmented reality service is provided to the recognized mobile terminal according to the number of participants or participant information. Therefore, it will be described as 'Social Augmented Reality Service' in that the surrounding users can use the augmented reality service together.

Referring to FIG. 1, the social augmented reality service system 100 according to an exemplary embodiment of the present invention may include a user terminal 110, one or more other terminals 120 to 126, and an augmented reality service server (hereinafter, AR). Server) 130.

The user terminal 110 accepts a participation request from other terminals 120 to 126 while using an AR service based on marker information such as an object or a landmark, and accepts the AR object information and resources for the AR service. The information-enhanced update AR service is provided together with other terminals 120 to 126 authorized to participate in the AR service.

One or more other terminals 120 to 126 may display an image of an object or landmark obtained by photographing marker information such as an object or a landmark according to the AR service in order to participate in the AR service used by the user terminal 110. 130 to request to participate in the AR service, and then receives the updated AR service in which resource information including AR objects is enhanced from the AR server 130 according to the number of participants according to the acceptance of the participation of the user terminal 110. .

In this case, the user terminal 110 and one or more other terminals 120 to 126 may be configured with different functions.

While providing the AR service to the user terminal 110 based on marker information such as an object or a landmark, the AR server 130 requests to participate in the AR service together with an image of the same object or landmark from another terminal 120. If there is, when the user terminal 110 inquires whether to accept and accepts, according to the number of participants of the AR service, the updated AR service that augmented resource information including AR objects and the user terminal 110 and other terminals 120 and It is provided to other terminals 122 to 126 that are allowed to participate.

2, the AR server 130 according to an embodiment of the present invention includes a communication unit 210, a marker storage unit 220, an object storage unit 230, an AR provider unit 240, and a controller 250. It includes.

The communication unit 210 transmits and receives data to or from the user terminal 110 and one or more other terminals 120 to 126 by wire or wirelessly.

The marker storage unit 220 stores marker information corresponding to an AR service provided to the user terminal 110 or one or more other terminals 120 to 126.

The object storage unit 230 stores the marker information or the information of the AR object corresponding to the AR service.

The AR provider 240 relays the marker information and the AR object information to be shared between the user terminal 110 and one or more terminals 120 to 126 participating in the AR session, and the object according to the number of participants in the AR service. In addition, the updated AR service with enhanced resource information is provided to the user terminal 110 and the other terminals 120 to 126 corresponding to the participants of the AR service.

While providing the AR service according to the marker information to the user terminal 110, the controller 250 participates in the user terminal 110 when there is a request to participate in the AR service together with the image of the marker information from another terminal 120. When the user terminal 110 accepts whether or not the user terminal 110 accepts, the user terminal 110 and the other terminal that has been accepted to participate in the AR service to update the AR service that augmented resource information including objects according to the number of participants of the AR service ( 120 to 126).

If there is a request for participation in the AR service from the other terminal 120, the controller 250 compares marker information received from the other terminal 120 with marker information of the AR service provided to the user terminal 110. It is determined whether or not the same, and if it is the same, calculates the number of participants participating in the AR service, the AR terminal 240 generates an updated AR service augmented the AR object and resource information corresponding to the number of participants through the user terminal 110 And other terminals 120 to 126 corresponding to the participants of the AR service.

Referring to FIG. 3, the social augmented reality service terminal (hereinafter referred to as an AR terminal) 110 according to an embodiment of the present invention includes a communication unit 310, an AR sharing unit 320, a marker detection unit 330, and an AR engine unit 340. ), An AR control unit 350 and a position obtaining unit 360.

In addition to the above-described configuration, the apparatus further includes an input unit for inputting data, a display unit for displaying processing results and data, a photographed image and an AR object on a screen, and a storage unit for storing data and processing results and AR objects. In general, since it corresponds to a known technology, a configuration and description thereof will be omitted.

The communication unit 310 transmits and receives data to or from the AR server 130 by wire or wirelessly.

The AR sharing unit 320 shares the marker information on the AR service and the information of the AR object with the other terminals 120 to 126 connected to the AR session through the AR server 130.

In addition, the AR sharing unit 320 may share the information of the AR object for the updated AR service with the resource information, including the object, according to the number of participants of the AR service, with other terminals connected to the AR session.

The marker detector 330 detects marker information from a preview image obtained by photographing a subject.

The AR engine unit 340 generates an AR object corresponding to the marker information by using the information of the AR object, and displays the generated AR object together with the preview image.

The AR control unit 350 processes the operation of the AR object according to the AR execution, and controls to share the updated AR service including the object and the resource information enhanced through the AR sharing unit 320 according to the number of participants of the AR service. .

The position acquirer 360 may acquire a position at which the subject is photographed using GPS information, and the marker detector 330 may detect the marker image by combining the subject image and the GPS information obtained by photographing the subject.

In addition, the marker detector 330 may detect the acquired subject image as marker information when the subject image photographed and acquired corresponds to a unique landmark.

In addition, when the AR control unit 350 receives the AR session participation request message of the other terminal 120 from the AR server 130, the AR control unit 350 transmits to the AR server 130 whether to allow the participation according to the user's selection.

In addition, the AR controller 350 detects marker information from the preview image through the marker detector 330 and transmits an AR session participation request message requesting to participate in the AR session to the AR server 130, and the AR server 130. After receiving the AR participation permission message from), the AR server 130 receives the information of the AR object for the updated AR service, including the object and the resource information is enhanced according to the number of participants of the AR service.

Referring to FIG. 4, in the social AR service system 100 according to an exemplary embodiment, the user terminal 110 first receives information of an AR object from the AR server 130 to generate an AR object according to marker information. By using the AR service (S410).

Subsequently, the other terminal 120 detects the marker information through photographing (S420), and transmits a participation request message requesting participation in the AR service to the AR server 130 along with the marker information (S422).

Therefore, the AR server 130 transmits the AR service participation request of the other terminal 120 to the user terminal 110 (S430).

Subsequently, the user terminal 110 transmits the AR service participation acceptance message of the other terminal 120 to the AR server 130 (S432).

In this case, the AR service participation request from the other terminal 120 is transmitted to the user terminal 110 so that the user who opens the AR service may first approve, but anyone may participate without the user's approval.

Subsequently, the AR server 130 calculates the number of participants in the AR service (S440), and updates the AR service information and resource information of the AR object according to the number of participants in the user terminal 110 and other terminals 120 to 126. To provide (S450).

Therefore, the user terminal 110 and the other terminals 120 to 126 receive and use the updated AR service from the AR server 130 (S460).

Referring to FIG. 5, the AR server 130 according to an embodiment of the present invention provides an AR service according to marker information to the user terminal 110 (S510).

Subsequently, when receiving an AR service participation request message together with the image of the marker information from the other terminal 120 (S520-Yes), the AR service participation request of the other terminal is transmitted to the user terminal (S530).

Subsequently, upon accepting the participation of the AR service from the user terminal (S540-Yes), the AR server 130 calculates the number of participants of the AR service (S550).

Here, although the user who opened the AR service was first approved by passing the AR service participation request from the other terminal 120 to the user terminal 110, anyone requesting participation without the user's approval may participate. .

Subsequently, the AR server 130 generates an updated AR service by augmenting information and resource information of the AR object according to the number of participants in the AR service (S560).

In addition, the AR server 130 provides the generated update AR service to the other terminal and the other terminals participating in the AR service (S570).

Therefore, as illustrated in FIG. 8, the AR server 130 may control interaction between the user terminal and other terminals and other terminals participating in the AR service through the provided update AR service. 8 is a flowchart illustrating a case in which Participant A and Participant B interact with each other through an AR service according to an embodiment of the present invention. That is, when the participant A touches and acquires the content (eg, the lottery ticket) displayed through the marker on the terminal as illustrated in FIG. 8, the AR server 130 augments the terminal even if the other participant B sees the same marker. Demonstrates controlling the display of reality.

Referring to FIG. 6, when the other terminal uses the AR service according to the marker information, the AR terminal 110 captures and acquires marker information used by the other terminal (S610).

In this case, the marker information may be one of a QR code image, an object image, and a landmark image, as shown in FIG. 7. 7 is a diagram illustrating an example of acquiring one of a QR code, an object, and a landmark image as marker information according to an exemplary embodiment of the present invention.

In addition, the AR terminal 110 may acquire a location for capturing marker information used by the other terminal 120 as GPS information, and obtain marker information by combining GPS information and an image obtained through a camera.

The AR terminal 110 may acquire the acquired landmark image as marker information when the image acquired by photographing corresponds to a unique landmark.

Subsequently, the AR terminal 110 transmits a participation request message of the AR service to the AR server 130 together with the obtained marker information (S620).

Subsequently, the AR terminal 110 receives the AR service participation acceptance message of the other terminal 120 from the AR server 130 (S630).

Here, although the user who opened the AR service is first approved by transmitting the AR service participation request from the other terminal 120 to the user terminal 110, anyone who requests the participation without the user's approval may participate.

Subsequently, the AR terminal 110 receives an updated AR service from which the AR object and resource information is updated according to the number of participants for the AR service according to the marker information from the AR server 130 (S640).

Subsequently, the AR terminal 110 shares marker information on the AR service and information on the AR object with other terminals connected to the AR session (S650).

That is, the AR terminal 110 uses the AR engine unit 340 to allow the AR control unit 350 to share the updated AR service including resource and augmented resource information according to the number of participants of the AR service through the AR sharing unit 320. The AR object corresponding to the marker information is generated using the information of the AR object, and the generated AR object is displayed together with the preview image.

Therefore, when the user proceeds to play the game using the social augmented reality service terminal according to the present invention, several people around to participate in the game together, such as jointly defeating enemies or building a city jointly together Enjoy.

In addition, the AR terminal 110 may interact with other terminals and other terminals participating in the AR service as shown in FIG. 8 through the update AR service. For example, in the case of finding a prize through augmented reality for the surrounding tags, a participant finds a prize and obtains it (find a prize tag, check it with augmented reality, and click on the prize shown as augmented reality. In the case of acquisition through the same tag, even if another participant sees and confirms the same tag, the prize does not appear on the terminal. As another example, if you have a notepad with augmented reality using tags or landmarks, one user can leave a message on the notepad so that other users can read the message on the notepad together.

As described above, according to the present invention, when a user uses augmented reality service through a mobile terminal such as a smart phone, other users in the vicinity may use the same object, a marker, or a landmark through the mobile terminal. And asynchronously, a social augmented reality service system and method for providing different augmented reality services according to the number of participants or participant information to the mobile terminal of the recognized users, and allowing the participants to interact with each other through augmented reality Can be realized.

As those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features, the embodiments described above should be understood as illustrative and not restrictive in all aspects. Should be. The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. do.

When the user is using augmented reality service through the mobile terminal, when other users nearby recognize the same object or marker or landmark through the mobile terminal simultaneously or asynchronously, The present invention can be applied to a social augmented reality service system and method for providing augmented reality services to neighboring users by providing another augmented reality service updated according to the number of participants or participant information on a mobile terminal of one user.

Claims

A user terminal that receives an AR request based on marker information and receives an enhanced AR service for the AR service together with the other terminal when a request for participation is received from another terminal;

While providing the AR service according to the marker information to the user terminal, when there is a request for participation in the AR service together with the same marker information from another terminal, the AR service when inquiring whether to participate in the user terminal is accepted. An AR server for providing an update AR service with augmented resource information including an object to the user terminal and another terminal according to the number of participants of the terminal; And

In order to participate in the AR service used by the user terminal, an image of an object or landmark obtained by photographing marker information corresponding to the AR service is transmitted to the AR server to request participation in the AR service, and then the user. At least one other terminal receiving an updated AR service including resource and augmented resource information according to the number of participants from the AR server according to the terminal's acceptance of participation;

Social augmented reality service system comprising a.
Communication unit for transmitting and receiving data to or from the user terminal and one or more other terminals by wire or wireless;

A marker storage unit for storing marker information that is a basis of an AR service provided to the user terminal or the one or more other terminals;

An object storage unit which stores the marker information or information of an AR object corresponding to the AR service;

The marker information and the information of the AR object is relayed to be shared between the user terminal and the one or more terminals participating in the AR session, and updated AR service to augment resource information, including the object according to the number of participants of the AR service An AR providing unit provided to the user terminal and another terminal corresponding to a participant of the AR service; And

While providing the AR service to the user terminal based on the marker information, if there is a request to participate in the AR service together with the image of the marker information from the other terminal, the user terminal inquires whether to participate, and the A control unit for controlling, when the user terminal accepts, to provide the user terminal and another terminal that is allowed to participate in the AR service, an update AR service that augments resource information including objects according to the number of participants of the AR service;

Social augmented reality service server comprising a.
The method according to claim 2,

The marker information is a social augmented reality service server, characterized in that the QR code, one of the thing image, landmark image.
The method according to claim 2,

If there is a request for participation in the AR service from the other terminal, the controller compares the marker information received from the other terminal with marker information of the AR service provided to the user terminal and determines whether the same is the same. Computing the number of participants participating in an AR service, generating an updated AR service augmented the AR object and resource information corresponding to the number of participants through the AR providing unit to the other terminals corresponding to the user terminal and the participant of the AR service Social augmented reality service server, characterized in that to control to provide.
Communication unit for transmitting and receiving data to or from the AR server by wire or wireless;

An AR sharing unit for sharing marker information on an AR service and information on an AR object with other terminals connected to an AR session through the AR server;

A marker detector for detecting the marker information in a preview image obtained by photographing a subject;

An AR engine unit for generating an AR object corresponding to the marker information using the information of the AR object and displaying the generated AR object together with the preview image; And

An AR control unit processing the operation of the AR object according to AR execution, and controlling to share the updated AR service including resource and augmented resource information according to the number of participants of the AR service through the AR sharing unit;

Social augmented reality service terminal comprising a.
The method according to claim 5,

The apparatus may further include a position acquisition unit for acquiring a position of photographing the subject as GPS information.

The marker detection unit is a social augmented reality service terminal, characterized in that for detecting the marker information by combining the GPS information and the obtained subject image photographing the subject.
The method according to claim 5,

The marker detecting unit detects the acquired subject image as marker information when the subject image acquired by photographing corresponds to a unique landmark.
The method according to claim 5,

The AR sharing unit, augmented reality service terminal, characterized in that sharing the information of the AR object for the update AR service, including the object and the resource information is augmented according to the number of participants of the AR service with other terminals connected to the AR session .
The method according to claim 5,

The AR controller, upon receiving an AR session participation request message of another terminal from the AR server, transmits whether to allow participation according to a user's selection to the AR server.
The method according to claim 5,

The AR controller detects the marker information from the preview image through the marker detector and transmits an AR session participation request message requesting to participate in the AR session to the AR server, and sends an AR participation permission message from the AR server. After receiving, the AR service terminal, characterized in that for receiving the information of the AR object for the update AR service with the resource information, including the object according to the number of participants of the AR service from the AR server.
A social augmented reality service method of a system comprising a user terminal and at least one other terminal and an AR server,

(a) the user terminal receiving information of an AR object from the AR server and generating an AR object according to marker information to use an AR service;

(b) detecting, by the other terminal, the marker information and transmitting a participation request message along with the marker information to the AR server to request participation in the AR service;

(c) the AR server forwarding an AR service participation request of the other terminal to the user terminal;

(d) the user terminal transmitting an AR service participation acceptance message of the other terminal to the AR server;

(e) calculating, by the AR server, the number of participants in the AR service, and providing the user terminal and the other terminal with an updated AR service that augments information and resource information of an AR object according to the number of participants; And

(f) the user terminal and the other terminal receiving and using an update AR service from the AR server;

Social augmented reality service method comprising a.
The method according to claim 11,

The marker information is one of a combination of a QR code and a thing image, landmark image, the terminal location and the thing image.
A social augmented reality service method of an AR server for transmitting and receiving data with a user terminal and one or more other terminals in a wired or wireless manner,

(a) providing an AR service according to marker information to the user terminal;

(b) receiving a join request message of the AR service together with an image of the marker information from the other terminal;

(c) forwarding an AR service participation request of the other terminal to the user terminal;

(d) calculating the number of participants of the AR service when accepting the AR service from the user terminal; And

(e) generating an updated AR service by augmenting information and resource information of an AR object according to the number of participants of the AR service and providing the updated AR service to the user terminal, the other terminal, and other terminals participating in the AR service;

Social augmented reality service method of the AR server comprising a.
The method according to claim 13,

The marker information is a social augmented reality service method of the AR server, characterized in that one of the QR code, the thing image, the landmark image.
The method according to claim 13,

(f) controlling mutual interaction between the user terminal, the other terminal, and other terminals participating in the AR service through the update AR service;

Social augmented reality service method of the AR server comprising a.
A social augmented reality service method of an AR terminal for transmitting and receiving data to or from an AR server by wire or wirelessly,

(a) photographing and obtaining the marker information when another terminal uses the AR service according to the marker information;

(b) transmitting a participation request message of an AR service to the AR server together with the obtained marker information;

(c) receiving an AR service participation acceptance message of the other terminal from the AR server;

(d) receiving, from the AR server, an updated AR service in which an AR object and resource information are updated according to the number of participants for an AR service according to the marker information; And

(e) sharing marker information on the updated AR service and information on an AR object with other terminals connected to an AR session;

Social augmented reality service method of the AR terminal comprising a.
The method according to claim 16,

In the step (a), the augmented reality of the AR terminal, characterized in that to obtain the location to shoot the marker information to the GPS information, and to obtain the marker information by combining the image obtained by the photographing and the GPS information. Service method.
The method according to claim 16,

In the step (a), when the image acquired by photographing corresponds to a unique landmark, the acquired augmented landmark image as the marker information, the social augmented reality service method of the AR terminal.
The method according to claim 16,

(f) interacting with the other terminals through an update AR service through the AR server;

Social augmented reality service method of an AR terminal comprising a.