WO2016153108A1

WO2016153108A1 - Method and apparatus for providing augmented reality-based dynamic service

Info

Publication number: WO2016153108A1
Application number: PCT/KR2015/005831
Authority: WO
Inventors: 우운택; 하태진; 김재인
Original assignee: 한국과학기술원
Priority date: 2015-03-20
Filing date: 2015-06-10
Publication date: 2016-09-29

Abstract

The present invention comprises the steps of: collecting data associated with a pre-configured authoring item on the basis of a predetermined viewing time point within content to be guided, when an authoring mode for supplying a viewing time-based information providing service is executed at the time of performing a service for providing an augmented reality-based content service; rendering the authoring item-specific data collected on the basis of a pre-configured augmented reality content service policy, matching the rendered data to metadata corresponding to the predetermined viewing time point, and storing the matched data; checking the metadata of the viewing time point of the content displayed on a pre-configured cycle-specific viewing area on the basis of a user's status information sensed when executing a viewer mode; and as a result of the checking, when the metadata of the viewing time point coincides with the viewing time-specific metadata corresponding to the content, matching the metadata to the content displayed on the viewing area and augmenting the content, wherein the content is a real three dimensional space viewed according to the user's movement or a pre-configured scenario-based virtual reality space.

Description

Augmented reality based dynamic service providing method and apparatus

The present invention relates to a viewpoint authoring and a viewer for augmented reality based guide service.

The initial research on augmented reality authoring is a study of Authoring 3D Hypermedia for Wearable Augmented and Virtual Reality [1] at the University of Columbia, USA. You can use the to view the authored content.

In a recent study, Google's Auto Awesome [2] presented a study that automatically records travel records based on time and location information when a user takes a picture and uploads it to a server.

On the viewer's side, the Georgia Tech's Exploring spatial narratives and mixed reality experiences in Oakland Cemetery [3] conducted a study to enhance narration by enhancing narration using GPS sensors, and the Museum of London: Streetmuseum [4]. The research shows the pictures taken in the past on the basis of location, so that viewers can see the past in the field. In the case of AntarcticAR [5], the location information is visualized so that the content can be found based on the direction that the user is facing by presenting the direction and distance of each content on the map.

This experience is simply a representation of a voice or a picture on the image based on the planar location information in the map.

Therefore, the present invention stores viewing point information through capturing a scene of interest and adds related multimedia contents and narration corresponding to the viewing point of each author, so that the user can later obtain information on the object of interest at the optimal viewing point. An augmented reality authoring and viewer for visualizing the viewpoint is provided.

According to an aspect of the present invention, when an authoring mode for supporting a viewing time-based information providing service is executed when a service for providing an augmented reality-based content service is performed, data related to a predetermined authoring item based on a predetermined viewing time in a content to be guided is displayed. Collecting, storing and matching the collected item-specific data based on a preset AR content service policy, matching and storing metadata corresponding to the viewing time point, and user state information sensed when the viewer mode is executed. Checking the metadata of the viewing time of the content displayed in the predetermined viewing period for each period based on the; and if the check result matches the metadata of the viewing time corresponding to the corresponding content, the metadata is added to the viewing area. Match and enhance the displayed content Comprising the step, and the content is characterized in that, depending on the user's viewing movement (viewing) the actual three-dimensional space or a predetermined scenario-based virtual reality space.

According to another aspect of the present invention, when performing a service for providing augmented reality-based content service, the authoring mode for supporting the viewing time-based information providing service is supported, and the authoring mode related to augmented reality-based content authoring from a network connected client terminal When executed, collects data related to a predetermined work item based on a predetermined viewing time point in the content to be guided, renders data collected for each writing item based on a predetermined AR content service policy, and renders the data on the metadata corresponding to the viewing time point. Matches and stores the metadata, and checks and checks the metadata of the viewing time of the content displayed in the preset periodic viewing area based on the user's state information sensed when executing the augmented reality based content viewer request related viewer mode from the client terminal. texture When matching the viewing point-specific metadata corresponding to the content enhancement by matching the content to be displayed for the meta data to the viewing area it is characterized in that it comprises a content server that provides to the client terminal.

The present invention not only enables the generation of advanced content for AR services, but also provides a content retrieval function based on content optimized for content displayed on a display unit of a user terminal based on an actual three-dimensional space or a predetermined scenario. It is possible to provide optimized contents by viewing point of view, and interactive adaptation between users and authors who can acquire desired information by only accessing the user's terminal to the object of interest without the user's separate searching operation based on the writing by viewing point. As augmented reality-based content service is possible, the experience of enhanced space telling is possible.

1 is a flowchart illustrating a method for providing augmented reality-based dynamic service according to an embodiment of the present invention.

FIG. 2 is a diagram schematically illustrating an operation flow between a client (author or user) and a server providing an AR-based dynamic service in the AR-based dynamic service providing method according to an embodiment of the present invention.

3 is a flowchart illustrating an operation in an augmented / virtual reality-based content authoring and visualization software platform to which a method for providing augmented reality-based dynamic services is applied according to an embodiment of the present invention.

4 is a diagram illustrating a screen to which the augmented reality-based dynamic service providing method according to an embodiment of the present invention is applied.

5 is an exemplary diagram in which information related to a method for providing augmented reality-based dynamic service according to an embodiment of the present invention is coded.

6 is a diagram illustrating a screen access showing an XML file and a folder related to a content resource in the augmented reality-based dynamic service providing method according to an embodiment of the present invention.

7 is an exemplary view showing a user location / gaze information visualization concept image in the augmented reality-based dynamic service providing method according to an embodiment of the present invention.

8 is a diagram illustrating a screen in which a visualization concept image is applied to an actual screen in the augmented reality-based dynamic service providing method according to an embodiment of the present invention.

9 is a view illustrating an authoring content confirmation screen by calling an XML file in a content server in a web browser in the augmented reality-based dynamic service providing method according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, specific details such as specific components are shown, which are provided to help a more general understanding of the present invention, and the specific details may be changed or changed within the scope of the present invention. It is self-evident to those of ordinary knowledge in Esau.

The present invention relates to a viewpoint authoring and a viewer for augmented reality-based guide service, and more specifically, to collect metadata related to a predetermined authoring item based on a predetermined viewing time point in a content to be guided when the authoring mode is executed. Store metadata and check metadata of the viewing time of the content displayed in the preset periodic viewing area based on the state information of the user sensed when the viewer mode is executed and match the metadata of the predetermined viewing time corresponding to the corresponding content. Matching and augmenting the metadata with the content displayed in the viewing area to visualize the viewing viewpoint corresponding to the current image or content that is currently visually observed, so that the user can know information about the plurality of objects of interest present in the viewing viewpoint. Obtainable, real 3 Analyzes the movement information of the user sensed according to the user's interrupt in the content displayed on the display unit of the user terminal based on the original space or a predetermined scenario, and the information on the viewing viewpoint corresponding thereto (eg, multimedia content, camera view) , Narration, etc.) by adaptively authoring and storing the content as metadata for each viewing point of the content, or by providing the authoring information corresponding to the previously saved viewing point of view, it is possible to continuously generate the evolved content for the augmented reality-based content service. Rather, it is possible to provide optimized content for each viewing point by utilizing a content search function based on the content optimized for the content displayed on the display unit of the user terminal based on an actual three-dimensional space or a predetermined scenario. to the center Provides a technology that enables enhanced space-telling experience by enabling interactive and adaptive augmented reality-based content services between users and authors who can acquire desired information by simply accessing the user's terminal to the object of interest without a separate search operation of the user. I would like to.

Hereinafter, an augmented reality-based dynamic service providing method according to an embodiment of the present invention will be described in detail with reference to FIG. 1.

1 is a flowchart illustrating an augmented reality-based dynamic service providing method according to an embodiment of the present invention.

Referring to FIG. 1, in step 110, an AR-based content service to which the present invention is applied is performed.

Here, the content is an actual three-dimensional space or a predetermined scenario-based virtual reality space that is viewed according to a user's movement, and the content to which the present invention is applied is augmented or virtual (as described below sequentially). virtual) reality is displayed and serviced in the viewing area, and such content is supported through the execution of a specific program or application of the user terminal or retrieved and serviced through the Internet, or received and serviced from a remote service server. Or an actual three-dimensional space input from the viewing area through user shooting. In this case, the content searched through the Internet may be a content corresponding to a virtual space, the content according to an embodiment of the present invention provides the interaction-based feedback (eg, correction / supplementation) between the content creator and the content user Throughout this we refer to all content that is constantly updated and evolved.

In step 112, when the user terminal performs a service for providing an augmented reality-based content service, a mode switching unit checks mode switching through a corresponding user selection to check whether a current mode is an authoring mode.

As a result of the check, when the current mode of the user terminal is the authoring mode, the process moves to step 114 to capture a predetermined viewing time point of the currently displayed content.

Here, the authoring mode is a mode for providing information including a camera viewpoint, narration, and related multimedia content based on a corresponding viewing viewpoint of the content, and the capture is for acquiring corresponding information for visualizing the viewing viewpoint. For example, when the author captures a scene of interest in the authoring mode, information at the time of capture, that is, a three-dimensional space that is currently captured, or a remote service server (cloud server, content server) or internet search that is linked through a network. If the virtual space provided through the property information (museum, exhibition hall, concert, map, etc.) of the corresponding content, the 3D location, 3D rotation and GPS information acquisition of the author's terminal in the content (the sensor provided in the user terminal Sensed through a plurality of views within the perceived viewing time Stores chebyeol or overall information of the viewing point.

In other words, the narrator (or spectator) takes a picture of the object of interest while moving with the user terminal equipped with the camera. At this time, the viewing point is stored by estimating the position of the user and the attitude of the camera.

Alternatively, contents authored by the on-site authors are displayed on a map background, and the authors of the offline environment can check and modify / supplement the contents authored online. Various viewing stories can be produced through writing such as setting the order between viewing viewpoints or setting a tour pass in a space unit.

Subsequently, the process 116 collects data related to a predetermined work item based on the viewing viewpoint captured in the process 114.

The preset authoring item-related data is data including a camera viewpoint, narration, and related multimedia content. The data may be collected by broadcasting the necessary data through at least one service server distributed in a network.

Through the data collected through broadcasting, the author records and stores a description of a scene of interest based on a viewing point, or searches and stores related multimedia contents.

In this case, the related multimedia content is the content corresponding to the highest priority based on the similarity based on the scenario-based (flow that is developed according to the theme of the content) of the corresponding content, and the content retrieved through the correlation analysis based on predetermined related data. Is provided to the author through the authoring interface in.

In other words, according to an exemplary embodiment of the present invention, the content may be authored remotely based on the virtual reality environment or the content may be authored based on the augmented reality environment in the field. Authorable contents include camera viewpoint, narration, and related multimedia contents that enable information to be provided based on the viewing viewpoint, wherein the related multimedia contents are based on the pre-stored metadata of the viewing viewpoint. Based on the analysis of keyword search, location, object identifier, etc.), the content (text, picture, photo, video, etc.) with the highest relevance (using content meta information) is automatically searched for use by authors. Annotations of an image method and visual effects using color and image filters may be added to a scene corresponding to a viewing point.

In step 118, the data for each copyrighted item collected based on a preset AR content policy is rendered, and stored according to metadata corresponding to the viewing time point.

The metadata refers to detailed information corresponding to the viewing viewpoints. In order to identify a plurality of viewing viewpoints in the content, the metadata includes content types, identifiers, location information in the contents, and objects existing in each preset viewing viewpoint region. Includes detailed information of each star and responsiveness.The area of the viewing point is set based on a specific object when generating the corresponding content, or the viewing is captured when the author captures the viewing point by classifying the viewing point into a plurality of intervals according to the content type. Stores the collected item-specific data by matching the pre-stored metadata corresponding to a specific object of the viewpoint or searches the captured viewing viewpoint at the classified viewing viewpoint of the corresponding content and stores the matching viewing metadata in the retrieved viewing viewpoint metadata. .

When the authoring mode is completed, information such as a point of the feature map, a keyframe image, a camera viewpoint posture information, GPS position coordinates, a recording file, and a camera image image corresponding to the viewing viewpoint is displayed in FIG. 5. It is stored in the server's content database. At this time, the standard of the information is in the form of XML (Extensible Markup Language), and includes one GPS value, one feature map data, and N viewpoint view nodes.

The viewpoint view includes N augmented contents.

The stored XML file and content resource can be accessed as shown in FIG. 6 through a folder. When the viewing point is stored in the field, media files such as an image and a voice corresponding to the viewing point are stored in real time in the content DB of the content server.

At this time, the content server according to an embodiment of the present invention, the authoring mode for supporting the viewing time-based information providing service when performing a service for providing augmented reality-based content service is supported, augmented reality based from a client terminal connected to the network When the authoring mode related to content authoring is executed, data related to a predetermined authoring item based on a predetermined viewing point in the content to be guided are collected, and data for each authoring item collected based on a preset AR content service policy is rendered. Matching and storing the metadata corresponding to the viewpoint, and based on the user's state information sensed when executing the augmented reality based content viewer request related viewer mode from the client terminal, Meta day If the data is matched with the metadata for each viewing time point corresponding to the content, the metadata is matched with the content displayed in the viewing area and augmented to be provided to the corresponding client terminal.

Subsequently, in step 120, when the mode is switched to the viewer mode by checking whether the viewer mode is present, the process moves to step 122 to acquire state information of the sensed user.

Here, the state information of the user may be based on, for example, a user based on a touch screen input (two-dimensional touch screen coordinate information, touch input, swipe input information, etc.) based on an information processing device having visualization software installed thereon, and a viewer device. It is obtained through motion input information (three-dimensional rotation information, etc.), color image from the camera connected to the information processing device, depth map image using depth camera, three-dimensional movement and three-dimensional rotation using electromagnetic sensor. Information, acceleration of the viewer device and gyro sensor based motion information (three-dimensional rotation information), compass sensor information (one-dimensional rotation information), GPS sensor information (two-dimensional moving coordinates).

In addition, to obtain a six degree of freedom pose including movement and rotation information of a camera mounted on the information processing device (eg, a smartphone camera) or a camera mounted on a head mounted display. , Electromagnetic field sensor, image-based camera tracking technology (3D movement, 3D rotation information can be obtained based on the object from which feature points can be extracted within near / far), built-in motion sensor (2D position based on GPS sensor) Information, the yaw rotation direction information using the compass sensor, three-axis rotation information can be obtained by using the gyro sensor).

In step 124, the metadata of the viewing time of the content displayed in the preset periodic viewing area is checked based on the user state information, and in step 126, the metadata is checked according to the viewing time corresponding to the corresponding content. If it matches with and proceeds to step 128, the metadata is matched with the content displayed in the viewing area to enhance.

More specifically, in the viewer mode, a viewing time point in which the motion information obtained by acquiring the motion information of the user in a real three-dimensional space or a predetermined scenario-based virtual reality space that is viewed according to the movement of the user corresponds to the corresponding content. It is a mode that guides the user to the preferred viewing point by object by presenting a viewing point guide (visual cue) that enables augmented reality experience when it matches each star's metadata. When the user accesses the content at a specific location, the user can easily find the viewing point by presenting a visual cue that enables augmented reality experience based on precise camera posture tracking technology. To be.

This is the best time to see the object. When the user approaches the viewing point, the contents (articles, pictures, photos, videos, narrations, annotations, etc.) that were created appear. This visualization method is differentiated from the inaccurate augmented reality application technology based on the existing GPS sensor. In addition, when the user does not access specific content, the user is shown the location information through the virtual map, thereby inducing the user's access.

Referring to FIG. 7, when a user approaches a specific time point, an information annotation associated with an object is visualized. The location of the annotation is pre-mapped from the author (curator or other user) to make it easy for the user to see where he or she is looking and where.

8 is a diagram illustrating a screen in which the visualization concept image of FIG. 7 is applied to an actual screen. As shown in FIG. 8, the left side shows the location information in a distant state, and the right side is an exemplary view showing the approach of the location information point.

Here, referring to FIG. 4, FIG. 4 is an exemplary view of a screen to which a method for providing augmented reality-based dynamic service according to an embodiment of the present invention is applied. Induced, the authored content is augmented when the viewer moves to the viewing position as shown in Figure 4b).

Referring to the augmented reality-based viewing point authoring and experience process of Figure 1 through Figure 2, Figure 2 is a method for providing augmented reality-based dynamic service according to an embodiment of the present invention, the client (author or user) and augmented reality based The operation flow between the servers providing the dynamic service is schematically shown, and the client 210 corresponding to the author for the viewing viewpoint information registration (S216) of the scene of interest is the user position, the 3D camera position / viewing position information (218). ) And information 220 about the viewing position, camera posture, narration, and the like, to the server 212.

In the server 212, the user's position and the 3D camera position / viewing posture information 218 received from the client 210 are searched for meta information about the viewing point and related content similarity calculation / viewing through the content DB 224. The candidate selection 222 is performed, and the information 220 regarding the viewing position, the camera posture, the narration, and the like is performed based on the viewing position / viewing augmented reality content authoring / supplementation 226 to correspond to the client 214, respectively. Is sent to the user terminal.

At this time, the operation of the meta information search and related content similarity calculation / candidate selection (222) and the viewing position / viewing-based augmented reality content authoring / compensation (226) are related to the viewing position / viewing-based augmented reality content authoring. The information provided according to the viewing position / view-based augmented reality content authoring / correction / complement 226 operation is calculated based on the spatiotemporal context query and the related content similarity calculation / candidate selection (222). Is provided through the operation.

The user terminal of the client 214 is provided with augmented reality content authoring data based on a viewing position / viewpoint registered at a predetermined viewing time through the

augmented reality experiences

228 and 230 at the viewing time.

The configuration flow of each configuration of FIG. 2 is schematically illustrated as a screen example of 232, 234, and 236.

3 is a flowchart illustrating an operation of an augmented / virtual reality-based content authoring and visualization software platform to which the augmented reality-based dynamic service providing method according to an exemplary embodiment of the present invention is applied.

Referring to FIG. 3, the sensor-based location is performed through the operation of step 312 when the built-in sensor according to the system input in the authoring mode and the camera image data input according to the mode set in the corresponding terminal through the input device 310 of the terminal. User location recognition is performed by classifying viewpoints or image-based locations and viewpoints, and space telling authoring is performed through scene selection and content matching (arrangement) by performing operation 314.

Through operation 314, data in which the location, the viewpoint, and the information of the viewing viewpoint are specified is visualized through augmented reality-based content visualization and interaction between the author and the user in step 316, and output to the display unit of the output device 318.

On the other hand, the button, motion, touch screen-based user input in the viewer mode via the input device 310 of the terminal obtains the user input information through the corresponding user input interpretation 311 and outputs the user's intention in step 314 Space telling authoring is performed through scene selection and content matching (layout). The space telling authoring is performed by using the meta information retrieval and content extraction 313 for the context query through the operation of step 313. At this time, the related content is provided in the space telling authoring through the meta information retrieval and content extraction 313, and the meta information retrieval and content extraction 313 is performed based on the content DB and the meta information DB of the content server 320. .

In the example of using an augmented / virtual reality-based content authoring and visualization software framework to which the augmented reality-based dynamic service providing method according to an embodiment of the present invention is applied, first, an example of using an in-situ authoring-based visualization system According to the narrator (or spectator) is carrying a mobile device equipped with a camera. Take a picture of the object of interest. At this time, the viewing point is stored by estimating the position of the user and the attitude of the camera. In addition, related content can be retrieved and stored. Information authored based on the map is stored. Later, you can write additional works in an offline virtual reality environment.

According to an example of using virtualization-based visualization software in desktop and web environments, contents written by the authors in the field are displayed on the background of a map, and the authors in the offline environment can check, modify, and supplement the contents written online. Various viewing stories can be produced through writing such as setting the order between viewing viewpoints or setting a tour pass in a space unit.

According to an example of using visualization software for viewers, viewers may download visualization software and select an authored viewing story. The downloaded story allows the tour pass to be changed dynamically according to the user's profile (interest, desired visit, desired end time, etc.), allowing a personalized story experience. Story points are displayed based on the map, and the viewing viewpoint guide becomes visible when the viewer moves to a nearby location. According to the commentator's point of view, viewers can experience the story.

Referring to FIG. 9, a plurality of divided

regions

910 and 912 are provided, and preset content display items (Pose, Picture, Narration, Latitude, Longitude, Comment) items are arranged and displayed in a predetermined order, and comments set on the object or stored by user definition according to an interrupt generated in the confirmation blocks 92 and 93 marked in one region of the first location. Is activated and displayed, and a position related to one or all of the objects displayed in the first position is displayed in the second position 912 based on the GPS coordinate-based map 94 according to the user interrupt position movement operation.

In this case, an object existing on the movement path according to the movement route according to the user interrupt of the GPS coordinate-based map 94 displayed on the second position 912 on which the objects 90 and 91 are displayed is located in the first position ( Corresponding information from the content server is provided according to the related preset content display item displayed on 910 so that at least one object related information is listed and displayed.

Accordingly, the first location 910 is changed according to the user interrupt on the GPS coordinate-based map 94 displayed at the second location.

As described above, operations related to a method and apparatus for providing augmented reality-based dynamic service according to the present invention can be made. Meanwhile, the above-described description of the present invention has been described with reference to specific embodiments, but various modifications can be made without departing from the scope of the present invention. Can be implemented. Therefore, the scope of the present invention should not be defined by the described embodiments, but by the claims and equivalents of the claims.

참고문헌references

[1] S. Guven and S. Feiner, Authoring 3D Hypermedia for Wearable Augmented and Virtual Reality, Int. Symp. Wearable Comput. (2003), 118 126.

[2] Google Auto Awesome. [Online]. Available: https://plus.google.com/photos/takeatour.

[3] S. Dow, J. Lee, C. Oezbek, B. Maclntyre, J. D. Bolter, and M. Gandy, Exploring spatial narratives and mixed reality experiences in Oakland Cemetery, Int. Conf. Adv. Comput. Entertain. Technol. (2005), 5160.

[4] Museum of London: Streetmuseum. [Online]. Available: http://www.museumoflondon.org.uk .

[5] LEE, Gun A., et al. Antarctic AR: An outdoor AR experience of a virtual tour to Antarctica. In: Mixed and Augmented Reality-Arts, Media, and Humanities (ISMAR-AMH), 2013 IEEE International Symposium on. IEEE, (2013). 29-38.

Claims

When the authoring mode for supporting the viewing time based information providing service is executed when performing a service for providing augmented reality-based content service, the process of collecting data related to a predetermined authoring item based on a predetermined viewing time in the content to be guided;

Rendering data collected for each of the authoring items based on a preset AR content service policy and matching and storing the metadata for the viewing time point;

Checking the metadata at the time of viewing the content displayed in the preset periodic viewing area based on the state information of the user sensed when the viewer mode is executed;

And matching the metadata with the content displayed in the viewing area when the metadata match the metadata for each viewing time corresponding to the corresponding content, and augmenting reality-based dynamic service providing method.
The method of claim 1, wherein the authoring mode,

This mode provides information including camera viewpoint, narration and related multimedia contents based on the viewing viewpoint of the content.

The related multimedia content is a content corresponding to the highest priority based on the similarity in the content searched through correlation analysis based on scenario-based preset related data of the corresponding content, and is provided to the author through an authoring interface in an authoring mode. Reality-based dynamic service delivery method.
The method of claim 1, wherein the viewer mode,

Acquiring the motion information of the user in an actual three-dimensional space or a predetermined scenario-based virtual reality space that is viewed according to the movement of the user;

If the acquired motion information matches the metadata for each viewing point corresponding to the corresponding content, the process includes guiding the user to the preferred viewing point for each object by presenting a viewing point guide (visual cue) capable of augmented reality experience. Augmented reality-based dynamic service providing method characterized in that.
The method of claim 1,

The content is augmented reality-based dynamic service providing method characterized in that the actual three-dimensional space or a predetermined scenario-based virtual reality space to be viewed in accordance with the user's movement.
The method of claim 1, wherein the augmented reality-based content service providing screen authored through an authoring mode to execute the viewer mode is provided.

An interrupt generated in a confirmation block having a plurality of divided areas, the predetermined content display item-specific items for each object are arranged and displayed in a predetermined order at the divided first location, and marked in one area of the first location. According to the user set or stored by the user defined comments are activated, and according to the user interrupt location movement operation, any one or all of the objects associated with the object displayed in the first location is based on the GPS coordinate-based map Augmented reality-based dynamic service providing method characterized in that displayed in two locations.
The method of claim 5,

In the GPS coordinate-based map displayed at the second location on which the object is displayed, an object existing on the moving path is displayed at the first location according to the corresponding moving path according to the user interrupt, and the content server according to the related preset content display item. And providing corresponding information from at least one object-related information, which is listed and displayed.
When performing a service for providing an augmented reality-based content service, an authoring mode for supporting a viewing point-based information providing service is supported, and when the authoring mode related to augmented reality-based content authoring is executed from a networked client terminal, the content to be guided is Collects data on a predetermined work item based on a predetermined viewing point, renders the collected work item-specific data based on a preset AR content policy, and stores and matches the metadata corresponding to the viewing point;

The metadata of the viewing time of the content displayed in the preset periodic viewing area is checked based on the state information of the user sensed when executing the augmented reality-based content viewer request-related viewer mode from the client terminal. And a content server matching the metadata with the content displayed in the viewing area and providing the corresponding metadata to the corresponding client terminal when the metadata is matched with corresponding viewing viewpoint metadata.
The method of claim 7, wherein the authoring mode,

This mode provides information including camera viewpoint, narration and related multimedia contents based on the viewing viewpoint of the content.

The related multimedia content is a content corresponding to the highest priority based on the similarity in the content searched through correlation analysis based on scenario-based preset related data of the corresponding content, and is provided to the author through an authoring interface in an authoring mode. Reality-based dynamic service providing device.
The method of claim 7, wherein the viewer mode,

Acquiring the motion information of the user in an actual three-dimensional space or a predetermined scenario-based virtual reality space that is viewed according to the movement of the user;

If the acquired motion information matches the metadata for each viewing point corresponding to the corresponding content, the process includes guiding the user to the preferred viewing point for each object by presenting a viewing point guide (visual cue) capable of augmented reality experience. Augmented reality-based dynamic service providing device characterized in that.