KR20120045600A - System and method for providing augmented reality service - Google Patents

Abstract

PURPOSE: An AR(Augmented Reality) service providing system and method thereof are provided to output and display various content information in a terminal by supporting interlocking functions between terminals and AR playback apparatus. CONSTITUTION: A terminal apparatus(100) outputs content information according to content provided from an external apparatus. An AR content playback apparatus(200) provides AR services. AR content is outputted according to AR realization function through the AR services. An AR content playback apparatus provides specific content corresponding to the AR service to the terminal apparatus when the terminal is connected with the AR content playback apparatus in order to be interlocked with the AR service.

Description

Augmented Reality Service Provision System and Method {SYSTEM AND METHOD FOR PROVIDING AUGMENTED REALITY SERVICE}

The present invention relates to a system and method for providing an augmented reality service, and more particularly, to support an interworking function between an augmented reality content playback device for providing an augmented reality service and a mobile terminal to provide content information corresponding to an augmented reality service in a mobile terminal. By outputting / displaying and manipulating / information of augmented reality content playback apparatus through operation on a mobile terminal, in providing augmented reality service, a more expanded and new type of content information is provided through a mobile terminal and a range of operation is provided. The present invention relates to a scalable augmented reality service providing system and method, an augmented reality content playback device and an augmented reality content playback device, a terminal device and a method of driving the terminal device.

Augmented Reality (AR) is one of virtual reality that combines the real world that the user sees with the virtual world with additional information in one image. AR, a concept that complements the real world with a virtual world, uses a virtual environment made of computer graphics, but the main role is the real environment. Computer graphics serve to provide additional information needed for the real world. This means that the distinction between the real environment and the virtual screen is blurred by overlapping the 3D virtual image on the live image that the user sees.

The augmented reality service by the method of implementing such an augmented reality, unfolds the page of the printed book, photographed through the camera and the playback device displays the captured real-time image on the screen, a specific marker is recorded in the page As a result, when a specific marker is recognized within the captured image, there is a method of drawing a 3D graphic model connected to the marker on an actual image, ie, a captured image. Here, the marker is actually present on the two-dimensional plane, and provides information on the size, direction, and position in which the three-dimensional graphic model connected to it is drawn.

However, the above-described conventional augmented reality service does not support interworking with a mobile terminal that most other terminals, especially general users, due to a platform limited to a playback device (eg, a PC or a mobile terminal) that plays augmented reality content. I can't.

Accordingly, the present invention provides an augmented reality service environment that can provide a more expanded and new type of content information by supporting the interworking between a playback device (eg, PC, mobile terminal) and a separate mobile terminal for playing augmented reality content. I would like to.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an augmented reality service for outputting augmented reality content according to the augmented reality content reproduction device performs a predetermined augmented reality implementation function, When a terminal device is connected for interworking with an augmented reality service, the augmented reality content playback device provides specific content corresponding to the augmented reality service to the terminal device, and the terminal device is provided from the augmented reality content playback device. By providing a system and method for providing augmented reality service for outputting content information according to content, by supporting an interworking function between an augmented reality content playback device providing an augmented reality service and a mobile terminal, content information corresponding to an augmented reality service in a mobile terminal Can be displayed / displayed on the mobile terminal By operating / providing augmented reality content playback apparatus through manipulation, in providing augmented reality service, a more expanded and new type of content information is provided through a mobile terminal and an operation range is expanded.

The present invention has been made in view of the above circumstances, and another object to be achieved in the present invention is connected to an external augmented reality content playback device, the augmented reality content application in the content provided from the augmented reality content playback device is If it is included, the augmented reality-related application is installed, and the terminal device and the terminal device for outputting the content information according to the content providing a method of operation of the terminal device, the augmented reality content playback device providing an augmented reality service and interworking function between the mobile terminal It is to support the environment to output / display the content information corresponding to the augmented reality service in the mobile terminal.

The present invention was created in view of the above circumstances, and another object to be achieved in the present invention is to perform a preset augmented reality implementation function, and when the terminal device is connected to the augmented reality service, the augmented reality At least one of a first control operation for providing an augmented reality service for outputting augmented reality content and a second control operation for providing a specific content corresponding to the augmented reality service to the connected terminal device according to an implementation function. By providing an augmented reality content playback device and a method of operating the augmented reality content playback device to perform the operation, by supporting the augmented reality content playback device providing augmented reality service and the mobile terminal interworking function corresponding to the augmented reality service in the mobile terminal It is to support an environment that can display / display content information.

An augmented reality service providing system according to a first aspect of the present invention for achieving the above object, the terminal device for outputting the content information according to the content provided from the connected external device; And augmented reality service outputting an augmented reality content according to a preset augmented reality implementation function, and when a terminal device is connected for interworking with the augmented reality service, specific content corresponding to the augmented reality service to the terminal device. It includes an augmented reality content playback device to provide.

Terminal device according to a second aspect of the present invention for achieving the above object, Connection support for supporting the connection with the external augmented reality content playback device; Installation function unit for installing a specific augmented reality-related applications; And outputting content information according to content provided from the augmented reality content playback device through the connection support unit, and controlling the installation function to install the augmented reality related application when the augmented reality related application is included in the content. It includes an interlock control unit.

The augmented reality content according to the augmented reality content information may be generated by driving the augmented reality related application when the augmented reality content information is included in the content provided from the augmented reality content playback device. You can output

Preferably, when the operation information for the augmented reality content is provided from the augmented reality content playback device, the linkage control unit changes the augmented reality content or a virtual object rendered in the augmented reality content based on the operation information. You can print

Preferably, the interlocking controller may provide operation information according to an operation by a user to the augmented reality content playback device.

An augmented reality content playback device according to a third aspect of the present invention for achieving the above object, an augmented reality service control unit for providing an augmented reality service for outputting augmented reality content to the output unit to perform a preset augmented reality implementation function; And a first control operation of controlling the augmented reality service control unit to provide the augmented reality service and a specific content corresponding to the augmented reality service when the terminal device is connected for interworking with the augmented reality service. It includes an interlocking control unit for performing at least one control operation of the second control operation to provide.

Preferably, the interlocking control unit, if the augmented reality implementation function is performed to provide the augmented reality service in the augmented reality service control unit, and if there is a terminal device connected to check whether there is a connected terminal device, the corresponding terminal device The first control operation or the second control operation may be performed according to a user's selection of whether to interwork with the.

Preferably, the linkage control unit, when augmented reality service linkage is selected according to the user's selection of whether or not the linkage with the terminal device, checks the synchronization setting state with the terminal device when the normal synchronization setting state; In the case of performing a control operation 2 and in an abnormal abnormal synchronization setting state, resynchronization setting may be induced to the terminal device.

Preferably, the interlocking control unit checks whether the connected terminal device exists and, if there is no connected terminal device, searches for a terminal device that can be connected when the linking function is used and provides a terminal list accordingly. A preset connection operation with the corresponding terminal device selected by the terminal device may be performed.

Preferably, the linkage control unit, corresponding to the augmented reality service, the book-related information including at least one of a cover image, book content information and book additional information about the printed book to be photographed, and at least in the printed book Page-related information including at least one of a page image, page content information, and page additional information of one specific page, augmented reality content information of the augmented reality content output according to the augmented reality service, and the augmentation The content including at least one of virtual object related information corresponding to the virtual object rendered in the real content and a specific augmented reality related application may be provided to the terminal device.

Preferably, the linkage control unit may provide operation information to the terminal device according to an operation input by the user corresponding to the augmented reality service.

Preferably, the linkage control unit controls the augmented reality service control unit to change and output the augmented reality content or a virtual object rendered in the augmented reality content based on the operation information when the operation information is provided from the terminal device. Or output the information screen according to the operation information to the output unit.

A method for providing augmented reality service according to a fourth aspect of the present invention for achieving the above object comprises the steps of: providing an augmented reality service for outputting augmented reality content according to the augmented reality content reproduction function performed by the augmented reality content playback device; Providing a specific content corresponding to the augmented reality service by the augmented reality content playback device when the terminal device is connected to the augmented reality service for interworking; And outputting, by the terminal device, content information according to content provided from the augmented reality content playback device.

A method of operating a terminal device according to a fifth aspect of the present invention for achieving the above object comprises: a connection supporting step connected to an external augmented reality content playback device; An application installation step of installing the augmented reality related application when the augmented reality related application is included in the content provided from the augmented reality content playback device; And a content output step of outputting content information according to the content.

Preferably, the content output step, when the content provided from the augmented reality content playback device includes a specific augmented reality content information, by driving the augmented reality-related application through which the augmented according to the augmented reality content information Real content can be output.

Preferably, when operation information on the augmented reality content is provided from the apparatus for reproducing augmented reality content, changing and outputting the augmented reality content or a virtual object rendered in the augmented reality content based on the manipulation information. It may include.

Preferably, the method may further include providing operation information according to a manipulation by a user to the augmented reality content playback device.

Operation method of the augmented reality content playback device according to a sixth aspect of the present invention for achieving the above object, performing augmented reality function performing a preset augmented reality implementation function; And a first control operation for providing an augmented reality service for outputting an augmented reality content according to the execution of the augmented reality implementation function when the terminal device is connected to the augmented reality service in connection with the augmented reality service. And an interlocking control step of performing at least one control operation among the second control operations provided to the connected terminal device.

Preferably, the interlocking control step, when the preset augmented reality implementation function is performed, if there is a connected terminal device to determine whether there is a connected terminal device according to the user's selection of whether or not interworking with the corresponding terminal device The first control operation or the second control operation may be performed.

Preferably, in the interlocking control step, when augmented reality service interworking is selected according to a user's selection of interworking with the terminal device, checking a synchronization setting state with the terminal device and in a normal synchronization setting state. When performing the second control operation and in an abnormal abnormal synchronization setting state, resynchronization setting may be induced to the terminal device.

Preferably, in the interlocking control step, if the connected terminal device does not exist by checking the existence of the connected terminal device, the terminal device may search for a connectable terminal device and provide a terminal list accordingly when it is set to the use of the interworking function. The preset connection operation with the terminal device selected by the user may be performed.

Preferably, the content corresponding to the augmented reality service, corresponding to the augmented reality service, book-related information including at least one of a cover image, book content information and book additional information for the photographed printed book, Augmented reality content for the page-related information including at least one of a page image, page content information and page additional information for at least one specific page in the printed book and the augmented reality content output according to the augmented reality service Information, the virtual object related information corresponding to the virtual object rendered in the augmented reality content, and may include at least one of a specific augmented reality related application.

Preferably, the method may further include providing operation information according to an operation by a user input corresponding to the augmented reality service to the terminal device.

Preferably, when the operation information is provided from the terminal device, the execution of the augmented reality implementation function to control or output the augmented reality content or the virtual object rendered in the augmented reality content based on the operation information or control the operation The method may further include outputting an information screen according to the information.

Accordingly, according to the augmented reality service providing system and method of the present invention, the augmented reality content playback apparatus provided in the augmented reality content playback device by supporting the interworking function between the augmented reality content playback device for providing augmented reality service and the terminal device having mobility Various content information corresponding to the reality service can be output / displayed, and the augmented reality content playback device can be operated / informed through the operation on the terminal device, thereby providing augmented reality service to expand and provide a new type of content information. It can be provided through a separate terminal device of mobility and expands the operation range.

1 is a block diagram of an augmented reality service providing system according to a preferred embodiment of the present invention.
2 is a block diagram of a terminal device according to a preferred embodiment of the present invention.
3 is a block diagram of an apparatus for reproducing augmented reality content according to a preferred embodiment of the present invention.
4 is a flowchart illustrating a control flow of a method for providing augmented reality service according to a preferred embodiment of the present invention.
5 is a flowchart illustrating a method of operating a terminal device according to an exemplary embodiment of the present invention.
6 is a flowchart illustrating a method of operating an augmented reality content playback device according to a preferred embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described a preferred embodiment of the present invention.

1 is a diagram illustrating an augmented reality service providing system according to a preferred embodiment of the present invention.

As shown in FIG. 1, the augmented reality service providing system according to the present invention includes a terminal device 100 that outputs content information according to content provided from a connected external device, and a preset augmented reality implementation function. Augmented reality service that provides augmented reality services for outputting augmented reality content, and provides a specific content corresponding to the augmented reality service to the terminal device 100 when the terminal device 100 is connected to link to the augmented reality service And a content playback device 200.

Here, the augmented reality content reproducing apparatus 200 can perform a variety of augmented reality implementation function, for example, augmented reality is reflected by performing a preset augmented reality implementation function in playing the advertising content stored from the outside or internally The augmented reality content may be output or the augmented reality content may be output by performing a preset augmented reality implementation function based on a photographed image of a specific print book.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book.

That is, the augmented reality content playback apparatus 200 analyzes the photographed image of the print book 10 located in the specific photographing zone 1 and performs the preset augmented reality implementation function corresponding to the analysis result. An augmented reality service for outputting augmented reality content applied to the image can be provided.

The printed book 10 is an offline book consisting of at least one page containing text and / or pictures. Such a printed book 10 may include at least one marker 10a for augmented reality on a page.

Here, the printed book 10 will be placed in the specific photographing zone 1 photographed by the augmented reality content playback device 200 with the specific page unfolded by the user. As shown in FIG. 1, the printed book 10 may include book identification information indicating what the print book 10 is or page identification information indicating what the page is or a specific virtual object (eg, 3D). It may include a page having a marker (10a) corresponding to the augmentation identification information to render (rendered) to a specific position to augmented display.

Of course, if the augmented reality content playback device 200 provides a variety of marker free (marker-free) or marker-less (augmented reality) service, the print book 10 is a separate marker (10a) on the page May not be included.

The augmented reality content reproducing apparatus 200 analyzes a photographed image of a print book 10 located in a specific photographing zone 1 and performs a preset augmented reality implementation function corresponding to the analysis result. The augmented reality service is provided to the user by outputting the applied augmented reality content.

Accordingly, the augmented reality content playback apparatus 200 analyzes a photographed image of the unfolded page of the printed book 10 located in the specific photographing zone 1, and analyzes the photographed real-time photographed image if there is no marker as a result of the analysis. Process the output as it is without augmenting the virtual object, and if there is a marker (eg 10a) as a result of analysis, shoot by performing a preset augmented reality implementation function (eg 3D graphic model rendering) corresponding to the corresponding marker (eg 10a). By augmenting and outputting a virtual object (eg, a 3D graphic model) to the real-time photographed image, an augmented reality service may be provided based on a photographed image of the print book 10.

Meanwhile, in the above description, although the marker 10a is included in the printed book 10, the AR content reproducing apparatus 200 provides augmented reality service through marker recognition, but this is only an example.

That is, even if the marker 10a is not included in the printed book 10, the AR content reproducing apparatus 200 provides a preset AR service based on various marker free or markerless methods. Of course it would be possible.

Hereinafter, for convenience of description, the marker 10a is included in the printed book 10 so that the augmented reality content reproducing apparatus 200 provides an augmented reality service through marker recognition.

On the other hand, augmented reality content playback device 200, when performing the augmented reality implementation function, or when providing augmented reality service to output the augmented reality content in accordance with the implementation of the augmented reality implementation function, the terminal device for interworking with the augmented reality service ( When 100 is connected, the terminal device 100 may provide specific content corresponding to this augmented reality service.

The augmented reality content playback device 200 is a console device that can support augmented reality services by embedding augmented reality implementation, specifically, a PC device, a mobile device such as a smartphone device or a PDA device. Can be.

The terminal device 100 may be connected to an apparatus for providing an augmented reality service, that is, the augmented reality content playback device 200, and may output and display content information according to content provided from the augmented reality content playback device 200. .

The terminal device 100 may be a mobile phone terminal or a mobile terminal such as a smart phone or a PDA device.

Thus, for example, while augmented reality content playback device 200 provides an augmented reality service that outputs augmented reality content (eg, a photographed image + a virtual object) according to photographing the unfolded page of the printed book 10, Based on the contents (eg, page related information) provided from the real content playback device 200, the terminal device 100 may display page images, page content information, page additional information, and the like for the corresponding page of the print book 10. have.

Alternatively, for example, while the augmented reality content playback device 200 provides an augmented reality service that outputs augmented reality content (eg, a photographed image + a virtual object), the content provided from the augmented reality content playback device 200, that is, a printed book. Based on augmented reality content information of the augmented reality content (eg, photographed image + virtual object) according to photographing the unfolded page of (10), the augmented reality content (eg, photographed image + virtual object) is displayed on the terminal device 100. Can be.

For example, the augmented reality content playback device 200 does not provide an augmented reality service, but instead augmented reality content by taking the content provided from the augmented reality content playback device 200, that is, an unfolded page of the print book 10 ( For example, the augmented reality content (eg, the photographed image + the virtual object) may be displayed on the terminal device 100 based on the augmented reality content information about the photographed image + the virtual object.

Hereinafter, the terminal device 100 according to the present invention will be described in more detail with reference to FIG. 2.

 Terminal device 100 according to the present invention, the connection support unit 110 for supporting the connection with the external augmented reality content playback device 200, and the installation function unit 120 for installing a specific augmented reality-related applications, connection Outputs the content information according to the content provided from the augmented reality content playback device 200 through the support unit 110, the installation function unit to install the augmented reality related application when the augmented reality related application in the content is included ( And a linkage control unit 130 for controlling 120.

The connection support unit 110 is a function unit that supports a connection with an external augmented reality content playback device 200, and can support a connection through a wired connection or wireless communication such as Bluetooth, Wi-Fi (for example, short-range wireless). Communication).

The installation function unit 120 may include an installer having a function of automatically installing the provided application, and may install a specific augmented reality related application provided by the interlocking controller 130.

The interlocking control unit 130 is a function unit for controlling overall interlocking with the augmented reality content playback device 200 connected through the connection support unit 110.

Accordingly, the interlocking controller 130 may perform synchronization setting operation through the preset method with the augmented reality content playback device 200 connected through the connection support unit 110 to support synchronization with the augmented reality content playback device 200. will be.

In more detail, the interworking controller 130 receives the content provided from the AR content playback device 200 through the connection support unit 110 and outputs content information according to the received content.

Then, the interlocking control unit 130, when the specific augmented reality-related applications in the content provided from the augmented reality content playback device 200 includes the corresponding augmented reality related application to the installation function unit 120 to install the installation function unit ( 120 may control to install the AR application.

Accordingly, when the interlocking controller 130 outputs content information according to the content provided from the AR content playback device 200, when the content provided from the AR content playback device 200 includes specific AR content information. The augmented reality related application may be driven by the installation function unit 120 to output the augmented reality content according to the augmented reality content information.

That is, the interlock control unit 130, the cover image and the book content information (for example, author related information, publication related information, plot related information, etc.) for the print book 10 in the content provided from the augmented reality content playback device 200; And book additional information including at least one of book additional information (eg, marker information, book review information, readership information, related other book information, etc.), a content information screen according to the book related information is displayed. And / or to a speaker.

In addition, the interlocking controller 130 may include page images and page content information (eg, page plot information, etc.) and pages for at least one specific page in the print book 10 in the content provided from the AR content playback device 200. When page related information including at least one of additional information (eg, page marker information and word related information) is included, a content information screen according to the page related information may be output to a display screen and / or a speaker. .

In addition, the interlocking control unit 130 includes augmented reality content information for the augmented reality content output according to the augmented reality service provided by the augmented reality content playback device 200 to the content provided from the augmented reality content playback device 200. In other words, if augmented reality content information for augmented reality content (eg, photographed image + virtual object) according to augmented reality implementation function in the augmented reality content playback device 200 is included, according to the augmented reality content information A content information screen, that is, augmented reality content (eg, a photographed image + a virtual object) may be output to a display screen and / or a speaker.

In addition, the interlocking controller 130 may correspond to the virtual object rendered in the augmented reality content output according to the augmented reality service provided by the augmented reality content playback device 200 to the content provided from the augmented reality content playback device 200. When the virtual object related information is included, the content information screen according to the virtual object related information, that is, the virtual object may be output to the display screen and / or the speaker.

And, when the operation information on the augmented reality content is provided from the augmented reality content playback device 200, the interlocking controller 130 changes the augmented reality content or a virtual object rendered in the augmented reality content based on the operation information. You can print

That is, the interlocking controller 130 outputs an augmented reality content (eg, a photographed image + a virtual object) or a virtual object on a display screen and / or a speaker based on the content provided from the augmented reality content playback device 200. When the corresponding operation information is provided from the reality content reproducing apparatus 200, the augmented reality content (for example, photographed image + virtual object) or the virtual object is moved, rotated, enlarged or reduced based on the provided operation information. Can be changed / output.

On the other hand, the interlocking controller 130 may provide the augmented reality content playback device 200 with the operation information according to the operation by the user.

For example, the interlocking controller 130 is outputting content information according to the content provided from the AR content playback device 200, that is, AR content or virtual object, to the display screen and / or the speaker, while augmented reality content or virtual When a preset manipulation function is input by a user to move, rotate, reduce, or enlarge an object, the manipulation information corresponding to the object may be generated and provided to the augmented reality content playback apparatus 200.

Alternatively, when the user inputs input information for display / output to the augmented reality content playback device 200 by the user, the interlocking controller 130 generates corresponding operation information (including input information) to generate the augmented reality content playback device. 200 may be provided.

Hereinafter, the configuration of the apparatus for reproducing augmented reality content 200 according to the present invention will be described in more detail with reference to FIG. 3.

Augmented reality content playback device 200 according to the present invention, augmented reality service control unit 230 for providing an augmented reality service for outputting augmented reality content to the output unit 220 in accordance with a predetermined augmented reality implementation function performance; When the terminal device 100 is connected for interworking with the augmented reality service, the first control operation for controlling the augmented reality service control unit 230 to provide the augmented reality service and specific content corresponding to the augmented reality service. It includes an interlocking control unit 240 for performing at least one control operation of the second control operation provided to the connected terminal device 100, and the connection support unit 250.

Here, the augmented reality content reproducing apparatus 200 can perform a variety of augmented reality implementation function, for example, augmented reality is reflected by performing a preset augmented reality implementation function in playing the advertising content stored from the outside or internally The augmented reality content may be output or the augmented reality content may be output by performing a preset augmented reality implementation function based on a photographed image of a specific print book.

Hereinafter, for convenience of description, it will be described with reference to an example of performing a preset augmented reality implementation function based on a photographed image photographing a specific printed book. In this case, the AR content reproducing apparatus 200 may include a photographing unit 210 as shown in FIG. 3.

The connection support unit 250 is a function unit for supporting the connection with the external terminal device 100, and may support connection through a wired connection or perform wireless communication (for example, short-range wireless communication) such as Bluetooth or Wi-Fi. It can also support connections.

The photographing unit 210 photographs the designated specific photographing zone 1 and captures a photographed image of a page of the print book 10 located in the photographing zone 1 by the augmented reality service control unit 230 and / or the interlocking controller. Provided at 240. The photographing unit 210 may be a functional device that can provide a photographed image by capturing / recognizing an image such as a camera, a cam, and a scanner.

The augmented reality service control unit 230 outputs an augmented reality content applied to the photographed image in accordance with a predetermined augmented reality implementation function corresponding to the analysis result by analyzing the photographed image taken by the photographing unit 210 output unit 220 ) To provide augmented reality service to the user.

For example, the augmented reality service control unit 230 analyzes the photographed image photographed by the photographing unit 210 to recognize a marker in the photographed image, that is, whether or not the marker exists in the photographed image. Check the analysis results corresponding to which markers are present.

The augmented reality service control unit 230 outputs, through the output unit 220, augmented reality content applied to the captured image according to the execution of a preset augmented reality implementation function corresponding to the analysis result, based on the analysis result described above. Here, the output unit 220 may include at least one of a display unit and a speaker.

For example, the augmented reality service control unit 230, if the marker does not exist in the photographed image, the real-time photographed image taken, that is, the photographed image of the unfolded page of the print book 10 is processed without outputting the virtual object as it is output It can be output through the unit 220. In this case, the content of the captured image photographing the unfolded page of the print book 10 corresponds to the augmented reality content.

In addition, the augmented reality service control unit 230, if there is a marker (eg 10a) in the captured image, and performs a preset augmented reality implementation function (eg 3D graphic model rendering) corresponding to the marker (eg 10a). As a result, a virtual object (for example, a graphic model of 3D) may be augmented and output through the output unit 220. In this case, content rendered by a virtual object (eg, a 3D graphic model) on the open page of the print book 10 corresponds to the augmented reality content.

As such, the augmented reality service control unit 230 may provide a general augmented reality service based on a marker of a photographed image photographing the print book 10.

Meanwhile, in the above description, although the marker 10a is included in the printed book 10, the augmented reality service controller 230 provides augmented reality service through marker recognition, but this is only an example.

That is, the augmented reality service control unit 230 has various marker free or marker-less preset augmented reality service providing functions, and the marker 10a is printed on the printed book 10. Even if not included, various marker free or marker-less augmented reality services may be provided.

The interlocking control unit 240 controls the augmented reality service control unit 230 to provide an augmented reality service when the terminal device 100 is connected for interworking with the augmented reality service provided by the augmented reality content playback device 200. At least one of the first control operation and the second control operation of providing the specific content corresponding to the augmented reality service to the connected terminal device 100 is performed.

In more detail, when the augmented reality implementation function is performed to provide an augmented reality service by the augmented reality service controller 230 based on the captured image, the interworking controller 240 may determine whether the connected terminal device 100 exists. If there is a terminal device 100 connected to the terminal device 100, the first control operation or the second control operation may be performed according to a user's selection of whether the terminal device 100 is interlocked with the corresponding terminal device 100.

That is, when the augmented reality implementation function is performed by the augmented reality service control unit 230 to provide an augmented reality service based on the captured image, the linkage controller 240 checks the setting state of the linkage function by the user. When the function is not set to use, the augmented reality service control unit 230 performs the first control operation to provide the augmented reality service outputting the augmented reality content according to the augmented reality implementation function to the output unit 220. .

On the other hand, when the user checks the setting state of the interlocking function and is previously set to the interlocking function using state, the interlocking control unit 240 checks whether the connected terminal device 100 exists.

If the connected terminal device 100 does not exist as a result of checking whether it exists, the interworking control unit 240 searches for a connectable terminal device and provides a terminal list according to the connection function when the interworking function is used. The preset connection operation with the terminal device can be performed.

That is, if the connected terminal device 100 does not exist, it is currently set to use an interlocking function, so that the interworking control unit 240 searches for a connectable terminal device in order to connect the terminal device for interworking. In this case, the interworking controller 240 may search for terminal devices within a close range that can be communicated through wireless communication (for example, short-range wireless communication) such as Bluetooth and Wi-Fi.

Then, the interlocking control unit 240 presents a terminal list indicating the at least one searched terminal device to the user to allow the user to select a terminal device to be connected. Accordingly, when a specific terminal device 100 is selected in the terminal list, the interworking control unit 240 performs a preset connection operation with the selected terminal device 100 and the terminal device 100 through the connection support unit 250. It can be connected with.

On the other hand, as a result of checking whether there is a connected terminal device 100, the interlocking control unit 240, by presenting the interlocking selection screen to induce the user to select whether or not to execute the interworking with the corresponding terminal device 100 to the user It may be selected whether or not interworking with the terminal device (100).

Accordingly, the interlocking controller 240 performs the first control operation when the interlocking is not selected according to the user's selection of the interworking with the terminal device 100, thereby causing the augmented reality service control unit 230 to perform the augmented reality implementation function. To provide an augmented reality service for outputting the augmented reality content according to the output unit 220.

On the other hand, the interlocking control unit 240, according to the user's selection of the interworking with the terminal device 100, if the interlocking is selected, and confirms the synchronization setting state with the terminal device 100, the second control when the normal synchronization setting state When performing the operation and in an abnormal abnormal synchronization setting state, the terminal device 100 may induce resynchronization setting.

That is, when the interlocking control unit 240 selects the interlocking with the terminal device 100 by the user, the interlocking control unit 240 checks the synchronization setting state with the currently connected terminal device 100 and determines whether it is a normal synchronization setting state. .

Accordingly, when it is determined that the synchronization setting state is abnormal, the interlocking control unit 240 induces resynchronization setting to the terminal device 100, thereby providing the interlocking control unit 130 of the aforementioned terminal device 100. By performing the synchronization setting operation in a preset manner with and will support the synchronization with the terminal device (100).

On the other hand, when it is determined that the synchronization setting state is a normal synchronization setting state, the interlocking control unit 240 may provide the terminal device 100 with specific content corresponding to the augmented reality service by performing the above-described second control operation. have.

That is, the interlocking control unit 240 corresponds to the augmented reality service according to the augmented reality implementation function performed in the augmented reality service control unit 230, among the cover image and the book content information and the book additional information of the print book (1). Book-related information including at least one, page-related information including at least one of page images, page content information, and page additional information of at least one specific page in the printed book 1, and augmented reality service. The terminal device 100 includes augmented reality content information of the augmented reality content output according to the output, virtual object related information corresponding to a virtual object rendered in the augmented reality content, and content including at least one of a specific augmented reality related application. Can be provided as

For example, the interlocking control unit 240, according to the performance of the augmented reality implementation function performed to provide augmented reality service in the augmented reality service control unit 230 based on the photographed image of the print book (1), the print book ( 10) cover image and book contents information (eg author related information, publication related information, plot related information, etc.) and additional book information (eg marker information, book review information, readership information, related other book information, etc.) Content including book related information including at least one may be provided to the terminal device 100.

In addition, the interlocking control unit 240, according to the performance of the augmented reality implementation function performed to provide the augmented reality service in the augmented reality service control unit 230 based on the photographed image of the print book 1, the print book (10) Includes page related information including at least one of page image and page content information (eg page story information) and page additional information (eg page marker information, word related information, etc.) of at least one specific page The content may be provided to the terminal device 100.

In addition, the interlocking control unit 240, augmented reality content function according to the augmented reality implementation function performed to provide an augmented reality service in the augmented reality service control unit 230 based on the photographed image photographing the print book (1) (eg, : Content including augmented reality content information and / or a specific augmented reality related application for the photographed image + virtual object may be provided to the terminal device (100).

In addition, the interlocking controller 130 renders in the augmented reality content according to the augmented reality implementation function performed to provide an augmented reality service by the augmented reality service control unit 230 based on the photographed image of the print book 1. The terminal apparatus 100 may provide the terminal apparatus 100 with content including virtual object related information corresponding to the virtual object and / or a specific augmented reality related application.

Here, the specific augmented reality-related application, and then installed in the terminal device 100 to output the corresponding augmented reality content (eg, photographed image + virtual object) based on the augmented reality content information and / or virtual object related information and / Or it might be an application designed to output virtual objects.

Meanwhile, the interlocking controller 130 performs a second control operation for providing the terminal device 100 with specific content corresponding to the augmented reality service, and outputs the augmented reality content to the output unit 220. The first control operation for controlling the augmented reality service control unit 230 to provide a service may be performed together.

In addition, the interworking controller 240 may provide the terminal device 100 with operation information according to an operation input by the user corresponding to the augmented reality service.

That is, the interlocking control unit 240, the operation information (for example, the actual coordinate and / or virtual coordinate change information) as the print book 1 is moved, tilted, rotated or moved away from the photographing unit 210 by the user The terminal 100 may provide operation information (eg, marker response control information) according to marker recognition set as a specific manipulation function, operation information (eg, gesture response control information) according to preset user hand gesture recognition, and the like. .

Thus, as described above, the terminal device 100 outputs an augmented reality content (eg, a photographed image + a virtual object) or a virtual object to a display screen and / or a speaker based on the content provided from the augmented reality content playback device 200. Among the augmented reality content playback apparatus 200, the augmented reality content (e.g., photographed image + virtual object) or virtual object is moved or rotated, enlarged or reduced based on the operation information provided correspondingly. Can output

On the other hand, when the operation information is provided from the terminal device 100, the interlocking control unit 240, the augmented reality service control unit to change and output the augmented reality content or a virtual object rendered in the augmented reality content based on the operation information ( 230 or output the information screen according to the operation information to the output unit 220.

For example, operation information for moving, rotating, reducing or enlarging the augmented reality content or the virtual object may be provided from the terminal device 100.

In this case, the interlocking controller 240 moves or rotates the augmented reality content (eg, a photographed image + a virtual object) or a virtual object according to the augmented reality service provided by the augmented reality service control unit 230 based on the operation information. The augmented reality service control unit 230 may be controlled to change, output, reduce, enlarge, or enlarge.

Alternatively, operation information including input information for displaying / outputting from the terminal apparatus 100 to the augmented reality content playback apparatus 200 may be provided.

In this case, the interlocking control unit 240 may output the information screen according to the input information included in the operation information to the output unit 220 based on the operation information.

As described above, the augmented reality service providing system according to the present invention provides an augmented reality content playback apparatus in a terminal device by supporting an interworking function between an augmented reality content playback device for providing an augmented reality service and a terminal device having mobility. It is possible to output / display various contents information corresponding to the augmented reality service, and to operate / inform the augmented reality content playback device through an operation on a terminal device, thereby providing augmented reality service in a more expanded and new form. Content information can be provided through a separate terminal device of mobility and the operation range can be extended.

Hereinafter, a method of providing augmented reality service according to a preferred embodiment of the present invention will be described with reference to FIGS. 4 to 6. Here, for convenience of description, the components shown in FIGS. 1 to 3 will be described with reference to corresponding reference numerals.

First, the augmented reality service providing method of the present invention will be described with reference to FIG. 4.

The terminal device 100 and the augmented reality content playback device 200 are connected to each other for interworking with the augmented reality service provided by the augmented reality content playback device 200 (S10).

The augmented reality content reproducing apparatus 200 captures a print book 10 located in a specific photographing zone 1 (S20), analyzes the photographed photographed image, and implements a preset augmented reality corresponding to the analysis result. Perform (S30). Thus, the augmented reality content playback device 200 provides an augmented reality service to the user by outputting augmented reality content applied to the captured image in accordance with the performance of the augmented reality implementation function (S40).

Accordingly, the augmented reality content playback apparatus 200 analyzes a photographed image of the unfolded page of the printed book 10 located in the specific photographing zone 1, and analyzes the photographed real-time photographed image if there is no marker as a result of the analysis. Process the output as it is without augmenting the virtual object, and if there is a marker (eg 10a) as a result of analysis, shoot by performing a preset augmented reality implementation function (eg 3D graphic model rendering) corresponding to the corresponding marker (eg 10a). By augmenting and outputting a virtual object (eg, a 3D graphic model) to the real-time photographed image, an augmented reality service may be provided based on a photographed image of the print book 10.

Meanwhile, in the above description, although the marker 10a is included in the printed book 10, the AR content reproducing apparatus 200 provides augmented reality service through marker recognition, but this is only an example.

That is, even if the marker 10a is not included in the printed book 10, the AR content reproducing apparatus 200 provides a preset AR service based on various marker free or markerless methods. Of course it would be possible.

Hereinafter, for convenience of description, the marker 10a is included in the printed book 10 so that the augmented reality content reproducing apparatus 200 provides an augmented reality service through marker recognition.

On the other hand, augmented reality content playback device 200, when performing the augmented reality implementation function, or when providing augmented reality service to output the augmented reality content in accordance with the implementation of the augmented reality implementation function, the terminal device for interworking with the augmented reality service ( If 100 is connected, the terminal device 100 may provide specific content corresponding to the augmented reality service (S50).

The augmented reality content playback device 200, a console (Console) device that can support augmented reality services built-in augmented reality implementation function, specifically may be a mobile device such as a PC device or a smart phone device or PDA device have.

The terminal device 100 may output and display content information corresponding to the content provided from the device providing the augmented reality service, that is, the augmented reality content playback device 200 (S60).

The terminal device 100 may be a mobile phone terminal or a mobile terminal such as a smart phone or a PDA device.

Hereinafter, a method of operating a terminal device according to the present invention will be described in more detail with reference to FIG. 5.

The operation method of the terminal device 100 according to the present invention is connected to the external augmented reality content playback device 200 (S100). In this case, the operation method of the terminal device 100 according to the present invention may be connected to the augmented reality content playback device 200 by supporting a connection through a wired connection or wireless communication such as Bluetooth, Wi-Fi, etc. Wireless communication) may be connected to the augmented reality content playback device 200 by supporting a connection through.

In addition, the operation method of the terminal device 100 according to the present invention receives the content provided from the connected augmented reality content playback device 200 (S110), and outputs the content information according to the received content (S130).

At this time, the operation method of the terminal device 100 according to the present invention, if a specific augmented reality-related application in the content provided from the augmented reality content playback device 200 includes a built-in installation function unit corresponding to the augmented reality related application ( 120 can be automatically installed through the installation function according to (S120).

Thus, the operation method of the terminal device 100 according to the present invention, in step S130 of outputting the content information according to the content provided from the augmented reality content playback device 200, the content provided from the augmented reality content playback device 200 When the specific augmented reality content information is included in the augmented reality related application by the installation function unit 120 is installed by the augmented reality content can be output through this through the augmented reality content information.

That is, the operating method of the terminal device 100 according to the present invention includes a cover image and book content information (eg, author related information, publication related information) for the print book 10 in the content provided from the AR content playback device 200. If book-related information including at least one of information, story-related information, etc., and book supplementary information (e.g. marker information, book review information, readership information, related other book information, etc.) is included, The corresponding content information screen may be output to the display screen and / or the speaker.

In addition, the operating method of the terminal device 100 according to the present invention, the content provided from the augmented reality content playback device 200, the page image and page content information (for example: at least one specific page in the print book 10) A page related information including at least one of page plot information, etc.) and page additional information (eg, page marker information, word related information, etc.) Or you can output to the speaker.

In addition, the operation method of the terminal device 100 according to the present invention, the content provided from the augmented reality content playback device 200 to the augmented reality content output in accordance with the augmented reality service provided by the augmented reality content playback device 200 When augmented reality content information is included, that is, augmented reality content information for augmented reality content (eg, photographed image + virtual object) according to the augmented reality implementation function performed in the augmented reality content playback device 200, A content information screen according to the augmented reality content information, that is, augmented reality content (eg, a photographed image + a virtual object) may be output to a display screen and / or a speaker.

In addition, the operation method of the terminal device 100 according to the present invention, within the augmented reality content output in accordance with the augmented reality service provided by the augmented reality content playback device 200 to the content provided from the augmented reality content playback device 200 When the virtual object related information corresponding to the rendered virtual object is included, the content information screen according to the virtual object related information, that is, the virtual object may be output to the display screen and / or the speaker.

And, in the operation method of the terminal device 100 according to the present invention, when the operation information for the augmented reality content is provided from the augmented reality content playback device 200 (S140), the augmented reality content or the augmentation based on the operation information The virtual object rendered in the real content may be changed and output (S150).

That is, in the method of operating the terminal device 100 according to the present invention, an augmented reality content (eg, a photographed image + a virtual object) or a virtual object is displayed on a display screen and / or based on the content provided from the augmented reality content playback device 200. While outputting to the speaker, if a corresponding operation information is provided from the augmented reality content playback apparatus 200, the augmented reality content (eg, a photographed image + a virtual object) or a virtual object is moved or rotated based on the provided operation information. Can be modified, enlarged, reduced, or printed.

In addition, the operation method of the terminal device 100 according to the present invention may provide the augmented reality content playback device 200 with the operation information according to the operation by the user (S160).

For example, the operation method of the terminal device 100 according to the present invention may be configured to output content information corresponding to content provided from the AR content playback device 200, that is, AR content or virtual object, to a display screen and / or a speaker. If a predetermined operation function is input by the user to move, rotate, reduce or enlarge the augmented reality content or the virtual object, the corresponding operation information is generated and provided to the augmented reality content playback device 200. can do.

Or, the operation method of the terminal device 100 according to the present invention, when the input information for display / output to the augmented reality content playback device 200 is input by the user, corresponding operation information (including input information) It can be generated and provided to the augmented reality content playback device 200.

Hereinafter, with reference to Figure 6 will be described in more detail the operation method of the augmented reality content playback device according to the present invention.

The operation method of the apparatus for reproducing augmented reality content 200 according to the present invention performs a preset augmented reality implementation function.

For example, in the method of operating the augmented reality content reproducing apparatus 200 according to the present invention, the designated specific photographing zone 1 is photographed and the print book 10 located in the corresponding photographing zone 1 is photographed (S200). . That is, in the method of operating the augmented reality content playback apparatus 200 according to the present invention, the unfolded pages of the print book 10 located in the specific photographing zone 1 may be photographed.

In addition, the operation method of the apparatus for reproducing augmented reality content 200 according to the present invention may analyze a photographed photographed image and perform a preset augmented reality implementation function corresponding to the analysis result (S210).

And, the operation method of the augmented reality content playback device 200 according to the present invention, when the terminal device 100 is connected for interworking with the augmented reality service, applied to the captured image according to performing the augmented reality implementation function of step S210 At least one of a first control operation for providing an augmented reality service for outputting an augmented reality content and a second control operation for providing a specific content corresponding to the augmented reality service to the connected terminal device 100 are performed.

In more detail, the operation method of the augmented reality content playback device 200 according to the present invention, when the augmented reality implementation function is performed to provide an augmented reality service based on the photographed image taken in step S210, linked by the user Check the setting state for the function (S220), if not set to use the augmented reality service performs the first control operation to output the augmented reality content according to the augmented reality implementation function output to the output unit 220 To provide (S290).

On the other hand, by checking the setting state for the interlocking function by the user (S220), if the preset state using the interlocking function, the operation method of the augmented reality content playback device 200 according to the present invention, the connected terminal device 100 Check the presence of (S230).

If the connected terminal device 100 does not exist as a result of checking whether there is a presence, the operation method of the augmented reality content playback device 200 according to the present invention searches for a terminal device that can be connected when the connection function is set to use (S250). The terminal list may be provided (S253) and a preset connection operation with the corresponding terminal selected by the user may be performed (S257).

That is, if the connected terminal device 100 does not exist, it is currently set to use the interworking function, so that the method for operating the augmented reality content playback device 200 according to the present invention may be connected to connect the terminal device for interworking. Search for the terminal device. In this case, the method of operating the augmented reality content playback apparatus 200 according to the present invention may search for terminal devices within a close range that can be communicated through wireless communication (eg, near field communication) such as Bluetooth and Wi-Fi. .

In addition, the operating method of the apparatus for reproducing augmented reality content 200 according to the present invention presents a terminal list indicating the searched at least one terminal device to the user so as to select the terminal device to which the user wants to connect. Thus, when a specific terminal device 100 is selected from the terminal list, the operation method of the augmented reality content playback device 200 according to the present invention, the terminal device by performing a preset connection operation with the selected terminal device 100 It may be connected to (100).

On the other hand, as a result of checking whether the existence of the step S230, if there is a connected terminal device 100, the operation method of the augmented reality content playback device 200 according to the present invention, whether to perform the interworking with the terminal device 100; By presenting an interlocking selection screen for inducing selection, the user may select whether to interwork with the corresponding terminal device 100.

Therefore, the operation method of the augmented reality content playback device 200 according to the present invention, according to the user's selection of whether or not interlocking with the terminal device 100 (S240), if the linkage is not selected by performing the first control operation to enhance To provide an augmented reality service to output the augmented reality content to the output unit 220 in accordance with the implementation of the reality (S290).

On the other hand, the operation method of the augmented reality content playback device 200 according to the present invention, according to the user's selection of whether or not interlocking with the terminal device 100 (S240), if the linkage is selected, the synchronization setting with the terminal device 100 In operation S260, the second control operation may be performed in the case of the normal synchronization setting state (S270), and resynchronization may be induced to the terminal device 100 in the abnormal synchronization setting state (S265).

That is, in the operating method of the augmented reality content playback device 200 according to the present invention, if the linkage is selected by the user as to whether or not the linkage with the terminal device 100, confirm the synchronization setting state with the currently connected terminal device 100. It is determined whether or not the normal synchronization setting state (S260).

Accordingly, when it is determined that the synchronization setting state is abnormal, the operation method of the augmented reality content playback device 200 according to the present invention may induce a resynchronization setting to the terminal device 100, thereby providing the above-described terminal. The synchronization with the terminal device 100 will be supported by performing the synchronization setting operation through the preset method with the device 100 (S265).

On the other hand, if it is determined that the synchronization setting state is a normal synchronization setting state, the operation method of the augmented reality content playback apparatus 200 according to the present invention, by performing the above-described second control operation specific content corresponding to the augmented reality service It may be provided to the terminal device 100 (S270).

That is, the operation method of the augmented reality content playback device 200 according to the present invention, in response to the augmented reality service according to the implementation of the augmented reality implementation function, the cover image and the book content information and book additional information for the print book (1) Book-related information including at least one of the following, page-related information including at least one of page image and page content information and page additional information on at least one specific page in the printed book 1, and augmented reality service The terminal apparatus 100 includes augmented reality content information on the augmented reality content output according to the present invention, virtual object related information corresponding to a virtual object rendered in the augmented reality content, and content including at least one of a specific augmented reality related application. ) Can be provided.

For example, the operation method of the augmented reality content playback device 200 according to the present invention, the printing according to the augmented reality implementation function performed to provide augmented reality service based on the photographed image of the print book 1, Cover image and book contents information (e.g. author related information, publication related information, plot related information, etc.) and additional book information (e.g. marker information, book review information, readership information, related other book information, etc.) ) May provide content including book related information including at least one of the terminal information to the terminal device 100.

In addition, the operation method of the augmented reality content playback device 200 according to the present invention, according to the augmented reality implementation function performed to provide an augmented reality service based on the photographed image of the print book (1), the print book ( 10) page-related information including at least one of page image and page content information (eg, page plot information, etc.) and page additional information (eg, page marker information, word-related information, etc.) for at least one specific page in the page. It may provide a content including the to the terminal device (100).

In addition, the operation method of the augmented reality content playback device 200 according to the present invention, augmented reality content function according to the implementation of the augmented reality to perform augmented reality service based on the photographed image of the print book 1, The terminal device 100 may provide augmented reality content information regarding a photographed image + a virtual object and / or content including a specific augmented reality related application.

In addition, the operation method of the augmented reality content playback device 200 according to the present invention, augmented reality content function according to the implementation of the augmented reality to perform augmented reality service based on the photographed image of the print book 1, The terminal apparatus 100 may provide the terminal apparatus 100 with content including virtual object related information corresponding to the virtual object to be rendered and / or a specific AR application.

Here, the specific augmented reality-related application, and then installed in the terminal device 100 to output the corresponding augmented reality content (eg, photographed image + virtual object) based on the augmented reality content information and / or virtual object related information and / Or it might be an application designed to output virtual objects.

In addition, the operation method of the apparatus for reproducing augmented reality content 200 according to the present invention may provide the terminal apparatus 100 with operation information according to an operation input by a user corresponding to the augmented reality service (S280).

That is, the operation method of the augmented reality content playback device 200 according to the present invention, the operation information (for example, as the print book 1 is moved or tilted or rotated by the user or moved away from the photographing unit 210 (for example: Actual coordinates and / or virtual coordinate change information), operation information according to marker recognition (e.g. marker response control information) set by a specific operation function, operation information (eg hand gesture response control information), etc. It may be provided to the terminal device (100).

Thus, as described above, the terminal device 100 outputs an augmented reality content (eg, a photographed image + a virtual object) or a virtual object to a display screen and / or a speaker based on the content provided from the augmented reality content playback device 200. Among the augmented reality content playback apparatus 200, the augmented reality content (e.g., photographed image + virtual object) or virtual object is moved or rotated, enlarged or reduced based on the operation information provided correspondingly. Can output

On the other hand, the operation method of the augmented reality content playback device 200 according to the above-described present invention, in addition to providing a specific content corresponding to the augmented reality service to the terminal device 100, the output unit augmented reality content The step S290 of providing an augmented reality service output to 220 may be performed in parallel.

In this case, while the augmented reality content playback device 200 provides an augmented reality service that outputs augmented reality content (eg, a photographed image + a virtual object), the content provided from the augmented reality content playback device 200, that is, a printed book ( Based on the augmented reality content information for the augmented reality content (for example, photographed image + virtual object) according to the unfolded page of 10), the augmented reality content (for example, photographed image + virtual object) is displayed on the terminal device 100. Can be.

And the operation method of the augmented reality content playback device 200 according to the present invention, it is determined whether the operation information is provided from the terminal device (100), if the operation information is provided based on the operation information augmented reality The execution of the augmented reality implementation function may be controlled to change and output the content or the virtual object rendered in the augmented reality content or the information screen according to the manipulation information may be output to the output unit 220 (S310).

For example, operation information for moving, rotating, reducing or enlarging the augmented reality content or the virtual object may be provided from the terminal device 100.

In this case, the operation method of the augmented reality content playback device 200 according to the present invention, the augmented reality content according to the augmented reality service provided by the augmented reality service control unit 230 based on the operation information (eg, photographed image + virtual object Or augmented reality service control unit 230 to control the performance of the augmented reality service control unit 230 to change / output by moving, rotating, reducing, or enlarging the virtual object.

Alternatively, operation information including input information for displaying / outputting from the terminal apparatus 100 to the augmented reality content playback apparatus 200 may be provided.

In this case, the operation method of the apparatus for reproducing augmented reality content 200 according to the present invention may output the information screen according to the input information included in the operation information to the output unit 220 based on the operation information.

As described above, the method for providing augmented reality service according to the present invention provides an augmented reality content playback device in a terminal device by supporting an interworking function between an augmented reality content playback device for providing an augmented reality service and a terminal device having mobility. It is possible to output / display various contents information corresponding to the augmented reality service, and to operate / inform the augmented reality content playback device through an operation on a terminal device, thereby providing augmented reality service in a more expanded and new form. Content information can be provided through a separate terminal device of mobility and the operation range can be extended.

Although the present invention has been described in detail with reference to preferred embodiments, the present invention is not limited to the above-described embodiments, and the technical field to which the present invention belongs without departing from the gist of the present invention as claimed in the following claims. Anyone skilled in the art will have the technical idea of the present invention to the extent that various modifications or changes are possible.

Supports the interworking function between the augmented reality content playback device that provides augmented reality service and the terminal device having mobility so that the terminal device can output / display various contents information corresponding to the augmented reality service provided by the augmented reality content playback device. Thus, in the case of applying the augmented reality service providing system and method for providing augmented reality service to provide a more expanded and new type of content information for books and augmented reality content through a separate terminal device of mobility, In terms of diversity expansion and user satisfaction, it is possible to make a great progress, and there is not only sufficient possibility of marketing or sales of the applied augmented reality content playback device and terminal device and service solution, but also it can be clearly implemented in reality.

10: printed book
100: terminal device
200: augmented reality content playback device

Claims (24)

A terminal device for outputting content information according to content provided from a connected external device; And
Providing an augmented reality service for outputting augmented reality content in accordance with a predetermined augmented reality implementation function, when the terminal device is connected to the augmented reality service linked to the specific content corresponding to the augmented reality service to the terminal device; Augmented reality content providing device comprising augmented reality content playback device providing. Connection support unit for supporting the connection with the external augmented reality content playback device;
Installation function unit for installing a specific augmented reality-related applications; And
Interworking to output the content information according to the content provided from the augmented reality content playback device through the connection support unit, and to control the installation function to install the augmented reality-related application when the augmented reality-related applications in the content is included. Terminal device comprising a control unit. The method of claim 2,
The interlocking control unit,
The terminal device characterized in that the augmented reality content information is included in the content provided from the augmented reality content playback device to drive the augmented reality-related application to output the augmented reality content according to the augmented reality content information . The method of claim 2,
The interlocking control unit,
And when the operation information on the augmented reality content is provided from the augmented reality content reproducing apparatus, changing and outputting the augmented reality content or a virtual object rendered in the augmented reality content based on the operation information. The method according to any one of claims 2 to 4,
The interlocking control unit,
Terminal device characterized in that for providing the operation information according to the operation by the user to the augmented reality content playback device. An augmented reality service control unit for providing an augmented reality service for outputting an augmented reality content to an output unit when performing a preset augmented reality implementation function; And
When the terminal device is connected for interworking with the augmented reality service, the first control operation for controlling the augmented reality service control unit to provide the augmented reality service and specific content corresponding to the augmented reality service to the terminal device connected to the augmented reality service. An augmented reality content playback device, characterized in that it comprises an interlocking control unit for performing at least one control operation of the second control operation. The method according to claim 6,
The interlocking control unit,
When the augmented reality service is performed by the augmented reality service control unit to provide the augmented reality service, the user selects whether to interwork with the corresponding terminal device if the connected terminal device exists by checking whether the connected terminal device exists. And reproducing the first control operation or the second control operation. The method of claim 7, wherein
The interlocking control unit,
When augmented reality service interworking is selected according to a user's selection of interworking with the terminal device, the synchronization setting state with the terminal device is checked and the second control operation is performed when the synchronization setting state is normal. And a resynchronization setting is induced to the terminal device in the synchronization setting state. The method according to claim 6,
The interlocking control unit,
If the connected terminal device does not exist by checking the existence of the connected terminal device, if it is set to the use of the interworking function, the terminal device is searched for and provides a terminal list accordingly, and the terminal device is selected by the user. Augmented reality content playback device characterized in that for performing a preset connection operation. 10. The method according to any one of claims 6 to 9,
The interlocking control unit,
In response to the augmented reality service, book-related information including at least one of a cover image, book content information, and book additional information of a printed book to be photographed, a page image of at least one specific page in the printed book, Corresponds to page-related information including at least one of page content information and page additional information, augmented reality content information of the augmented reality content output according to the augmented reality service, and a virtual object rendered in the augmented reality content An apparatus for reproducing augmented reality contents, comprising: providing the terminal apparatus with the contents including at least one of virtual object related information and a specific augmented reality related application. The method of claim 10,
The interlocking control unit,
Augmented reality content playback device characterized in that for providing the terminal device with operation information according to the operation input in response to the augmented reality service. 10. The method according to any one of claims 6 to 9,
The interlocking control unit,
When the manipulation information is provided from the terminal device, the augmented reality service control unit controls the augmented reality service control unit to output the augmented reality content or a virtual object rendered in the augmented reality content based on the manipulation information, or the information screen according to the manipulation information. Augmented reality content playback device characterized in that it outputs to the output unit. Providing an augmented reality service for outputting an augmented reality content according to a predetermined augmented reality implementation function performed by an augmented reality content reproducing apparatus;
Providing a specific content corresponding to the augmented reality service by the augmented reality content playback device when the terminal device is connected to the augmented reality service for interworking; And
And outputting, by the terminal device, content information according to content provided from the augmented reality content playback device. A connection supporting step connected to an external augmented reality content playback device;
An application installation step of installing the augmented reality related application when the augmented reality related application is included in the content provided from the augmented reality content playback device; And
And a content outputting step of outputting content information according to the content. 15. The method of claim 14,
The content output step,
When the content provided from the augmented reality content playback device includes a specific augmented reality content information, the terminal characterized in that for outputting the augmented reality content according to the augmented reality content information by running the augmented reality-related application How the device works. 15. The method of claim 14,
If the augmented reality content playback device is provided with the operation information on the augmented reality content, the step of changing the output augmented reality content or a virtual object rendered in the augmented reality content based on the operation information further comprises the step of outputting. Method of operation of the terminal device. 17. The method according to any one of claims 14 to 16,
And providing the operation information according to the operation by the user to the augmented reality content reproducing apparatus. Performing an augmented reality function to perform a preset augmented reality implementation function; And
A first control operation for providing an augmented reality service for outputting an augmented reality content according to the execution of the augmented reality implementation function and a specific content corresponding to the augmented reality service when the terminal device is connected to the augmented reality service for interworking; And an interlocking control step of performing at least one control operation among the second control operations provided to the connected terminal device. The method of claim 18,
The interlocking control step,
When the preset augmented reality implementation function is performed, the first control operation or the second control is performed according to a user's selection of whether or not interworking with the corresponding terminal device when the connected terminal device exists. Method of operation of augmented reality content playback device, characterized in that to perform the operation. The method of claim 19,
The interlocking control step,
When augmented reality service interworking is selected according to a user's selection of interworking with the terminal device, the synchronization setting state with the terminal device is checked and the second control operation is performed when the synchronization setting state is normal. And in a synchronization setting state, induces resynchronization to the terminal device. The method of claim 19,
The interlocking control step,
If the connected terminal device does not exist by checking the existence of the connected terminal device, if it is set to the use of the interworking function, the terminal device is searched for and provides a terminal list accordingly, and the terminal device is selected by the user. Operating method of the augmented reality content playback device, characterized in that for performing a preset connection operation. 22. The method according to any one of claims 19 to 21,
Content corresponding to the augmented reality service,
In response to the augmented reality service, book-related information including at least one of a cover image, book content information, and book additional information of the photographed printed book, a page image of at least one specific page in the printed book, Corresponds to page-related information including at least one of page content information and page additional information, augmented reality content information of the augmented reality content output according to the augmented reality service, and a virtual object rendered in the augmented reality content And a virtual object related information and at least one of a specific augmented reality related application. The method of claim 22,
And providing the terminal device with operation information according to an operation input by a user input in correspondence to the augmented reality service. 22. The method according to any one of claims 19 to 21,
When the operation information is provided from the terminal device, the execution of the augmented reality implementation function is controlled to output the augmented reality content or the virtual object rendered in the augmented reality content based on the operation information, or the information according to the operation information. Operation method of the augmented reality content playback device further comprising the step of outputting a screen.

Images