KR20130047148A - Method and system for providing content in augmented reality - Google Patents

Abstract

PURPOSE: A method for providing augmented reality content and a digital device for the same are provided to display augmented reality content even offline, to minimize the quantity of data required for making augmented reality, and to display the augmented reality content in various ways. CONSTITUTION: A control unit controls a touch screen to display an image photographed and generated by a photographing unit(S210). If a QR code exists in the image photographed in step S210, the control unit extracts the QR code from the photographed image(S230). The meta-information in the QR code includes frame information and content information. The control unit obtains the frame information and the content information by parsing the meta-information extracted from the QR code in step S230(S240). The control unit generates a frame based on the frame information obtained in step S240, overlaps the frame on the image generated by the photographing unit, and displays the overlapped image on the touch screen(S250). The control unit generates content based on the content information obtained in step S240, adds the content in the frame, and provides the content frame as a virtual object in augmented reality(S260). [Reference numerals] (AA) Start; (BB) End; (S210) Photograph/display an image; (S220) QR code exists in the photographed image?; (S230) Extract the QR code from the photographed image; (S240) Parse meta-information recorded in the extracted QR code to obtain frame information and content information; (S250) Generate a frame based on the obtained frame information to be overlapped and displayed on an image photographed; (S260) Generate content based on the obtained content information to be added in the frame

Description

Method for providing content in augmented reality and electronic device applying the same {Method and system for providing content in augmented reality}

The present invention relates to an augmented reality providing method and an electronic device to which the same is applied. More particularly, the present invention relates to a method of providing information useful as a content in an augmented reality as a virtual object and an electronic device to which the same is applied.

Augmented reality is a technique of superimposing a virtual object in the real space, and is performed by a process of recognizing a marker in the real space and expressing the virtual object on the recognized marker. Exposed virtual objects are stored on a remote server.

Therefore, in order to implement augmented reality, a terminal providing augmented reality must access a remote server through a wired / wireless network and receive a virtual object from the connected server.

Such a network-based implementation of augmented reality has the advantage that it is possible to secure the diversity of virtual objects, but there is a disadvantage that it is impossible or difficult to implement augmented reality in places where the network is unavailable or difficult.

The present invention has been made to solve the above problems, an object of the present invention is to provide a method that can provide augmented reality even offline.

Another object of the present invention is to provide a method for minimizing the capacity of data to be delivered for augmented reality and providing a variety of expression methods, even if augmented reality is provided through online.

According to an embodiment of the present invention, a content frame providing method includes: displaying a captured image; Extracting code information from the captured image; Acquiring frame information and content information using the code information; Generating a frame based on the frame information and superimposing the captured image on the captured image; And generating content based on the content information and adding the content to the frame.

Frame information and content information may be included in the code information.

In addition, the frame may be generated using at least one of pre-stored objects and images.

The content may be generated using at least one of pre-stored text and images.

The frame information may include information about the type of the frame, information about the size of the frame, information about the color of the frame, information about the position of the frame, information about the rotation angle of the frame, and the frame. It may include at least one of information about the visual effect of.

The size of the frame may be a relative size to the size of the code information.

The position of the frame may be a relative position based on the position of the code information.

The content may be text, and the content information may include information about the content of the text, information about a location of the text, information about a font of the text, information about the size of the text, and color of the text. Information about the information, information on the alignment of the text, information about the visual effect of the text and information about the scroll of the text may be included.

In addition, the position of the text may be a relative position with respect to the position of the frame.

The content may be an image, and the content information may include at least one of an image file name, an image file format, an image file, a URL at which the image is located, information about the location of the image, and information about the size of the image. have.

The position of the image may be a relative position with respect to the position of the frame, and the size of the image may be a relative size with respect to the size of the frame.

The acquiring step may include: accessing a server by referring to the code information; And receiving the frame information and the content information from the server.

The code information may be a Quick Response (QR) code.

On the other hand, according to another embodiment of the present invention, an electronic device includes a display that displays a photographed image; And acquiring frame information and content information using code information extracted from the captured image, generating a frame based on the frame information, generating content in the frame based on the content information, and adding content. And a controller which superimposes the captured frame on the captured image.

On the other hand, the content providing method according to another embodiment of the present invention, the step of displaying the captured image; Extracting code information from the captured image; Acquiring content information using the code information; And generating content based on the content information and superimposing the captured image on the captured image.

As described above, according to the present invention, it is possible to provide augmented reality even in the offline where the content can not be downloaded, thereby to break down the local restrictions to implement augmented reality.

In particular, since the information about the virtual object simplified by the object and text can be included in the QR code and included in the QR code, augmented reality can be provided at a high speed even without a network connection.

In addition, since the QR code can be used as a marker, a process for extracting / designating a marker can be omitted, thereby simplifying an application.

1 is a block diagram of a smartphone, according to an embodiment of the present invention;
FIG. 2 is a flowchart provided to explain a method of generating a content frame and providing the content frame to a virtual object in augmented reality by the smartphone shown in FIG. 1;
3 is a diagram illustrating a result of displaying an image captured on a touch screen as a result of performing step S210 of FIG. 2;
4 is a diagram illustrating a result of generating a frame based on frame information through step S250 of FIG. 2;
FIG. 5 is a diagram illustrating a result of adding content, generated based on content information, to a frame through step S260 of FIG. 2;
FIG. 6 is a diagram illustrating a result of providing Chinese guidance text to a transparent frame; FIG.
7 is a view showing a result of providing a Japanese language notice in a transparent frame;
8 is a view showing a result of providing a product usage guide using a transparent frame;
9 illustrates a frame having a three-dimensional shape;
10 is a diagram showing a content frame providing system according to another embodiment of the present invention;
FIG. 11 is a view provided to explain a process of providing a content frame to the virtual object in the augmented reality by the content frame providing system shown in FIG. 10.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

In the embodiments of the present invention, a content frame is generated by using meta information contained in a Quick Response (QR) code, and the generated content frame is provided to the virtual object in Augmented Reality.

Here, the content frame is a frame in which the content is shown, and will be described later, but there is no restriction on the format of the frame and the content of the content. Frames and content may be received online from a server accessible via a network, but may be generated offline without a server.

1 is a block diagram of a smartphone according to an embodiment of the present invention. Smartphone 100 according to an embodiment of the present invention, as shown in Figure 1, the communication unit 110, the photographing unit 120, the control unit 130, the touch screen 140 and the storage unit 150 It is provided.

The communication unit 110 communicates with a base station through a mobile communication network and communicates with an external device through a wireless network. The photographing unit 120 generates an image through photographing.

The touch screen 140 functions as a display that displays an image photographed by the photographing unit 120 and a processing result by the controller 130 to be described later, and receives a user command through a touch method to the controller 130. It also functions as a user input means for delivery.

The storage unit 150 is a storage medium in which programs and data necessary for operating the smartphone 100 are stored. In particular, the storage unit 150 stores various objects to be used as frames.

The controller 130 controls the overall operation of the smartphone 100. In particular, the controller 130 generates a content frame using the meta information contained in the QR code shown in the image generated by the photographing unit 120, and adds the generated content frame to the image generated by the photographing unit 120. It is displayed on the touch screen 140.

Hereinafter, a process of providing a content frame to augmented reality will be described in detail with reference to FIG. 2. FIG. 2 is a flowchart provided to explain a method in which the smartphone 100 illustrated in FIG. 1 generates a content frame and provides the content frame to the virtual object in augmented reality.

As shown in FIG. 2, first, the controller 130 controls the image generated by the photographing unit 120 to be displayed on the touch screen 140 (S210). If a QR code exists in the image photographed at step S210 (S220-Y), the controller 130 extracts the QR code from the captured image (S230).

The meta information contained in the QR code includes frame information and content information. The controller 130 parses the meta information of the QR code extracted in step S230 to obtain frame information and content information (S240).

Hereinafter, the frame and the content will be described in detail.

1) frame

The 'frame' refers to a frame in which the content appears, and the frame information includes frame type information, frame color information, frame position information, frame size information, frame rotation angle information, and frame visual effect information.

The frame type specifies objects of different shapes / shapes, such as rectangles, circles, rectangles with rounded corners, and the like.

The frame color can be colored as well as colorless (transparent). Since the colorless frame cannot be seen by the user's eyes, when the colorless frame is generated, only the content is visible to the user's eyes.

The frame position may be designated as a relative position with respect to the position of the QR code. For example, the frame position may be specified such that the center of the frame coincides with the center of the QR code, or the frame position may be specified such that the top & left edge of the frame coincides with the top & left edge of the QR code.

The frame size may be specified as a relative size to the size of the QR code. For example, the frame width may be twice the length of the QR code and the frame length may be specified as twice the length of the QR code, or the frame diagonal may be specified as 1.5 times the length of the QR code.

The frame rotation angle is a rotation angle based on a specific point of the QR code. For example, the frame rotation angle may be specified such that the frame rotates 30 ° about the center of the QR code, or the frame rotation angle may be specified so that the frame rotates 45 ° about the top & left edges of the QR code.

The frame visual effect refers to a visual effect such as a texture of a frame and a three-dimensional effect.

2) contents

In this embodiment, the content is assumed to be text. In this case, the content information (text information) includes text content information, text position information, text font information, text size information, text color information, text paragraph information, text visual effect information, text scroll information, and the like.

The text content refers to a combination having meanings such as letters, numbers, and symbols constituting the text.

The text position may be designated as a relative position with respect to the position of the frame. For example, the text may be positioned so that the text starts one point from the top of the frame and one point from the left.

Text alignment refers to how text is aligned within a frame such as left justification, center alignment, and the like.

Text visual effects are visual representations of text, such as bold, italics, underlines, and flashing.

Text scrolling indicates whether scrolling should be used if the text content cannot all be arranged in a frame.

Again, this will be described in detail with reference to FIG. 2.

The controller 130 generates a frame based on the frame information obtained in operation S240, and superimposes the image on the touch screen 140 generated by the photographing unit 120 (S250).

Thereafter, the controller 130 generates the content based on the content information obtained in step S240, adds the generated content to the frame, and provides the content frame as a virtual object of the augmented reality (S260).

In FIG. 3, an image photographed as a result of performing step S210 of FIG. 2 is displayed on the touch screen 140. As shown in FIG. 3, it can be seen that the QR code 210 exists in the captured image. As described above, the QR code 210 includes meta information including frame information and content information.

4 illustrates a result of generating a frame based on the frame information through step S250 of FIG. 2. The frame generation in operation S250 is performed by processing an object stored in the storage 150 with a graphic tool. Therefore, the data capacity of the frame information is not large.

FIG. 5 illustrates a result of adding the content 230 generated in the frame 220 based on the content information through step S260 of FIG. 2. Since the content added to the frame in step S260 is text, the data capacity of the content information is not large.

As shown in FIG. 5, it can be seen that the content frame in which the Chinese guide for the Korean guide "step stairs" (see FIG. 3), which was actually printed on the guide sign, was provided as a virtual object of augmented reality.

Meanwhile, the frame color may be colorless (transparent), and in this case, the user may view only the content on the touch screen 140. 6 shows a result of providing a Chinese guidance text using a transparent frame.

Meanwhile, the text content information may include a plurality of contents, and the smartphone 100 may add one of them in a frame. For example, when the text content includes an English guide, a Chinese guide, and a Japanese guide, the controller 130 of the smartphone 100 may add one guide to the frame according to the language setting.

That is, when the language of use of the smartphone 100 is set to Chinese, the controller 130 adds a Chinese guide letter in the transparent frame as shown in FIG. 6, but when the language of use of the smartphone 100 is set to Japanese, the controller 130 130 may be implemented to add Japanese announcements into the transparent frame as shown in FIG.

8 illustrates a case in which a product usage guide is provided using a transparent frame, and FIG. 9 illustrates a frame having a three-dimensional shape.

In FIG. 2, it is assumed that the content is text. As shown in FIG. 9, the content may be implemented as an image.

In this case, the image may be embodied as being stored in the storage unit 150. In this case, the content information (image information) may include an image file name and an image file format (for example, png, gif, jpg, bmp, etc.) stored in the storage unit 150. ), Image location information, image size information, and the like.

Even in this case, the image position may be designated as a relative position with respect to the frame position, and the size of the image may be designated as a relative size with respect to the size of the frame.

On the other hand, it is also possible to record an image file in content information (image information). In this case, the capacity of the image file should be limited to less than the available capacity contained in the meta information of the QR code.

On the other hand, the image may be implemented by being stored in a content server (not shown). In this case, the content information (image information) includes a Uniform Resource Locator (URL), image location information, image size information, etc., of the content server where the image is located. May be included. In this case, it is also possible to use a video instead of an image as the content.

In addition, in FIG. 2, it is assumed that the frame is generated by processing an object stored in the storage 150, and the frame may also be implemented as an image. In this case, the image to be used as a frame may be implemented as an image stored in the storage unit 150, an image recorded in frame information, an image stored in a content server (not shown), and the like, as the image to be used as content.

Hereinafter, another embodiment of providing a content frame as a virtual object in augmented reality will be described in detail.

10 is a diagram illustrating a content frame providing system according to another embodiment of the present invention. As shown in FIG. 10, the content frame providing system is constructed by connecting the smartphone 100, the AR (Augmented Reality) server 400, and the content server 500 to communicate with each other.

In the content frame providing system illustrated in FIG. 10, the meta information including the frame information and the content information is not stored in the QR code but is held in the AR server 400. Instead, the QR code contains the URL and code-ID of the AR server 400.

Hereinafter, a process of providing the content frame to the virtual object in the augmented reality by the content frame providing system illustrated in FIG. 10 will be described in detail with reference to FIG. 11.

As shown in FIG. 11, the smartphone 100 displays an image generated through photographing (S310), and if a QR code exists in the image photographed through S310 (S320 -Y), the smartphone 100. ) Extracts a QR code from the captured image (S330).

As described above, since the URL and the code-ID of the AR server 400 are recorded in the QR code, the smartphone 100 obtains the URL and the code-ID of the AR server 400 from the QR code (S340). .

Thereafter, the AR server 400 is connected to the AR server 400 by referring to the URL of the AR server 400, and the meta-information is received in response thereto (S350).

The meta information received in operation S350 includes frame information and content information. The smartphone 100 parses the meta information received in step S350 to obtain frame information and content information (S360).

Subsequently, the smartphone 100 generates a frame based on the frame information obtained in step S360, displays the image superimposed on the captured image (S370), and generates content based on the content information obtained in step S360. In addition to the frame, the content frame is provided as a virtual object of augmented reality (S380).

There is no restriction on the frame generation method in step S370. In other words, all of the aforementioned schemes can be used. Specifically, it is possible not only to process and create an object stored in the smartphone 100, it is also possible to create using the image, the image is stored in the smartphone 100, the image contained in the meta information, All images downloaded from the content server 500 are possible.

In addition, there is no restriction on the content generation method in step S380. In other words, all of the aforementioned schemes can be used. In detail, the smartphone 100 may not only generate content from the text, but also use the image to generate the content. The image may be an image stored in the smartphone 100, an image included in meta information, or a content server ( All images downloaded from 500 are available.

So far, the method and system for generating a content frame offline and providing the virtual object in augmented reality have been described in detail with reference to preferred embodiments.

Since the QR code mentioned in the above embodiment is just an example of a code, it may be replaced with another kind of code, for example, a barcode.

In addition, the smartphone 100 mentioned in the above embodiment also corresponds to an example of an electronic device capable of implementing augmented reality. Therefore, the technical spirit of the present invention may be applied to all other electronic devices capable of implementing augmented reality in addition to the smartphone 100.

Meanwhile, in the above embodiment, the content frame provided to the virtual object through augmented reality is only a preferred embodiment. Therefore, it is also possible to provide only the content as a virtual object in augmented reality without a frame. In this case, only the content information may be included in the meta information without the frame information. At this time, the content position is preferably specified as a relative position based on the position of the QR code, not the position of the frame.

It goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium having a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present disclosure may be implemented in the form of computer readable codes recorded on a computer readable recording medium. The computer-readable recording medium is any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. In addition, the computer readable code or program stored in the computer readable recording medium may be transmitted through a network connected between the computers.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

100: smartphone 110: communication unit
120: recording unit 130: control unit
140: touch screen 150: storage unit

Claims (15)

Displaying a captured image;
Extracting code information from the captured image;
Acquiring frame information and content information using the code information;
Generating a frame based on the frame information and superimposing the captured image on the captured image; And
Generating content based on the content information and adding the content to the frame;
The method of claim 1,
Frame information and content information,
Content frame providing method, characterized in that contained in the code information.
The method of claim 1,
The frame includes:
Method for providing a content frame, characterized in that generated using at least one of the pre-stored object and image.
The method of claim 3, wherein
The content may include:
Method for providing a content frame, characterized in that it is generated using at least one of pre-stored text and images.
The method of claim 1,
The frame information,
Among the information about the type of the frame, information about the size of the frame, information about the color of the frame, information about the position of the frame, information about the rotation angle of the frame, information about the visual effect of the frame Content frame providing method comprising at least one.
6. The method of claim 5,
The size of the frame,
And a size relative to the size of the code information.
6. The method of claim 5,
The position of the frame,
And a relative position based on the position of the code information.
The method of claim 1,
The content is text,
The content information,
Information on the content of the text, information on the position of the text, information on the font of the text, information on the size of the text, information on the color of the text, information on the alignment of the text, the text And at least one of information on visual effects of the text and information on scrolling of the text.
The method of claim 8,
The text is located at
Content frame providing method, characterized in that the relative position with respect to the position of the frame.
The method of claim 1,
The content is an image,
The content information,
And at least one of an image file name, an image file format, an image file, a URL at which the image is located, information about the location of the image, and information about the size of the image.
The method of claim 10,
The location of the image is
Relative position relative to the position of the frame,
The size of the image,
Content frame providing method characterized in that the relative size to the size of the frame.
The method of claim 1,
The acquiring step includes:
Accessing a server by referring to the code information; And
Receiving the frame information and the content information from the server; Content frame providing method comprising a.
The method of claim 1,
The code information,
Content frame providing method characterized in that the Quick Response (QR) code.
A display on which the captured image is displayed; And
Obtain frame information and content information using code information extracted from the photographed image, generate a frame based on the frame information, generate content in the frame based on the content information, and add content. And a controller which superimposes a frame on the captured image.
Displaying a captured image;
Extracting code information from the captured image;
Acquiring content information using the code information; And
Generating content based on the content information and superimposing the captured image on the photographed image to display the content.

Images