KR20190101228A - Method, system and non-transitory computer-readable recording medium for providing contents associated with an object - Google Patents

Abstract

According to one aspect of the present invention, a method for providing content associated with an object comprises the following steps: obtaining an image including at least one object from a device of a user; specifying a target object corresponding to a shape and a marker of the object included in the obtained image; and providing content associated with the specified target object to the device based on at least one of augmented reality and virtual reality.

Description

METHOD, SYSTEM AND NON-TRANSITORY COMPUTER-READABLE RECORDING MEDIUM FOR PROVIDING CONTENTS ASSOCIATED WITH AN OBJECT}

The present invention relates to a method, system and non-transitory computer readable recording medium for providing content associated with an object.

In recent years, as interest in Augmented Reality (AR) or Virtual Reality (VR) increases, research and development are being actively conducted on technologies for providing content based on the AR.

In this regard, as an example of the related art, when a list including a plurality of virtual reality contents is provided to a user, and one of the plurality of virtual reality contents included in the list is selected by a key operation of the user, the virtual A device for providing a virtual reality service that provides reality content to a corresponding user but also provides water injection, wind generation, and oxygen generation associated with the content has been introduced.

However, according to the above-described prior arts and the related arts, only a content selected by a user from among a plurality of virtual reality contents in a list is provided, and any object in the real world or the virtual world is recognized and the object is recognized. It was not able to actively provide related contents.

Accordingly, the present inventors propose a technique for recognizing a shape and a marker of an object included in an image, specifying a target object, and providing augmented reality or virtual reality-based content related to the target object.

The present invention aims to solve all of the above-mentioned problems of the prior art.

In addition, the present invention is to provide a content associated with the object by recognizing the shape and the marker of the object.

In addition, another object of the present invention is to provide content such as a guide on an object on an augmented reality or virtual reality basis.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, a method for providing content associated with an object, the method comprising: obtaining an image including at least one object from a user's device, a shape of an object included in the obtained image, and a marker of the object ( specifying a target object corresponding to a marker), and providing content associated with the specified target object to the device based on at least one of augmented reality and virtual reality.

According to another aspect of the present invention, a method for providing content associated with an object, comprising: an image obtaining unit obtaining an image including at least one object from a user's device, the shape of the object included in the obtained image and the object A system includes a target object specifying unit specifying a target object corresponding to a marker, and a content providing unit providing content to the device based on at least one of augmented reality or virtual reality associated with the specified target object. do.

In addition, there is further provided a non-transitory computer readable recording medium for recording another method for implementing the present invention, another system, and a computer program for executing the method.

According to the present invention, it is possible to recognize the shape of the object and the marker to provide content associated with the object.

According to the present invention, it is possible to provide content such as a guide on an object on the basis of augmented reality or virtual reality.

1 is a view showing a schematic configuration of an entire system for providing content associated with an object according to an embodiment of the present invention.
2 is a diagram showing in detail the internal configuration of the content providing system according to an embodiment of the present invention.
3 is a diagram illustrating a situation in which content associated with an object is provided according to an embodiment of the present invention.

DETAILED DESCRIPTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented with changes from one embodiment to another without departing from the spirit and scope of the invention. In addition, it is to be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be taken as encompassing the scope of the claims of the claims and all equivalents thereto. Like reference numerals in the drawings indicate the same or similar elements throughout the several aspects.

Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

In the present specification, content is a concept that collectively refers to digital information or individual information elements composed of letters, codes, voices, sounds, images, moving pictures, and the like, accessible through a communication network. Such content may include, for example, data such as text, images, video, audio, links (eg, web links), or a combination of at least two of these data.

Configuration of the entire system

1 is a view showing a schematic configuration of an entire system for providing content associated with an object according to an embodiment of the present invention.

As shown in FIG. 1, the entire system according to an embodiment of the present invention may include a communication network 100, a content providing system 200, and a device 300.

First, according to an embodiment of the present invention, the communication network 100 may be configured regardless of a communication mode such as wired communication or wireless communication, and may include a local area network (LAN) and a metropolitan area network (MAN). Network, a wide area network (WAN), and the like. Preferably, the communication network 100 as used herein may be a known Internet or World Wide Web (WWW). However, the communication network 100 may include, at least in part, a known wired / wireless data communication network, a known telephone network, or a known wired / wireless television communication network without being limited thereto.

For example, the communication network 100 is a wireless data communication network, including Wi-Fi communication, Wi-Fi Direct communication, Long Term Evolution (LTE) communication, Bluetooth communication (more specifically, low power Bluetooth). (BLE; Bluetooth Low Energy), infrared communication, ultrasonic communication, and the like may be implemented at least in part.

Next, the content providing system 200 according to an embodiment of the present invention obtains an image including at least one object from the device 300 to be described later through the communication network 100, the obtained image Specifying a target object corresponding to the shape of the object included in the object and a marker of the object, and providing the content associated with the specified target object to the corresponding device 300 based on at least one of augmented reality and virtual reality. Function can be performed.

Meanwhile, according to an embodiment of the present invention, such an object may be a real object (ie, a general object having a predetermined physical position in the real world, for example, a fire extinguisher, a card, etc.) in the real world, It may be a concept that includes virtual objects that may exist or may be augmented, mixed, or merged with respect to the real world.

The function of the content providing system 200 will be described in more detail below. Meanwhile, although described above with respect to the content providing system 200, this description is exemplary, and at least some of the functions or components required for the content providing system 200 may be included in an external system (not shown) as necessary. It will be apparent to those skilled in the art that the present invention may be implemented in or included in an external system.

Next, the device 300 according to an embodiment of the present invention is a digital device that includes a function for enabling communication after connecting to the content providing system 200 through a communication network, such as a smartphone or a tablet PC. As long as a portable digital device having a memory means and a microprocessor equipped with arithmetic capability can be adopted as the terminal 300 according to the present invention.

In addition, the device 300 according to an embodiment of the present invention may further include an imaging module (not shown) for acquiring an image including at least one object.

Meanwhile, the device 300 according to an embodiment of the present invention may include an application for providing content associated with an object according to the present invention. Such an application may be downloaded from the content providing system 200 or an external application distribution server (not shown).

Composition of Content Delivery System

Hereinafter, the internal configuration of the content providing system 200 performing important functions for the implementation of the present invention and the function of each component will be described.

2 is a diagram illustrating in detail the internal configuration of the content providing system 200 according to an embodiment of the present invention.

As shown in FIG. 2, the content providing system 200 according to an exemplary embodiment of the present invention may include an image obtaining unit 210, a target object specifying unit 220, a content providing unit 230, and a communication unit 240. And a controller 250. According to an embodiment of the present invention, the image acquisition unit 210, the target object specifying unit 220, the content providing unit 230, the communication unit 240 and the control unit 250 is at least a part of the external system and It may be a program module that communicates. Such program modules may be included in the content providing system 200 in the form of an operating system, an application module, or other program modules, and may be physically stored in various known storage devices. In addition, such a program module may be stored in a remote storage device that can communicate with the content providing system 200. On the other hand, such program modules include, but are not limited to, routines, subroutines, programs, objects, components, data structures, etc. that perform particular tasks or execute particular abstract data types, described below, in accordance with the present invention.

First, the image acquisition unit 210 according to an embodiment of the present invention may perform a function of acquiring an image including at least one object from the user's device 300.

For example, according to an embodiment of the present disclosure, the device 300 of the user may capture an image including at least one object according to the user's image capturing command, and the image acquisition unit 210 may correspond to the user. The photographed image may be obtained from the device 300.

For another example, according to an embodiment of the present invention, an external system (not shown, for example, a camera) in which the user's device 300 is connected to the user's device 300 through the communication network 100. Module) may receive an image including at least one object, and the image acquirer 210 may obtain the received image from the device 300 of the corresponding user.

Next, the target object specifying unit 220 according to an embodiment of the present invention specifies the target object corresponding to the shape of the object included in the image acquired by the image obtaining unit 210 and the marker of the object. To perform the function. According to an embodiment of the present invention, such a target object may refer to an object determined to be provided by the user based on at least one of augmented reality and virtual reality according to the present invention. According to an embodiment of the present invention, the marker may be various within the scope of achieving the object of the present invention, such as an optical (eg, infrared) marker, a magnetic marker, an ultrasonic wave marker, and the like. Types of markers can be used.

For example, the target object specifying unit 220 according to an embodiment of the present invention, to specify the shape of the object from the image above, and to specify the marker included in the shape of the object from the shape of the specified object. Can be. The target object specifying unit 220 according to an embodiment of the present invention uses the information on the shape and the marker of the object specified above to match the information on the shape and the marker, or the target object having a degree of similarity or higher than a predetermined level. Can be specified. According to an embodiment of the present disclosure, the target object specifying unit 220 may further refer to a lookup table (not shown) regarding objects corresponding to a plurality of shapes or a plurality of markers. Meanwhile, according to one embodiment of the present invention, the target object specifying unit 220, in specifying the target object using the information on the marker of the above object, in the size of the marker, the type of the marker, the object Information about the location (or arrangement) of the corresponding marker may be further referred to.

In addition, the target object specifying unit 220 according to an embodiment of the present invention verifies whether the target object is correctly specified by comparing the shape of the object and the target object specified in correspondence with each of the markers of the object. can do.

For example, the target object specifying unit 220 according to an embodiment of the present invention specifies a first target object corresponding to the shape of the object, specifies a second target object corresponding to the marker of the object, and By comparing the first target object of and the second target object of each, and analyzing the match or similarity, it is possible to verify whether the target object is specified correctly.

Next, the content providing unit 230 according to an embodiment of the present invention is based on at least one of augmented reality or virtual reality associated with the target object specified by the target object specifying unit 220 of the user's device 300 You can perform the functions provided to).

For example, the content providing unit 230 according to an exemplary embodiment of the present invention may use a guide (for example, description of use of the target object) associated with the target object as content based on at least one of augmented reality or virtual reality. May be provided to the device 300.

Next, the communication unit 240 according to an embodiment of the present invention performs a function to enable data transmission / reception from / to the image acquisition unit 210, the target object specifying unit 220, and the content providing unit 230. can do.

Finally, the controller 250 according to an embodiment of the present invention controls the flow of data between the image acquisition unit 210, the target object specifying unit 220, the content providing unit 230, and the communication unit 240. Can be performed. That is, the controller 250 according to the present invention controls the data flow from / to the outside of the content providing system 200 or the data flow between each component of the content providing system 200, thereby obtaining the image obtaining unit 210, The target object specifying unit 220, the content providing unit 230, and the communication unit 240 may each control to perform a unique function.

3 and 4 exemplarily illustrate situations in which content associated with an object is provided according to an embodiment of the present invention.

It may be assumed that the content providing system 200 according to an embodiment of the present invention is included in the user's device 300.

3 and 4, first, according to an embodiment of the present invention, images 301 and 401 including at least one object (ie, a card or a fire extinguisher) are obtained from a user's device 300. Can be.

Then, according to one embodiment of the present invention, the target object 302 corresponding to the shape 303, 403 of the object included in the obtained image 301, 401 and the marker 304, 404 of the object. , 402 may be specified.

Then, according to one embodiment of the invention, the content 305, 405 based on at least one of augmented reality or virtual reality associated with the target object 302, 402 specified above is the device 300 of the user above. ) May be provided. For example, according to an embodiment of the present invention, the content provided above means that the characters 305 and 405 based on augmented reality or virtual reality are contained in the card 302 that is the target object 302 or 402. Or it may be a content that describes the information on how to use the fire extinguisher 402, the target object in text, voice or video.

Meanwhile, according to an embodiment of the present invention, the content may be provided through a wearable device (not shown) connected to the user's device 300 and the communication network 100. In this case, according to an embodiment of the present invention, such a wearable device may include a head mounted display (HMD), an eye glasses display (EGD), and a face mounted display for implementing virtual reality. The display device may include at least one of a face mounted display (FMD) and a near eye display (NED).

Embodiments according to the present invention described above can be implemented in the form of program instructions that can be executed by various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified with one or more software modules to perform the processing according to the present invention, and vice versa.

Although the present invention has been described by specific matters such as specific components and limited embodiments and drawings, it is provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. Those skilled in the art may make various modifications and changes from this description.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and the scope of the spirit of the present invention is defined not only in the claims below, but also in the ranges equivalent to or equivalent to the claims. Will belong to.

100: network
200: content delivery system
210: image acquisition unit
220: target object specifying unit
230: content provider
240: communication unit
250: control unit
300: device

Claims (6)

A method of providing content associated with an object,
Obtaining an image including at least one object from a user's device,
Specifying a target object corresponding to a shape of an object included in the obtained image and a marker of the object, and
Providing content associated with the specified target object to the device based on at least one of augmented reality and virtual reality;
Way. The method of claim 1,
In the specifying step, verifying whether the target object is correctly specified by comparing the shape of the object and the target object specified corresponding to each of the markers of the object with each other;
Way. The method of claim 1,
The content includes at least one of audio, video, and text.
Way. The method of claim 1,
The content is content about a guide using the object.
Way. A non-transitory computer readable recording medium for recording a computer program for executing the method according to claim 1. A method of providing content associated with an object,
An image obtaining unit obtaining an image including at least one object from a user's device,
A target object specifying unit specifying a target object corresponding to a shape of an object included in the obtained image and a marker of the object, and
And a content provider configured to provide the content associated with the target object to the device based on at least one of augmented reality and virtual reality.
system.

Images