KR20140111868A - Apparatus and method for managing object based on panorama media - Google Patents

Abstract

An apparatus and a method for managing an object based on a panoramic image are disclosed. The method comprises the steps of: generating or receiving a first panoramic image; tagging a first object included in the first panoramic image generated or received based on an input of a client terminal; determining real world coordinates of the tagged first object; and tagging the first object included in a second panoramic image based on the determined real world coordinates of the first object.

Description

[0001] APPARATUS AND METHOD FOR MANAGING PANORAMIC IMAGE-BASED OBJECT [0002]

Embodiments relate to an object management apparatus and method thereof, and more particularly to an apparatus and method for managing a panorama image-based object.

The method of tagging an object in a panoramic image is mostly performed by hand, and data is stored in the unit of a reference pixel in the local coordinate system in the image. The current object tagging method differs from the panorama provider (Google, 360Cities, Daum, NHN, etc.) and the general consumer so that it is difficult for the general consumer to understand the panorama and author the tagging and the additional media experience.

Korean Patent Laid-Open Publication No. 10-2004-001300 relates to a system and method for synthesizing a video image using a panoramic image as a background. A panoramic image with a 360-degree panoramic view on the computer and an editing operation that composes the image of a person, object, or other object on the image as a background creates a synthesized edited video image as if the object was photographed in a place with the background The present invention relates to a system and method for synthesizing a video image using a panoramic video image as a background. However, Korean Patent Laid-Open Publication No. 10-2004-001300 merely shows a composite image of a panoramic image and other images, and does not support a convenient object tagging and an additional media experience sharing method.

Korean Patent Publication No. 10-2004-001300

According to an aspect of the present invention, when tagging an object of one panorama image, an object commonly included in other panorama images can be tagged easily.

According to another aspect of the present invention, it is possible to utilize information and multimedia tagged on an object basis in other panorama images and applications by using real world coordinates of an object of one panorama image.

According to an aspect of the present invention, there is provided an image processing method comprising: generating or receiving a first panoramic image; Tagging a first object included in the generated or received first panorama image based on an input of a client terminal; Determining a real world coordinate of the tagged first object; And tagging a first object included in the second panorama image based on the determined real world coordinate of the first object.

According to another aspect of the present invention, there is provided an image processing method comprising: generating or receiving a first panoramic image; Tagging a first object included in the generated or received first panorama image; Determining a real world coordinate of the tagged first object; And tagging a first object included in the second panorama image based on the determined real-world coordinate of the first object. A computer-readable recording medium recording a computer program for performing a method of managing a panorama image- Is provided.

According to another aspect of the present invention, there is provided a panorama image management system comprising: a panorama image management unit for generating or receiving a first panorama image; An object tagging unit for tagging a first object included in the generated or received first panorama image based on an input of a client terminal; And a real-world coordinate determination unit for determining a real-world coordinate of the tagged first object, wherein the object tagging unit tags the first object included in the second panoramic image based on the determined real- A panorama image-based object management apparatus is provided.

According to the present invention, when an object of one panorama image is tagged, it is possible to easily tag an object commonly included in other panorama images by utilizing it. Accordingly, the user can apply the tagging method to all the panoramic images with only one object tagging.

In addition, it is possible to utilize multimedia authored on the basis of an object in other panorama images and applications by using real world coordinates of an object of one panorama image. Especially, it can be used in applications such as augmented reality.

FIG. 1 is a diagram illustrating an internal configuration of a panorama image-based object management apparatus 100 and a client terminal 10 communicating therewith according to an embodiment of the present invention.
2A to 2C are views illustrating an example of a process of tagging objects in a panoramic image according to an embodiment of the present invention.
FIGS. 3A to 3D are views illustrating an example of a process of using multimedia objects in augmented reality application when objects are based on an object of one panoramic image, according to an exemplary embodiment of the present invention.
4 is a flowchart illustrating a method of managing a panorama image-based object according to an exemplary embodiment of the present invention.

The following detailed description of the invention refers to the accompanying drawings, which illustrate, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which such claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

FIG. 1 is a diagram illustrating an internal configuration of a panorama image-based object management apparatus 100 and a client terminal 10 communicating therewith according to an embodiment of the present invention.

The client terminal 10 is a terminal used by a client. The client can communicate with the panorama image-based object management apparatus 100 through the client terminal 10 to transmit an input for tagging an object included in the panorama image. More specifically, multimedia data of at least one of text, image, audio, and video can be transmitted in the form of tag information around an object included in the panorama image.

The client terminal 10 may be implemented in various forms and may include various features. The client terminal 10 may include all apparatuses in which a specific application can be operated, and does not limit the form thereof. In one embodiment, an application, that is, an arbitrary program can be operated through the client terminal 10, and the camera function, the storage function, the arithmetic function, etc. of the client terminal 10 can be utilized. For example, the client terminal 10 may be a Personal Communication System (PCS), a Global System for Mobile communications (GSM), a Personal Digital Cellular (PDC), a Personal Handyphone System (PHS), a Personal Digital Assistant (PDA) Mobile Telecommunication) -2000-based terminals, and the like, as well as handheld-based wireless terminals. The client terminal 10 may also include a processing system having a processor, an operating system, and an application program interface (API) to provide communication between one or more software applications and an operating system. Further, the processing system of the client terminal 10 may be configured to execute various software applications. The client terminal 10 can communicate with other objects, and hardware or software capable of communicating with the client terminal 10 can be mounted thereon. The communication method may include all communication methods that the object and the object can network, and is not limited to wired / wireless communication, 3G, 4G, or other methods.

The panorama image-based object management apparatus 100 may tag the first object included in the first panorama image based on the input of the client terminal, and may generate a first object included in the second panorama image based on the real- Tagging. In one embodiment, the panoramic image-based object management apparatus 100 includes a panoramic image management unit 110, an object tagging unit 120, a real-world coordinate determination unit 130, a storage unit 140, and a communication unit 150 . However, it is not intended to limit the elements to the elements described above.

The panorama image managing unit 110 serves to generate or receive a panorama image. In one embodiment, the panoramic image management unit 110 may include a photographing unit 111. The photographing unit can photograph an external object in a panoramic form to generate a panoramic image. The panorama image may be already stored in the storage unit 140 or may be received from an external object (not shown) through a network. The communication method includes all common communication modes, and is not particularly limited.

The object tagging unit 120 tags the first object included in the first panorama image managed by the panorama image managing unit 110 based on the input of the client terminal 10. [ Assume that the panoramic image as shown in FIG. 2A is generated or received as the first panoramic image. The wall-mounted TV included in Fig. 2A is referred to as a first object, and the wall-mounted TV in the red box in Fig. 2B is referred to as "Global Lounge TV" re.kr / dev / object / television ". As a result, as shown in FIG. 2C, the text "Global Lounge's TV" can be superimposed on the first object, the wall-mounted TV.

In one embodiment, the object tagging unit 120 may input at least any one of text, image, audio, and video multimedia information as tag information around the first object. Assume that the panoramic image shown in FIG. 3A is generated or received as the first panoramic image. 3B, when a red building is referred to as a first object, a video in which a text "small tree" around the first object, an image of " Tag information can be input.

The real-world coordinate determination unit 130 determines the real world coordinates of the first object tagged by the object tagging unit 120. [ In one embodiment, the real world coordinate determining unit 130 may determine the real world coordinates of the tagged first object based on the position of the first panoramic image and the panoramic inner coordinates of the tagged first object.

In one embodiment, the panoramic image may include header information or tag information, and may include GPS information about the location where the panoramic image was taken. The GPS module is built in the photographing device for photographing the panorama image, and it is recorded at which position on the latitude and longitude the panorama image is generated. In addition, each object in the panoramic image has a relative coordinate value according to the local coordinate system of the panoramic image. The real world coordinate determination unit 130 may determine the absolute coordinate value of the first object, that is, the real world coordinate, by adding the relative coordinate value according to the panoramic image reference local coordinate system of the object based on the absolute coordinate such as GPS information. Accordingly, the object of the relative coordinate system can be incorporated into the absolute coordinate system.

The object tagging unit 120 tags the first object included in the second panorama image based on the real world coordinates of the first object determined by the real world coordinate determination unit 130. Since the real world coordinate of the object is an absolute coordinate, the same object can be searched for another panoramic image including the same object, and the same tagging can be automatically performed. In one embodiment, the object tagging unit 120 may tag the first object included in the second panorama image based on the position of the second panorama image and the panorama inner coordinates of the first object included in the second panorama image, do. That is, the panorama inner coordinate value of the first object included in the second panorama image is added to the GPS information about the position of the second panorama image, and when the second panorama image coincides with the real world coordinate of the first object of the first panorama image, It is possible to tag the contents tagged to the first object in the same manner.

For example, assume that in FIG. 3A, the audio of the "female student" and the "effect sound" are tagged around an object called "building" of the first panoramic image. In the case of performing panoramic photographing (second panoramic image) of a similar space with a separate mobile device as shown in Fig. 3D, an object called "building" having a real world coordinate equal to the real world coordinate of " Since the image is found in the panoramic image, the image of the student "associated with the first object," and the audio in which the " effect sound "is expressed are visualized in an augmented reality manner.

The storage unit 140 stores information in the panorama image-based object management apparatus 100 and various information received from the client terminal 10. [ Specifically, the panorama image managing unit 110, the photographing unit 111, the object tagging unit 120, and the real-world coordinate determining unit 130 may store various information obtained during the functioning process or during the functioning process.

The communication unit 150 performs communication between the panorama image-based object management apparatus 100 and an external object. The panorama image management unit 110 and the object tagging unit 120 may directly communicate with an external object, but may perform communication with an external object under the support of the communication unit 150. The communication method may include all communication methods in which objects and objects can be networked, and is not limited to the types of wired / wireless communication, 3G, 4G, or later methods, if the communication function is available.

4 is a flowchart illustrating a method of managing a panorama image-based object according to an exemplary embodiment of the present invention. First, the first panoramic image is generated or received from the outside (S1). The first object included in the first panorama image generated or received by the input of the client terminal 10 is tagged (S2). In one embodiment, the tagging process may be a process of inputting at least any one of text, image, audio, and video multimedia information as tag information around the first object. Then, the real world coordinate of the first object is determined based on the photographing position of the first panorama image and the inner coordinates of the panorama image of the first object (S3). In one embodiment, the first panorama image capturing position is GPS information, the first panorama image coordinate of the object may be a relative coordinate value according to the panorama image reference local coordinate system of the object, and the real world coordinate may be an absolute coordinate By adding a relative coordinate value according to the panoramic image reference local coordinate system of the object with reference to the reference coordinate system. If a second panorama image is generated or received (S4), a first object commonly included in the second panorama image is tagged based on the real world coordinates of the first object (S5). In this process, the real-world coordinate of the first object commonly included in the second panoramic image can be compared with the real-world coordinate value of the first object of the first panoramic image.

The embodiments of the present invention described above can be implemented in the form of program instructions that can be executed through various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, and the like, alone or in combination. The program instructions recorded on the computer-readable recording medium may be ones that are specially designed and configured for the present invention and are known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM < flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims.

Therefore, the spirit of the present invention should not be construed as being limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the following claims, I will say.

10:
100: panorama image-based object management device
110: Panorama image management unit
111:
120: Object tagging unit
130: Real world coordinate determination unit
140:
150:

Claims (9)

Generating or receiving a first panoramic image;
Tagging a first object included in the generated or received first panorama image based on an input of a client terminal;
Determining a real world coordinate of the tagged first object;
And tagging the first object included in the second panorama image based on the determined real world coordinate of the first object.
The method according to claim 1,
Wherein the step of tagging the first object included in the generated or received first panorama image comprises:
Further comprising inputting at least one of text, image, audio, and video multimedia information as tag information around the first object.
The method according to claim 1,
Wherein determining the real world coordinate of the tagged first object comprises:
Determining a real world coordinate of the tagged first object based on a position of the first panorama image and a panorama inner coordinate of the tagged first object.
The method of claim 3,
Wherein the step of tagging the first object included in the second panorama image based on the determined real-
Further comprising tagging a first object included in a second panorama image based on a position of the second panorama image and a panorama inner coordinate of a first object included in the second panorama image, How to manage.
Generating or receiving a first panoramic image; Tagging a first object included in the generated or received first panorama image; Determining a real world coordinate of the tagged first object; And tagging a first object included in the second panorama image based on the determined real-world coordinate of the first object. A computer-readable recording medium recording a computer program for performing a method of managing a panorama image- .
A panorama image managing unit for generating or receiving a first panorama image;
An object tagging unit for tagging a first object included in the generated or received first panorama image based on an input of a client terminal; And
And a real world coordinate determination unit for determining a real world coordinate of the tagged first object,
Wherein the object tagging unit tags the first object included in the second panorama image based on the determined real world coordinate of the first object.
The method according to claim 6,
The object tagging unit,
Wherein at least one of text, image, audio, and video multimedia information is tagged around the first object.
The method according to claim 6,
The real-world coordinate determination unit determines,
And determines a real world coordinate of the tagged first object based on a position of the first panorama image and a panorama inner coordinate of the first tagged object.
9. The method of claim 8,
The object tagging unit,
And tagging a first object included in a second panorama image based on a position of the second panorama image and a panorama inner coordinate of a first object included in the second panorama image.

Images