KR20160038375A - Contents creation apparatus and method for operating the contents creation apparatus - Google Patents

Abstract

Provided are a content producing device and an operating method of the content producing device. The content producing device photographs an image, extracts personal information and object information related to the image, detects a location where the image is photographed, and inputs the personal information, the object information, and the location to the image so as to produce content information.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a content creation apparatus and a content creation apparatus,

Embodiments of the present invention relate to a content production apparatus and an operation method of the content production apparatus.

As a result of the rapid development of electronic engineering and communication engineering, mobile communication terminals have been provided with various functions. As wireless communication and data processing technologies are rapidly developed, people use mobile communication terminals as well as voice communication, And video message transmission.

BACKGROUND ART [0002] Mobile communication terminals are becoming an essential means of communication in modern life, for example, due to rapid diffusion of mobile communication terminals, a considerable amount of communication occurring in human relationships is performed through mobile communication terminals.

In addition, the mobile communication terminal may photograph a picture or a moving picture by using a built-in camera as well as a call function, store the captured picture in its own memory or store it in another mobile communication terminal or a personal PC It is possible.

With the development of the mobile communication terminal, the service provided through the mobile communication terminal and the application processed in the mobile communication terminal have been further increased and diversified.

For example, the mobile communication terminal can listen to music and moving pictures using a music playing application and a moving picture playing application, and can execute various games using a game application.

In addition, the mobile communication terminal may store the photographed pictures and moving pictures as they are, but may also edit and store the photographed pictures and moving pictures using the content producing application.

However, the application provided by the mobile communication terminal still has the inconvenience that the user has to directly edit the content and directly classify various contents.

[TECHNICAL FIELD OF THE INVENTION]

Techniques that constitute the background of the present invention are disclosed in the following two patent documents.

(1) Korean Patent Publication No. 2004-0096935 (November 17, 2004)

(2) Korean Patent Publication No. 2005-0046147 (May 18, 2005)

One embodiment of the present invention is to recognize a person and a place in a photograph or a moving picture photographed by a user and automatically insert the information related to a photograph or a moving picture into a text basis to produce contents.

An embodiment of the present invention aims to classify a photograph or a moving image automatically photographed without manually separating the photographed image or moving image.

A content production apparatus according to an embodiment of the present invention includes an image capturing unit for capturing an image, an information extracting unit for extracting person information and object information related to the image, a position detecting unit for detecting a position where the image is captured, And a content creator for inputting the person information, the object information, and the position to produce content information.

According to an aspect of the present invention, the position detector can detect the position by recognizing POI (Point of Interest) information.

According to an aspect of the present invention, the information extraction unit may extract the person information from address book information stored in the content production apparatus.

According to an aspect of the present invention, the information extraction unit can extract the person information from profile information of an application driven through the content production apparatus.

According to an aspect of the present invention, the information extracting unit includes a person recognizing unit that extracts the person information from the image using the person recognition system, and an object recognizing unit that extracts the object information using the object recognizing system from the image can do.

According to an aspect of the present invention, the information extracting unit may extract the weather at the location on the date and the date when the image was photographed.

According to an aspect of the present invention, the content production unit may generate the content information by inputting the person information, the object information, the location, the date, and the weather on the image.

The content production apparatus according to an aspect of the present invention may further include a storage unit for storing the produced content information.

According to an aspect of the present invention, the content production unit may process the content information by combining text information, image information, and music information input by the user.

An operation method of a content production apparatus according to an embodiment of the present invention includes the steps of capturing an image, extracting person information and object information related to the image, detecting a position where the image is captured, And inputting the person information, the object information, and the position to produce content information.

According to an aspect of the present invention, the step of detecting the position where the image is photographed may include detecting the position by recognizing POI (Point of Interest) information.

According to an aspect of the present invention, the step of extracting the person information and the object information includes extracting the person information from the address book information stored in the content authoring apparatus, and extracting the person information from the profile information of the application And extracting the person information.

According to an aspect of the present invention, the step of extracting the person information and the object information includes extracting the person information from the image using a person recognition system, and extracting the object information from the image using the object recognition system. And extracting the extracted data.

According to an aspect of the present invention, there is provided a method of operating a content production apparatus, the method comprising: extracting a weather at a location on a date and a date on which the image was photographed; And generating the content information by inputting the weather information.

The method of operating a content production apparatus according to an aspect of the present invention may further include storing the produced content information.

The operation method of the content production apparatus according to an aspect of the present invention may further include processing the content information by combining text information, image information, and music information input by a user.

According to an embodiment of the present invention, a person or a place is recognized in a photograph or a moving picture taken by a user, and information about the photograph or moving picture is automatically inserted into the text and the contents can be produced.

According to an embodiment of the present invention, a user can classify a photographed image or a moving image automatically, without manually separating the photographed image or the moving image.

1 is a block diagram showing a configuration of a content production apparatus according to an embodiment of the present invention.
2 is a block diagram showing a configuration of an information extracting unit according to an aspect of the present invention.
3 is a view showing a first embodiment of a content information production process according to an aspect of the present invention.
4 is a diagram illustrating a second embodiment of a content information production process according to an aspect of the present invention.
5 is a view showing a third embodiment of a content information production process according to an aspect of the present invention.
6 is a flowchart illustrating an operation method of a content production apparatus according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and accompanying drawings, but the present invention is not limited to or limited by the embodiments.

Various modifications may be made to the embodiments described below. It is to be understood that the embodiments described below are not intended to limit the embodiments, but include all modifications, equivalents, and alternatives to them.

The terms used in the examples are used only to illustrate specific embodiments and are not intended to limit the embodiments. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The terminology used herein is a term used for appropriately expressing an embodiment of the present invention, which may vary depending on the user, the intent of the operator, or the practice of the field to which the present invention belongs. Therefore, the definitions of these terms should be based on the contents throughout this specification.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as ideal or overly formal in the sense of the art unless explicitly defined herein Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

An embodiment of the present invention relates to a content production apparatus and an operation method of the content production apparatus, and more particularly to a content production apparatus and a content production apparatus in which related information is automatically added to a photographed image of a photograph, And a method of operating the content production apparatus.

≪ Configuration of content production apparatus >

Hereinafter, a configuration of a content production apparatus according to an embodiment of the present invention will be described.

1 is a block diagram showing a configuration of a content production apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a content production apparatus according to an exemplary embodiment of the present invention includes a photographing unit 110, an information extracting unit 120, a position detecting unit 130, and a content producing unit 140.

According to an aspect of the present invention, the content production apparatus may include a control unit 150, and the control unit 150 may control an overall operation of the content production apparatus. For example, the control unit 150 may transmit and receive data between the respective modules and transmit the data to another module, or may generate control data to control the respective modules. Each of the modules may be driven under the control of the controller 150 or independently of the controller 150.

The photographing unit 110 photographs an image.

The content production apparatus may photograph an image using the built-in photographing unit 110, but may also receive an image photographed by an external photographing apparatus connected through an external connection apparatus.

The information extracting unit 120 extracts person information and object information related to the image.

For example, the information extraction unit 120 may extract the person information from the address book information stored in the content production apparatus.

Also, the information extracting unit 120 can extract the person information from the profile information of the application driven through the content producing apparatus. For example, the information extraction unit 120 may extract the person information from profile information such as thumbnails provided through the SNS application of the user.

The information extracting unit 120 can automatically recognize through the person recognition system and the object recognition system.

2 is a block diagram showing a configuration of an information extracting unit according to an aspect of the present invention.

2, the information extracting unit 200 may include a person recognizing unit 210 and an object recognizing unit 220. The information extracting unit 200 may automatically recognize the objects through the character recognizing system and the object recognizing system.

At this time, the person recognition unit 210 can extract the person information from the image using the person recognition system, and the object recognition unit 220 can extract the object information using the object recognition system from the image have.

Referring back to FIG. 1, the position detector 130 detects a position at which the image is captured.

At this time, the position detector 130 recognizes the POI (Point of Interest) information and can detect the position.

When a user takes a picture or a moving picture by using the photographing unit 110 of the contents producing apparatus or the external photographing apparatus connected to the contents producing apparatus, the user can recognize the main POI information for automatically inputting the photograph or the moving picture.

For example, the content production apparatus can transmit and receive data to / from the communication server through wireless communication, and can receive the POI information from the server and detect the location where the photograph or moving image is captured.

The content creator 140 generates the content information by inputting the person information, the object information, and the position in the image.

At this time, the information extraction unit 120 may extract the weather of the location at the date and the date when the image was photographed, and the content production unit 140 may extract the person information, the object information, the location, Date, and weather to generate the content information.

The content production unit 140 may combine the text information, the image information, and the music information input by the user with the content information.

The content production apparatus according to an aspect of the present invention may include a storage unit 160, and the storage unit 160 may store the produced content information. Also, the storage unit 160 may store not only the produced content information but also the person information, the object information, the location, the date, and the weather, and may store all information related to the information.

<Contents information production process>

Hereinafter, the process of producing content information according to one aspect of the present invention will be described.

3 is a view showing a first embodiment of a content information production process according to an aspect of the present invention.

Referring to FIG. 3, the content production apparatus analyzes the photographed image 310 by using a photographing unit such as a built-in camera, as shown in FIG. 3 (a) And the object information 330 can be extracted.

For example, the content production apparatus can extract the person information from the stored address book information or extract the person information from the profile information of the application driven through the content production apparatus.

As another example, the content production apparatus may automatically extract the person information from the image using the person recognition system, or may automatically extract the object information using the object recognition system.

The content production apparatus can transmit and receive data to and from the communication server through wireless communication, and can receive the POI information from the server and detect the location where the photograph or moving image is captured.

The content production apparatus can generate content information by inputting the person information, the object information, and the position information into the image. For example, as shown in FIG. 3 (b), when a photograph is taken from Kim Young Hee and the Han River Grand Bridge in the spring of 2014, " Quot; can be input to the image to produce content information.

In addition, the content production apparatus may extract information related to the weather at the location on the date and the date when the image was photographed. The content production apparatus can generate the content information by inputting information such as the date 350 and the weather 360 to the image.

4 is a diagram illustrating a second embodiment of a content information production process according to an aspect of the present invention.

4, when a photograph 410 is photographed using a photographing unit such as a built-in camera as shown in FIG. 4 (a), the content production apparatus analyzes the photographed photograph, Can be extracted.

For example, the content production apparatus can extract the person information from the stored address book information or extract the person information from the profile information of the application driven through the content production apparatus.

As another example, the content production apparatus may automatically extract the person information from the image using the person recognition system, or may automatically extract the object information using the object recognition system.

The content production apparatus can transmit and receive data to and from the communication server through wireless communication, and can receive the POI information from the server and detect the location where the photograph or moving image is captured.

As shown in (b) of FIG. 4, the content production apparatus can input information such as a place and a person into the photograph 410 to produce and display the content information.

The content production apparatus can generate content information by inputting the person information, the object information, and the position information into the image. For example, as shown in FIG. 4 (b), when a picture is taken together with Resin and Kim Taehee in Berlin, the content production apparatus generates a phrase 430 of "Place: Berlin, Can be input to the image to produce content information.

In addition, the content production apparatus may extract information related to the weather at the location on the date and the date when the image was photographed. The content production apparatus may generate the content information by inputting information such as date and weather 430 to the image.

Also, the content production apparatus may combine the text information, the image information, and the music information input by the user with the content information. For example, the content production apparatus may edit the content information to add the moving image information 440 as shown in FIG. 4 (b).

5 is a view showing a third embodiment of a content information production process according to an aspect of the present invention.

5, when a photograph 510 is photographed using a photographing unit such as a built-in camera as shown in FIG. 5A, the content production apparatus analyzes the photographed photograph, Can be extracted.

The content production apparatus can generate and display content information by inputting the information 520 of a place and a person into the photo 510, as shown in FIG. 5A.

In addition, the content production apparatus may extract information related to the weather at the location on the date and the date when the image was photographed. The content production apparatus can generate the content information by inputting information such as the date 530 and the weather 540 to the image.

Also, the content production apparatus may combine the text information, the image information, and the music information input by the user with the content information. For example, the user may edit the produced content information by clicking the "edit" button 550 displayed on the content information produced by the content producing apparatus.

As shown in FIG. 5B, the content production apparatus can drive an application 560 capable of editing content information, and the user can input information for editing such as input and deletion in addition to content information can do.

The content production apparatus may modify the content information with the edited contents 570 as shown in (c) of FIG. 5 according to the edited contents of the user.

&Lt; Operation method of content production apparatus >

Hereinafter, an operation method of a content production apparatus according to an embodiment of the present invention will be described.

6 is a flowchart illustrating an operation method of a content production apparatus according to an embodiment of the present invention.

The operation method of the content production apparatus according to an embodiment of the present invention can be performed using the above-described content production apparatus, and thus will be described from the viewpoint of the content production apparatus.

Referring to FIG. 6, the content production apparatus captures an image (610).

The content production apparatus extracts person information and object information related to the image (620).

For example, the content production apparatus can extract the person information from the address book information stored in the content production apparatus, and extract the person information from the profile information of the application driven through the content production apparatus.

In addition, the content production apparatus can extract the person information from the image using the person recognition system, and extract the object information using the object recognition system from the image.

The content production apparatus detects a position where the image is photographed (630).

For example, the content production apparatus can recognize the POI (Point of Interest) information and detect the position.

The content production apparatus inputs the person information, the object information, and the position to the image to produce content information (640).

In addition, the content production apparatus may extract the weather of the location on the date and the date on which the image was photographed, and input the person information, the object information, the location, the date, Content information can be produced.

The content production apparatus stores the produced content information (650).

In addition, the content production apparatus may combine the text information, the image information, and the music information input by the user with the content information.

The content production apparatus according to an aspect of the present invention automatically inputs a person who is photographed in weather, shooting date, POI information, and image information into text information in a video image, And store the produced information.

A content production apparatus according to an aspect of the present invention can display on a screen the date of shooting a photograph or a moving image together with the weather of the corresponding date and edit the meta information stored in the storage unit to process new content information It is possible.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA) , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI &gt; or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

110:
120: information extracting unit
130:
140: Content production department
150:
160:

Claims (17)

A content production apparatus comprising:
A photographing unit for photographing an image;
An information extracting unit for extracting person information and object information related to the image;
A position detector for detecting a position at which the image is captured; And
A content production section for inputting the character information, the object information, and the position on the image to produce content information,
And a content creator. The method according to claim 1,
Wherein,
Recognizing POI (Point of Interest) information and detecting the position,
Content production device. The method according to claim 1,
The information extracting unit extracts,
Extracting the person information from the address book information stored in the content production apparatus,
Content production device. The method according to claim 1,
The information extracting unit extracts,
And extracting the person information from profile information of an application driven through the content production apparatus,
Content production device. The method according to claim 1,
The information extracting unit extracts,
A person recognition unit for extracting the person information from the image using a person recognition system; And
An object recognition unit for extracting the object information using the object recognition system from the image,
And a content creator. The method according to claim 1,
The information extracting unit extracts,
And a weather information generating unit for generating a weather information of the location,
Content production device. The method according to claim 6,
The content production unit,
And generating the content information by inputting the person information, the object information, the location, the date, and the weather on the image,
Content production device. The method according to claim 1,
A storage unit for storing the produced content information,
Further comprising: The method according to claim 1,
The content production unit,
And combining the text information, the image information, and the music information input by the user with the content information,
Content production device. A method of operating a content production apparatus,
Capturing an image;
Extracting person information and object information related to the image;
Detecting a position at which the image is photographed; And
Creating the content information by inputting the person information, the object information, and the location into the image
And a content creator. 11. The method of claim 10,
Wherein the step of detecting the position where the image is photographed comprises:
Recognizes POI (Point of Interest) information and detects the position.
A method of operating a content production apparatus. 11. The method of claim 10,
Wherein the step of extracting the person information and the object information comprises:
Extracting the person information from address book information stored in the content production apparatus; And
Extracting the person information from the profile information of the application driven through the content production apparatus
And a content creator. 11. The method of claim 10,
Wherein the step of extracting the person information and the object information comprises:
Extracting the person information from the image using a person recognition system; And
Extracting the object information using the object recognition system from the image
And a content creator. 11. The method of claim 10,
Extracting the weather at the location on the date the image was taken and the date; And
And generating the content information by inputting the person information, the object information, the location, the date, and the weather on the image
Further comprising the steps of: 11. The method of claim 10,
Storing the produced content information
Further comprising the steps of: 11. The method of claim 10,
Combining the text information, the image information, and the music information input by the user with the content information,
Further comprising the steps of: A computer-readable recording medium recording a program for performing the method of any one of claims 10 to 16.

Images