KR102250374B1 - A mobile device managing images taken by an imaging device in association with schedule information and a method for managing images using the same - Google Patents

Abstract

Disclosed are a mobile communication terminal for managing image content acquired by an imaging device in association with schedule information, and a method for managing image content using the same. The mobile communication terminal includes an image pickup unit, a schedule information management unit that generates and stores schedule information of a user, an image content acquisition detection unit that detects image content acquisition by the image pickup unit and generates an image content acquisition signal, and the image content acquisition unit. Receiving the image content acquisition signal from the sensing unit, by inquiring the schedule information management unit to receive schedule information including a schedule information item matching at least one reference information item among image content metadata included in the image content acquisition signal A schedule information mapping unit that determines the searched schedule information as related schedule information, maps and stores the acquired image content with the related schedule information, and an image that provides the acquired image content in association with the related schedule information It includes a content management unit.

Description

A mobile communication terminal that manages video content acquired by an imaging device in association with schedule information, and a video content management method using the same.{A MOBILE DEVICE MANAGING IMAGES TAKEN BY AN IMAGING DEVICE IN ASSOCIATION WITH SCHEDULE INFORMATION AND A METHOD FOR MANAGING IMAGES USING THE SAME}

The present invention relates to a mobile communication terminal for managing image content acquired by an imaging device in association with schedule information, and an image content management method using the same, and more specifically, to a partial item of metadata of the acquired image content. The present invention relates to a mobile communication terminal that provides a user interface for easily searching for video contents related to a specific schedule by searching for related schedule information and mapping the searched related schedule information with the acquired video content, and a video content management method using the same. .

Mobile communication terminals such as smartphones, which have recently been popularized, support various functions in addition to the transmission and reception of voice calls and text messages through a mobile telephone switching network.

Particularly, in a mobile communication terminal such as a smart phone, a video content device capable of capturing high-resolution video content is generally built-in. A user of a mobile communication terminal may take a picture or video using such a built-in video content device, store the photographed picture and video, and view it when necessary, or share it with others using a platform such as SNS.

Meanwhile, a schedule management application capable of recording, modifying, and storing schedules is provided in mobile communication terminals. Users can use the calendar application to record and check important schedules.

The user can take pictures or videos related to the schedule while digesting a specific schedule. For example, during a meeting, a part of the meeting material may be taken as a picture, or a participant's remarks and presentations may be captured as a video.

Conventional photo management applications and schedule management applications do not provide a function to search for video content captured in relation to a specific schedule, so you have to search for photos related to the schedule in a normal video content storage folder. There was an inconvenience.

The present invention is to solve the problem of the prior art, by searching for related schedule information using some items of metadata of acquired video content, and mapping the searched related schedule information with the acquired video content to An object of the present invention is to provide an electronic communication terminal that provides a user interface for easily searching for related video contents, and a video content management method using the same.

A mobile communication terminal according to an embodiment of the present invention includes an image pickup unit, a schedule information management unit that generates and stores schedule information of a user, and image content that detects acquisition of image content by the image pickup unit and generates an image content acquisition signal. A schedule that matches at least one reference information item among image content metadata included in the image content acquisition signal by inquiring the schedule information management unit by receiving the image content acquisition signal from the acquisition detection unit and the image content acquisition detection unit A schedule information mapping unit that searches for schedule information including an information item and determines the searched schedule information as related schedule information, maps and stores the obtained image content with the related schedule information, and stores the obtained image content as the related schedule information. It includes a video content management unit that provides in association with schedule information.

The video content management unit may be configured to display information on one or more video content mapped to the related schedule information on a schedule information management user interface provided by the schedule information management unit.

The reference information item may include at least one of an image content capturing time and an image content capturing location.

The schedule information mapping unit extracts the video content shooting time and the video content shooting location from the video content metadata, and searches the schedule information management unit to have the same time and place as the video content shooting time and the video content shooting location. When the schedule information is searched for, and when schedule information having the same time and place as the video content shooting time and the video content shooting location is searched, the searched schedule information is determined as the related schedule information and transmitted to the video content management unit. I can.

The schedule information mapping unit, when the schedule information having the same time and place as the video content capture time and the video content capture location is not searched, a first user input to check whether a schedule related to the acquired video content is generated It can be configured to create and display an interface.

The schedule information mapping unit receives a user input for requesting generation of a related schedule through the first user input interface, and executes the schedule management unit in response to a user input requesting generation of the related schedule to generate a schedule generation user interface. It may be configured to provide the schedule information input through the schedule generation user interface and determine the related schedule as the related schedule and transmit the schedule information to the video content management unit.

The schedule information mapping unit may determine the searched schedule information as candidate-related schedule information when only one of the video content shooting time and the video content shooting location is searched, and determine the candidate-related schedule information as the acquired video content It may be configured to generate and display a second user input interface for confirming whether to associate with.

The schedule information mapping unit receives a user input requesting to associate the candidate-related schedule information with the obtained video content through the second user input interface, and requests the association between the candidate-related schedule information and the obtained video content. In response to a user input, the candidate related schedule information may be determined as the related schedule information and may be transmitted to the video content management unit.

The schedule information mapping unit may be configured to modify an item of the candidate-related schedule information that does not match the reference information item of the acquired image content as reference information of the acquired image content and map it to the acquired image content. have.

The schedule information mapping unit executes and displays the schedule management unit to modify the schedule information related to the candidate, and receives a modification of the schedule information related to the candidate input by the schedule management unit, and among the schedule information related to the candidate, the It may be configured to modify an item that does not match the reference information item of the acquired image content into the reference information of the acquired image content and map it to the acquired image content.

The video content management unit may be configured to generate an album including one or more video content mapped to the related schedule information.

The video content management unit may be configured to display information on one or more video content mapped to the related schedule information on a schedule information management user interface provided by the schedule information management unit.

On the other hand, the image content management method according to an embodiment of the present invention is a video content management performed by a mobile communication terminal including an imaging unit, a schedule information management unit, an image content acquisition detection unit, a schedule information mapping unit, and an image content management unit. A method comprising the steps of: an image content acquisition detection unit detecting image content acquisition by the imaging unit and generating an image content acquisition signal, a schedule information mapping unit receiving the image content acquisition signal from the image content acquisition detection unit 130 And, extracting the image content information to be matched included in the image content acquisition signal, the schedule information mapping unit inquiring the schedule information management unit to search for a schedule including an item matching the extracted reference information, the schedule information mapping unit is searched Determining the schedule as a related schedule related to the captured image content, mapping and storing the acquired image content to the determined related schedule information, and providing the acquired image content in association with the related schedule information by the image content management unit. Includes.

The video content management method according to an embodiment of the present invention provides information on one or more video contents mapped to the related schedule information by the video content management unit to a schedule information management user interface provided by the schedule information management unit. It may further include displaying.

The reference information item may include at least one of an image content capturing time and an image content capturing location.

The schedule information mapping unit may include: extracting the video content shooting time and the video content shooting location from the video content metadata; Searching the schedule information management unit to search for schedule information having the same time and place as the video content shooting time and the video content shooting location; And when schedule information having the same time and place as the video content capturing time and the video content capturing location is searched, determining the searched schedule information as the related schedule information and transmitting the result to the video content management unit.

The schedule information mapping unit, when the schedule information having the same time and place as the video content capture time and the video content capture location is not searched, a first user input to check whether a schedule related to the acquired video content is generated The step of creating and displaying an interface may be further performed.

The schedule information mapping unit may include receiving a user input requesting generation of a related schedule through the first user input interface; Providing a schedule generation user interface by executing the schedule management unit in response to a user input requesting the related schedule generation; And determining schedule information input through the schedule generation user interface as the related schedule and transmitting the determined schedule information to the video content management unit.

When the schedule information matching only one of the video content shooting time and the video content shooting location is searched for, the schedule information mapping unit may include determining the searched schedule information as candidate-related schedule information; The step of generating and displaying a second user input interface for confirming whether to associate the candidate-related schedule information with the acquired video content may be further performed.

The schedule information mapping unit comprises: receiving a user input requesting to associate the candidate related schedule information with the obtained video content through the second user input interface; And determining the candidate-related schedule information as the related schedule information and transmitting the candidate-related schedule information to the video content management unit in response to a user input requesting the association between the candidate-related schedule information and the acquired video content.

The schedule information mapping unit may further perform the step of modifying an item of the candidate-related schedule information that does not match the reference information item of the acquired image content as reference information of the acquired image content and mapping it to the acquired image content. You can do it.

The schedule information mapping unit may include executing and displaying the schedule management unit in order to correct the schedule information related to the candidate; And, an item that does not match the reference information item of the acquired video content from among the candidate-related schedule information by receiving a modification of the candidate-related schedule information input by the schedule management unit as reference information of the acquired video content. Modifying and mapping to the acquired image content may be further performed.

According to the above configuration of the present invention, by searching for related schedule information using some items of metadata of the acquired video content, and mapping the searched related schedule information with the acquired video content, quickly and easily search for video contents related to the schedule information. can do.

1 is a block diagram conceptually showing the configuration of a mobile communication terminal according to an embodiment of the present invention.
2 is a diagram for explaining a mapping process between acquired image content and schedule.
3 is a diagram illustrating an example of a first user input interface.
4 is a diagram illustrating an example of a second user input interface.
5 is a diagram illustrating an example in which schedule information is modified based on image content information.
6 is a diagram illustrating an example of creating an album (schedule video content folder) including one or more video contents mapped to the same related schedule.
7 is a diagram illustrating a schedule information management user interface in which information on image contents mapped to a schedule is displayed according to an embodiment of the present invention.
8 is a diagram illustrating an example of a video content sharing interface.
9 is a flowchart illustrating a process of a video content management method according to an embodiment of the present invention.
10 is a flowchart illustrating a process of specifying an additional schedule related to the acquired image content and mapping the added schedule to the image content.
11 is a flowchart illustrating a process of automatically correcting and mapping a schedule when the schedule does not match part of the reference information of video content.

In the present invention, various modifications may be made and various forms may be applied, and specific embodiments will be illustrated in the drawings and described in detail in the text. However, this is not intended to limit the present invention to a specific form disclosed, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention. In describing each drawing, similar reference numerals have been used for similar components. In the accompanying drawings, dimensions of structures may be exaggerated than actual for clarity of the present invention.

Terms such as first and second may be used to describe various constituent elements, but the constituent elements should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features or It is to be understood that the presence or addition of numbers, steps, actions, components, parts, or combinations thereof does not preclude the possibility of preliminary exclusion. In addition, A and B are'connected' and'coupled' means that A and B are directly connected or combined, and other components C are included between A and B, so that A and B are connected or combined. To include that.

Unless otherwise defined, all terms used herein including technical or scientific terms have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in the present application. Does not. Further, in the claims for the method invention, the order of each step may be interchanged with each other, as long as each step is not clearly bound to the order.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram conceptually showing the configuration of a mobile communication terminal according to an embodiment of the present invention.

Referring to FIG. 1, the mobile communication terminal 10 includes an imaging unit 110, a schedule information management unit 120, an image content acquisition detection unit 130, a schedule information mapping unit 140, and an image content management unit 150. Includes. Mobile communication terminals are terminals capable of making voice calls and data communication using a mobile communication network, and include smartphones and tablets.

Although not shown in FIG. 1, a mobile communication terminal includes a display that displays results of various services provided by an application, such as financial transactions, video viewing, web search, and the like.

The image pickup unit 110 includes an optical device such as a lens and an image pickup device such as a CCD, and performs a function of generating image content by photographing an external view. The imaging unit 110 is mounted on a mobile communication terminal in the form of a camera module, and in the case of a recent smart phone, it is common to include a front camera disposed on a display mounting surface and a rear camera disposed on a rear surface of the display mounting surface.

The schedule information management unit 120 is configured to manage schedule information of a user. The schedule information management unit 120 provides a schedule management user interface, and a user can input, modify, and delete his/her schedule through the schedule management user interface. The schedule information input through the schedule management user interface includes information about the date and time of the schedule, information about the place of the schedule, information about the contents of the schedule, and the like, and such schedule information is included in the mobile communication terminal 10. It is stored and stored in memory. The schedule information management unit 120 may be configured to provide a notification function for notifying a user of a schedule to come in the future based on the schedule information. The schedule information management unit 120 may be hardware, software, or a combination of hardware and software configured to provide a schedule management user interface. For example, the schedule information management unit 120 may be configured by software including instructions necessary for processing additional functions and a processor in the mobile communication terminal 10 that performs processing according to the instructions. In this case, the software constituting the schedule information management unit 120 may be installed in the mobile communication terminal 10 in the form of an application.

The image content acquisition detection unit 130 is configured to detect acquisition of image content by the imaging unit and generate an image content acquisition signal. The video content includes a still image or a moving image captured by the imaging unit 110. Shooting of a still image or a moving image by the imaging unit 110 is performed by executing a camera application installed in the mobile communication terminal 10. The camera application maps and stores information related to the acquired video content, which is referred to as video content metadata. The image content metadata may include various types of information, for example, an image content capture time, an image content capture location, a resolution of an image content, exposure information, imaging device information, mobile communication terminal information, and the like. Among the video content metadata, items used for searching schedule information to be described later are referred to as'reference information'. The reference information includes at least one of a video content capture time and a video content capture location. Since the schedule includes information on the time and/or location of the scheduled event, it is efficient to use the information on the shooting time and/or the location of the video content metadata in order to search for a schedule related to the video content. Because.

When the image content acquisition detection unit 130 detects that the camera application has captured a still image or a video by driving the imaging unit 110, at least a part of the information included in the metadata of the acquired image content, preferably the above An image content acquisition signal including one reference information is generated, and the generated image content acquisition signal is transmitted to the schedule information mapping unit 140.

The schedule information mapping unit 140 receives the image content acquisition signal from the image content acquisition detection unit, and extracts reference information included in the image content acquisition signal. The schedule information mapping unit 140 searches for a schedule including items matching the extracted reference information by inquiring the schedule information management unit. Specifically, the schedule information mapping unit 140 extracts the reference information generated based on the video content metadata, for example, the video content capture time and/or the video content capture location from the video content acquisition signal, and the schedule information The management unit searches for schedule information having the same time and/or place as the video content capture time and/or video content capture location.

If, when a schedule having an item matching the extracted reference information is searched, the schedule information mapping unit 140 determines the searched schedule as a schedule related to the captured video content (hereinafter referred to as'related schedule'), and The video content is mapped and stored with the related schedule information. Specifically, when schedule information having the same time and/or place as the video content shooting time and/or the video content shooting location is searched, the schedule information mapping unit 140 determines the searched schedule information as the related schedule information. It is transmitted to the video content management unit 150. In this case, the photographing location of the image content information and the location information of the schedule may be displayed in different formats, and the schedule information mapping unit 140 may be configured to compare location information of different formats. For example, the photographing location information of the image content information may be stored as GPS coordinates and an address of the photographing location, and since a place in schedule information is input by a user, it may be stored in abbreviated notation such as a building name or a business name. In this case, the schedule information mapping unit 140 may be configured to convert the abbreviated place information in the schedule information into GPS coordinates or a standard address using the geographic information DB and compare it with the photographed location in the image content information.

The process of associating (mapping) the acquired image content with the schedule will be described in more detail with reference to FIG. 2 as follows.

2 is a diagram for explaining a mapping process between acquired image content and schedule.

Referring to FIG. 2, the video content metadata includes a plurality of pieces of information, such as a shooting time, a shooting location, a resolution, a file size, and an ISO, among which information used to search for a related schedule, that is, reference information, is shooting. It is at least one of time and location. The reason for using at least one of a photographing time and a photographing location as reference information for searching a related schedule is as described above.

In the example of FIG. 2, the image content (IMG 1) is the image content that has just been captured by the imaging unit 110, and the image content acquisition detection unit 130 determines the shooting time and the shooting location as reference information in the image content metadata. The extracted and included in the image content acquisition signal is transmitted to the schedule information mapping unit 140. The schedule information mapping unit 140 searches the schedule information management unit 120 to search for a schedule including received reference information, that is, an item that matches the shooting time and the shooting location. Among the plurality of schedules stored in the schedule information management unit 120, the time of the k-th schedule SCH(k) is between 13:00 and 15:00 on March 12, 2019, and the location is the NHN office building. Since the time information of this schedule (SCH(k)) includes the recording time of the acquired video content (IMG 1), 2019.03.12 13:04:03, the schedule information mapping unit 140 uses this schedule (SCH(k)). It is determined that the time information of) coincides with the shooting time. The location information of this schedule (SCH(k)) is the NHN office building, which is the name of the building, and the shooting location on the video content information is a standard address. As described above, the schedule information mapping unit 140 inquires the geographic information DB and Find a standard address and match it with the location of the shoot. The standard address of the NHN office building searched by querying the geographic information DB is 16, Daewangpangyo-ro 645beon-gil, Bundang-gu, Seongnam-si, Gyeonggi-do, and matches the shooting location on the video content information, so the schedule information mapping unit 140 It is determined that the location information matches the photographing location. Since the time and location information coincides with both the shooting time and the shooting location of the video content, the schedule information mapping unit 140 determines this schedule SCH(k) as a related schedule of the acquired video content IMG 1 This schedule SCH(k) is mapped and stored in the content meta information. Referring to FIG. 2, it can be seen that SCH(k) is added as a related schedule to meta data after being mapped.

In the above, the case where the reference information includes both a time and a place has been described as an example, but as described above, the reference information may include only one of a time and a place. For example, when the reference information is time, it is possible to search and map a schedule in which time information of the schedule matches the photographing time.

If a schedule having an item matching the extracted reference information is not searched, the schedule information mapping unit 140 terminates the process for mapping the acquired video content and the schedule.

According to an embodiment of the present invention, when a schedule related to the acquired video content is not registered, the user additionally designates a schedule related to the video content, and associates the added schedule with the acquired schedule (by mapping). You can make it manageable. For example, when schedule information having the same time and place as the video content capture time and/or video content capture location is not searched, the schedule information mapping unit 140 checks whether a schedule related to the acquired video content is generated. It may be configured to generate and display a first user input interface for display.

3 is a diagram illustrating an example of a first user input interface.

Referring to FIG. 3, the first user input interface 100 is displayed in the form of a message window. The message window 100 includes, for example, a message 110 asking "Would you like to add a schedule with respect to this photo?" and user input buttons 121 and 122 for inputting a user's selection for adding a schedule. It can be a message window to say. The user may select whether to add a schedule through the first user input interface.

In the above-described example, when the user selects the "Yes" button 121 to request addition of a schedule, the schedule information mapping unit 140 receives a user input for requesting creation of a related schedule through the first user input interface. It may be configured to receive and, in response to a user input requesting the creation of the related schedule, to execute the schedule management unit to provide a schedule generation user interface. When the user inputs new schedule information through the provided schedule generation user interface, the schedule information mapping unit 140 determines the schedule information input through the schedule generation user interface as a related schedule, and sends the schedule information to the video content management unit 150. send. In contrast, in the above example, when the user selects the "No" button 122, the schedule information mapping unit 140 ends the process for mapping the acquired video content to the schedule.

For the search efficiency and accuracy of the related schedule, it is preferable that the reference information includes both the shooting time and the shooting location. However, in some cases, one of the time or place may be changed among the scheduled schedule, but there may be a case where the user does not modify the changed time or place.

An embodiment of the present invention is for mapping the acquired video content and the schedule even in such a case, and when schedule information matching only one of the video content shooting time and the video content shooting location is searched, for example, among the stored schedule, When a schedule with location information that matches the shooting time of the acquired video content matches the shooting location but does not match the shooting location, or when the location information that matches the shooting information of the acquired video content matches the shooting time When a schedule having time information that does not match with is searched, the schedule information mapping unit 140 may be configured to select the schedule as a candidate-related schedule once. In this case, the schedule information mapping unit 140 may be configured to generate and display a second user input interface for confirming whether to associate the searched candidate related schedule information with the obtained video content. The second user input interface informs the user that a schedule matching only one of the shooting time or the shooting location of the acquired video content has been found, and asks whether to store the searched schedule in association with the acquired video content (by mapping). And, it may include an input means that can be input by the user.

4 is a diagram illustrating an example of a second user input interface.

Referring to FIG. 4, for example, the second user input interface 200 may be provided in the form of a message window. The message window 200 says "A schedule that is allegedly related to this photo has been retrieved." It may be a message window including a search result message 210 and a candidate-related schedule display unit 220 that displays the contents of the searched schedule, that is, the candidate-related schedule. The candidate-related schedule display unit 220 may display some information on the candidate-related schedule, and may include a link for accessing the schedule. In this case, when the user touches the candidate-related schedule display unit 220, the schedule information mapping unit 140 may be configured to display detailed information of the corresponding schedule by executing the schedule information management unit through a link. On the other hand, in the message window 200, for example, a user acceptance confirmation message display unit 230 asking whether to map a candidate-related schedule such as "Would you like to associate this schedule with this photo?", and a selection regarding whether or not the user's schedule is related. Buttons 241 and 242 that can be input may be provided together. In the example of FIG. 3, when the user touches the "Yes" button 241, the schedule information mapping unit 140 requests that the candidate-related schedule information be associated with the acquired video content through a second user input interface. Receiving a requested user input, and in response to a user input requesting association of the candidate-related schedule information and the obtained video content, determine the candidate-related schedule information as the related schedule information, and transmit it to the video content management unit 160 do.

According to an embodiment of the present invention, the schedule information mapping unit 140 modifies, among the candidate-related schedule information, an item that does not match the reference information item of the acquired video content as reference information of the acquired video content. Thus, it may be configured to map to the acquired image content. That is, when any one of the time information and the location information of the candidate-related schedule mapped to the video content finally obtained as the related schedule by the user input is different from the shooting time and the shooting location of the video content information, the schedule information mapping unit 140 ) May be configured to correct inconsistent information of the relevant schedule to match the video content information.

5 is a diagram illustrating an example in which schedule information is modified based on image content information.

The k-th schedule SCH(k) of FIG. 5 is a schedule finally selected as a related schedule through the above-described process, that is, a process of processing a request for registering a related schedule of a user input through the second user input interface.

The example of FIG. 5 is the same as that shown in FIG. 2 except for the location information of the k-th schedule SCH(k), and thus descriptions of the same items will be omitted.

Referring to FIG. 5, since the k-th schedule (the place information of SCH(k) is the company name'Cheongmaek, a patent corporation', and the shooting location on the video content information is a standard address, the schedule information mapping unit 140 is Search the DB to find the standard address of the patent corporation Cheongmaek and compare it with the shooting location The standard address of NHN office building searched by searching the geographic information DB is 39, Teheran-ro 25-gil, Gangnam-gu, Seoul, so the location of the video content information Daewangpangyo-ro, Bundang-gu, Seongnam-si, Gyeonggi-do It is inconsistent with 645beon-gil 16. The schedule information mapping unit 140 corrects the location information that is inconsistent with the video content information to match the photographing location on the video content information. The conversion of the place notation format can be performed in the same manner as that of the place before the modification, and the conversion of the place notation format may be performed using the geographic information DB as described above. In "16, Daewangpangyo-ro 645beon-gil, Bundang-gu, Seongnam-si, Gyeonggi-do," and since the display format of the place information before modification is the name of the company, the schedule information mapping unit 140 uses the geographic information DB to "16, Daewangpangyo-ro 645beon-gil, Bundang-gu, Gyeonggi-do," It may be configured to search for a company name located in and store the location information by modifying the location information to the searched company name “NHN.” Subsequently, the schedule information mapping unit 140 stores the modified k-th schedule SCH′(k). Mapped to meta-information of the acquired image content IMG1 and stored in. Referring to Fig. 5, it can be seen that a schedule SCH'(k) modified to a related schedule is added to meta data after the mapping is performed.

In contrast, when the user selects the "No" button in the example of FIG. 4, the schedule information mapping unit 140 terminates the process for mapping the acquired video content to the schedule.

The image content management unit 150 provides the acquired image content in association with related schedule information. Specifically, the video content management unit 150 according to an embodiment of the present invention identifies a related schedule mapped to metadata of a plurality of video contents, and includes an album (schedule) including one or more video contents mapped to the same related schedule. Video content folder).

6 is a diagram illustrating an example of creating an album (schedule video content folder) including one or more video contents mapped to the same related schedule.

Referring to FIG. 6, the video content management unit 150 separately collects video content mapped to each schedule and generates a video content album SIF for each of a plurality of schedules. In the example of FIG. 6, the schedule album displays five schedule video content folders SIF1 to SIF5 in which video content associated with each of the five schedules is stored. When the user touches the fourth schedule video content folder SIF4, it is switched to the schedule album interface (SIUI) in which only the video content related to the schedule 4 is separately displayed, as shown in the right screen of FIG. 6. The schedule album interface SIUI includes a schedule information display unit SD that displays at least some information of a corresponding schedule. The schedule album interface SIUI displays a plurality of video contents img 1 to img7 mapped to the schedule.

In addition to the creation of the schedule video content folder, the video content management unit 150 identifies a related schedule mapped to metadata of a plurality of video contents, and provides information on one or more video contents mapped to the same related schedule, It may be configured to be displayed on a schedule information management user interface provided by the schedule information management unit.

7 is a diagram illustrating a schedule information management user interface in which information on image contents mapped to a schedule is displayed according to an embodiment of the present invention.

The schedule information management user interface of FIG. 7 is provided by the schedule information management unit 120. The video content management unit 150 identifies a related schedule mapped to metadata of a plurality of video contents, and manages information on one or more video contents mapped to the same related schedule, and schedule information provided by the schedule information management unit. Display in the user interface. Referring to FIG. 7, on the schedule information management user interface, thumbnails representing video contents related to a schedule and a video content index indicating the number of video contents mapped to the schedule are displayed. The thumbnail may include a link for accessing a schedule album in which only video contents mapped to a corresponding schedule are collected. When the user touches the thumbnail, the video content management unit 150 may be configured to display a linked schedule album. Referring back to FIG. 7, among the schedules registered in the schedule information management unit 120, six video contents mapped and stored in “Seo Seoul Rounding” on March 9, and video contents mapped and stored in “Meeting” on March 12 It can be seen that there are 3 video contents mapped on March 19 and 5 video contents mapped on March 21 during the "business trip" period from March 18 to March 21. By touching the thumbnails displayed on each schedule, the user may collect and store only the image contents mapped to the schedule and move to the stored schedule image contents folder, and check individual image contents photographed in relation to the schedule.

For example, when the video content thumbnail of March 9 is touched in the schedule management user interface shown on the left side of FIG. 7, the schedule information management unit 120 displays the schedule management user interface, which is generated for the schedule. Switch to the schedule album interface (SIUI). The converted schedule album interface (SIUI) is as shown on the right side of FIG. 7, and its configuration is the same as that of the schedule album interface (SIUI) of FIG. 6. Since the related schedule is mapped to meta information of the image content and stored, the user can search for the image content using information included in the related schedule. Information included in the schedule may include time, place, and attendees. For example, a user may input a search word through a search UI provided on a video content viewer, and the video content search engine searches for video content mapped to a schedule including the search word, and converts the searched video content to video content. It can be configured to display in the viewer. For example, in the example of FIG. 5, when "Representative A" is entered in the video content search box, the video content search engine searches for schedule information mapped to metadata and retrieves image content (IMG1) with "Representative A" as a participant. It can be included in the search result and displayed on the video content viewer. That is, according to the present invention, when searching for video content, schedule information mapped to metadata, for example, time, place, attendee, etc. may be used as a search word.

According to an embodiment of the present invention, the video content management unit 150 may be configured to provide a video content sharing interface that enables the video content mapped to a specific schedule to be shared with a related person.

For example, when a specific video content is selected from a video content viewer or a schedule album interface provided by default, the video content management unit 150 is a video content sharing interface configured to share the video content with the related person together with the video content. It can be configured to generate and display. In this case, the video content management unit 150 may be configured to search for a schedule mapped to the selected video content and determine a participant of the searched schedule as a related person to share the selected video content.

8 is a diagram illustrating an example of a video content sharing interface.

The video content sharing interface ISI includes a video content display area IDA, a display area SA related to sharing, and a sharing platform display area SPA. The selected video content is displayed in the video content display area IDA. Participants of a schedule mapped to the selected video content are displayed in the sharing-related display area SA. In the sharing platform display area SPA, a platform to share the selected video content is displayed. The sharing platform is a platform for transmitting the selected video content to the selected sharing related person, and may include, for example, an SNS, a multimedia short message, and the like. When a user subscribes to a plurality of SNS, the subscribed SNS may be displayed in the sharing platform display area (SPA).

The user may select some or all of the participants displayed in the display area SA related to sharing as a sharer. The user may select at least one of the platforms displayed in the shared platform display area SPA. When the user selects a sharer and a platform, the video content management unit 150 transmits the selected video content to the selected sharer through the selected platform.

The video content displayed in the video content display area of FIG. 8 is img1 selected from the schedule album of FIG. 7. Since the schedule'Seo Seoul Rounding' is mapped to the video content img1, the video content management unit 150 extracts and shares "Jeon-Moo Kim", "CEO Lee", and "Sang-Moo Park" included in the participant information of the schedule'Seo-Seoul Rounding'. It is displayed in the relevant display area SA. Meanwhile, the video content management unit 150 displays a usable sharing platform, that is, a platform including an SNS or a multimedia message (MMS) to which a user has subscribed, on the sharing platform display area (SPA). In the example of FIG. 8, when “Jeon-Moo Kim” and “Sang-Moo Park” are selected as sharers, and the sharing platform is selected as a multimedia message (MMS), the video content management unit 150 searches the address book and “Park Sang-moo” and “ Checks the terminal number of "Jeon-Moo Kim", and transmits a multimedia message (MMS) including the video content img1 selected as the confirmed terminal number.

The above-described image content acquisition detection unit 130, schedule information mapping unit 140, and image content management unit 150 include software including commands required for processing each function, and a mobile terminal 10 that performs processing according to commands. ) Can be configured by the processor within. In this case, the software constituting the image content acquisition detection unit 130, the schedule information mapping unit 140, and the image content management unit 150 may be installed in the mobile terminal 10 in the form of an application.

Hereinafter, a method of managing the video content performed by the mobile communication terminal 10 described above in association with schedule information will be described in detail with reference to FIGS. 9 to 11.

9 is a flowchart illustrating a process of a video content management method according to an embodiment of the present invention.

First, the image content acquisition detection unit 130 detects acquisition of image content by the imaging unit and generates an image content acquisition signal (S1100). Specifically, when the image content acquisition detection unit 130 detects that the camera application has captured a still image or a video by driving the imaging unit 110, at least part of the information included in the metadata of the acquired image content, preferably In other words, an image content acquisition signal including the above-described reference information is generated, and the generated image content acquisition signal is transmitted to the schedule information mapping unit 140.

The schedule information mapping unit 140 receives the image content acquisition signal from the image content acquisition detection unit, and extracts collation target image content information included in the image content acquisition signal (S1200).

The schedule information mapping unit 140 searches for a schedule including an item matching the extracted reference information by inquiring the schedule information management unit (S1300).

If, when a schedule having an item matching the extracted collation target image content information is searched, the schedule information mapping unit 140 determines the searched schedule as a schedule related to the captured image content (hereinafter referred to as'related schedule'). (S1400).

Subsequently, the schedule information mapping unit 140 maps and stores the acquired video content with the related schedule information determined in S1400 (S1500). The mapping processing of the video content and the schedule information by the schedule information mapping unit 140 has been described with reference to FIG. 2, and thus a detailed description thereof will be omitted here.

When the mapping of the schedule information and the video content is completed, the video content management unit 150 provides the obtained video content in association with the related schedule information (S1600). The video content management unit 150 identifies a related schedule mapped to the metadata of a plurality of video contents, and creates an album (schedule video content folder) including one or more video contents mapped to the same related schedule, or the same related schedule Since information on one or more video contents mapped to can be displayed on the schedule information management user interface provided by the schedule information management unit, a detailed description is omitted here.

If a schedule having an item matching the extracted reference information is not searched, the schedule information mapping unit 140 terminates the process for mapping the acquired video content and the schedule.

According to an embodiment of the invention, when a schedule related to the acquired video content is not registered, the user additionally designates a schedule related to the video content, and manages the added schedule in association with the acquired schedule (by mapping). You can do it.

10 is a flowchart illustrating a process of specifying an additional schedule related to the acquired image content and mapping the added schedule to the image content.

The processes (S1310 to 1410) shown in FIG. 10 are performed after the image content information extraction process (S1200) to be matched included in the image content acquisition signal of FIG. 8 is performed.

First, the schedule information mapping unit 140 checks the schedule information management unit and determines whether there is a schedule that matches all of the extracted reference information. The schedule information mapping unit 140, for example, when the reference information is a photographing time and a photographing location, determines whether the schedule time information and the location information coincide with both the photographing time and the photographing location of the video content (S1300).

As a result of the determination, if there is a schedule that matches all of the reference information, the schedule information mapping unit 140 determines the searched schedule as a schedule related to the captured video content (hereinafter referred to as “related schedule”) (S1400). Processing after S1400 is performed in the same manner as described in FIG. 8.

As a result of the determination, if there is no schedule that matches all of the reference information, the schedule information mapping unit 140 generates and displays a first user input interface for checking whether a schedule related to the acquired video content is generated (S1320). . Since the first user input interface has been described with reference to FIG. 3, detailed descriptions are omitted here.

The schedule information mapping unit 140 determines whether a user input requesting generation of a related schedule is received through the first user input interface (S1330).

When a user input requesting generation of a related schedule is received through the first user input interface, the schedule information mapping unit 140 executes the schedule management unit in response to the user input requesting the generation of the related schedule to generate a schedule. An interface is provided (S1340).

When the user inputs new schedule information through the provided schedule generation user interface, the schedule information mapping unit 140 receives the added schedule information (S1350) and converts the schedule information input through the schedule generation user interface into a related schedule. It is determined and transmitted to the video content management unit 150 (S1400).

If a user input for requesting creation of a related schedule through the first user input interface is not received in S1330, the schedule information mapping unit 140 terminates the process for mapping the acquired video content to the schedule (S1410).

Meanwhile, in some cases, one of the time or place may be changed among the scheduled schedule, but there may be a case where the user does not modify the changed time or place.

An embodiment of the present invention is for mapping the acquired video content and the schedule even in such a case, and when schedule information matching only one of the video content shooting time and the video content shooting location is searched, for example, among the stored schedule, When a schedule with location information that matches the shooting time of the acquired video content matches the shooting location but does not match the shooting location, or when the location information that matches the shooting information of the acquired video content matches the shooting time When a schedule having time information that does not match with is searched, the schedule information mapping unit 140 may be configured to select the schedule as a candidate-related schedule once.

11 is a flowchart illustrating a process of automatically correcting and mapping a schedule when the schedule does not match part of the reference information of video content.

The processes S1311 to S1314 of FIG. 11 are performed after S1310 of FIG. 9. That is, the processes shown in FIG. 10 are performed when a schedule that matches all of the reference information of the video content is not searched.

Referring to FIG. 11, first, the schedule information mapping unit 140 determines whether there is a schedule that matches some of the reference information of the video content (S1311). For example, the schedule information mapping unit 140 inquires the schedule information management unit 120, and the time information corresponding to the shooting time of the acquired video content coincides, but the location information does not match the shooting location. It is determined whether there is a schedule with time information that matches the location information of the video content and does not match the recording time.

As a result of the determination, when a schedule matching some of the reference information of the video content is searched, the schedule information mapping unit 140 selects the schedule as a candidate-related schedule (S1312).

Subsequently, the schedule information mapping unit 140 generates and displays a second user input interface for confirming whether to associate the searched candidate related schedule information with the obtained video content (S1313). Since the second user input interface has been described above with reference to FIG. 4, detailed descriptions are omitted here.

The schedule information mapping unit 140 determines whether a user input agreeing to the mapping of the corresponding candidate-related schedule is received through the second user input interface (S1314).

When the user agrees to map the candidate-related schedule to the video content through the second user input interface, the schedule information mapping unit 140 responds to a user input requesting the association between the candidate-related schedule information and the acquired video content. In response, inconsistent information of the relevant schedule is corrected to match the video content information (S1315). Since the automatic correction of schedule information has been described with reference to FIG. 5, detailed descriptions are omitted here.

Subsequently, the schedule information mapping unit 140 determines the candidate-related schedule information as the related schedule information and transmits it to the video content management unit 160 (S1400).

In S1314, if the user does not agree to map the corresponding candidate-related schedule to the video content through the second user input interface, the schedule information mapping unit 140 ends the process for mapping the acquired video content and the schedule.

In the above, only the case where the image content is photographed by the imaging unit 110 has been described, but the image content may include not only what was photographed by the imaging unit 110 but also what was transmitted from another person or downloaded from a web page. . In other words, it is possible to map photos or videos that are transmitted from others through SNS or downloaded to web pages with schedule information. For example, when a photo is received from another person through SNS, related schedule information may be searched based on a download time included in the metadata of the transmitted photo, and the corresponding photo may be mapped to and stored in the searched schedule information. All of the above-described processing and operations may be performed in the same manner for video content transmitted from another person or downloaded video content. For example, the image content acquisition detection unit 130 may detect reception or download of image content through SNS, and may generate an image content acquisition signal, and the schedule information mapping unit 140 responds to the image content acquisition signal. Thus, the processing of S1200 to S1600 may be performed.

In the detailed description of the present invention described above, it has been described with reference to preferred embodiments of the present invention, but those skilled in the art or those of ordinary skill in the art, the spirit of the present invention described in the claims to be described later. And it will be understood that various modifications and changes can be made to the present invention within a range not departing from the technical field.

10: mobile communication terminal 110: imaging unit
120: schedule information management unit 130: image content acquisition detection unit
140: schedule information mapping unit 150: video content management unit

Claims (20)

An imaging unit;
A schedule information management unit for generating and storing user schedule information;
An image content acquisition detector configured to detect acquisition of image content by the imaging unit and generate an image content acquisition signal;
Receive the image content acquisition signal from the image content acquisition detection unit, query the schedule information management unit to extract the image content capture time and the image content capture location from image content metadata included in the image content acquisition signal, The schedule information management unit is searched for schedule information having the same time and place as the video content shooting time and the video content shooting location, and the searched schedule information is determined as related schedule information, and the acquired video content is the related schedule. A schedule information mapping unit that maps and stores the information; And
An image content management unit that provides the acquired image content in association with the related schedule information
Including,
The schedule information mapping unit,
When schedule information having the same time and place as the video content capturing time and the video content capturing location is searched, the searched schedule information is determined as the related schedule information and transmitted to the video content management unit,
When schedule information matching only one of the video content shooting time and the video content shooting location is searched, the searched schedule information is determined as candidate-related schedule information, and it is checked whether to associate the candidate-related schedule information with the obtained video content. Create and display a second user input interface for
When schedule information having the same time and place as the video content capturing time and the video content capturing location is not searched, generating and displaying a first user input interface for checking whether a schedule related to the acquired video content is generated
Mobile communication terminal.
delete delete delete The method of claim 1, wherein the schedule information mapping unit,
When schedule information having the same time and place as the video content shooting time and the video content shooting location is not searched,
Receiving a user input requesting creation of a related schedule through the first user input interface,
In response to a user input requesting the creation of the related schedule, the schedule information management unit is executed to provide a schedule generation user interface,
Determining schedule information input through the schedule creation user interface as the related schedule and transmitting the schedule information to the video content management unit
Mobile communication terminal.
delete The method of claim 1, wherein the schedule information mapping unit,
When schedule information matching only one of the video content shooting time and the video content shooting location is searched,
Receiving a user input requesting to associate the candidate-related schedule information with the acquired video content through the second user input interface,
In response to a user input requesting the association between the candidate-related schedule information and the acquired video content, determining the candidate-related schedule information as the related schedule information and transmitting the result to the video content management unit.
Mobile communication terminal.
The method of claim 7, wherein the schedule information mapping unit,
Modifying an item that does not match the reference information item of the acquired video content among the candidate-related schedule information as reference information of the acquired video content and mapping it to the acquired video content
Mobile communication terminal.
The method of claim 8, wherein the schedule information mapping unit,
In order to correct the candidate-related schedule information, the schedule information management unit is executed and displayed,
Receives a modification of the candidate-related schedule information inputted by the schedule information management unit, and among the candidate-related schedule information, an item that does not match the reference information item of the acquired video content is modified as the reference information of the acquired video content. Mapping to the acquired video content
Mobile communication terminal.
The method of claim 1,
The video content management unit,
Displaying information on one or more video contents mapped to the related schedule information on a schedule information management user interface provided by the schedule information management unit
Mobile communication terminal. An image content management method performed by a mobile communication terminal including an imaging unit, a schedule information management unit, an image content acquisition detection unit, a schedule information mapping unit, and an image content management unit,
Detecting, by the image content acquisition detection unit, image content acquisition by the image pickup unit, and generating an image content acquisition signal;
The schedule information mapping unit receives the image content acquisition signal from the image content acquisition detection unit, and queries the schedule information management unit to obtain the image content capture time and image content from the image content metadata included in the image content acquisition signal. Extracting a photographing position;
Searching a schedule including an item matching the extracted reference information by querying the schedule information mapping unit by the schedule information mapping unit;
Determining, by the schedule information mapping unit, a searched schedule as a related schedule related to the captured image content, and mapping and storing the obtained image content to the determined related schedule information; And
Providing, by the video content management unit, the acquired video content in association with related schedule information
Including,
Mapping and storing the acquired video content to the determined related schedule information,
When schedule information having the same time and place as the video content capturing time and the video content capturing location is searched, the searched schedule information is determined as the related schedule information and transmitted to the video content management unit,
When schedule information matching only one of the video content shooting time and the video content shooting location is searched, the searched schedule information is determined as candidate-related schedule information, and it is checked whether to associate the candidate-related schedule information with the obtained video content. Create and display a second user input interface for
When schedule information having the same time and place as the video content capturing time and the video content capturing location is not searched, generating and displaying a first user input interface for checking whether a schedule related to the acquired video content is generated
The method characterized in that.
delete delete delete The method of claim 11,
When schedule information having the same time and place as the video content capture time and video content capture location is not searched, the schedule information mapping unit,
Receiving a user input requesting creation of a related schedule through the first user input interface;
Providing a schedule generation user interface by executing the schedule information management unit in response to a user input requesting the related schedule generation; And
A method of further performing the step of determining schedule information input through the schedule creation user interface as the related schedule and transmitting the determined schedule information to the video content management unit.
delete The method of claim 11,
When schedule information matching only one of the video content capture time and video content capture location is searched, the schedule information mapping unit,
Receiving a user input requesting to associate the candidate-related schedule information with the acquired video content through the second user input interface; And
In response to a user input requesting the association between the candidate-related schedule information and the acquired video content, determining the candidate-related schedule information as the related schedule information and transmitting the information to the video content management unit.
The method of claim 17, wherein the schedule information mapping unit,
A method of further performing the step of modifying an item of the candidate-related schedule information that does not match the reference information item of the acquired video content as reference information of the acquired video content and mapping it to the acquired video content.
The method of claim 18,
The schedule information mapping unit,
Executing and displaying the schedule information management unit in order to correct the candidate related schedule information; And,
Receives a modification of the candidate-related schedule information inputted by the schedule information management unit, and among the candidate-related schedule information, an item that does not match the reference information item of the acquired video content is modified as the reference information of the acquired video content. The method of further performing the step of mapping to the acquired image content.
The method of claim 11,
And displaying, by the video content management unit, information on one or more video contents mapped to the related schedule information on a schedule information management user interface provided by the schedule information management unit.

Images