KR20140088753A - Apparatus and method for generating a still image from a moving picture in camera device and/or portable device having a camera - Google Patents

Abstract

An image processing method of a device having a camera comprises the steps of setting an image extraction condition to play a video; extracting an image satisfying the image extraction condition from the played video as a still image; and generating a folder and storing the extracted still image in the generated folder.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for generating a still image using a moving image in a terminal device having a camera device and a camera.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method for a terminal apparatus having a camera apparatus and a camera, and more particularly, to an apparatus and method for extracting an image from a moving image to generate a still image.

A terminal device including a camera device and a camera can photograph and store a moving image using a camera, and can generate a still image from the stored moving image. A method for generating a still image from the moving image is as follows. A user first executes a moving image. The user watches a moving image and pauses the desired moving image, and then executes a program such as Photoshop to capture the corresponding screen as a still image.

However, since the conventional still image editing method requires the user to manually capture a screen while watching a moving picture, it takes a lot of time and work has been troublesome.

The present invention proposes an apparatus and a method for automatically extracting meaningful images of moving images from a terminal device having a camera device and a camera. In addition, the present invention proposes an apparatus and a method for automatically extracting meaningful images of moving images from a terminal device having a camera device and a camera, and editing the extracted images into various types of still images.

The image processing method of an apparatus having a camera according to an embodiment of the present invention includes the steps of reproducing a moving image by setting an image extraction condition and extracting an image according to the image extraction condition from the moving image to be reproduced as a still image And creating a folder, and storing the extracted still image in the created folder.

According to another aspect of the present invention, there is provided an image processing method for an apparatus having a camera, the method comprising: reproducing an animation by setting an image extraction condition; extracting an image according to the image extraction condition from a still image, A folder, and storing the extracted still image in the generated folder; and displaying the extracted images in the folder or folder according to the number of divisions and style types selected when the editing mode is selected in the process of displaying the stored image or the extracted image. Wherein the step of editing the still image comprises the steps of displaying a divided selection display area and displaying the images corresponding to the number of divisions selected in the divided selection display area as one And displaying the divided image on the divided screen, A step of changing a frame of images of a divided screen displayed according to a selected style type and displaying a style selection display area including a selected style type, .

According to another aspect of the present invention, there is provided an image processing apparatus comprising: a camera for capturing a moving image; a storage unit for storing the moving image; And a display unit for displaying the extracted images under thumbnails under the control of the control unit. The display unit displays thumbnails of the extracted images, .

 The present invention can be applied to an image having a user's desired scene, for example, an image with emotional change such as a smiling scene, an image with a change such as addition or reduction of a person, and / Images with scene changes can be automatically extracted and edited as still images. Also, the still image processing method according to the embodiment of the present invention can combine the extracted images into various shapes and edit them into still images.

1 is a view showing a configuration of a camera device according to an embodiment of the present invention;
2 is a view for explaining a method of extracting a still image from a moving image in a camera device according to an embodiment of the present invention;
FIGS. 3A to 3C are diagrams illustrating an example of extracting a still image from a moving image and editing the extracted image in the camera apparatus according to the embodiment of the present invention
4 is a flowchart illustrating a procedure for extracting a still image from a moving image in a camera apparatus according to an embodiment of the present invention.
5 is a flowchart illustrating a procedure for extracting images corresponding to image extraction conditions set during movie playback and storing the images as still image images according to an embodiment of the present invention
6A to 6C are diagrams for explaining a processing operation of an image displayed while performing the procedure shown in FIG. 5;
7 is a view for explaining an operation of storing a still image extracted from a moving image in a storage unit;
8 is a flowchart showing a procedure for extracting images from a moving image according to an embodiment of the present invention,
9 is a flowchart illustrating a procedure for compositing images and editing them into still images according to an embodiment of the present invention
10A and 10B are views for explaining the operation of switching from the state of displaying a still image to the edit mode and the structure of a screen displayed in the edit mode according to the embodiment of the present invention
11A to 11F are diagrams showing an example in which images are synthesized and edited into still images while performing the procedure as shown in FIG. 9
12 is a diagram showing a configuration of a portable terminal for performing a photographing operation according to an embodiment of the present invention

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible.

The present invention can be applied to a terminal device having a camera device and / or a camera (hereinafter referred to as a camera device for the sake of convenience) The extracted images can be configured as respective frame images and stored as still images. In addition, the present invention combines images extracted from moving images in various forms in a camera device to generate a still image in which a plurality of images are combined.

1 is a diagram showing a configuration of a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the controller 100 controls the overall operation of the camera device. In addition, the control unit 100 controls moving image shooting, and automatically controls the operation of generating images as still images by automatically extracting images having a predetermined condition from a moving image or a moving image. In addition, the controller 100 controls the generation of the still image by synthesizing the plurality of images by editing the generated still images with the preset frame number and style.

The camera 120 captures a still image and a moving image under the control of the controller 100.

The storage unit 110 may include a program memory for storing a camera operation program and a program according to an embodiment of the present invention, and a data memory for storing images to be photographed. In addition, the memory 110 stores motion pictures photographed in the photographing mode according to an embodiment of the present invention, and stores still images generated under the control of the controller 100. [

The display unit 130 displays an image to be photographed under the control of the control unit 100. The display unit 130 may be an LCD or an OLED. The input unit 140 generates inputs for controlling the shooting of the camera apparatus. The display unit 130 and the input unit 140 may be integrated touch screens.

The camera apparatus having the above-described configuration can take a moving picture, and the taken moving picture is stored in the storage unit 110. [ Also, the storage unit 110 may receive moving pictures from an external device or an external memory in addition to the moving pictures captured by the camera 120 and store the moving pictures. In the embodiment of the present invention, the camera device reproduces a moving image captured from the camera 120 or a moving image stored in the storage unit 110, extracts images having a predetermined characteristic as a still image, and outputs the extracted images to the storage unit 110 It can be saved as still image. In addition, the camera device according to the embodiment of the present invention can edit a plurality of images selected from the still images extracted as described above into one still image, and edit the images in a specific style at the time of editing.

2 is a diagram for explaining a method of extracting a still image from a moving image in a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 2, the controller 100 controls the camera 120 in step 210,

Or receive a moving picture from an external device. In order to reproduce the moving image 210, the user can select and reproduce the desired moving image in the menu state, such as the reference numeral 220. At this time, in the case of the Samsung mobile terminal, the menu path for the video playback may be Videoplayer> Detail View> Best videoshot, and may also be Gallery> Detail View> Best Videohot or Video Editor> Best Videoshot. Accordingly, when it is desired to perform a mode for extracting a still image by playing back the moving image, the controller 110 provides a menu path for moving image reproduction and image extraction in step 220, When the specific video is reproduced (i.e., when the best video shot is executed), the controller 100 reproduces the video in step 230, displays the video on the display 130, and extracts images having the set characteristics. Here, the feature of the image extraction is that a scene change such as a facial expression (for example, a smiling face smile), a change in the number of figures (for example, increase or decrease of a face) and / (Scene Change), and extracts images satisfying the conditions to generate a still image.

After extracting images having the characteristics of the conditions set in the moving image as described above, the controller 100 generates a folder of the storage unit 110 in step 240 and saves the extracted images as a still image in the created folder . In addition, the extracted images can be shared with other applications. In the embodiment of the present invention, it is assumed that one of the sharing functions has a photo editor application. That is, the controller 100 extracts images satisfying the set condition from the moving image in step 230, selects a photo editing application among the applications that can be shared, such as 245, in step 240, A plurality of images may be synthesized in a set style to edit the image, and then the edited image may be stored as a still image in the storage unit 110. In step 240, the control unit 100 stores the extracted images in the storage unit 110, stores the images stored in the storage unit 110 in one folder, and performs a photo editing function using the still images of the folder .

Referring to FIGS. 3A to 3C, when the user requests video reproduction according to the embodiment of the present invention, the controller 100 displays a video menu 315 on a screen displayed as 310 of FIG. 3A in step 220, The moving picture menu includes a best video image for extracting and processing a still image from a moving picture according to an embodiment of the present invention. If the user selects the Best Videoshot in the state of displaying the menu 315, the controller 110 extracts images according to the set conditions at 230, and the extracted image is displayed on the display 130 as shown in 320 of FIG. In this case, in the embodiment of the present invention, the image extraction condition is a condition for determining whether the number of persons is changed by detecting faces of the image (hereinafter referred to as " (Hereinafter referred to as " Smile ") for determining whether or not the emotion has changed by recognizing the face area (in the embodiment of the present invention, smile detection is assumed to detect smile) And a condition (hereinafter referred to as a scene) for judging whether or not a similar image is detected by scene change detection and scene change detection. However, the image extraction criterion can be added as needed, for example, anger, surprise, highlight (scene with large sound), pet (scene with animal), and so on.

Here, a normal face recognition method can be used as a method of detecting the face region and determining the change of emotion (here, smile) in the detected face region. In addition, the scene extraction condition is expressed as an RGB histogram by analyzing the R, G, and G values of each image, and the highest frequency value in which the R, G, and B values of each image frequently appear in the histogram is compared The maximum values of the two images are similar), then it can be determined by comparing the highest frequency values of the two images. That is, if the difference between the frequency values is within a specific reference value, the image is determined to be the same image. If the difference is outside the reference value, the image is regarded as another image (i.e., scene change). Here, the specific reference value may be determined by an experimental value.

3A shows an example in which all is selected in the area 325 in FIG. 3A. In this case, the controller 100 extracts images satisfying any one of the face, smile, and scene conditions in the reproduced moving picture .

In step 240, the control unit 100 displays a save button, a cancel button, and a share via button 335 on the image screen 330 as shown in FIG. 3A in a state in which the still images are extracted according to the image extraction condition set in step 320 . At this time, when the save button is pressed, the controller 100 creates a folder in the storage unit 110 and stores the extracted images as a still image. When the sharing button 335 is pressed, the controller 100 displays shared menus such as 345 in the image 340 of FIG. 3B. Here, the sharing menu 345 includes a photo editor, and when the photo editor is selected, the controller 100 displays selected still images as an image frame of a set style, Assuming that three images (A4, A8, and A17) are selected as shown in 330 of FIG. 3A, the control unit 100 displays the still image Are combined and displayed as a single screen. When the save button is pressed in the state 350, the controller 100 senses this and stores the combined image of the plurality of images in the storage unit 110 as a still image.

In the embodiment of the present invention, the style for synthesizing the extracted images may be configured in various forms. 3C is a diagram for explaining an image frame structure of styles for synthesizing images according to an embodiment of the present invention. In the embodiment of the present invention, it is assumed that the image frame structure has four style styles A-style Ds, and each style has a frame structure for composing four images in two images. Here, it is assumed that the style is a multi-grid structure, and the style D has a structure in which the extracted images are overlaid on a background screen in which one of the images added by the user is blurred. In this case, the storage unit 110 may store image frames of each style for synthesizing extracted images according to an embodiment of the present invention. Here, the style frame is a picture frame structure for generating a still image by synthesizing a plurality of images. In the embodiment of the present invention, it is assumed that the style frame has four frame structures of style A-style D as shown in FIG. 3C.

4 is a flowchart illustrating a procedure for extracting a still image from a moving image in a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 4, when the user requests the moving picture playback through the input unit 140, the controller 100 detects the moving picture in step 411 and reproduces the moving picture in step 413. FIG. At this time, the moving image may be a moving image photographed through the camera 120, or may be a moving image stored in the storage unit 120 by downloading from an external device. Here, the video stored in the storage unit 120 may include a video taken by a user, a downloaded video, a shared video, and a video input through a computer.

At this time, it is possible to automatically extract an image of a scene that is significant in the moving picture during reproduction of the moving image, and to generate a still image. Here, the meaningful scene can be set by the user as an image extraction condition, and it is assumed that the face, the smile, the scene, and the like as described above in the embodiment of the present invention. The user can set all of the image extraction conditions as described above, and set some of these conditions. For this purpose, the user can set a mode for extracting a still image at the time of moving picture reproduction, that is, a best videoshot mode according to an embodiment of the present invention.

Accordingly, when the best video shot mode is set for the moving image reproduction, the controller 100 detects it in step 415 and extracts an image from the moving image to be reproduced according to the image extraction condition set in step 417. Upon completion of the image extraction, the controller 100 stores the images extracted in step 419 in the storage unit 110 as a still image.

5 is a flowchart illustrating a procedure for extracting images corresponding to an image extraction condition set during motion picture reproduction and storing the extracted images as a still image according to an embodiment of the present invention. 6A to 6C are views for explaining a processing operation of an image displayed while performing the procedure as shown in FIG. 5, and FIG. 7 is a view for explaining an operation of storing a still image extracted from a moving image in a storage unit .

5 to 7, when a function (i.e., best videoshot) for extracting a still image according to a set condition is set at the time of moving picture playback, the controller 100 detects it in step 511, and in step 513, And extracts the image from the moving image to be reproduced in accordance with the image. At this time, the image extraction condition may be provided in four forms of the face, the smile, the scene, and all including all of the conditions as described above. In the case of setting the best vidioshot, it is assumed that the image extraction condition is set to default all. 6A, all is set in the area 615 for displaying the extraction condition as shown in FIG. 6A, and the extracted image is displayed on the screen of the display unit 130 as a thumbnail having a set size, such as 610 or 620, Screen. The 610 screen shows a display example when the camera apparatus is in a portrait mode (i.e., a portrait display mode), and the 620 screen shows an example display when the camera apparatus is in a landscape mode (i.e., a landscape display mode).

When the image is extracted from the moving image as described above, the user can newly set the image extraction condition. Accordingly, when the user selects the area 615, the controller 100 displays selectable image extraction condition items (all, face, smile, scene) in the area 615 in step 517. If the user selects an image extraction condition (for example, a face, an smile, a scene, or a plurality of these conditions) in the displayed condition items, the control unit 100 detects this in step 519, And displays the images corresponding to the extraction condition on the display unit 130. [

In the embodiment of the present invention, it is assumed that the image extraction condition is set to default all in the best videoshot mode. However, the desired image extraction condition may be set at the time of executing the best videoshot mode. 6B, after the user selects a moving picture, the controller 100 sets a best videoshot mode, such as 635 of 630, and selects the image extracting area 615, the controller 100 detects the selection and selects each item of the image extraction condition item, ie all, face, smile, and scenes. If the user selects a desired extraction condition item in a state in which the image extraction conditions are displayed as shown in 645, the controller 100 senses the extracted extraction condition item and extracts images having the extracted extraction conditions while reproducing the moving image. 5, if the image extraction condition is selected in step 515, the image extraction condition is displayed in step 515. If the image extraction condition is selected by the user, It is detected in step 519 and the images satisfying the extraction condition selected in step 521 can be extracted and displayed.

At this time, the images extracted at the time of moving picture reproduction may be displayed as 610 or 620 of FIG. 6A. At this time, a large number of images may be extracted from the moving image during the moving image reproduction. Accordingly, the number of images extracted from the moving image can be variably provided, and the controller 100 can display the images on the display unit 130 in the order of extraction from the moving image. Also, in the image extraction condition, a large number of images that select items such as all can be extracted. In this case, it may be desirable to limit the number of images extracted to the moving image to an appropriate number. In the embodiment of the present invention, the number of images extracted by each image extraction condition can be limited (for example, maximum 12). It is also assumed that the extracted images have the same aspect ratio, and that the aspect ratio of the image extracted in the embodiment of the present invention is 16: 9. Preferably, the resolution of the extracted image is maintained at the original resolution of the moving image.

If it is not possible to extract the image corresponding to the image extraction condition set at the time of the moving image reproduction, the controller 100 displays on the display unit 130 that there is no extracted image in step 513 or step 521 as shown in FIG. 6C.

In addition, the extracted images can be reproduced in a moving picture format. Accordingly, if the playback item (e.g., quick play) indicated by 655 of 650 in FIG. 6B is selected in the state of performing the best videoshot mode, the controller 100 detects it in step 523, and in step 525, It is possible to reproduce the extracted images from the extracted time point by switching to the moving image playback mode.

In addition, the images thus extracted can be stored in the storage unit 110. If an image is extracted from the moving image and then a storage input is requested by the user, the controller 100 detects the image in step 527 and stores the extracted image in the storage unit 110 as a still image. 7 is a view for explaining an operation of extracting an image from a moving image and storing selected images according to an embodiment of the present invention. That is, when the image is extracted according to the image extraction condition set forth above, the controller 100 displays the extracted image on the display unit 130 as shown in 710 of FIG. At this time, an image extraction condition is displayed in the area 715 of the screen, and a select item for selecting an image to be stored on the screen such as 717 is displayed. At this time, if the user touches the select item 717, the controller 100 displays a check box 729 on the images displayed as 720 of FIG. When the user touches the displayed check box 729, the control unit 100 displays a check symbol indicating that the check box of the touched image is selected. The number of images selected in the display area 721 of the screen is displayed. Also, a share item 723, a delete item 725, and a save item 727 are displayed on the screen of 720. When the storage item 727 is touched in the above state, the control unit 100 creates a storage folder in the storage unit 110, such as 730, and stores the selected images as a still image. At this time, the storage folder may be a best videoshot folder. If the camera device is a Samsung mobile terminal, the image creates a separate folder in the gallery for storing images, and the folder name may be a best videoshot. At this time, the GALER storage file name may include a video source file name + an extraction time + a file unique ID. Here, the file unique ID is a file unique ID generated at the time of extracting the image from the moving image.

The user can confirm the stored image as described above. 7, if the user selects a cancel item or a back key, the controller 100 displays the images stored in the corresponding folder, such as 740. At this time, images stored as still images can be displayed by adding an item indicating that the images are stored as 743.

The camera apparatus according to the embodiment of the present invention can extract images according to the image extraction condition set when the moving image is reproduced and store the extracted images as a still image. Then, the extracted images can be edited into a synthesized still image. FIG. 8 is a flowchart illustrating a procedure for extracting images from a moving image according to an embodiment of the present invention, and then synthesizing the extracted images to edit as a still image.

Referring to FIG. 8, when the user requests the video playback through the input unit 140, the controller 100 detects the video in step 811 and plays back the video in step 813. At this time, if the best videoshot mode is set at the time of reproducing the moving image, the controller 100 detects it in step 815 and extracts an image from the moving image to be reproduced according to the image extraction condition set in step 817. Upon completion of the image extraction, the controller 100 buffers the extracted images. In this case, the process of extracting and processing the image in step 817 may be performed by the procedure shown in FIG. 5, and the extracted image may be processed as shown in FIGS. 6A to 6C and FIG.

In operation 817, the controller 100 displays the extracted images in a thumbnail form on the display unit 130, and may combine the images displayed by the user and edit the images as still images. If the user selects the best videoshot mode after selecting a video stored in the gallery folder of the storage unit 110, the controller 100 detects this in step 823 and displays the images stored in the gallery folder in thumbnail form on the display unit 130 . If the user selects the edit mode (photo edit mode) in the above state, the controller 100 recognizes this in step 819 and synthesizes the selected images from the images displayed in step 821 and edits the image as a still image.

If another function is selected in step 823 or step 819 of FIG. 8, the controller 100 detects the selected function and performs the corresponding function in step 831. FIG.

9 is a flowchart showing a procedure for compositing images and editing them into still images according to an embodiment of the present invention. 9 is a flowchart illustrating an operation procedure performed in step 821 of FIG. 10A and 10B are views for explaining the operation of switching from the state of displaying a still image to the editing mode and the configuration of a screen displayed in the editing mode according to the embodiment of the present invention. 11A to 11E are diagrams illustrating an example of compositing images and editing them into still images while performing the procedure as shown in FIG.

Referring to FIGS. 9 to 11E, when the best videoshot mode is performed, the controller 100 displays a screen 1010 shown in FIG. 10A on the display unit 130. At this time, the screen displayed on the display unit 130 displays the extracted images and the shared item 1013. In this case, the photo edit mode can be performed after storing the extracted image. Accordingly, when the shared item 1013 is selected, the controller 100 displays menus that can be shared by the shared item in step 913. [ At this time, if the extracted images are not stored, the controller 100 displays a popup window such as 1025 to store the selected images as shown in 1020 of FIG. 10A. At this time, if the user selects cancel, the controller 100 displays a screen such as 1010, and then, when the user selects the storage item 1017 on the screen of the screen 1010, the controller 100 stores the image in the storage unit 110. Also, if OK is selected in the pop-up window 1025 or the shared item 1013 is selected in the state where the image is stored, the control unit 100 displays a pop-up window of a shared menu such as 1035 of 1030. [

At this time, if the user selects the photo editor, the controller 100 detects that the image editing function is selected in step 915, and displays the edit screen on the display 130 in step 917. The screen of the photo editor mode may have the same configuration as 1040 and 1050 of FIG. 10B. The screens 1040 and 1050 illustrate a configuration example of a style A (multi-grid). First, the photo editor screen displays an undo item 1041 and a redo item 1043 for switching to a previous screen or a next screen, and a save item 1045 for storing an edited still image. A tray 1050 is an area for storing selected images. In the tray 1050, an item for adding an image, such as 1051, and selected images are displayed in a thumbnail form. The tray item 1060 is an item that turns on or off the display of the tray. The tray item 1060 displays an image tray 1050 according to the touch of the tray item 1060, or turns off the display of the tray area 1050, such as 1080 close). Reference numeral 1050 denotes an area for displaying images to be edited. When a drag and drop operation is performed at a boundary such as reference numeral 1057, the size of the image is resized (frame resize handler). Reference numeral 1070 denotes a divided screen number display area. In the embodiment of the present invention, the divided screen number display area is referred to as a divided selection display area. In the embodiment of the present invention, the split selection display area can be displayed as a split in 2, a split in 3, or a split in 4 screen as denoted by reference numerals 1073 to 1077. In the following description, the divided selection display area control unit 100 for selecting the number of divided screens displays the images of the tray area 1050 on the display unit 130 by the number of divided screens according to the user's selection. 10B shows an example in which a split in 2 1073 of the style A is selected.

In the embodiment of the present invention, the user can select the style (image frame structure) for composing the number of divided screens and the divided screen when editing the still image. In the following description, it is assumed that the controller 100 can display still images in a maximum of 4 split screens in the photo editor mode, and also has four styles of a composite image style A-style D that can be selected. At this time, if the number of divided screens is selected from the 1040 screen, the controller 100 displays selectable style types 1093-1099 in the style selection display area 1090 of 1080. [ The Style Here, the style is an image frame structure for compositing and displaying images, and it is assumed that the embodiment of the present invention has four style types 1093-1099 (style A-style D). 10C is a diagram showing an example of display of style types according to an embodiment of the present invention, and shows an example of a case of a quadrant screen. In FIG. 10C, the style A has a multi grid type structure, and the style D has a structure in which an image 1087 is overlaid on a background screen 1085. At this time, the background screen 1085 adjusts the transparency of one of the images added by the user Blur. Accordingly, the controller 100 first activates the display window to select the number of divisions of the image as 1070 of the 1040 screen. When the number of divisions is set, the controller 100 displays the display window 1080 to select a style type for displaying the split screen, .

In this case, the edit screen of the image to be edited in the photo editor mode may be as shown in FIG. 3C.

If the user selects the edit item as described above, the controller 100 displays the photo editor screen as shown in FIGS. 10B and 10B in step 917. In the embodiment of the present invention, it is assumed that the split screen / style A is set to the default when the first tray 1050 is opened. If the user selects the number of divided screens in the area 1070 in FIG. 11A, the controller 100 detects the number of divided screens in step 919 and displays the divided screen in step 921. FIG. When the divided screen is selected, the controller 100 displays a style type item (style A-style D) for displaying a divided screen in the style selection display area 1090 of FIG. 11A. When the style is selected, In step 925 and displays the image in the number and style of the split screen selected in step 925.

Referring to FIG. 11A, if the user selects two divisions 1105 on the 1100 screen, the controller 100 detects this and detects it in step 919. Since the local style is a multi-grid type, a screen such as 1110 is displayed on the display unit 130 . If the user selects the style C 1115 in the state of displaying the screen 1110 of FIG. 11A, the controller 100 senses the style C 1115 in step 923, and generates a style C type screen such as 1120 in step 925 and displays it on the display unit 130 Display. 11A, if the user selects style D 1125, the controller 100 senses the style D 1125 in step 923, generates a style D type screen such as 1130 in step 925, and displays it on the display unit 130 Display. If the user wants to edit the number of divided screens in a state of displaying the screen as described above, the user selects the divided item 115, and the controller 100 displays a screen such as 1100 on the display unit 130 so that the number of divided screens can be selected do.

As described above, on the photo editor screen, the user can select the number of images that can be displayed on the divided screen and the style for displaying the image on the divided screen. At this time, the image displayed in step 925 of FIG. 9 is displayed in the order of the images stored in the tray. 11D, the control unit 100 displays the images in the order of the images stored in the tray, such as the image 1200, when it is assumed that two to four images are stored in the tray. That is, when four images are stored in the tray, the controller 100 can arrange the images according to the order of the images stored in the tray as shown at 1210 to 1240 in FIG. 11D. However, the user can edit and arrange the images arranged in a fixed manner as desired. Accordingly, when the user generates an image editing request, the controller 100 detects the image editing request in step 927, and can edit the image of the selected area in step 929. The image editing may be image addition, replacement, deletion, or the like. 11B, the control unit 100 may replace the image displayed on the display unit 130 with an image stored in the tray, or may display the image in the empty space of the display unit 130 as shown in FIG. 11C, You can add images stored in the tray to the display area.

Referring to FIG. 11B, when the user touches a blank area as 1145 or touches a tray item 1060 on the same screen as the area 1140 of FIG. 11B, the controller 100 senses the touch and touches the tray (Tray open). If the thumbnail image of the tray area 1050 is dragged and dropped as shown in 1155 in the above state, the image 1153 of the 1150 screen is replaced with the image 1163 of the 1160 screen. At this time, when the drag and drop operation is performed as indicated by 1155 in FIG. 11B, the tray 1050 is turned off (tray closed). That is, if the drag and drop operation is performed as shown in the screens 1050 to 1155 of FIG. 11B, the tray is closed as shown in the screen 1160 of FIG. 11B. When the image of the tray 1050 is dragged and dropped, the image 1153 displayed on the 1150 screen is replaced with the image 1163 of the 1160 screen of FIG. 11B. , The tray 1050 is closed as shown in the screen 1175. That is, the tray 1050 is turned off when the tray item 1060 is touched or a drag-and-drop interaction is performed while the tray is displayed. If the thumbnail image displayed on the tray is dragged and dropped at the displayed image position after opening the tray in a state displaying images according to the set division and style of the display unit 130 as described above, One image can be replaced.

Referring to FIG. 11C, when the user touches a blank area where no image is displayed or touches the touch item 1060 in a state displaying images in the set division and style, the tray 1050 is displayed as a screen 1180 in FIG. 11C do. At this time, if the thumbnail of the image to be added is touched and dragged on the tray 1050 of the screen 1180 as shown at 1185 and dropped to a desired position, the control unit 100 adds the selected image in the tray 1050 as shown in the screen 1190,

Accordingly, when the user taps the blank area or touches the tray item 1060, the controller 100 opens the tray 1050 to display thumbnails of the images stored therein. When the user drags the thumbnail image of the tray 1050 and drops the image to the split screen position for displaying the image, the controller 100 displays the selected image at the drop position on the tray 1050. At this time, If the image is displayed on the split screen, the image is edited to replace the image on the split screen. In addition, the image displayed on the divided screen can be deleted. For example, when the user touches a specific position of the image displayed on the divided screen, the controller 100 can delete the image displayed on the divided screen of the corresponding position. Here, the specific position may be a corner position of the divided image.

The style of the split screen according to the embodiment of the present invention is assumed to be a style A-style D as described above, and the style A-style C is displayed in a constant pattern like a grid shape, Do not. However, in the case of style D, the background image is used, the divided images are also overlaid on the background image, and the divided images can be superimposed on each other. At this time, the background image can be displayed by adjusting transparency (i.e., blur processing, fit to screen).

Fig. 11E is a diagram showing an example of image editing of the style D, and Fig. 11F is a diagram for explaining an example of background processing of the style D. Fig.

11E, if the user touches the image 1253 below the image 1255 as in the image 1251 as shown in 1251 in the screen 1250 of FIG. 11E, the control unit 100 displays the divided screen as shown in FIG. And the image 1253 is positioned above the image 1255. When the user touches the corner of the image 1261, the controller 100 detects the image and rotates the image in the direction of the touched corner as shown in the screen 1270. If the user touched the area or the background image 1257, or touches the tray item 1060, the controller 100 detects the area and displays the tray 150 as shown in the screen 1280. If the thumbnail displayed on the tray 1050 is dragged and dropped on the screen 1280 as indicated by 1285, the control unit 100 displays the image stored in the tray 1050 as a split image 1255 as shown in the screen 1290. Also, when the image 1255 is touched as 1291 on the screen 1290, the controller 100 displays the divided image 1255 on the divided image 1253 as shown in the screen 1295.

When a divided image is displayed in the type of style D as described above, the divided divided image is displayed on the divided divided image by touching the divided divided image. When the divided divided image is displayed on the divided divided image, To display a tray on the screen, and when the thumbnail displayed in the tray area is dragged and dropped in the divided image display area, the image corresponding to the thumbnail image is added or replaced.

Referring to FIG. 11F, when the user touches the divided image 1313 area on the screen 1310 as shown in 1311, the controller 100 displays the divided image 1313 on the divided image 1315 as shown in the screen 1320. At this time, it is assumed that the divided image 1315 is a blank area in which no image is displayed. At this time, if the user touches the corner 1323 in the divided image 1313, the divided image 1313 is rotated as shown in the screen 1270 of FIG. If the user touches the corner 1321 in the divided image 1313, the divided image 1313 can not be rotated. In the divided image display of style D according to the embodiment of the present invention, it is assumed that a corner at a low position (portion 1321 in the case of the screen 1320) is used as an area for deleting a divided image. Accordingly, when the user touches the area 1321 of the divided image 1313, the control unit 100 deletes the image displayed in the divided area as shown in the screen 1330. [ At this time, if the divided image displayed on the display unit 130 is deleted, the control unit 100 also deletes the background image as indicated by 1317 on the screen 1330. At this time, when the background image 1317 is deleted, a default image is displayed, and the default image may be a specific color. If the user touches an area where no image is displayed, such as a tray item 1060 or 1331, the controller 100 displays the tray 1050 as shown in FIG. When the user drags the thumbnail on the tray 1050 and drops the thumbnail onto the divided image display area, the controller 100 detects the drop and displays the selected image on the tray 1050 at the dropped position as shown in the screen 1350. At this time, as shown in the screen 1350, the control unit 100 displays the divided image 1313 by dragging and dropping and displaying the background image 1317 again.

As described above, when displaying a divided screen in the style D type, if the divided image is deleted and the divided image is not displayed on the screen of the display unit 130, the controller 100 also deletes the background image as well. When the divided image is displayed again on the display screen, the background image is also displayed. At this time, the background image may use the first divided image (image 1313 in FIG. 11F).

After finishing the number of divisions, the display style, and the image editing as described above, the user can save the edited divided image. In this case, the user touches the save item displayed on the display unit 130. When the user touches the save item, the controller 100 detects the touch of the save item in step 831, and stores the edit image in the storage unit 110 in step 933. Here, the edit image is an image generated by synthesizing the images extracted from the moving image with the set style and the number of divisions, and is a still image in which the split screen of the style in which the plurality of images are set is edited. When the end of the photo editor mode is requested, the controller 100 detects this in step 845 and ends the photo editor mode.

12 is a diagram illustrating a configuration of a portable terminal for performing a photographing operation according to an embodiment of the present invention. Here, the portable terminal may be various digital devices such as a mobile phone including a smart phone, an MP3 terminal, a tablet, a computer, and a camera.

Referring to FIG. 12, the communication unit 170 performs a wireless communication function with a base station, an Internet server, and the like. The communication unit 170 may include a transmitter for up-converting and frequency-amplifying a frequency of a transmission signal, and a receiver for performing low-noise amplification and frequency down-conversion on a reception signal. The communication unit 170 may include a modulation unit and a demodulation unit. The modulator modulates the transmission signal and transmits the modulated signal to the transmission unit, and the demodulation unit demodulates the signal received through the reception unit. In this case, the modulation and demodulation unit may be LTE, WCDMA, GSM, WIFI, WIBRO, NFC, Bluetooth, or the like. In the embodiment of the present invention, it is assumed that the communication unit 170 includes LTE, WIFI, and bluetooh communication units.

The first camera 120 can photograph a high resolution image using a rear camera mounted on the rear surface of the terminal device. The second camera 125 is a front face camera mounted on the front face of the terminal device, and can take a relatively low-resolution image compared to the first camera 120.

The controller 100 controls the overall operation of the portable terminal. The controller 100 extracts an image according to an image extraction condition set during reproduction of a moving image according to an exemplary embodiment of the present invention to generate a still image. In the editing mode, To generate a still image.

The storage unit 110 may include a program memory for storing an operation program of the terminal and a program according to an embodiment of the present invention, tables for operation of the terminal, and a data memory for storing data generated during program execution. The storage unit 110 also stores split and style image frames according to an embodiment of the present invention.

The display unit 130 displays information of an application being executed under the control of the controller 100. [ The display unit 130 may be an LCD or an OLED. The input unit 140 may be implemented by a correction capacitance method or a resistance film method, and outputs the position information of the user's touch (hereinafter referred to as a finger touch) to the controller 100. Further, the input unit 140 may further include an EMR sensor pad, and senses the pen touch input and outputs the pen touch input to the controller 100. The display unit 130 and the input unit 140 may be integrally formed.

The audio processing unit 150 processes the audio signal generated in the communication mode under the control of the controller 100 and can process the audio signal according to the shooting in the camera shooting mode. The sensor 160 includes sensors for detecting movement of the portable terminal. The sensors may be comprised of an acceleration sensor, a geomagnetic sensor, and / or position sensing sensors.

The portable terminal according to an embodiment of the present invention having the configuration as shown in FIG. 12 can capture a moving image by controlling the camera 120 or download a moving image through the communication unit 120 and store the downloaded moving image in the storage unit 110. In addition, the portable terminal can extract images according to the extraction condition set as a still image from a moving image to be played back during moving image playback. In the embodiment of the present invention, the playback mode for extracting a still image from the moving image is referred to as a best videoshot mode. The image extraction condition set in the best videoshot mode includes a change in facial expression, a change in the number of figures, And the like). In the embodiment of the present invention, this is assumed to be a smile, a face, and a scene. At this time, the image extraction condition may be set to all the conditions as described above, or may be set to only some of the conditions.

Therefore, if the best videoshot mode is set for the moving image reproduction, the control unit 100 extracts an image from the moving image to be reproduced according to the set image extraction condition, and stores the extracted images in the storage unit 110 as a still image. At this time, an operation and a method of extracting an image from the moving image can be performed by the method shown in FIGS. 5, 6A to 6C, and 7.

In addition, the portable terminal according to the embodiment of the present invention can extract images according to the image extraction condition set when the moving image is reproduced, and store the images as a still image. Then, the extracted images can be edited into a synthesized still image. That is, the control unit 100 may perform an editing mode after extracting an image from a moving image. In the editing mode, the control unit displays the extracted images on the display unit 130 in a thumbnail form, Can be synthesized and edited as still images. Also, if the user selects the best videoshot mode after selecting the video stored in the storage unit 110, the controller 100 detects this in step 823, and displays the images stored in the corresponding folder in the thumbnail form on the display unit 130. When the user selects the edit mode (photo edit mode) in the above state, the controller 100 combines the selected images into an image frame corresponding to the set number of divisions and styles, and edits the image as a still image. At this time, an operation and a method of editing the extracted image or the stored images can be performed by the method as shown in FIGS. 9, 10A to 10C, and 11A to 11F.

In the embodiment of the present invention, the style for synthesizing the extracted images may be configured in various forms. In the embodiment of the present invention, as shown in FIG. 3C, the image frame structure has four styles of style A-style D, and each style has a frame structure for synthesizing four images in two images . Here, the style may be a multi-grid structure, and the style D may have a structure in which images extracted on a background screen are overlaid. In this case, the storage unit 110 may store image frames of each style for synthesizing extracted images according to an embodiment of the present invention.

The embodiments of the present invention disclosed in the present specification and drawings are merely illustrative of specific embodiments of the present invention and are not intended to limit the scope of the present invention in order to facilitate understanding of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims (17)

An image processing method for an apparatus having a camera,
Reproducing the moving picture by setting an image extraction condition,
Extracting an image according to the image extraction condition as a still image in the moving image to be reproduced;
Creating a folder, and storing the extracted still image in the generated folder. The image processing method according to claim 1,
A change in facial expression, a change in the number of figures, or scene changing conditions in the moving picture. 3. The method of claim 2,
And displaying the extracted still image as a thumbnail image on the display unit. 3. The method of claim 2, wherein the step of extracting with the still image further comprises extracting a predetermined number of images and ending the process when the number of images exceeds the set number. 5. The method of claim 4, wherein the step of storing the still image comprises:
Displaying an image selection item on a screen displaying the thumbnail image, displaying a check box in a thumbnail image displayed when the selection item is selected, and storing images of the check box selected in a storage request in a generated folder ≪ / RTI > The method according to claim 1,
Further comprising an image editing step of editing the extracted images according to the number of divisions and style types selected when the editing mode is selected and displaying them as one still image and storing the edited still image when a storage request is made . 7. The method of claim 6,
Dividing the images corresponding to the number of divisions selected in the divided selection display area into a single screen and displaying the divided images in a split screen;
Displaying a style selection display area including the selected number of divisions, changing and displaying a frame of images of a split screen displayed according to a selected style type,
And storing a still image of a style number and a number of divisions to be displayed when a storage request is made. 8. The method of claim 7,
A tray for displaying thumbnails of stored still images, and a tray item for controlling on / off of the tray,
Further comprising the step of turning on a tray displaying a thumbnail of a still image being stored when the tray item is selected, and turning off the tray when the tray item is selected when the tray is turned on. 9. The method of claim 8,
Further comprising the step of adding or replacing the image corresponding to the thumbnail at the drop position as a split screen when the thumbnail of the tray is dragged and dropped into the split screen area. The method according to claim 7, wherein when the number of divisions is selected in the style selection display region including the number of divisions, the divided selection display region is displayed. 8. The method according to claim 7, wherein the style type comprises a style type for overlaying an image on a background screen, and the background screen adjusts transparency of the image added by the user. An image processing apparatus comprising:
A camera for photographing a moving picture,
A storage unit for storing the moving image;
Extracting an image according to the image extraction condition from the moving image to be reproduced as a still image, generating a folder upon request for storage, and storing the extracted still image in the generated folder A control unit,
And a display unit for displaying thumbnails of the images extracted under the control of the control unit. 13. The method of claim 12,
The image extraction condition is a facial expression change, a change in the number of figures, or a scene change condition,
Wherein the control unit extracts images having extraction conditions corresponding to all or a part of the extraction conditions set at the time of moving image playback as still images. 14. The apparatus of claim 13, wherein the control unit
When the editing mode is selected, the divided selection display area is displayed on the display unit, the images corresponding to the selected number of divisions are divided into one screen on the display unit and displayed as a split screen, and a style selection display area including the selected split number is displayed And displays a frame of images of the split screen displayed in accordance with the selected style type, and stores the number of split images and the still image of the style type displayed when a storage request is made. 15. The method of claim 14,
The control unit displays a tray item for controlling on / off of a tray, turns on a tray for displaying a thumbnail of a still image being stored when the tray item is selected, and turns off the tray when the tray item is selected . 16. The method of claim 15,
Wherein the control unit adds or replaces an image corresponding to the thumbnail at a drop position as a split screen when the thumbnail of the tray is dragged and dropped in the split screen area. 15. The apparatus of claim 14, wherein the style type comprises a style type for overlaying an image on a background screen, and the background screen adjusts transparency of an image added by a user to display the style.

Images