KR102076629B1 - Method for editing images captured by portable terminal and the portable terminal therefor - Google Patents

Abstract

The present invention relates to a method for editing images taken by a portable device. To this end, the present invention, when photographing the foreground with the photographer in the portable device, after storing the image synthesized by overlapping the image obtained by the camera module with a part of the photographer, for example, a face, and then stored in the future composite image When the face image is to be edited, other face images corresponding to the face image are extracted from other pre-stored synthetic images, and then the face image desired by the user is replaced with the face image to be edited. The process consists of creating and storing a composite image. By doing so, the present invention can select a specific object of the synthesized images in which the front image and the rear image are superimposed and simply replace it with another image, thereby improving the convenience of editing the composite image.

Description

TECHNICAL FOR EDITING IMAGES CAPTURED BY PORTABLE TERMINAL AND THE PORTABLE TERMINAL THEREFOR}

TECHNICAL FIELD The present invention relates to an image synthesizing method, and more particularly, to a method for editing a synthetic image obtained by synthesizing a front and rear image captured by a portable device.

In recent years, due to the rapid development of communication technology, functions in portable devices are gradually expanding, and accordingly, more various user interfaces (UIs) and various functions using the same are provided. In order to increase the utility value of these portable devices and satisfy various needs of users, various applications executable in the portable devices have been developed.

Recently, the functions of the application using the camera have been diversified, ranging from the camera phone function of photographing the shape of an object using a mobile device and the video phone function of photographing a user's own image to a counterpart. . For example, in the case of an image synthesizing application downloaded by a user through a wireless Internet service, various image synthesizing applications such as synthesizing a hairstyle of a photograph taken by a user have been introduced.

In addition, recently, two cameras are basically installed in portable devices to satisfy various preferences of users. As described above, in a portable device equipped with a dual camera, the main image photographed by one camera is displayed on the preview screen, and the sub image photographed by the other camera is overlaid on the main image in the form of a picture in picture (PIP). . In the case of a portable device equipped with such a dual camera, the rear camera of the portable device is fixed to face the rear direction of the portable device, and the front camera of the portable device is fixed to face the front direction so that the user can be photographed.

As described above, a dual shot mode that simultaneously displays a front image captured by a front camera facing a user and a rear image taken by a rear camera facing a user on a screen is described in the related art. have. That is, in the conventional dual shot mode, the front image is synthesized with the rear image.

In general, the dual shot mode displays a rear image corresponding to a background on a PIP main screen and an image of a photographer's face on a sub screen. However, compared to the background, the face changes facial expression, position, and the like, and it is difficult to adjust the shooting angle according to the face, so that it is not easy to take a favorite face image of the photographer. Therefore, in the case of the composite image of the PIP method, there may occur a case where a face image is desired to be corrected rather than a background image.

In addition, in the conventional dual shot mode, the position of the front image is seen at a predetermined position, and there is a problem in that the desired front image cannot be positioned and stored in a desired area in the rear image. In addition, conventionally, even if each of the images taken by the front camera and the rear camera can be combined together, there is no method of using a separate image obtained.

In addition, in the case of a device having a large display screen, such as a portable device, since a touch input unit must be used simultaneously with the display screen, a user interface for editing in consideration of user convenience needs to be provided.

It is an object of certain embodiments of the present invention to at least partially solve, mitigate or eliminate at least one of the problems and / or disadvantages associated with the prior art.

One object of the present invention is to provide an editing method that can facilitate editing of images captured by two or more cameras in a portable device.

Another object of the present invention is to provide an editing method capable of positioning a desired front image in a desired area in a rear image.

According to an aspect of the present invention, there is provided a portable apparatus for editing photographed images, comprising: a storage unit storing at least one first composite image overlaid with a second image on a first image; When a touch screen for displaying the first composite image and a selection for a third image to replace the second image superimposed on the first composite image are received, the selected third image is overlaid on the first image. And generating a second composite image and storing the second composite image in the storage unit.

According to another aspect of the present invention, there is provided a method for editing images photographed by a portable device, the method comprising: displaying a first composite image superimposing a second image on a first image, and displaying a third image to replace the second image; And receiving a selection for the second image, generating a second composite image by superimposing the selected third image on the first image, and storing the generated second composite image.

The present invention has an advantage of easily editing a composite image by providing a user interface that displays a list of replaceable images in the edit region and replaces any of them when the edit region of the composite image is selected.

In addition, the present invention synthesizes by storing the front image and combining it with another rear image when the user satisfies only the composite image including any one front image among the synthesized images overlapping the front image and the rear image during dual shot shooting. The convenience of image editing can be improved.

In addition, according to the present invention, by providing an editing method for synthesizing the front image desired by the user in other composite images, not only can the convenience of use be improved, but also there is an advantage of providing a composite image with high user satisfaction.

1 is a schematic block diagram showing a portable device according to an embodiment of the present invention;
2 is a front perspective view of a portable device according to an embodiment of the present invention;
3 is a rear perspective view of a portable device according to an embodiment of the present invention;
4 is a diagram illustrating a case of photographing a front and rear subject using a dual camera of a portable device according to an embodiment of the present invention;
5 is an operation flowchart for explaining a method of editing images taken according to an embodiment of the present invention;
6 to 7C illustrate screen views illustrating an operation process of FIG. 5;
8 is a flowchart illustrating an editing method of captured images according to another embodiment of the present invention;
9 to 12 are screen examples showing an operation process of FIG. 8.

As the inventive concept allows for various changes and numerous embodiments, particular embodiments will be illustrated in detail with reference to the accompanying drawings. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

The present invention relates to a method for editing images taken by a portable device. To this end, the present invention, when photographing the foreground with the photographer in the portable device, after storing the image synthesized by overlapping the image obtained by the camera module with a part of the photographer, for example, a face, and then stored in the future composite image When the face image is to be edited, other face images corresponding to the face image are extracted from other pre-stored synthetic images, and then the face image desired by the user is replaced with the face image to be edited. The process consists of creating and storing a composite image. By doing so, the present invention can select a specific object of the synthesized images in which the front image and the rear image are superimposed and simply replace it with another image, thereby improving the convenience of editing the composite image.

In the present invention, the portable device may be any device having a touch screen, and the portable device may be referred to as a mobile terminal, a communication terminal, a portable communication terminal, a portable mobile terminal, or the like.

For example, a mobile device may be a smartphone, a mobile phone, a game machine, a TV, a display device, a vehicle head unit, a notebook computer, a laptop computer, a tablet computer, a personal media player (PMP), a personal digital assistant (PDA), or the like. Can be. The portable device can be implemented as a pocket size portable communication terminal having a wireless communication function. In addition, the portable device may be a flexible display device. In addition, the present invention can be applied to any device capable of mounting a camera.

The typical configuration of such a portable device is for a mobile phone, and in the exemplary configuration of such a portable device, some components may be omitted or changed as necessary.

1 is a schematic block diagram illustrating a portable device according to an exemplary embodiment.

Referring to FIG. 1, the portable device 100 includes one touch screen 190 and at least one touch screen controller 195. In the present invention, as an example of the display unit and the display controller, the case of the touch screen 190 and the touch screen controller 195 will be described as an example. In addition, the portable device 100 may include a controller 110, a communication module 120, a camera module 150, an input / output module 160, a sensor module 170, a storage unit 175, and a power supply unit 180. It includes.

First, the controller 110 may store or carry signals or data input from the ROM 111 and the outside of the portable apparatus 100, in which the CPU 111, a control program for controlling the portable apparatus 100, are stored. The device 100 may include a RAM 113 used as a storage area for a task performed in the device 100. The CPU 111 may include not only a single core but a plurality of cores such as dual core, triple core, or quad core. The CPU 111, the ROM 112, and the RAM 113 may be interconnected through an internal bus.

In addition, the controller 110 may include a communication module 120, a camera module 150, an input / output module 160, a sensor module 170, a storage unit 175, a power supply unit 180, and a touch screen 190. And the touch screen controller 195.

The communication module 120 may include at least one of a mobile communication module, a wireless LAN module, and a short range communication module.

The mobile communication module may allow the mobile device 100 to be connected to an external electronic device through mobile communication using at least one, one, or a plurality of antennas (not shown) under the control of the controller 110. The mobile communication module uses a mobile phone (not shown), a smart phone (not shown), a tablet PC or another electronic device (not shown) having a telephone number input to the mobile device 100 to make a voice call, a video call, a text message. Send / receive radio signals for messaging (SMS) or multimedia messages (MMS).

The WLAN module may be connected to the Internet through a wireless access point (AP) (not shown) under the control of the controller 110. The WLAN module supports the WLAN standard (IEEE802.11x) of the Institute of Electrical and Electronics Engineers (IEEE).

The short range communication module may wirelessly perform short range communication between the portable apparatus 100 and the external electronic device under the control of the controller 110. The short range communication method may include Bluetooth, Infrared Data Association (IrDA), Wi-Fi Direct communication, Near Field Communication (NFC), and the like.

The camera module 150 includes an image sensor and may include at least one of a first camera 151 and a second camera 152 that capture a still image or a video under the control of the controller 110. In addition, the camera module 150 may include a barrel unit 155 that performs zoom in / zoom out for photographing a subject, a motor unit 154 that controls the movement of the barrel unit 155, and an auxiliary light source for photographing a subject. It may include at least one of the flash 153 to provide. The first camera 151 may be disposed on the front surface of the portable device 100, and the second camera 152 may be disposed on the rear surface of the portable device 100.

In addition, the camera module 150 may further include a third camera. In this case, the first camera 151 and the third camera (not shown) are disposed adjacently (for example, the distance between the first camera 151 and the third camera is larger than 1 cm and smaller than 8 cm) so that the 3D is three-dimensional. You can also shoot still images or three-dimensional video.

The first and second cameras 151 and 152 may each include a lens system, an image sensor, and the like. Each of the first and second cameras 151 and 152 converts an optical signal input through a lens system into an electrical image signal and outputs it to the control unit 110, and the user first and second cameras 151 and 152 respectively. You can shoot videos or still images with.

The input / output module 160 may include at least one of at least one button 161, at least one vibrating element 164, and a keypad 166. In addition, the input / output module 160 is not limited thereto, and in addition to at least one microphone, at least one speaker, and an earphone jack, a cursor control such as a mouse, a trackball, a joystick, or cursor direction keys may include a touch screen ( 190 may be provided to control the movement of the cursor on.

The button 161 may be formed on the front, side, or back of the housing (or case) of the portable device 100, and may include a power / lock button, a volume button, a menu button, a home button, and a back button. And a search button.

The vibration element 164 may convert an electrical signal into mechanical vibration under the control of the controller 110. For example, when the mobile device 100 in the vibration mode receives a voice or video call from another device (not shown), the vibration device 164 operates. One or more vibrating elements 164 may be formed in a housing of the portable device 100. The vibrating element 164 may operate in response to a user input through the touch screen 190.

The keypad 166 may receive a key input from a user for controlling the portable device 100. The keypad 166 includes a physical keypad (not shown) formed on the portable device 100 or a virtual keypad (not shown) displayed on the touch screen 190. The physical keypad formed on the portable device 100 may be excluded according to the performance or structure of the portable device 100.

The sensor module 170 includes at least one sensor that detects a state of the portable device 100 and a situation around the portable device 100. For example, the sensor module 170 may include a proximity sensor that detects whether a user approaches the portable device 100, an illumination sensor (not shown) that detects an amount of light around the portable device 100, or a portable device. A motion sensor (not shown) that detects the operation of the device 100 (eg, rotation of the mobile device 100, acceleration or vibration of the mobile device 100), an earth magnetic field, At least one of a geo-magnetic sensor for detecting the point of the compass, a gravity sensor for detecting the direction of gravity, and an altimeter for detecting altitude by measuring atmospheric pressure It may include a sensor of. In addition, a camera sensor for photographing a user may also be included in the sensor module 170. Sensors provided in the sensor module 170 may be added or deleted depending on the performance of the portable device 100 other than the sensor illustrated in the present invention.

The storage unit 175 receives an input according to the operation of the communication module 120, the camera module 150, the input / output module 160, the sensor module 170, or the touch screen 190 under the control of the controller 110. Can store / output signals or data. The storage unit 175 may store a control program and applications for controlling the portable apparatus 100 or the controller 110.

The term “storage unit” refers to a storage unit 175, a ROM 112 in the controller 110, a RAM 113, or a memory card (eg, an SD card or a memory stick) mounted in the portable device 100. Is used as a term to refer to any data storage device. The storage unit 175 may include a nonvolatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

In addition, the storage unit 175 may be configured to provide applications of various functions such as navigation, video call, game, time-based alarm application, and the like to provide a graphical user interface (GUI) related thereto. , User information, documents, databases or data related to a method of processing touch input, background images (menu screen, standby screen, etc.) or operating programs necessary for driving the portable device 100, the camera module 150, and the like. Images taken by the user can be stored.

The storage unit 175 is a machine-readable medium (eg, a computer), and the term machine-readable medium may be defined as a medium for providing data to the machine so that the machine can perform a specific function. Can be. The storage unit 175 may include non-volatile media and volatile media. All such media must be tangible so that the instructions carried by the media can be detected by a physical mechanism that reads the instructions into the machine.

Such machine-readable media include, but are not limited to, floppy disks, flexible disks, hard disks, magnetic tapes, compact disc read-only memory (CD-ROM), optical disks. , At least one of a punch card, paper tape, RAM, Programmable Read-Only Memory (PROM), Erasable PROM (EPROM), and FLASH-EPROM Include.

The power supply unit 180 may supply power to one or a plurality of batteries disposed in the housing of the portable device 100 under the control of the controller 110. One or more batteries supply power to the portable device 100. In addition, the power supply unit 180 may supply power input from an external power source to the portable device 100 through a wired cable connected to the connector. In addition, the power supply unit 180 may supply power to the portable apparatus 100 that is wirelessly input from an external power source through a wireless charging technology.

In addition, the portable device 100 may include at least one touch screen 190 that provides a user graphical interface corresponding to various services (eg, a call, data transmission, broadcasting, and photography).

The touch screen 190 may display a user interface corresponding to various services (eg, a call, data transmission, broadcasting, and photography) based on an operating system (OS) of the portable device 100. . The touch screen 190 may output an analog signal corresponding to at least one user input input to the user graphic interface to the touch screen controller 195. The touch screen 190 may receive at least one user input through a user's body (eg, a finger including an index finger). The touch screen 190 may receive a continuous movement of one touch. The touch screen 190 may output an analog signal corresponding to continuous movement of an input touch to the touch screen controller 195.

In the present invention, the touch is not limited to the contact between the touch screen 190 and the user input means such as a finger, and the recognition that can detect the user input means without contact (for example, without direct contact with the touch screen 190). And when the user input means is located within a distance (eg 1 cm). The distance or interval at which the user input means can be recognized by the touch screen 190 may be changed according to the performance or structure of the portable apparatus 100. In particular, the touch screen 190 may be directly contacted by a contact with the user input means. A value detected by the direct touch event and the hovering event (eg, including a voltage value or a current value as an analog value) may be differently output so that the touch event and the indirect touch event (ie, the hovering event) can be detected separately. It can be configured to be.

The touch screen 190 may be implemented by, for example, a capacitive method, an infrared method, an ultrasonic wave method, or a combination thereof.

The touch screen controller 195 converts an analog signal input from the touch screen 190 into a digital signal and transmits the converted digital signal to the controller 110. The controller 110 may control a user interface displayed on the touch screen 190 by using the digital signal received from the touch screen controller 195. For example, the controller 110 may allow a shortcut icon (not shown) or an object displayed on the touch screen 190 to be selected or executed in response to a direct touch event or a hovering event. In addition, the touch screen controller 195 may be integrated into the controller 110.

The touch screen controller 195 may detect a value (eg, a current value) output through the touch screen 190 to check a hovering interval or distance as well as a user input position, and may determine a digital signal (eg , Z coordinate) may be provided to the controller 110. In addition, the controller 110 may detect various user inputs received through the camera module 150, the input / output module 160, the sensor module 170, etc. as well as the touch screen 190. The user input may include not only the touch but also various types of information input into the portable device 100 such as a user's gesture, voice, eye movement, and a bio signal. The controller 110 may control the mobile device 100 to perform a predetermined operation or function corresponding to the detected user input.

2 is a view showing a front perspective view of a portable device according to an embodiment of the present invention, Figure 3 is a view showing a rear perspective view of the portable device according to an embodiment of the present invention.

2 and 3, the touch screen 190 is disposed in the center of the front surface 101 of the portable device 100. The touch screen 190 may be largely formed to occupy most of the front surface 101 of the portable device 100. 2 illustrates an example in which a main home screen is displayed on the touch screen 190. The main home screen is the first screen displayed on the touch screen 190 when the portable device 100 is turned on. In addition, when the portable device 100 has different home screens of several pages, the main home screen may be the first home screen of the home screens of the several pages. The home screen may display shortcut icons 191-1, 191-2, and 191-3, main menu switch key 191-4, time, weather, and the like for executing frequently used applications.

A home button 161a, a menu button 161b, and a back button 161c may be formed below the touch screen 190.

The home button 161a displays a main home screen on the touch screen 190. The menu button 161b provides a connection menu that can be displayed on the touch screen 190. The connection menu may include a widget adding menu, a background screen changing menu, a search menu, an editing menu, an environment setting menu, and the like. The back button 161c may be used to display a screen that was executed immediately before the currently running screen or to terminate the most recently used application.

The first camera 151, the illuminance sensor 170a, and the proximity sensor 170b may be disposed at an edge of the front surface 101 of the portable device 100. A second camera 152, a flash 153, and a speaker 163 may be disposed on the rear surface 103 of the portable device 100. For example, a power / lock button 161d, a volume button 161e, one or a plurality of microphones 162, and the like may be disposed on the side surface 102 of the portable device 100.

Meanwhile, although the two cameras 151 and 152 are illustrated in FIG. 1, two or more cameras may be mounted at different positions. Accordingly, in the process of synthesizing each image photographed by a plurality of cameras into a single composite image, the present invention may be equally applied. That is, one image of the images photographed by the first camera 151 is selected, one image of the images photographed by the second camera 152 is selected, and a third camera (not shown). After selecting one image from among the images photographed through, it is also possible to synthesize each of the selected images into a single composite image. However, in the following description, a case in which the first camera 151 and the second camera 152 are used for convenience of description will be described.

The present invention provides an image obtained by synthesizing the front image photographed by the first camera 151 with the rear image photographed by the second camera 152. The rear side is a direction facing the rear side of the portable device 100, the front side is a direction facing the rear side of the portable terminal 100, the front side represents one direction, and the rear side represents a direction opposite to the one direction. That is, the first camera 151 may be configured to take a picture of the user, and the second camera unit 152 may be configured to take a photograph of a subject to be photographed or a foreground of the user's view.

The controller 110 controls the overall operation of the portable device 100, and the controller 110 controls a different component of the portable device 100 to edit a composite image. In addition, the controller 110 controls the first camera 151 mounted on the portable apparatus 100 to output a front image including a subject obtained by photographing a part of the user, for example, a face, from the first camera 151. Control the second camera 152 to control the rear image obtained from photographing the subject to be output from the second camera 152 to generate an image obtained by combining the rear image with the image of the subject, It performs a function of controlling an operation for editing the composite image.

Prior to describing the present invention, the dual shot and the best shot used in the present invention will be briefly described as follows.

Dual shot refers to the ability to take two images simultaneously or sequentially and combine them into a single image using cameras in different positions. It refers to a function of continuously photographing images and selecting an optimal image based on a predetermined classification criterion. Here, the predetermined classification criterion represents a value obtained by quantifying the amount of blur in the image, the facial expression of the person, the photographing composition, and the like, respectively.

Reference will be made to FIG. 4 to specifically describe the dual shot mode used in the present invention. 4 is a diagram illustrating a case of photographing a subject using a dual camera of a portable device according to an exemplary embodiment of the present invention.

Referring to FIG. 4, for example, when the user takes a picture at the same time or with a parallax through the first camera 151 and the second camera 152, the user 405 may use the second camera 152. As the foreground 410 is photographed, the rear image 420 corresponding to the foreground 410 is displayed on the screen of the portable device 100. At the same time or with a time difference, the user 405 photographs the face 415 of the user 405 by using the first camera 151, so that the screen of the portable device 100 is displayed on the rear image 420. Overlaid face images 425 are displayed. In this state, when the user inputs a shooting command, the composite image in which the face image 425 is superimposed on the rear image 420 is stored in the storage unit 175. In this manner, the storage unit 175 may store at least one composite image captured in the dual shot mode.

The present invention provides an editing method for such composite images. According to the editing method according to the present invention, any one of the overlapping images in the composite image may be replaced with another image. For example, in a composite image in which an image including a user face is superimposed on a rear image corresponding to a background, a user may select edit for the face image and replace the face image with another desired image. Similarly, the present invention can be applied to the case where the rear image except for the face image is replaced with another rear image.

5 is a flowchart illustrating an editing method of photographed images according to an exemplary embodiment.

Referring to FIG. 5, when an editing application for editing a composite image is executed according to a user input in operation 500, the target image to be edited is displayed on the touch screen 190 in operation 505. Here, the target image to be edited may be determined according to a user's selection among pre-stored composite images loaded when the editing application is executed. 6 (a) illustrates a composite image 600 in which an object image 605 is displayed in a predetermined area of a rear image. Here, the object image 605 is an image representing the user photographed by the first camera 151, and the rear image is an image representing the foreground of the rear photographed by the second camera 152.

Here, when the object image is to be changed to another object image in the rear image, the user may select and edit an area in which the object image is disposed. Accordingly, in operation 510, it is determined whether the editing area is selected. Here, in the embodiment of the present invention, the editing area means an area in which an object image is disposed. If the edit area is not selected, the process proceeds to step 535 to determine whether the editing is finished.

6B illustrates a case in which the user selects the object image 605 to edit the object image. The object image 605 for editing may be selected by a direct touch event by contact with a user input means, an indirect touch event (ie, a hovering event), or the like. For example, a user may make a selection for editing through a hovering method such as a short touch on the object image 605, a touch hold for a predetermined time, or an input means closer to the object image 605. If there is a selection for the editing area, that is, when a user input for editing is received for the object image 605, as shown in FIG. 6 (b), it may show that the object image 605 is selected in a shaded manner or the like. .

In addition, to execute the editing of the object image, the user presses the button 161 of the input / output module 160, selects an icon representing the editing through the touch screen 190, or advances the touch screen 190 in advance. Input a set pattern (e.g., double tap, pinch or spread with two fingers touching, draw a circle with one finger touching), type a voice command through the microphone, A gesture or motion input may be performed through the camera module 150, or a specific command may be wirelessly input through the communication module 120.

In addition, when editing of the object image 605 is selected, an editing menu may be displayed together with the editing target image on the editing application screen.

If the edit area is selected in step 510, the controller 110 extracts object images corresponding to the edit area from each of the pre-stored composite images in step 515. Specifically, the at least one composite image stored in the storage unit 175 is stored in the JPEG file format, in the JPEG file format of the object image photographed by the first camera 151 in the rear image, for example, ( X, Y) composite position coordinates are stored. Therefore, the controller 110 may check the position of the object image for each composite image by reading the composite position. Here, the composite position coordinates may be the center coordinates of the object image or each corner coordinate of the object image. As described above, in the method of detecting the object images based on the composition position coordinates such as tag information of the object image in each composite image, even if the object image is not placed at a fixed position for each composite image, the respective composite images are different from each other. It is possible to detect the object image of the position.

Accordingly, the control unit 110 according to an embodiment of the present invention extracts the object images corresponding to the composition position coordinates from each composition image based on the composition position coordinates of the object image of the editing area. In this case, the object image region may be detected using techniques such as corner feature points and / or edge detection based on the composition position coordinates of the editing region in each of the composite images. In addition, according to an embodiment of the present invention, the control unit 110, for example, in the case of the detected object image based on the center coordinates of the object image size by comparing the size of the detected object image area and the size of the editing area It can be determined whether is equal. If the size of the detected object image is different from the size of the editing area, the size of the detected object image may be enlarged or reduced to be equal to the size of the editing area.

When the object images to be replaced in the editing area are extracted in this manner, the controller 110 displays the extracted object images on the touch screen 190 together with the target image to be edited in step 520. If the object images to be replaced are not extracted, it can be notified that editing is not possible.

FIG. 7A illustrates a case in which the extracted object image list 700 is displayed together with the target image 600 to be edited. The object images 705, 710, 715, 720 in the object image list 700 are images having the same size as the object image 605 of the editing area. Although FIG. 7A illustrates an example in which the object images in the extracted object image list 700 are face images such as the object image 605 to be edited, the extracted image based on the composition position coordinates is an image corresponding to another object. Of course you can.

In operation 525, the controller 110 determines whether one object image is selected from the object image list. If one object image is selected, the selected object image is positioned on the target image 600 by replacing the existing object image in step 530, and then the two images are synthesized.

FIG. 7B illustrates a case in which the user selects any one object image 705 of the object image list 700 by a touch method. As such, when the object image 705 to be replaced is touched, the existing object image 605 may be replaced with the new object image 705, or alternatively, may be replaced through the edit menu. Accordingly, the synthesized image in which the new object image 705 is disposed may be displayed on the touch screen 190 as shown in FIG. 7C.

In operation 535, when the editing is finished, the editing is ended, and in operation 540, the synthesized image is stored in the storage unit 175. If the editing is not completed, the process returns to step 505 and the above-described process is repeated.

8 is a flowchart illustrating an editing method of photographed images according to another exemplary embodiment.

8 illustrates an editing process according to a 1: 1 replacement method. When an editing application is executed in operation 800, a target image and a source image to be edited are displayed in operation 808. In other words, after the edited image and the modified image are loaded together, 1: 1 editing is performed on one screen. Here, as described above, the target image and the source image to be edited may be determined according to a user's selection among pre-stored composite images loaded when the editing application is executed.

9A illustrates an editing application screen displaying a target image 900 and a source image 910 to be edited. Although FIG. 9A illustrates a target image 900 and a source image 910 to be edited that include similar backgrounds and similar objects 905 and 915, the background and different objects in different places, such as faces, objects, etc. It may be an image including a.

In the state where the editing application screen as shown in FIG. 9A is displayed, the controller 110 determines whether a movement command of the object image 915 is input in the source image 910 in step 810. If a move command is input, the object image 915 is moved according to a user move command in step 815.

9B and 9C, the object image 915 touched by the input means is selected for movement on the source image 910, and the touched object image 915 is moved onto the editing target image 900 according to the movement command. The case where it is moved and displayed is illustrated.

The movement command for the touched object image 915 may be a gesture in which the input means keeps touching the object image 915 on the touch screen 190 and drags on the touch screen 190. Can be. Alternatively, as shown in FIG. 10, the controller 110 searches for an object image 1015 corresponding to a best shot determined according to a predetermined classification criterion, and displays a source image 1010 including the found object image 1015. Thereafter, the object image 1005 in the editing target image 1000 may be automatically replaced and displayed. As such, the object image 915 and the existing object image 905 are replaced by any one of a drag and drop method, a method of sequentially selecting one by one, and a method of simultaneously selecting the object image 915. ,

In operation 820, the object image information of the source image 910 is compared with the object image information of the editing target image 900. For example, image sizes and the like are compared with each other. In operation 828, it is determined whether the comparison results match, and if the comparison results do not match, in operation 830, the editing is notified. FIG. 11 illustrates a case in which the object 1115 in the source image 1110 is not moved to the object image 1105 of the editing target image 1100 and thus a message 1120 indicating that the editing cannot be output is output.

On the other hand, if the comparison result is matched, that is, if the size of the object images 905 and 915 is determined to be interchangeable, the object image 905 in the edited image 900 may be moved in step 835. Synthesize by replacing with. Then, in step 838, it is determined whether the editing is completed, and when the editing is completed, the synthesized image is stored in the storage unit 175 in step 840, and if the editing is not finished, the process returns to step 808 and repeats the above-described process.

Meanwhile, according to the movement command to the object image 915 in step 815, the area where the object image 915 is located in the existing object image 905 of the editing target image 900 regardless of the size of the object image 915. It may be moved to and displayed immediately. Accordingly, steps 820 to 830 of FIG. 8 corresponding to determining whether the object image 915 can be moved can be omitted.

In FIG. 12, when the object image 1215 of the source image 1210 is moved and displayed directly to an area where the existing object image 1220 of the editing target image 1200 is located, regardless of the size of the object image 1215. To illustrate. In this case, the moved object image 1215 may be automatically reduced or enlarged to have the same size as the existing object image 1220 or according to a user input.

As described above, according to the present invention, when an area to be edited is selected, it is possible to simply edit another object image by displaying replaceable object images in the area. In addition, according to the present invention, it is possible to increase the convenience of use by providing a user interface for simple editing between composite images in a portable device having a display screen of limited size.

In the above examples, the first camera may be described as the front camera, the second camera as the rear camera, the front image as the first image, and the rear image as the second image.

In addition, in the above examples, although a touch screen is illustrated as a representative example of a display unit displaying a screen, a liquid crystal display (LCD) and an organic light emitting diode (LCD) without a touch sensing function may be used instead of the touch screen. Conventional display units such as Diodes (OLED), LEDs, etc. may be used.

It will be appreciated that embodiments of the invention may be realized in the form of hardware, software or a combination of hardware and software. Any such software may be, for example, volatile or nonvolatile storage devices such as storage devices such as ROM, whether or not erasable or rewritable, or memories such as, for example, RAM, memory chips, devices or integrated circuits. Or, for example, CD or DVD, magnetic disk or magnetic tape and the like can be stored in a storage medium that is optically or magnetically recordable and simultaneously readable by a machine (eg computer). It will be appreciated that the storage unit that can be included in the portable device is an example of a machine-readable storage medium suitable for storing a program or programs including instructions for implementing embodiments of the present invention. Accordingly, the present invention includes a program comprising code for implementing the apparatus or method described in any claim herein and a machine readable storage medium storing such a program. In addition, such a program may be transferred electronically through any medium, such as a communication signal transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

In addition, the portable device may receive and store the program from a program providing device connected by wire or wirelessly. The program providing apparatus includes a memory for storing a program or the like including instructions for performing a method of editing images photographed by the portable apparatus, a communication unit for performing wired or wireless communication with the portable apparatus; It may include a control unit for transmitting the program to the portable device or the request of the portable device automatically.

In the above description of the present invention, specific embodiments have been described, but various modifications may be made without departing from the scope of the present invention. Therefore, the scope of the present invention should not be defined by the described embodiments, but should be determined by the equivalent of claims and claims.

Claims (18)

In the portable device for editing the captured images,
Storage unit;
touch screen; And
Storing at least one composite image in which the second image is superimposed on a first image, in the storage unit;
Displaying a first composite image of the at least one composite image to be edited on the touch screen when an editing request is made;
When editing of the second image is requested in the first composite image, the composition position information of the second image is detected in the first composite image,
Identify a plurality of third images to replace the second image in the at least one composite image based on the detected composite position information,
When a selection of a third image of any one of the identified third images is received, a second composite image is generated by overlapping the selected third image with the first image, and then the second composite image is read. And a control unit storing the storage unit in a storage unit.
The method of claim 1, wherein the first image and the second image,
And a rear image photographed by the first camera and an image of a subject included in the front image photographed by the second camera.
delete The method of claim 1, wherein the control unit,
And display the identified third images on the touch screen together with the first synthesized image based on the detected synthesis position information.
delete The method of claim 1, wherein the identified third images,
And the images having the same positional information as the detected synthesized positional information from each of the at least one composite image.
The method of claim 1, wherein the control unit,
A third image including an automatically selected third image by automatically selecting one third image to replace the second image among the identified third images together with the first composite image when the editing request is made; And a composite image is displayed on the touch screen.
The method of claim 1, wherein the second image and the third image of any one,
And a drag-and-drop method, a method of sequentially selecting one by one, and a method of simultaneously selecting the portable device.
The method of claim 7, wherein the automatically selected third image,
And the second image is enlarged or reduced so as to be the same as the size of the second image when the size is different from that of the second image.
In the method for editing images taken on a portable device,
Storing at least one composite image in which the second image is superimposed on the first image;
Displaying a first composite image of the at least one composite image to be edited upon an editing request;
Detecting editing position information of the second image in the first composite image when editing of the second image is requested in the first composite image;
Identifying a plurality of third images to replace the second image in the at least one composite image based on the detected composite position information;
Receiving a selection of a third image of the identified third images;
Generating a second composite image by overlapping the selected third image with the first image;
And storing the generated second composite image.
delete The method of claim 10,
And displaying the identified third images together with the first composite image.
delete The method of claim 10, wherein the identified third images,
And images having the same positional information as the detected synthesized positional information from each of the at least one composited image.
The method of claim 10,
When the editing request is received, the first composite image includes a third image automatically selected by automatically selecting any third image to replace the second image among the identified third images. And displaying the third composite image.
The method of claim 10, wherein the second image and the third image of any one,
A method for editing photographed images, characterized in that it is replaced by one of a drag-and-drop method, a method of sequentially selecting one by one, and a method of simultaneously selecting.
The method of claim 15, wherein the automatically selected third image,
If the size is different from the second image is enlarged or reduced so as to be the same as the size of the second image is a method for editing the captured image, characterized in that.
The method of claim 10, wherein the first image and the second image,
Editing the photographed images corresponding to the images of the subject included in the rear image photographed by the first camera mounted to the portable apparatus and the front image photographed by the second camera mounted to the portable apparatus. How to.

Images