KR20140089134A - Apparatus and method for processing a dual image in device having a dual camera - Google Patents

Abstract

A method for processing an image for a device with a dual camera comprises: a preview step of displaying an image outputted from a camera when the camera operates, and displaying a camera button and a dual button; a main screen and auxiliary screen displaying step of displaying a main screen and an auxiliary screen by performing a dual-on mode when the dual button is selected in the preview step; and a main screen and auxiliary screen image switching step of switching and displaying a main screen image and an auxiliary screen image by switching camera output when the camera button is selected in the dual-on mode.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to an image processing apparatus and method for an apparatus having a dual camera,

The present invention relates to an image processing apparatus and method for an apparatus having a dual camera, and more particularly, to an apparatus and method for displaying and processing images photographed by a dual camera as a main screen and a sub screen.

Currently, a portable terminal equipped with a camera device and a camera includes a high-pixel camera and a low-pixel dual camera, which are respectively mounted on the front and rear surfaces of the device. 2. Description of the Related Art [0002] In general, an apparatus having a dual camera selects front and rear cameras independently to shoot a front face object or a back face object. That is, the conventional dual camera apparatus separately captures different images and separately manages the captured images. Therefore, in the conventional dual camera apparatus, it is impossible to photograph two front and rear images desired by the user together and to store and synthesize them. In order to do this, the two cameras are sequentially driven to take images, Had to use the method. In addition, when the images are displayed on one screen, the images are overlapped, and a manual operation such as manually placing the images is required.

The present invention proposes an apparatus and method for simultaneously displaying a dual camera and an image captured by a dual camera in an apparatus having a dual camera. Also, the present invention proposes an apparatus and method for synthesizing and storing two images photographed in a state of simultaneously driving the dual cameras. Also, the present invention proposes an apparatus and method for changing the size, position, and / or style of a sub-screen when the dual camera is simultaneously driven and displayed as a main screen and a sub-screen.

The image processing method of an apparatus having a dual camera according to an exemplary embodiment of the present invention includes a preview process of displaying an image output from a camera when the camera is driven and displaying a camera button and a dual button, Displaying a main screen and a sub-screen by performing a dual-on mode upon sensing a selection; switching the camera output when the camera button is selected in the dual-on mode to switch and display a main screen and a sub- .

The dual image processing apparatus according to an embodiment of the present invention may further include a first camera mounted on a rear surface of the apparatus, a second camera mounted on a front surface of the apparatus, and a second camera connected to the first camera and the second camera, A display unit for displaying an image to be displayed on the display unit as a main screen and a sub-screen, and a preview mode for displaying an image outputted from the camera driven at the time of driving the first camera or the second camera on the display unit, On the other hand, when the selection of the camera button is detected in the dual-on mode, the camera output is switched to control the main screen and the sub-screen image And a control unit for switching and displaying the information.

The present invention can simultaneously display images shot by a dual camera on a main screen and a sub-screen by driving a dual camera in an apparatus having a dual camera, and display camera selection and dual on / off icons on the screen, It is possible to switch between the main screen and the sub screen in accordance with the display mode, and also to perform dual on / off easily. In addition, it is possible to combine and store two images photographed in a state in which the dual cameras are driven at the same time, and it is possible to select simultaneous photographing or sequential photographing according to the user's selection, so that dual images can be obtained simultaneously or sequentially. In addition, when the dual camera is simultaneously driven to display the main screen and the sub screen, the size, position, and / or style of the sub screen can be changed.

1 is a view showing a configuration of a camera device according to an embodiment of the present invention;
2 is a flow chart illustrating a procedure for processing a dual image in an apparatus having a dual camera according to an embodiment of the present invention.
FIG. 3 is a flowchart showing a procedure for performing dual on / off in the preview mode when the camera is driven in FIG.
4A and 4B are views for explaining a display example at the time of dual on / off while performing the same procedure as in FIG.
5 is a flowchart showing a procedure of shooting an image in an apparatus having a dual camera
Fig. 6 is a flowchart showing a procedure for shooting still images in Fig. 5
FIGS. 7A to 7E are views for explaining an example of capturing a still image and a moving image by the procedure shown in FIGS. 5 and 6
8 is a flowchart illustrating a process of processing a main screen and a sub-screen in a dual mode in an apparatus having a dual camera according to an embodiment of the present invention.
9 is a flowchart showing a procedure for changing the display position and / or the size of the sub-screen in Fig. 8
Figs. 10A to 10C are diagrams for explaining an example of changing the display position and size of the sub-screen performed in Fig. 9
Fig. 11 is a flowchart showing a procedure for changing the display style of the sub-screen in Fig. 8
12A to 12C are diagrams for explaining an example of changing the display style of the sub-screen by the procedure shown in FIG.
13 is a flowchart illustrating a procedure of editing a sub-screen image by analyzing a person area after taking a main screen and a sub-screen image in a dual-on mode according to an embodiment of the present invention
14A and 14B are diagrams for explaining an example of editing an image by the procedure shown in FIG. 13
15 is a diagram showing the configuration of a portable terminal for performing a photographing operation according to an embodiment of the present invention

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible.

The apparatus having the dual camera of the present invention simultaneously drives a dual camera to acquire a plurality of images, and displays the acquired image as a main screen and a sub screen. At this time, the main screen and the sub screen can be changed by the user's camera selection. In addition, the dual camera apparatus can photograph a dual camera simultaneously by driving the dual cameras simultaneously when the photographing is requested in the dual mode, or sequentially drive the dual cameras according to the set order, and synthesize the main image and the sub- Can be generated. Also, the dual camera device can edit the sub-screen when the dual camera is simultaneously displayed by displaying the main screen and the sub-screen simultaneously, and the editing of the sub-screen changes the display size of the sub-screen, Or a displayed form of the sub-screen to be displayed, that is, a style change or the like. At this time, the editing of the sub-screen may be performed at the time of driving the dual camera, or the image shot by the dual shot may be edited.

1 is a diagram showing a configuration of a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 1, a first camera 120 (hereinafter referred to as a rear camera) is mounted on the rear side of the apparatus, and a second camera 125 (hereinafter referred to as a front camera) is mounted on the front side of the apparatus. Here, the first camera 120 may be a camera having a higher pixel count than the second camera 125. The first camera 120 and the second camera 125 may be independently driven under the control of the controller 100, and may be simultaneously driven. Also, the first camera 120 and the second camera 125 photograph a still image and a moving image by the controller 100.

The control unit 100 controls the overall operation of the camera apparatus. Also, the controller 100 can drive the first camera 120 and / or the second camera 125 and can simultaneously drive them. When the image is simultaneously driven according to the embodiment of the present invention, And control shooting and editing of the dual screen. Here, the sub-picture may be a PIP (Picture In Picture).

The storage unit 110 may include a program memory for storing a camera operation program and a program according to an embodiment of the present invention, and a data memory for storing images to be photographed.

The display unit 130 may be mounted on a front surface of the apparatus, such as the second camera 125, and displays images photographed by the first camera 120 and / or the second camera 125 under the control of the controller 100. The display unit 130 may be an LCD or an OLED. The input unit 140 generates inputs for controlling the shooting of the camera apparatus. The display unit 130 and the input unit 140 may be integrated touch screens.

2 is a flowchart illustrating a procedure for processing a dual image in an apparatus having a dual camera according to an embodiment of the present invention.

Referring to FIG. 2, when the camera driving is requested through the input unit 140, the controller 100 drives the rear camera 120 in step 211 and displays an image photographed by the rear camera 120 on the display unit 130. At this time, the controller 100 may include a camera selection button for selecting the rear camera 120 or the front camera 125 on the screen of the display unit 130, and a dual button for selecting the single / dual mode. If the dual on mode is selected by the dual button, the controller 100 senses this in step 215, simultaneously drives the rear camera 120 and the front camera 125 in step 215, and displays images captured by the two cameras 120 and 125 And displays them on the display unit 130 as a main screen image and a sub-screen image. In the dual on mode, the controller 100 processes the output of the camera selected by the camera selection button as a main screen image and the output of another camera as a sub-screen image. At this time, the control unit 100 processes the main screen image and outputs it to the display unit 130, processes the sub-screen image and displays it at a predetermined position of the main screen, and resizes the sub- And outputs it. However, if the dual-off mode is selected by the dual button, the controller 100 detects this in step 213, drives the camera selected by the camera selection button in step 217, processes the image acquired by the camera, 130. The above operation may be a preview mode operation of a device having a dual camera.

When a dual shot shot request is generated in the apparatus driven as described above, the controller 100 detects it in step 219 and performs a dual shot mode in step 221. [ When the dual shot imaging is requested, the controller 100 processes images photographed by the first camera 120 and the second camera 125 in a dual-on mode in step 221, and combines them into a main screen and a sub-screen image, And encodes and stores it in the storage unit 110. However, if the mode is the dual off mode in step 221, the control unit 100 drives the camera not in operation to switch to the dual on mode, processes the images shot by the first camera 120 and the second camera 125, Synthesizes them into a sub-screen image, displays them on the display unit 130, encodes them, and stores them in the storage unit 110. At this time, the sub-screen image may be an image shot by a camera driven upon switching to the dual-on mode. Such an operation may be a photographing mode operation of an apparatus having a dual camera.

If a camera off request is generated during the preview mode and the shooting mode using the dual camera, the controller 100 detects the camera off in step 223 and terminates the camera operation.

FIG. 3 is a flowchart illustrating a procedure for performing dual on / off in the preview mode when the camera is driven in FIG. 4A and 4B are views for explaining a display example at the time of dual on / off while performing the procedure as shown in FIG.

3 and 4A to 4B, when the camera is driven, the controller 100 displays a camera button 410 and a dual button 415 on a preview screen as shown in a screen 430 of FIG. 4A or a screen 460 of FIG. 4B in step 311. FIG. Here, the camera button 410 is a button for selecting a camera for photographing an image displayed as a main screen, and the dual button 415 is a button for selecting a dual on mode and a dual off mode. Also, in the preview screen 430 or 460, the control unit 100 displays a still image button 420 for shooting a still image, a mode button 423 for setting a shooting mode of the camera, and a movie button 425 for shooting a movie. Here, it is assumed that when the camera is driven, the controller 100 drives the first camera 120 (rear camera) and performs a dual-off mode. It is assumed that the camera button 410 and the dual button 415 are buttons operating in a toggle manner. In this case, the image displayed on the display unit 130 becomes the screen 430 of FIG. 4A. In the following description, it is assumed that the first camera 120 photographs a landscape image and the second camera 125 photographs a portrait image.

If the user touches the dual button 415 in the state of being displayed as the screen 430, the controller 100 detects the dual on mode in step 315, displays the dual button 415 as dual off in step 317, and drives the second camera 125 do. Here, the reason why the dual button 415 is displayed as dual off is to indicate that the dual button 415 is operated in the dual off mode. In step 317, the control unit 100 processes the image obtained from the first camera 120 and displays the image on the display unit 130 as a main screen. After processing and resizing the image obtained from the second camera 125, The sub screen is displayed at the set position. Here, the controller 100 knows the size and display position of an image displayed on the sub-screen, and the sub-screen can overlay display the set size of the main screen. At this time, the display position and size of the sub-screen are set to a default display position and size, and the display position and / or the display size may be changed by the user's selection. In this case, the screen displayed on the display unit 130 may be the same screen as the screen 440.

When the user selects the dual button 415 in the state of being displayed as the screen 440, the controller 100 senses this in step 315 and turns off the driving of the second camera 125 in step 319 because the current state is the dual on mode , The display of the dual button 415 is switched to dual on. Then, the image obtained by the first camera 120 is processed and displayed on the display unit 130. At this time, the screen displayed on the display unit 130 is displayed as screen 450 of FIG. 4A.

If the user selects the camera button 410 in the state shown in the screen 430 of FIG. 4A, the controller 100 detects the camera button 410 in step 313 and analyzes the state of the dual button 415 in step 321. At this time, if the dual-off state is established, the controller 100 detects this in step 321 and drives the second camera 125 and turns off the first camera 120 in step 325. And processes the image obtained by the second camera 125 and outputs the processed image to the display unit 130. The dual button 415 is displayed as dual on. That is, if the camera button 401 is selected on the screen 430 of FIG. 4A, the controller 100 generates a screen 460 of FIG. 4B on the display 130 in step 325.

When the user touches the dual button 415 in the state that the second camera 120 is turned on, the controller 100 senses it in step 321, displays the dual button 415 as dual off, and drives the first camera 120 in step 323 . In step 323, the controller 100 processes the image obtained from the second camera 125 and displays the image on the display unit 130 as a main screen. After processing and resizing the image obtained from the first camera 120, Position on the screen. In this case, the screen displayed on the display unit 130 may be the screen 470 shown in FIG. 4B.

If the user selects the camera button 410 in the state of being displayed as the screen 470, the controller 100 detects the camera button 410 in step 313 and detects it in step 315 because the current state is the dual on mode. In step 317, 120 and the second camera 125, respectively. At this time, since the camera button 410 is selected, an image of the main screen and sub-screen must be switched. Accordingly, the controller 100 processes the image obtained from the first camera 120 in step 317, displays the image on the display unit 130 as a main screen, processes and resizes the image obtained from the second camera 125, Position on the screen. At this time, the display unit 130 displays a screen 480.

As described above, when the camera button 410 is selected in the preview mode, the controller 100 switches the camera for displaying the main screen image. When the dual button 415 is selected, the controller 100 switches dual on / off. 4A and 4B, when the camera button 410 is selected in a state in which the screen 430 of FIG. 4A is displayed, the controller 100 displays a screen 460 of FIG. 4B. In a state where the screen 440 of FIG. When the camera button 410 is selected, the controller 100 displays a screen 470 shown in FIG. 4B. When the dual button 415 is selected in a state where the screen 450 shown in FIG. 4A is displayed, the controller 100 displays a screen 480 as shown in FIG.

3 and 4A to 4B, the user can photograph a still image or a moving image using the still image button 420 or the moving image button 425 in the preview mode. FIG. 5 is a flowchart illustrating a procedure of capturing an image in an apparatus having a dual camera, and FIG. 6 is a flowchart illustrating a procedure of capturing a still image in FIG. FIGS. 7A to 7E are views for explaining an example of capturing a still image and a moving image by the procedures shown in FIGS. 5 and 6. FIG.

5, 6, and 7A to 7E, if the still image button 420 is selected in the preview mode, the controller 100 senses it in step 511, acquires and stores a still image from the camera in step 550 . The still image photographing can be performed by the procedure shown in FIG.

Referring to FIG. 6, in the apparatus having a dual camera, simultaneous shooting and sequential shooting can be used for shooting a still image, which can set a shooting method in a setting mode. When the user sets the camera in the setting mode, a shooting mode menu is displayed as indicated by 710 on the screen 720, and the shooting mode menu 710 has a dual shot mode. When the user selects the dual shot mode, the controller 100 displays a dual shot menu such as 715. [ The dual shot menu 715 indicates to select either simultaneous shooting (sync) or sequential shooting (async). Here, the simultaneous photographing is a photographing mode in which a photographing image is simultaneously acquired from the front and rear cameras, and the sequential photographing means a photographing mode in which an image is acquired from the camera of the main screen and then an image is obtained from the sub-screen. The simultaneous photographing simultaneously processes the images output from the two cameras as a still image when a photographing is requested. At this time, the user generally sets the main screen image to fit the shooting composition in the dual shot shooting, and in this case, the shooting composition of the sub-screen image may not be in a desired state. In this case, it may be desirable to use sequential imaging. In the sequential shooting method, first, the main screen image is set to a desired shooting composition (first shutter-on point), and then the sub-screen image is set to a desired shooting composition (second shutter-on point). In the embodiment of the present invention, simultaneous shooting or sequential shooting can be selected according to the user's selection when setting the dual shot mode.

 If the still image button 420 is selected, the control unit 611 checks the shooting mode. At this time, if the mode is the simultaneous photographing mode, the controller 100 detects it in step 611 and checks whether it is currently in a dual on state in step 641. [ At this time, if the mode is the dual off mode, the controller 100 senses this in step 641, processes the image currently captured in the camera (the first camera 120 or the second camera 125) as a still image in step 631, Screen 730 is displayed. In this case, the still image processed by the controller 100 may be an encoded image (for example, a JPEG image), and the still image is stored in the storage unit 110 in step 633. [ However, if the dual on mode is determined in step 641, the controller 100 captures an image obtained by the first camera 120 and the second camera 125 as a still image, as shown in step 740 in step 643. At this time, when the image of the screen 740 is processed, the controller 100 processes the output of the first camera 120 that captures an image of the main screen in step 643 and displays it as a main screen image, And displays it as a sub-screen image. At this time, the still images of the main screen and the sub-screen processed by the controller 100 are synthesized and displayed on the display unit 130. In step 645, still images (composite image of the main screen and the encoded image) And stores it in the storage unit 110 as an image.

FIG. 7B illustrates a method of setting the sequential shooting mode. When the camera setting mode is selected as described above, the shooting menu including the dual shot mode is displayed as indicated by 710 on the screen 750. When the dual shot mode is selected, simultaneous shooting and sequential shooting Display the team in shooting. At this time, if the sequential shooting menu is selected as in the screen 750, a single image such as a screen 755 can be acquired in a dual off state and a dual image as a screen 760 in a dual on state. At this time, when the sequential shooting mode is selected, the controller 100 may display a sequential shooting sequence in the dual on mode. The screen 750 shows an example of shooting a main screen image first and a sub-screen image by a second shutter switch. The screen 760 may be displayed during the set time (N sec) in the sequential shooting setting in the dual on mode.

When the still image button 420 is generated in the state in which the sequential shooting is set as described above, the controller 100 detects it in step 611 and checks whether it is in a dual on state in step 613. [ At this time, if the camera is in the dual off state, the controller 100 detects it in step 613, and processes the images photographed by the currently driven camera while performing steps 631 and 633, and stores the image.

However, if it is in the dual on state, the controller 100 detects it in step 613 and performs the sequential shooting mode. At this time, when the controller 100 detects the selection of the still image button 420 in the state in which the sequential shooting is set, the controller 100 may guide the main screen and the sub screen being displayed to be sequentially picked up. In the sequential shooting mode, the controller 100 shoots the main screen image in step 615 and displays the sub-screen image in a preview state. That is, in step 615, when the control unit 100 senses the input of the still image button 420 as shown on the screen 765, the control unit 100 captures a main screen image (assuming that the image is acquired by the first camera 120 on the screen 765) , And displays the generated still image on the display unit 130. At this time, the sub-screen image (assuming that the image is acquired by the second camera 125 on the screen 765) is processed as a preview image. Accordingly, the display unit 130 displays a still image on the main screen and displays a preview image on the sub-screen as shown on the screen 760. [

If the user selects the still image button 420 for the second time as shown in the screen 770 of FIG. 7C, the controller 100 detects it in step 617 and processes the sub-screen image in step 619 to generate a still image. At this time, the main screen image is captured as a still image, and thus the main screen is displayed as a still image. In step 619, the controller 100 synthesizes the still images of the main screen and the sub-screen as a screen 775, displays them as one still image on the display 130, and displays the combined still images of the main screen and the sub- Encoded in a set manner, and stored in the storage unit 110.

Accordingly, in the sequential shooting, the user can set a desired composition of the main screen image to perform a first shooting, and then set a desired composition of the sub-screen image to be able to take a second shot, thereby obtaining a main screen and a sub- .

When the user selects the video button, the controller 100 detects the video button in step 511 of FIG. 5 and checks whether the mode is the dual on mode in step 513. FIG. At this time, if the mode is the dual on mode as in 780 of FIG. 7d, the controller 100 detects it in step 513, and performs dual on-motion video shooting on the screen 783 in step 515. FIG. In step 515, the controller 100 synthesizes a sub-screen image on the main screen image and then displays the sub-screen image on the display unit 130. The controller 100 also encodes the synthesized moving image of the two images and records do. Therefore, the moving picture photographed in the dual on mode is recorded after the moving picture of the main picture and the sub picture picked up by the dual camera are synthesized and encoded. If the dual off is not set, the controller 100 repeats the operation of step 517 until the end of the motion picture recording is requested, and records the dual motion picture.

However, if the user selects the dual button 415 during the recording of the moving image in the dual on mode and requests to switch to the dual off mode, the controller 100 detects this in step 517 and displays it on the screen 785 of FIG. The driving of the camera for generating the sub-screen image is turned off, and the moving picture recording operation in the dual off mode is performed. Also, when the moving picture button is selected as shown in the screen 790 of FIG. 7E in the state of performing the dual off mode as in the screen 790, the moving picture of the dual off mode is recorded. Accordingly, if it is detected in step 513 that the dual off mode is detected as shown in the screen 790 of FIG. 7E, or if the dual on mode is detected in the dual on mode as shown in the screen 783 of FIG. 7D in step 517, 7e or a picture 785 of FIG. 7d on the display unit 130. The main screen image is motion-coded and stored in the storage unit 110. FIG. When the recording end request is generated in the state of executing the moving picture recording in the dual off mode, the controller 100 detects it in step 523 and ends the moving picture recording.

As described above, in the apparatus having a dual camera, it is possible to easily perform on / off of the dual mode for displaying the main screen and the sub-screen image on the display unit 130 according to the user's selection in the preview mode, It is possible to easily select the camera for generating the image. In addition, a main screen and a sub-screen image generated in a dual-on mode at the time of shooting can be synthesized and recorded as a still image and a moving image, and sequential shooting at shooting can be performed to acquire a main screen and a sub- have. Also, when performing a dual mode in an apparatus having a dual camera, the sub-screen image can be edited in various forms or the style can be changed. Here, if editing means changing the display position of the sub-screen and / or the screen size to be displayed, the style editing means setting or changing the display type of the sub-screen to the style type or the like.

FIG. 8 is a flowchart illustrating a process of processing a main screen and a sub-screen in a dual mode in an apparatus having a dual camera according to an embodiment of the present invention.

8, when the camera is driven, the controller 100 detects it in step 811 and performs a dual on / off preview mode according to the selection of the camera button 410 and the dual button 415 in step 813. Here, the operation of step 813 may be performed by the method shown in FIG. 3 and FIGS. 4A to 4B. The controller 100 executes a dual on mode in which the main screen and the sub screen are displayed and a dual off mode in which only the main screen is displayed in response to the selection of the dual button 415. In addition, Thereby controlling the camera to be generated.

The display position and / or size of the sub-screen displayed in the preview mode may be changed as in step 813, and the display style of the sub-screen may be changed. When the user requests to change the display position and / or size of the sub-screen to be displayed, the controller 100 detects the display position and / or the size of the sub-screen displayed in step 821. In step 823, Change the size. If the user requests to change the display style of the sub-screen, the controller 100 detects the change in the display style of the sub-screen in step 831 and changes the display style of the sub-screen to the display style selected in step 833.

If the still image button 420 or the moving picture button 425 is selected in the preview state, the controller 100 detects it in step 841 and records a still image or a moving image according to the set photographing mode in step 843. [ The method of photographing in step 843 may be performed by the method shown in FIGS. 5, 6 and 7A to 7E.

9 is a flowchart showing a procedure for changing the display position and / or the size of the sub-screen in Fig. 10A to 10C are views for explaining an example of changing the display position and size of the sub-screen performed in FIG.

Referring to FIG. 9 and FIGS. 10A to 10C, when the main screen and the sub screen are displayed as shown in the screen 1020 of FIG. 10A by performing the dual on mode and tap and hold is performed as shown in 1005, In step 821 of FIG. 8, the controller 100 detects that the mode is a mode for changing the display position and / or the size of the sub-screen, and displays a handler such as 1010 on the screen 1030 in step 911 of FIG. When the handler 1010 is enabled, the display of the left and right buttons (icons) is removed as shown on the screen 1030, and the main screen area The display of the handler 1010 is removed, and the left and right buttons (icons) are displayed again.

 When the handler 1010 is displayed and the user touches and drags the sub screen area as shown in the screen 1040, the controller 100 displays the sub screen in the drag direction as shown in screens 1045 and 1050 of FIG. 10B in step 915 . At this time, a screen 1045 shows a case of a wide screen (16: 9 screen), and a screen 1050 shows a case of a normal screen (normal, 4: 3 screen). In the case of the normal screen, both sides of the screen may be displayed in black. If the main screen area is tapped as shown in the screen 1055 after the sub screen area is dragged as described above and the sub screen area is moved to a desired position, the controller 100 detects this in step 921, and displays the handler And the left and right buttons are reactivated and displayed. Accordingly, the controller 100 can move the display position of the sub-screen as shown in the screen 1055. [

 When the handler 1010 is touched and dragged as shown in the screen 1060 of FIG. 10C in the state where the handler is displayed, the controller 100 detects the handler 1017 in step 917 and displays the handler 1010 in the drag direction as shown in screens 1065 and 1070 of FIG. Enlarge or reduce the size of the screen. At this time, a screen 1065 shows a case of a wide screen (16: 9 screen), and a screen 1070 shows a case of a normal screen (normal, 4: 3 screen). In the case of the normal screen, both sides of the screen may be displayed in black. If the handler displayed on the sub-screen is dragged as described above to adjust the size of the sub-screen to a desired size and the main screen area is tapped as shown in the screen 1075, the controller 100 senses it in step 921, Remove the handler display in the step and activate the left and right buttons again to display. Accordingly, the controller 100 can adjust the display size of the sub-screen as shown in the screen 1055.

FIG. 11 is a flowchart illustrating a procedure for changing a display style of a sub-screen in FIG. 8, and FIGS. 12A to 12C are views for explaining an example of changing a display style of a sub-screen according to the procedure shown in FIG.

Referring to FIG. 11 and FIGS. 12A to 12C, the controller 100 displays a button 1210 in a state of displaying a main screen and a sub screen as shown in a screen 1240 of FIG. 12A. The button 1210 may be used as a button for selecting filters in the dual off mode, and may be used as a style button 1210 for selecting a style type of a sub screen in a dual on mode displaying a main screen and a sub screen. Accordingly, when the style button 1210 is selected, the controller 100 determines that the style is changed in step 831 of FIG. Accordingly, if it is detected in step 1111 of FIG. 11 that the style button 1210 is selected, the controller 100 displays a style tool bar for selecting a style at the bottom of the dual on mode screen as shown in the screen 1250 of FIG. ) ≪ / RTI > If the user selects a desired style type in the style tool bar 1220, the controller 100 displays the sub-screen in the selected style type in step 1115.

In the embodiment of the present invention, the style type of the sub screen may be implemented in various forms. 12B and 12C are diagrams showing examples of style types according to an embodiment of the present invention. In this case, the default type of the display style of the sub-screen may be a rectangular style, and a Cubism effect, a Split view (style type that displays the main screen and the sub-screen at the same size), a Polaroid, a Postcard, a Circle, A style type in which the main screen and sub screen are overlaid by the same size), Heartshape, Shiny, and Stamp. Accordingly, when the user selects the style button 1210 and selects a desired style type from the style tool bar 1220 displayed as shown in FIGS. 12B and 12C, the controller 100 displays the sub-screen image with the selected style type.

At this time, when the still image is captured in the dual-on mode, the main screen image and the sub-screen image can be influenced each other. That is, depending on the display position and size of the sub-screen, a part of the subject of the main screen may be covered. For example, if the main screen is a portrait, a part of the body may be covered by the sub-screen. Also, if the image of the sub-screen is a portrait image in the dual-on mode, the position where the sub-screen is displayed may be unnatural according to the line of sight of the person. Accordingly, it is preferable that the controller 100 photographs the main screen and the sub-screen image in the dual-on mode to generate a composite image, and then analyzes the character area of the main screen and the sub-screen image to edit the image appropriately.

13 is a flowchart illustrating a procedure of editing a sub-screen image by analyzing a person area after taking a main screen and a sub-screen image in a dual-on mode according to an embodiment of the present invention. 14A and 14B are views for explaining an example of editing an image by the procedure shown in FIG. The operation as shown in FIG. 13 may be performed in step 621 or step 645 of FIG.

13 and 14A to 14B, after capturing a dual image, the controller 100 synthesizes the two images, and recognizes and analyzes the character area of the composite image in step 1311. FIG. At this time, in the composite image analysis process, the character area of the main screen can be analyzed and the gaze direction of the sub screen can be analyzed. At this time, a partial area of the subject of the main screen may be masked by the image of the sub-screen synthesized by overlaying at the time of the dual shot. Accordingly, the controller 100 analyzes the main screen image in step 131 and determines the main object based on the face detection (person) and the salience (building, etc.). 14A, the control unit 100 processes the image of the sub screen 1420 as shown in the screen 1445 in step 1313. If the subject 1430 of the main screen 1410 is overlapped with the sub screen 1420 So that the subject 1430 of the main screen 1410 is normally displayed. That is, in step 1315, the controller 100 arranges the sub-screen in a range where the subject of the main screen is not covered. Therefore, if the composition of the two images is partially changed to overlap the sub-screen image on the subject of the main screen image, the size or position of the sub-screen image is changed. Thus, it is possible to prevent a situation in which the main shot intended by the dual shot is covered.

If the sub-screen is a portrait image, the controller 100 detects the direction of the line of sight in the face area of the sub-screen in step 1311. [ In step 1321, the controller 100 checks whether the display position of the sub-screen differs from the viewing direction. If the display position is different, the controller 100 automatically adjusts the display value of the sub-screen in the direction of the gaze of the person. That is, when the control unit 100 determines that the viewing direction of the sub-screen person and the display position of the sub-screen are analyzed and a position different from the viewing direction, i.e., the viewing direction is located at the end of the main screen (upper and lower and left and right ends of the main screen) , The display position of the sub screen is automatically moved as shown in FIG. 12B.

In the case of dual shot shooting in a state in which the main screen and the sub-screen are displayed, it is difficult to shoot both the main screen and the sub-screen in a desired structure. In this case, if the main screen image is set to a desired composition and then the shutter switch is turned on, the control unit 100 may use a method of photographing a main screen image as a still image and a sub-screen image as a burst shot. In this case, the main screen image may be captured as a still image, and the sub-screen image may be captured as a plurality of images by a burst shot. If an image of a desired composition is selected from among the sub-screen images and then synthesized into a main screen image, an image of the main screen and the sub-screen can be photographed in a desired composition.

Also, when the main screen is shot as a still image and the sub-screen is shot as a burst shot, the control unit 100 can shoot the shot as a dual animated shot. This allows emotional expression of the main screen image using a sub-screen image. In this case, the controller 100 shoots the main screen image as a still image and the sub-screen image as a burst shot (continuous shooting) when shooting the dual shot. In this case, the change of the photographer or the expression of the subject or the description of the photograph can be stored together with animation or voice.

15 is a diagram illustrating a configuration of a portable terminal that performs a photographing operation according to an embodiment of the present invention. Here, the portable terminal may be various digital devices such as a mobile phone including a smart phone, an MP3 terminal, a tablet, a computer, and a camera.

Referring to FIG. 15, the communication unit 170 performs a wireless communication function with a base station, an Internet server, and the like. The communication unit 170 may include a transmitter for up-converting and frequency-amplifying a frequency of a transmission signal, and a receiver for performing low-noise amplification and frequency down-conversion on a reception signal. The communication unit 170 may include a modulation unit and a demodulation unit. The modulator modulates the transmission signal and transmits the modulated signal to the transmission unit, and the demodulation unit demodulates the signal received through the reception unit. In this case, the modulation and demodulation unit may be LTE, WCDMA, GSM, WIFI, WIBRO, NFC, Bluetooth, or the like. In the embodiment of the present invention, it is assumed that the communication unit 170 includes LTE, WIFI, and bluetooh communication units.

The first camera 120 can photograph a high resolution image using a rear camera mounted on the rear surface of the terminal device. The second camera 125 is a front face camera mounted on the front face of the terminal device, and can take a relatively low-resolution image compared to the first camera 120.

The controller 100 controls the overall operation of the portable terminal, and controls operations such as previewing of the main screen and the sub-screen, shooting, and editing of the sub-screen in the dual-on mode according to the embodiment of the present invention.

The storage unit 110 may include a program memory for storing an operation program of the terminal and a program according to an embodiment of the present invention, tables for operation of the terminal, and a data memory for storing data generated during program execution. Also, the storage unit 110 stores the style types of the sub-screen according to the embodiment of the present invention, and stores still images and moving images photographed in the dual-on mode.

The display unit 130 displays information of an application being executed under the control of the controller 100. [ The display unit 130 displays images of the main screen and the sub-screen under the control of the controller 100 in the dual on mode. The display unit 130 may be an LCD or an OLED. The input unit 140 may be implemented by a correction capacitance method or a resistance film method, and outputs the position information of the user's touch (hereinafter referred to as a finger touch) to the controller 100. Further, the input unit 140 may further include an EMR sensor pad, and senses the pen touch input and outputs the pen touch input to the controller 100. The display unit 130 and the input unit 140 may be integrally formed.

The audio processing unit 150 processes audio signals generated in the communication mode under the control of the controller 100. [ The sensor 160 includes sensors for detecting movement of the portable terminal. The sensors may be comprised of an acceleration sensor, a geomagnetic sensor, and / or position sensing sensors.

When the camera 120 and / or the camera 125 is operated, the controller 100 displays the images output from the cameras 120 and / or 125 on the display unit 130, and displays camera buttons 410 and / And a dual button 415 for turning on / off the dual mode display. Accordingly, the controller 100 can display a dual image on the display unit 130 by selecting the user's dual button 415, and can select a camera to output a main screen image by selecting the camera button 410 when displaying a dual image.

In the preview mode, the controller 100 processes images output from the cameras 120 and / or 125 according to the selection of the buttons 410 and / or 415 in the same manner as in FIGS. 3 and 4A to 4B. Also, in the shooting mode, the control unit 100 performs processing in the same manner as in Figs. 5, 6 and 7A to 7E. In addition, in the dual on mode, it is possible to perform an editing function of changing the display position of the sub-screen, the size adjustment, the display style type, and the like. . ≪ / RTI > When synthesizing the main screen and the sub screen, the synthesized image of the main screen and the sub screen can be analyzed to control the image of the main screen and / or the sub screen. This is performed by the method shown in FIG. 13 and FIGS. 14A to 14B can do.

The embodiments of the present invention disclosed in the present specification and drawings are merely illustrative of specific embodiments of the present invention and are not intended to limit the scope of the present invention in order to facilitate understanding of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims (15)

1. An image processing method for an apparatus having a dual camera,
A preview process of displaying an image outputted from the camera when the camera is driven and displaying a camera button and a dual button,
Displaying a main screen and a sub-screen by performing a dual-on mode when detecting the selection of a dual button in the preview process;
And switching and displaying the main screen and the sub-screen image by switching the camera output when the camera button is selected in the dual-on mode. The method according to claim 1,
The preview process displays a photographing button,
Capturing the main screen and the sub-screen as a still image by selecting the shooting button, and composing and storing the captured still image. 3. The method according to claim 2, wherein the photographing process photographs a still image,
The still image capturing is performed by capturing a main screen image at the first shutter-on, capturing a sub-screen image at the second shutter-on, compositing the captured images of the sequentially captured main screen and sub-screen, Lt; / RTI > 4. The method according to claim 3, wherein the photographing process photographs a moving image,
Wherein the moving picture capturing includes synthesizing a main screen and a sub-screen image in each frame, and encoding the combined main screen and sub-screen image into a moving picture. The method according to claim 1,
Displaying a handler when selecting a sub-screen image in the preview process;
And moving the sub-screen image in the drag direction when the sub-screen image on which the handler is displayed is dragged. 6. The method of claim 5,
Wherein the editing step further comprises the step of enlarging or reducing the sub-screen image in the drag direction by dragging the handler in a state in which the handler is displayed. The method according to claim 6,
Wherein the editing process removes the display of the buttons displayed on the screen when the handler is displayed on the sub-screen. The method according to claim 1,
The preview process displays a style button,
Displaying the style of the sub-screen on the style tool when the style button is selected;
Further comprising changing a display style of the sub-screen to a style type selected from a displayed style toolbar. In a dual image processing apparatus,
A first camera mounted on a rear surface of the apparatus,
A second camera mounted on a front surface of the apparatus,
A display unit for displaying an image outputted to the first camera and the second camera in a dual on mode as a main screen and a sub screen,
The image output from the camera driven by the first camera or the second camera performs a preview mode for displaying on the display unit, and displays a camera button and a dual button. When the dual button is selected, a dual on mode is performed Wherein the controller is configured to display a main screen and a sub-screen on the display unit, and to switch and display a main screen and a sub-screen image by switching the camera output when the camera button is selected in the dual on mode. 10. The method of claim 9,
Wherein the control unit displays a shooting button on the display unit in a preview mode and captures an image of the main screen and the sub screen output from the first and second cameras as a still image when the shooting button is selected, And the still image is synthesized and stored in the storage unit. 11. The method of claim 10,
The photographing button is a still image button,
The control unit captures the main screen image by the first shutter-on when the private key button is selected and captures the sub-screen image by the second shutter-on, and then displays the captured image of the main screen and the sub- And then stores the encoded data. 12. The apparatus of claim 11, wherein the photographing button further comprises a moving picture button,
Wherein the control unit synthesizes a main screen and a sub-screen image in each frame when the motion picture button is selected, and encodes the synthesized main screen and the sub-screen image to be encoded. 10. The method of claim 9,
Wherein the control unit displays a handler on the sub-screen when the sub-screen image is selected in the preview mode, and moves the sub-screen image in a drag direction of the sub-screen image on which the handler is displayed. 14. The method of claim 13,
Wherein the control unit enlarges or reduces the sub-screen image in a drag direction when the handler is dragged while the handler is being displayed. 10. The method of claim 9,
The control unit displays the style buttons in the preview mode. When the style button is selected, the control unit displays the display styles of the sub-screen in the style tool bar and changes the display style of the sub- Lt; / RTI >

Images