KR20110035121A - Image photographing apparatus and method thereof - Google Patents

Abstract

PURPOSE: An image photographing apparatus and a method thereof are provided to set up a desirable composition at spot through a camera having low specifications which provides a preview screen for a subject. CONSTITUTION: A first photographing unit(121) is installed at a first position of an image photographing device, and a second photographing unit(122) is installed at a second position of the image photographing device. Based on the subject photographed through the first photographing unit, a control unit(180) sets up a reference composition. When the photographing composition for the subject is matched with the reference composition, the control unit photographs the subject through the second photographing unit. The second photographing unit provides the photographing composition.

Description

Image capturing device and method thereof {IMAGE PHOTOGRAPHING APPARATUS AND METHOD THEREOF}

The present invention relates to an image capturing apparatus and a method thereof, and more particularly, to an apparatus for capturing an image with a stable composition using a camera and an image capturing method in such a device.

In general, an image capturing apparatus installed in a mobile terminal according to the prior art photographs a photographing unit (first photographing unit) and a person or a background screen installed in front of the mobile terminal in order to make a video call or take a self image. It includes a photographing unit (second photographing unit) installed in the rear of the mobile terminal. Since the first photographing unit is for taking a video call or a simple self image, the specification is low (low quality), while the second photographing unit is relatively high (high definition).

When the user turns the terminal upside down and takes a picture to take a high-quality self image through the second photographing unit, it is difficult to take a picture in a desired composition because the captured image cannot be previewed. In addition, there is a limit to the user to obtain a stable composition only by the convex mirror installed on the rear of the mobile terminal.

The present invention is to solve the above problems, when taking a self-image in the mobile terminal by setting a reference composition by setting a reference composition by taking a stable self-image of a stable composition with a low-specific camera provided with a preview screen for the subject The present invention provides an image capturing apparatus and method capable of capturing a high-quality self image of a stable structure by automatically photographing a self image with a high specification camera when it matches.

In addition, the present invention provides an image capturing apparatus and a method for inducing to take a high-fidelity self-image of a stable composition by guiding the high-capacity camera to take a self-image according to a reference composition set through a low-specific camera.

In addition, the present invention is an image recording apparatus and method that can provide a user's convenience by assisting to shoot according to a predetermined composition through a low specification camera regardless of the rotation state of the mobile terminal when taking a self-image with a high specification camera To provide.

An image capturing apparatus for solving the technical problem includes a first capturing unit, a second capturing unit, and a controller. The first photographing unit is installed at a first position of the image photographing apparatus. The second photographing unit is installed at a second position of the image capturing apparatus. The control unit sets a reference composition based on the subject photographed through the first photographing unit, and when the photographing composition of the subject provided through the second photographing unit matches the reference composition, through the second photographing unit. Shoot the subject.

In a preferred embodiment, the control unit outputs information about a moving direction of the image photographing apparatus to match the photographing composition to the reference composition when the photographing composition does not match the reference composition.

Also in a preferred embodiment, when the photographing composition matches the reference composition, information for photographing instruction is output.

On the other hand, it is preferable that the first position is the front side of the image photographing apparatus, and the second position is the rear side of the image photographing apparatus.

Preferably, the control unit may include a composition setting unit and a composition comparison unit. The composition setting unit sets the reference composition and the photographing composition. The composition comparison unit checks whether the photographing composition matches the reference composition.

Also, preferably, the composition setting unit includes a background composition setting unit and a person composition setting unit. The background composition setting unit sets the composition of the background. The person composition setting unit sets the composition for the person.

The background composition setting unit may set the composition of the background using a scale invariant feature transform (SIFT), Kanade Lucas Tomasi (KLT) or Harris corner detector method.

On the other hand, the controller determines whether the photographing composition matches the composition that rotates the reference composition at a predefined angle, and when the photographing composition matches the rotated composition, sets the photographing composition to the predefined angle. The subject is photographed through the second photographing unit by rotating in reverse direction.

Meanwhile, the image capturing method for solving the other technical problem is to photograph the subject through the second photographing unit according to a reference composition set through the first photographing unit. The image capturing apparatus first photographs a subject through a first photographing unit installed at a first position of the image capturing apparatus. The reference composition is set based on the photographed subject. Also, a photographing composition of the subject provided through a second photographing unit installed at a second position of the image photographing apparatus is set. Then, it is checked whether the photographing composition matches the reference composition. Also, when the photographing composition matches the reference composition, the subject is photographed through the second photographing unit.

In a preferred embodiment, the photographing of the subject through the second photographing unit may be performed by adjusting the photographing composition to the reference composition when the photographing composition does not match the reference composition. Outputting information relating to the information.

In addition, in the preferred embodiment, the photographing of the subject through the second photographing unit includes outputting information for photographing instruction when the photographing composition matches the reference composition.

On the other hand, the checking may include checking whether the photographing composition is matched with the composition by rotating the reference composition at a predetermined angle, and photographing the subject through the second photographing unit, wherein the photographing composition is the reference composition And photographing the subject through the second photographing unit by reversely rotating the photographing composition to the predefined angle when matched with.

According to the present invention, when a user takes a high-quality self-image, a low-definition camera provided with a preview screen for a subject may instantly set a desired composition, thereby ensuring a high-quality self-image with a stable composition according to each situation. .

Such an image capturing apparatus and method having a simple composition setting procedure and a convenient photographing procedure have advantages in reducing the time cost and hardware burden associated with repetitive photographing and increasing the utilization of the camera function of the mobile terminal.

Hereinafter, when taking a self-image with the image capturing device, after setting a reference composition (hereinafter referred to as the reference composition) by shooting a subject with a low-definition camera installed on the front, the subject provided by the high-definition camera installed on the rear An exemplary embodiment of an image capturing apparatus and method for assisting photographing so that a composition (hereinafter, referred to as a photographing composition) can be photographed as a reference composition will be described in detail with reference to FIGS. 1 to 9.

1 is a block diagram of a mobile terminal to which an image photographing apparatus according to an embodiment of the present invention is applied. In the present embodiment, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, a controller 180, and a power supply 190 are included.

The wireless communication unit 110 performs the modulation / demodulation and encoding / decoding operations of signals transmitted and received with the base station of the wireless communication system so that the mobile terminal 100 can communicate with other terminals through the wireless communication system. The wireless signal transmitted and received by the mobile terminal 100 to the base station of the wireless communication system may be a voice call signal, a video call call signal or a text message. The wireless communication unit 110 includes a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, and a location information module 115.

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The position information module 115 is a module for checking or obtaining the position of the mobile terminal (it is possible to check the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal. The A / V input unit 120 includes a first photographing unit 121, a second photographing unit 122, and Microphone 123 is included. The first photographing unit 121 and the second photographing unit 122 process image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 and may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110.

According to the present invention, the first photographing unit 121 is installed at the first position of the mobile terminal, and the second photographing unit 122 is installed at the second position of the mobile terminal. Advantageously, said first position is a front side of said mobile terminal and said second position is a rear side of said mobile terminal. The first photographing unit 121 is for a video call, a simple self-photographing, etc., and includes a camera of low specification (low definition), and the second photographing unit 122 is for a portrait, a background photographing, etc. It includes a camera.

The microphone 123 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 accepts an input command that the user applies for controlling the operation of the terminal, and transfers the received command to the controller 180 so that the controller 180 operates according to the command. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

According to the present invention, the user input unit 130 inputs (eg, a shutter release signal, a zoom signal, etc.) for photographing a subject to set a reference composition from the user through the first photographing unit 121, and the second photographing unit. An input (eg, a shutter release signal, a zoom signal, etc.) for photographing a subject is received through a composition corresponding to the composition set through the 122.

The sensing unit 140 may be a mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, a presence or absence of a user contact, an orientation of the mobile terminal 100, an acceleration / deceleration of the mobile terminal 100, or the like. The sensing state of the mobile terminal 100 generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is a slide phone type, it may sense whether the slide phone is opened or closed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

According to the present invention, the sensing unit 140 is a photographing guide for matching the composition, that is, when the photographing composition does not match the reference composition of the mobile terminal according to the movement direction guide of the mobile terminal for matching the photographing composition to the reference composition. Monitor the movement.

The output unit 150 is for outputting an audio signal, a video signal or an alarm signal, and the output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may include.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 outputs the touch screen. In addition to the device can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

The act of bringing the pointer closer to the touch screen without being touched to recognize that the pointer is located on the touch screen is called "Proximity Touch", and the pointer is actually touched on the touch screen. The behavior is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for event occurrence notification may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

The haptic module 154, in addition to the vibration, the pin arrangement to move vertically with respect to the contact skin surface, the blowing force or suction force of the air through the injection or inlet, the grazing to the skin surface, the contact of the electrode (eletrode), the stimulation such as electrostatic force Various tactile effects can be produced, such as the effects of the heat-absorbing effect and the effect of reproducing a sense of cold using the elements capable of absorbing heat or heat.

The haptic module 154 may not only deliver a tactile effect through direct contact, but also may allow a user to feel the tactile effect through a muscle sense such as a finger or an arm.

The memory 160 is a ROM (Read Only Memory) 161 for storing a program for the operation of the controller 180, for example, a flash memory, and a RAM for storing temporary output data processed for transmission / reception or display. Access Memory, 162).

According to the present invention, the ROM 161 stores a program for photographing an image, a program for editing the photographed image, and an image photographed by the second photographing unit 122. The RAM 162 stores image data and a reference composition for the subject photographed by the first photographing unit 121, image data and a photographing composition about the subject provided by the second photographing unit 122, a reference composition, and a photographing composition. Temporarily stores the comparison result. In addition, the RAM 162 may further store separation information on the composition when the photographing composition does not match the reference composition.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and universal user authentication. It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 sets the image data and the reference composition for the subject photographed through the first photographing unit 121 and stores the image data and the reference composition in the RAM 162. In addition, the controller 180 sets a photographing composition of a subject provided through the second photographing unit 122 and stores the photographing composition in the RAM 162. In addition, the controller 180 compares the photographing composition stored in the RAM 162 with the reference composition. The controller 180 automatically photographs a subject through the second photographing unit 122 when the photographing composition matches the reference composition.

Preferably, when the photographing composition does not match the reference composition, the controller 180 outputs information regarding a moving direction of the image photographing apparatus to match the photographing composition to the reference composition. Also, preferably, the controller 180 outputs information for photographing instruction when the photographing composition matches the reference composition.

Meanwhile, the controller 180 checks whether the photographing composition matches the composition rotated from the reference composition at a predetermined angle (for example, 90 degrees, 180 degrees, or 270 degrees), and photographs when the photographing composition matches the rotated composition. The composition is reversed at a predetermined angle to photograph the subject through the second photographing unit 122.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

2 is a detailed block diagram of the controller 180 shown in FIG. 1. In the present embodiment, the controller 180 includes a main controller 182, a composition setting unit 183, a composition comparison unit 186, a shooting guide unit 187, and a shooting control unit 188. Meanwhile, for convenience of description, FIG. 2 illustrates a user input unit 130, an A / V input unit 120, a memory 160, and an output unit 150.

The main controller 182 controls operations of other components in the controller 180 and the user input unit 130, the A / V input unit 120, the memory 160, and the output unit 150.

The composition setting unit 183 includes a person composition setting unit 184 and a background composition setting unit 185. The composition setting unit 183 sets a reference composition based on the subject photographed through the first photographing unit 121, and sets a photographing composition of the subject provided through the second photographing unit 122. The composition setting unit 183 stores the set reference composition and photographing composition in the RAM 162.

The person composition setting unit 184 analyzes image data of a subject photographed through the first photographing unit 121 and the second photographing unit 122, and relates to the number, position, size, and direction of the face in the image area. Extract the information. The background composition setting unit 185 analyzes image data of a subject photographed through the first photographing unit 121 and the second photographing unit 122, and extracts information about a main subject except for the person part in the image area. .

Preferably, the person composition setting unit 184 detects a face using a method of detecting a face using surface property information such as a known skin color of a face or a method of detecting a face using geometric property information such as a head or an eye, Among them, the face part is particularly detected. Also, the background composition setting unit 185 may detect the background part of the subject through a known scale invariant feature transform (SIFT), Kanade Lucas Tomasi (KLT), or Harris corner detector. Extract.

SIFT is an algorithm that extracts information from a specific object that best represents that object. The information that best represents an object does not change even if its position, orientation, or size changes. KLT refers to an algorithm that performs image tracking and stereo matching by detecting edges that are low-level feature points in consecutive image frames and stereo images. Harris corner detector is a feature extraction algorithm that is robust to rotation, brightness variations or image noise. Such techniques may be used by the person composition setting unit 184 to extract a person part of a subject.

The composition comparison unit 186 receives a command from the main controller 182, and in response, reads a reference composition and a photographing composition stored in the RAM 162, compares them, and transmits a comparison result to the main controller 182.

The composition comparison unit 186 determines whether the number, size, position, and direction of the face in the portrait portion of the photographing composition correspond to the number, size, position, and direction of the face in the portrait portion of the reference composition within a predetermined error range. To judge. Also, the composition comparison unit 186 determines whether the arrangement of the background portion of the photographing composition coincides with the arrangement of the reference composition within a predetermined error range. This comparison determination operation is continued until the end of shooting by the user, the passage of a predetermined time or the composition is matched.

Preferably, the composition comparison unit 186 may store, in the RAM 162, the spaced apart information of the two compositions, that is, the spaced direction and the distance, when the photographing composition does not match the reference composition.

Also, the composition comparison unit 186 may determine whether the photographing composition matches the composition in which the reference composition is rotated at a predetermined angle (for example, 90 degrees, 180 degrees, or 270 degrees). . If the composition comparison unit 186 compares the composition of the reference composition rotated at a predetermined angle with the photographing composition, if the user matches the reference composition in which only the composition of the photographed subject is rotated even if the user holds the image photographing device upside down or tilts it. Allows you to shoot in the desired composition. Afterwards, the photographing control unit 188 matches the photographing composition (by rotating the reference composition by the reverse angle) to shoot or stores the image data stored after shooting by rotating the reference composition by the angle by rotating the reference composition and storing the image data in the ROM 161. do.

Referring to FIG. 4, a reference composition 310 set for the subject photographed through the first photographing unit 121 and a photographing composition 320 set for the subject provided through the second photographing unit 122 are illustrated. have. The photographing composition 320 is rotated 180 degrees on the screen compared to the reference composition 310. The composition comparison unit 186 rotates the reference composition 310 at a predetermined angle (for example, 180 degrees), and then compares the rotated composition with the photographing composition 320 to determine whether they match. In addition, the photographing controller 188 reversely rotates the photographing composition at a predetermined angle (for example, 180 degrees), or stores the image data stored after the photographing by rotating the image data stored in the ROM 161 at a predetermined angle. .

The photographing guide 187 may receive a command from the main controller 182 when the photographing composition does not match the reference composition, and in response thereto, inform the moving direction of the image photographing apparatus to match the photographing composition to the reference composition. That is, the photographing guide 187 reads the spaced apart information of the photographing composition and the reference composition stored in the RAM 162, interprets the information, and outputs information for matching the composition as a visual or audio signal.

The photographing control unit 188 receives a command of the main controller 182 when the photographing composition matches the reference composition, and in response thereto, outputs a shutter release signal for photographing so that photographing proceeds automatically.

Preferably, when the photographing composition matches the reference composition, the main controller 182 may receive a command and may output information for photographing instruction in response thereto. For example, a light emitting device is installed on a rear surface of the image photographing apparatus in which the second photographing unit 122 is located, and outputs visual information by lighting the light emitting device when the photographing composition matches the reference composition. Or, when the photographing composition matches the reference composition, the audio output module 152 outputs auditory information for photographing instruction such as "kimchi".

Referring to FIG. 3, the reference composition 210 set for the subject photographed through the first photographing unit 121 and the photographing composition 220 set for the subject provided through the second photographing unit 122 are illustrated. have. Compared with the reference composition 210, the photographing composition 220 is enlarged in the left and upper directions on the screen. The photographing control unit 188 reads the separation information from the RAM 162 that the photographing composition 220 is enlarged to the left and the upper side compared to the reference composition 210 and interprets it to move the image photographing apparatus to the right and the upper rear. May output an indication signal.

In this case, the photographing control unit 188 outputs a voice message such as “rightward”, “upward” and “backward” through the sound output module 152, or the second photographing unit of the image capturing apparatus. The movement information can be visually provided by turning on the right, upper and rear lights through the direction indicators located in the same area (surface) as the second position where the 122 is located.

5 is a flowchart illustrating an image photographing process according to an embodiment of the present invention. The image capturing process may include setting a reference composition (S110), comparing the reference composition with a photographing composition (S120), determining whether the photographing composition matches the reference composition (S130), and step 130. If the composition is not matched, the step of taking a photographing guide (S140), if the reference composition is matched automatically or the step of outputting a photographing instruction signal (S150).

First, referring to FIG. 6, there is shown a flowchart detailing a step (S110) of setting a reference composition. The main controller 182 monitors whether an input for photographing (photographing for setting a composition) through the first photographing unit 121 is received from the user input unit 130 (S111). When an input through the first photographing unit 121 is received, the photographing controller 188 receives a command from the main controller 182, and photographs a subject through the first photographing unit 121 in response to this (S112). . The photographing control unit 188 stores image data photographing the subject in the RAM 162 (S113).

When the photographing of the subject through the first photographing unit 121 of the photographing controller 188 is completed, the main controller 182 transmits a command for setting a reference composition to the composition setting unit 183. The composition setting unit 183 receives a command for setting a reference composition from the main control unit 182, and in response thereto, reads image data stored in the RAM 162 and sets a reference composition. The person composition setting unit 184 extracts the composition of the person portion of the image data, and the background composition setting unit 185 extracts the composition of the main subject excluding the person portion of the image data (S114). The composition setting unit 183 stores the set reference composition in the RAM 162 (S115).

Next, referring to FIG. 7, a flowchart showing in detail S120 of comparing the reference composition and the photographing composition is shown. The main controller 182 monitors whether the state of the image photographing apparatus is a photographing mode for the second photographing unit 122 (S121). When the image capturing apparatus is in the photographing mode for the second photographing unit 122, the main controller 182 transmits a command for setting the photographing composition to the composition setting unit 183, and the composition setting unit 183 responds thereto. First, image data provided through the second photographing unit 122 is detected (S122).

The composition setting unit 183 sets the photographing composition on the basis of the detected image data. The setting of the photographing composition is performed in the same manner as that of setting the reference composition. That is, the person composition setting unit 184 extracts the composition of the person portion of the image data, and the background composition setting unit 185 extracts the composition of the main subject excluding the person portion of the image data (S123). The composition setting unit 183 stores the set photographing composition in the RAM 162 (S124).

When the photographing composition setting of the composition setting unit 183 is completed, the main controller 182 transmits a command for comparing the reference composition and the photographing composition to the composition comparing unit 186. The composition comparison unit 186 receives a command for comparing the reference composition with the photographing composition, and in response thereto, reads the reference composition and the photographing composition stored in the RAM 162 (S125).

The composition comparison unit 186 determines whether the number, size, position, and direction of the face in the portrait portion of the photographing composition match the number, size, position, and direction of the face in the portrait portion of the reference composition within a predetermined error range. To judge. Also, the composition comparison unit 186 determines whether the arrangement of the background portion of the photographing composition is consistent with the arrangement of the reference composition within a predetermined error range. Preferably, the composition comparison unit 186 may compare the composition of the reference composition rotated at a predetermined angle with the photographing composition (S126).

The composition comparison unit 186 stores the match between the reference composition and the photographing composition in the RAM 162. Preferably, the composition comparison unit 186 may further store spaced apart information of the reference composition and the photographed composition, that is, information about the direction and distance spaced apart, for the photographing guide when the photographing composition does not match the reference composition (S127). .

Referring back to FIG. 5, the main controller 182 reads a comparison result between the reference composition and the photographing composition stored in the RAM 162, and starts the photographing guide S140 when the composition does not match.

That is, referring to FIG. 8, a flowchart showing the photographing guide step S140 in detail is shown. The main controller 182 transmits a command for photographing guide to the photographing guide 187, and the photographing guide 187 reads compositional space information stored in the RAM 162 in response to the photographing guide 187 (S141). In addition, the photographing guide 187 analyzes the composition separation information and provides photographing guide information, that is, information about a direction in which the image photographing apparatus should move (S142). Preferably, the sensing unit 140 monitors the movement of the mobile terminal according to the movement direction guidance of the mobile terminal (S143).

Referring back to FIG. 5, when the sensing unit 140 detects the movement of the mobile terminal, the sensing unit 140 compares the photographing composition changed by the movement of the mobile terminal again (S120). In operation 130, when the photographing composition matches the reference composition, the main controller 182 transmits a command for automatic photographing or photographing instruction to the photographing controller 188 (S150).

That is, referring to FIG. 9, a flowchart showing the photographing step S150 in detail is shown. The capturing controller 188 receives a command for automatic capturing or capturing instruction from the main controller 182, and in response to this, the capturing controller 188 examines whether the image capturing apparatus is in the capturing mode (S151). As a result of the examination, when the image capturing apparatus is in the automatic capturing mode, the shutter release signal is output to automatically capture the image. Preferably, when the composition is matched by comparing the composition in which the composition comparison unit 186 rotates the reference composition to a predefined angle and the photographing composition, the photographing control unit 188 controls the photographing composition to the predefined angle. When shooting by rotating in reverse or after shooting in the shooting composition and save in the ROM (161) by rotating in reverse at a predetermined angle (S152).

However, in operation 151, when the image capturing apparatus is not in the automatic photographing mode, the photographing instruction information is output. The shooting instruction information includes visual or audio information for shooting instruction (S153).

The mobile terminal described herein transmits and receives text messages as well as mobile phones, such as smart phones, laptop computers, digital broadcasting terminals, personal digital assistants, portable multimedia players, navigation devices, and the like. It can be any terminal that can do it.

The present invention is not limited to the configuration and method of the above-described embodiments, but the embodiments may be configured by selectively combining all or some of the embodiments so that various modifications can be made.

Here, the terms or words used in the present specification and claims should not be construed as being limited to the common or dictionary meanings, but should be interpreted as meanings and concepts corresponding to the technical spirit of the present invention.

Therefore, the embodiments described in the specification and the drawings shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all of the technical idea of the present invention, which can be replaced at the time of the present application It should be understood that there may be various equivalents and variations.

1 is a block diagram of a mobile terminal to which an image photographing apparatus according to an embodiment of the present invention is applied.

2 is a detailed block diagram of the controller 180 shown in FIG. 1.

3 illustrates a reference composition and a photographing composition according to an embodiment of the present invention.

4 illustrates a reference composition and a photographing composition according to an embodiment of the present invention.

5 is a flowchart illustrating an image photographing process according to an embodiment of the present invention.

6 is a flowchart showing in detail a step (S110) of setting a reference composition according to an embodiment of the present invention.

7 is a flowchart illustrating an operation (S120) of comparing a reference composition and a photographing composition according to an exemplary embodiment of the present invention.

8 is a flowchart illustrating a shooting guide step (S140) according to an embodiment of the present invention in detail.

9 is a detailed flowchart illustrating a photographing step S150 according to an embodiment of the present invention.

Claims (12)

A first photographing unit installed at a first position of the image photographing apparatus; A second photographing unit installed at a second position of the image photographing apparatus; A reference composition is set based on a subject photographed through the first photographing unit, and when the photographing composition of the subject provided through the second photographing unit matches the reference composition, the subject is photographed through the second photographing unit. An image capturing apparatus comprising a control unit. The method of claim 1, The control unit, And when the photographing composition does not match the reference composition, outputting information about a moving direction of the image photographing apparatus to match the photographing composition to the reference composition. The method of claim 1, The control unit, And outputting information for photographing instruction when the photographing composition matches the reference composition. The method according to any one of claims 1 to 3, And the first position is the front side of the image photographing apparatus, and the second position is the rear side of the image photographing apparatus. The method according to any one of claims 1 to 3, The control unit, A composition setting unit configured to set the reference composition and the photographing composition; And a composition comparison unit to check whether the photographing composition matches the reference composition. The method of claim 5, The composition setting unit, A background composition setting unit for setting a composition for the background; And a person composition setting unit for setting a composition for the person. The method of claim 6, The background composition setting unit, An image capturing apparatus comprising setting a composition for the background by a scale invariant feature transform (SIFT), a Kanade Lucas Tomasi (KLT), or a Harris corner detector method. The method of claim 1, The control unit, Determine whether the photographing composition matches the composition that rotates the reference composition at a predefined angle, and when the photographing composition matches the rotated composition, reverses the photographing composition to the predefined angle to adjust the photographing composition. 2. The image photographing apparatus, characterized by photographing the subject through a photographing unit. Photographing a subject through a first photographing unit installed at a first position of the image photographing apparatus; Setting a reference composition based on the photographed subject; Setting a photographing composition of the subject provided through a second photographing unit installed at a second position of the image photographing apparatus; Checking whether the photographing composition matches the reference composition; And photographing the subject through the second photographing unit when the photographing composition matches the reference composition. The method of claim 9, The photographing of the subject through the second photographing unit may include: And when the photographing composition does not match the reference composition, information about a moving direction of the image photographing apparatus to output the photographing composition to the reference composition. The method of claim 9, The photographing of the subject through the second photographing unit may include: And outputting information for photographing instruction when the photographing composition matches the reference composition. The method of claim 9, The checking step, Check that the photographing composition matches the composition in which the reference composition is rotated at a predetermined angle, The photographing of the subject through the second photographing unit may include: And photographing the subject through the second photographing unit by rotating the photographing composition back to the predefined angle when the photographing composition matches the reference composition.

Images