KR101587145B1 - Image photographing apparatus and method thereof - Google Patents

Abstract

The present invention relates to an image photographing apparatus and method for photographing a self-image with a low-angle camera and photographing a self-image with a high-end camera according to a set composition, thereby photographing a high-quality self-image with a stable composition. To this end, a video photographing apparatus according to an embodiment of the present invention includes a first photographing unit installed at a first position of a video photographing apparatus; A second photographing unit installed at a second position of the image photographing apparatus, a second photographing unit configured to set a reference composition based on the subject photographed through the first photographing unit, and a second photographing unit configured to photograph an object, And a control unit for photographing the subject through the second photographing unit when the reference photograph matches the reference composition.

Self-image, composition setting, photography assistant

Description

[0001] IMAGE PHOTOGRAPHING APPARATUS AND METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image photographing apparatus and method thereof, and more particularly, to an apparatus for photographing a stable composition image using a camera and a method of photographing an image in such an apparatus.

2. Description of the Related Art In general, a video image pickup apparatus installed in a mobile terminal according to the related art includes a photographing unit (first photographing unit) installed on the front face of a mobile terminal for photographing a video call or a self- And a photographing unit (second photographing unit) installed on the rear surface of the mobile terminal. Since the first photographing unit is for photographing a video call or a simple self-image, the specification is low (low quality), while the second photographing unit is relatively high in specification (high image quality).

When the user takes a picture of the user by turning the terminal upside down to photograph a high quality self-image through the second photographing unit, it is difficult to take a picture of a desired composition because the user can not preview the image to be photographed. In addition, there is a limit in that a user can obtain a stable composition with only a convex mirror installed on the rear surface of the mobile terminal.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and it is an object of the present invention to provide a mobile terminal that captures a self-image of a stable composition with a camera of low- And automatically capturing the self-image with a high-end camera when matching the self-image with the high-quality self-image.

It is another object of the present invention to provide an image photographing apparatus and method which can guide a user to photograph a self-portrait with a high-end camera in accordance with a reference frame set through a low-end camera to photograph a self-

In addition, the present invention provides an image capturing apparatus and method capable of providing convenience to a user by assisting in capturing a self-image in accordance with a preset image through a low-end camera regardless of the rotation state of the mobile terminal when capturing a self- .

According to an aspect of the present invention, there is provided a video photographing apparatus including a first photographing unit, a second photographing unit, and a control unit. The first photographing unit is installed at a first position of the image photographing apparatus. And the second photographing unit is installed at a second position of the image photographing apparatus. Wherein the control unit sets a reference composition based on a subject photographed through the first photographing unit, and when the photographing plan for the subject provided through the second photographing unit matches the reference plan, The subject is photographed.

In a preferred embodiment, the controller outputs information on the moving direction of the image photographing device to match the photographing composition to the reference composition when the photographing composition does not match the reference composition.

Further, in a preferred embodiment, information for photographing instruction is outputted when the photographing composition matches the reference composition.

Preferably, the first position is a front face of the image capturing apparatus, and the second position is a rear face of the image capturing apparatus.

Preferably, the control unit may include a configuration unit and a composition comparison unit. The composition setting unit sets the reference composition and the photographing composition. The composition comparing unit checks whether the image composition matches the reference composition.

Also, preferably, the composition setting section includes a background composition section and a portrait composition setting section. The background composition setting unit sets a composition for the background. The person composition setting unit sets a composition for a person.

Meanwhile, the background composition setting unit may set a composition for the background by SIFT (Scale Invariant Feature Transform), KLT (Kanade Lucas Tomasi) or Harris corner detector method.

On the other hand, the control unit confirms whether the photographing composition is matched with the composition in which the reference composition is rotated by a predetermined angle, and when the photographing composition is matched with the rotated composition, And photographs the subject through the second photographing unit.

According to another aspect of the present invention, there is provided an image capturing method for capturing an object through a second capturing unit according to a reference frame set through a first capturing unit. The image capturing apparatus first photographs a subject through a first capturing unit provided at a first position of the image capturing apparatus. A reference composition is set based on the photographed subject. And sets a photographing plan for the subject provided through a second photographing unit installed at a second position of the image photographing apparatus. Then, it is checked whether the photographic composition matches the reference composition. And photographs the subject through the second photographing unit when the photographing composition matches the reference composition.

In a preferred embodiment, the step of photographing the subject through the second photographing unit may include the step of photographing the subject in the moving direction of the image photographing apparatus to match the photographing composition to the reference composition when the photographing composition does not match the reference composition And outputting information relating to the information.

Further, in a preferred embodiment, the step of photographing the subject through the second photographing unit includes a step of outputting information for photographing instruction when the photographing composition matches the reference composition.

The checking step may include checking whether the reference composition is rotated at a predefined angle to match the photographing composition and photographing the subject through the second photographing part, And photographing the subject through the second photographing unit by rotating the photographing composition backward at the predefined angle.

According to the present invention, a high-quality self image can be obtained in a stable composition according to each situation by setting a desired composition on the fly with a low-end camera provided with a preview screen for a subject when a user captures a high-quality self image .

Such a video photographing apparatus and method in which the composition setting procedure is simple and the photographing procedure is convenient have the advantage of reducing the time cost and hardware burden of repeated photographing and increasing utilization of the camera function of the mobile terminal.

Hereinafter, when a self-image is photographed by the image capturing apparatus, a subject is photographed with a low-end camera installed on the front side to set a reference composition (hereinafter referred to as a reference composition), and then, Preferred embodiments of a video photographing apparatus and method for assisting in photographing a composition (hereinafter, referred to as a photographing composition) so that the composition can be photographed in a reference composition will be described in detail with reference to FIG. 1 to FIG.

1 is a block diagram of a mobile terminal to which an image photographing apparatus according to an embodiment of the present invention is applied. In this embodiment, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, and a power supply 190.

The wireless communication unit 110 performs modulation / demodulation and encoding / decoding of a signal transmitted / received with the base station of the wireless communication system so that the mobile terminal 100 can communicate with other terminals through the wireless communication system. The radio signal exchanged between the mobile terminal 100 and the base station of the wireless communication system may be a voice call signal, a video call signal or a text message. The wireless communication unit 110 includes a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving previously generated broadcast signals and / or broadcast-related information and transmitting the broadcast signals and / or broadcast- related information to the mobile communication terminal 100 . The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112. The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data related to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile communication terminal 100 or externally. Here, the wireless Internet technology includes a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a WiMAX, and a High Speed Downlink Packet Access (HSDPA) Can be used.

The short-range communication module 114 means a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, etc. may be used as the short distance communication technology.

The position information module 115 is a module for confirming or obtaining the position of the mobile terminal (capable of checking the position of the vehicle when the mobile terminal is mounted on the vehicle). One example is the GPS (Global Position System) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can accurately calculate the current position according to the triangle method by measuring the precise time and distance from three or more satellites and measuring three different distances. A method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. In particular, the GPS module can acquire latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite. A Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied as the location information module 115.

The A / V input unit 120 is provided with a first photographing unit 121, a second photographing unit 122, and a third photographing unit 124. The A / And a microphone 123 are included. The first photographing unit 121 and the second photographing unit 122 process image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151 and stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [

According to the present invention, the first photographing unit 121 is installed at the first position of the mobile terminal, and the second photographing unit 122 is installed at the second position of the mobile terminal. Preferably, the first position is the front face of the mobile terminal and the second position is the rear face of the mobile terminal. The first photographing unit 121 is for low-light (low-quality) photographing for a video call or a simple self-photographing, and the second photographing unit 122 is for a portrait, Camera.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. In the call mode, the processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 accepts an input command that the user inputs for controlling the operation of the terminal, and transmits the received command to the controller 180 so that the controller 180 operates according to the command. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like. Particularly, when the touch pad has a mutual layer structure with the display unit 151, it can be called a touch screen.

According to the present invention, the user input unit 130 includes an input (e.g., a shutter release signal, a zoom signal, etc.) for photographing a subject to set a reference composition through a first photographing unit 121 from a user, (E.g., a shutter release signal, a zoom signal, and the like) for photographing a subject in a composition diagram corresponding to the composition set through the controller 122.

The sensing unit 140 senses the position of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal 100, 100, and generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. The sensing unit 140 senses whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

According to an embodiment of the present invention, the sensing unit 140 may include a sensing guide for matching a composition, that is, a sensing guide for matching a sensing composition to a reference composition when the sensing composition is not matched to a reference composition, Monitor movement.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, May be included.

The display unit 151 displays information to be processed by the mobile terminal 100 and outputs the information. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display (3D display). In addition, there may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the mobile terminal 100 may be provided with an external display unit (not shown) and an internal display unit (not shown) at the same time.

(Hereinafter, referred to as a 'touch screen') has a mutual layer structure with the display unit 151 and a sensor (hereinafter, referred to as 'touch sensor' It can also be used as an input device in addition to the device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the control unit 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Quot; Proximity Touch "refers to an operation of recognizing that the pointer is positioned on the touch screen without touching the pointer on the touch screen, and the pointer is actually contacted on the touch screen The action is referred to as "Contact Touch ". A position where the pointer is proximally touched on the touch screen means a position where the pointer corresponds to the touch screen vertically when the pointer is touched.

Further, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, do. Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include receiving a call signal, receiving a message, and inputting a key signal. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. When the call signal is received or the message is received, the alarm unit 153 can vibrate the mobile terminal through the vibration means to inform it. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile terminal 100 through the vibration means with the feedback of the key signal input. Through the above-described vibration, the user can recognize the occurrence of the event. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, And various effects of tactile effect such as effect of reproducing the cold sensation using the heat absorbing or heatable element can be generated.

The haptic module 154 can transmit a tactile effect through direct contact, and the tactile effect can be felt by a user through a muscular sense such as a finger or an arm.

The memory 160 includes a ROM (Read Only Memory) 161 for storing a program for the operation of the controller 180, for example, a flash memory, and a random access memory (RAM) for storing temporary output data processed for transmission / Access Memory, 162).

According to the present invention, the ROM 161 stores a program for image capturing, a program for editing the captured image, and an image photographed by the second photographing section 122. The RAM 162 stores image data and reference composition for the subject photographed by the first photographing section 121, image data and photographing composition for the subject provided by the second photographing section 122, The result of the comparison is temporarily stored. In addition, the RAM 162 may further store the spacing information for the composition when the shot composition does not match the reference composition.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, An audio input / output (I / O) port, a video I / O (input / output) port, and an earphone port. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter, referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the received data to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be transmitted to the mobile terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, the control unit 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180.

The control unit 180 sets image data and a reference frame for the photographed subject through the first photographing unit 121 and stores the image data and the reference frame in the RAM 162. [ Further, the control unit 180 sets a photographing plan for the subject provided through the second photographing unit 122, and stores it in the RAM 162. [ Further, the control unit 180 compares the photographic composition stored in the RAM 162 with the reference composition. The control unit 180 automatically photographs the subject through the second photographing unit 122 when the photographing composition matches the reference composition.

Preferably, the controller 180 outputs information on the moving direction of the image photographing device to match the photographing composition to the reference composition when the photographing composition does not match the reference composition. Preferably, the control unit 180 outputs information for a photographing instruction when the photographing composition matches the reference composition.

On the other hand, the controller 180 checks whether the composition of the reference composition is rotated at a predetermined angle (e.g., 90 degrees, 180 degrees, or 270 degrees) and the composition of the image is matched. When the composition is matched with the composition of the images, The composition is reversely rotated at a predefined angle, and the subject is photographed through the second photographing unit 122.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 and supplies power required for operation of the respective components.

2 is a detailed block diagram of the control unit 180 shown in FIG. In the present embodiment, the control unit 180 includes a main control unit 182, a composition setting unit 183, a composition comparing unit 186, an imaging guide unit 187, and a photographing control unit 188. 2, the user input unit 130, the A / V input unit 120, the memory 160, and the output unit 150 are shown together for convenience of explanation.

The main control unit 182 controls operations of the other components in the control unit 180 and the user input unit 130, the A / V input unit 120, the memory 160, and the output unit 150.

The composition setting unit 183 includes a portrait composition setting unit 184 and a background composition setting unit 185. The composition setting unit 183 sets the reference composition based on the subject photographed through the first photographing unit 121 and sets the photographing plan for the subject provided through the second photographing unit 122. [ The composition setting unit 183 stores the set reference composition and the photographing composition in the RAM 162. [

The portrait composition setting section 184 analyzes the image data of the subject photographed through the first photographing section 121 and the second photographing section 122 and determines the number of faces in the image area, Information is extracted. The background composition setting unit 185 analyzes the image data of the subject photographed through the first photographing unit 121 and the second photographing unit 122 and extracts information on the main subject excluding the character portion in the image region .

Preferably, the portrait composition setting unit 184 sets the portrait composition of the person in the subject through the method of detecting the face using known surface skin information such as face skin color or the method of detecting the face using geometric attribute information such as head, In particular, the face portion is detected. Preferably, the background composition setting unit 185 sets a background part of the subject through a known scale invariant feature transform (SIFT), a Kanade Lucas Tomasi (KLT), or a Harris corner detector .

SIFT is an algorithm that extracts information that best represents the object in a particular object. The information that best represents the object does not change even if the position, direction, or size of the object changes. KLT is an algorithm that performs image tracking and stereo matching by detecting edges, which are characteristic points of low-level images in a continuous image frame and a stereo image. The Harris corner detector is a feature point extraction algorithm robust to rotation, brightness changes, or image noise. It goes without saying that such techniques may be used for the person composition setting section 184 to extract a person portion in a subject.

The composition comparing unit 186 receives the command of the main control unit 182 and reads the reference composition and the photographic composition stored in the RAM 162 in response thereto and compares the read reference composition and the photographic composition and transmits the comparison result to the main control unit 182.

The composition comparing unit 186 compares the number, size, position, and direction of the face in the person portion of the photographic composition with the number, size, position, and direction of the face in the person portion of the reference composition within a predetermined error range . The composition comparing unit 186 determines whether or not the arrangement of the background portion of the photographic composition agrees with the arrangement of the reference composition within a predetermined error range. Such comparison determination operation is continued until forced termination of shooting by the user, elapse of a predetermined time, or matching of the composition.

Preferably, the composition comparator 186 may store in the RAM 162 information on the composition of the two or more constructions when the imaging composition is not matched to the reference composition, i.e., information on the distant directions and distances.

Also, preferably, the composition comparing unit 186 can determine whether the imaging composition matches the composition in which the reference composition is rotated at a predefined angle (e.g., 90 degrees, 180 degrees, or 270 degrees) . If the composition comparing unit 186 compares the composition obtained by rotating the reference composition by a predetermined angle and the composition of the image is compared with the reference composition rotated only by the user, even if the user holds the image capturing apparatus upside down or tilts, Make it possible to shoot in the desired composition. Thereafter, the photographing control section 188 matches the photographing composition (reverse rotation by the angle at which the reference composition is rotated) or reversely rotates the image data stored after the photographing by the rotated angle of the reference composition and stores the same in the ROM 161 do.

Referring to FIG. 4, a reference composition 310 set for an object photographed through the first imaging unit 121 and an imaging composition 320 set for an object provided through the second imaging unit 122 are shown have. Compared to the reference composition 310, the imaging composition 320 is rotated 180 degrees on the screen. The composition comparing unit 186 rotates the reference composition 310 at a predetermined angle (e.g., 180 degrees), and then compares the rotated composition with the shooting composition 320 to determine whether or not the composition is matched. Further, the photographing control section 188 photographs the photographing composition in reverse rotation at a predetermined angle (for example, 180 degrees) or reversely rotates the image data stored after photographing at a predetermined angle, and stores the image data in the ROM 161 .

The photographing guide unit 187 receives an instruction from the main control unit 182 when the photographing composition does not match the reference composition, and can notify the moving direction of the photographing apparatus to match the photographing composition to the reference composition in response thereto. That is, the photographing guide unit 187 reads out the distance information between the photographing composition and the reference composition stored in the RAM 162, analyzes the information, and outputs information for matching the composition as a visual or audible signal.

The photographing control unit 188 receives a command from the main control unit 182 when the photographing composition matches the reference composition, and outputs a shutter release signal for photographing in response thereto, thereby automatically photographing.

Preferably, when the imaging composition matches the reference composition, it receives an instruction from the main control unit 182, and can output information for the imaging instruction in response thereto. For example, a light emitting element is provided on a rear surface of a video photographing apparatus in which the second photographing section 122 is located, and visual information is outputted by lighting the light emitting element when the photographic composition matches the reference composition. Or acoustic output module 152 to output auditory information for a shooting instruction such as "Kimchi " when the shooting composition matches the reference composition.

3, a reference composition 210 set for an object photographed through the first imaging unit 121 and an imaging configuration 220 set for an object provided through the second imaging unit 122 are shown have. Compared with the reference composition 210, the imaging composition 220 is enlarged in the left and upward directions on the screen. The photographing control unit 188 reads the distance information indicating that the photographing composition 220 is enlarged to the left and the upper side relative to the reference composition 210 from the RAM 162 and analyzes the information to move the photographing apparatus to the right and the upper back Can output an instruction signal.

In this case, the photographing control unit 188 outputs a voice message such as "right", "up" and "back" through the sound output module 152, The right side, the upper side, and the rear side are lighted through the direction indicator located in the same area (surface) as the second position where the second side 122 is located, thereby visually providing the movement information.

5 is a flowchart illustrating an image capturing process according to an embodiment of the present invention. The image capturing process includes a step of setting a reference composition (S110), a step of comparing the reference composition with a photographing composition (S120), a step of determining whether the photographing composition matches the reference composition (S130) (S140) when the composition is not matched, a step (S150) of automatically photographing when the reference composition matches, or outputting a photographing instruction signal.

Referring first to FIG. 6, there is shown a flowchart illustrating in detail step S110 of setting a reference composition. The main control unit 182 monitors whether an input for photographing (photographing for setting a composition) through the first photographing unit 121 is received from the user input unit 130 (S111). When the input through the first photographing unit 121 is received, the photographing control unit 188 receives the command from the main control unit 182 and photographs the subject through the first photographing unit 121 in response to this command (S112) . The photographing control section 188 stores the image data of the photographed subject in the RAM 162 (S113).

The main control unit 182 transmits a command for setting the reference composition to the composition setting unit 183 when the photographing of the subject through the first photographing unit 121 of the photographing control unit 188 is completed. The composition setting unit 183 receives a command for setting a reference composition from the main control unit 182, reads the image data stored in the RAM 162 in response thereto, and sets a reference composition. The portrait composition setting unit 184 extracts the composition of the character portion of the image data, and the background composition setting unit 185 extracts the composition of the main subject excluding the character portion of the image data (S114). The composition setting unit 183 stores the set reference composition in the RAM 162 (S115).

Next, referring to FIG. 7, there is shown a flow chart detailing the step (S120) of comparing the reference composition with the imaging composition. The main control unit 182 monitors whether the state of the image photographing apparatus is the photographing mode for the second photographing unit 122 (S121). If the image capturing apparatus is the image capturing mode for the second image capturing section 122, the main control section 182 transmits a command for setting the image capturing composition to the composition setting section 183, and the composition setting section 183, First, the image data provided through the second photographing unit 122 is detected (S122).

The composition setting section 183 sets a photographing composition based on the detected image data. The setting of the shooting composition is performed in the same manner as the method of setting the reference composition. That is, the portrait composition setting unit 184 extracts the composition of the character portion of the image data, and the background composition setting unit 185 extracts the composition of the main subject excluding the character portion of the image data (S123). The composition setting unit 183 stores the set image composition in the RAM 162 (S124).

The main control unit 182 transmits a command to the composition comparing unit 186 to compare the reference composition and the photographing composition when the composition setting of the composition setting unit 183 is completed. The composition comparing unit 186 receives a command for comparing the reference composition and the photographing composition, and reads the reference composition and the photographing composition stored in the RAM 162 in response thereto (S125).

The composition comparing unit 186 compares the number, size, position, and direction of the face in the person portion of the photographic composition with the number, size, position, and direction of the face in the person portion of the reference composition within a predetermined error range . Also, the composition comparing unit 186 determines whether or not the arrangement of the background portion of the photographing composition matches the arrangement of the reference composition within a predetermined error range. Preferably, the composition comparing unit 186 may compare the composition obtained by rotating the reference composition at a predetermined angle with the composition (S126).

The composition comparing unit 186 stores in the RAM 162 whether or not the reference composition matches the photographing composition. Preferably, the composition comparing unit 186 may further store information on the distance between the reference composition and the photographing composition, that is, the distant direction and the distance, for the photographing guidance when the photographing composition does not match the reference composition (S127) .

Referring back to FIG. 5, the main control unit 182 reads the comparison result of the reference composition and the photographing composition stored in the RAM 162, and starts the photographing guidance (S140) if the composition does not match.

That is, referring to FIG. 8, a flowchart showing the shooting guide step (S140) is shown in detail. The main control unit 182 transmits a command for photographing guidance to the photographing guidance unit 187 and the photographing guidance unit 187 reads the composition separation information stored in the RAM 162 in response thereto in step S141. The photographing guide unit 187 interprets the composition spacing information and provides information on photographing guide information, that is, the direction in which the image photographing apparatus should move (S142). Preferably, the sensing unit 140 monitors the movement of the mobile terminal according to the movement direction guidance of the mobile terminal (S143).

Referring to FIG. 5 again, when the sensing unit 140 senses the motion of the mobile terminal, the imaging composition changed by the reference composition and the motion of the mobile terminal is compared again (S120). In operation 130, the main control unit 182 transmits an instruction for automatic photographing or photographing instruction to the photographing control unit 188 when the photographing composition matches the reference composition (S150).

That is, referring to FIG. 9, a flowchart showing the photographing step S150 in detail is shown. The photographing control unit 188 receives a command for automatic photographing or photographing instruction from the main control unit 182 and, in response thereto, checks whether the photographing apparatus is in the automatic photographing mode (S151). As a result of the review, when the image pickup apparatus is in the automatic image pickup mode, the shutter release signal is outputted and the image pickup is automatically performed. Preferably, when the composition comparing unit 186 compares a composition obtained by rotating the reference composition by a predetermined angle with a photographing composition, and the composition is matched, the photographing control unit 188 compares the photographing composition with a predefined angle When the image is photographed in the reverse direction or photographed according to the photographic composition and stored in the ROM 161, the image is stored in the reverse rotation at a predefined angle (S152).

However, if it is determined in step 151 that the image capturing apparatus is not in the automatic capturing mode, the capturing instruction information is output. The photographing instruction information includes visual or auditory information for photographing instruction (S153).

The mobile terminal described in this specification can transmit and receive a text message such as a smart phone, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player) It can be any terminal that can do it.

The present invention is not limited to the configuration and method of the embodiments described above, but the embodiments may be configured by selectively combining all or some of the embodiments so that various modifications may be made.

Here, the terms and words used in the present specification and claims should not be construed as limited to ordinary or dictionary meanings, but should be construed as meaning and concept consistent with the technical idea of the present invention.

Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It should be understood that various equivalents and modifications may be present.

1 is a block diagram of a mobile terminal to which an image photographing apparatus according to an embodiment of the present invention is applied.

2 is a detailed block diagram of the control unit 180 shown in FIG.

FIG. 3 shows a reference composition and a photographing plan according to an embodiment of the present invention.

FIG. 4 shows a reference composition and a photographic composition according to an embodiment of the present invention.

5 is a flowchart illustrating an image capturing process according to an embodiment of the present invention.

FIG. 6 is a flowchart illustrating in detail step S110 of setting a reference composition according to an embodiment of the present invention.

FIG. 7 is a flowchart illustrating in detail step S120 of comparing a reference composition and a photographic composition according to an embodiment of the present invention.

FIG. 8 is a flowchart illustrating in detail an imaging guide step (S140) according to an embodiment of the present invention.

FIG. 9 is a flowchart illustrating in detail shooting step S150 according to an embodiment of the present invention.

Claims (12)

A first photographing unit installed at a first position of the image photographing apparatus; A second photographing unit installed at a second position of the image photographing apparatus; And a control unit for setting a reference composition based on a subject photographed through the first photographing unit and photographing the subject through the second photographing unit when the photographing composition of the subject provided through the second photographing unit matches the reference composition, And a controller, The matching is determined by whether or not the number, size, position, and direction of the face in the person portion of the photographing plan match with the number, size, position, and direction of the face in the person portion of the reference composition within a predetermined error range And the image pickup device. The method according to claim 1, Wherein, Wherein the photographing guide transmits a command for photographing guidance to the photographing guide unit, reads out the composition distance information corresponding to the difference between the reference composition and the photographing composition from the storage unit, And outputs the information on the moving direction of the image photographing device to match the photographing composition to the reference composition when no matching is made. 3. The method of claim 2, Wherein, And outputs information for a photographing instruction when the photographing composition matches the reference composition based on the composition spacing information. 4. The method according to any one of claims 1 to 3, Wherein the first position is a front face of the image capturing apparatus and the second position is a rear face of the image capturing apparatus. 4. The method according to any one of claims 1 to 3, Wherein, A composition setting unit for setting the reference composition and the imaging composition; And a composition comparing unit for determining whether the image composition matches the reference composition. 6. The method of claim 5, The composition setting unit may set, A background composition setting unit for setting a composition for the background; And a person composition setting section for setting a composition for the person. The method according to claim 6, The background composition setting unit, Wherein a composition for the background is set by SIFT (Scale Invariant Feature Transform), KLT (Kanade Lucas Tomasi) or Harris corner detector method. The method according to claim 1, Wherein, And a controller for checking whether the image composition is matched with a composition obtained by rotating the reference composition by a predetermined angle and rotating the image composition at the angle defined in advance when the composition is matched with the rotated composition, 2 photographing unit for photographing the subject through the photographing unit. Photographing a subject through a first photographing unit installed at a first position of the image photographing apparatus; Setting a reference composition based on the photographed subject; Setting a photographing plan for the subject provided through a second photographing unit installed at a second position of the image photographing apparatus; Confirming whether the photographic composition matches the reference composition; And photographing the subject through the second photographing unit when the photographing composition matches the reference composition, The step of confirming whether or not the matching is performed may include determining whether the number, size, position, and direction of the face in the person portion of the imaging composition match the number, size, position, and direction of the face in the person portion of the reference composition within a predetermined error range And judging whether or not the image is captured. 10. The method of claim 9, Wherein the photographing of the subject through the second photographing unit comprises: Transmitting a command for photographing guidance to the photographing guide unit; Reading composition distance information corresponding to a difference between the reference composition and the photographing composition from a storage unit; Wherein the information about the moving direction of the image photographing apparatus is output in order to match the photographing composition to the reference composition when the photographing composition does not match the reference composition on the basis of the composition spacing information . 11. The method of claim 10, Wherein the photographing of the subject through the second photographing unit comprises: And outputting information for a photographing instruction when the photographing composition matches the reference composition based on the composition spacing information. 10. The method of claim 9, Wherein the verifying step comprises: Checking whether the reference composition is rotated at a predefined angle and the image composition is matched, Wherein the photographing of the subject through the second photographing unit comprises: Wherein when the photographing composition matches the reference composition, the photographing composition is reversely rotated at the predefined angle, and the subject is photographed through the second photographing portion.

Images