KR102388888B1 - Camera and image distortion correcting method thereof - Google Patents

Abstract

The camera according to an embodiment of the present invention includes a lens that collects light incident from the outside, an image sensor that acquires an image of a photographing target by using the light, and a movement direction of the lens after hand shake correction based on the acquired image and A control unit for obtaining the movement amount of the lens, calculating a correction coefficient when the movement amount corresponding to the obtained movement direction satisfies a limit condition, and correcting distortion occurring in the periphery of the image based on the calculated correction coefficient may include

Description

CAMERA AND IMAGE DISTORTION CORRECTING METHOD THEREOF

The present invention relates to a camera and an image distortion correction method thereof.

Optical Image Stabilization (OIS) technology is a method of suppressing image shake by mechanically correcting a subject that is shaken due to hand shake. The OIS method includes a module tilt method that rotates both the camera and the sensor in the direction opposite to the shaking direction and a lens shift method that changes the relative position between the lens and the sensor. In the case of the module tilt method, the volume is larger than the existing lens shift method, and the structure is also complicated, so it is very difficult to apply it to a mobile camera or a DSLR camera, and even if it is applied, the cost increase is very large.

On the other hand, the lens shift method has a simple structure and is widely used in mobile terminals such as cell phones and DSLR cameras.

However, in the case of the lens shift method, the shake of the central image can be suppressed, but the magnification of the upper and lower sides is different from the center, so there is a fundamental problem in that the shake is not corrected toward the periphery.

An object of the present invention is to suppress peripheral distortion of an image generated by a lens shift method, which is one type of optical image stabilization method.

The camera according to an embodiment of the present invention includes a lens that collects light incident from the outside, an image sensor that acquires an image of a photographing target by using the light, and a movement direction of the lens after hand shake correction based on the acquired image and A control unit for obtaining the movement amount of the lens, calculating a correction coefficient when the movement amount corresponding to the obtained movement direction satisfies a limit condition, and correcting distortion occurring in the periphery of the image based on the calculated correction coefficient may include

According to various embodiments of the present disclosure, it is possible to suppress a peripheral distortion phenomenon of an image generated by a lens shift method, which is one type of hand shake correction method.

1 is a block diagram illustrating a mobile terminal related to the present invention.
2 is a view for explaining a lens shift method for optical image stabilization (OIS).
3 to 4 are diagrams showing that, in the case of the lens shift method, the image is deteriorated as the magnification of the periphery of the image is changed.
5 is a block diagram illustrating the configuration of a camera according to an embodiment of the present invention.
6 is a flowchart illustrating a method for correcting image distortion of a camera according to an embodiment of the present invention.
7 is a view for explaining an image processing process for obtaining a moving direction and a moving amount of a lens according to an embodiment of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and a slate PC. , tablet PCs, ultrabooks, wearable devices, for example, watch-type terminals (smartwatch), glass-type terminals (smart glass), HMD (head mounted display), etc. may be included. there is.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in this specification may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage, except when applicable only to a mobile terminal. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention.

The mobile terminal 100 includes a wireless communication unit 110 , an input unit 120 , a sensing unit 140 , an output unit 150 , an interface unit 160 , a memory 170 , a control unit 180 , and a power supply unit 190 . ) and the like. The components shown in FIG. 1 are not essential for implementing the mobile terminal, so the mobile terminal described in this specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 110 is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. It may include one or more modules that enable wireless communication between them. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111 , a mobile communication module 112 , a wireless Internet module 113 , a short-range communication module 114 , and a location information module 115 . .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 or an audio input unit for inputting an audio signal, and a user input unit 123 for receiving information from a user, for example, , a touch key, a push key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, information on the surrounding environment surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. Sensor (G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor: infrared sensor), fingerprint recognition sensor (finger scan sensor), ultrasonic sensor , optical sensors (eg, cameras (see 121)), microphones (see 122), battery gauges, environmental sensors (eg, barometers, hygrometers, thermometers, radiation detection sensors, It may include at least one of a thermal sensor, a gas sensor, etc.) and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of a display unit 151 , a sound output unit 152 , a haptip module 153 , and an optical output unit 154 . can do. The display unit 151 may implement a touch screen by forming a layer structure with the touch sensor or being integrally formed. Such a touch screen may function as the user input unit 123 providing an input interface between the mobile terminal 100 and the user, and may provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100 . The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In response to the connection of the external device to the interface unit 160 , the mobile terminal 100 may perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100 . The memory 170 may store a plurality of application programs (or applications) driven in the mobile terminal 100 , data for operation of the mobile terminal 100 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions (eg, incoming calls, outgoing functions, message reception, and outgoing functions) of the mobile terminal 100 . Meanwhile, the application program may be stored in the memory 170 , installed on the mobile terminal 100 , and driven to perform an operation (or function) of the mobile terminal by the controller 180 .

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100 . The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170 .

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1 in order to drive an application program stored in the memory 170 . Furthermore, in order to drive the application program, the controller 180 may operate at least two or more of the components included in the mobile terminal 100 in combination with each other.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power to each component included in the mobile terminal 100 . The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the respective components may operate in cooperation with each other in order to implement an operation, control, or control method of a mobile terminal according to various embodiments to be described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170 .

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 as described above, the above-listed components will be described in more detail with reference to FIG. 1 .

First, referring to the wireless communication unit 110 , the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more of the broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

Mobile communication module 112, the technical standards or communication methods for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives a radio signal to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to.

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100 . The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) may be understood as a type of the mobile communication module 112 .

Short-range communication module 114 is for short-range communication, Bluetooth™, RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, NFC At least one of (Near Field Communication), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 114 is, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 through wireless area networks (Wireless Area Networks). ) and another mobile terminal (100, or an external server) can support wireless communication between the network located. The local area network may be local area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device capable of exchanging (or interworking) data with the mobile terminal 100 according to the present invention, for example, a smart watch, smart glasses. (smart glass) or HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 in the vicinity of the mobile terminal 100 . Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least a portion of data processed by the mobile terminal 100 to the short-range communication module ( 114) to the wearable device. Accordingly, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received in the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received in the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 has one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a moving image obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170 . On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the cameras 121 forming the matrix structure as described above, various angles or focal points are applied to the mobile terminal 100 . A plurality of image information with can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes an external sound signal as electrical voice data. The processed voice data may be utilized in various ways according to a function (or an application program being executed) being performed by the mobile terminal 100 . Meanwhile, various noise removal algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122 .

The user input unit 123 is for receiving information from a user, and when information is input through the user input unit 123 , the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or, a mechanical key, for example, a button located on the front, back or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, jog switch, etc.) and a touch input means. As an example, the touch input means consists of a virtual key, a soft key, or a visual key displayed on the touch screen through software processing, or a part other than the touch screen. It may be made of a touch key (touch key) disposed on the. On the other hand, the virtual key or the visual key, it is possible to be displayed on the touch screen while having various forms, for example, graphic (graphic), text (text), icon (icon), video (video) or these can be made by a combination of

On the other hand, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, function, or operation related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of an object having conductivity by a change in an electric field according to the proximity of the object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of approaching an object on the touch screen without contacting it so that the object is recognized that it is located on the touch screen is called “proximity touch”, and the touch The act of actually touching an object on the screen is called "contact touch". The position where the object is touched in proximity on the touch screen means a position where the object is perpendicular to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) there is. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be printed on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a contact touch. .

The touch sensor receives a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. detect

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or a change in capacitance occurring in a specific part of the touch screen into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, an electrostatic capacitance at the time of touch, etc. in which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

As such, when there is a touch input to the touch sensor, a signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180 . Accordingly, the controller 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a component separate from the controller 180 , or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or may perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object may be determined according to the current operating state of the mobile terminal 100 or a running application program.

On the other hand, the above-described touch sensor and proximity sensor independently or in combination, a short (or tap) touch on the touch screen (short touch), long touch (long touch), multi touch (multi touch), drag touch (drag touch) ), flick touch, pinch-in touch, pinch-out touch, swype touch, hovering touch, etc. It can sense touch.

The ultrasonic sensor may recognize position information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the position of the wave source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source may be calculated using the property that light is much faster than ultrasonic waves, that is, the time at which light arrives at the optical sensor is much faster than the time at which ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave source may be calculated using a time difference from the time that the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 121 as seen in the configuration of the input unit 120 includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on the display device, and the photo sensor is configured to scan the motion of a sensing target close to the touch screen. More specifically, the photo sensor mounts a photo diode and TR (transistor) in rows/columns and scans the contents placed on the photo sensor using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photo sensor calculates the coordinates of the sensing target according to the amount of change in light, and through this, location information of the sensing target can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100 . For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information. .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glassesless method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100 . The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by a user's selection or setting of the controller. For example, the haptic module 153 may synthesize and output different vibrations or output them sequentially.

In addition to vibration, the haptic module 153 is configured to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, a jet force or suction force of air through a nozzle or an inlet, rubbing against the skin surface, contact of an electrode, electrostatic force, etc. Various tactile effects can be generated, such as the effect of heat absorption and the effect of reproducing a feeling of coolness and warmth using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through a muscle sense such as a finger or arm. Two or more haptic modules 153 may be provided according to the configuration of the mobile terminal 100 .

The light output unit 154 outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile terminal 100 . Examples of the event occurring in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the optical output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors toward the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100 . The interface unit 160 receives data from an external device, receives power and transmits it to each component inside the mobile terminal 100 , or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio I/O (Input/Output) port, a video I/O (Input/Output) port, an earphone port, etc. may be included in the interface unit 160 .

On the other hand, the identification module is a chip storing various types of information for authenticating the use authority of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (subscriber identity module; SIM), universal user authentication It may include a universal subscriber identity module (USIM) and the like. A device equipped with an identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160 .

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100, or is input from the cradle by a user. Various command signals may be a path through which the mobile terminal 100 is transmitted. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is input.

Memory 170 is a flash memory type (flash memory type), hard disk type (hard disk type), SSD type (Solid State Disk type), SDD type (Silicon Disk Drive type), multimedia card micro type (multimedia card micro type) ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium. The mobile terminal 100 may be operated in relation to a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the general operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state restricting input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice call, data communication, video call, etc., or performs pattern recognition processing capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively. can Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control one or a combination of any one or a plurality of the components described above.

The power supply unit 190 receives external power and internal power under the control of the control unit 180 to supply power required for operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of the interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon or a resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. power can be transmitted.

Meanwhile, various embodiments below may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

Next, a communication system that can be implemented through the mobile terminal 100 according to the present invention will be described.

First, the communication system may use different air interfaces and/or physical layers. For example, the air interfaces available by a communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA). ), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A)), Global System for Mobile Communications (GSM), etc. may be included.

Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to all communication systems including CDMA wireless communication systems as well as OFDM (Orthogonal Frequency Division Multiplexing) wireless communication systems.

The CDMA wireless communication system includes at least one terminal 100, at least one base station (Base Station, BS (also referred to as Node B or Evolved Node B)), and at least one base station controller (Base Station Controllers, BSCs). ), and a mobile switching center (MSC). The MSC is configured to be connected to a Public Switched Telephone Network (PSTN) and BSCs. BSCs may be connected in pairs with a BS through a backhaul line. The backhaul line may be provided according to at least one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, and xDSL. Accordingly, a plurality of BSCs may be included in a CDMA wireless communication system.

Each of the plurality of BSs may include at least one sector, and each sector may include an omni-directional antenna or an antenna pointing in a specific radial direction from the BS. In addition, each sector may include two or more antennas of various types. Each BS may be configured to support multiple frequency assignments, and each of the multiple frequency assignments may have a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency allocation may be referred to as a CDMA channel. BSs may be referred to as Base Station Transceiver Subsystems (BTSs). In this case, one BSC and at least one BS may be collectively referred to as a “base station”. A base station may also refer to a “cell site”. Alternatively, each of a plurality of sectors for a specific BS may be referred to as a plurality of cell sites.

A broadcast transmitter (BT) transmits a broadcast signal to the terminals 100 operating in the system. The broadcast reception module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by BT.

In addition, a global positioning system (GPS) for confirming the location of the mobile terminal 100 may be linked to the CDMA wireless communication system. The satellite helps to locate the mobile terminal 100 . Useful location information may be obtained by two or fewer or more satellites. Here, the location of the mobile terminal 100 may be tracked using not only the GPS tracking technology but also all techniques capable of tracking the location. In addition, at least one of the GPS satellites may optionally or additionally be responsible for satellite DMB transmission.

The location information module 115 provided in the mobile terminal is for detecting, calculating, or identifying the location of the mobile terminal, and representative examples thereof may include a Global Position System (GPS) module and a Wireless Fidelity (WiFi) module. If necessary, the location information module 115 may perform any function of the other modules of the wireless communication unit 110 to obtain data on the location of the mobile terminal as a substitute or additionally.

The GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to accurately calculate three-dimensional current location information according to latitude, longitude, and altitude. can do. Currently, a method of calculating position and time information using three satellites and correcting errors in the calculated position and time information using another one satellite is widely used. In addition, the GPS module 115 may calculate the speed information by continuously calculating the current location in real time. However, it is difficult to accurately measure the position of the mobile terminal using the GPS module in the shaded area of the satellite signal, such as indoors. Accordingly, in order to compensate for positioning by the GPS method, a WiFi Positioning System (WPS) may be utilized.

A WiFi positioning system (WPS) uses a WiFi module provided in the mobile terminal 100 and a wireless AP (Wireless Access Point) that transmits or receives a wireless signal with the WiFi module, the mobile terminal 100 As a technology for tracking the location of a wireless network, it refers to a wireless local area network (WLAN)-based positioning technology using WiFi.

The Wi-Fi location tracking system may include a Wi-Fi positioning server, the mobile terminal 100, a wireless AP connected to the mobile terminal 100, and a database in which arbitrary wireless AP information is stored.

The mobile terminal 100 connected to the wireless AP may transmit a location information request message to the Wi-Fi location location server.

The Wi-Fi positioning server extracts information on the wireless AP connected to the mobile terminal 100 based on the location information request message (or signal) of the mobile terminal 100 . Information on the wireless AP connected to the mobile terminal 100 may be transmitted to the Wi-Fi positioning server through the mobile terminal 100 or may be transmitted from the wireless AP to the Wi-Fi positioning server.

Based on the location information request message of the mobile terminal 100, the extracted wireless AP information is MAC Address, Service Set IDentification (SSID), Received Signal Strength Indicator (RSSI), Reference Signal Received Power (RSRP), RSRQ ( Reference Signal Received Quality), channel information, Privacy, Network Type, signal strength, and noise strength may be at least one.

As described above, the Wi-Fi positioning server may receive information of a wireless AP connected to the mobile terminal 100 and extract wireless AP information corresponding to a wireless AP to which the mobile terminal is connected from a pre-established database. At this time, the information of arbitrary wireless APs stored in the database includes MAC Address, SSID, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, the name of the building where the wireless AP is located, the number of floors, and detailed indoor location information (GPS coordinates). available), the AP owner's address, phone number, and the like. In this case, in order to remove a mobile AP or a wireless AP provided using an illegal MAC address in the positioning process, the Wi-Fi positioning server may extract only a predetermined number of wireless AP information in order of increasing RSSI.

Thereafter, the Wi-Fi positioning server may extract (or analyze) the location information of the mobile terminal 100 by using at least one wireless AP information extracted from the database. By comparing the included information and the received wireless AP information, the location information of the mobile terminal 100 is extracted (or analyzed).

As a method for extracting (or analyzing) the location information of the mobile terminal 100, a Cell-ID method, a fingerprint method, a triangulation method, a landmark method, etc. may be utilized.

The Cell-ID method is a method of determining the location of a wireless AP having the strongest signal strength among surrounding wireless AP information collected by the mobile terminal as the location of the mobile terminal. It has the advantages of being simple to implement, not requiring additional cost, and being able to quickly obtain location information, but has a disadvantage in that the positioning accuracy is lowered when the installation density of the wireless AP is low.

The fingerprint method is a method of collecting signal strength information by selecting a reference position in a service area, and estimating the position through signal strength information transmitted from a mobile terminal based on the collected information. In order to use the fingerprint method, it is necessary to make a database of propagation characteristics in advance.

The triangulation method is a method of calculating the position of a mobile terminal based on the coordinates of at least three wireless APs and the distance between the mobile terminal. In order to measure the distance between the mobile terminal and the wireless AP, the signal strength is converted into distance information, the time at which a wireless signal is transmitted (Time of Arrival, ToA), and the time difference of the signal is transmitted (Time Difference of Arrival, TDoA) , the angle at which the signal is transmitted (Angle of Arrival, AoA), etc. may be used.

The landmark method is a method of measuring the location of a mobile terminal using a landmark transmitter that knows the location.

In addition to the enumerated methods, various algorithms may be utilized as a method for extracting (or analyzing) location information of a mobile terminal.

The extracted location information of the mobile terminal 100 is transmitted to the mobile terminal 100 through the Wi-Fi positioning server, so that the mobile terminal 100 can acquire the location information.

The mobile terminal 100 may acquire location information by being connected to at least one wireless AP. In this case, the number of wireless APs required to acquire the location information of the mobile terminal 100 may be variously changed according to the wireless communication environment in which the mobile terminal 100 is located.

Next, a lens shift method for optical image stabilization (OIS) will be described with reference to FIG. 2 .

2 is a view for explaining a lens shift method for optical image stabilization (OIS). The components of FIG. 2 may be components included in the camera 121 illustrated in FIG. 1 .

In FIG. 2 , the lens 1 may collect light incident from the outside and transmit it to the sensor 2 . The lens 1 may allow an image corresponding to the focus to be focused on the sensor 2 through the collected light. The sensor 2 acquires an image of an object to be photographed by using the light transmitted from the lens 1 . The sensor 2 may detect the light transmitted through the lens 1 to acquire an image of the object to be photographed. The sensor may be an image sensor such as a charge-coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like.

Fig. 2 (a) shows an image 3 obtained by the sensor 2 by the user's hand shake before the lens 1 is moved, and Fig. 2 (b) shows the lens 1 according to the lens shift method. ), the image 5 acquired through the sensor 2 is shown.

Referring to (a) of Figure 2, the position of the lens 1 is not fixed by the user's hand shake, but is shaken, so the center 3a of the image 3 acquired through the sensor 2 is also can be moved from the center 3b of Due to this, the correct image 3 may not be obtained. In the lens shift method, image distortion can be suppressed by moving the lens 1 as much as the position in which the center 3a of the image 3 is moved from the original center 3b in order to solve this problem. That is, as shown in (b) of FIG. 2 , by moving the lens 1 as much as the position where the center 3a of the image 3 is moved, a proper image 5 can be obtained.

However, the lens shift method can suppress the shake in the center of the image caused by the user's hand shake, but the magnification of the periphery may be changed, and thus the image may be deteriorated.

3 to 4 are diagrams showing that, in the case of the lens shift method, the image is deteriorated as the magnification of the periphery of the image is changed.

In FIG. 4 , it is assumed that the unit of each numerical value is mm, the focus is 3.18 mm, and the tilting angle indicating hand shake is tilted by 1 degree and -1 degree in the y-axis direction with respect to the x-axis.

Figure 3 (a) is a view for explaining the magnification of the image obtained by the image sensor before the hand shake, Figure 3 (b) is the x-axis is fixed, after the hand shake in the y-axis direction, the image sensor It is a diagram for explaining the magnification of an image obtained by

Figure 4 (a) is a table for comparing and explaining the magnification of the corrected image before hand shake, after hand shake, and after hand shake correction is performed by the lens shift method, and Figure 4 (b) is based on the original image, When the lens shift method is applied, it is a diagram showing what kind of image is actually obtained according to the angle tilted to the center of each x-axis.

Referring to (a) of FIG. 4 , the Y-coordinate value of the center (H0) of the image before the hand tremor was 0, and after the hand tremor, the Y-coordinate value of the center (H0) of the image was changed to 0.058. When hand shake correction is performed according to the lens shift method, the Y coordinate value of the center (H0) of the image is corrected to 0 again. That is, image distortion does not occur at the center of the image.

Referring to (a) of FIG. 4 , the Y coordinate value of the upper side (H1) of the image based on the center (HO) of the image before the hand tremor is 1.314, and after the hand tremor, the Y coordinate of the upper side (H1) of the image The value was changed to 1.379. When hand shake correction is performed according to the lens shift method, the Y coordinate value of the upper side (H1) of the image is corrected to be 1.321. However, compared with before hand tremor, the Y coordinate value of the upper side (H1) of the image increased by 0.017.

Referring to (a) of FIG. 4 , the Y coordinate value of the lower side (H-1) of the image based on the center (HO) of the image before the hand tremor is -1.314, and after the hand tremor, the lower side of the image (H- The Y coordinate value of 1) was changed to -1.250. When image stabilization was performed according to the lens shift method, the Y coordinate value of the lower side (H-1) of the image was corrected to -1.308. However, compared with before hand tremor, the Y coordinate value of the lower side (H1) of the image increased by -0.006.

As a result, the center of the image is fixed according to the lens shift method, but the magnification is changed at the periphery of the image, so proper correction is not performed. That is, as shown in (b) of FIG. 4, the image 12 when the y-axis is tilted by 1 degree about the x-axis and the image when the y-axis is tilted by -1 degree around the x-axis ( When 13) is merged, the actual image 14 is deteriorated due to the shaking of the periphery compared to the original image 11 .

Hereinafter, a method for suppressing deterioration of the image periphery that occurs in the lens shift method will be described.

5 is a block diagram illustrating the configuration of a camera according to an embodiment of the present invention.

The camera 200 may correspond to the camera 121 illustrated in FIG. 1 . The camera 200 may be mounted on the mobile terminal 100 .

Referring to FIG. 5 , the camera 200 includes a lens 210 , an image sensor 220 , a lens movement information acquisition unit 230 , a correction coefficient calculation unit 240 , a storage unit 250 , and a control unit 270 . may include

The lens 210 may collect light incident from the outside. The collected light may be transmitted to the image sensor 220 and used to form an image of an object to be photographed.

The image sensor 220 may acquire an image of the object to be photographed by using the light transmitted from the lens 210 . The image sensor 220 may be any one of a charge-coupled device (CCD) and a complementary metal oxide semiconductor (CMOS), but this is only an example.

The lens movement information obtaining unit 230 may obtain the moving direction and the moving amount of the lens 210 based on the obtained image. The lens movement information obtaining unit 230 may obtain the direction and the amount of movement of the lens 210 before the hand shake correction and after the hand shake correction based on the position of the lens 210 . This will be described later. The lens movement information acquisition unit 230 may be included in the control unit 270 .

The correction coefficient calculator 240 calculates the correction coefficient calculator 240 of the camera 200 in the movement direction of the lens 210 when the obtained movement amount corresponding to the movement direction of the lens 210 satisfies the limit condition. A correction factor may be calculated based on the corresponding movement amount. The correction coefficient calculator 240 may be included in the controller 270 .

The storage unit 250 may store the changed coordinate values used in an image processing operation to be described later by mapping the movement direction and movement amount of the lens 210 .

The storage unit 250 may store the movement amount corresponding to the movement direction of the lens 210 in correspondence with the correction coefficient.

The controller 270 may control the components of the camera 200 in the first half.

The controller 270 may check whether a movement amount corresponding to the movement direction of the lens 210 obtained through the lens movement information obtaining unit 230 satisfies a limit condition.

When the obtained movement amount corresponding to the movement direction of the lens 210 satisfies the limit condition, the control unit 270 is configured to calculate a correction coefficient based on the movement amount corresponding to the movement direction of the lens 210 . (240) can be controlled.

The controller 270 synchronizes the image acquired from the image sensor 220 using a time stamp method and the movement information of the lens 210 acquired through a sensor included in the lens movement information acquisition unit 230 . can match

The controller 270 may be a component corresponding to a kernel of an operating system that drives the camera 200 . The controller 270 may acquire sensing data from a sensor included in the lens movement information acquisition unit 230 through a Hardware Abstraction Layer (HAL). The HAL may be an interface for receiving sensing data from each sensor. The HAL may be included in the controller 270 .

The controller 270 may be included in the controller 180 illustrated in FIG. 1 .

A detailed operation of the control unit 270 will be described later.

6 is a flowchart illustrating a method of correcting image distortion of a camera according to an embodiment of the present invention.

Referring to FIG. 6 , the image sensor 220 of the camera 200 acquires an image of an object to be photographed by using the light transmitted through the lens 210 ( S101 ).

The lens movement information obtaining unit 230 of the camera 200 obtains the moving direction and the moving amount of the lens 210 based on the obtained image (S103). In an embodiment, the lens movement information obtaining unit 230 may obtain the movement direction and movement amount of the lens 210 moved by hand shake correction using one or more sensors. The hand shake correction may be a correction for suppressing image distortion by the lens shift method described with reference to FIGS. 2 to 4 . The lens movement information obtaining unit 230 may include one or more of a gyro sensor, an acceleration sensor, and a Hall sensor. Each sensor may measure the moving direction and the moving amount of the lens 210 .

In an embodiment, the amount of movement of the lens 210 may be an amount indicating how much the lens 210 has moved from the reference coordinates of the second axis with respect to the first axis after hand-shake correction. For example, when the first axis is the x-axis, the lens 210 may be tilted by a predetermined angle in the y-axis direction according to hand shake. The camera 200 may correct the y-axis coordinate of the image center to the y-axis coordinate of the image center before hand shake by applying the lens shift method. At this time, as described in FIGS. 3 to 4 , the y-coordinates of the upper and lower sides of the image are different from the y-axis coordinates of the upper side of the image and the y-axis coordinates of the lower side of the image before hand shake correction, so distortion may occur in the periphery of the image. can The amount of movement of the lens 210 may indicate a coordinate change value between the y-axis coordinate value of the uppermost side of the image before hand shake correction, and the y-axis coordinate value of the uppermost side of the image after hand shake correction. The amount of movement of the lens 210 may represent a changed coordinate value between the y-axis coordinate value of the lowermost side of the image before hand shake correction, and the y-axis coordinate value of the lowermost side of the image after the hand shake correction.

In another embodiment, the lens movement information obtaining unit 230 may measure a movement direction of the lens 210 and a movement amount of the lens 210 through image processing. In this regard, image processing is a method of measuring the direction and amount in which the lens 210 is moved through comparison between a reference image frame and a subsequently acquired image frame. This will be described with reference to FIG. 7 .

7 is a view for explaining an image processing process for obtaining a moving direction and a moving amount of a lens according to an embodiment of the present invention.

7(a) is a reference image frame 21, and FIG. 7(b) is a next image frame 22 obtained after hand shake correction.

The lens movement information obtaining unit 230 may obtain movement information of the lens 210 by comparing the reference image frame 21 and the next image frame 22 . For example, the lens movement information obtaining unit 230 compares a point 21a of the reference image frame 21 and a point 22a of the next image frame 22 representing the same portion as the point 21a. Movement information of the lens 210 may be acquired through . Specifically, the lens movement information obtaining unit 230 may calculate a coordinate value changed between the coordinates of a point 21a of the reference image frame 21 and the coordinates of a point 22a of the next image frame 22 . The storage unit 250 may store the changed coordinate value by mapping it with the moving direction and the moving amount of the lens 210 . The lens movement information acquisition unit 230 may acquire the movement direction and the movement amount of the lens 210 through the storage unit 250 .

Fig. 6 will be described again.

The controller 270 of the camera 200 checks whether the movement amount corresponding to the obtained movement direction of the lens 210 satisfies a limit condition (S105). In an embodiment, the limit condition may indicate whether a movement amount corresponding to the movement direction of the lens 210 exceeds a preset value in order to correct distortion of the image periphery. For example, when the movement amount corresponding to the movement direction of the lens 210 obtained by the lens movement information obtaining unit 230 exceeds a preset value, the controller 270 may determine that the limit condition is not satisfied. . When the movement amount corresponding to the movement direction of the lens 210 obtained by the lens movement information obtaining unit 230 does not exceed a preset value, the controller 270 may confirm that the limit condition is satisfied.

For example, the control unit 270 controls the value of the coordinate change between the y-axis coordinate value of the uppermost side of the image before hand shake correction, and the y-axis coordinate value of the uppermost side of the image after the hand shake correction exceeds a preset value. It can be confirmed that the condition is not satisfied. In this case, the controller 270 may determine that the user's hand shake does not occur. For example, the case where the restriction condition is not satisfied is not a situation in which the user takes a picture of a subject through the camera 200 , but a case in which the camera 200 itself is moved beyond a minute hand shake, such as when holding the camera 200 and running. It may be a shaky situation. In this case, the image distortion correction operation according to the embodiment of the present invention is not required.

When the obtained movement amount corresponding to the movement direction of the lens 210 satisfies the limit condition, the correction coefficient calculator 240 of the camera 200 corrects based on the movement amount corresponding to the movement direction of the lens 210 . A coefficient is calculated (S107). In an embodiment, the correction coefficient may be a coefficient for compensating for a movement amount corresponding to the movement direction of the lens 210 . For example, referring to (a) of FIG. 4 , when the camera shake correction is performed according to the lens shift method at an angle where the y-axis is tilted with respect to the x-axis by 1 degree, the Y-coordinate value of the upper side (H1) of the image is Although corrected to 1.321, the Y coordinate value of the upper side (H1) of the image increased by 0.017 compared to before hand tremor. The correction coefficient calculation unit 240 measures the change value of the y-axis coordinates before and after the hand-shake correction at the tilted angle of the y-axis with respect to the x-axis in units of 1 degree from 1 degree to 10 degrees, and based on this, A correction factor can be calculated.

Similarly, the correction coefficient calculation unit 240 measures the change value of the y-axis coordinates before and after the hand-shake correction by measuring the tilted angle of the y-axis with respect to the x-axis by 1 degree from -1 degree to -10 degrees, Based on this, a correction coefficient can be calculated.

The controller 270 of the camera 200 corrects the distorted image based on the calculated correction coefficient (S109). The controller 270 may correct the image in which the peripheral part is distorted by correcting the magnification of the peripheral part of the image based on the calculated correction coefficient.

The controller 270 of the camera 200 outputs the corrected image (S111). The controller 270 may output the corrected image to a storage unit or a display unit provided outside the camera 200 .

The present invention described above can be implemented as computer-readable codes on a medium in which a program is recorded. The computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission through the Internet) includes implementation in the form of. In addition, the computer may include the control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (5)

a lens that collects light incident from the outside;
an image sensor configured to acquire a reference image of an object to be photographed by using the light; and
After hand shake correction based on the obtained reference image, the moving direction of the lens and the moving amount of the lens are obtained, and when the moving amount corresponding to the obtained moving direction satisfies the limit condition, a correction coefficient is calculated and calculated A control unit for correcting distortion occurring in the periphery of the image based on the corrected correction coefficient,
the control unit
If the amount of movement corresponding to the movement direction of the lens does not exceed a preset value, it is determined that the restriction condition is satisfied,
When the amount of movement corresponding to the movement direction of the lens exceeds a preset value, it is determined that the restriction condition is not satisfied,
the control unit
Comparing the reference image and the next image obtained after the hand shake correction to obtain the moving direction and the moving amount of the lens,
the control unit
calculating a coordinate value changed between the coordinates of the first point of the reference image and the coordinates of the second point of the next image representing the same part as the first point,
To obtain the movement direction and movement amount of the lens through the changed coordinate value
camera. According to claim 1,
The amount of movement of the lens is
It is a coordinate change value indicating to what extent the lens has moved from the reference coordinates of the second axis to the first axis before the hand shake correction and after the hand shake correction.
camera. 3. The method of claim 2,
The amount of movement of the lens is
Before the hand shake correction, the coordinate value of the second axis corresponding to the uppermost or lowermost side of the obtained image and the coordinate value of the second axis corresponding to the uppermost or lowermost side of the obtained image after the handshake correction Coordinate values that are changed between values
camera. delete According to claim 1,
the control unit
When the value of the coordinate change between the y-axis coordinate value of the uppermost side of the image before the handshake correction and the y-axis coordinate value of the uppermost side of the image after the handshake correction exceeds a preset value, it is determined that the restriction condition is not satisfied
camera.

Images