KR20100119440A - Display method of mobile terminal and apparatus thereof - Google Patents

Abstract

PURPOSE: A display method of a mobile terminal and a device thereof are provided to easily control an image by a finger or motion of a user. CONSTITUTION: A control unit(407) recognizes a shape and/or motion of a user from an image photographed by a camera(409). The control unit enlarges and reduces an image displayed on a display unit(405) by the recognized shape and/or motion. The display unit displays a path guide map and the enlarged or reduced image. A voice output unit(406) outputs path guidance voice information of path guidance information.

Description

DISPLAY METHOD OF MOBILE TERMINAL AND APPARATUS THEREOF}

The present invention relates to a display method and a device for a mobile terminal.

In general, a mobile terminal such as a mobile phone not only performs a phone call but also performs a video call through a camera. In addition, the user may capture a desired image through the camera of the mobile terminal.

SUMMARY OF THE INVENTION An object of the present invention is to provide a display method and apparatus for displaying a mobile terminal that can easily control an image according to a user's finger or movement.

Another object of the present invention is to provide a display method and apparatus for a mobile terminal that can freely shoot without the help of another person by automatically controlling a zoom function according to a user's finger or movement.

Still another object of the present invention is to provide a display method and apparatus for a mobile terminal which can reduce the number of re-photographing due to a shooting area error by automatically controlling a zoom function according to a user's finger or movement.

It is still another object of the present invention to provide a display method and apparatus for displaying a mobile terminal capable of controlling a function of the mobile terminal according to a user's finger or movement.

A display device of a mobile terminal according to embodiments of the present invention for achieving the above object is a camera; A recognition unit for recognizing a shape and / or a movement of a user's hand from an image captured by the camera; And a control unit controlling an image displayed on the display unit according to the shape and / or movement of the hand recognized by the recognition unit.

A display device of a mobile terminal according to embodiments of the present invention for achieving the above object is a camera for photographing a subject; A display unit which displays an image of the photographed subject; An outline extraction unit for extracting an outline of the user from the captured image; A recognition unit for recognizing the extracted outline by matching the extracted outline with a preset outline; And a controller for enlarging or reducing the image based on the recognized contour.

A display device of a mobile terminal according to embodiments of the present invention for achieving the above object is a camera for photographing a subject; A display unit which displays an image of the photographed subject; An outline extraction unit for extracting an outline of the user from the captured image; A recognition unit recognizing the extracted contour as a reference point; And a control unit which tracks the movement trajectory of the reference point and controls an image corresponding to an area within the start point and the end point when the start point and the end point of the movement trajectory are met.

A display method of a mobile terminal according to embodiments of the present invention for achieving the above object comprises the steps of photographing a subject; Displaying an image of the photographed subject; Extracting a contour of the user from the captured image; Recognizing the extracted contour by matching the extracted contour with a preset contour; Magnifying or reducing the image based on the recognized contour.

A display method of a mobile terminal according to embodiments of the present invention for achieving the above object comprises the steps of photographing a subject; Displaying an image of the photographed subject; Extracting a contour of the user from the captured image; Recognizing the extracted contour as a reference point; And tracking the movement trajectory of the reference point and controlling an image corresponding to a region within the start point and the end point when the start point and the end point of the movement trajectory are met.

The display method and apparatus for a mobile terminal according to embodiments of the present invention have an effect of easily controlling an image according to a user's finger or movement.

The method and apparatus for controlling a mobile terminal according to embodiments of the present invention have an effect of allowing free shooting without the help of another person by automatically controlling a zoom function according to a user's finger or movement.

The method and apparatus for controlling a mobile terminal according to the embodiments of the present invention can also reduce the number of retakes due to a shooting area error by automatically controlling a zoom function according to a user's finger or movement.

The method and apparatus for controlling a mobile terminal according to embodiments of the present invention has an effect of controlling a function of the mobile terminal by recognizing a reference point according to a user's finger or movement.

Hereinafter, a display method and an embodiment of a device of a mobile terminal capable of easily controlling a function (for example, a zoom function) of the mobile terminal according to a user's finger or movement will be described with reference to FIGS. 1 to 12. It demonstrates in detail with reference.

1 is a block diagram illustrating a configuration of a mobile communication terminal 100 to which a display device according to embodiments of the present invention is applied. The mobile communication terminal (mobile phone) 100 may be implemented in various forms. For example, the mobile communication terminal 100 includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

As shown in FIG. 1, the mobile communication terminal 100 includes a wireless communication unit 110, an A / V (Audio / Video) input unit 120, a user input unit 130, a sensing unit 140, and an output unit 150. ), A memory 160, an interface unit 170, a controller 180, a power supply unit 190, and the like. Not all components of the mobile communication terminal 100 shown in FIG. 1 are essential components, and the mobile communication terminal 100 may be implemented by more components than those shown in FIG. The mobile communication terminal 100 may also be implemented by components.

The wireless communication unit 110 includes one or more components for performing wireless communication between the mobile communication terminal 100 and a wireless communication system or wireless communication between the mobile communication terminal 100 and a network in which the mobile communication terminal 100 is located. It may include. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a pre-generated broadcast signal and / or broadcast related information and transmits the same to the mobile communication terminal 100. . The broadcast associated information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112. The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be built in or external to the mobile communication terminal 100. Here, wireless Internet technologies include wireless LAN (WLAN), Wi-Fi, WiBro, WiMAX, World Interoperability for Microwave Access (WMAX), HSDPA (High Speed Downlink Packet Access), and the like. Can be used.

The short range communication module 114 means a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite may be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite. As the location information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal, and the A / V input unit 120 includes a camera 121 and a microphone 122. May be included. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be configured according to the configuration of the mobile terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. In the call mode, the processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the mobile terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151, this may be referred to as a touch screen.

The sensing unit 140 may be an open / closed state of the mobile communication terminal 100, a location of the mobile communication terminal 100, a user contact presence, a bearing of the mobile communication terminal 100, an acceleration / deceleration of the mobile communication terminal 100, and the like. As described above, the current state of the mobile communication terminal 100 is sensed to generate a sensing signal for controlling the operation of the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in the form of a slide phone, whether the slide phone is opened or closed may be sensed. In addition, the sensing unit 140 is responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The interface unit 170 serves as an interface with all external devices connected to the mobile communication terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile communication terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile communication terminal 100 through a port. The interface unit 170 receives data from an external device or receives power to transmit the data to each component inside the mobile communication terminal 100 or transmit data within the mobile communication terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 includes a display unit 151, an audio output module 152, an alarm unit 153, and the like. This may be included.

The display unit 151 displays and outputs information processed by the mobile communication terminal 100. For example, when the mobile communication terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile communication terminal 100 is in a video call mode or a photographing mode, the mobile communication terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, or a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to an implementation form of the mobile communication terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile communication terminal 100.

On the other hand, when the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 ) Can be used as an input device in addition to an output device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

In addition, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch. When there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can determine which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in the inner region of the mobile communication terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using mechanical force by using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as "Proximity Touch", and the touch The act of actually touching the pointer on the screen is called "Contact Touch". The position of the proximity touch with the pointer on the touch screen means a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

In addition, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). do. Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile communication terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile communication terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may vibrate the mobile terminal through a vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile communication terminal 100 through the vibration means in response to the key signal input. The user can recognize the occurrence of the event through the vibration as described above. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user may feel the tactile effect through a muscle sense such as a finger or an arm. The haptic module 154 may be provided with two or more according to the configuration aspect of the telematics terminal. The haptic module 154 may be provided where frequent contact with the user is made in the vehicle. For example, it may be provided in a steering wheel, a shift gear lever, a seat seat, and the like.

The memory 160 may store a program for processing and controlling the controller 180, and a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). You can also do

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory). Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. In addition, the mobile communication terminal 100 may operate a web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, An audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port may be configured. Here, the identification module is a chip that stores a variety of information for authenticating the use authority of the mobile terminal 100, a user identification module (UIM), subscriber identification module (SIM), universal user authentication It may include a module (Universal Subscriber Identity Module (USIM)). In addition, the device equipped with the identification module (hereinafter referred to as an identification device) may be manufactured in the form of a smart card. Therefore, the identification module may be connected to the mobile terminal 100 through a port. The interface unit 170 may receive data from an external device or receive power and transmit the data to each component inside the mobile terminal 100 or transmit data within the mobile terminal 100 to an external device.

The interface unit 170 may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input by the user from the cradle. It may be a passage through which a signal is transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile communication terminal 100. For example, the controller 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on a touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The functions of the components applied to the mobile communication terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. Hardware implementations include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPCs), and controllers (FPGAs). It may be implemented using at least one of controllers, micro-controllers, microprocessors, electrical units for performing functions, etc. In some cases such embodiments are implemented by the controller 180. In a software implementation, embodiments such as a procedure or function may be implemented with a separate software module that performs at least one function or operation Software code may be written in a software application written in a suitable programming language. Software code is also stored in the memory 160 and controlled. It may be executed by the unit 180.

The navigation session 300 applied to the mobile communication terminal 100 generates road guidance information based on the map data and the location information of the mobile communication terminal 100 and transmits the generated road guidance information to the user. Notify.

On the other hand, the display device applied to a mobile communication terminal according to an embodiment of the present invention, the camera 121; Control unit for recognizing the shape and / or movement of the user's hand from the image taken by the camera 121, and to enlarge or reduce the image displayed on the display unit 151 according to the recognized shape and / or movement of the hand It consists of 180. The image may be map data or an image of a subject photographed by the camera 121.

2 is a block diagram illustrating a vehicle navigation system for explaining a telematics terminal to which a display device according to embodiments of the present invention is applied.

As shown in Fig. 2, the vehicle navigation system includes an information providing center 30 for providing traffic information and various data (e.g., a program, an executable file, etc.); Telematics, which is mounted in a vehicle, receives traffic information through a long range wireless communication network 20 and / or a short range wireless communication network, and provides a road guidance service based on the GPS signal received through the satellite 10 and the traffic information. It consists of a terminal 200.

Hereinafter, a configuration of the telematics terminal 200 to which the display device according to the exemplary embodiments of the present invention is applied will be described with reference to FIG. 3.

3 is a block diagram showing a configuration of a telematics terminal 200 to which a display device according to embodiments of the present invention is applied.

As shown in Fig. 3, the telematics terminal 200 includes a central processing unit (CPU) (control unit) 212 for controlling the telematics terminal 200 as a whole, a memory 213 for storing various kinds of information, and various keys. The main board 210 includes a key control unit 211 for controlling a signal and an LCD control unit 214 for controlling an LCD.

The memory 213 stores map information (map data) for displaying road guidance information on a digital map. In addition, the memory 213 stores a traffic information collection control algorithm for inputting traffic information according to a road situation in which the vehicle is currently driving, and information for controlling the algorithm.

The main board 210 is assigned a unique device number and receives a GPS signal for a CDMA module 206, which is a mobile communication terminal embedded in a vehicle, a vehicle location guide, a driving route tracking from a starting point to a destination, or a user. GPS module 207 for transmitting traffic information collected by GPS signal, CD deck 208 for reproducing signals recorded on compact disk (CD), gyro sensor 209, etc. . The CDMA module 206 and the GPS module 207 transmit / receive signals through the antennas 204 and 205.

In addition, the TV module 222 is connected to the main board 210 and receives a TV signal through the TV antenna 223. The main board 210 includes a display unit (201) under the control of the LCD control unit 214 through the interface board 203, a front board 202 under the control of the key control unit 211, and a vehicle. The camera 227 for capturing the inside and / or the outside is connected. The display unit 201 displays various video signals and text signals, and the front board 202 includes buttons for inputting various key signals, and provides a main signal 210 corresponding to a button selected by a user. To provide. In addition, the display unit 201 includes a proximity sensor and a touch sensor (touch screen) of FIG. 2.

The front board 202 may include a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by the key controller 211.

The audio board 217 is connected to the main board 210 and processes various audio signals. The audio board 217 includes a microcomputer 219 for controlling the audio board 217, a tuner 218 for receiving a radio signal, a power supply unit 216 for supplying power to the microcomputer 219, and various voices. It consists of a signal processor 215 for processing a signal.

In addition, the audio board 217 is composed of a radio antenna 220 for receiving a radio signal, and a tape deck 221 for reproducing an audio tape. The audio board 217 may further configure a voice output unit (for example, an amplifier) 226 for outputting a voice signal processed by the audio board 217.

The voice output unit (amplifier) 226 is connected to the vehicle interface 224. That is, the audio board 217 and the main board 210 are connected to the vehicle interface 224. The vehicle interface 224 may be connected to a hands-free 225a for inputting a voice signal, an airbag 225b for occupant safety, a speed sensor 225c for detecting the speed of the vehicle, and the like. The speed sensor 225c calculates a vehicle speed and provides the calculated vehicle speed information to the central processing unit 212.

The navigation session 300 applied to the telematics terminal 200 generates road guide information based on map data and vehicle current location information, and notifies the user of the generated road guide information.

The display unit 201 detects a proximity touch in the display window through a proximity sensor. For example, when the pointer (for example, a finger or a stylus pen) is in proximity or touch touch, the display unit 201 receives a writing input (or handwriting data / writing message) according to the proximity or touch touch. Recognize and control a menu (function) tagged in the recognized handwriting input. Here, the handwriting input is information input by a user, and various information such as an English alphabet, Korean, numbers, and symbols may be input.

On the other hand, the display device applied to the telematics terminal 200 according to an embodiment of the present invention, the camera 227; A controller for recognizing the shape and / or movement of the user's hand from the image photographed by the camera 227 and for enlarging or reducing the image displayed on the display unit 201 according to the recognized shape and / or movement of the hand ( CPU) 212. The image may be map data or an image of a subject photographed by the camera 227.

Hereinafter, the display device according to the first embodiment of the present invention will be described in detail with reference to a navigation apparatus. The navigation device may be applied to the telematics terminal 200 and the mobile communication terminal 100, but may be configured independently. In addition, the display device according to embodiments of the present invention may be applied to a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), and the like.

4 is a block diagram illustrating a configuration of the navigation device 400 to which the display device according to the first embodiment of the present invention is applied.

As shown in Figure 4, the navigation device 400 to which the control device according to the first embodiment of the present invention is applied,

Receives a global positioning system (GPS) signal received from a satellite and based on the received GPS signal, a first vehicle of a navigation device (referred to be in the same position as the telematics terminal 200 or the mobile communication terminal 100). A GPS module 401 for generating position data; A dead-reckoning (DR) sensor 402 for generating second vehicle position data based on a driving direction of the vehicle and the speed of the vehicle; A storage unit (or memory) 404 for storing map data and various information; A vehicle estimation position is generated based on the first vehicle position data and the second vehicle position data, and the generated vehicle estimation position and a link in the map data stored in the storage unit 404 (map matching link or map matching road). Map matching unit (403) for matching and outputting the matched map information (map matching result); A communication unit 408 for receiving real-time traffic information from the information providing center 30 and performing telephone communication through the wireless communication network 500; Generate road guidance information based on the matched map information (map matching result), recognize the shape and / or movement of the user's hand from the image captured by the camera 409, and recognize the shape and And / or a controller 407 which enlarges or reduces an image displayed on the display unit 405 according to the movement; A display unit 405 for displaying a road guidance map (including POI information) included in the road guidance information and displaying an enlarged or reduced image; And a voice output unit 406 for outputting road guide voice information (road guide voice message) included in the road guide information. Here, the communication unit 408 may further include a handsfree having a Bluetooth module.

The road guidance information may include not only map data but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and route finding information. .

Signals received through the GPS module 401 are 802.11, Bluetooth, UWB, which is a standard of a wireless network for a wireless LAN, including a wireless LAN and some infrared communication proposed by the Institute of Electrical and Electronics Engineers (IEEE). 802.15, a standard for wireless personal area networks (PANs) including Zigbee, and wireless metro area networks (BWAs) including fixed wireless access (FWA), etc. The wireless communication method such as 802.16, which is a standard standard for mobile communication, and 802.20, which is a standard for mobile Internet for mobile broadband (MBWA: Mobile Broadband Wireless Access) including Wibro, WiMAX, etc. Location information may be provided to the navigation device 400.

An input unit may be further configured in the navigation device 400, and the input unit may select a desired function or receive information (receive), and various devices such as a keypad, a touch screen, a jog shuttle, a microphone, and the like may be used. have.

The map matching unit 403 generates a vehicle estimation position based on the first position data and the second position data, and reads map data corresponding to a driving route from the storage unit 404.

The map matching unit 403 matches the estimated vehicle position with a link (road) included in the map data, and outputs the matched map information (map matching result) to the controller 407. . For example, the map matching unit 403 generates a vehicle estimation position based on the first position data and the second position data, and generates the estimated vehicle position and the map data stored in the storage unit 404. The links within the link are matched according to the link order, and the matched map information (map matching result) is output to the controller 407. The map matching unit 403 may output road attribute information, such as a tomographic road or a double layer road, included in the matched map information (map matching result) to the controller 407. In addition, the function of the map matching unit 403 may be implemented in the controller 407.

The storage unit 404 stores map data. At this time, the stored map data includes geographic coordinates (Geographic Coordinate or longitude coordinates) for displaying latitude and longitude in degrees and seconds (DMS unit: Degree / Minute / Second). Here, the stored map data may use Universal Transverse Mercator (UTM) coordinates, Universal Polar System (UPS) coordinates, Transverse Mercator (TM) coordinates, etc. in addition to the geographic coordinates.

The storage unit 404 stores various kinds of information such as various menu screens, point of interest (POI), function characteristic information according to a specific position of map data, and the like.

The storage unit 404 stores various user interfaces (UIs) and / or graphical user interfaces (GUIs).

The storage unit 404 stores data, a program, and the like necessary for the navigation device 400 to operate.

The storage unit 404 stores destination information input from a user through the input unit. In this case, the destination information may be any one of a destination or a departure point and a destination.

The display unit 405 displays image information (or road guidance map) included in the road guide information generated by the control unit 407. Here, the display unit 405 includes a touch sensor (touch screen) and / or a proximity sensor. The road guidance information may include not only map data but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and route finding information. have.

When displaying the image information, the display unit 405 may display various contents such as various menu screens and road guide information by using a user interface and / or a graphic user interface included in the storage unit 404. have. Here, the content displayed on the display unit 405 includes a menu screen including various text or image data (including map data and various information data) and data such as icons, list menus, combo boxes, and the like.

The voice output unit 406 outputs voice information (or a voice message for the road guide information) included in the road guide information generated by the controller 407. Here, the voice output unit 406 may be an amplifier or a speaker.

The controller 407 generates road guide information based on the matched map information, and outputs the generated road guide information to the display unit 405 and the voice output unit 406. In this case, the display unit 405 displays the road guide information.

The controller 407 receives real-time traffic information from the information providing center to generate road guidance information.

The controller 407 may be connected through a call center and a communication unit 408 to perform a telephone call or to transmit / receive information between the navigation device 400 and the call center. Here, the communication unit 408 includes a hands-free module having a Bluetooth function using a short range wireless communication method.

Hereinafter, a display device according to a first exemplary embodiment of the present invention will be described with reference to FIGS. 4 and 5.

5 is a flowchart showing a display method according to the first embodiment of the present invention.

First, in the camera mode (S11), the camera 409 photographs a subject according to a user's selection, and outputs the photographed subject image to the controller 407 (S12). In this case, the controller 407 displays the subject image on the display unit 405.

The controller 407 recognizes the shape and / or movement of the user's hand from the photographed subject image, and enlarges or reduces the photographed subject image according to the shape and / or movement of the recognized hand. For example, the outline extracting unit 407B extracts the user's outline from the captured image and outputs the extracted outline information to the recognition unit 407A. That is, the contour extraction unit 407B extracts the contours of the user's forefinger and thumb from the captured image and outputs the extracted contour information to the recognition unit 407A (S13). Here, the technology itself for recognizing the shape and / or movement of the user's hand is a known technology, and the description thereof is also disclosed in US Pat. No. 6,191,773, and thus a detailed description thereof will be omitted.

The recognition unit 407A determines whether the extracted contour matches a predetermined contour to enlarge or reduce the image (S14). In this case, the controller 407 enlarges or reduces the image based on the extracted contour when the extracted contour is matched with a preset contour to enlarge or reduce the photographed image. That is, the controller 407 enlarges or reduces an image in the direction of the extracted index finger and the direction of the thumb (S15). Here, the image in the index finger direction and the thumb direction may be an image in a rectangular shape.

6 is an exemplary view illustrating a method of enlarging or reducing an image according to the shape of a user's hand according to the first embodiment of the present invention. The method of enlarging or reducing the image according to the shape of the user's hand may be applied to a mobile communication terminal (mobile phone) and / or a navigation device.

As shown in Fig. 6, the contour extracting unit 407B extracts the contours of the user's index finger and thumb from the captured image and outputs the extracted contour information to the recognition unit 407A. The recognition unit 407A determines whether the extracted contour matches a preset contour to enlarge or reduce the image. The controller 407 may determine whether the extracted contour matches a preset contour to enlarge or reduce the image. That is, the controller 407 detects the direction of the extracted index finger and the direction of the thumb when the extracted contour is matched with a preset contour to enlarge or reduce the photographed image, and the detected index finger The image 6-1 in the direction of the finger and the direction of the thumb is enlarged or reduced. In addition, the controller 407 may adjust the range of the image to be enlarged or reduced in accordance with the positional movement of the extracted forefinger and thumb.

7 is an exemplary view illustrating a method of enlarging or reducing an image according to a user's movement according to a first embodiment of the present invention.

As shown in Fig. 7, the contour extracting unit 407B extracts the contour of the user's arm and leg from the captured image and outputs the extracted contour information to the recognition unit 407A. The recognition unit 407A determines whether the extracted contour matches a preset contour to enlarge or reduce the image. The controller 407 may determine whether the extracted contour matches a predetermined contour to enlarge or reduce the image. That is, the controller 407 reduces the photographed image when the extracted contour is matched with a preset contour to reduce the photographed image (when the extracted arms and legs are pinched). In addition, the controller 407 enlarges the photographed image when the extracted contour is matched with a preset contour to enlarge the photographed image (when the extracted arm and leg are open).

In addition, the controller 407 may sequentially reduce or enlarge the photographed image at a preset ratio according to the extracted arms and legs. For example, the controller 407 is configured to capture the image when the extracted contour is matched with a preset contour to reduce the photographed image (eg, when the extracted arm and leg are pinched). When the extracted contour is matched with a preset contour to enlarge the photographed image (e.g., when the extracted arms and legs are open). The photographed image is sequentially enlarged at a preset ratio (for example, 1.1, 1.2, 1.3 ... 2 times). Herein, the preset ratio may be variously changed according to a user or a designer.

Therefore, the user may reduce or enlarge the image at a preset ratio and then photograph himself by taking a desired pose without the help of others. Here, the control unit 407 reduces the image or enlarges the image at a preset ratio and automatically photographs a subject through the camera 409 when a predetermined time (for example, 2 to 5 seconds) elapses. The photographed subject image is stored in the storage unit 404. Thus, the user can take a picture of himself / herself without the help of others at a desired enlargement ratio or reduction ratio.

Hereinafter, a display device according to a second exemplary embodiment of the present invention will be described with reference to FIGS. 4 and 8.

8 is a flowchart illustrating a display method according to a second embodiment of the present invention.

First, in the camera mode (S21), the camera 409 photographs a subject according to a user's selection, and outputs the photographed subject image to the controller 407 (S22). In this case, the controller 407 displays the subject image on the display unit 405.

The contour extracting unit 407B extracts the user's contour (for example, the user's index finger) from the captured image, and outputs the extracted contour information to the recognition unit 407A (S23).

The recognition unit 407A recognizes the extracted contour as a reference point when it is matched with a predetermined contour to enlarge or reduce the extracted contour and the captured image (S24). For example, the recognition unit 407A recognizes the end of the index finger as a reference point when the index finger of the user matches a preset outline to enlarge or reduce the captured image (S25).

In addition, the controller 407 displays an identifier (eg, an identifier for identifying a reference point such as a figure, a symbol, or an icon) at a position corresponding to the recognized reference point. That is, the controller 407 may display the identifier so that the user can recognize whether the user's index finger is recognized, and track the movement trajectory when the identifier is displayed.

The control unit 407 tracks the movement trajectory of the reference point (S26), displays the tracked movement trajectory on the display unit 405 (S27), and when the start point and the end point of the movement trajectory are met, the start point and the end point The image corresponding to the region inside is enlarged or reduced (S28).

In addition, the controller 407 corrects the region within the start point and the end point to a preset figure (for example, a rectangle) when the region within the start point and the end point is similar to a preset figure (for example, a rectangle), When the area within the start point and the end point is similar to the circle (preset figure), the area within the start point and the end point is corrected to the circle (preset figure).

9 is an exemplary view illustrating a method of enlarging an image according to a movement trajectory of a user's finger according to a second embodiment of the present invention.

As shown in Fig. 9, the recognition unit 407A uses the extracted contour as a reference point when the extracted contour (for example, the index finger) matches a predetermined contour to enlarge the photographed image. Recognize. The recognition unit 407A may set a predetermined time (for example, 1 second to 2 seconds) in which the extracted contour (for example, the index finger) is fixed so that the user can designate a desired point as a reference point. Is maintained, the extracted contour is recognized as a reference point when a predetermined contour is matched to enlarge the captured image.

The control unit 407 displays an identifier (for example, an identifier for identifying a reference point such as a figure, a symbol, or an icon) 9-1 at a position corresponding to the recognized reference point. That is, the controller 407 displays the identifier 9-1 so that the user can recognize whether the user's index finger is recognized, and tracks the movement trajectory when the identifier 9-1 is displayed. It may be.

The control unit 407 tracks the movement trajectory of the reference point (for example, the movement trajectory of the index finger tip) 9-2, and displays the tracked movement trajectory 9-2 on the display unit 405. When the start point and the end point of the movement trajectory 9-2 are met, the image corresponding to the area within the start point and the end point is automatically enlarged.

On the other hand, the recognition unit 407A recognizes the extracted contour as a reference point when the extracted contour (for example, a thumb) and a predetermined contour match to reduce the captured image. The controller 407 displays the identifier 9-1 so that the user can recognize whether the user's thumb is recognized, and tracks the movement trajectory when the identifier 9-1 is displayed.

The controller 407 tracks the movement trajectory of the reference point, displays the tracked movement trajectory on the display unit 405, and when the start point and the end point of the movement trajectory are met, an image corresponding to the area within the start point and the end point. Zoom out.

Thereafter, the controller 407 enlarges or reduces an image corresponding to an area within the start point and the end point, and automatically displays the enlarged or reduced image when a predetermined time (for example, 2 to 5 seconds) elapses. Stored in the storage unit 404.

Hereinafter, a display device according to a third exemplary embodiment of the present invention will be described with reference to FIGS. 4 and 10.

10 is a flowchart illustrating a display method according to a third embodiment of the present invention.

First, when the camera is selected by the user in the road guidance mode, the controller 407 photographs a subject through the camera 409, and outputs the photographed subject image to the controller 407 (S31). In this case, the controller 407 does not display the subject image on the display unit 405 so that the user can view the road guide information in the road guide mode. That is, the controller 407 cuts off the subject image signal output to the display unit 405 so as to view the road guide information in the road guidance mode (blocks the subject image displayed on the display unit). S32).

The contour extracting unit 407B extracts the user's contour (for example, the user's index finger) from the photographed image, and outputs the extracted contour information to the recognition unit 407A (S33).

The recognition unit 407A refers to the extracted contour (for example, the end point of the user's forefinger) when the extracted contour is matched with a preset contour to enlarge or reduce the captured image (S34). To be recognized. For example, the recognition unit 407A recognizes the end of the index finger as a reference point when a predetermined outline is matched to enlarge or reduce the index finger of the user and the captured image (S35).

In addition, the controller 407 displays an identifier (eg, an identifier for identifying a reference point such as a figure, a symbol, or an icon) at a position corresponding to the recognized reference point. That is, the controller 407 may display the identifier so that the user can recognize whether the user's index finger is recognized, and track the movement trajectory when the identifier is displayed.

The control unit 407 tracks the movement trajectory of the reference point (S36), displays the tracked movement trajectory on the display unit 405 (S37), and when the start point and the end point of the movement trajectory meet, the start point and the end point The image corresponding to the region inside is enlarged or reduced (S38).

Further, the controller 407 corrects the area within the start point and the end point to a rectangle when the area within the start point and the end point is similar to a rectangle, and the area within the start point and the end point when the area within the start point and the end point is similar to a circle. Calibrate to circular.

11 is an exemplary view illustrating a method of enlarging an image according to a movement trajectory of a user's finger according to a third embodiment of the present invention.

As shown in Fig. 11, the recognition unit 407A uses the extracted contour as a reference point when the extracted contour (for example, the index finger) matches a predetermined contour to enlarge the photographed image. Recognize. The recognition unit 407A may set a predetermined time (for example, 1 second to 2 seconds) in which the extracted contour (for example, the index finger) is fixed so that the user can designate a desired point as a reference point. If the extracted contour is matched with a predetermined contour to enlarge the photographed image, the extracted contour may be recognized as a reference point.

The controller 407 displays an identifier (eg, an identifier for identifying a reference point such as a figure, a symbol, or an icon) 11-1 at a position corresponding to the recognized reference point. That is, the controller 407 displays the identifier 11-1 so that the user can recognize whether the user's index finger is recognized, and tracks the movement trajectory when the identifier 11-1 is displayed. It may be.

The controller 407 tracks the movement trajectory of the reference point, displays the tracked movement trajectory on the display unit 405, and when the start point and the end point of the movement trajectory are met, an image corresponding to the area within the start point and the end point. Zoom in.

On the other hand, the recognition unit 407A recognizes the extracted contour as a reference point when the extracted contour (for example, a thumb) and a preset contour to reduce the photographed image match. The controller 407 displays the identifier 11-1 so that the user can recognize whether the user's thumb is recognized, and tracks the movement trajectory when the identifier 11-1 is displayed.

The controller 407 tracks the movement trajectory of the reference point, displays the tracked movement trajectory on the display unit 405, and when the start point and the end point of the movement trajectory are met, an image corresponding to the area within the start point and the end point. Zoom out.

Thereafter, the controller 407 enlarges or reduces an image corresponding to an area within the start point and the end point, and automatically displays the enlarged or reduced image when a predetermined time (for example, 2 to 5 seconds) elapses. Stored in the storage unit 404.

Hereinafter, a display method according to a fourth embodiment of the present invention will be described with reference to FIGS. 4 and 12.

12 is a diagram showing a display method according to a fourth embodiment of the present invention.

First, when the camera is selected by the user in the road guidance mode, the controller 407 photographs a subject through the camera 409, and outputs the photographed subject image to the controller 407. In this case, the controller 407 does not display the subject image on the display unit 405 so that the user can view the road guide information in the road guide mode. That is, the controller 407 blocks the subject image signal output to the display unit 405 so that the user can view the road guide information in the road guide mode.

The contour extracting unit 407B extracts the user's contour (for example, the user's forefinger) from the captured image, and outputs the extracted contour information to the recognition unit 407A.

The recognition unit 407A recognizes the extracted outline as a reference point when it matches a predetermined outline to enlarge or reduce the extracted outline and the captured image. For example, the recognition unit 407A recognizes the end of the index finger as a reference point when it is matched with a preset contour to enlarge or reduce the index finger of the user and the captured image.

In addition, the controller 407 displays an identifier (eg, an identifier for identifying a reference point such as a figure, a symbol, or an icon) at a position corresponding to the recognized reference point. That is, the controller 407 displays the identifier so that the user can recognize whether the user's index finger is recognized, and tracks the movement trajectory when the identifier is displayed.

The controller 407 generates a pop-up window (or message window) for inquiring whether to enlarge an image corresponding to an area within the start point and the end point when the start point and the end point of the movement trajectory are met. The generated popup window 12-1 is displayed on the display unit 405.

The controller 407 is a preset time (for example, 1 second to 2 seconds) in which the extracted contour (for example, the end point of the index finger) is fixed on the confirmation key of the pop-up window 12-1. ), The confirmation key is regarded as selected and the image corresponding to the area within the start point and the end point is enlarged. On the other hand, the control unit 407 is a preset time (for example, 1 second to 2 seconds) in which the extracted contour (for example, the index finger) is fixed on the cancel key of the pop-up window 12-1. In this case, the cancel key is regarded as selected and the image corresponding to the region (selected region) within the start point and the end point is not enlarged (releasing the selected region).

In addition, the controller 407 recognizes the extracted contour as a reference point when the extracted contour (for example, the end point of the index finger) is located in the pop-up window, and identifies an identifier (i.e., a position corresponding to the recognized reference point). 12-2). That is, when the reference point moves in the pop-up window, the controller 407 displays the identifier 12-2 according to the movement so that the user can accurately select the confirmation key or the cancel key.

As described in detail above, the method and apparatus for controlling a mobile terminal according to embodiments of the present invention can easily control an image according to a user's finger or movement.

In the method and apparatus for controlling a mobile terminal according to embodiments of the present invention, a zoom function is automatically controlled according to a user's finger or movement, thereby enabling free shooting without the help of another person.

The method and apparatus for controlling a mobile terminal according to the embodiments of the present invention can reduce the number of retakes due to a shooting area error by automatically controlling a zoom function according to a user's finger or movement.

The method and apparatus for controlling a mobile terminal according to embodiments of the present disclosure may control a function of the mobile terminal by recognizing a reference point according to a user's finger or movement.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a block diagram illustrating a configuration of a mobile communication terminal to which a display device according to embodiments of the present invention is applied.

2 is a block diagram illustrating a vehicle navigation system for explaining a telematics terminal to which a display device according to embodiments of the present invention is applied.

3 is a block diagram illustrating a configuration of a telematics terminal to which a display device according to embodiments of the present invention is applied.

4 is a block diagram illustrating a configuration of a navigation device to which a display device according to a first embodiment of the present invention is applied.

5 is a flowchart showing a display method according to the first embodiment of the present invention.

6 is an exemplary view illustrating a method of enlarging or reducing an image according to the shape of a user's hand according to the first embodiment of the present invention.

7 is an exemplary view illustrating a method of enlarging or reducing an image according to a user's movement according to a first embodiment of the present invention.

8 is a flowchart illustrating a display method according to a second embodiment of the present invention.

9 is an exemplary view illustrating a method of enlarging an image according to a movement trajectory of a user's finger according to a second embodiment of the present invention.

10 is a flowchart illustrating a display method according to a third embodiment of the present invention.

11 is an exemplary view illustrating a method of enlarging an image according to a movement trajectory of a user's finger according to a third embodiment of the present invention.

12 is a diagram showing a display method according to a fourth embodiment of the present invention.

* Explanation of symbols on the main parts of the drawings

401: GPS module 402: DR sensor

403: map matching unit 404: storage unit

405: display unit 406: audio output unit

407: control unit 407A: recognition unit

407B: Contour Extraction Unit 408: Communication Unit

409: camera

Claims (23)

A camera; A recognition unit for recognizing a shape and / or a movement of a user's hand from an image captured by the camera; And a control unit controlling an image displayed on the display unit according to the shape and / or movement of the hand recognized by the recognition unit. The display device of claim 1, wherein the image is map data. The display device of claim 1, wherein the image is an image of a subject photographed by the camera. The method of claim 1, wherein the control unit, And the image is enlarged or reduced in accordance with the recognized shape and / or movement of the hand. A camera for photographing the subject; A display unit which displays an image of the photographed subject; An outline extraction unit for extracting an outline of the user from the captured image; A recognition unit for recognizing the extracted outline by matching the extracted outline with a preset outline; And a controller configured to enlarge or reduce the image based on the recognized contour. The method of claim 5, wherein the contour extraction unit The display device of the mobile terminal, characterized in that for extracting the contour of the first finger and the second finger of the user. The method of claim 6, wherein the control unit, And the image in the direction of the extracted first finger and the direction of the second finger is enlarged or reduced. The method of claim 6, wherein the control unit, And adjusting a range of an image to be enlarged or reduced in accordance with the movement of the extracted first and second fingers. A camera for photographing the subject; A display unit which displays an image of the photographed subject; An outline extraction unit for extracting an outline of the user from the captured image; A recognition unit recognizing the extracted contour as a reference point; And a control unit which tracks a movement trajectory of the reference point and controls an image corresponding to an area within the start point and the end point when the start point and the end point of the movement trajectory are met. The method of claim 9, wherein the control unit, The display device of the mobile terminal, characterized in that to enlarge or reduce the image corresponding to the area within the start point and end point. The method of claim 9, wherein the display unit, And displaying the tracked movement trajectory. The display apparatus of claim 9, wherein the contour extracting unit extracts an outline of the first finger of the user, and the recognition unit recognizes the end of the extracted first finger as the reference point. The method of claim 9, wherein the control unit, And the region within the start point and the end point is corrected to the preset figure when the region within the start point and the end point is similar to the preset figure. The method of claim 9, wherein the control unit, And displaying an identifier at a position corresponding to the recognized reference point. The method of claim 14, wherein the control unit, And displaying the movement trajectory when the identifier is displayed. The method of claim 9, wherein the control unit, And displaying the extracted contour as a reference point when the extracted contour is held in a fixed state for a predetermined time. The method of claim 9, wherein the control unit, And the enlarged or reduced image is automatically stored in the storage unit after a preset time elapses after the image corresponding to the area within the start point and the end point is enlarged or reduced. The method of claim 9, wherein the control unit, When providing the road guidance information on the display, the display device of the mobile terminal, characterized in that for blocking the subject image displayed on the display. The method of claim 9, wherein the control unit, And a pop-up window for inquiring whether to control an image corresponding to an area within the start point and the end point when the start point and the end point of the movement trajectory are met on the display unit. The method of claim 19, wherein the control unit, And if the extracted contour is held for a predetermined time in a fixed state on a specific key of the pop-up window, controlling the image by considering the specific key as selected. The method of claim 20, wherein the control unit, And when the extracted contour is located in the pop-up window, recognize the extracted contour as a reference point, and display an identifier at a position corresponding to the recognized reference point. Photographing the subject; Displaying an image of the photographed subject; Extracting a contour of the user from the captured image; Recognizing the extracted contour by matching the extracted contour with a preset contour; And zooming in or out of the image based on the recognized contour. Photographing the subject; Displaying an image of the photographed subject; Extracting a contour of the user from the captured image; Recognizing the extracted contour as a reference point; And tracking a moving trajectory of the reference point and controlling an image corresponding to an area within the starting point and the ending point when the starting point and the ending point of the moving trajectory are met.

Images