KR101968524B1 - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal capable of capturing a screen image and a control method thereof. A mobile terminal according to an embodiment of the present invention includes: a display unit displaying a screen image including at least a part of a page; A capture unit capturing a screen image displayed on the display unit; A scroll unit for selecting a direction in which the page is to be autoscrolled and for scrolling the page in the selected direction; And a control unit for controlling the capture unit to capture screen images that change as the image is scrolled, and merging the captured screen images to generate a merged image.

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of capturing a screen image and a control method thereof.

The terminal is movable And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

With this improvement, the terminal can display the page. However, due to the size limitation of the display portion, the entire area of the page may not be displayed all at once on the display portion. At this time, if the entire area of the page is to be captured, there is a need to input a capture signal while the user scrolls the page.

It is an object of the present invention to provide a mobile terminal and a control method thereof capable of capturing the entire area of a page even if the entire area of the page is not displayed all at once on the display part.

A mobile terminal according to an embodiment of the present invention includes: a display unit displaying a screen image including at least a part of a page; A capture unit capturing a screen image displayed on the display unit; A scroll unit for selecting a direction in which the page is to be autoscrolled and for scrolling the page in the selected direction; And a control unit for controlling the capture unit to capture screen images that change as the image is scrolled, and merging the captured screen images to generate a merged image.

In an embodiment, the scroll portion may display indicators on the display portion corresponding to each of the directions to be autoscrolled, and may autoscroll the page in a direction corresponding to a selected one of the indicators.

In an exemplary embodiment, the scroll unit senses a flick input applied to the display unit and can scroll the page in the direction of the flick input.

In an embodiment, the scrolling portion may stop autoscrolling the page based on an input signal applied during the scrolling of the page.

In an embodiment, the scroll unit may change the direction of the auto-scroll based on the input signal applied during the auto-scrolling of the page.

In one embodiment, when a plurality of indicators among the indicators are selected, the scroll unit scrolls the page in one direction among a plurality of directions corresponding to the selected indicators based on the priority of the selected indicators After autoscrolling, the page can be autoscrolled in the other direction.

In an embodiment, the capturing unit may calculate the number of captures based on the total size of the page and the size of the screen image displayed on the display unit, and may capture the screen images based on the calculated number of times.

In an embodiment, the capture unit may stop capturing based on an input signal applied during the process of autoscrolling the page.

In an embodiment, the capturing unit detects coordinates of the designated area in the screen image when an area is designated in the screen image displayed on the display unit, and detects the coordinates of the designated area in the other screen images It is possible to capture a portion corresponding to the designated area.

In an embodiment, the control unit is further configured to: combine the captured screen images to generate the merged image, wherein a boundary between the screen images is added to the merged image such that each of the captured screen images can be distinguished from the merged image Can be displayed.

In an embodiment, when a control command for executing an editing mode is detected, the control unit may set the merged image as an editing material of the editing mode.

In an embodiment, the control unit may designate a partial area of the merged image based on a touch input applied to the merged image, and store the designated partial area.

In an embodiment, the mobile terminal further includes a user input unit for receiving condition information for capturing, and the capturing unit may capture a screen image including an area corresponding to the condition information in the page.

In an embodiment, the capture unit may capture a screen image comprising at least one of a specific word of text data, a specific portion of image data, and a bookmark.

A method of controlling a mobile terminal according to an embodiment of the present invention includes displaying a screen image including at least a portion of a page on a display unit; Capturing a screen image displayed on the display unit; Selecting a direction in which the page is to be autoscrolled and autoscrolling the page in the selected direction; Capturing screen images that change as the screen is scrolled; And merging the captured screen images to generate a merged image.

In an embodiment, the step of selecting a direction in which the page is to be autoscrolled and the step of autoscrolling the page in the selected direction comprises the steps of: displaying indicators on the display corresponding to each of the directions to be autoscrolled; Selecting at least one of the displayed indicators; And autoscrolling the page in a direction corresponding to the selected one of the indicators.

In an embodiment, the step of selecting a direction in which the page is to be autoscrolled and the step of autoscrolling the page in the selected direction may include sensing a flick input applied to the display unit; And autoscrolling the page in the direction of the flick input.

In an embodiment, merging the captured screen images to generate a merged image may include displaying a boundary between the screen images in the merged image such that each of the captured screen images in the merged image may be distinguished Step < / RTI >

According to the present invention, even if the entire area of the page is not displayed on the display unit at all, the entire area of the page is divided into a plurality of areas An image for the entire area of the page can be obtained using the captured images.

Further, according to the present invention, the direction in which the page is to be scrolled can be set. Accordingly, the user may acquire only the image for the desired area of the entire area of the page. Consequently, the convenience of the user can be improved.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a flowchart for explaining an embodiment of a mobile terminal according to the present invention.
FIGS. 4 to 13 are conceptual diagrams showing an operation example of the mobile terminal according to FIG.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art can easily carry out the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention, parts not related to the description are omitted, and like parts are denoted by similar reference numerals throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120 (hereinafter referred to as a user tracking unit), a user input unit 130, An input unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The position information module 115 is a module for acquiring the position of the mobile terminal 100, and a representative example thereof is a Global Position System (GPS) module.

1, the user tracking unit 120 receives an audio signal and a video signal and tracks a user using the received signal. The user tracking unit 120 includes a camera 121, a microphone 122, A sensor 123, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure and static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the touch pressure.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, corresponding signals are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

In the case where the touch screen is electrostatic, it can be configured to detect the proximity of the sensing object by a change of the electric field along the proximity of the sensing target. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This can be referred to as a transparent display. A typical example of such a transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing the appearance of the mobile terminal 100 related to the present invention.

FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, when the user's face is photographed and the photographed image is transmitted to the other party in real time, the size of the transmitted data can be reduced. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 'may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). Further, a back display unit for outputting time information can be additionally mounted on the touch pad 135. [ At this time, information output from both sides of the front display unit 151 and the rear display unit can be controlled by the touch pad 135. [

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be positioned parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Meanwhile, the mobile terminal 100 can display a page. However, due to the size limitation of the display unit 151, the entire area of the page may not be displayed on the display unit 151 at a time. At this time, if the entire area of the page is to be captured, there is a need to input a capture signal while the user scrolls the page.

Accordingly, in the following, with reference to the attached drawings for the mobile terminal 100 and its control method capable of capturing the entire area of the page even if the entire area of the page is not displayed all over the display part 151 Explain.

FIG. 3 is a flowchart for explaining an embodiment of the mobile terminal 100 (see FIG. 1) according to the present invention. The mobile terminal 100 includes a display unit 151 (see FIG. 1), a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 3, first, a step S110 in which a screen image including at least a part of a page is displayed on the display unit 151 is performed.

The display unit 151 may display a page including an image or a text, a web page, an e-mail, an electronic document (E-documents), and a social network service (SNS) At least one of the contents may be displayed. Here, the screen image means information displayed on one screen of the display unit 151.

Next, the process of capturing the screen image displayed on the display unit 151 (S120) proceeds.

Specifically, the capture unit 182 can capture a screen image displayed on the display unit 151. [ The capturing means that some information is selected from the information displayed on the display unit 151 and the selected information is stored.

Thereafter, the direction in which the page is to be autoscrolled is selected, and the step of autoscrolling the page in the selected direction (S130) proceeds.

Here, scrolling means that when the amount of information included in a page exceeds one screen, the entire information moves up or down or left or right based on an input applied from the outside. The term " autoscrolling " means that the entire information is moved up or down or left or right at a predetermined speed.

Specifically, in one embodiment, the scroll unit 183 may display on the display unit 151 an indicator corresponding to each of the directions to be autoscrolled. For example, the scroll unit 183 may display, on the display unit 151, arrow-shaped objects representing respective directions to be autoscrolled as an indicator. At this time, if at least one of the objects is selected, the page may be autoscrolled in the direction corresponding to the selected object.

Meanwhile, as another embodiment, when a flick input or a drag input is detected on a page, the scroll unit 183 may autoscroll the page in the direction of the flick input or the direction of the drag input. Here, the flick input is a touch gesture including a start coordinate and an end coordinate, which means a touch gesture that is released after being dragged in an arbitrary direction.

Next, step S140 is performed in which screen images that are changed as the image is scrolled are captured.

Specifically, the capture unit 182 can calculate the number of captures based on the total size of the page and the size of the screen image displayed on the display unit 151, and capture the screen images based on the calculated number of times. For example, if the total size of the page is equal to the size of n number of screen images, the capture unit 182 may capture the screen image n times while the page is being autoscrolled.

At this time, although not shown, the capture unit 182 may stop capturing based on the input signal applied during the page auto-scrolling. That is, the capture unit 182 may stop capturing based on the touch input applied to the display unit 151 or the input to the user input unit 130 (see FIG. 1).

Thereafter, the captured screen images are merged to generate a merged image (S150).

In particular, the control unit 180 may merge the captured screen images to generate a merged image, and may display a border between the screen images in the merged image so that each captured screen image in the merged image can be distinguished. For example, a boundary between screen images may be indicated by a solid line or a dotted line.

In addition, the control unit 180 may edit the captured screen images based on the touch input applied to the captured screen images, and may generate the merged image by reflecting the edited result.

Also, the control unit 180 may designate a partial area of the merge image based on the touch input applied to the merge image, and store the designated partial area.

As described above, according to the present invention, when the entire area of the page is not displayed on the display unit 151 at all, even if the user scrolls the page directly and does not input the capture signal a plurality of times, The entire area is divided and captured into a plurality of areas, and an image for the entire area of the page can be obtained using the captured images.

Further, according to the present invention, the direction in which the page is to be scrolled can be set. Accordingly, the user may acquire only the image for the desired area of the entire area of the page. Consequently, the convenience of the user can be improved.

FIGS. 4 and 5 are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

4, when a control command for autoscrolling is applied to the user input unit 230, the display unit 251 displays an indicator corresponding to each of the directions to be autoscrolled, for example, Can be displayed.

At this time, as shown, when one of the objects 252a is selected, the scroll unit 183 can scroll the page in the direction corresponding to the selected object. For example, if an object 252a for autoscrolling a page is selected so that the lower portion of the page is displayed on the display 251, the scroll portion 183 may autoscroll the page from the lower side to the upper side . Accordingly, the lower portion of the page can be displayed on the display unit 251. [

On the other hand, the order in which the control command for the auto-scroll is applied and the direction in which the direction to be autoscrolled is selected is not limited thereto. That is, a control command for autoscrolling may be applied to the user input unit 230 after at least one of the indicators corresponding to the respective directions to be autoscrolled is selected on the display unit 251.

5, when a control command for autoscrolling is applied to the user input unit 230 and a flick input or a drag input is detected on a page, the scroll unit 183 controls the direction of the flick input or the direction of the drag input You can also autoscroll the page in the direction. For example, when a flick input is sensed in a page from the bottom up, the scroll portion 183 may autoscroll the page from the bottom up.

4 and 5, as the page is autoscrolled, the capture unit 182 can capture the screen images displayed on the display unit 251. [

At this time, the capture unit 183 may calculate the number of captures based on the total size of the page and the size of the screen image displayed on the display unit 251, and may capture the screen images based on the calculated number of times. In this case, the control unit 180 may then connect the captured screen images to generate a merged image.

On the other hand, the capture unit 183 may capture screen images at predetermined time intervals as the page is autoscrolled. In this case, the control unit 180 may then remove overlapping portions of the captured screen images to generate a merged image.

When the autoscrolling is completed, the capturing unit 183 can stop capturing. At this time, as shown in the figure, the display unit 251 may display a popup window 253 indicating that the capture is completed.

On the other hand, although not shown, when a plurality of directions are selected in the direction to be autoscrolled, the scroll portion 183 scrolls the page in one direction among a plurality of directions based on the priority of the plurality of directions The page can be autoscrolled in the backward direction.

Also, although not shown, some of the screen images displayed on the display unit 251 may be designated. In this case, the capture unit 182 may detect the coordinates of the designated area in the screen image, and capture only the portion corresponding to the designated area in the other screen images using the detected coordinates.

6 and 7 are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 6, the display unit 251 may display an indicator corresponding to each of the directions to be autoscrolled, for example, arrow-shaped objects representing respective directions to be autoscrolled.

As shown, the scroll portion 183 may autoscroll the page in a direction corresponding to the selected object 252a. Accordingly, the scroll unit 183 can scroll the page from the lower side to the upper side.

At this time, as shown, when another object 252b of the objects is selected, the scroll unit 183 can change the direction in which the object is scrolled. That is, the scroll portion 183 may autoscroll the page in a direction corresponding to another selected object 252b. Accordingly, the scroll unit 183 can scroll the page from the right side to the left side. Also, while the direction to be autoscrolled is changed, the display section 251 may change the arrangement of the scroll bars.

Referring to FIG. 7, when a flick input or a drag input is detected on a page, the scroll unit 183 may autoscroll the page in the direction of the flick input or the direction of the drag input. For example, when a flick input is sensed in a page from the bottom up, the scroll portion 183 may autoscroll the page from the bottom up.

At this time, when the flick input or the drag input is sensed in the other direction as shown, the scroll unit 183 can change the direction of the auto-scroll. For example, if a scroll input is detected from right to left in a page, the scroll portion 183 may autoscroll the page from right to left. Likewise, while the direction to be autoscrolled is changed, the display section 251 may change the arrangement of the scroll bars.

FIG. 8 is a conceptual diagram showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 8, the scroll portion 183 may stop autoscrolling the page based on the input signal applied during the page auto-scrolling. In addition, the control unit 180 may stop capturing the screen image based on the input signal applied during the auto scrolling of the page.

For example, as shown, when a touch input to the display portion 251 is sensed while the page is being scrolled, the control portion 180 may stop capturing the screen image. At the same time, the scroll unit 183 may stop autoscrolling the page. At this time, as shown in the figure, the display unit 251 may display a pop-up window 254 indicating that the capture is interrupted.

Figs. 9 and 10 are conceptual diagrams showing operational examples of the mobile terminal 200 according to Fig. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

The control unit 180 may merge the captured screen images to generate a merged image 255. [ In particular, the control unit 180 may connect the captured screen images to generate a merged image 255, and may remove the overlapping portions of the captured screen images to generate a merged image 255. [

Returning to the third figure of FIGS. 4 and 5, the display unit 251 may display a pop-up window 253 indicating that the capture is completed. 9, when a control command for displaying the merge image 255 is sensed, for example, when a touch input to the pop-up window 253 is sensed, The image 255 can be displayed on the display unit 251. [

The merge image 255 may be enlarged or reduced in size based on the pinch-in or pinch-out touch input to be displayed on the display unit 251.

Returning to the third figure of FIGS. 6 and 7, the display unit 251 may display a pop-up window 253 indicating that the capture is completed. 10, when a control command for displaying the merge image 255 is sensed, the control unit 180 may display the merge image 255 on the display unit 251. In this case,

At this time, as shown in the upper part of FIG. 10, the merge image 255 may include regions of the coverable page as the page is scrolled from the lower side to the upper side and from the right side to the left side.

10, the merge image 255 may include only the areas of the page that were displayed on the display unit 251 as the page scrolls from the lower side to the upper side and scrolls from the right side to the left side, as shown in the lower part of FIG. 10 have.

11 is a conceptual diagram showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

The control unit 180 merges the captured screen images to generate a merged image 255 so that the boundaries between the screen images in the merged image 255 are separated so that each of the screen images captured in the merged image 255 can be separated Can be displayed. Here, the boundary between the screen images can be indicated by a solid line or a dotted line.

When a control command for executing the edit mode is detected, the control unit 180 may set the merge image 255 as an edit material of the edit mode. As shown, when the icon 256 for executing the edit mode is selected, the edit mode can be executed. In the edit mode, the control unit 180 may delete some areas of the merge image 255 and may overlap other images or text on the merge image 255. [ The edited merged image 255 may be stored.

FIGS. 12 and 13 are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 includes a display unit 251, a user input unit 230, a capture unit 182 (see FIG. 1), a scroll unit 183 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 12, the capture unit 182 may capture only a screen image including an area corresponding to specific condition information in a page. For example, the capture unit 182 may capture only a screen image that includes at least one of a specific word of text data, a specific portion of image data, and a bookmark.

As shown, a screen image including the bookmark 256 can be set as condition information for capturing. At this time, even if the screen images displayed on the display unit 251 are changed as the page is autoscrolled, the capturing unit 182 captures screen images including the book mark 256, for example, Only 3 screen images can be captured. Thereafter, the control unit 180 may merge the first screen image and the third screen image to generate a merged image.

Accordingly, when a control command for displaying the merge image 255 is sensed, for example, when a touch input to the pop-up window 253 is sensed, The merge image 255 can be displayed on the display unit 251. [ At this time, the merge image 255 is generated by merging the first screen image and the third screen image in which the book mark 256 was included.

Meanwhile, although not shown, the user input unit 230 or the display unit 251 can receive condition information for capturing directly from the user. Accordingly, the user can set a specific node of the text data and a specific portion of the image data as the condition information for capturing.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (19)

A touch screen displaying a first portion of a page; And
Responsive to a capture command being issued to capture a first portion of the page, capturing a first portion of the page,
The control unit
Scrolling the page so that after capture of the first portion, the second portion is output on the touch screen in response to a capture command being applied to a second portion that is at least partially different from the first portion,
Capture a second portion of the page with scrolling of the page,
And merging the captured first portion and the captured second portion to generate a merged image. The method according to claim 1,
The control unit
Outputting an indicator for receiving a capture command for the second portion after capturing the first portion,
And in response to the touch input being applied to the indicator, capturing the second portion. 3. The method of claim 2,
The indicator
Is a graphic object indicating a direction in which the page is to be scrolled. The method according to claim 1,
The control unit
And stops scrolling of the page based on that touch input is applied to the page during scrolling of the page. 5. The method of claim 4,
The control unit
And displays a pop-up window on the touch screen indicating that the capture of the second portion is interrupted when the scroll of the page is interrupted. The method according to claim 1,
The control unit
Wherein when the capture of the entire portion of the page is completed, the mobile terminal stops scrolling the page and outputs a pop-up window indicating that the merged image is generated on the touch screen. The method according to claim 1,
Wherein,
Calculating a number of captures based on the total size of the page and the size of the first portion displayed on the touch screen,
And captures at least a part of the page based on the calculated number. The method according to claim 1,
Wherein,
And displays a border between the captured first portion and the captured second portion in the merged image such that the first portion and the second portion can be distinguished from each other in the merged image. The method according to claim 1,
Wherein,
In response to a control command for executing an edit mode, an edit mode for editing the merge image is executed. 10. The method of claim 9,
Wherein,
And performs editing of a part of the merge image based on the touch input applied to the merge image. The method according to claim 1,
Wherein,
And captures a portion corresponding to preset condition information for capturing in the page. 12. The method of claim 11,
Wherein,
Capturing a portion of the page including at least one of a specific word of text data, a specific portion of image data, and a bookmark. Displaying a first portion of a page on a touch screen;
Responsive to a capture command being issued to capture a first portion of the page, capturing a first portion of the page;
Scrolling the page such that after capture of the first portion, the second portion is output on the touch screen in response to a capture command being directed to a second portion that is at least partially different from the first portion, ;
Capturing a second portion of the page with scrolling of the page; And
And merging the captured first portion and the captured second portion to generate a merged image. 14. The method of claim 13,
In the step of scrolling the page,
Displaying an indicator for receiving a capture command of the first portion on the touch screen;
And scrolling the page so that the second portion is output on the touch screen in response to the touch input being applied to the displayed indicator. 15. The method of claim 14,
The indicator
Wherein the graphical object is a graphic object indicating a direction in which the page is to be scrolled. 14. The method of claim 13,
In the step of scrolling the page,
Further comprising: stopping scrolling of the page based on the touch input being applied to the page during scrolling of the page. 17. The method of claim 16,
In the step of stopping the scrolling of the page,
When the scroll of the page is interrupted, a pop-up window indicating that the capture of the second portion is interrupted is output on the touch screen. 14. The method of claim 13,
In the step of generating the merge image,
Wherein when the capture of the entire portion of the page is completed, a scrolling of the page is stopped, and a pop-up window indicating that the merge image is generated is output on the touch screen. 14. The method of claim 13,
Wherein the generating the merged image comprises:
And displaying a boundary between the captured first portion and the captured second portion in the merged image so that the first portion and the second portion can be distinguished from each other in the merged image .

Images