KR20150056346A - Terminal for screen capture processing for multi windows - Google Patents

Abstract

The present invention provides a terminal. The terminal includes: a display unit which displays multiple screen windows and a capture object for capturing a screen on the screen; and a control unit which captures the screen when the capture object is moved on the corresponding screen to be arranged on a single window or multiple windows by a pre-set touch input from a user while the screen windows are displayed on the screen of the display unit. When the screen windows are displayed on the screen of the mobile terminal, the present invention enables users to move the capture object such as a capture icon or capture widget displayed on the screen to arrange the capture object between the screen windows to capture the screen. Accordingly, the present invention implements a fairly intuitive screen capture operation in terms of the user experience and enhances the user convenience.

Description

[0001] TERMINAL FOR SCREEN CAPTURE PROCESSING FOR MULTI WINDOWS [0002]

The present invention relates to a terminal for capturing a multi-window screen, and more particularly, to a terminal for capturing a capture object such as a screen capture icon or a capture widget displayed on a screen when a plurality of screen windows are displayed on a screen of the mobile terminal The present invention relates to a terminal for multi-window screen capture processing which enables a very intuitive and convenient screen capture in terms of a user experience for capturing a screen by moving and positioning the selected screen in one or a plurality of screen windows.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, a communication function of voice, text, video and e-mail, as well as a function of shooting a picture or a moving picture, reproducing music or video file, And is implemented in the form of a multifunctional multimedia device having various functions.

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

It is now possible to operate multiple functions on one screen by adding the function of simultaneously displaying multiple windows on one screen as the terminal is high-definition, large-screen.

However, with the current screen capture function, screen capturing can not be performed by controlling each individual window, and there is no succeeding function.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a method and system for capturing a capture object such as a screen capture icon or a capture widget displayed on a screen when a plurality of screen windows are displayed on a screen of a mobile terminal, The present invention provides a terminal for a multi-window screen capturing process that enables highly intuitive and convenient screen capturing in terms of a user experience for capturing a screen.

Another problem to be solved by the present invention is to provide a method and apparatus for capturing thumbnails corresponding to captured images captured by a mobile terminal by moving the captured thumbnails to various application objects installed in the mobile terminal, And to provide a terminal for the screen capture processing method.

The problems to be solved by the present invention are not limited to the above-mentioned problems, and other problems not mentioned can be clearly understood by those skilled in the art from the following description will be.

According to an aspect of the present invention, there is provided a display device including: a display unit displaying a plurality of screen windows and a capture object for screen capture on a screen; And performing a screen capture on the screen window when a plurality of screen windows are displayed on the screen of the display unit and the captured object is moved on the screen and positioned in one or more screen windows by a preset touch input from the user A terminal including a control unit is provided.

According to the present invention, when a plurality of screen windows are displayed on a screen of a mobile terminal, a user moves a capture object such as a screen capture icon or a capture widget displayed on the screen to one or a plurality of screen windows It is very intuitive in terms of the user experience for screen capture and has an effect of enhancing the convenience of the user.

According to the present invention, it is possible to edit or share the captured image by moving and positioning the captured thumbnails corresponding to the screen-captured captured images to various application objects installed in the mobile terminal, It is very intuitive in terms of the user experience and increases the convenience of the user.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a diagram illustrating a screen for explaining how to capture objects on a screen by touching a capture menu icon in a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 3 is a diagram illustrating an example of screen capturing by dragging and dropping a capture object on a screen window to capture a capture object in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 4 is a diagram illustrating a screen capture process performed when a plurality of screen windows overlaps in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 5 is a diagram illustrating an example of screen capture by dragging and dropping a capture object when a plurality of screen windows overlap in a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 6 is a diagram illustrating a screen for arranging capture thumbnails when a plurality of screens captured by a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 7 is a diagram illustrating a screen for displaying thumbnails and displaying additional information when a plurality of screens are captured in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 8 is a diagram illustrating an example of capturing a screen window, which has already been captured by a mobile terminal, into a single screen by combining other screen windows according to an exemplary embodiment of the present invention.
FIG. 9 is a diagram illustrating an example of capturing a screen window, which has already been captured in a mobile terminal, into a single screen by combining other screen windows according to an exemplary embodiment of the present invention.
10 is a diagram illustrating a screen for explaining a note on a screen captured by a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 11 is a diagram illustrating an example of executing a memo function when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
FIG. 12 is a diagram illustrating an example of executing a memo function when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.
13 is a diagram for explaining sharing of a captured image in a mobile terminal according to an exemplary embodiment of the present invention.
14 is a diagram for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an embodiment of the present invention.
FIG. 15 is a diagram illustrating a screen for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention.
16 is a diagram for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. The following embodiments are provided by way of example so that those skilled in the art can fully understand the spirit of the present invention. Therefore, the present invention is not limited to the embodiments described below, but may be embodied in other forms. In the drawings, the width, length, thickness, and the like of the components may be exaggerated for convenience. Like reference numerals designate like elements throughout the specification. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a pad, a notebook, a tablet PC, a laptop computer, a digital broadcast terminal, a PDA (Personal Digital Assistants), a PMP And the like. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

1, a mobile terminal 100 according to an exemplary embodiment of the present invention includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, An output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. Here, the broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated by the broadcast server and transmitting the generated broadcast signals and / or broadcast- The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112. Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may be a digital multimedia broadcasting (DMB-T), a digital multimedia broadcasting (DMB-S), a media forward link only (DVF-H) (ISDB-T), and digital broadcasting systems such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for acquiring the position of the mobile terminal, for example, a Global Position System (GPS) module.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment. For example, it may include a front camera positioned at the front of the terminal to photograph a user, and a rear camera positioned at the rear of the terminal to photograph the front. The camera 121 can be used for the video call mode.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include, for example, a key pad dome switch, a touch pad (static / static), a jog wheel, and a jog switch. The user input unit 130 may include an identification module selection switch for generating a selection signal for selecting an arbitrary identification module among a plurality of identification modules.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, A sensing signal for controlling the operation of the mobile terminal 100 may be generated. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. The sensing unit 140 may include a touch sensor 141 and a proximity sensor 142, for example. The touch sensor 141 is a sensor for sensing a touch operation. For example, the touch sensor 141 may have the form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor 141 may form a mutual layer structure (hereinafter referred to as 'touch screen') with the display unit 151. The touch sensor 141 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 141 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 141, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 142 may be disposed within an interior region of the mobile terminal or proximate to the touch screen that is enclosed by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact using the force of the electromagnetic field or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high.

Examples of the proximity sensor 142 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is electrostatic, it is configured to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

The term "proximity touch " refers to an act of causing the pointer to be located on the touch screen in proximity to the touch screen without the pointer touching the touch screen. "Contact touch" refers to the act of actually contacting the pointer on the touch screen. The position where the pointer is proximately touched on the touch screen means the position where the pointer corresponds vertically to the touch screen when the pointer is touched proximately.

The proximity sensor 142 detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern can be output on the touch screen.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of a transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152. Accordingly, the display unit 151 and the audio output module 152 may be classified as a part of the alarm unit 153. [

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module 200 is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, As shown in FIG. The various command signals or power from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

A controller 180 controls the overall operation of the mobile terminal. For example, the control unit 180 may perform related control and processing for voice call, data communication, video call, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

When a captured object is moved on the screen and positioned in one or a plurality of screen windows by a predetermined touch input from the user in a state where a plurality of screen windows are displayed on the screen of the display unit 151, You can do a screen capture for.

The control unit 180 may display a status bar at the top of the screen and may generate a capture object for capturing the screen if there is a preset touch input for the capture menu icon provided in the status display bar and display the captured object on the screen. Here, the capture object may be a capture icon or a capture widget.

The control unit 180 can perform screen capturing of the screen window when the captured object is moved on the screen by the drag and drop input from the user and positioned in one or a plurality of screen windows.

The control unit 180 may display a pop-up window for confirming whether or not the captured object is located on one or a plurality of screen windows by drag-and-drop input from the user.

The control unit 180 may include a plurality of pop-up windows for receiving a selection of a single screen window from among a plurality of screen windows displayed on the screen of the display unit 151, or a screen for capturing a plurality of screen windows, Can be displayed.

The control unit 180 may form and display a captured thumbnail of the screen window captured at the place where the captured object is located in the corresponding window after performing the screen capture.

When there are a plurality of captured screens, the control unit 180 forms a capture bar in a part of the screen, and arranges and displays a plurality of capture thumbnails formed on the capture bar.

When the first capture thumbnail formed on the captured first screen window is located in the second screen window partially overlapped with the first screen window by the drag and drop input from the user, the controller 180 controls the first screen window and the second screen window A second capture thumbnail is formed, a capture bar is formed in a partial area of the screen, and a first capture thumbnail and a second capture thumbnail are arranged and displayed on a capture bar.

The control unit 180 displays an edit screen for editing the captured image if the captured thumbnail formed on the captured screen window has a preset touch input. The controller 180 can edit the captured image according to the editing of the user and store the edited captured image have.

When the captured object displayed on the screen is dragged and dropped onto the capture bar, the control unit 180 displays an edit screen for a plurality of capture thumbnails arranged in the capture bar, edits the captured image according to the editing of the user, Can be stored.

If there is a double-touch input for the captured object displayed on the screen, the control unit 180 displays an editing screen for a plurality of captured thumbnails arranged in the capture bar, edits the captured image according to the editing of the user, Can be stored.

When the captured object is moved on the screen by the drag input from the user and positioned in one of the plurality of overlapping screen windows, the control unit 180 adjusts the transparency of another screen window, which partially overlaps the positioned screen window The screen window on which the capture object is located can be displayed on the screen without covering it with another screen window.

The control unit 180 can perform screen capturing for the corresponding screen window when the screen window on which the captured object is located among the plurality of screen windows is displayed on the screen without covering the screen window with another screen window.

The control unit 180 may display the related information of the captured screen image corresponding to the captured thumbnail on the screen if a predetermined touch input is made for an arbitrary captured thumbnail among a plurality of captured thumbnails displayed on the capture bar.

If the captured screen window is calendar information, the control unit 180 can display today's date and current time as related information.

If the captured screen window is a video screen, the control unit 180 may display the captured video file name and the shooting time as related information.

If the captured screen window is a DMB screen window, the controller 180 may display channel information and program name of the captured DMB as related information.

If the captured screen window is a memo screen window, the control unit 180 may display the memo creation date and a part of the content of the captured memo window as related information.

If the captured screen window is an Internet screen window, the control unit 180 may display the captured Internet site address as related information.

If the captured screen window is a calculator screen window, the controller 180 may display the calculation process and the result of the captured calculator screen window as related information.

When the first capture thumbnail corresponding to the captured first screen window among the plurality of capture thumbnails displayed on the capture bar is located in the second screen window partially overlapped with the first screen window by the drag and drop input from the user , A first screen window and a second screen window are captured as a single screen, a second capture thumbnail is formed, and a first capture thumbnail and a second capture thumbnail are arranged and displayed on a capture bar.

The capture bar may include a previous job cancel menu icon. Accordingly, the control unit 180 can cancel the previous operation if there is an execution command of the user for the previous job cancel menu icon.

The capture bar may include a capturing end menu icon. Accordingly, the controller 180 can remove the capture bar from the screen and terminate the capture operation if the user has an execution command for the capture operation end menu icon.

The control unit 180 displays an edit screen for editing the first capture thumbnail selected from a plurality of capture thumbnails displayed on the capture bar, edits the first captured image according to the editing of the user, and selects a second capture thumbnail The edited first captured image may be stored, and the first captured thumbnail corresponding to the edited first captured image may be displayed in the capture bar.

The control unit 180 may reflect the edited content on the edit screen in real time on the corresponding captured thumbnail displayed on the capture bar and display it.

The control unit 180 can switch to the home screen if there is a preset key input to switch to the home screen and display the edited capture thumbnail on the capture bar of the home screen.

The capture bar includes a sharing icon, and if there is an execution input to the sharing icon, the control unit 180 changes the location of the capture bar so that the area of the capture bar is expanded and shares the captured image in the area of the expanded capture bar Shared application menu icons to be displayed.

The control unit 180 may share the captured image corresponding to the captured thumbnail through the corresponding shared application when any captured thumbnail among the plurality of captured thumbnails displayed on the capture bar is dragged and dropped onto the shared application menu icons.

When a plurality of capture thumbnails among the plurality of capture thumbnails displayed on the capture bar are dragged and dropped onto the shared application menu icons, the control unit 180 may attach a plurality of captured images corresponding to the capture thumbnails to the corresponding shared application.

The control unit 180 displays the capture bar in the first area of the screen, arranges application menu icons for sharing a plurality of capture thumbnails in the second area of the screen, and displays an arbitrary capture thumbnail in the capture bar When dragged and dropped onto the application icon, the captured image corresponding to the captured thumbnail can be shared through the corresponding shared application.

The control unit 180 changes the position of the capture bar so that the capture bar is enlarged when a plurality of capture thumbnails displayed on the capture bar are dragged in an arbitrary direction by the user's multi-touch, The shared application menu icons for sharing images captured by the user can be arranged and displayed.

The control unit 180 may select a shared application menu icon for sharing the captured image corresponding to the captured thumbnail, and may attach the captured image to the corresponding shared application have.

When a memo application object is selected, the control unit 180 executes an image editing window for editing the captured image corresponding to the captured thumbnail and displays it on the screen can do.

The control unit 180 displays a first edit thumbnail and a second edit thumbnail selected from a plurality of capture thumbnails displayed on the capture bar, and displays a first captured image and a second captured image according to the user's editing And edited on the edit screen can be reflected in real time on the corresponding capture thumbnail displayed on the capture bar and displayed.

The control unit 180 can switch to the home screen if there is a preset key input to switch to the home screen and display the edited capture thumbnail on the capture bar of the home screen.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, May be implemented by the control unit 180.

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes are stored in the memory 160 and can be executed by the control unit 180. [

2 is a diagram illustrating a screen for explaining how to capture objects on a screen by touching a capture menu icon in a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 2A, the controller 180 displays a status incate bar 10 on the screen 20 when there is a drag input in a downward direction from the upper end of the screen 20 by the user Can be displayed. Although the status indicator bar 10 is described here, the present invention is not limited thereto. For example, the status indicator bar 10 may be a guide bar. The status bar may be a menu bar.

The status display bar 10 may be located at the top of the screen 20. Here, the status bar 10 is positioned at the top of the screen 20, but the present invention is not limited thereto. For example, the status bar 10 may be located at the bottom of the screen 20. The status display bar 10 may be located on the left side of the screen 20. The status display bar 10 may be located on the right side of the screen 20. In addition, the status display bar 10 may have a shape other than a straight line in a pop-up shape, for example, an arc shape, overlapped with an appropriate area of the screen 20.

The status bar 10 may include various function icons, such as a capture menu icon 11, a data menu icon, a Wi-Fi menu icon, a Bluetooth menu icon, a position menu icon, etc., in an appropriate number,

The control unit 180 can receive the user's long touch input for the capture menu icon 11 while the status display bar 10 is displayed on the screen 20. [ However, the present invention is not limited to the pong touch input, and it is possible to use a predetermined touch input.

Referring to FIG. 2B, when the status display bar 10 is displayed on the screen and the user has a long touch input for the capture menu icon 11, the controller 180 performs a screen capture function And displays the captured object 21 on the screen 20. [ Here, the capture object 21 may be a capture icon or a capture widget.

The control unit 180 can execute various visual effects functions when displaying the captured object 21 on the screen 20. [ For example, the control unit 180 can execute an animation function to add fun to the user when the capture object 21 appears on the screen. For example, the control unit 180 may display the captured object 21 to move within the screen 20 for a predetermined period of time. The control unit 180 can stop the capture object 21 from moving around and display it at a predetermined arbitrary point when a predetermined time elapses.

When the capture object 21 is displayed on the screen 20, the control unit 180 can perform various additional functions. For example, the control unit 180 determines "What should be captured? Or "Ready to capture." Or a variety of texts such as "Drag and drop on the screen to be captured" can be displayed in a popup window. The control unit 180 may cause the displayed pop-up window to disappear from the screen 20 after a predetermined time elapses. For example, when the capture object 21 is displayed on the screen, the control unit 180 can reproduce a sound file set for a fun sound effect.

The control unit 180 can remove the status display bar 10 from the screen 20 when the captured object 21 is displayed on the screen 20 or after it is displayed. At this time, the control unit 180 can perform the visual effect that the status indicator bar 10 disappears to the top of the screen 20. For example, the control unit 180 may execute an animation function. However, the present invention is not limited thereto. Therefore, the status display bar 10 can be continuously displayed on the screen in a state in which the captured object 21 is displayed on the screen 20. [

Through the user interface, if the user has a screen window to be captured, the user can drag the top of the screen 20 downward and drag the status bar 10 to the top of the screen 20 to display the screen . Thereafter, a capture object 21 for performing a screen capture function can be formed at an arbitrary point on the screen 20 by touching the capture menu icon 11 in the status bar 10 displayed on the screen 20 have.

FIG. 3 is a diagram illustrating an example of screen capturing by dragging and dropping a capture object on a screen window to capture a capture object in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

3 (a), the control unit 180 displays an arbitrary screen window 23 (FIG. 3) on the captured object 21 for screen capturing from the user in a state in which the captured object 21 is displayed on the screen 20 ) To receive the drag and drop input.

When the capture object 21 is displayed on the screen 20 and there is a drag and drop input into the arbitrary screen window 23 with respect to the capture object 21, the control unit 180 displays the captured object 21a Is positioned at the dropped point in the screen window (23) and displayed. Here, the screen window 23 is a screen window for the user to perform screen capture.

3 (b), the control unit 180 displays a popup window 24 for capturing confirmation, which inquires whether or not to capture the screen window 23 at the point where the capture object 21a is dropped, Display. For example, the control unit 180 may display a popup window 24 for capture confirmation of "capture" 24a or "cancel" 24b on the screen.

3 (c), when the "capture" 24a is selected in the capture confirmation pop-up window 24, the control unit 180 displays a screen capture of the screen window 23 in which the capture object 21a is dropped . The control unit 180 generates and displays a thumbnail 25 of the captured screen window 23 instead of the captured object 21a at the point where the captured object 21a is dropped after the screen capture.

Through the user interface, if the user has a screen to be captured, the user can drag and drop the capture object 21 into the screen window 23 to capture the pop-up window to confirm whether to capture the corresponding window 23 (24) can be seen floating. When the capture window 24a is selected in the pop-up window, the corresponding window 23 at the point where the capture object 21a has been dropped is captured, and the captured thumbnail 25 of the captured window 23 is captured The user can confirm that the corresponding window 23 has been captured through the display of the window 21a at the point where the window 21a is dropped.

FIG. 4 is a diagram illustrating a screen capture process performed when a plurality of screen windows overlaps in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 4 (a), the controller 180 may display a plurality of screen windows 23 and 33 on the screen. A plurality of screen windows (23, 33) may be partially overlapped. The control unit 180 can display the capture object 21 on the screen 20 in a state where a plurality of screen windows 23 and 33 are displayed on the screen 20. [

The control unit 180 may receive a drag and drop input 22 directed toward the selected screen window 33 among the plurality of screen windows 23 and 33 partially overlapped with the capture object 21 at the current position.

4B, the controller 180 displays pop-up windows 24c, 24d, 24e, and 24f for the capture selection on the screen 20 to select a screen window to be captured from among a plurality of screen windows . At this time, the capture selection pop-up windows 24c, 24d, 24e, and 24f allow one menu to be selected in one pop-up window so that one or a plurality or all of the plurality of window windows can be selected, The number of pop-up windows can be increased. However, the present invention is not limited in any way. The pop-up window may be implemented by having a plurality of selection menus in one pop-up window so that one, or a plurality or all of the plurality of window can be selected.

Referring to FIG. 4C, when an arbitrary pop-up window is selected from the capture selection pop-up windows 24c to 24f, the controller 180 captures the window windows 23 and 33 corresponding to the pop-up window . The control unit 180 displays a capture thumbnail 34 of a screen window captured on the screen after capturing the screen. At this time, a captured thumbnail 34 of the captured screen window may be displayed instead of the captured object at the point where the captured object is dropped. The screen popup window 24e for capturing both the two window windows 23 and 33 is selected in a state where the two window windows 23 and 33 are overlapped with each other so that the two window windows 23 and 33 And a capture thumbnail 34 captured on one screen is displayed.

Through such a user experience interface, when a user has a screen to be captured while a plurality of screen windows 23 and 33 are displayed on the screen 20, the user can select the capture object 21 as a window of the screen to be captured (22c), pop-up windows (24c, 24d, 24e, 24f) for capturing selection for receiving a user's input to select one or a plurality of or all of the plurality of displayed window windows Can be seen. When a popup window corresponding to a screen window desired to be captured by the user is selected from the capture selection popup windows 24c, 24d, 24e, and 24f, the corresponding window is captured, and the thumbnail 34 of the turned on screen window is displayed on the screen 20 It is possible to confirm that the corresponding screen windows 23 and 33 have been captured. At this time, the captured thumbnail 34 of the captured screen window may be displayed at a point where the captured object 21a is dropped, or may be displayed at an arbitrary position on the screen.

FIG. 5 is a diagram illustrating an example of screen capture by dragging and dropping a capture object when a plurality of screen windows overlap in a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 5A, the controller 180 may display a plurality of screen windows 23, 33, and 43 on the screen. A plurality of screen windows (23, 33, 43) may be partially overlapped. The control unit 180 can display the captured object 21 on the screen in a state where a plurality of screen windows 23, 33, and 43 are displayed on the screen 20. [ The first screen window 23 may be partially covered by the second screen window 33. [ The first screen window 23 can be displayed by covering a part of the third screen window 43.

The control unit 180 may receive a drag input or a drag and drop input directed to a plurality of screen windows 23, 33 and 43 partially overlapped with the capture object 21 at the current position.

5B, the controller 180 may receive a drag input 22 from the current position of the capture object 21 to the first screen window 23 by the user. The control unit 180 displays the first screen window 23 on the uppermost surface of the screen 20 when the captured object 21a is located in a part of the first screen window 23 by the drag input of the user. For this, the controller 180 may switch the second screen window 33 covering a part of the first screen window 23 to a transparent state or a shade state to display the second screen window 33. [ Thus, all the portions of the first screen window 23 are displayed on the screen. The user can see the whole of the first screen window 23 and can select whether to capture or not.

At this time, the controller 180 displays the entire first screen window 23 on the screen while the drag input state for the capture object 21a is maintained by the user.

5C, the controller 180 controls the dragging of the capture object 21a located in the first window 23 to the area of the second window 33 ). When the captured object 21a enters the area of the second screen window 33 from the area of the first screen window 23 by the drag input 22 of the user, the control unit 180 switches to the transparent state or the shade state The second screen window 33 is displayed on the uppermost surface of the screen. At this time, the controller 180 may switch the first screen window 23 covering a part of the second screen window 33 to a transparent state or a shade state to display the first screen window 23. The present invention is not limited thereto. For example, when the first screen window 23 is partially covered by the second screen window 33, the control unit 180 displays the second screen window 33 on the uppermost surface of the screen 20 . Thus, all portions of the second screen window 33 are displayed on the screen 20. The user can see the whole of the second screen window 33 and can select whether to capture or not.

Through such a user interface, when a user has a screen 23 or 33 to be captured while a plurality of screen windows 23, 33 and 43 are displayed on the screen 20, The screen images 23 and 33 in which the captured object 21a is located among the plurality of displayed screen windows 23, 33 and 43 are displayed on the uppermost side of the screen 20 It is convenient to select a screen window to be captured. The user can select the screen windows 23, 33, and 43 to be captured while dragging the screen 22 on the screen 20 while touching the captured objects 21 and 21a, 23, and 33 are determined, the user can release the touch from the captured object 21a to complete the drag-and-drop operation, thereby capturing the screen window to be captured.

5D, the controller 180 may receive a drag-and-drop input 22 from the current position of the capture object 21 to the first screen window 23 by the user. The control unit 180 displays the first screen window 23 on the uppermost surface of the screen 20 when the captured object is positioned in a part of the first screen window by the drag input of the user. The control unit 180 switches the second screen window 33 covering a part of the first screen window 23 into a transparent state or a shade state and displays the second screen window 33. [ At this time, the controller 180 displays the entire first screen window 23 on the screen while the drag input state for the capture object 21a is maintained by the user.

The control unit 180 performs screen capture for the first screen window 23 when there is a drop input for the capture object 21a in a state where the dragging input of the user to the capture object 21a is maintained.

5E, the controller 180 performs screen capture on the first screen window 23 and then displays the captured thumbnail 24 of the captured first screen window 23 on the first screen 23, Is displayed on a part of the window (23). At this time, the control unit 180 returns the second screen window 33, which has been changed to the transparent state or the shadow state, to the original transparency.

FIG. 6 is a diagram illustrating a screen for arranging capture thumbnails when a plurality of screens captured by a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 6A, the controller 180 may display a plurality of screen windows 23, 33, and 43 on the screen 20. At this time, a plurality of screen windows (23, 33, 43) may be partially overlapped. The control unit 180 controls the capture object 20 to move from the current position to an arbitrary screen window 23, 33, 43 while the plurality of screen windows 23, 33, 43 are displayed on the screen 20 You can receive drag and drop input. Accordingly, the control unit 180 may display a capture thumbnail of a screen window captured in an arbitrary area of the screen after performing a screen capture of an arbitrary screen window according to the drag and drop operation of the user.

6 (b), the controller 180 performs screen capture by the screen window capturing operation of the drag-and-drop operation 22, displays the first capture thumbnail 24, Drop input 22 directed to an arbitrary screen window 33 at the current position with respect to the display window 21, 21a. Of course, another drag-and-drop input can be a screen window other than the screen window that was previously captured. However, the present invention is not limited to this, and even if dragging and dropping is performed on a screen window that has been previously captured, capturing of the screen window can be made.

Referring to FIG. 6C, the controller 180 performs screen capture on the corresponding screen window 33 by performing a drag-and-drop screen window capturing operation performed once again, and then performs a second capture thumbnail 34 ) Is generated and displayed. At this time, the controller 180 may display the first capture thumbnail 24a and the second capture thumbnail 34 on the capture bar 50 located at the upper end of the screen. The controller 180 may arrange the first capture thumbnail 24a and the second capture thumbnail 34 on the capture bar 50 and display the same. However, the present invention is not limited thereto. For example, the capture bar 50 may be formed at the lower end of the screen. For example, the first capture thumbnail 24a and the second capture thumbnail 34 may be displayed at any location on the screen 20, rather than the capture bar 50. [ The first capture thumbnail 24a and the second capture thumbnail 34 may be displayed according to a predetermined arrangement format. The first capture thumbnail 24a and the second capture thumbnail 34 may be respectively displayed on the captured screen windows 23 and 33 without a certain array format.

Through the user interface, the user can drag and drop the capture objects (21, 21a) into a screen window to be captured while a plurality of screen windows (23, 33, 43) And a plurality of capture thumbnails corresponding to a plurality of captured screen windows are displayed on the capture bar located at the upper end of the screen, respectively.

FIG. 7 is a diagram illustrating a screen for displaying thumbnails and displaying additional information when a plurality of screens are captured in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 7A, the controller 180 may display each of the captured thumbnails generated through screen capturing for a certain window on the capture bar 50 located at the upper end of the screen. For example, the controller 180 may arrange the first capture thumbnail 24a and the second capture thumbnail 34 on the capture bar 50 and display the same.

At this time, a plurality of screen windows 23, 33, and 43 are displayed on the screen 20 by the control unit 180. A plurality of screen windows (23, 33, 43) may be partially overlapped. In any one of the screen windows 23, 33, and 43, the captured captured object 21a can be displayed by the drag and drop input of the user.

The control unit 180 may receive a touch input of a user for an arbitrary capture thumbnail displayed on the capture bar 50. [ The control unit 180 may display the first captured thumbnail 24a, which is input by touch, from the second captured thumbnail 34, and display the first captured thumbnail 24a. For example, you can adjust transparency or display more selection boxes.

7B, the controller 180 may adjust the transparency or display the selection box 24b to indicate that the first capture thumbnail received the touch input in the capture bar is selected, Related information 60 for the corresponding captured thumbnail. For example, when the first capture thumbnail 24b generated by capturing the first screen window 23 of the calendar is selected, the control unit 180 can display the current date and the current time 60 in a predetermined area of the screen have.

In another embodiment of the present invention, the first capture thumbnail 24a may be a capture thumbnail captured from a video screen. In this case, the controller 180 adjusts the transparency or displays a selection box to indicate that the first capture thumbnail 24a received the touch input from the capture bar is selected, and then displays the captured video file name and shooting time information Can be displayed.

In another embodiment of the present invention, the first capture thumbnail 24a may be a capture thumbnail captured by the DMB screen. In this case, the controller 180 controls the transparency or displays a selection box to indicate that the first capture thumbnail 24a received the touch input from the capture bar is selected, and then displays the channel information and program name information of the captured DMB Can be displayed.

In another embodiment of the present invention, the first capture thumbnail 24a may be a capture thumbnail captured from the memo screen. The controller 180 controls the transparency or displays a selection box to indicate that the first capture thumbnail 24a received the touch input from the capture bar is selected and displays a note creation date and a part of the content of the captured note .

In another embodiment of the present invention, the first capture thumbnail 24a may be a capture thumbnail capturing the Internet screen. The control unit 180 may display the captured internet site address information after adjusting the transparency or displaying a selection box to indicate that the first capture thumbnail 24a received the touch input from the capture bar is selected.

In another embodiment of the present invention, the first capture thumbnail 24a may be a capture thumbnail captured by a computer screen. The control unit 180 may adjust the transparency or display a selection box to indicate that the first capture thumbnail 24a received the touch input from the capture bar is selected, and then display the calculation process and calculation result on the calculator screen .

FIG. 8 is a diagram illustrating an example of capturing a screen window, which has already been captured by a mobile terminal, into a single screen by combining other screen windows according to an exemplary embodiment of the present invention.

Referring to FIG. 8A, the controller 180 may display each of the captured thumbnails generated through screen capturing for a certain window on the capture bar 50 located at the upper end of the screen. For example, the controller 180 may arrange the first capture thumbnail and the second capture thumbnail on the capture bar.

At this time, a plurality of screen windows 23, 33, and 43 are displayed on the screen 20 by the control unit 180. A plurality of screen windows (23, 33, 43) may be partially overlapped. In any one of the screen windows 23, 33, and 43, the captured captured object 21a can be displayed by the drag and drop input of the user.

The control unit 180 may receive the touch input of the user with respect to the first capture thumbnail 24a displayed on the capture bar 50. [ The control unit 180 may receive a drag and drop input 22 directed to the first capture thumbnail 24a into the second screen window 33 at the current location.

Referring to FIG. 8B, the controller 180 controls the first and second screen windows 23 and 24 by dragging and dropping the first capture thumbnail 24a to the second screen window 33, The first capture thumbnail 35 and the third capture thumbnail 35 are displayed on the capture bar 50. In this case, Accordingly, the first capture thumbnail 24a, the second capture thumbnail 34, and the third capture thumbnail 35 are displayed on the capture bar 50.

The control unit 180 displays the first capture thumbnail 24a, the second capture thumbnail 34, and the third capture thumbnail 35 in the capture bar 50 in the state illustrated in FIG. 8 (b) The user can receive the touch input of the cancel icon provided in the capture bar 50. [

The control unit 180 cancels the capture operation performed immediately before the touch button 50 receives the user's touch input for the cancel icon. The control unit 180 deletes the third capture thumbnail 35 displayed on the capture bar 50 from the capture bar 50 and deletes the captured image from the memory 160. [

The control unit 180 displays the first capturing thumbnail 24a, the second capturing thumbnail 34 and the third capturing thumbnail 35 on the capture bar 24a, The touch input of the user can be received.

When the control unit 180 receives the user's touch input for the end icon from the capture bar 50, the control unit 180 terminates the capture operation and deletes the capture bar from the screen.

FIG. 9 is a diagram illustrating an example of capturing a screen window, which has already been captured in a mobile terminal, into a single screen by combining other screen windows according to an exemplary embodiment of the present invention.

9A, the controller 180 displays the first capture thumbnail 24 generated through the screen capturing of the first screen window 23 in the first screen window 23 on which the screen capture is performed, .

At this time, a plurality of screen windows 23, 33, and 43 are displayed on the screen 20 by the control unit 180. A plurality of screen windows (23, 33, 43) may be partially overlapped. Any one of the screen windows 23, 33, and 43 may display a capture object 21 that can be moved by dragging and dropping input by a user at the time of screen capturing.

Referring to FIG. 9B, the controller 180 controls the first capture thumbnail 24 displayed on the first screen window 23 to display a drag-and-drop input from the current position to the second screen window 33 (22). Accordingly, the first capture thumbnail 24a can be moved in the second screen window 33. [

Referring to FIG. 9C, the controller 180 displays a second dragged-and-dropped second screen window 33 in the first screen window 23 already captured by the drag-and-drop screen window capture operation The second capture thumbnail 34 is generated and displayed on the screen 20. The second capture thumbnail 34 is displayed on the screen 20 as shown in FIG. At this time, the controller 180 may display the first capture thumbnail 24a and the second capture thumbnail 34 on the capture bar 50 located at the upper end of the screen 20. The controller 180 may arrange the first capture thumbnail 24a and the second capture thumbnail 34 on the capture bar 50 and display the same. However, the present invention is not limited thereto. For example, the capture bar may be formed at the lower end of the screen. For example, the first capture thumbnail 24a and the second capture thumbnail 34 may be displayed at any location on the screen 20, rather than the capture bar 50. [ The first capture thumbnail 24a and the second capture thumbnail 34 may be displayed according to a predetermined arrangement format. The first capture thumbnail 24a and the second capture thumbnail 34 may be respectively displayed on the first screen window 23 and the second screen window 33 captured without a certain array format. At this time, the capture object 21c may be displayed in any area of the screen 20 or in any one of the screen windows 23, 33, and 43 so that the position can be moved by dragging and dropping input by the user at the time of screen capturing.

Through such a user interface, the user can capture a single screen window by dragging and dropping the capture object into a window of a screen to be captured while a plurality of screen windows are displayed on the screen, and when a captured thumbnail of the captured screen window is displayed , Drag and drop the corresponding capture thumbnail to another screen window to perform a screen capture combining the second dragged and dropped screen window into the already captured first screen window, generate a second capture thumbnail, and then generate a plurality of capture thumbnails It is possible to confirm that the corresponding screen is captured through the ones displayed on the capture bar located at the upper end of the screen.

10 is a diagram illustrating a screen for explaining a note on a screen captured by a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 10A, the controller 180 may receive a long touch input 33b for an arbitrary area of the screen 20 or a capture thumbnail 33a displayed on the screen window 33. FIG. The control unit 180 may execute a memo function that can perform a memo on the image of the capture thumbnail when the long touch input 33b for the capture thumbnail 33a is present.

10B, the controller 180 receives the edit input from the user for the captured image 71 corresponding to the capture thumbnail 33a on the memo editing screen 70 according to the memo function executed, Perform editing. For example, the control unit 180 may receive an underline editing input from a user and generate an underline 71a in the captured image, or may perform image editing in which the content of the note is written. The control unit 180 reflects and stores the edited captured image 71. The control unit 180 may display a thumbnail 72 having a captured image 71 edited with a memo added thereto. For example, the control unit 180 may display a thumbnail 72 at the bottom of the screen and reflect the contents edited in the image editing window in real time. At this time, a selection box 73 may be displayed outside the thumbnail 72 to indicate that the thumbnail 72 corresponds to the captured image 71 being edited on the memo editing screen 70.

FIG. 11 is a diagram illustrating an example of executing a memo function when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 11A, the controller 180 may display a capture bar 50 having a plurality of capture thumbnails 24a, 34, and 35 arranged at the top of the screen. At this time, the capture object 21a may be positioned at any point on the screen and displayed.

Referring to FIG. 11 (b), the controller 180 controls the capture object 21a to display any one of the captured thumbnails 24a, 34, and 35 displayed on the capture bar 50 at the current position And receive a capture thumbnail, e.g., a drag and drop input 22, into the first capture thumbnail 24a.

Referring to FIG. 11 (c), the controller 180 displays a drag and drop input (FIG. 11 (b)) directed toward the first capture thumbnail 24a displayed on the capture bar 50 at the current position with respect to the captured object 21a displayed on the screen 22), the memo editing screen 70 is displayed by executing a memo function capable of memoing the captured image 71 of the first capture thumbnail 24a.

The control unit 180 receives the edit input from the user for the captured image 71 of the first capture thumbnail 24a on the memo editing screen 70 by the executed memo function, and performs image editing. The control unit 180 may display a plurality of capture thumbnails on the screen while the memo editing function for the selected first capture thumbnail 24a is performed. The control unit 180 displays a plurality of capture thumbnails 72, 74 and 75 at the bottom of the screen and displays a first captured thumbnail 73 selected from among the plurality of capture thumbnails 72, It is possible to adjust the transparency of the thumbnail or to display the selection box 73 in order to distinguish and display it, and to reflect the edited contents in the image editing window in real time.

The control unit 180 can change the capture thumbnail to be edited according to the selection signal input from the user in the plurality of capture thumbnails 72, 74, and 75 displayed on the capture bar arranged at the lower end of the screen, When selecting to switch to another capture thumbnail, the contents previously processed in the memo window can be reflected and stored in the capture thumbnail displayed on the capture bar.

The control unit 180 can receive a home key or a back button (not shown) for returning to the home screen on the memo editing screen 70. [

When a home key or a back button for returning to the home screen is inputted from the memo function screen, the control unit 180 displays the home screen on the screen and displays the captured thumbnails displayed on the memo editing screen 70 on the top of the home screen Can be displayed on a capture bar located on the screen. The capture bar located at the top of the home screen includes a first capture thumbnail, a second capture thumbnail, and a third capture thumbnail.

FIG. 12 is a diagram illustrating an example of executing a memo function when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 12A, the controller 180 may display a capture bar 50 having a plurality of capture thumbnails 24a, 34, and 35 arranged at the top of the screen. The first capture thumbnail 24a among the plurality of capture thumbnails 24a, 34 and 35 displays a selection box 24c indicating that the first capture thumbnail 24a has been selected by the user. At this time, the capture object 21a may be positioned at any point on the screen and displayed.

Referring to FIG. 12B, the controller 180 may receive the double-touch input 21c for the captured object 21a displayed on the screen.

Referring to FIG. 12C, when the double-touch input 21c is displayed on the captured object 21a displayed on the screen, the controller 180 displays a plurality of captured thumbnails The memo editing screen 70 can be displayed by executing a memo function for editing the first capture thumbnail 24a selected by the user from among the memos 24a, 34a, and 35a. Then, the control unit 180 receives the editing input from the user for the captured thumbnail image 71 on the memo editing screen 70 by the executed memo function, and performs image editing. The control unit 180 may display a plurality of thumbnails on the screen while the memo editing function for the selected first capture thumbnail 24a is performed. The control unit 180 displays a plurality of thumbnails 72, 74 and 75 at the bottom of the screen and displays a selection box 73 for distinguishing the currently selected first thumbnail 73 among the plurality of thumbnails, And the contents edited in the image editing window can be reflected in real time and displayed. The control unit 80 can change the capture thumbnail to be edited according to the selection signal input from the user among the plurality of capture thumbnails displayed on the capture bar arranged at the lower end of the screen.

13 is a diagram for explaining sharing of a captured image in a mobile terminal according to an exemplary embodiment of the present invention.

13 (a), the controller 180 displays a plurality of thumbnails 24a, 34, and 35 on the capture bar 50 located at the top of the screen, The touch input 51a can be received.

13 (b), when the control unit 180 receives a touch input for the sharing icon 51 from the capture bar 50 located at the top of the screen, the control unit 180 enlarges the capture bar 50 downward And displays it. The control unit 180 displays various shared application icons 52 for performing a sharing function on the extended capture bar 50a. The shared application icons 52 may include a text message, an email, a webmail, a memo application, various SNS applications, and a calendar application.

Referring to FIG. 13C, the controller 180 displays any captured thumbnails displayed on the capture bar for sharing any capture thumbnails, for example, And may receive a touch input 36 for a third capture thumbnail 35. Accordingly, the selection box 36a is displayed on the third capture thumbnail 35. [

Referring to FIG. 13D, the control unit 180 may be an arbitrary shared application to be used for sharing the third capture thumbnail 35 displayed in the extended capture bar 50a at the current position, for example, And a drag and drop input 22 to the note application 52.

13E, the control unit 180 performs an operation of attaching the captured image 35b corresponding to the third capture thumbnail 35 to the note application. When the captured image 35b is attached to the note image 35b, And displays it on the screen 70 of the application.

At this time, if there is a drag and drop input to the note application 52 with respect to the plurality of capture thumbnails 24a, 34, and 35 displayed in the capture bar 50 described with reference to FIG. 13 (a) An operation of attaching the captured images corresponding to the respective capture thumbnails to the execution screen of the note application may be performed and a screen window of the note application to which a plurality of captured images are attached may be displayed.

14 is a diagram for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 14A, the control unit 180 may display a capture bar 50 having a plurality of capture thumbnails 24a, 34, and 35 arranged at the top of the screen. The capture bar may include a share icon, a cancel icon, and an exit icon.

The control unit 180 can display a lower menu bar 81 having a plurality of application icons arranged at the lower end of the screen. The lower menu bar 81 may include a phone icon, an address book icon, a message icon 81a, and a menu icon. The lower menu bar 81 may also include icons for executing notes, e-mail, and chat functions.

The control unit 180 can execute the telephone function if there is an execution request for the telephone icon. The control unit 180 may execute the address book application if there is an execution request for the address book icon. The control unit 180 can execute a text message function if there is an execution request for the message icon. The control unit 180 can display various applications on the screen by executing a menu function if there is an execution request for the menu icon.

Referring to FIG. 14B, the controller 180 controls the first capture thumbnail 24a displayed on the capture bar 50 located at the upper end of the screen to display application icons located in the lower menu bar 81 at the current position For example, a drag and drop input 22 to the message icon 81a with any application icon to be used for attachment in the message icon 81a.

Referring to FIG. 14C, the controller 180 executes a text sending application corresponding to the message icon 81a and attaches a captured image corresponding to the first captured thumbnail to the executed text sending application And displays a character creation screen 80 to which the captured image 24c is attached.

At this time, if there is a drag and drop input to the message icon 81a with respect to the plurality of capture thumbnails 24a, 34, and 35 displayed in the capture bar 50 described in FIG. 14B, The captured images corresponding to the respective capture thumbnails may be attached to the character sending application and a plurality of captured images may be displayed on the character creating screen 80 of the attached character sending application. The control unit 180 can input text to the user through the keyboard 82 on the character creation screen 80 and create a character.

FIG. 15 is a diagram illustrating a screen for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 15 (a), the controller 180 may display a capture bar 50 having a plurality of capture thumbnails 24a, 34, and 35 arranged at the top of the screen. The capture bar may include a share icon, a cancel icon, and an exit icon. The control unit 180 may receive the first capture thumbnail 24a displayed on the capture bar and the drag input 22 in the downward direction by the user's multi-touch on the third capture thumbnail 35. [

Referring to FIG. 15B, the controller 180 displays the first capture thumbnail 24a and the third capture thumbnail 35 displayed on the capture bar 50 in a downward direction According to the input 22, the capture bar 50 displayed at the top of the screen is extended downward and displayed. At this time, the control unit 180 displays the capture thumbnails, the sharing icon, the cancel icon, and the end icon displayed at the top of the screen at the lower end of the extended capture bar 50a, and displays various shared applications On the screen. The shared application icons 52 may include a text message, an e-mail, a web mail, a memo application 52a, various SNS applications, and a calendar application.

Referring to FIG. 15 (c), the control unit 180 displays one or a plurality of captured thumbnails displayed on the capture bar for sharing an arbitrary capture thumbnail, for example, For example, the first capture thumbnail 24a and the third capture thumbnail 35 may receive a touch input 22a for selection. Accordingly, the control unit 180 displays through the selection box 22b that the first capture thumbnail 24a and the third capture thumbnail 35 have been selected. In the above description, the capture thumbnails are selected by the touch input 22a for the first capture thumbnail 24a and the third capture thumbnail 35, but the present invention is not limited thereto. In another embodiment of the present invention, at the time of the drag input 22 in the downward direction by the multi-touch of the user with respect to the first capture thumbnail 24a and the third capture thumbnail 35 in FIG. 15A, Thumbnails may be implemented as selected. In this case, if there is a separate touch input 22a, it can be operated by being released from selection. If it is desired to select again in the released state, it is possible through the separate touch input 22a.

15D, when the first capture thumbnail 24a and the third capture thumbnail 35 displayed on the capture bar are selected, the control unit 180 displays an arbitrary shared application to be used for sharing, for example, The user can receive the touch input 22c for the note application 52a.

15E, when the controller 180 receives the touch input for the note application, the controller 180 displays the captured images 24c and 35a corresponding to the first capture thumbnail 24a and the third capture thumbnail 35, To the executed notebook application, and displays the screen 70 of the notebook application to which the captured images are attached. For example, the controller 180 arranges the captured images 24c and 35a corresponding to the first capture thumbnail 24a and the third capture thumbnail 35 one by one in the screen 70 of the note application, Can be displayed.

At this time, if one of the plurality of capture thumbnails displayed on the capture bar described in (d) of FIG. 13 is selected, the control unit 180 displays a captured image corresponding to the captured thumbnails as a note application The user can perform an operation of attaching the program to the execution screen. The control unit 180 may additionally attach a capture image corresponding to the capture thumbnail to the execution screen of the note application when the note application is touched after another capture thumbnail is additionally selected.

16 is a diagram for explaining a function of attaching a captured image to an arbitrary application when a capture bar is formed in a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 16A, the controller 180 controls the first capture thumbnail 24a and the third capture thumbnail 35 displayed on the capture bar according to a drag input in the downward direction by the user's multi-touch, The capture bar displayed at the top of the screen is extended downward and displayed. At this time, the control unit 180 displays capture thumbnails, a sharing icon, a cancel icon, and a termination icon at the bottom of the extended capture bar, and displays various shared application icons 52 for performing a sharing function on the screen Display. Shared application icons may include text messages, email, web mail, memo applications, various SNS applications, and calendar applications.

The control unit 180 may display a capture object 21a capable of performing a memo function on captured thumbnails on the screen.

The control unit 180 displays one or a plurality of capture thumbnails, for example, a first capture thumbnail 24a and a third capture thumbnail 24a displayed on the capture bar for sharing an arbitrary capture thumbnail, The user can receive a touch input for selection with respect to the touch panel 35. Accordingly, the control unit 180 displays through the selection box 22b that the first capture thumbnail 24a and the third capture thumbnail 35 have been selected.

16B, when the first capture thumbnail 24a and the third capture thumbnail 35 displayed on the capture bar are selected, the control unit 180 displays the captured object 21a for performing the memo function The user can receive the double touch input 22d.

Referring to FIG. 16C, when the controller 180 receives the double-touch input 22d for the capture object 21a, the controller 180 determines whether the captures corresponding to the first capture thumbnail 24a and the third capture thumbnail 35 It is possible to display the first captured image 24c and the third captured image 35a on the screen by executing the memo function for editing the images 24c and 35a. For example, the control unit 180 displays captured images 24c and 35a corresponding to the first capture thumbnail 24a and the third capture thumbnail 35 one by one in the memo screen 70 .

The control unit 180 displays a first capture thumbnail 24d and a third capture thumbnail 35b at the lower end of the screen.

The control unit 180 may receive the edit input from the user for the first captured image 24c displayed on the memo screen 70 and perform image editing. When the editing operation of the user is performed on the first captured image 24c, the control unit 180 displays the editing operation performed in the first captured image 24c in real time in the first captured thumbnail 24d displayed on the capture bar And reflects it.

The control unit 180 may receive the edit input from the user for the third captured image 35a displayed in the memo editing window and perform image editing. When the editing operation of the user is performed with respect to the third captured image 35a, the control unit 180 displays the editing operation performed in the third captured image 35a in real time in the third captured thumbnail 35b displayed in the capture bar And reflects it.

The control unit 180 may receive a home key or a back button (not shown) for returning to the home screen from the memo screen 70. [

When a home key or a back button for returning to the home screen is inputted from the memo screen 70, the controller 180 displays the home screen on the screen, and displays the captured thumbnails displayed on the memo screen 70 on the home screen It is displayed on the capture bar located at the top. A capture bar located at the top of the home screen may include a first capture thumbnail and a third capture thumbnail that were edited in FIG. 16 (c).

According to an embodiment of the present invention, the above-described method can be implemented as a code readable by a processor on a medium on which a program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims and the claims.

Claims (21)

A display unit for displaying a plurality of screen windows and a capture object for screen capture on a screen; And
When a plurality of screen windows are displayed on the screen of the display unit and the captured object is moved on the screen by a preset touch input from the user and positioned in one or a plurality of screen windows, And a control unit. The apparatus of claim 1, wherein the control unit displays a status display bar at the top of the screen, generates a capture object for capturing the screen if there is a preset touch input for the capture menu icon provided on the status display bar, . The terminal of claim 1, wherein the capture object is a capture icon or a capture widget. The terminal as claimed in claim 1, wherein the control unit performs screen capturing of the screen window when the capture object is moved on the screen and positioned in one or a plurality of screen windows by a drag and drop input from the user. The apparatus of claim 4, wherein the control unit forms a pop-up window for confirming whether the captured object is captured when the captured object is moved on the screen by one of a drag and drop input from the user and positioned in one or a plurality of screen windows, . The apparatus of claim 5, wherein the controller is further configured to select a single screen window from among a plurality of screen windows displayed on the screen of the display unit, or to select a plurality of screen windows, A terminal that displays a popup window. The terminal according to claim 4, wherein the controller forms and displays a capture thumbnail of a screen window captured at a place where the capture object is located in the screen window after capturing the screen. The terminal according to claim 7, wherein the controller forms a capture bar in a partial area of a screen when a plurality of captured screens are displayed, and arranges and displays a plurality of capture thumbnails formed on the capture bar. The apparatus of claim 8, wherein when the first capture thumbnail formed on the captured first screen window is located in a second screen window partially overlapped with the first screen window by a drag and drop input from the user, A second capture thumbnail is formed, a capture bar is formed in a partial area of the screen, and the first capture thumbnail and the second capture thumbnail are arranged and displayed on the capture bar, . 8. The method of claim 7, wherein the control unit displays an edit screen for editing a captured image if the captured thumbnail formed in the captured screen window has a preset touch input, and when the user edits the captured image, A terminal that stores captured images. The apparatus of claim 8, wherein when the capture object displayed on the screen is dragged and dropped on the capture bar, the controller displays an edit screen for a plurality of capture thumbnails arranged in the capture bar, A terminal that stores edited and edited capture images. The apparatus of claim 8, wherein, when there is a double-touch input for a captured object displayed on the screen, the controller displays an editing screen for a plurality of captured thumbnails arranged in the capture bar, And stores the edited captured image. The apparatus of claim 1, wherein when the capture object is moved on the screen by a drag input from the user and positioned in one of the plurality of screen windows overlapping with each other, And controlling a transparency of another screen window to display a screen window on which the captured object is located, without covering the screen window with the other screen window. 14. The method according to claim 13, wherein when the control unit displays a screen window on which the captured object is located among the plurality of screen windows on the screen without covering the screen window with the other screen window, . The apparatus of claim 8, wherein the controller is further configured to cause the first capture thumbnail corresponding to the first screen window captured from the plurality of capture thumbnails displayed on the capture bar to be partially overlapped with the first screen window by the drag- The first capture thumbnail and the second capture thumbnail are arranged on the capture bar to form a second capture thumbnail, and the first capture thumbnail and the second capture thumbnail are displayed on the capture bar, . 9. The apparatus according to claim 8, wherein the controller displays an edit screen for editing a first capture thumbnail selected from a plurality of capture thumbnails displayed on the capture bar, edits the first captured image according to a user's edit, Stores the edited first captured image and displays a first captured thumbnail corresponding to the edited first captured image on the capture bar when a second captured thumbnail is selected in the capture bar. The method as claimed in claim 8, wherein the capture bar includes a sharing icon, and the control unit changes the position of the capture bar so that the capture bar is expanded when the execution icon has the execution input, A shared application menu icon for sharing an image captured in a region of the captured image, and when any capture thumbnail among a plurality of captured thumbnails displayed on the capture bar is dragged and dropped onto the shared application menu icons, A terminal that shares a captured image through a corresponding shared application. 18. The apparatus of claim 17, wherein when the plurality of capture thumbnails among the plurality of capture thumbnails displayed on the capture bar are dragged and dropped onto the shared application menu icons, the control unit attaches a plurality of captured images corresponding to the captured thumbnails to the corresponding shared application terminal. The method as claimed in claim 8, wherein the controller displays the capture bar on a first area of the screen, arranges application menu icons for sharing the plurality of capture thumbnails on a second area of the screen, And the captured image corresponding to the captured thumbnail is shared through the corresponding shared application when the application icon is dragged and dropped onto an application icon among the application menu icons. The apparatus of claim 8, wherein the control unit controls the capture bar such that a plurality of capture thumbnails displayed on the capture bar are selected for sharing by the multi-touch of the user and are dragged in an arbitrary direction, And displays shared application menu icons for sharing the captured image in an area of the extended capture bar. When an arbitrary shared application menu icon is selected, a plurality of capture images corresponding to the selected plurality of capture thumbnails A terminal that attaches an image to a corresponding shared application. The apparatus of claim 20, wherein the controller is configured to share a first capture thumbnail and a second capture thumbnail among a plurality of capture thumbnails displayed on the capture bar, and when the memo application object is selected, And arranging and displaying the corresponding first captured image and the second captured image, respectively.

Images