KR102188265B1 - Terminal and method for controlling the same - Google Patents

Abstract

In the present invention, two or more first and second content provided by a currently executed application and displayed in a window independent from each other in the application are displayed together on one screen, and two or more first and second applications are multitasked. In a state, the present invention relates to a portable terminal for displaying a first and a second application together on one screen, and a control method thereof.

Description

Mobile terminal and its control method {TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a portable terminal and a method of controlling the same, in which the user's convenience is further considered and the use of the terminal can be implemented.

Terminal can be moved Depending on whether or not it can be divided into a mobile terminal (mobile/portable terminal) and a stationary terminal (stationary terminal). Again, the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the functions are diversified, such a terminal is in the form of a multimedia player with complex functions such as, for example, taking photos or videos, playing music or video files, and receiving games and broadcasts. It is being implemented.

In recent years, as the smartphone market has rapidly expanded, the number of users of smartphones has increased accordingly, and due to the various functions of smartphones, the daily life of smartphone users has come a step further.

A smartphone is equipped with a number of applications that provide various functions, and a user can use various functions through the applications.

However, as the functions of the application are diversified, there is an inconvenient problem in that a user must switch a window or scroll a window each time to view various information provided by the application while using the current application.

In addition, in a state in which two or more of the first and second applications are multitasked, there is an inconvenient problem in that the window of the first application must be switched to the window of the second application every time to view the second application while using the first application.

An object of the present invention is to provide a portable terminal and a method for controlling the same for displaying two or more first and second content provided by a currently executed application and displayed in windows independent from each other in the application.

Still another object of the present invention is to provide a portable terminal for displaying a first and a second application together on one screen in a state in which two or more first and second applications are multitasked, and a control method thereof.

A portable terminal according to the present invention for achieving the above objects includes: a memory having one or more applications; A display unit for displaying a first application among the applications on a screen; When a command to simultaneously display two or more first and second content included in the first application on the display unit is input, the screen is divided into regions in which the two or more first and second content will be displayed, respectively And a control unit for controlling the display of the two or more first and second contents in each of the divided regions.

In addition, a method of controlling a portable terminal according to the present invention includes the steps of displaying a first application on a screen; When a command to simultaneously display two or more first and second content included in the first application on the display unit is input, the screen is divided into regions in which the two or more first and second content will be displayed, respectively And; And displaying the two or more first and second content in each of the divided regions.

The portable terminal and its control method according to the present invention provide the following effects.

First, by displaying two or more first and second contents provided by the currently executed application and displayed in windows independent from each other on one screen, the user can change the first and second contents on one screen without changing other windows. There is an effect that the second content can be used together.

Second, by displaying two or more first and second applications currently multitasking together on one screen, there is an effect that a user can use the first and second applications together on one screen without changing a window.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a portable terminal according to an embodiment of the present invention.
3 is a front view of the portable terminal for explaining an operating state of the portable terminal related to the present invention.
4 is a flowchart of a first embodiment showing a control process of a portable terminal according to the present invention.
5 to 12 are explanatory diagrams illustrating a first embodiment of a control process of a portable terminal according to the present invention.
13 is a flowchart of a second embodiment showing a control process of a portable terminal according to the present invention.
14 to 17 are diagrams illustrating a second embodiment of a control process of a mobile terminal according to the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in more detail with reference to the drawings. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

The portable terminal described herein may include a mobile phone, a smart phone, a laptop computer, a terminal for digital broadcasting, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation system, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to a fixed terminal such as a digital TV or a desktop computer, except when applicable only to a portable terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The portable terminal 100 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the control unit 180, and the power supply unit 190 may be included. Since the components shown in FIG. 2 are not essential, a mobile terminal having more components or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the portable terminal 100 and a wireless communication system or between the portable terminal 100 and a network in which the portable terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The broadcast reception module 111 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 includes, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcasting (DVB-H). -Handheld), ISDB-T (Integrated Services Digital Broadcast-Terrestrial), and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast reception module 111 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the portable terminal 100. Wireless Internet technologies include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE (Long Term). Evolution) (but not limited to), and the like may be used.

From the point of view that wireless Internet access through Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc. is made through a mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module. It may be understood as a kind of (112).

The short-range communication module 114 refers to a module for short-range communication. As short range communication technology, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for acquiring the location of the portable terminal 100, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 2, an audio/video (A/V) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, or the like and processes it as electrical voice data. In the case of a call mode, the processed voice data may be converted into a format that can be transmitted to a mobile communication base station through the mobile communication module 112 and then output. Various noise removal algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (positive pressure/power failure), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects the current state of the mobile terminal 100, such as an open/closed state of the mobile terminal 100, the position of the mobile terminal 100, whether a user is in contact, the orientation of the mobile terminal, and acceleration/deceleration of the mobile terminal. Thus, a sensing signal for controlling the operation of the mobile terminal 100 is generated. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it is also possible to sense whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to visual, auditory, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, a haptic module 154, and a projector module ( 155) and the like may be included.

The display unit 151 displays (outputs) information processed by the portable terminal 100. For example, when the mobile terminal 100 is in a call mode, a user interface (UI) or a graphical user interface (GUI) related to a call is displayed. When the portable terminal 100 is in a video call mode or a photographing mode, a photographed or/and received image, UI, or GUI is displayed.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display) and a 3D display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmission type structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist depending on the implementation type of the portable terminal 100. For example, in the portable terminal 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

When the display unit 151 and a sensor (hereinafter referred to as'touch sensor') for detecting a touch motion form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 151 It can also be used as an input device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only a touched position and area, but also a pressure at the time of touch.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in an inner area of the portable terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. Proximity sensors have a longer lifespan and higher utilization than contact sensors.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is capacitive, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". A position at which a proximity touch is performed by a pointer on the touch screen means a position at which the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed in the portable terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event in the portable terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, by vibration. The video signal or audio signal may also be output through the display unit 151 or the audio output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 is used for stimulation such as an arrangement of pins that move vertically with respect to the contact skin surface, a blowing force or suction force of air through a jet or inlet, a grazing on the skin surface, contact of an electrode, electrostatic force, etc. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element.

The haptic module 154 may not only transmit a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 154 may be provided depending on the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the portable terminal 100, and is the same as an image displayed on the display unit 151 according to a control signal from the controller 180 Or, at least some of the other images may be displayed on an external screen or wall.

Specifically, the projector module 155 generates an image to be output to the outside by using a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, and light generated by the light source. It may include an image generating means (not shown) for performing and a lens (not shown) for expanding the image to the outside at a predetermined focal length. In addition, the projector module 155 may include a device (not shown) capable of adjusting an image projection direction by mechanically moving a lens or the entire module.

The projector module 155 may be divided into a cathode ray tube (CRT) module, a liquid crystal display (LCD) module, a digital light processing (DLP) module, and the like according to the device type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by expanding and projecting an image generated by reflecting light generated from a light source onto a digital micromirror device (DMD) chip.

Preferably, the projector module 155 may be provided on the side, front, or rear of the portable terminal 100 in the longitudinal direction. Of course, it is natural that the projector module 155 may be provided at any position of the mobile terminal 100 as necessary.

The memory unit 160 may store a program for processing and control of the controller 180, and temporarily store input/output data (eg, a phone book, a message, an audio, a still image, a video, etc.) It can also perform a function for. The memory unit 160 may also store a frequency of use for each of the data (eg, a frequency of use for each phone number, each message, and each multimedia). In addition, the memory unit 160 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (Random Access Memory, RAM), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The portable terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 over the Internet.

The interface unit 170 serves as a passage for all external devices connected to the portable terminal 100. The interface unit 170 receives data from an external device, receives power, and transmits it to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio input/output (I/O) port, A video input/output (I/O) port, an earphone port, etc. may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the right to use the mobile terminal 100, and includes a user identification module (UIM), a subscriber identification module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module, USIM), etc. may be included. A device equipped with an identification module (hereinafter,'identification device') may be manufactured in the form of a smart card. Therefore, the identification device can be connected to the terminal 100 through the port.

When the portable terminal 100 is connected to an external cradle, the interface unit serves as a passage through which power from the cradle is supplied to the portable terminal 100, or various command signals input from the cradle by a user are transmitted to the portable terminal 100. It may be a passage that is transmitted to the terminal 100. Various command signals or the power input from the cradle may be operated as signals for recognizing that the portable terminal 100 is correctly mounted on the cradle.

The controller 180 generally controls the overall operation of the portable terminal 100. For example, it performs related control and processing for voice calls, data communication, and video calls. The controller 180 may also include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for the operation of each component.

The battery may be a built-in battery made to be rechargeable, and may be detachably coupled to the body of the portable terminal 100 for charging or the like. The connection port may be configured as an example of the interface unit 170 to which an external charger that supplies power for charging the battery is electrically connected.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions, in some cases herein. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. The software code can be implemented as a software application written in an appropriate programming language. The software code may be stored in the memory 160 and executed by the controller 180.

The portable terminal referred to in this specification may include at least one of the components illustrated in FIG. 1. In addition, the controller 180 may control an individual operation of a component or a cooperative operation between a plurality of components in order to perform an operation using a component (eg, a touch screen, a wireless communication unit, a memory, etc.).

In an embodiment of the present invention, a touch gesture refers to a gesture implemented by touching or proximity touching on the display unit 151 of a touch screen type, and a touch input refers to an input received by a touch gesture.

Touch gestures are tapping, touch & drag, flicking, press, multi-touch, pinch in, and pinch out depending on the motion. It is divided into etc.

Tapping is an operation of lightly pressing and releasing the display unit 151 once, and refers to a touch gesture such as a click of a mouse in a general personal computer.

In addition, the touch drag is an operation of moving to a specific location while maintaining the touch of the display unit 151 and then removing the object. When an object is dragged, the object may be continuously moved and displayed according to the dragging direction.

In addition, flicking refers to an operation of touching the display unit 151 and then moving in a specific direction (up, down, left, right, or diagonal) and then removing the contact point, and the mobile terminal 100 touches the touch input by flicking. When this is received, processing of a specific operation is performed based on the flicking direction and speed. For example, based on the flicking direction, a page turning operation of a document/webpage/specific screen may be performed.

In addition, press refers to an operation of continuously maintaining the touch for more than a preset time after touching the display unit 151.

In addition, multi-touch refers to an operation of simultaneously touching a plurality of points of the display unit 151.

Further, the pinch-in refers to an operation of dragging a plurality of pointers on the display unit 151 in a direction in which the multi-touch pointers are closer to each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched on the display unit 151 and occurs in a direction in which a plurality of points that are multi-touched are close to each other.

Further, the pinch-out refers to an operation of dragging a plurality of pointers on the display unit 151 in a direction away from each other. That is, it means a drag that starts from at least one of a plurality of points that are multi-touched on the display unit 151 and occurs in a direction in which the plurality of points that are multi-touched are separated from each other.

2 is a front perspective view of an example of a portable terminal related to the present invention.

The disclosed portable terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are coupled so as to be relatively movable.

The body includes a case (casing, housing, cover, etc.) forming the exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102.

The cases may be formed by injection of synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti).

A display unit 151, an audio output unit 152, a camera 121, a user input unit 130/131 and 132, a microphone 122, an interface 170, etc. may be disposed on the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. An audio output unit 151 and a camera 121 are disposed in an area adjacent to one end of the display unit 151, and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of manipulation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as a manipulating portion, and any method may be employed as long as the user operates while having a tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first manipulation unit 131 receives commands such as start, end, scroll, and the like, and the second manipulation unit 132 adjusts the size of the sound output from the sound output unit 152 or the display unit 151 A command such as switching to the touch recognition mode of) can be input.

An antenna 116 for receiving broadcast signals may be additionally disposed on the side of the terminal body in addition to an antenna for a call. The antenna 116 forming a part of the broadcast receiving module 111 (refer to FIG. 2) may be installed to be retractable from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body, or may be configured to be directly detachable from the outside of the terminal body.

Hereinafter, a method of operating the display unit 151 and the touch pad 135 related to each other will be described with reference to FIG. 3.

3 is a front view of the portable terminal for explaining an operating state of the portable terminal related to the present invention.

Various types of visual information may be displayed on the display unit 151. These information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

In order to input such information, at least one of the letters, numbers, symbols, graphics, and icons may be displayed in a certain arrangement, thereby being implemented in the form of a keypad. Such a keypad may be referred to as a so-called'virtual keypad'.

3 shows that a touch applied to a virtual keypad is input through the front of the terminal body.

The display unit 151 may operate as an entire area, or may be divided into a plurality of areas and operated. In the latter case, the plurality of regions may be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. On the input window 151b, a virtual keypad 151c displaying numbers for inputting a phone number or the like is output. When the virtual keypad 151c is touched, a number corresponding to the touched virtual keypad is displayed on the output window 151a. When the first manipulation unit 131 is operated, a call connection to the phone number displayed on the output window 151a is attempted.

In addition, the display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling. By scrolling the display unit 151 or the touch pad 135, the user may move an object displayed on the display unit 151, for example, a cursor or a pointer positioned on an icon. Furthermore, when the finger is moved on the display unit 151 or the touch pad 135, a path of the finger movement may be visually displayed on the display unit 151. This will be useful for editing an image displayed on the display unit 151.

In response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a certain time range, a function of the terminal may be executed. In the case of touching together, there may be a case in which the user clamps the terminal body using the thumb and index finger. The one function may be, for example, activation or deactivation of the display unit 151 or the touch pad 135.

For convenience of description, it is assumed that the portable terminal 100 described below includes at least one of the components shown in FIG. 1.

Also, a graphic in the form of a highlight, an arrow, or a finger for pointing to a specific object or selecting a menu on the display unit 151 is usually referred to as a pointer or a cursor.

However, in the case of a pointer, it is often used interchangeably to mean a finger or a stylus pen for touch manipulation or the like. Therefore, in this specification, in order to clearly distinguish the two, a graphic displayed on the display is referred to as a cursor, and a physical means such as a finger or a stylus pen that can perform a touch, a proximity touch, or a gesture is referred to as a pointer.

Hereinafter, a control process of the mobile terminal according to the present invention will be described in detail with reference to FIGS. 4 to 17.

First, a first embodiment of the present invention will be described in detail with reference to FIGS. 4 to 12 below.

[No. 1 Example ]

The first embodiment of the present invention shows a process of displaying two or more first and second contents provided by a currently executed application and displayed in windows independent from each other in the application together on one screen.

4 is a flow chart of a first embodiment showing a control process of a portable terminal according to the present invention.

5 to 12 are explanatory diagrams illustrating a first embodiment of a control process of a portable terminal according to the present invention.

4 to 12, when an execution command of a specific first application is input from a user through the user input unit 130 or the touch screen 151, in response to the execution command, the controller 180 1 The application is executed, and the execution screen of the first application is displayed on the touch screen 151 [S110].

In this case, the first application is provided in the memory 160 and performs a specific function and provides a plurality of content information related to the specific function.

As an example, the first application may be a messenger for chatting with a plurality of partners, and in this case, the content information provided by the first application may be a chat window including chat contents with each of the plurality of partners. have.

As another example, the first application may be a web browser, and in this case, the content information provided by the first application may be a plurality of web pages included in the web browser.

As another example, the first application may be a media player, and in this case, the content information provided by the first application may be a plurality of media playable through the media player. In addition, the media may include broadcasts, images, and videos.

As another example, the first application includes a photographing function of a first camera provided on the front side of the mobile terminal and a second camera provided on the back side of the mobile terminal, in this case, content provided by the first application The information may be first and second images input through the first and second cameras.

Of course, the type of the first application and the content information provided by the first application are not limited as described above, but may include all content information provided by all applications that can be installed and used in the mobile terminal 100. .

The controller 180 receives two or more first and second content information provided by the first application from the user through the user input unit 130 or the touch screen 151 while displaying the execution screen of the first application. At the same time, when a command for displaying together on the execution screen is input [S120], the screen of the touch screen 151 is divided into areas in which the two or more first and second content information will be displayed [S130], and the The first and second content information is displayed in each of the divided regions [S140].

As an example, FIGS. 5 to 8 illustrate that the first application is a messenger, and first and second content information provided by the first application is content of conversations with first and second counterparts.

That is, as shown in (a) of FIG. 5, in a state in which the messenger is driven and the chat content 310A with the first counterpart is displayed through the messenger, the controller 180 2 When the chat contents 310B are received from the other party, an icon 210 assigned with the function of displaying the chat contents 310A and 310B of the first and second parties on one screen is displayed.

In addition, when the icon 210 is selected, the controller 180 displays the screen of the touch screen 151 as shown in FIG. 5(b), and the chat contents 310A and 310B of the first and second counterparts. ) Is divided into first and second areas to be displayed, and chat contents 310A and 310B of the first and second counterparts are displayed in each of the divided first and second areas.

In this case, if the display mode of the touch screen 151 is a vertical mode as shown in FIG. 5, the controller 180 divides the screen into an upper area and a lower area, and the display mode of the touch screen 151 In the horizontal mode, the screen may be divided into a left area and a right area.

In addition, the icon 210 may be replaced with a notification window notifying that the chat content 310B has been received from the second party, or notification information indicating the reception may be displayed in the icon 210.

In addition, the controller 180 displays the chat content 310A with the first partner through the messenger, and when the chat content 310B is received from the second party through the messenger, the icon 210 is displayed. And without a selection operation, dividing the screen of the touch screen 151 into the first and second regions, and chatting contents 310A and 310B of the first and second counterparts in each of the divided first and second regions. You can also display each. At this time, the controller 180 displays the chat contents 310B of the second party, whose chat has started most recently, in the lower area of the divided areas by default, and communicates with the first party who has previously chatted. Chat content 310A may be displayed in the upper area.

In addition, the controller 180 may display a first window including the chat content 310A with the first party and a second window including the chat content 310B with the second party as independent windows in the messenger. When the icon 210 is selected in the state, the screen of the touch screen 151 is divided into the first and second regions, and the first and second counterparts chat in each of the divided first and second regions. Contents 310A and 310B may be displayed respectively.

In addition, when the first window including the chat content 310A with the first partner and the second window including the chat content 310B with the second partner are displayed in the messenger, the controller 180 Without the display and selection operation of 210, the screen of the touch screen 151 is divided into the first and second regions, and the chat contents of the first and second counterparts in each of the divided first and second regions (310A, 310B) can also be displayed respectively. At this time, the controller 180 displays the chat contents 310B of the second party, whose chat has started most recently, in the lower area of the divided areas by default, and communicates with the first party who has previously chatted. Chat content 310A may be displayed in the upper area. In addition, the controller 180 may display, by default, a window containing the chat contents of the other party, which has the most typing operation among the chat contents 310A and 310B of the first and second parties, in the lower area of the divided areas. have.

Next, as shown in (a) of FIG. 6, while the messenger is driven and the chat content 310A with the first counterpart is displayed through the messenger, the controller 180 When the chat content 310B is received from the second partner through, a UI (User Interface) 220 for designating an area in which the chat content 310A and 310B with the first and second parties will be displayed, respectively, is displayed, When an area in which at least one of the chat contents 310A and 310B with the first and second counterparts is to be displayed is designated through the UI, as shown in Figs. 6B and 6C, the touch screen The screen of 151 is divided into the first and second areas, and chat contents 310A and 310B with the first and second parties are displayed in the designated area among the divided first and second areas. .

For example, in (b) of FIG. 6 shows that the lower area of the divided areas is designated and displayed as an area to display the chat content 310A with the first party through the UI 220, and FIG. 6 In (c) of, the upper area of the divided areas is designated and displayed as an area in which the chat contents 310A with the first counterpart will be displayed through the UI 220.

Next, as shown in (a) of FIG. 7, the controller 180 displays the chat contents 310A of the first and second counterparts on the screen of the touch screen 151 according to FIGS. 4 to 6. When the first and second windows each including 310B) are displayed together, as shown in FIG. 7(b), the first and second keypads for inputting chat contents on the first and second windows respectively (311A, 311B) can be displayed and provided to the user.

For example, when an input window for inputting chat content in the first and second windows is selected, respectively, the controller 180 may display the first and second keypads 311A and 311B.

Next, as shown in (a) of FIG. 8, the controller 180 is in a horizontal mode of the touch screen 151, so that the screen is divided into a left area and a right area, and the first and second counterparts The first and second windows each including the chat contents 310A and 310B are displayed in the left and right areas, respectively, and as shown in FIG. 8B, on the first and second windows A third keypad 311 for inputting chat content to be transmitted to the first and second counterparts may be displayed and provided to the user.

Next, as shown in FIG. 9, the controller 180 places the icon 210 and UI 220 described in FIGS. 5 and 6 into the notification bar 200 of the mobile terminal 100. Display, and the user manipulates the icon 210 and the UI 220 on the notification bar 200 to display chat contents 310A and 310B with the first and second counterparts together on the screen. have.

The notification window 200 includes various operation states of the mobile terminal 100, events currently occurring in the mobile terminal (for example, message reception, application update news, alarms, etc.), and various function setting UIs of the mobile terminal (for example, Wi-Fi on/off, Bluetooth on/off, GPS on/off, etc.).

As another example, FIG. 10 is a web browser 320 in which the first application provides a plurality of web pages to a user, and first and second content information provided by the first application is provided by the web browser 320. It shows that it is the 1st and 2nd web pages 320A, 320B.

That is, as shown in (a) of FIG. 10, the control unit 180 drives the web browser 320, and the first web page 320A is displayed through the web browser 320 by the user's manipulation. In the displayed state, when the second web page 320B is displayed through the web browser 320 by the user's manipulation, the function of displaying the first and second web pages 320A and 320B on one screen is provided. The assigned icon 210 or UI 220 is displayed. For example, in (a) of FIG. 10, the UI 220 is displayed.

In addition, when an area in which at least one of the first and second web pages 320A and 320B is to be displayed is designated through the UI 220, the controller 180, as shown in FIG. 10B, The screen of the touch screen 151 is divided into the first and second areas, and the first and second web pages 320A and 320B are displayed in the designated area among the divided first and second areas. .

For example, as shown in (a) of FIG. 10, the controller 180 designates an upper area among the divided areas as an area in which the first web page 320A will be displayed through the UI 220, , When the lower area of the divided areas is designated as the area in which the second web page 320B will be displayed through the UI 220, as shown in FIG. 10(b), the divided upper area and the The first and second web pages 320A and 320B are displayed in each of the lower areas.

At this time, when the second web page 320B is additionally displayed while the first web page 320A is displayed through the web browser 320, the control unit 180, the icon 210 or the UI ( 220), the screen of the touch screen 151 is divided into the first and second regions, and the first and second web pages 320A, respectively, in the divided first and second regions, 320B) may be displayed respectively. At this time, the controller 180 displays the most recently displayed second web page 320B in the lower area of the divided areas by default, and displays the previously displayed first web page 320A in the upper area. May be.

In addition, the controller 180 is in a state in which the first window including the first web page 320A and the second window including the second web page 320B are displayed as independent windows in the web browser 320 When the icon 210 is selected, the screen of the touch screen 151 is divided into the first and second regions, and the first and second web pages 320A, respectively, are divided into the divided first and second regions. 320B) may be displayed respectively.

In addition, when the first window including the first web page 320A and the second window including the second web page 320B are displayed as separate windows in the web browser 320, the controller 180 Without displaying and selecting the icon 210 or the UI 220, the screen of the touch screen 151 is divided into the first and second regions, and the first and second regions are respectively And the second web pages 320A and 320B, respectively. At this time, the controller 180 displays the most recently displayed second web page 320B in the lower area of the divided areas by default, and displays the previously displayed first web page 320A in the upper area. May be. In addition, the controller 180 may display, by default, a web page in which typing operation is performed most among the first and second web pages 320A and 320B in a lower area of the divided areas.

As another example, FIG. 11 is a media player 330 capable of playing a plurality of media in the first application, and first and second content information provided by the first application is playable through the media player 330. It has shown that it is the 1st and 2nd media 330A, 330B.

In this case, the first and second media 330A and 330B are included in a folder in which media provided in the memory 160 are stored, and the media player 320 may play all media stored in the folder. In addition, the first and second media 330A and 330B include all data capable of at least one of an image display and an audio output in the mobile terminal 100, for example, the first and second media 330A , 330B) includes video, broadcast, photo, document, and the like.

That is, as shown in (a) of FIG. 11, the controller 180 drives the media player 330, and plays the first media 330A through the media player 330 by a user's manipulation. In the displayed state, when the second media 330B is additionally played and displayed through the media player 330 by the user's manipulation, the first and second media 330A and 330B are displayed on one screen. The icon 210 or UI 220 to which the function is assigned is displayed. For example, in (a) of FIG. 11, the UI 220 is displayed.

In addition, when an area in which at least one of the first and second media 330A and 330B is to be displayed is designated through the UI 220, the controller 180, as shown in FIG. 11(b), The screen of the touch screen 151 is divided into the first and second areas, and the first and second media 330A and 330B are displayed in the designated area among the divided first and second areas.

For example, as shown in (a) of FIG. 11, the controller 180 designates an upper area of the divided areas as an area in which the first media 330A will be displayed through the UI 220, When a lower area of the divided areas is designated as an area in which the second media 330B will be displayed through the UI 220, as shown in FIG. 11B, the divided upper area and the lower area The first and second media 330A and 330B are displayed on each.

In this case, when the first media 330A is played back through the media player 330 and the second media 330B is additionally played, the controller 180 displays the icon 210 or the UI 220 ), the screen of the touch screen 151 is divided into the first and second regions, and the first and second media 330A and 330B are respectively divided into the first and second regions. You can also display each. At this time, the controller 180 displays the most recently played second media 330B in the lower area of the divided areas by default, and displays the previously played first media 330A in the upper area. May be.

In addition, the controller 180 displays the icon 210 or the UI 220 in a state in which a first window including the first media 330A and a second window including the second media 330B are respectively displayed. When selected, the screen of the touch screen 151 is divided into the first and second regions, and the first and second media 330A and 330B may be displayed in each of the divided first and second regions, respectively. have.

In addition, when the first window including the first media 330A and the second window including the second media 330B are displayed, respectively, the controller 180 displays the icon 210 or the UI 220 And without a selection operation, dividing the screen of the touch screen 151 into the first and second regions, and displaying the first and second media 330A and 330B in each of the divided first and second regions, respectively. You may. In this case, the controller 180 may display the most recently played second media 330B in the lower area of the divided areas by default, and display the previously displayed first media 330A in the upper area. .

As another example, FIG. 12 is a photographing function of first and second cameras provided on the front and rear sides of the mobile terminal 100 as the first application, and first and second content information provided by the first application Indicates that the first and second images 340A and 340B are input through the first and second cameras.

In this case, the first image 340A is an image input through the first camera and photographed in front of the mobile terminal 100, and may include a user's image, and the second image 340B is An image that is input through a second camera and photographed behind the portable terminal 100 may include a surrounding landscape.

That is, as shown in FIG. 12, when the first and second cameras are driven, and the first and second images 340A and 340B are input through the first and second cameras, , The screen of the touch screen 151 is divided into the first to third regions, and the first and second images 340A and 340B are displayed on the divided first and second regions, respectively.

Further, the controller 180 displays a third image 341A or 341B in which the first and second images 340A and 340B are combined into one, on the third area.

In this case, as shown in FIG. 12, the controller 180 may display a 3-1 image 341A obtained by synthesizing the first image 341A within the second image 340B in the third area. In addition, a 3-2 image 341B obtained by synthesizing the second image 341B within the first image 340A may be displayed in the third area.

[2nd Example ]

The second embodiment of the present invention shows a process of displaying the first and second applications together on one screen while two or more first and second applications are multitasked.

13 is a flowchart of a second embodiment showing a control process of a portable terminal according to the present invention.

14 to 17 are diagrams illustrating a second embodiment of a control process of a mobile terminal according to the present invention.

13 to 17, when an execution command of a specific first application is input from a user through the user input unit 130 or the touch screen 151, the controller 180 responds to the execution command. 1 The application is executed, and the execution screen of the first application is displayed on the touch screen 151 [S210].

In a state in which the execution screen of the first application is displayed, when the user inputs an execution command of a second application different from the first application from the user through the user input unit 130 or the touch screen 151, the controller 180 The second application is executed [S220].

In addition, when a command for simultaneously displaying the first and second applications on the screen of the touch screen 151 is input [S230], the controller 180 displays the screen of the touch screen 151 as the first And the second application execution screen is divided into regions to be displayed [S240], and execution screens of the first and second applications are displayed in each of the divided regions [S250].

As an example, FIG. 14 shows that the first application is a web browser on which a specific web page 411 is displayed, and that the second application is a messenger including chat contents 412 with a specific counterpart.

That is, as shown in (a) of FIG. 14, when the messenger is executed while the web browser is executed and a specific web page 411 is displayed through the web browser, the web An icon 210 assigned to display a browser and a messenger on one screen is displayed.

In addition, when the icon 210 is selected, the controller 180 displays the screen of the touch screen 151 in the first and second areas in which the web browser and the messenger are displayed, as shown in FIG. 14C. And the web browser and the messenger are displayed in each of the divided first and second areas.

In this case, if the display mode of the touch screen 151 is a vertical mode, as shown in FIG. 14, the controller 180 divides the screen into an upper area and a lower area, and the display mode of the touch screen 151 In the horizontal mode, the screen may be divided into a left area and a right area.

In addition, when the messenger is executed while the specific web page 411 is displayed through the web browser, the controller 180 displays the screen of the touch screen 151 without displaying and selecting the icon 210. May be divided into the first and second areas, and the web browser and the messenger may be displayed in each of the divided first and second areas, respectively. In this case, the controller 180 may display the most recently executed messenger in the lower region of the divided regions as a default, and display the previously executed web browser in the upper region. In addition, the controller 180 may display one of the web browser and the messenger, which has the most typing operation, in the lower area of the divided areas by default.

In addition, when the icon 210 is selected while the first window including the web browser and the second window including the messenger are displayed as independent windows on the touch screen 151, the controller 180 The screen of the screen 151 may be divided into the first and second areas, and the web browser and the messenger may be displayed in each of the divided first and second areas.

Next, as shown in (b) of FIG. 14, when the messenger is executed after the web browser is executed, the control unit 180 uses a UI for designating an area in which the web browser and the messenger will be displayed. Interface) 220 is displayed, and when an area in which at least one of the web browser and a messenger is to be displayed is designated through the UI, the screen of the touch screen 151 is displayed as shown in FIG. 14C. It divides into the first and second areas, and displays the web browser and the messenger in the designated area among the divided first and second areas.

As an example, in (b) of FIG. 14, the upper area of the divided areas is designated and displayed as an area in which the web browser is to be displayed through the UI 220.

As another example, FIG. 15 is a camera application in which the first application provides a shooting function of the camera 121 of the mobile terminal 100, and the second application provides a playback function of a specific image (media) 422. It indicates that it is a media player.

That is, as shown in FIG. 15, when the camera application 421 is executed, the controller 180 displays the first image 421 input through the camera 121, and the specific second image ( When the media player for playing the media) 422 is executed, the screen of the touch screen 151 is divided into two or more regions, and the camera 121 is placed in each of the first and second regions among the divided regions. A first image 421 input through and a second image 422 played by the media player are displayed, respectively.

In addition, the controller 180 displays a third image 421A or 422A in which the first and second images 421 and 422 are combined into one, on a third area among the divided areas.

In this case, as shown in FIG. 15, the controller 180 may display a 3-1 image 421A obtained by synthesizing the first image 421 in the second image 422 in the third area. In addition, a 3-2 image 422A obtained by synthesizing the second image 422 within the first image 421 may be displayed in the third area.

As another example, FIG. 16 shows that the first application is a video call application that provides a video call function with a specific counterpart, and that the second application is a media player that provides a play function of a specific media 433.

That is, as shown in FIG. 16, when the video call application is executed and a video call is connected with a specific counterpart, the controller 180 provides a user image 431 and a wireless communication unit 110 input through the camera 121. The other party's image 432 received through is displayed on the touch screen 151.

Thereafter, when a media player that plays the specific media 433 is executed while performing the video call function, the controller 180 divides the screen of the touch screen 151 into first to third areas, and the division The user image 431, the counterpart image 432, and the media 433 are displayed in each of the first to third areas.

At this time, when the third area in which the media 433 is displayed is selected, the controller 180 controls the media being played instead of the user image 431 transmitted in real time to the other party of the video call through the wireless communication unit 110 433) can be transmitted to the counterpart in real time.

In addition, when the third area in which the media 433 is displayed is selected, the controller 180 combines the user image 431 and the media 433 input in real time from the camera 121 into one image, Instead of the user image 431 transmitted in real time to the other party of the video call through the wireless communication unit 110, the synthesized image may be transmitted to the other party in real time.

As another example, FIG. 17 shows that the first application is a media player that provides a playback function of a specific media 441, and that the second application is a web browser that provides a display function of a specific web page 442. .

That is, as shown in (a) of FIG. 17, when the media player is executed and the specific media 441 is played through the media player, the controller 180 displays on the playback screen of the media 441. When a user interface (UI) 220 for specifying an area in which the media player and the web browser are to be displayed is displayed, and an area in which at least one of the media player and the web browser is to be displayed is designated through the UI, As shown in (b) and (c) of 17, the screen of the touch screen 151 is divided into the first and second regions, and the media player and the web browser are divided into the divided first and second regions. Display in the designated area among 2 areas.

As an example, in (a) of FIG. 17, an upper area of the divided areas is designated and displayed as an area to be displayed by the media player through the UI 220.

At this time, as shown in (b) of FIG. 17, when the controller 180 determines the size of the image area on which the media 441 is displayed in a state in which the screen mode of the touch screen 151 is set to a vertical mode , Determine the size of the upper area to have the same size as the aspect ratio of the media 441, determine the remaining area excluding the determined upper area as the lower area, and display the web browser in the determined lower area can do.

As described above, it is apparent to those skilled in the art that the present invention can be embodied in other specific forms within the scope not departing from the spirit and essential features of the present invention.

The above-described present invention can be implemented as a computer-readable code on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, and the like, and are implemented in the form of carrier waves (for example, transmission over the Internet). Also includes. In addition, the computer may include the controller 180 of the portable terminal.

Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

The portable terminal and its control method described above are not limited to the configuration and method of the above-described embodiments, but the embodiments are all or part of each of the embodiments selectively so that various modifications can be made. It may be configured in combination.

100: mobile terminal 110: wireless communication unit
111: broadcast receiver 112: mobile communication module
113: wireless Internet module 114: short-range communication module
115: location information module 120: A/V input
121: camera 122: microphone
130: user input unit 140: sensing unit
141: proximity sensor 150: output
151: display unit 152: sound output module
153: alarm module 154: haptic module
155: projector module 160: memory
170: interface unit 180: control unit
181: multimedia module 190: power supply

Claims (9)

A memory equipped with applications;
A display unit that displays a first application among the applications on a screen; And
When a command to simultaneously display two or more first and second content included in the first application on the display unit is input, the screen is divided into regions in which the two or more first and second content will be displayed, respectively And, a control unit for controlling to display the two or more first and second content in each of the divided regions; Including,
The first application includes a photographing function of a first camera provided on the front of the portable terminal and a second camera provided on the rear of the portable terminal,
The first and second content are first and second images input through the first and second cameras,
And the control unit displays the first image, the second image, and a third image in which the first and second images are combined into one in each of the divided regions. The method of claim 1,
The control unit displays a UI (User Interface) for designating a region in which the two or more first and second content will be displayed among the divided regions, and displays the two or more first and second content through the UI When each of the areas to be designated is designated, the two or more first and second contents are displayed in each of the designated areas. The method of claim 1,
The first application includes a messenger,
The first and second contents are contents of a chat with a first party in the messenger and contents of a chat with a second party in the messenger. The method of claim 1,
The first application includes a web browser,
And the first and second content are a first web page and a second web page included in the web browser. The method of claim 1,
The first application includes a media player,
The first and second contents are a first media and a second media playable through the media player. delete The method of claim 1,
When a second application among the applications is further executed and a command for simultaneously displaying the first and second applications on the display unit is input, the controller displays the screen as the first and second applications. And the first and second applications are displayed in each of the divided areas. The method of claim 7,
Wherein the control unit displays, among the first and second applications, an application having a large amount of user manipulation or a recently executed application in a preset area among the divided areas. delete

Images