KR101772453B1 - Mobile terminal and method for controlling thereof - Google Patents

Abstract

The present invention relates to a mobile terminal and a control method thereof that can provide a more convenient user interface by individually adjusting the transparency of two or more applications. The mobile terminal according to at least one embodiment of the present invention can provide a user interface with less delay and a convenient user interface by easily adjusting transparency of each application without going through a hardware block in a multitasking environment.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THEREOF [0002]

The present invention relates to a mobile terminal and a control method thereof that can provide a more convenient user interface by individually adjusting the transparency of two or more applications.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In particular, as multitasking is supported in a mobile terminal and video processing performance is improved, a more convenient user environment is required when two or more applications are simultaneously executed in a multitasking environment.

The present invention is to provide a more convenient user interface by adjusting transparency of each application in a multitasking environment.

It is another object of the present invention to provide a free and dynamic method of adjusting the transparency of a particular application.

 It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

A mobile terminal according to an embodiment of the present invention for realizing the above object includes a surface stage for processing at least one surface, a window stage for processing at least one window, A surface processor for generating a window through transparency change for the at least one surface and synthesis according to display priority among the at least one surface; And a display unit for displaying the generated window under the control of the control unit. Here, when the first application is displayed on the display unit, when the second application is executed, the transparency of the surface corresponding to at least one of the first application and the second application is adjusted, As shown in FIG.

The mobile terminal according to at least one embodiment of the present invention configured as described above can provide a more convenient user interface by easily adjusting transparency of each application in a multitasking environment.

In addition, since transparency of a specific application is not controlled through hardware blocks, it is possible to adjust the transparency freely and dynamically.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a front view of a mobile terminal for explaining an operation state of the mobile terminal according to the present invention.
4 shows a process of generating a general display image.
FIG. 5 shows a process of generating the general display image in more detail.
6 is a display state diagram illustrating an example of a pop-up UI to which transparency adjustment is applied.
7A and 7B show an example of the image of the surface required for display of the moving picture reproducing application as shown in Fig.
FIG. 8 shows a display image generating method that can be applied to embodiments of the present invention.
9 illustrates display state diagrams in which a background video function is performed according to an embodiment of the present invention.
FIG. 10 is a conceptual diagram illustrating a change in capacitance according to a pointer having a different contact area with the touch screen in the capacitive touch sensor.
11A to 11C show an example of BGV application according to another embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

Hereinafter, a related operation of the display unit 151 and the touch pad 135 will be described with reference to FIG.

3 is a front view of a portable terminal for explaining an operation state of the portable terminal according to the present invention.

Various types of time information can be displayed on the display unit 151. [ These pieces of information can be displayed in the form of letters, numbers, symbols, graphics, or icons.

At least one of the letters, numbers, symbols, graphics, or icons may be displayed in a predetermined arrangement for inputting such information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " virtual keypad ".

3 illustrates inputting of a touch applied to the virtual keypad through the front surface of the terminal body.

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with each other.

For example, an output window 151a and an input window 151b are displayed on the upper and lower portions of the display unit 151, respectively. The output window 151a and the input window 151b are areas allocated for outputting or inputting information, respectively. In the input window 151b, a virtual keypad 151c is displayed in which a number for inputting a telephone number or the like is displayed. When the virtual keypad 151c is touched, numbers and the like corresponding to the touched virtual keypad are displayed on the output window 151a. When the first operation unit 131 is operated, call connection to the telephone number displayed on the output window 151a is attempted.

The display unit 151 or the touch pad 135 may be configured to receive a touch input by scrolling, as well as the input method described in the above embodiments. The user can move a cursor or a pointer located on an object displayed on the display unit 151, for example, an icon or the like, by scrolling the display unit 151 or the touch pad 135. [ Further, when the finger is moved on the display portion 151 or the touch pad 135, the path along which the finger moves may be visually displayed on the display portion 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the terminal may be executed in response to a case where the display unit 151 (touch screen) and the touch pad 135 are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the terminal body using the thumb and index finger. The one function may be activation or deactivation of the display unit 151 or the touch pad 135, for example.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least one of the components shown in FIG.

In general, a pointer refers to means (for example, a stylus pen or a finger) for touching the touch screen, and may be a specific shape (for example, a stylus pen or a finger) displayed on a display For example, an arrow, an hourglass). In this specification, the means for touching the touch screen is referred to as a " pointer ", and the display of a specific shape moved by an operation of a mouse, a touch pad, a touch screen, or the like will be referred to as a "cursor" The cursor may include an indication on the display indicating where the user can enter the text.

Adjust display transparency

Hereinafter, a method of adjusting transparency of an object displayed on the display unit 151, which can be applied to embodiments of the present invention, will be described.

4 shows a process of generating a general display image.

Referring to FIG. 4, an image displayed on the display unit may be generated through a surface stage that processes at least one surface, and a window stage that processes at least one window. Here, each stage may be included in the controller 180 or may be included in a processor for separate image processing.

At least one surface constitutes one window, and at least one window is combined to constitute an image finally displayed on the display unit 151 (e.g., LCD).

A more specific example of such image generation will be described with reference to Figs. 5 to 7. Fig.

FIG. 5 shows a process of generating the general display image in more detail.

5 shows a semitransparent pop-up user interface (hereinafter referred to as a " pop-up user interface ") under a certain condition a pop-up UI) is provided.

First, the image of the moving picture itself to be reproduced and the pop-up user interface are composed of one surface 501, 511, respectively. In addition, the user interface (UI) of the playback application is composed of two surfaces 521, 523.

In this case, a surface refers to an unprocessed image stored in a display memory buffer, which may be a video frame received from a codec. Also, setting information for transparency adjustment (alpha blanding or transparency) can be set.

Each surface constitutes windows 551, 553, and 555, which form an image 580 displayed on the display unit 151 through a hardware block 570. At this time, in the hardware block, each window is merged or overlapped (Mergy / Overlay), and the transparency is adjusted for each window to make a final image (580).

For example, when the video playback application is initially executed in a state in which each window is prepared, the UI is displayed first, and the video is overlaid on the UI image as the playback command is input from the user. That is, the hardware block 580 first outputs only the window 555 corresponding to the UI, but outputs the video overlaying the window of the movie 551 to the UI window 555 according to the playback command. At this time, when the user moves the cursor to the area where the moving image is displayed and a semitransparent popup UI is to be displayed, the hardware block 570 is enabled to apply a semitransparent effect to the popup UI window 553, Overlay it at the top.

An example in which such a popup UI window is displayed on the actual display unit 151 will be described with reference to Fig.

6 is a display state diagram illustrating an example of a pop-up UI to which transparency adjustment is applied.

Referring to FIG. 6A, a user interface (UI) 610 for controlling the reproduction of a moving picture is displayed on both edges of the display unit 151 as the moving picture reproducing application is executed, The moving image to be reproduced is displayed on the display unit 620.

In this case, when the user takes the pointer to the moving image playback area 620 through the touch screen, the pop-up UI 630 including the detailed control information and detailed control menu of the moving image as shown in FIG. . ≪ / RTI >

An image of a surface required for display of the moving picture reproducing application as shown in Fig. 6 will be described with reference to Figs. 7A to 7D.

First, FIG. 7A corresponds to an image of a moving image to be reproduced, and FIG. 7B corresponds to an image of a pop-up UI 511 of FIG. 7C corresponds to 521 of FIG. 5 as a UI button of the playback application, and FIG. 7D corresponds to 523 of FIG. 5 as a background image of the UI. That is, the surfaces of FIGS. 7C and 7D together form one UI window.

The correspondence between the above-described FIG. 5 and FIG. 7 is for the sake of understanding, and there may be various correspondence.

Adjusting the transparency of the surface

When a full screen of each application is prepared for each window and two or more applications are simultaneously displayed on the display unit in the multitasking environment, there may occur a case where the areas of the respective applications are at least partially overlapped with each other. In this case, although the entire screen of each application is prepared in the actual window stage, only the uppermost application is displayed in the image actually displayed on the display unit, and overlapped portions are not displayed in the applications located thereunder. Here, the concept of an upper or a lower level refers to a display priority. When there is a portion overlapping the upper image and the lower image in the image to be actually displayed on the display unit, the upper image is displayed first, and the lower image is not overlapped with the upper image Only the part is displayed.

At this time, if transparency effect is adjusted by adjusting the transparency of the application located at the upper part, the user can see the entire application located at the lower part even if there is overlapping part. However, if the transparency of a specific window is controlled (that is, OSD Alpha Blanding), the H / W block enable is required. In this case, a delay time occurs due to the activation / deactivation of the hardware block, so that a delay or a screen break phenomenon may occur until an image having a semitransparent effect is actually provided to the user.

Therefore, in the present invention, instead of generating an image to be finally displayed through at least one window of a hardware block at the end of a window, a window is created by adjusting the transparency of each surface by software at the end of the surface end Method. This will be described with reference to FIG.

FIG. 8 shows a display image generating method that can be applied to embodiments of the present invention.

Referring to FIG. 8, the method for generating a display image according to the present invention does not adjust the transparency of a specific window in a hardware block at the end of a window, unlike FIG. Instead, the transparency and / or the display priority of each surface 810 can be adjusted and combined by software through a surface flinger 820 positioned at the end of the surface stage to create one window 830 have. Since the image 840 to be finally displayed is generated using one window 830 thus generated, an activation process of a separate hardware block is not required to control transparency. As a result, according to the present method, there is no delay due to the enable / disable of the hardware block, and the transparency of the dynamically displayed image can be adjusted.

Accordingly, in displaying the video on the display unit 151, the user can manipulate other applications irrespective of video playback while arranging the video on a background screen in a translucent manner. In addition, there is an effect that the transparency of the application to which the translucent effect is applied and the change of the application to which the translucent effect is applied can be performed dynamically without delay. In addition, since the semitransparent effect is applied to one application as a whole, two or more applications can be simultaneously viewed on the entire screen.

The function of processing a screen corresponding to some applications in a semi-transparent manner in an environment where multitasking is supported through the display image generation method described above with reference to FIG. 8 is referred to as "background video (BGV) "

Specific embodiments

Hereinafter, a specific form to which the BGV function is applied will be described.

9 illustrates display state diagrams in which a background video function is performed according to an embodiment of the present invention.

Referring to FIG. 9A, a moving picture reproducing application is executed in the mobile terminal according to the present invention, and a moving picture reproducing application is displayed on the display unit 151. At this time, the user can operate the predetermined menu button 910 to activate the background video (BGV) function. At this time, a menu button 910 (hereinafter referred to as "BGV button") corresponding to the BGV function may be a virtual key button displayed on the touch screen or a hardware button provided on one side of the mobile terminal body.

As the BGV button is operated, a semitransparent effect is applied to the image displayed on the current display unit (i.e., a moving image playback application) at the surface flank of the end of the surface, and a preset menu screen for the BGV function, As shown in FIG. Here, the menu screen preset for the BGV function may be an initial menu screen or may be a shortcut bar of an application frequently used by the user for multitasking. At this time, if the user does not control the semi-transparent video, the playback state can be continuously maintained.

When the user selects the Internet browser icon 920, the web browser is executed in the background of the moving picture to be played back as shown in (c) of FIG. 9, so that the user can perform web surfing simultaneously with watching the moving image. Meanwhile, when the BGV function is activated, a menu icon 930 for changing the display priority may be arranged in one area of the display unit 151 to change the display priority of the applications displayed in the background and the applications displayed in the background . In addition, a menu icon (not shown) for adjusting the transparency of an application displayed in the background may be additionally disposed.

How to operate the application when applying BGV

Meanwhile, when two or more applications are running in the mobile terminal and the semitransparent effect is given to at least one application through the BGV function, a method of operating each application needs to be defined.

1) As a first method, a general touch input or button operation input may be applied only to an application having the highest display priority or to a currently active application. For this purpose, when the applications do not completely overlap with each other, the user can increase or decrease the display priority of the selected application by selecting a portion that does not overlap with another application in order to change the application having the highest display priority . If two or more applications are all displayed on the full screen, the display priority can be changed or the activated application can be changed using the menu icon 930 for changing the display priority. At this time, the priority changing function can be performed not only by the menu icon 930 but also through a specific hardware key button.

2) In a different way, different applications can be controlled by different touch input areas.

That is, even if the same portion and the same time on the touch screen are touched, the number of simultaneous touches and / or the touch area are taken into consideration so as to be accepted as at least two separate commands. This will be described with reference to FIG.

FIG. 10 is a conceptual diagram illustrating a change in capacitance according to a pointer having a different contact area with the touch screen in the capacitive touch sensor.

Referring to FIG. 10, a film 1010 made of a conductive material is formed on the upper plate 1020 and the lower plate 1021, respectively. When a predetermined pointer suitable for the touch input of the capacitive touch screen, that is, the touch pen 1030 and the top plate 1020 are touched by the finger 1040, the pointer and the conductive film 1010 are interposed between the pointer and the conductive film 1010 A predetermined parasitic capacitance is generated. However, since the contact area of the finger 1040 is larger than that of the touch pen 1030, parasitic capacitance is generated in a wider area. The touch screen senses the difference in the area where the parasitic capacitance is generated, and can output a different touch signal according to the touch receiving area and its position. The control unit 180 can recognize the touch receiving area in at least two ways using the touch signal. Accordingly, it is possible to distinguish the touch input received through the touch pen from the touch input received through the finger, and recognize different commands to operate different functions.

So far, the principle that the mental capacity type touch sensor distinguishes the touch area is explained. However, the mobile terminal according to at least one embodiment of the present invention can be used regardless of the sensing method as long as it is a touch sensor capable of outputting different touch signals according to an area receiving a touch, in addition to the capacitive touch sensor described above .

There are a variety of pointers that can apply touch input to the touch screen, and thus the contact area with the touch screen may vary. However, in the present specification, for simplicity of explanation, a pointer for applying a touch input to a touch screen will be divided into two types according to the touch area. That is, when the mobile terminal 100 related to the present invention receives a touch input by the touch pen 1030 and a finger 1040 having a relatively large area in contact with the touch screen relatively, It can be assumed. Hereinafter, the touch input by the touch pen 1030 is referred to as a "first area touch", and the touch input by the finger 1040 is referred to as a "second area touch".

According to the above-described touch recognition method, the user can operate the application to which the transparency change is applied through the first area touch through the BGV function, and the application that does not change through the second area touch. Alternatively, the operation target of the first area touch and the second area touch may be reversed. For example, in the case of (c) of FIG. 9, the user can operate the video playback program by touch input through the finger, and operate the web browser by touch input through the touch pen.

3) Another way is to use a touch screen that can distinguish proximity touch and contact touch. In this case, the user can manipulate one application through the proximity touch and manipulate other applications through the contact touch have.

Application of BGV according to event occurrence

According to another embodiment of the present invention, a BGV is applied to a mobile terminal capable of multitasking as a specific event occurs. This will be described with reference to FIG.

11A to 11C show an example of BGV application according to another embodiment of the present invention.

11A, when a text message arrives while a moving picture playback application is running on the display unit 151, a BGV effect is applied to a window 1110 indicating a text message arrival notification, Can be displayed at the set position.

When the user selects the arrival notification window 1110 (touching the notification window or operating a predetermined hardware key button), a semitransparent effect may be applied to the window 1120 informing the contents of the received text message as shown in FIG. 11B. The user can select the reply menu 1130 with a touch via the pointer 1140 to reply to the received text message.

As the reply menu 1130 is selected, a virtual keypad 1140 for creating a text message may be displayed on the display unit 151 as shown in FIG. 11C. When the virtual keypad invades the UI area of the moving image playback application, A touch input having a different touch area can be used. That is, the controller 180 recognizes the touch input through the finger as a touch input for operating the video player, and recognizes the touch input using the touch pen 1140 as a touch input for operating the virtual keypad have.

In FIG. 11, it is assumed that a text message arrives as an example of an event that has occurred. However, the present invention is not limited to this, and can be applied to various events. Examples of these events are communication events (voice calls, video calls, various messages or mail arrivals), or alarm events (time announcements, anniversary announcements or schedule notifications). If an alarm event occurs, a scheduler to which a BGV function (i.e., transparency adjustment) is applied can be displayed.

In addition to the above-described embodiments, the present invention can be applied to various types of mobile terminals on a mobile terminal by displaying a document or a web page to be referenced in a background screen in a state of executing a document creating application through BGV function, It can be applied to multitasking.

Further, according to an embodiment of the present invention, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal having the above-described transparent display unit can be applied to a case where the configuration and method of the above-described embodiments are not limited and the embodiments can be modified so that all or some of the embodiments are selectively As shown in FIG.

Claims (10)

A surface stage for processing at least one surface, a window stage for processing at least one window, and a display stage for changing the transparency and display priority for the at least one surface between the surface stage and the window stage A control unit including a surface processing unit for generating a window through synthesis based on the synthesized result; And
And a touch screen for displaying the generated window under the control of the controller,
When the first application is displayed on the touch screen and the second application is executed, the controller controls the transparency of at least one of the first application and the second application to be displayed in a translucent manner If the inputted touch area corresponds to the first touch area or the second touch area, if the input touch area corresponds to the first touch area, Is recognized as a touch input for operating the corresponding operation of the first application and if the input touch area corresponds to the second touch area, the input touch is recognized as a touch input for operating the corresponding operation of the second application ,
The first touch area is a touch area inputted by one of the user's finger and the touch pen,
Wherein the second touch area is a touch area input by one of the finger and the touch pen of the user different from the first touch area of the user. The method according to claim 1,
Further comprising a user input unit for receiving a command from a user,
Wherein,
Wherein the control unit controls to display a menu screen for selecting a second application when the first application is displayed on the touch screen and the first key button is selected through the user input unit. 3. The method of claim 2,
Wherein the first key button comprises:
A hardware key button, or a virtual key button displayed in one area of the touch screen. 3. The method of claim 2,
The menu screen displays,
A main menu or an application shortcut set by a user. 3. The method of claim 2,
Wherein,
Controls the transparency of the surface corresponding to the menu screen so as to be displayed in a translucent manner. The method according to claim 1,
The second application,
And is executed when a specific event condition is satisfied. The method according to claim 6,
The specific event condition may include:
Receiving a communication event including a voice call, a video call, a short message, a multi-message, and a mail arrival, or an alarm time including an appointed period, anniversary, and schedule. The method according to claim 1,
Wherein,
Wherein the control unit controls the virtual screen so that a virtual key button for changing a display priority of the first application and the second application is further displayed on the touch screen. delete Executing a first application and displaying it on a touch screen;
Generating a window having a transparency adjusted through at least one of a surface corresponding to the first application and a surface corresponding to the second application through the surface processing unit when the execution condition of the second application is satisfied;
Displaying the generated window;
Determining whether an area of the input touch corresponds to a first touch area or a second touch area when a touch is input on the touch screen;
Recognizing the input touch as a touch input for operating a corresponding operation of the first application if the input touch area corresponds to the first touch area; And
And recognizing the input touch as a touch input for operating a corresponding operation of the second application if the input touch area corresponds to the second touch area,
The first touch area is a touch area inputted by one of the user's finger and the touch pen,
Wherein the second touch area is a touch area input by one of the finger and the touch pen of the user other than the first touch area.

Images