KR102076193B1 - Method for displaying image and mobile terminal - Google Patents

Abstract

The present invention relates to an image display method and a portable terminal, and more particularly, to a method for displaying a specific image on the top layer of the screen at all times and a portable terminal for implementing the same. An image display method according to an embodiment of the present invention includes displaying a video on a first area of a screen; Determining a second area to display an image related to the event when an event occurs; Checking whether the second area overlaps the first area when the event is a predetermined specific event; Determining a third region that does not overlap the second region when the second region overlaps the first region; And displaying the image in the second area and displaying the video in the third area.

Description

Image display method and mobile terminal {METHOD FOR DISPLAYING IMAGE AND MOBILE TERMINAL}

The present invention relates to an image display method and a portable terminal, and more particularly, to a method for displaying a specific image on the top layer of the screen at all times and a portable terminal for implementing the same.

As hardware specifications of mobile terminals increase and multimedia technologies develop, portable terminals can provide a function of always displaying a video on the top layer. That is, the video is placed on top of any image. Such a function is called a pop-up function. The user can perform other tasks such as the Internet or texting while watching the video.

However, according to the conventional pop-up function, the position of the video is fixed, which interferes with other tasks. For example, an event may be requested to display a keypad while a video is located at the bottom of the screen. In response to the event, the mobile terminal displays a keypad. The keypad is usually displayed at the bottom of the screen. Therefore, the user is inconvenient to use the keypad after changing the position of the video.

An object of the present invention is to provide a method for always displaying a specific image on the top layer and a portable terminal for implementing the same. In particular, an object of the present invention is to provide a method for enabling a user to perform other tasks without inconvenience while watching a video and a portable terminal implementing the same.

An image display method according to an embodiment of the present invention includes displaying a video on a first area of a screen; Determining a second area to display an image related to the event when an event occurs; Checking whether the second area overlaps the first area when the event is a predetermined specific event; Determining a third region that does not overlap the second region when the second region overlaps the first region; And displaying the image in the second area and displaying the video in the third area.

In accordance with another aspect of the present invention, an image display method includes displaying a video on a first area of a screen; Determining a second area to display an image related to the event when an event occurs; Checking whether the second area overlaps the first area when the event is a predetermined specific event; Determining a third region that does not overlap the first region when the second region overlaps the first region; And displaying the image in the third area.

In accordance with another aspect of the present invention, an image display method includes displaying a video on a first area of a screen; Determining a second area to display an image related to the first event when a first event occurs; Checking whether the second area overlaps with the first area when the first event is a predetermined specific event; Displaying the image in a second area when the second area overlaps the first area, and semi-transparently displaying a portion of the video overlapping the image; And displaying the video in a third area that does not overlap the second area when a second event for requesting a location change of the video occurs.

In accordance with another aspect of the present invention, an image display method includes displaying a video on a first area of a screen; Determining a second area to display an image related to the event when an event occurs; Checking whether the second area overlaps the first area when the event is a predetermined specific event; Displaying a guide image for changing a position of the video when the second region overlaps the first region; Detecting selection of one icon in the guide image; And displaying the image in the second area and displaying the video in a third area corresponding to the selected icon.

In accordance with another aspect of the present invention, an image display method includes displaying a first image on a first area of a screen; Determining a second area to display a second image associated with the event when an event occurs; Checking whether the second area overlaps the first area when the event is a predetermined specific event; Determining a third region that does not overlap the second region when the second region overlaps the first region; And displaying the second image in the second area and displaying the first image in the third area.

A mobile terminal according to an embodiment of the present invention includes a display unit for displaying a video in a first area of the screen; An event generator; And a controller configured to control the display of the video in response to an event received from the event generator, wherein the controller determines a second area to display an image related to the event, wherein the event is a predetermined specific event. Is determined whether the second area overlaps with the first area, and when the second area overlaps with the first area, determines a third area that does not overlap with the second area, and displays the image in the second area. And display the video in the second area.

According to another aspect of the present invention, there is provided a portable terminal including a display unit for displaying a video on a first area of a screen; An event generator; And a controller configured to control the display of the video in response to an event received from the event generator, wherein the controller determines a second area to display an image related to the event, wherein the event is a predetermined specific event. Is determined whether the second area overlaps with the first area, and when the second area overlaps with the first area, determines a third area that does not overlap with the first area, and determines the image as the first area. Control to display in 3 areas.

According to still another aspect of the present invention, there is provided a portable terminal including a display unit for displaying a video on a first area of a screen; An event generator; And a controller configured to control the display of the video in response to the first event and the second event received from the event generator, wherein the controller determines a second area to display an image related to the first event. Check whether the second area overlaps with the first area when the first event is a predetermined specific event; and display the image on the second area when the second area overlaps with the first area. And control to display a portion overlapping with the image in the video in a translucent manner and display the video in a third area that does not overlap with the second area in response to the second event.

According to still another aspect of the present invention, there is provided a portable terminal including a display unit for displaying a video on a first area of a screen; An event generator; And a controller configured to control the display of the video in response to an event received from the event generator, wherein the controller determines a second area to display an image related to the event, wherein the event is a predetermined specific event. In the case of checking whether the second area overlaps the first area, and if the second area overlaps the first area, and displays a guide image for changing the position of the video, one from the guide image Detects selection of an icon, displays the image in the second area, and controls to display the video in a third area corresponding to the selected icon.

According to still another aspect of the present invention, there is provided a portable terminal including a display unit configured to display a first image and a second image; An event generator; And a controller configured to control display of the first image and the second image in response to an event received from the event generator, wherein the controller determines a first area of a screen on which the first image is to be displayed. And controlling to display the first image in the first area, determine a second area of a screen to display the second image when the event occurs during display of the first image, and specify the predetermined event In case of an event, it is determined whether the second region overlaps the first region, and when the second region overlaps the first region, a third region that does not overlap the second region is determined, and the second image Is displayed on the second area and the first image is displayed on the third area.

The image display method and the portable terminal according to the present invention allows the user to perform other tasks without inconvenience while watching a video.

1 is a block diagram of a portable terminal according to an embodiment of the present invention.
2 is a flowchart illustrating an image display method according to an embodiment of the present invention.
3A to 3D, 4A, and 4B are diagrams for describing an image display method according to an exemplary embodiment.
5 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention.
6 is a diagram for describing an image display method according to another exemplary embodiment.
7 is a flowchart illustrating an image display method according to another embodiment of the present invention.
8A through 8C are diagrams for describing an image display method, according to another exemplary embodiment.
9 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention.
10A to 10C are diagrams for describing an image display method according to another exemplary embodiment of the present invention.
11 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention.
12A to 12C are diagrams for describing an image display method according to another exemplary embodiment of the present invention.
13A and 13B are diagrams for describing an image display method in a landscape mode.

In the present invention, the portable terminal is a portable electronic device such as a smartphone, a tablet PC, a notebook PC, and the like. Hereinafter, the image display method of the portable terminal according to the present invention will be described in detail. Prior to the detailed description of the present invention, terms or words used below should not be construed as being limited to ordinary or dictionary meanings, but should be construed as meanings and concepts corresponding to the technical spirit of the present invention. Therefore, the following description and the accompanying drawings are only preferred embodiments of the present invention, and do not represent all of the technical idea of the present invention, and various equivalents and modifications may be substituted for them at the time of the present application. Should be understood. In addition, some of the components in the accompanying drawings are exaggerated, omitted or schematically illustrated, the size of each component does not entirely reflect the actual size. Accordingly, the present invention is not limited by the relative size or spacing drawn in the accompanying drawings.

1 is a block diagram of a portable terminal according to an embodiment of the present invention.

Referring to FIG. 1, the mobile terminal 100 according to the present invention includes a display unit 110, a key input unit 120, a storage unit 130, a wireless communication unit 140, an audio processing unit 150, a speaker (SPK), The microphone MIC and the controller 160 are included.

The display unit 110 displays an image on a screen under the control of the controller 160. That is, when the controller 160 processes (eg, decodes) data into an image to be displayed on the screen and stores the data in the buffer, the display unit 110 converts the image stored in the buffer into an analog signal and displays the image on the screen. When power is supplied to the display unit 110, the display unit 110 displays a lock image on the screen. If the lock release information is detected while the lock image is being displayed, the controller 160 releases the lock. That is, the display 110 displays another image instead of the locked image under the control of the controller 160. The unlock information may be text (eg, 1234) input by the user on the mobile terminal 100 using the keypad or key input unit 120 displayed on the screen of the display unit 110, or the user's touch on the display unit 110. It is a locus, a direction of a touch, a kind of touch, or voice data of a user input to the mobile terminal 100 through a microphone (MIC). Other images are home images, application launch images (eg, videos, web pages, etc.), keypads, or lists. The home image includes a background image and a number of icons displayed thereon. Icons indicate applications (hereinafter, referred to as App) or data (eg, picture files, video files, recording files, documents, messages, etc.), respectively. When the user selects one of the icons, for example, an application icon (eg, taps the icon), the controller 160 executes the corresponding app (eg, an app that provides SNS) and displays the execution image. ).

The display unit 110 displays images on a screen in a multi-layer structure under the control of the controller 160. For example, the display unit 110 displays a first image (eg, a home image, a web page) on a screen, and displays a second image (eg, a video) on the first image. In this case, an area where the first image is displayed may be the entire screen, and an area where the second image is displayed may be part of the screen. Thus, the user can see a part of the first image, if not the whole. In addition, the display 110 may display the second image opaquely under the control of the controller 160. Accordingly, the entirety of the first image may be viewed.

Under the control of the controller 160, the display unit 110 always displays a specific image, especially a video, on the top layer of the screen. For example, a web browser is executed by the user, and a web page is displayed on the screen according to the execution of the web browser. In this case, the controller 110 controls the display unit 110 to display a video above the web page. In addition, the display 110 displays a first image (eg, a video) on the first area of the screen and controls the second image (eg, a keypad, a message, a notification window, etc.) under the control of the controller 160. It displays in the 2nd area | region which does not overlap.

The display unit 110 may include a liquid crystal display (LCD), an organic light emitting diode (OLED), an active matrix organic light emitting diode (AMOLED), or a flexible display.

The touch panel 111 is placed on the display unit 110. In detail, the touch panel 111 may include an add-on type located on the screen of the display unit 110, an on-cell type inserted into the display unit 110, or an in-cell type. cell type).

The touch panel 111 generates an analog signal (eg, a touch event) in response to a user gesture on the touch panel 111, converts the analog signal to A / D, and transmits the analog signal to the controller 160. In this case, the touch event includes touch coordinates (x, y). When the touch coordinates are received from the touch panel 111, the controller 160 determines that the touch mechanism (eg, a finger or a pen) is touched by the touch panel 111, and the touch coordinates may not be received from the touch panel 111. If it is determined that the touch is released. Also, the controller 160 determines that the touch mechanism is moved when the touch coordinate is changed from (x ₁ , y ₁ ) to (x ₂ , y ₂ ). The controller 160 calculates a position change amount (dx, dy) of the touch mechanism, a moving speed of the touch mechanism, and the like in response to the movement of the touch mechanism. The controller 160 touches a user gesture based on touch coordinates, whether the touch device is released, whether the touch device is moved, the amount of change in the touch device, and the moving speed of the touch device. Double Tap, Long tap, Tap & touch, Drag, Flick, Press, pinch in and pinch out ), Etc. A touch is a gesture in which a user contacts a touch mechanism at a point on the touch panel 111 of a screen, and a multi-touch is a gesture in which a plurality of touch mechanisms (eg, a thumb and an index finger) are touched at various points, and a tab is a screen. After the touch mechanism is touched at any point of, the gesture is touch-off at that point without moving, and the double tap is a gesture of tapping a point twice consecutively, and the long tap is relatively After the long touch is a gesture of releasing the touch mechanism at the point without moving the touch mechanism, tap and touch is a gesture of tapping a certain point on the screen and touching the point again within a predetermined time (for example, 0.5 seconds), Drag is a gesture that moves the touch mechanism in a predetermined direction while touching a point, and flick moves the touch mechanism faster than the drag and releases the touch. Gesture, press is a gesture of pressing a point after touching a point, pinch-in is a gesture of narrowing the distance between touch mechanisms after multi-touching two points simultaneously with two touch mechanisms, and pinch-out is a touch of the touch mechanisms. This gesture is to widen the interval. That is, the touch means a state in which the touch panel 111 is in contact with the touch panel 111, and the other gestures mean a change in the touch.

The touch panel 111 may be a composite touch panel including a hand touch panel for detecting a hand gesture and a pen touch panel for detecting a pen gesture. Here, the hand touch panel is configured in a capacitive type. Of course, the hand touch panel may be configured in a resistive type, an infrared method, or an ultrasonic method. In addition, the hand touch panel may not generate a touch event only by a user's hand gesture, but may also generate a touch event by another object (eg, an object of conductive material capable of applying a capacitance change). The pen touch panel may be configured of an electromagnetic induction type. Accordingly, the pen touch panel generates a touch event by a specially manufactured touch stylus pen to form a magnetic field. Meanwhile, the touch panel 111 may include a pressure sensor to detect the pressure at the touched point. The detected pressure information is transmitted to the controller 160, and the controller 160 distinguishes a touch from a press based on the detected pressure information. The pressure information can also be detected in other ways.

The key input unit 120 may include a plurality of keys for receiving numeric or character information and setting various functions. These keys may include menu recall keys, screen on / off keys, power on / off keys, volume control keys, and the like. The key input unit 120 generates a key event related to user setting and function control of the mobile terminal 100 and transmits the generated key event to the controller 160. The key event may include a power on / off event, a volume control event, a screen on / off event, a shutter event, and the like. The controller 160 controls the above components in response to the key event. Meanwhile, a key of the key input unit 120 may be referred to as a hard key, and a virtual key displayed on the display unit 110 may be referred to as a soft key.

The storage unit 130 is a secondary memory unit of the controller 160, and includes a disk, a RAM, a ROM, a flash memory, and the like.

The storage unit 130 stores the position change table 131. The location change table 131 includes event information and location information corresponding thereto. Here, the location information can be changed by the user, and an example of the location change table 131 is shown in Table 1 below.

Event information Location information Keypad display request Top of the screen Receive a message Bottom of screen Call request Center of the screen

The storage unit 130 stores data (eg, contacts) generated in the mobile terminal 100 and data (eg, messages, video files) received from the outside through the wireless communication unit 140. May include size information of an image (eg, a keypad, a video, a message, etc.) and display area information of the image. Assuming that the minimum unit constituting the screen is a pixel, the size information is, for example, "x * y". "x" means the x-th pixel in the X-axis direction and "y" means the y-th pixel in the Y-axis direction. The display area information is, for example, four coordinates, that is, (x1, y1), (x2, y1), (x2, y1), and (x2, y2). In addition, the display area information may be one coordinate.

The storage unit 130 may include setting values (eg, a value indicating whether the screen brightness is automatically adjusted, a value indicating whether Bluetooth is used, a value indicating whether the pop-up function is used, and a use of the position change table 131). The value indicating whether or not).

The storage unit 130 stores a booting program, an operating system (OS), and applications. As is well known, the operating system manages computer resources such as CPU, GPU, main memory, and auxiliary memory while acting as an interface between hardware and applications and between applications. The operating system also controls the operation of hardware and the execution of applications, orders tasks, controls CPU and GPU operations, and manages the storage of data and files. Applications are classified into embedded applications and third party applications. For example, the internalization application is a web browser, an e-mail program, an instant messenger, or the like. The third party application is an application that is received and installed by the mobile terminal 100 from the app market server. When power is supplied from the battery to the controller 160, a boot program is first loaded into a main memory (eg, RAM) of the controller 160. This boot program loads the operating system into main memory. The operating system loads an application such as the video player 132 into the main memory.

The storage unit 130 may include a speech to text (STT) program for converting voice data into text. In addition, the storage unit 130 may include an artificial intelligence program that analyzes voice data to determine a user's intention. Specifically, an artificial intelligence program includes a natural language processing engine that recognizes a context in speech data, an inference engine that infers a user's intention based on the recognized context, and a user based on the recognized context. Conversation engine and the like to talk to.

The wireless communication unit 140 performs voice call, video call, or data communication with an external device through a network under the control of the controller 160. The radio communication unit 140 includes a radio frequency transmitter for upconverting and amplifying a frequency of a transmitted signal, and a radio frequency receiver for low noise amplifying and downconverting a frequency of a received signal. In addition, the wireless communication unit 140 may be a mobile communication module (eg, a third generation (3-Generation) mobile communication module, 3.5 (3.5-Generation) generation mobile communication module or 4 (4-Generation) generation mobile communication module, etc.), digital broadcasting Modules (eg, DMB modules) and near field communication modules (eg, Wi-Fi modules, Bluetooth modules, Near Field Communication (NFC) modules).

The audio processor 150 is coupled to the speaker SPK and the microphone MIC to input and output audio signals (eg, voice data) for voice recognition, voice recording, digital recording, and a call. The audio processor 150 receives an audio signal from the controller 160, converts the received audio signal to analog D / A ', amplifies it, and outputs the amplified audio signal to the speaker SPK. The audio processor 150 converts the audio signal received from the microphone MIC to digital and provides it to the controller 160. The speaker SPK converts an audio signal received from the audio processor 150 into a sound wave and outputs the sound wave. A microphone (MIC) converts sound waves transmitted from a person or other sound sources into an audio signal.

The controller 160 controls the overall operation of the mobile terminal 100 and a signal flow between internal components of the mobile terminal 100, performs a function of processing data, and controls a power supply from the battery to the components. do. The controller 160 includes a central processing unit (CPU) and a graphic processing unit (GPU). As is well known, the CPU is an essential control unit of a computer system that performs computation and comparison of data, interprets and executes instructions, and the like. The GPU is a graphic control unit that performs calculation and comparison of data related to graphics, interpretation and execution of instructions, etc. on behalf of the CPU. Each of the CPU and GPU can be integrated into one package of two or more independent cores (eg quad-cores) in a single integrated circuit. In addition, the CPU and GPU may be integrated into one chip (System on Chip). In addition, the CPU and GPU may be packaged in a multi-layer. Meanwhile, a configuration including a CPU and a GPU may be referred to as an application processor (AP).

The controller 160 includes a main memory unit, for example, RAM. The main memory stores various programs loaded from the storage 130, for example, a booting program, a host operating system, guest operating systems, and applications. In other words, the CPU and GPU of the control unit 161 access such a program, decode the instruction of the program, and execute a function (eg, a pop-up function) according to the decryption result. In addition, the controller 160 includes a cache memory that temporarily stores data to be written in the storage unit 130 and temporarily stores data read from the storage unit 130.

The controller 160 operates the mobile terminal 100 using the size information and the display area information stored in the storage 130. For example, when an event for requesting the display of the keypad occurs, the controller 160 reads size information and display area information corresponding to the keypad from the storage 130 and displays the keypad on the display area based on the read information. The display unit 130 is controlled to control the display unit 130.

The controller 160 operates the mobile terminal 100 using the setting values stored in the storage 130. For example, when a video is displayed, the controller 160 reads a "value indicating whether the pop-up function is used" from the storage 130 and determines whether to use the pop-up function based on this value. If it is determined to use the pop-up function, the controller 160 reads the "value indicating whether the position change table 131 is used" from the storage unit 130 and uses the position change table 131 based on the value. Determine whether or not. Meanwhile, whether to execute the popup function may be determined regardless of the corresponding setting value. For example, the display unit 11 displays a popup function button together with a video. These buttons may be displayed semi-transparently over the video or in a separate area. If the user selects a button, the controller 160 executes a pop-up function. In this case, “ON” may be displayed on the button. If the user selects the button again, the controller 160 ends the pop-up function. In this case, “OFF” may be displayed on the button. The image that is the target of the pop-up function is not limited to a video, but may be another image (eg, a picture, a still image, a memo, map information, etc.). That is, in addition to the video, other images may always be displayed on the top layer of the screen.

When it is determined to use the position change table 131, the controller 160 reads the position change table 131 shown in Table 1 from the storage 130. The controller 160 changes the display position of the image with reference to the position change table 131. For example, a video is displayed at the bottom of the screen. At this time, an event (eg, a user taps a text input field on a web page) is generated to request display of a keypad. Then, the controller 160 controls the display unit 110 to display the video on the top of the screen and the keypad on the bottom of the screen. That is, the video moves from the bottom of the screen to the top. Of course, the opposite can also be true. That is, the video may be displayed at the bottom of the screen as it is and the keypad may be displayed at the top of the screen. Meanwhile, whether to execute the position change function may be determined regardless of the position change table 131. That is, the controller 160 may change the display position of the image without using the position change table 131. Specific examples thereof will be described in detail with reference to the accompanying drawings.

On the other hand, according to the convergence (convergence) trend of the digital device is very diverse and can not be enumerated, the mobile terminal 100 is a camera, GPS module, vibration motor, accessories, external device interface (eg, ear jack), It may further include components not mentioned above, such as an acceleration sensor. Here, the accessory may be an accessory of the portable terminal 100 that can be detached from the portable terminal 100, and may be, for example, a pen for touching the screen of the display unit 110. In addition, the mobile terminal 100 may be omitted from the above configuration or replaced with another configuration according to the form of the provision.

2 is a flowchart illustrating an image display method according to an embodiment of the present invention. 3A to 3D, 4A, and 4B are diagrams for describing an image display method according to an exemplary embodiment.

Referring to FIG. 2, in step 210, the controller 160 determines whether a first event for requesting display of a video occurs. The first event may be a user gesture (eg, a user taps a thumbnail indicating a corresponding video) on the display unit 110 or a key event generated by the key input unit 130. The first event may also be voice data. For example, the name of the video is displayed, and the user speaks the name of the video, for example, "Titanic", toward the microphone MIC. Then, the microphone MIC receives the user's voice, converts it into an audio signal, and transmits the converted audio signal to the audio processor 150. The controller 160 receives voice data from the audio processor 150, converts the received voice data into text, and determines that the first event has occurred when the text includes, for example, “Titanic”. On the other hand, the user says "play Titanic" toward the microphone (MIC). Then, the controller 160 determines the user's intention by using an artificial intelligence program and determines that the first event has occurred. In this case, the video and the artificial intelligence program may be provided in an external server instead of the mobile terminal 100. If so, the controller 160 controls the wireless communication unit 140 to transmit a video request message including the corresponding voice data to the server. In response, the server analyzes the voice data to determine the user's intention and transmits the video to the mobile terminal 100. When the video is received, the controller 160 determines that the first event has occurred.

When the first event occurs, in step 215, the controller 160 determines a first area in which a video is to be displayed. For example, the controller 160 reads display area information from the storage 130 and determines a first area to display a video based on the read information. For example, as illustrated in FIG. 3A, the size of the screen is 640 * 380, and the display area information is (0,0), (0, 213), (380, 213), and (380, 0). Then, the first region is determined as 310 in FIG. 3A. In operation 220, the controller 160 controls the display 110 to display the video 320 in the first area. In addition, the controller 160 performs a popup function. The display area information may be one coordinate, for example, (107, 190). If so, the first area may be determined to be an area centered on 107 and 190.

In operation 225, the controller 160 determines whether a second event occurs. If the second event did not occur, the process proceeds to step 230. In operation 230, the controller 160 determines whether to end the display of the video. For example, when the end button displayed on the display 110 becomes a tap, the process ends. Otherwise the process returns to step 225.

When the second event occurs, in step 235, the controller 160 determines a second area to display an image related to the second event. For example, the controller 160 reads display area information corresponding to the second event from the storage 130 and determines the area corresponding to the read display area information as the second area. For example, the keypad is determined at the bottom of the screen. Caller information (eg, name and phone number) requesting a call is determined at the top of the screen. An image (eg, including a call acceptance icon and a call rejection icon) for allowing a user to select whether the caller accepts the call request is determined at the bottom of the screen. The notification image for notifying the reception of a message such as a short message service (SMS) message, a multimedia message service (MMS) message, a social network service (SNS) message, an e-mail, and a news is determined at the top or the center of the screen.

In operation 240, the controller 160 determines whether the second event is a predetermined specific event. The predetermined specific event may be a keypad display request event received from the touch panel 111 or the key input unit 120 and voice data received from the microphone MIC through the audio processor 150 (eg, a voice called “keypad”). And various messages (eg, a call request message, a short message service (SMS) message, a multimedia message service (MMS) message, a social network service (SNS)) received from a network (eg, a base station) through the wireless communication unit 140. Messages, emails, news, etc.). When a specific event is a call request message (especially, a video call request message), video playback may be paused. That is, when a call request message is received from the network through the wireless communication unit 140, the controller 160 controls the display unit 110 to continuously display one frame. Here, the frame is a still image constituting moving images. For example, one second video consists of 30 frames. Meanwhile, when a function (eg, a call) according to the call request message ends, the pause is released and a video is displayed. In addition, when a video call message is received, the video may be continuously played without stopping. For example, the controller 160 controls the display unit 110 to display a video on the video display area and display the video on the video display area. Here, the two regions may not overlap each other under the control of the controller 160. The call image includes a video received from the counterpart terminal and a video captured by the camera (that is, a video to be sent to the counterpart terminal).

If the second event is not the specific event, the process proceeds to step 245. In operation 245, the controller 160 performs a function corresponding to the second event. For example, when the second event is a tab for the Internet icon 330 (see FIG. 3B), the controller 160 displays the web page 340 (see FIG. 3C) on the second area (eg, the entire screen). To control. At this time, the video 320 is located on the top floor. Thus, as shown in FIG. 3C, a part of the web page 340 is not displayed. After the function corresponding to the second event is performed, the process returns to step 225.

If the second event is a specific event, in step 250, the controller 160 checks whether the second area overlaps with the first area. Here, the overlap means that a part of the second region overlaps with the first region, the second region is included in the first region, or the first region is included in the second region.

If the two regions do not overlap, the process proceeds to step 255. In operation 255, the controller 160 controls the display unit 110 to display an image in the second area. Accordingly, the video and the image are displayed on the top layer of the screen without overlapping each other.

If the two regions overlap, in step 260, the controller 160 determines a third region that does not overlap the second region. As an example, the control unit 160, as shown in Figure 3c, the four coordinates (x1, y1), (x1, y2), (x2, y2) and ( x2, y1) is determined, and the third region 360 is determined based on the identified four coordinates. That is, the rectangular region having four coordinates as the vertex is determined as the third region 360.

As another example, the controller 160 reads the position change table 131 from the storage 130. For example, when the specific event is a keypad display request event (eg, a user's tap on the text input field 380), the controller 160 confirms that the corresponding location information is “top of the screen”. Therefore, the controller 160 determines the third area based on the identified location information.

In operation 265, the controller 160 controls the display unit 110 to display an image in the second area and display the video in the third area. Accordingly, the video and the image are displayed on the top layer of the screen without overlapping each other. Meanwhile, the second region may include a plurality of regions separated from each other. For example, referring to FIG. 4A, the first area 410 is determined as the bottom of the screen so that the video 420 is displayed in the first area 410. Subsequently, in response to receiving the call request message, the second-first area 421 to display the caller information 431 is determined as the top of the screen, and the second-second to display the call acceptance icon 432 and the call rejection icon 433. The second area 422 is determined as the bottom of the screen. In this case, the second-second area 422 overlaps with the first area 410. Accordingly, the third region 440 is determined as the center of the screen, and the video 420 is reduced and displayed on the third region 440.

5 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention. 6 is a diagram for describing an image display method according to another exemplary embodiment.

Referring to FIG. 5, in step 510, the controller 160 controls the display unit 110 to display a video in the first area 610 (see FIG. 6) of the screen. In addition, the controller 160 performs a popup function.

In operation 515, the controller 160 determines whether an event occurs. If no event occurs, the process proceeds to step 520. In operation 520, the controller 160 determines whether to end the display of the video. If the display of the video has not ended, the process returns to step 515.

If an event occurs, in step 525, the controller 160 determines a second area in which to display an image related to the event.

In operation 530, the controller 160 determines whether the event is a predetermined specific event.

If the event is not a specific event, the process proceeds to step 535. After the function corresponding to the event is performed by the controller 160 in step 535, the process returns to step 515.

If the event is a specific event, in step 540, the controller 160 determines whether the second area overlaps with the first area.

If the two regions do not overlap, the process proceeds to step 545. In operation 545, the controller 160 controls the display unit 110 to display an image in the second area.

When the two regions overlap (eg, when the second region 620 is included in the first region 610 as shown in FIG. 6), in operation 550, the controller 160 may include a third region that does not overlap the first region. Determine the area. For example, the controller 160 reads the position change table 131 from the storage 130. The controller 160 checks the location information (eg, bottom of the bottom surface) corresponding to the specific event (eg, message reception) that occurred in the location change table 131. The controller 160 determines the third area based on the identified location information.

In operation 555, the controller 160 controls the display unit 110 to display the image 630 on the third region 640. Accordingly, the video 650 and the image 630 are displayed on the top layer of the screen without overlapping each other.

7 is a flowchart illustrating an image display method according to another embodiment of the present invention. 8A through 8C are diagrams for describing an image display method, according to another exemplary embodiment.

Referring to FIG. 7, in operation 710, the controller 160 controls the display unit 110 to display the video 820 in the first area 810 of the screen. In addition, the controller 160 performs a popup function.

In operation 715, the controller 160 determines whether the first event occurs. If the first event did not occur, the process proceeds to step 720. In operation 720, the controller 160 determines whether to end displaying the video. If the display of the video has not ended, the process returns to step 715.

When the first event occurs, in step 725, the controller 160 determines a second area to display an image related to the first event.

In operation 730, the controller 160 determines whether the event is a predetermined specific event.

If the first event is not the specific event, the process proceeds to step 735. After the function corresponding to the first event is performed by the controller 160 in step 735, the process returns to step 715.

If the first event is a specific event, in step 740, the controller 160 determines whether the second area overlaps the first area 810.

If the two regions do not overlap, the process proceeds to step 745. In operation 745, the controller 160 controls the display unit 110 to display an image in the second area.

If the two regions overlap (eg, when a portion of the second region 830 overlaps the first region 810 as shown in FIG. 8A), the controller 160 controls the image 840 to display the second image 840 in step 750. The display unit 110 is controlled to display the area 830. In addition, the controller 160 controls the display unit 110 to semi-transparently display a portion 821 overlapping the image 840 in the video 820. Accordingly, not only the entire video 820 but also the entire image 840 can be identified. When the touch event occurs in the overlapping portion 821, the controller 160 determines that the touch event is an event related to the image 840 instead of the video 820. Meanwhile, the portion 821 overlapping with the image 840 in the video 820 may not be displayed. That is, although the pop-up function is being performed, in this case, the image 840 is located on the high floor and the video 820 is located on the low floor.

In operation 755, the controller 160 determines whether a second event for requesting a location change of the video 820 occurs. The second event may be a user gesture for the display unit 110 (eg, an upward flick 850 for the video 820) or a key event generated in the key input unit 130. The second event may also be audio data (eg, "change video position"). As the video 820 moves upward, there is a portion that does not overlap the image 840. Then, the controller 160 recognizes such a part and controls the display unit 110 to display the recognized part opaquely.

In operation 760, the controller 160 controls the display unit 110 to display the video 820 in the third region 860 in response to the second event. As shown in FIG. 8C, the third region 860 does not overlap the second region 830.

9 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention. 10A to 10C are diagrams for describing an image display method according to another exemplary embodiment of the present invention.

Referring to FIG. 9, in operation 910, the controller 160 controls the display unit 110 to display a video 1020 in the first area 1010 of the screen. In addition, the controller 160 performs a popup function.

In operation 915, the controller 160 determines whether an event occurs. If no event occurs, the process proceeds to step 920. In operation 920, the controller 160 determines whether to end the display of the video. If the display of the video has not ended, the process returns to step 915.

If an event occurs, in step 925, the controller 160 determines a second area in which to display an image related to the event.

In operation 930, the controller 160 determines whether the event is a predetermined specific event.

If the event is not a specific event, the process proceeds to step 935. After the function corresponding to the event is performed by the controller 160 in step 935, the process returns to step 915.

If the event is a specific event, in step 940, the controller 160 determines whether the second area overlaps with the first area 1010.

If the two regions do not overlap, the process proceeds to step 945. In operation 945, the controller 160 controls the display unit 110 to display an image in the second area.

If the two regions overlap (eg, when a portion of the second region 1030 overlaps the first region 1010 as shown in FIG. 10), the controller 160 displays the direction icons 1041 to 1043 in step 950. The display unit 110 is controlled to display (). That is, the direction icons 1041 to 1043 are guide images for changing the position of the video 1020. This guide image may be a message 1040 as shown in FIG. 10B, instead of directional icons. The message 1040 disappears after being displayed for a predetermined time (eg, 2 seconds). The controller 160 controls the display unit 110 to display the positioning icons 1051 to 1053 as shown in FIG. 10C after the message 1040 disappears.

In operation 955, the controller 160 determines whether the user selects a direction icon (or a positioning icon).

When the selection of the direction icon (or the positioning icon) is detected, in step 960, the controller 160 controls the display unit 110 to display an image in the second area 1030. In addition, the controller 160 controls the display unit 110 to display the video 1020 in a third area corresponding to the selected direction icon (or positioning icon).

11 is a flowchart illustrating an image display method according to another exemplary embodiment of the present invention. 12A to 12C are diagrams for describing an image display method according to another exemplary embodiment of the present invention.

Referring to FIG. 11, in step 1110, the controller 160 controls the display 110 to display the event list 1210. In one example, the display unit 110 displays a home image including an environment setting icon. When the environment setting icon is selected, the controller 160 controls the display unit 110 to display an environment setting image including a location change menu. When the location change menu is selected, the event list 1210 as shown in FIG. 12A is displayed.

In operation 1120, the controller 160 determines whether the user selects one event icon from the event list 1210.

When the selection of the event icon is detected, in step 1130, the controller 160 controls the display 110 to display the positioning icons 1221 to 1229 as shown in FIG. 12B. That is, the positioning icons 1221 to 1229 are guide images for setting location information corresponding to the event. The guide image may be direction icons 1231 to 1238 as shown in FIG. 12C.

In operation 1140, the controller 160 determines whether the user selects a positioning icon (or a direction icon).

When the selection of the positioning icon (or direction icon) is detected, in step 1150, the controller 160 maps the event information corresponding to the selected event icon and the location information corresponding to the selected positioning icon (or direction icon) and stores the storage unit. Save to 130.

In the meantime, the above-described examples have been described assuming that the display mode is a portrait mode, that is, a portrait mode. Of course, the present invention is also implemented in landscape mode, that is, landscape mode. The mobile terminal 100 further includes a sensor capable of detecting a posture of the mobile terminal, for example, an acceleration sensor. The acceleration sensor detects acceleration (eg, X-axis acceleration, Y-axis acceleration, and Z-axis acceleration) of the mobile terminal 100 and changes thereof, and generates sensing information and transmits the detected information to the controller 160. The controller 160 calculates a posture, for example, inclination information (eg, rotation angles about each of the X, Y, and Z axes) of the mobile terminal 100 using the sensed information transmitted from the acceleration sensor. Often, the rotation angle around the X axis is called the roll angle, the rotation angle around the Y axis is called the pitch angle, and the rotation angle around the Z axis is called the yaw angle. The controller 160 determines the display mode of the mobile terminal 100 using the calculated slope information. Of course, the display mode may be fixed as desired by the user regardless of the posture of the portable terminal 100. However, if it is not fixed (for example, if the automatic screen rotation function is set), the controller 160 determines the display mode using the tilt information.

13A and 13B are diagrams for describing an image display method in a landscape mode.

13A and 13B, the controller 160 performs a popup function. That is, the display unit 110 displays the video 1310 on the left side of the screen under the control of the controller 160. In this case, a specific event (eg, a user's tap for the text input field 1320) occurs. Then, the display unit 110 displays the video 1310 at the center of the screen under the control of the controller 160, displays the left keypad 1331 of the split keypad on the left side of the screen, and displays the right keypad 1332. Displayed on the right side of the screen.

The image display method according to the present invention as described above may be implemented in program instructions that can be executed by various computers, and recorded in a computer-readable recording medium. The recording medium may include program instructions, data files, data structures, and the like. The program instructions may also be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. The recording medium also includes magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic-optical such as floppy disks. Hardware devices such as magneto-optical media, ROM, RAM, flash memory, and the like may be included. In addition, the program instructions may include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter. The hardware device may be configured to operate as one or more software modules to carry out the present invention.

The image display method and the portable terminal according to the present invention are not limited to the above-described embodiments, and various modifications can be made within the range allowed by the technical idea of the present invention.

100: mobile terminal
110: display unit 111: touch panel
120: key input unit 130: storage unit
131: position change table 132: video player
140: wireless communication unit 150: audio processing unit
160: control unit

Claims (29)

In a portable electronic device,
touch screen;
A processor; And
Memory,
The memory, when executed, is executed by the processor:
Providing a first window to the touch screen,
Providing a second window displaying a video over a portion of the first window,
Detect user input while the second window is provided over a portion of the first window,
In response to the detection of the user input, when it is determined that the second window overlaps the keyboard when the keyboard is displayed on the touch screen, the second window is moved on the touch screen, and in the moved second window Storing instructions for displaying the keyboard on the first window while displaying the video,
The first window has a text input portion displayed on the touch screen and a portion not including the text input portion,
The moved second window is located on a portion not including the text input portion,
The moved second window does not overlap the displayed keyboard and the text input portion. The method of claim 1,
The instructions cause the processor to move the second window from the first portion of the touchscreen to the second portion of the touchscreen when it is determined that the second window is provided in the first portion of the touchscreen. ,
The second window moved to the second portion does not overlap the displayed keyboard. The portable electronic device of claim 1, wherein the first window is displayed on a full screen, and a second window is provided on the first window. The portable electronic device of claim 2, wherein the video is displayed under the touch screen as the first portion before the moving. The portable electronic device of claim 1, wherein the text input portion is displayed on an upper portion of the touch screen. The portable electronic device of claim 1, wherein the moved second window does not overlap with the displayed keyboard, the text input portion, and a third window provided by the touch screen. The portable electronic device of claim 6, wherein the third window comprises a message or a notification window. The method of claim 1,
The first window comprises a web page,
The video is displayed on the web page. The method of claim 1,
And the size and position of the second window are manually adjusted. The method of claim 1, wherein the instructions comprise at least one of:
While the video is displayed, if a call connection request message is received for call initiation, the playback of the video is paused.
And release the pause when the call is disconnected. The method of claim 2, wherein the instructions comprise at least one of:
Reduce the second window displaying the video,
And display the reduced second window on a third portion of the touch screen. The method of claim 2, wherein the memory,
And store position change information defining mapping relations between the first portion and the second portion. The method of claim 1, wherein the instructions comprise at least one of:
A portable electronic device for separating the displayed keyboard into a left keyboard and a right keyboard. The method of claim 13, wherein the instructions comprise at least one of:
And provide the second window for displaying the video between the left keyboard and the right keyboard. The portable electronic device of claim 2, wherein when the second window is moved to display the keyboard in the first portion, the boundary of the moved second window is in substantially contact with the boundary of the keyboard. In the method for displaying a window in a portable electronic device,
Providing a first window to the touch screen;
Providing a second window displaying a video over a portion of the first window;
Detecting user input while the second window is provided over a portion of the first window; And
In response to detecting the user input, when it is determined that the second window overlaps with the keyboard when the keyboard is displayed on the touch screen, the second window is moved on the touch screen, and in the moved second window Displaying the keyboard on the first window while displaying the video;
The first window has a text input portion displayed on the touch screen and a portion not including the text input portion,
The moved second window is located on a portion not including the text input portion,
The moved second window does not overlap the displayed keyboard and the text input portion. The method of claim 16,
When it is determined that the second window is provided in the first portion of the touch screen, moving the second window may include moving the second window from the first portion of the touch screen to the second portion of the touch screen. Move to,
The second window moved to the second portion does not overlap the displayed keyboard. The method of claim 16, wherein the first window is displayed on a full screen and a second window is provided on the first window. The method of claim 17, wherein the video is displayed below the touch screen as the first portion before the moving. The method of claim 16, wherein the text input portion is displayed on top of the touch screen. The method of claim 16, wherein the moved second window is positioned at a position not overlapping with the displayed keyboard, the text input portion, and a third window provided by the touch screen. The method of claim 21, wherein the third window comprises a message or notification window. The method of claim 16,
The first window comprises a web page,
The video is displayed on the web page. The method of claim 16,
Pausing playback of the video when a call connection request message is received for call initiation while the video is displayed; And
Canceling the pause when the call is disconnected. The method of claim 17,
Reducing the second window displaying the video; And
And displaying the reduced second window on a third portion of the touch screen. The method of claim 17,
Storing location change information defining mapping relations between the first portion and the second portion in a memory of the portable electronic device. The method of claim 16,
Separating the displayed keyboard into a left keyboard and a right keyboard. The method of claim 27,
And providing the second window displaying the video between the left keyboard and the right keyboard. In a portable electronic device,
touch screen; And a processor,
The processor,
Displaying a web browser including a text input portion and a portion not including the text input portion on the entire screen of the touch screen;
Provide a pop-up window displaying a video over a portion of the web browser,
While the web browser is displayed and the pop-up window is provided over a portion of the web browser, detecting user input in the text input portion,
In response to the detection of the user input, when the popup window is being provided at a first screen position, move the popup window from the first screen position to a second screen position and display the video in the moved popup window. While displaying the keyboard so that it does not overlap the second screen position,
The text input portion does not overlap the video,
The moved pop-up window is located on a portion where the text input portion is not included.

Images