KR20090132140A - Method of utilizing sub display unit in handheld terminal and handheld terminal performing the method - Google Patents

Abstract

PURPOSE: A method for utilizing a sub-display unit of a portable terminal and the same sub-display using the same are provided to display an event map set in different colors or different background patterns on a sub-screen by discriminating kinds of user events. CONSTITUTION: A sub-display unit(200) indicates information related to a main display unit(100). A control unit discriminates an image region to be displayed in the main display unit according to a user interface displayed in the main display unit. The control unit composes an event map for displaying the discriminated regions, respectively. The control unit controls the sub-display unit in order to display the event map using the sub-display unit.

Description

TECHNICAL FIELD OF THE INVENTION Auxiliary display unit utilization in a portable terminal and a portable terminal using the same {METHOD OF UTILIZING SUB DISPLAY UNIT IN HANDHELD TERMINAL AND HANDHELD TERMINAL PERFORMING THE METHOD}

The present invention relates to a method of utilizing an auxiliary display unit, and more particularly, to a method of using an auxiliary display unit in a portable terminal using a dual screen and a portable terminal using the same.

Recently, terminals provide various functions and services to meet user needs, while keypads having a fixed matrix arrangement are still mainly used as user input devices. For example, even when the display screen of color and high resolution is adopted in the terminal and the appearance and slimness and miniaturization are in progress, the user input device has not changed much from the conventional keypad type input device.

It is expected that a large number of terminals produced in the future as an alternative to the user interface using the keypad will be adopted as a touch type user interface such as a touch pad or a touch screen. This is a result of reducing the cost of the touch interface device and the problem of low reliability and life of the conventional touch interface device.

A touch pad is a flat plate equipped with a pressure sensor. When a touch is made using a finger or a pen, a touch pad senses pressure to move an indicator on the screen, and the computer recognizes the position information.

The touch screen includes a position sensor that outputs the coordinates of the touch point when a point on the display screen is touched with a finger or the like. For example, a device in which the display screen serves as a touch pad may be defined as a touch screen.

Such touch-type input devices include a pressure resistive film method, a contact capacitance method, a surface acoustic wave (SAW) method, an infrared light sensing method, and a piezoelectric method. Among them, the pressure-sensitive resistive method which is high in transmittance, fast in response and excellent in resistance is less affected by the operating environment.

In particular, the touch screen can provide a user with an interactive and immediate correspondence between the contents displayed on the screen and the contents input through the screen, and various types of inputs are possible to provide high user satisfaction and ease of use. can do. That is, as a concept of integrating an output device and an input device constituting a user interface as compared to a standard user input device such as a keypad having a fixed arrangement, various types of inputs and outputs can be simultaneously performed. In particular, while changing from a conventional low-resolution text-based interface consisting of numbers and letters to a high-resolution graphic-based interface, it becomes possible to realize input through graphic-based objects, and to replace the keypad, the keypad installation area can be omitted. Therefore, it is also possible to display a relatively large screen in a terminal having the same volume.

Such touch screens are often used in the form of dual screens divided into smaller sub-screens than the main screen and the main screen. The sub screen mainly handles notification events that the user should notify in order to reduce power consumption before using the main screen. In addition, if the user is watching a video on the home screen, the notification event is displayed on the home screen to prevent the user from stopping the video being watched by an insignificant event. It is common. Such notification events include message reception, alarms, shadow area entry, low battery, call reception, and missed notification.

In the case of the existing dual screen, since the main screen handles all events, it is not easy for the user to intuitively know which user events can be handled by the touch screen in the current UI (User Interface) state.

Accordingly, the present invention provides a portable terminal for displaying an event map set on a sub screen by dividing the types of user events that can be handled in a specific area according to the user interface state of the main screen and setting them to different colors or background patterns. It is an object of the present invention to provide a method of using the auxiliary display unit and a portable terminal using the same.

According to an aspect of the present invention, a portable terminal includes a main display unit, an auxiliary display unit for displaying information related to the main display unit, and a user interface displayed on the main display unit. And a controller for classifying regions of an image displayed on the main display unit according to a state, creating an event map for distinguishing and displaying each divided region, and for causing the auxiliary display unit to display the event map.

Each of the divided regions may be displayed in different colors, or may be displayed using different background patterns.

Each divided area of the event map may include at least one of a non-touchable area, a scrollable area, a key clickable area, and a gesture input area.

The controller may create an event map by capturing an image stored in a buffer of the main display unit and resizing the captured image to a size of the auxiliary display unit.

The controller may also create the event map by dividing the image into at least one area according to the type of event, and assigning different background patterns or different colors to each of the divided areas.

The background pattern is a pattern formed using at least one of an oblique line, a double line, a point island, and a check.

According to another aspect of the present invention, a method of using an auxiliary display unit in a portable terminal includes a main display unit and an auxiliary display unit displaying information related to the main display unit. Classifying areas of an image displayed on the main display unit according to a state of a user interface displayed on a display unit, creating an event map for distinguishing and displaying each divided area; and displaying the generated event map on the secondary display. Displaying on the part.

The generating of the event map may include capturing an image stored in a buffer of the main display unit and resizing the captured image to a size of the secondary display unit.

The generating of the event map may further include dividing the image into at least one region according to an event type, and assigning different background patterns or different colors to each divided region.

According to another aspect of the present invention, a portable terminal may display a first display unit, a second display unit, and the first display unit according to a user event state associated with a touch input of a user interface displayed on the first display unit. And a controller configured to classify regions of the image, create an event map having different background patterns or different colors for each of the divided regions, and cause the second display unit to display the event map.

A display method of a portable terminal according to another aspect of the present invention is a display method of a portable terminal including a first display unit and a second display unit, the user event associated with the touch input of the user interface displayed on the first display unit Dividing the regions of the image displayed on the first display unit according to a state, creating an event map with different background patterns or different colors for each of the divided regions, and generating the created event map. 2 displaying on the display unit.

According to the present invention, by sorting the types of user events that can be processed in a specific area according to the state of the user interface of the main screen, by displaying each area in a different form and expressing it on the sub-screen, the user on the sub-screen By viewing the displayed display pattern, it is possible to recognize the event type of the main screen at a glance, thereby increasing convenience of the user of the portable terminal.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention. In describing the drawings, similar reference numerals are used for similar elements.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In this application, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The gesture input used in the present invention means a unique input pattern that is distinguished when the touch on the touch screen is made of a unique pattern. For example, a touch action on a touch screen draws a trajectory in a series of predetermined directions (e.g., a straight line leading to the right, a straight line leading upwards), or a trajectory in a predetermined change pattern of direction (e.g., clockwise direction). Or a circular trajectory drawn in a counterclockwise direction, drawing a shape of a predetermined figure (eg, 'O', 'X', etc.), or a combination of straight lines and / or curves having a predetermined direction (eg, the letter 'A'). Form, 'b' form), etc., it is possible to uniquely identify the pattern of the touch input. This is defined as gesture input.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as having meanings consistent with the meanings in the context of the related art, and are not construed in ideal or excessively formal meanings unless expressly defined in this application. Do not.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. Hereinafter, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1A illustrates a main display unit and an auxiliary display unit according to an embodiment of the present invention before an event occurs.

As shown in FIG. 1A, the dual screen according to the present invention includes a main display unit 100 and an auxiliary display unit 200, and the auxiliary display unit 200 includes information related to the main display unit 100. Is displayed. The main display unit 100 and the sub display unit 200 according to the present invention not only perform image display, but also input through touch, respectively. In addition, depending on which function the portable terminal supports, one of the main display unit and the auxiliary display unit may be implemented to perform only a display function.

Preferably, the main display unit 100 is a 2.2-inch thin film transistor (TFT) liquid crystal display (LCD), and the sub display unit 200 is smaller than the main display unit 100. Implemented as PMOLED (Passive Matrix Organic Light Emitting Diode). In addition, the resolution of the main display unit 100 may be set to 260K, and the resolution of the secondary display unit 200 to 65K.

As described above, in the portable terminal to which the dual screen is applied, the secondary display unit 200 having a smaller size and lower resolution than the main display unit 100 assists the main display unit 100. For example, when the portable terminal receives a message while a specific application is running in the main display unit 100, the secondary display unit 200 may perform a function of notifying the arrival of the message.

FIG. 1A illustrates a case where both the main display unit 100 and the sub display unit 200 are in a sleep state or an off state. That is, it indicates a state in which no event occurs in the portable terminal.

1B illustrates a main display unit and an auxiliary display unit of a portable terminal according to an embodiment of the present invention when a notification pop-up event occurs.

FIG. 1B is an alarm set by a user when a portable terminal in a sleep state as shown in FIG. 1A receives a specific event, for example, a call or a message, when a low battery notification occurs, or notifies a shaded area. When this occurs, it indicates a state that a notification pop-up event such as the case of the missed notification occurred.

In the dual screen of FIG. 1B, the main display unit 100 is still in an off state, and only the auxiliary display unit 200 is in an ON state. In this case, according to an exemplary embodiment of the present invention, the auxiliary display unit 200 displays a notification event informing that there are N new messages. According to another embodiment of the present invention, the secondary display unit 200 displays a notification event indicating that the battery is low (Low Battery) or the shadow area status (No Service Status). According to another exemplary embodiment, the auxiliary display unit 200 displays a notification event indicating that a call is received from the caller 'Hong Gil Dong'. Meanwhile, according to another exemplary embodiment, when there is no special event, when the auxiliary display unit 200 is touched, the current time is displayed.

FIG. 1C illustrates a main display unit and an auxiliary display unit of a portable terminal according to an embodiment of the present invention when the user confirms the notification message of the auxiliary display unit shown in FIG. 1B and touches the main display unit.

That is, when the user who checks the notification event displayed on the auxiliary display unit 200 as shown in FIG. 1B selects the corresponding event or touches the main display unit 100, the main display unit 100 is activated to display the selected notification event. Display the contents.

In this case, the secondary display unit 200 displays an event map related to a user event related to the image currently displayed on the main display unit 100. In the event map displayed on the auxiliary display unit 200, types of user events that can be processed in a corresponding area are displayed according to the state of the user interface displayed by the main display unit 100 and provided to the user.

According to an exemplary embodiment of the method for classifying and displaying the types of such events, there is a method of displaying and assigning different colors to each type of event. A method of displaying different background patterns (for example, patterns using diagonal lines, dotted lines, double lines, checkered patterns, etc.) for regions may be used.

In other words, the main display unit 100 shown in FIG. It consists of a key click provided to select or reply to. The secondary display unit 200 classifies the event type of the main display unit 100 and displays the area according to each event using a different background pattern or a different color. For example, the non-touchable area displaying the received message in the main display unit 100 is displayed in red to indicate that the non-touchable area 210 is displayed, and the scroll bar located on the right side is displayed in yellow. It may indicate that the scrollable region 230 is displayed. Also, the key click may be displayed in green to indicate that the scrollable region 230 is a key clickable region 220.

That is, the auxiliary display unit 200 includes at least one region of the image displayed on the main display unit 100 according to whether the touch input is possible from the side of the touch input or, if possible, the touch input. By distinguishing and displaying each divided area with a different background pattern or a different color, the background pattern provided on the secondary display 200 allows the user to display the types of user events applicable to the main display unit 100. Intuitively judge by color.

In the foregoing description, although the display of the main display unit and the auxiliary display unit has been described as an example of displaying a text message, it should be understood that the present invention can be applied to various other embodiments.

In the photo editing user interface according to an embodiment of the present invention, an area set to be able to control photo editing such as pasting, cutting, copying, and deleting a photo and enlargement and reduction of the photo by a touch input called a user gesture, next photo Different patterns (e.g. diagonal lines, dotted lines, double lines, checks, etc.) for areas where the key is set to be displayed for display, and areas that are set to display the remaining parts when the picture is enlarged and it is impossible to display all on one screen. Etc.) or another color and displayed on the secondary display so that the user can grasp the event on the main display at a glance.

According to another embodiment, when a plurality of applications such as a widget is executed on the standby screen of the main display unit, a user gesture input area for handling drag and drop and a hotkey interface and a switchable area between the widget application, and Areas for interfacing with applications such as menus or phonebooks / messages may be displayed by dividing the area or the like into a color or a background pattern to intuitively provide the user with information about the event processing area.

2 is a schematic flowchart of a method of using an auxiliary display unit in a portable terminal having a dual display unit according to an exemplary embodiment of the present invention.

The portable terminal according to the present invention continuously checks whether a notification event occurs in a state in which both the main display unit and the sub display unit are in a sleep or off state (S201). Notification events include message reception, alarms, shadow area entry, low battery, call reception, and missed notifications. When such a notification event occurs, the portable terminal displays the corresponding notification event on the auxiliary display unit (S202).

When the user who checks the displayed notification event selects the notification event (YES in S203), an image stored in the buffer of the main display unit is captured (S204). At this time, the image stored in the buffer is displayed on the main display unit.

The portable terminal according to the present invention resizes the captured image to the size of the auxiliary display unit (S205). In addition, the captured image is divided into at least one area according to possible user events (S206). The portable terminal completes an event map by matching a background pattern or color corresponding to each area classified according to the event type (S207). In this case, the pattern or color set in each area may be set at the time of manufacture of the portable terminal, and then may be changed and set by the user. Finally, the portable terminal displays the thus completed event map on the secondary display unit (S208).

3 is a block diagram illustrating a portable terminal for performing text input according to an embodiment of the present invention.

The portable terminal according to the present invention includes a touch screen input unit 310, a key input unit 320, a camera module unit 330, a microphone 340, a control unit 350, a storage unit 360, a display unit 370, Speaker 380, a wireless transceiver 390 and the like. Herein, the controller 350 may include a touch screen controller 351 and a central controller 353. The main display unit and the auxiliary display unit according to the present invention may include a touch screen input unit 310 and a display unit 320. It can be understood as a concept. That is, the main display unit and the auxiliary display unit shown in FIG. 1A and FIG. 1C visually distinguish and represent the portable terminal according to the present invention, and the touch screen input unit 310 and the display unit 320 in FIG. 3 are functionally divided. It can be understood as expressed.

Referring to FIG. 3, the touch screen input unit 310 receives at least one touch input from a user, converts it into a potential difference, a capacitance, a wavelength, or an IR optical interrupt, and converts the converted result into a touch screen controller ( 351). Here, the touch screen input unit 310 may include a touch screen and may include a touch pad in addition to the touch screen. In FIG. 3, the touch screen input unit 310 is configured as one block. However, in the dual screen to which the present invention is applied, the touch screen input unit 310 may be divided into a first block and a second touch screen input unit. It should be understood.

The touch screen controller 320 receives a value having a form of a potential difference, a capacitance, a wavelength, or an IR optical interrupt for a predetermined touch input from the touch screen input unit 310, and coordinates such as (X, Y). The value is converted into a value form, and the converted result is output to the controller 330.

The key input unit 320 receives a key input on a keypad from a user, converts the key input into the form of a key code corresponding to the key input, and outputs the converted key code to the central controller 353. Here, the key input unit 320 may be omitted when the portable terminal device according to the present invention is implemented as a front touch screen.

The camera module unit 330 converts the captured image image into a form of displayable image data through image processing, and outputs the image data to the central controller 353. The camera module unit 330 may include a camera (not shown) and an image processor (not shown) including a CMOS image sensor or a CCD image sensor.

The microphone 340 converts the ambient sound of the user and / or the user into an electrical signal form and outputs the electrical signal to the central controller 353.

The central controller 353 according to the present invention displays an event map related to a user event related to the image currently displayed on the main display unit 100 on the secondary display unit. In the event map displayed on the auxiliary display unit 200, types of user events that can be processed in a corresponding area are displayed to the user according to the state of the user interface displayed by the main display unit 100.

The central control unit 353 may also receive a key code from the key input unit 320 to perform at least one of character input, numeric input, image processing device setting change, image processing device setting display, and application execution corresponding to the key code. You can perform the operation.

The central control unit 353 receives the image data from the camera module unit 330, and stores the image data in the storage unit 360 in the form of an image file that can be recognized by a file system such as FAT16 or FAT32. For example, the stored image file may be deleted, renamed, moved to a folder location, or may be post-processed such as adjusting image brightness, adjusting image color, or inserting characters into the image.

The central controller 353 may receive an electrical signal from the microphone 340, convert the electrical signal into an electrical signal that can be transmitted through voice processing, and output the converted result to the wireless transceiver 390.

The central controller 353 receives an electrical signal corresponding to the voice of the other party from the wireless transceiver 390, converts the electrical signal into an electrical signal capable of voice output through voice processing, and converts the converted result into a speaker. 380 can be output.

The storage unit 360 receives and stores at least one of setting information of the image processing apparatus, operating system execution information, and application execution information from the central control unit 353, and executes the setting information and operating system execution at the request of the central control unit 353. At least one of the information and the application execution information is output to the central controller 353.

The display unit 370 receives image data from the central controller 353 and outputs the image data on the screen of the image processing apparatus. The display unit 370 may be implemented using a display device such as a liquid crystal display (LCD). Here, it should be understood that the display unit 317 of FIG. 3 is a concept including the main display unit 100 and the auxiliary display unit 200 described above. The auxiliary display unit according to the present invention displays an event map in which the types of events that can be processed in the corresponding area are displayed according to the state of the user interface displayed by the main display unit.

The speaker 380 may receive an electrical signal from the central controller 353, convert the electrical signal into a sound, and output the sound.

The wireless transceiver 390 may receive a transmittable electrical signal corresponding to a sound of a user and / or a user's surroundings from the central controller 353, and transmit the transmittable electrical signal to a counterpart portable terminal through a wired or wireless network. .

The wireless transceiver 390 may receive an electrical signal corresponding to the voice of the counterpart from the counterpart terminal through a wired or wireless network, and output the electrical signal corresponding to the voice of the counterpart to the central controller 353.

The touch screen controller 351 and the central controller 353 according to the present invention may be implemented as one block like the controller 350 and may be implemented as one semiconductor chip.

In another embodiment of the present invention, the touch screen input unit 310 and the touch screen controller 351 may be implemented in one block like the touch screen module unit (not shown). For example, the touch screen controller 351 may be manufactured together by the same semiconductor process as the manufacturing process of the touch screen input unit 310.

The portable terminal according to the present invention described above is not only a mobile communication terminal but also various portable devices such as a personal digital assistant (PDA) having a touch screen input unit, a portable multimedia player (PMP), an MP3 player, and the like. Means an apparatus, but the present invention is not limited to a portable apparatus, but may be applied to an image processing apparatus such as a television.

Although described with reference to the above embodiments, those skilled in the art will understand that various modifications and changes can be made without departing from the spirit and scope of the invention as set forth in the claims below. Could be.

1A illustrates a main display unit and an auxiliary display unit according to an embodiment of the present invention before an event occurs.

1B illustrates a main display unit and an auxiliary display unit of a portable terminal according to an embodiment of the present invention when a notification pop-up event occurs.

1C is a diagram illustrating a main display unit and an auxiliary display unit of a portable terminal according to an embodiment of the present invention, when the user confirms a notification message of the auxiliary display unit shown in the form of FIG. 1B and touches the main display unit.

2 is a schematic flowchart of a method of using an auxiliary display unit in a portable terminal having a dual display unit according to an exemplary embodiment of the present invention.

3 is a block diagram of a portable terminal utilizing an auxiliary display unit according to an embodiment of the present invention.

Explanation of symbols on the main parts of the drawings

100: main display unit 200: auxiliary display unit

210: non-touchable area 220: key clickable area

230: scrollable area 310: touch input unit

320: key input unit 330: camera module unit

340: microphone 350: control unit

360: storage unit 370: display unit

380: speaker 390: wireless transceiver

Claims (16)

A main display unit; An auxiliary display unit displaying information related to the main display unit; And According to the state of the user interface displayed on the main display unit, to distinguish the areas of the image displayed on the main display unit, to create an event map for distinguishing and displaying each of the divided areas, and causes the secondary display unit to A portable terminal comprising a control unit for displaying a map. The method of claim 1, The event map, A portable terminal, characterized in that the divided areas are displayed in different colors. The method of claim 1, The event map, The divided terminals are displayed using different background patterns. The method of claim 1, Each divided area of the event map, And at least one of a non-touchable area, a scrollable area, a key clickable area, and a gesture input area. The method of claim 1, The control unit, And capturing an image stored in a buffer of the main display unit, and resizing the captured image to a size of an auxiliary display unit to create the event map. The method of claim 1, The control unit, And dividing the image into at least one region according to possible types of user events, and assigning different background patterns or different colors to each divided region to create the event map. The method of claim 3, And the background pattern is a pattern formed using at least one of an oblique line, a double line, a point island, and a check. A method of using an auxiliary display unit in a portable terminal including a main display unit and an auxiliary display unit displaying information related to the main display unit, Creating an event map that distinguishes areas of an image displayed on the main display unit according to a state of a user interface displayed on the main display unit, and distinguishes and displays each divided area; Wow And displaying the created event map on the auxiliary display unit. The method of claim 8, The event map, And the divided areas are displayed in different colors. The method of claim 8, The event map, And the divided areas are displayed using different background patterns. The method of claim 8, Each divided area of the event map, And at least one of a non-touchable area, a scrollable area, a key clickable area, and a gesture input area. The method of claim 8, Creating the event map, Capturing an image stored in a buffer of the main display unit; Wow And resizing the captured image according to the size of the auxiliary display unit. The method of claim 8, Creating the event map, Dividing the image into at least one area according to possible types of user events; Wow And providing a different background pattern or a different color to each divided area. The method of claim 10, And the background pattern is a pattern formed using at least one of an oblique line, a double line, a point island, and a check. A first display unit; A second display unit; And According to a user event state associated with a touch input of a user interface displayed on the first display unit, a region of an image displayed on the first display unit is divided, and a different background pattern or a different color for each divided region is provided. And a controller configured to generate an event map to which the event is assigned and to cause the second display to display the event map. A display method of a portable terminal including a first display unit and a second display unit, Dividing an area of an image displayed on the first display unit according to a user event state associated with a touch input of a user interface displayed on the first display unit; Creating an event map with different background patterns or different colors for each of the divided areas; And And displaying the created event map on a second display unit.

Images