KR20020063338A - Method and Apparatus for Displaying Portable Mobile Device - Google Patents

Abstract

PURPOSE: A display device and a method for a portable mobile device are provided to easily access to the desired information by using the portable mobile device as a pointing device. CONSTITUTION: A pointing button(205b) enables the portable mobile device to user as a pointing device. A pointing detection sensor(215) measures the relative pointing vector value by detecting the moving distance and direction of the mobile device. An A/D converter(220) converts the relative pointing vector value into a digital signal by connecting to the pointing detection sensor. A microprocessor(225) calculates a control signal by receiving the input signal inputted by the mobile device and calculates the absolute pointing vector value corresponding to the moving distance and direction of the mobile device by decoding the relative pointing vector value. A memory(230) applies the information and the various kinds of programs requested by the microprocessor. A display controller(235) controls the movement of a display screen according to the absolute pointing vector value.

Description

Display device and method of portable mobile device {Method and Apparatus for Displaying Portable Mobile Device}

The present invention relates to a display device and a method of a portable mobile device, and more particularly, by using the mobile mobile device itself as a pointing device, an output screen larger than a small display space of the portable mobile device can be easily retrieved. The present invention relates to a display device and a method of a portable mobile device.

In general, since a computer collects various types of information from the outside and works on it, most computers usually use two types of input devices to directly input information. Examples include a device (eg, a keyboard) for inputting symbolic information such as letters and numbers and a device (eg, a pointing device) for inputting arbitrary location information on a display screen. However, such an input device is a useful device for a computer occupying a certain amount of space, but is not suitable for a portable mobile device that is spotlighted by modern people who consider mobility important. Examples of devices used for data input to a computer include keyboards, mice, optical pens, trackballs, pointing sticks, touch screens, speech recognition systems, joysticks, and the like. These conventional input devices each have advantages and disadvantages for any particular application or user.

For example, touch screens require minimal training and use direct eye-hand coordination, but have limited resolution and require that the user be close to the display to see the display contents. There is discomfort. Trackballs require at least two inches of balls and a housing near or attached to the keyboard and are relatively large in structure. Optical pens are useful in some applications, but should be used on or very close to the display screen. Optical pens are not available in a wide range of locations far from the screen. In addition, the user may feel tired of the arm by holding the light pen against the screen. Most commonly used mice are inexpensive devices and do not block the user's display screen, but require a flat surface and only input relative movement information. In addition, the mouse requires a separate space next to the keyboard for the user's hand operation, and the mechanical mouse often occurs when the dirt is absorbed to cause a malfunction.

Therefore, incorporating a pointing device used in a computer into a portable mobile device is limited and requires a new type of pointing device. Here, the portable mobile device is a general term for using a computing device in a mobile environment, and includes general personal digital assistants (PDAs), cellular phones, handheld PCs, palm sized PCs, and handheld terminals. Handheld terminals, as well as laptops, laptop (Lap Top) computers, and even computers installed inside police patrol cars or emergency emergency vehicles operated by hospitals, are examples of portable mobile devices.

At present, as the spread of portable mobile devices increases exponentially, communication business through personal portable terminals is in earnest. Various devices such as cellular phones, personal digital assistants (PDAs), and PDAs are equipped with and enhanced communication functions, and development and research on contents that can utilize these functions are being actively conducted. However, due to the limited user interface of the portable mobile device, the development is facing limitations. The user interface is the principle of the interaction between the user and the device, and in general, the method of inputting and outputting on the screen are mainly. Anyone who has attempted to access the web through a wireless PDA can't handle complex pages, and even after accessing information over long periods of time, the PDA's small screen makes it difficult to understand or display the content correctly. I know it often happens.

Portable mobile devices represented by PDAs are used in various places due to their nature. In addition to use in a means of transportation such as a subway or a car, it should be possible to simply access desired information while standing or walking in such means of transportation. The use of a small handheld mobile device that can be held by one hand is to access the desired information as described above, ie, 'information browsing'. In order to access information desired by a user, an operation of selecting a menu shown on a display screen and displaying contents of the selected menu should be performed. In this case, since the information in the menu cannot be displayed at a time due to the limited screen size of the portable mobile device, the user may scroll the screen using a button (for example, a navigation key). have. Scrolling the screen using a button is the most commonly used method. In the case of a PDA such as the Palm series, the up and down scrolling is performed using a button, and many other PDAs use a general button-using method. However, this screen scrolling method using a button is possible with one hand, but has a disadvantage of slow response speed. In addition, a method of directly moving the screen using a stylus or a scroll bar may be used to move the screen. This method is used as a pointing device, but has a disadvantage in that it is difficult to perform with one hand.

In general, the PDA avoids left and right scrolling, and constitutes content that is mainly scrolled up and down. Such a PDA uses a method of scrolling left and right only when the displayed information is larger than the screen, such as a subway line chart. Using a stylus is inconvenient when carrying two hands to use an application, and when using a scroll bar, the user's eyes move toward the scroll bar.

Therefore, the information browsing of the portable mobile device does not require the input of a large number of information by a keyboard or the like, but on the other hand, since the user may use the portable mobile device while standing or walking as described above, the desired information is simpler. There is a need for a pointing device and display method capable of accessing the same.

Accordingly, the present invention has been made to solve the above-mentioned conventional problems, and a first object of the present invention is to designate a portable mobile device itself as a pointing device to access desired information in a state of holding with one hand. The present invention provides a display device and method for a portable mobile device that can easily access desired information by only moving the portable mobile device.

The second object of the present invention is to move the screen only when the portable mobile device is used as a pointing device while moving the portable mobile device while pressing a specific button (for example, a pointing button), and when a specific button is not pressed, a general screen is pressed. The present invention provides a display device and a method of a portable mobile device for moving a screen to a desired position by using a move button (eg, a move key).

It is a third object of the present invention to provide a display device and a method of a portable mobile device for detecting a movement of the portable mobile device using a pointing detection sensor.

1 is an external view of an exemplary PDA in which the present invention may be practiced,

2 is a block diagram showing an internal configuration of a PDA according to the present invention,

3 is a flow chart for explaining the overall operation of the present invention,

4 is an exemplary diagram of a virtual screen to be displayed.

5 to 7 illustrate screens displayed according to the moving direction.

♣ Explanation of symbols for the main parts of the drawing ♣

205b: pointing button 215: pointing detection sensor

220: A / D converter 225: microprocessor

230: memory unit 235: display controller

245: display

In order to achieve the above object, the present invention provides a display device of a portable mobile device which scrolls a display screen by an operation of a mobile key.

A pointing button for instructing to utilize the portable mobile device as a pointing device; A pointing detection sensor operated by an operation of a pointing button and detecting a relative pointing vector value by detecting a moving distance and a direction of the portable mobile device; An analog / digital converter connected to a pointing detection sensor and converting a relative pointing vector value measured by the pointing detection sensor into a digital signal; Receives an input signal applied from the portable mobile device, calculates a corresponding control signal, decodes the relative pointing vector value applied from the analog / digital converter, and calculates an absolute pointing vector value corresponding to the moving distance and the moving direction of the portable mobile device. A microprocessor for controlling to calculate; A memory unit which is connected to the microprocessor and stores various information and application programs transmitted from the microprocessor and applies the information to the microprocessor when an information request signal is applied from the microprocessor; And a display controller which is connected to the microprocessor and controls to move the display screen according to the absolute pointing vector value applied from the microprocessor.

In addition, the present invention provides a method of displaying a portable mobile device which scrolls a display screen by an operation of a mobile key, the method comprising: displaying information corresponding to a menu selected by a user of the portable mobile device; Determining whether a pointing button using the portable mobile device as a pointing device is input and detecting a movement of the portable mobile device through a pointing detection sensor when the pointing button is operated; Calculating a pointing vector value corresponding to the movement of the portable mobile device; And moving the display screen by a moving distance and a moving direction corresponding to the pointing vector value.

Miniaturization of communication devices is rapidly progressing, and mobile phones (cellular phones) are rapidly spreading, and everyone is easily encountering a portable mobile device. Although the present invention can be applied to all of these portable mobile devices, the description will be mainly focused on a PDA in order to accurately understand the gist of the present invention. However, the present invention is not limited to PDAs, and can be applied to all portable computing devices (eg, cellular phones, HPCs, PPCs, handy terminals, notebook computers, laptop computers, etc.). If you can easily understand. Here, notebook computers and laptop computers are portable devices that can be carried but cannot be held by one hand, but the present invention can be applied, but its utility value is inferior in efficiency. In addition, the present invention can be applied to all PDAs on the market, and easily adds a pointing button for instructing the use of the PDA itself as a pointing device and a pointing detection sensor capable of detecting the movement of the PDA to an existing PDA. You can access the information.

Hereinafter, exemplary embodiments of a display apparatus and method of a portable mobile device according to the present invention will be described in detail with reference to the accompanying drawings.

1 is an external view of an exemplary PDA 100 in which the present invention may be implemented, the PDA 100 having a power key 110 for applying power to start or stop operation of the PDA 100, a PDA ( 100, a fixed icon 120 for executing an application program, a character recognition panel 130 for inputting a character using a touch pen (ie, a stylus), a PDA user touches or touches the touch pen. In response to the touch screen display device 140 for interacting with the PDA 100, the movement key 150 for moving the screen or the cursor, and an execution key for activating a selected menu to output corresponding information. 160, an external connection terminal 170 for exchanging information by connecting to another PDA or PC or a cellular phone, and a pointing button 180 for instructing to utilize the PDA itself as a pointing device. Here, the touch screen display 140 may be used as an alternative to the user interface in an application requiring a mouse, such as a web browser, and a resistive touch screen or touch screen that responds to a contact causing a change in current. The surface wave touch screen detects the touch position by the change of the ultrasonic wave passing over the panel, and the capacitive touch screen detects the touch position by the change of the amount of charge at the touch point. In general, a resistive or surface wave touch screen is suitable for the PDA 100. In the example PDA 100 of FIG. 1, the pointing button 180 is located at the top right, but this is just one embodiment, and the right hand can be positioned on the left for frequent users, , The left and right spaces in which the power key 110 is located. In addition, the pointing button 180 may be a push-in button or a touch pad button and may be configured to detect the pointing of the PDA or to detect the pointing at one input and stop the pointing at another input while the button is pressed. It can also be configured.

2 is a block diagram showing an internal configuration of the PDA 200 according to the present invention, the PDA 200 to which the present invention is applied includes a key input unit 205, an input interface 210, a pointing detection sensor 215, and an analog. / Digital converter 220 (hereinafter, referred to as A / D converter), microprocessor 225, memory 230, display controller 235, output interface 240, display 245 and external connection 250 ) Is configured to include. Here, the key input unit 205 is composed of a keypad 205a and a pointing button 205b.

The key input unit 205 is a general term for input means for instructing execution instructions intended by a PDA user, and refers to various buttons provided in a general PDA. The key input unit 205 is a keypad 205a (for example, a power key 110, a fixed icon 120, a character recognition panel 130, and a touch screen) indicating various buttons installed in a general PDA to help understand the invention. The display device 140, the movement key 150, the execution key 160, etc.] and the pointing button 205b for utilizing the PDA as a pointing device will be described. Description of each keypad 205a and pointing button 205b is described above in the description of FIG.

The input interface 210 is connected to the key input unit 205, and the difference in data representation format and electrical characteristics between the key input unit 205 and other components (eg, the pointing device 215 and the micro process 225). The operation timing is adjusted, and data and control lines are provided, including the address decoding circuit of the input device. Since the key input unit 205 and other components generally have different operating speeds, when transmitting and receiving data, the transmitting side and the receiving side must transmit data while checking the state of each other.

The pointing detection sensor 215 is connected to the input interface 210, and is operated by a pointing operation start signal applied from the pointing button 205b through the input interface 210 to detect the movement of the PDA to obtain a pointing vector value. Perform the function of calculating. That is, when the PDA user moves the PDA while holding the PDA, the pointing detection sensor 215 detects the movement and calculates a vector value (ie, x, y, z value) corresponding to the moving distance to detect the relative moving distance. Here, x is the horizontal movement vector value, y is the vertical movement vector value, and z is defined as the gradient vector value. In addition, each vector value is measured only within the tolerance range and does not detect fine movement (i.e., movement within tolerance) or excessive movement (i.e., movement exceeding tolerance), and the relative distance corresponding to the vector value. The value can be freely changed by the user's choice. The pointing detection sensor 215 may use a displacement sensor (for example, a plane sensor, a cylinder sensor, or the like) or a gyro sensor that detects the displacement of the PDA, a spatial perception sensor or a motion detection sensor that detects the spatial movement of the PDA. Each sensor is well known to those skilled in the art and is not described in detail in the present invention.

The A / D converter 220 is connected to the pointing detection sensor 215 and performs a function of converting the vector value measured by the pointing detection sensor 215 into a processable digital signal.

The microprocessor 225 is connected to the input interface 210 and the A / D converter 220, receives an input signal applied from the input interface 210, calculates a corresponding control command, and generates an A / D converter ( It receives the pointing vector value applied from the 220 to calculate the movement position and the movement distance of the PDA and performs a function to control to perform the corresponding operation. In general, in the PDA, the microprocessor 225 uses a high performance processor having a reduced instruction computer (RISC) structure because a small amount of memory is used while achieving high performance and low power consumption. RISC's simple instruction set can reduce the circuit size of the microprocessor, which is effective in suppressing power consumption. Since one instruction can be executed by one clock, the instruction set can be realized without increasing the operating frequency. In addition, in the PDA, since addition or multiplication is frequently used for coordinate transformation for graphics processing, the RISC microprocessor is preferably equipped with a dedicated multiplier.

The memory unit 230 is interconnected with the microprocessor 225 and stores various kinds of information (eg, addresses, appointments, memos and e-mail messages, HTML documents, etc. input by PDA users), ROM, and RAM. It includes. In addition, the memory unit 230 preferably includes a flash memory for upgrading the operating system software (ie, an application program). Modern PDA memory has increased storage capacity, with more than 2M of RAM to store up to 6000 addresses, five years of appointments (about 3000), 1500 to-do lists, 1500 notes, and 2000 email messages. .

The display controller 235 is interconnected with the microprocessor 225 and performs a function of controlling the display 245 according to a pointing vector value applied from the microprocessor 225. Here, since the display controller 235 and the display 245 are generally configured to have different operating speeds, the output interface 240 adjusts the difference in data representation format, electrical characteristics, and operation timing. Here, the display 245 generally uses a liquid crystal display (LCD). The display controller 235 can easily perform graphic display with a large amount of information by embedding a frame memory in the segment driver and giving a intensity of light and dark on the screen.

The external connection unit 250 is interconnected with the microprocessor 225 and performs a function of exchanging information by connecting to a general telephone line, a cellular phone, or a PC. For connection with mobile communication devices such as telephone lines and cellular phones, a modem adapter, which is a plug-in card modem, or a large scale integration (LSI) for modems built in a PDA, is used. For connection with a PC, a PC card is used.

Hereinafter, the operation relationship of the display apparatus and method of the portable mobile device according to the present invention will be described in more detail with reference to the accompanying drawings.

3 is a flow chart for explaining the overall operation of the present invention, the portable mobile device to set up a PDA for an exemplary description of the operation of the present invention, the PDA user desired operation to retrieve a document larger than the display screen Assume that the operation moves the screen.

First, the PDA user presses the power key located at the bottom of the PDA to apply power to operate the PDA (S310). When the PDA is activated, icons displaying various menus are displayed on the display screen. The PDA user accesses the information he / she wants among the displayed menus using a touch pen, etc., and executes the corresponding menu (S320). The contents input by the PDA user are applied to the micro process through the input interface, and the micro process decodes a signal corresponding to the input contents and transmits the information stored in the memory to the display controller. The display controller receives the corresponding information to adjust the operation timing through the output interface, and then displays the corresponding information on the display screen (S330). Here, since the displayed information is assumed to be larger than the display screen of the PDA, the initially displayed screen displays only a part of the information desired by the PDA user.

After checking the displayed information, the PDA user determines whether to utilize the PDA itself as a pointing device to search for the non-displayed portion (S340). In this case, it is preferable that the PDA user moves the screen using a general navigation key when the user wants a precise search, and moves the screen by using a pointing button when the user wants a quick search. When the PDA user decides not to use the PDA as a pointing device in step S340, the user moves the screen using a moving key to search for desired information (S350). When the PDA user decides to utilize the PDA as a pointing device, the upper right side of the PDA While pressing the pointing button located in the PDA to move in the desired direction (S370).

The movement of the PDA is detected by a pointing detection sensor, and the pointing detection sensor measures a pointing vector value corresponding to the distance traveled by the PDA user. The pointing vector value represents the distance traveled by the PDA as x (left, right), y (up and down), and z (tilt) values. The distance and the pointing vector traveled by the PDA are not absolute measurements but relative measurements. Of course, the designer can move the screen by the distance the PDA moves by matching the pointing vector with the distance the PDA moved. The pointing vector value measured by the pointing detection sensor is converted into digital information by the A / D converter and applied to the microprocessor, and the microprocessor decodes the corresponding information to calculate the pointing vector value (S380), and then the pointing vector value. This information is sent to the display controller. Here, the pointing vector value calculated by the microprocessor is an absolute value and moves the screen by the corresponding vector value. After adjusting the operation timing through the output interface, the display controller transmits a screen movement control signal to the display to control the display screen to move (S390). Therefore, the PDA user can easily search for the desired part by moving the PDA itself without using the moving key.

4 is an exemplary diagram of a virtual screen to be displayed, and FIGS. 5 to 7 are exemplary views of a screen displayed according to a moving direction.

When a PDA user searches for a map of Seosomun-dong, assuming that the virtual screen stored in memory is FIG. 4, only a part of the map is initially displayed since the screen is larger than the display space of the PDA. . At this time, when the PDA user moves the PDA to the right while pressing the pointing button on the right side, the screen moves as shown in FIGS. 5B and 5C according to the moving distance. Of course, if you want to move to the left, you can move the PDA to the left. In this case, when the desired part comes out or you want to see more detail, if you release the pointing button that is pressed, the operation of the pointing detection sensor is stopped at that moment and the screen of the current state is fixed and displayed. That is, when the PDA is moved while the pointing button is pressed, the screen moves by the corresponding pointing vector value, but the screen does not move when the PDA is moved without pressing the pointing button. If you want to search the upper part of the map by searching the upper part, you can hold down the pointing button and move the PDA down. 6 and 7 illustrate screens when the PDA is lowered and diagonally, and the operation principle is the same as that of FIG.

The above description is only for explaining one embodiment, and the present invention is not limited to the above-described embodiment and can be variously changed within the scope of the appended claims. For example, the shape and structure of each component specifically shown in the embodiment of the present invention may be modified.

As described above, according to the display apparatus and the method of the portable mobile device according to the present invention, the portable mobile device itself is used as a pointing device so that the user can access the desired information while holding with one hand. There is an effect that can easily access the desired information.

In addition, there is an effect that can further accelerate the miniaturization of the portable mobile device by minimizing the display space of the portable mobile device, which is much limited by the display size.

Claims (8)

A display device of a portable mobile device that scrolls a display screen by an operation of a move key. A pointing button for instructing to use the portable mobile device as a pointing device; A pointing detection sensor operated by an operation of the pointing button and detecting a relative pointing vector value by detecting a moving distance and a direction of the portable mobile device; An analog / digital converter connected to the pointing detection sensor and converting the relative pointing vector value measured by the pointing detection sensor into a digital signal; Receives an input signal applied from the portable mobile device, calculates a corresponding control signal, and decodes the relative pointing vector value applied from the analog / digital converter to determine an absolute value corresponding to the moving distance and the moving direction of the portable mobile device. A microprocessor for controlling to calculate a pointing vector value; A memory unit interconnected to the microprocessor and storing various information and application programs transmitted from the microprocessor and applying the information to the microprocessor when an information request signal is applied from the microprocessor; And And a display controller interconnected to the microprocessor and configured to move the display screen according to an absolute pointing vector value applied from the microprocessor. The device of claim 1, wherein the portable mobile device is Personal Digital Assistants (PDAs), Cellular Phones (Cellular Phones), Handheld PCs (HPCs), Palm sized PCs (PPCs), Handy Terminals, Notebook Computers, Laptops (Lap Top) Computers Display device of a portable mobile device. The method of claim 1, wherein the pointing detection sensor is activated when the portable mobile device is moved while the pointing button is pressed and is not activated when the portable mobile device is moved without pressing the pointing button. A display device of a portable mobile device, characterized in that. The method of claim 1 or 3, wherein the pointing sensor is And a displacement sensor or a gyro sensor for detecting displacement of the portable mobile device, a spatial perception sensor or a motion detection sensor for detecting spatial movement of the portable mobile device. In the display method of a portable mobile device scrolling the display screen by the operation of the movement key, Displaying information corresponding to a menu selected by a user of the portable mobile device; Determining whether a pointing button using the portable mobile device as a pointing device is input and detecting a movement of the portable mobile device through a pointing sensor when the pointing button is operated; Calculating a pointing vector value corresponding to the movement of the portable mobile device; And And moving the display screen by a moving distance and a moving direction corresponding to the pointing vector value. The device of claim 5, wherein the portable mobile device Personal Digital Assistants (PDAs), Cellular Phones (Cellular Phones), Handheld PCs (HPCs), Palm sized PCs (PPCs), Handy Terminals, Notebook Computers, Laptops (Lap Top) Computers Display method of portable mobile device. The method of claim 5, wherein the pointing detection sensor is operated when the portable mobile device is moved while the pointing button is pressed and is not activated when the portable mobile device is moved without pressing the pointing button. A display method of a portable mobile device, characterized in that. The method of claim 5 or 7, wherein the pointing detection sensor And a displacement sensor or a gyro sensor for detecting displacement of the portable mobile device, a spatial perception sensor or a motion detection sensor for detecting spatial movement of the portable mobile device.