WO2005122415A1 - Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof - Google Patents

Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof Download PDF

Info

Publication number
WO2005122415A1
WO2005122415A1 PCT/KR2005/001647 KR2005001647W WO2005122415A1 WO 2005122415 A1 WO2005122415 A1 WO 2005122415A1 KR 2005001647 W KR2005001647 W KR 2005001647W WO 2005122415 A1 WO2005122415 A1 WO 2005122415A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
terminal
area
screen
displayed
Prior art date
Application number
PCT/KR2005/001647
Other languages
French (fr)
Inventor
Sang-Baek Lee
Original Assignee
Sang-Baek Lee
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sang-Baek Lee filed Critical Sang-Baek Lee
Publication of WO2005122415A1 publication Critical patent/WO2005122415A1/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1615—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function
    • G06F1/1616—Constructional details or arrangements for portable computers with several enclosures having relative motions, each enclosure supporting at least one I/O or computing function with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04B—TRANSMISSION
    • H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
    • H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
    • H04B1/40—Circuits
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G06F3/0317—Detection arrangements using opto-electronic means in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
    • G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
    • G06F2200/163—Indexing scheme relating to constructional details of the computer
    • G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2250/00—Details of telephonic subscriber devices
    • H04M2250/52—Details of telephonic subscriber devices including functional features of a camera

Definitions

  • the displacement detection unit 210 includes a movement confirmation unit 230 manipulated by the user, which will be described in detail later.
  • the screen control unit 220 preferably sets coordinates of an entire area, in which the overall content is to be displayed, and coordinates of a partial content area to be displayed on the screen depending on the size and resolution of the screen of the terminal.
  • the partial content area displayed on the terminal preferably starts at the start coordinates (0, 0) of the overall content if the overall content is composed of 1000 * 1000 pixels corresponding to length * width, x and y coordinates, at which the content starts, are (0, 0), and the screen 240 of the terminal is composed of 100 * 100 pixels corresponding to length * width.
  • the screen control unit 220 preferably calculates the area of new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal detected by the displacement detection unit 210, and updates the screen of the terminal.
  • a reference area that is composed of unit pixels or pixel groups selected according to predetermined criteria based on shape, color tone, brightness and/or quality and the coordinates of the reference area, are set in the frame T(n) at step 112. From the frame 1 indicated by the solid line in FIG. 5, an area 10 indicated in the form of, for example, a corner, is the reference area.
  • movement detection is preferably performed based on the resolution between the pixels of the image sensor.
  • the displacement detection unit 210 detects lengthwise and crosswise displacements in multiples of the distances between pixels based on the resolution between the pixels of the image sensor at step 110.
  • the area of new content displayed on the screen to correspond to the displacements detected by the screen control unit 220 at step 120 is preferably a content area located away from the content area displayed at step 100 by multiples of the distances between lengthwise and crosswise pixels.

Abstract

A method of displaying content using a terminal having a restricted size screen and the terminal therefor are disclosed. According to the present invention, in a method of displaying content including a predetermined screen layout on the restricted size screen of a mobile terminal, such as a mobile phone or PDA, the area of partial content corresponding to the size of the screen in overall content having a screen layout to be played on the terminal is displayed on the screen of the terminal, the movement displacement of the terminal in a 3-dimensional space, by which the user moves the terminal to view an area other than the displayed content area in the overall content, is detected, and the area of some other partial content, placed to correspond to the detected displacement, in the overall content is displayed on the screen of the terminal.

Description

Description METHOD FOR DISPLAYING CONTENTS IN MOBILE TERMINAL HAVING RESTRICTED SIZE DISPLAY AND MOBILE TERMINAL THEREOF Technical Field
[1] The present invention relates, in general, to mobile terminals and, more particularly, to a method and apparatus, which can display content that cannot be displayed on a single screen, on the small size screen of a mobile terminal. Background Art
[2] With the development of the electronic industry, mobile terminals, such as small- sized portable communication devices or information appliances, have been popularized. For instance, mobile phones or Personal Digital Assistants (PDAs) are examples of mobile terminals. However, the size of a screen mounted on such a mobile terminal is restricted, so that visual information is provided depending on the restricted screen size.
[3] Of course, information is processed and displayed to be appropriate to a screen size, and inconvenience can be greatly reduced. However, in the case where a drawing, such as a design drawing, is intended to be displayed, the content of the drawing may occasionally not be perceived if the drawing is scaled down to be appropriate to a screen size and displayed. In this case, if the drawing is displayed on the screen of a mobile terminal without being scaled down, the drawing would be divided into portions that can be displayed on a screen, and then displayed, or only part of the drawing would be displayed. This display method is very inconvenient, and content may not be correctly perceived, depending on the nature of the displayed content.
[4] That is, if the size of an image or document to be displayed on the restricted size screen of a mobile terminal is large, the format of the image or document must be converted to be appropriate to the size of the screen of the mobile terminal, or only part of the image or document must be displayed. In either case, there is a problem in that a user is inconvenienced and cannot satisfactorily view a desired object through a mobile terminal. Disclosure of Invention Technical Problem
[5] Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and an object of the present invention is to provide a method, which can display content that cannot be displayed on a single screen using a terminal including a restricted size screen, such as a mobile terminal, without separately changing the format of the content or dividing the content into respective screens, and the terminal for the method. Technical Solution
[6] In order to accomplish the above object, the present invention provides a method of displaying content having a predetermined screen layout on a restricted size screen of a mobile terminal, such as a mobile phone or Personal Digital Assistant (PDA), comprising the steps of a) displaying an area of partial content, corresponding to a size of the screen in overall content having a predetermined screen layout to be displayed on the terminal, on the screen of the terminal; b) detecting movement displacement of the terminal, by which the terminal is moved in order for a user of the terminal to view an area other than the displayed content area in the overall content; and c) displaying an area of some other partial content, placed to correspond to the detected displacement in the overall content having a predetermined screen layout, on the screen of the terminal.
[7] Further, the present invention provides a mobile terminal, including a mobile phone or Personal Digital Assistant (PDA), for displaying content having a predetermined screen layout on a restricted size screen, comprising a content acquisition unit for storing overall content to be displayed or receiving the overall content through predetermined communication means; a displacement detection unit for detecting movement displacement by which the terminal is moved in order for a user to view another area of the overall content when a partial area of the content, acquired by the content acquisition unit, is displayed on the screen; and a screen control unit for displaying the partial area of the content, acquired by the content acquisition unit, on the screen of the terminal, determining another partial area of the overall content placed to correspond to the displacement that is detected by the displacement detection unit, and displaying the determined partial area on the screen of the terminal. Brief Description of the Drawings
[8] FIG. 1 is a flowchart of a method of displaying content using a terminal having a restricted size screen according to the present invention;
[9] FIG. 2 is a detailed flowchart showing step 100 of FIG. 1 ;
[10] FIG. 3 is a block diagram showing the construction of a mobile terminal for displaying content having a predetermined screen layout on the restricted size screen thereof according to the present invention;
[11] FIG. 4 is a detailed flowchart showing steps 110 and 120 of FIG. 1 according to a preferred embodiment of the present invention;
[12] FIG. 5 is a view showing respective frames sensed by an image sensor and a reference area; and [13] FIG. 6 is a view showing an example of the external shape of a terminal to which the present invention is applied. Best Mode for Carrying Out the Invention
[14] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.
[15] FIG. 1 is a flowchart of a method of displaying content using a terminal having a restricted size screen according to the present invention.
[16] Through a method of displaying content having a predetermined screen layout on the restricted size screen of a mobile terminal, such as a mobile phone or Personal Digital Assistant (PDA), the area of partial content corresponding to the size of the screen of the mobile terminal, in overall content having a predetermined screen layout to be displayed on the terminal, is displayed at step 100, the movement displacement of the terminal, by which a user moves the terminal to view an area other than the displayed content area of the overall content, is detected at step 110, and of the overall content having a predetermined screen layout, the area of some other partial content placed to correspond to the displacement detected at step 110 is displayed on the screen of the mobile terminal at step 120.
[17] FIG. 2 is a detailed flowchart showing step 100 of FIG. 1. At step 100, coordinates of an entire area, in which content having a predetermined screen layout is to be displayed, are set at step 102, the coordinates of a partial content area to be displayed on the screen depending on the size and resolution of the screen of the terminal, are set at step 104, and the partial content area, the coordinates of which are set, is displayed on the screen of the terminal at step 106.
[18] FIG. 3 is a block diagram showing the construction of a mobile terminal for displaying content having a predetermined screen layout on the restricted size screen thereof according to the present invention.
[19] The terminal, including a mobile phone or PDA, for displaying content having a predetermined screen layout on the restricted size screen thereof includes a content acquisition unit 200 for storing overall content to be displayed, or receiving the content through a predetermined communication means, a displacement detection unit for detecting the displacement of the terminal when a user moves the terminal to view another area of the overall content when the partial area of the content, acquired by the content acquisition unit 200, is displayed on a screen 240, and a screen control unit 220 for displaying the partial area of the content, acquired by the content acquisition unit 200, on the screen 240 of the terminal, determining some other partial content area, placed to correspond to the displacement detected by the displacement detection unit 210, in the overall content, and displaying the determined partial content area on the screen 240 of the terminal.
[20] Further, the displacement detection unit 210 includes a movement confirmation unit 230 manipulated by the user, which will be described in detail later.
[21] Hereinafter, a process of performing the method of FIG. 1 using the terminal of FIG. 3 is described in detail.
[22] As the terminal to be implemented in the present invention, other devices can be included as terminals, such as cellular phones, Personal Communication System (PCS) phones, Global System for Mobile communications (GSM) phones or PDAs, as long as they include a screen on which content, such as text, pictures or moving images, can be displayed, and are portable, in addition to the types of devices described above. Further, there are various types of content.
[23] For example, in the case where the content is a novel, a method of displaying the content of the novel, in such a way that a small amount of content is displayed on a small screen and a large amount of content is displayed on a large screen when text or illustrations related to the content of the novel is displayed on the screen of a mobile terminal, has already been used.
[24] However, if paper editing is suitably performed in consideration of easy reading and aesthetic aspects of the novel, it is impossible to view text or illustrations included in the edited paper while sufficiently grasping the content of the text or illustrations, using the restricted size screen of the mobile terminal. Even though the size of the screens of mobile terminals will become larger than in currently used mobile terminals, the above inconvenience or impossibility will persist.
[25] The present invention can provide a service of showing configured screen content to a user through a restricted size screen while maintaining the screen configuration of content, without a separate procedure of converting the screen content.
[26] The content acquisition unit 200 previously stores content to be displayed on the screen of a terminal, or receives content through a predetermined communication means, for example, a wireless telephone network, and stores the content. As described above, this content will be content which the user desires to view while its format displayed on a screen is maintained. It is apparent that, content, the display format of which can be arbitrarily changed, can be applied to the present invention without change.
[27]
[28] *The overall content that has been previously stored in the content acquisition unit 200, or received and stored therein, cannot be displayed on the screen 240 of the terminal at one time. Of the overall content having a predetermined screen layout to be displayed on the terminal, the screen control unit 220 displays the area of partial content, corresponding to the size of the screen 240, on the screen 240 of the terminal at step 100.
[29] In this case, the screen control unit 220 preferably sets coordinates of an entire area, in which the overall content is to be displayed, and coordinates of a partial content area to be displayed on the screen depending on the size and resolution of the screen of the terminal.
[30] That is, step 100 preferably includes the step 102 of setting the coordinates of the entire area in which the content having a predetermined screen layout is to be displayed, the step 104 of setting the coordinates of a partial content area to be displayed on the screen depending on the size and resolution of the screen of the terminal, and the step 106 of displaying the partial content area, the coordinates of which have been set, on the screen of the terminal.
[31] Further, when content is displayed on the screen, the screen control unit 220 causes the partial content area initially displayed on the terminal screen 240 to include the start portion of the overall content.
[32] For example, the partial content area displayed on the terminal preferably starts at the start coordinates (0, 0) of the overall content if the overall content is composed of 1000 * 1000 pixels corresponding to length * width, x and y coordinates, at which the content starts, are (0, 0), and the screen 240 of the terminal is composed of 100 * 100 pixels corresponding to length * width.
[33] The screen control unit 220 has coordinate values for all portions of the overall content. Therefore, regardless of which portion is displayed on the terminal screen 240, the screen control unit 220 has coordinate values for the displayed portion or an area corresponding to the coordinate values.
[34] After viewing content displayed on the terminal screen, or in order to find some other content, the user moves the terminal. In this case, this is sufficiently achieved by the user slightly moving the terminal held in his or her hand. For example, this may be the same movement as in the case in which, if a user views only a portion of wide content, such as a newspaper, corresponding to the size of the screen, through the screen of the terminal held by the user's hand, and desires to view another portion of the newspaper, the screen of the terminal moves to a corresponding area. That is, the display area of the screen is moved.
[35] In this way, if the user of the terminal moves the terminal to view content that is placed in an area other than the area of the content displayed on the terminal, in the overall content, the displacement detection unit 210 detects the movement of the terminal at step 110.
[36] Hereinafter, an example and operation of the displacement detection unit 210 are described in detail. [37] The displacement detection unit 210 can be implemented using a device for detecting changes in location in a space, for example, an inertial measurement device such as an accelerometer or a gyroscope, or a commercialized device, such as image sensor for sensing the relative change in locations of objects around the terminal.
[38] If the displacement detection unit 210 includes an image sensor composed of predetermined light receiving pixels, lengthwise and crosswise displacements at step 110 are detected in multiples of the distances between the light receiving pixels of the image sensor. The area of new content displayed on the screen to correspond to the displacements detected at step 120 is also the content area placed to correspond to the distances between lengthwise and crosswise pixels sensed by the image sensor.
[39] The image sensor including predetermined light receiving pixels is a device, for example, a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) having a predetermined number of pixels. In order to support the following function, the image sensor must have a two-dimensional array structure for detecting the locations of individual pixels, be implemented with an array of light receiving elements that are sensors capable of measuring a color tone or brightness, and acquire continuous images.
[40] The displacement detection unit 210 may be implemented to set a reference area composed of unit pixels or pixel groups selected according to predetermined criteria based on shape, color tone and/or brightness, and the coordinates of the reference area in a frame T(n) sensed by the image sensor before the terminal is moved, to detect the location of the reference area according to predetermined criteria in a subsequent frame T(n+1) sensed by the image sensor after the terminal is moved, to calculate the movement displacement of the reference area, and to detect the movement displacement of the terminal. Alternatively, the displacement detection unit 210 may be implemented to set a reference area, having a predetermined shape and composed of a predetermined number of pixels, on a predetermined location within the frame T(n), preferably, a center portion, to search the subsequent frame T(n+1) for comparison areas, each having the same shape as the reference area and having pixels, the number of which is the same as the reference area, to detect a comparison area having a color tone (color distribution) or brightness (brightness distribution) most similar to the reference area, to calculate the movement displacement of the reference area, and to detect the movement displacement of the terminal.
[41] That is, the displacement detection unit 210 selects reference pixels from the frame T(n), and detects the location of the reference pixels in the frame T(n+1). The criteria for selecting reference pixels may be set to select 1) a pixel group including features that can be distinguished from surrounding pixels on the basis of shape, color tone, brightness, etc., or 2) a pixel group having boundaries and pixels that are arbitrarily selected in the center of a frame, or etc.
[42] Further, the screen control unit 220 preferably calculates the area of new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal detected by the displacement detection unit 210, and updates the screen of the terminal.
[43] FIG. 4 is a detailed flowchart showing steps 110 and 120 according to a preferred embodiment of the present invention. Step 110 includes the following steps 111 to 117, and step 120 includes the following steps 121 and 122.
[44] FIG. 5 is a view showing respective frames sensed by the image sensor and a reference area.
[45] The displacement detection unit 210 reads a frame T(n) sensed by the image sensor before the terminal is moved at step 111. In FIG. 5, an area 1 indicated by a dotted line and a solid line is the frame T(n) sensed by the image sensor before the terminal is moved, that is, while currently displayed content is viewed.
[46] Further, a reference area that is composed of unit pixels or pixel groups selected according to predetermined criteria based on shape, color tone, brightness and/or quality and the coordinates of the reference area, are set in the frame T(n) at step 112. From the frame 1 indicated by the solid line in FIG. 5, an area 10 indicated in the form of, for example, a corner, is the reference area.
[47] The displacement detection unit 210 reads a frame T(n+1), which is the subsequent frame sensed by the image sensor after the terminal is moved, at step 113. That is, if the user moves the terminal to view another portion of the content, which the user is currently viewing through the screen, the image sensor also moves along with the movement of the terminal, and senses an area 2 indicated by a dotted line and a solid line in FIG. 5. That is, the area 2 indicated by the dotted line and the solid line in FIG. 5 is the frame T(n+1).
[48] The displacement detection unit 210 detects the location of the reference area, set at step 112, in the frame T(n+1). For this operation, the same criteria as those used to set the reference area at step 112 are applied to all pixels or areas in the frame, so that an area having the same features as that of a previous reference area is detected. The area 20 existing inside the solid line 2 in FIG. 5 would be determined to be the changed reference area in the frame T(n+1). If determination is performed using only the drawing, the criteria for determining the reference area may be shape.
[49] The displacement detection unit 210 determines new coordinates of the reference area detected as described above at step 114.
[50] If the terminal is moved and a previous frame and a new frame are detected by the image sensor, detection results or calculation results for the reference areas of the previous and new frames may not be perfectly identical with each other due to various causes, such as the limitations of the sensor itself, the shaking of the sensor occurring during the movement of the terminal by the user, brightness of instantaneous light and color variation, and the movement of other objects, even though the same calculation conditions are applied and reference areas are calculated or detected. Therefore, in order to prepare for this case, if calculation results for the reference areas belong to a certain range, that is, exist within predetermined threshold values, the reference areas are preferably determined to be the same areas.
[51] Whether calculation results for the reference areas exist within threshold values is determined at step 115, and a predetermined exceptional process is executed at step 116. The exceptional process will be described in detail later.
[52] The displacement detection unit 210 calculates the movement displacement of the reference area based on previous and subsequent coordinates of the reference area before and after movement, respectively, at step 117, and detects the movement displacement of the terminal using the calculated displacement at step 118.
[53] The screen control unit 220 calculates the area of new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal at step 121, updates the content area to be newly displayed on the screen of the terminal, and shows the content area to the user at step 122.
[54] In this case, even though the movement displacement of the terminal is small in the case in which one object sensed by the image sensor is located far from the terminal and in which another object is located near the terminal, the reference area of the far object moves relatively little, while the reference area of the near object moves relatively far. That is, even though the movement displacements of the terminal are identical to each other in the cases in which the object is located far from the terminal and in which the object is located near the terminal, respectively, the displacement, by which the new content area displayed on the screen of the terminal is changed, may differ. In order to prepare for this situation, it is required to determine a new content area updated in consideration of the distance between the terminal and the object sensed by the image sensor, or the reference area, which is part of the object.
[55] For this operation, the distance between the reference area set at step 112 and the terminal is also measured. It is preferable that the area of new content to be displayed on the screen of the terminal be calculated to correspond to the movement displacement of the terminal and the distance between the reference area and the terminal at step 121.
[56] The measurement of the distance between the image sensor and the object or the reference area can be easily performed by a method, such as the automatic focusing of a camera. For example, the time during which an ultrasonic wave is emitted to the object and is returned from the object is measured, or the time during which light is reflected through a light source is measured, so that the distance can be easily measured.
[57] The service of the present invention can be suitably utilized only when different cases, in which a user moves the terminal while walking or moving using a means of transportation while content is provided through the screen of the terminal according to the present invention and in which the user moves the terminal by moving his or her hand or arm to view content placed in another area, are distinguished. For this operation, the displacement detection unit 210 preferably includes the movement confirmation unit 230 manipulated by the user, which confirms that the terminal is moved to view another area of the overall content when the user moves the terminal after or while performing input using the movement confirmation unit 230.
[58] FIG. 6 is a view simply showing an example of an external shape of a terminal to which the present invention is applied. The above-described displacement detection unit 210 is typically located on the side opposite to a screen 340, but it is illustrated on the outside of the terminal for expression in the drawing (310). In the construction of FIG. 6, a movement confirmation unit 330 is preferably placed on a portion of the outside of the terminal 300 that allows a user to easily touch the portion, for convenience of use.
[59] That is, if the user horizontally or vertically moves the terminal 300 after or while pressing the movement confirmation unit 330 in the case where the user desires to view another portion of the content while viewing the content through the screen 340 of the terminal according to the present invention, this operation is recognized as movement that is different from typical movement and is used to view another part of the content according to the present invention. The screen control unit 220 displays the other portion of the content according to the degree of movement of the terminal on the screen 340.
[60] The detection of the movement displacement of the terminal by the displacement detection unit 210 is required to detect lengthwise and crosswise displacements around an area in which the content is displayed or is to be displayed. The area of new partial content displayed on the screen by the screen control unit 220 to correspond to the displacements detected by the displacement detection unit 210 is preferably a content area located away from the displayed partial content area by a distance corresponding to the detected lengthwise and crosswise displacements.
[61] That is, if the content is implemented in two dimensions, the displacement detection unit 210 detects the movement of lengthwise and crosswise coordinates, that is, x and y coordinates, in two dimensions around a plane on which the content is displayed, when the user moves the terminal to view another part of the content.
[62] Further, in this case, movement detection is preferably performed based on the resolution between the pixels of the image sensor. Accordingly, the displacement detection unit 210 detects lengthwise and crosswise displacements in multiples of the distances between pixels based on the resolution between the pixels of the image sensor at step 110. The area of new content displayed on the screen to correspond to the displacements detected by the screen control unit 220 at step 120 is preferably a content area located away from the content area displayed at step 100 by multiples of the distances between lengthwise and crosswise pixels.
[63] The above-description is conducted with respect only to x and y coordinates, which are lengthwise and crosswise directions, respectively, on a plane because it is difficult for the user to move the terminal precisely within a plane. However, this description may be extended and applied even to the movement of a content area in the directions of x, y and z coordinates, including a concept of height, while maintaining the gist of the present invention without change. That is, the direction in which the user moves the terminal is divided into lengthwise, crosswise and vertical directions, and the terminal is moved to a corresponding content area, so that the present invention can be more preferably applied to, in particular, the case in which content is implemented in three dimensions.
[64] In addition to the above-description, various displacement detection methods can be used. Regardless of the displacement detection method used, the method can belong to the scope of the present invention as long as it maintains the gist of the present invention.
[65] As described above, the displacement by which the user moves the terminal is detected, displacement detection results are transmitted to the screen control unit 220, and content existing in an area corresponding to the detected displacement is displayed on the screen 240 of the terminal at step 120.
[66] The user may move the terminal excessively fast or excessively far for some reason while viewing the content. A method of dealing with this situation is described.
[67] As a result of the calculation of the displacement by which the user moves the terminal, by the displacement detection unit 210, the displacement may exceed the range of the coordinates of overall content. In this case, the screen control unit 220 can variously process the above situation as an exceptional case.
[68] As one of exceptional processes executed by the screen control unit 220, the end portion of the overall content may be displayed on the screen. Further, 1) a current situation is determined to be an error situation caused by user error, the error situation is reported to the user, and then the service of the present invention is continuously provided. Further, 2) it is determined that the user intends not to use content any longer, and the display of the content on the screen is stopped. Further, 3) if content to be displayed is composed of a plurality of pages, it is preferable that the content of a subsequent page be displayed on the screen of the terminal, thus allowing steps starting from step 100 to be repeatedly performed. In order to distinguish respective cases from each other, in particular, cases 2) and 3), selection menu items for the user can be displayed on the screen of the terminal, so that the cases can be processed depending on the user's selection.
[69] This operation is also be applied to the exceptional process (step 116) described in FIG. 4, so that an error situation can be determined and reported to the user.
[70] Of course, it is apparent that, even when not in the case of an exceptional process, service can be continued or stopped depending on the user's selection through the above-described selection menu items or other menu items during the use of the content service of the present invention.
[71] When the speed at which the user moves the terminal exceeds a predetermined reference level, it is preferable to deal with this situation similarly to the above description.
[72] Content acquired or stored by the content acquisition unit 200 may be various. For example, the content may be a document, a newspaper, etc., composed of moving images, picture images, figures, entertainment or text, and may be other various content. Regardless of the case, the present invention can be applied.
[73] If the above-described content has been previously stored in the content acquisition unit 200, there is no problem. However, if content is received through a mobile communication network, high service charges may be incurred depending on the type of content or the amount of data constituting the content. In particular, when a charge for overall content corresponding to one page of a drawing, such as a large-scale design drawing, is paid, and the content is downloaded through a mobile communication network, unnecessary charges may be paid if only a portion of the drawing is actually viewed. In order to reduce such an unfavorable effect, only a portion of the overall content, including a partial content area to be selectively displayed on the screen of the terminal, may be received when the content acquisition unit 200 receives content through a predetermined communication means. Further, if the area of new partial content corresponding to the movement displacement of the terminal, detected by the displacement detection unit 210, is not included in the content received by the content acquisition unit 200, it is preferable to receive another portion of the overall content, containing the new partial content area, through the predetermined communication means.
[74] For this operation, even when the content acquisition unit 200 partially receives content through the communication network, the size of the overall content or coordinates of start and end parts of the content must be received together, information about a new content area to be received again from the displacement detection unit 210 must be received, and a corresponding portion of the overall content must be requested and received again.
[75] Through this process, service of using partial content can be provided, and a burden of cost incurred when the service of the present invention is used, can be reduced.
[76] Instead of the above-described method of detecting the displacement, by which the user moves the terminal, and displaying another portion of content, other methods can be applied to the present invention without change and implemented thereby. For example, if a user draws a line right on the screen of the terminal using a means, such as a touch pen, it is possible to display content, which is placed to the right of the content currently being displayed and is not shown, on the screen of the terminal. Although not separately described, it is also possible to apply this example to the present invention while maintaining the gist of the present invention.
[77] Those skilled in the art will appreciate that various modifications, additions and substitutions are possible, without departing from the scope and spirit of the invention as disclosed in the accompanying claims. Therefore, the embodiments disclosed in the present invention must be considered from a descriptive standpoint, not a restrictive standpoint. The embodiments included in the above description are introduced for the understanding of the present invention, and do not limit the spirit and scope of the present invention. For example, in the description, the Internet has been mainly used as an example of the communication network, but it is possible to use a public switched telephone network, that is, a PSTN. It is apparent to those skilled in the art that, in addition to the above examples, it is possible to realize various implementations according to the present invention. The present invention must be interpreted so that the scope thereof is defined by the accompanying claims, not the above description, and all differences, existing in the scope equivalent to the claims, are included in the present invention.
[78] Further, those skilled in the art will easily understand that respective steps of the present invention can be variously implemented in software using typical programming techniques, or in hardware.
[79] Further, some of the steps of the present invention can be implemented in the format of computer-readable code on a recording medium readable by the computer. The computer-readable recording medium includes all types of recording devices, on which data readable by a computer system are stored. As an example of the computer- readable recording medium, there are Read Only Memory (ROM), Random Access Memory (RAM), Compact Disk (CD)-ROM, CD-Rewritable (RW) memory, magnetic tape, floppy disks, Hard Disk Drives (HDD), optical disks, magneto-optic storage devices, etc. Further, the present invention includes an embodiment implemented in the format of carrier waves (for example, transmission through the Internet). Further, the computer-readable recording medium is distributed to computer systems connected to a network, so that the steps of the present invention can be stored and executed in the format of a computer-readable code in a distribution manner. Industrial Applicability [80] According to the present invention, in a method of displaying content including a predetermined screen layout on the restricted size screen of a mobile terminal, such as a mobile phone or PDA, the area of partial content corresponding to the size of a screen of the terminal in overall content having a screen layout to be displayed on the screen is displayed on the screen, the movement displacement of the terminal, by which the user moves the terminal to view an area other than the displayed content area in the overall content, is detected, and the area of some other partial content placed to correspond to the detected displacement in the overall content, is displayed on the screen of the terminal. Therefore, content having a wide display area can be used unchanged using various mobile terminals having display screens having relatively small and structurally restricted sizes, through simple manipulation by the user without modifying the content to be used for a small-scale screen. Accordingly, all parties manufacturing content, parties providing content, and typical users who are final consumers can manufacture, provide and use existing content, respectively, in a convenient environment. Consequently, fields, to which mobile terminals including mobile communication terminals can be applied, can be extended.

Claims

Claims
[1] A method of displaying content having a predetermined screen layout on a restricted size screen of a mobile terminal, such as a mobile phone or Personal Digital Assistant (PDA), comprising the steps of: a) displaying an area of partial content, corresponding to a size of the screen in overall content having a predetermined screen layout to be displayed on the terminal, on the screen of the terminal; b) detecting movement displacement of the terminal, by which the terminal is moved in order for a user of the terminal to view an area other than the displayed content area in the overall content; and c) displaying an area of some other partial content, placed to correspond to the detected displacement in the overall content having a predetermined screen layout, on the screen of the terminal.
[2] The content display method according to claim 1, wherein the step a) comprises the steps of: al) setting coordinates of an entire area in which the content having a predetermined screen layout is to be displayed; a2) setting coordinates of a partial content area to be displayed on the screen depending on a size and resolution of the screen of the terminal; and a3) displaying the content area, the coordinates of which are set, on the screen of the terminal.
[3] The content display method according to claim 1 or 2, wherein partial content initially displayed on the screen of the terminal at step a) includes a start portion of the overall content.
[4] The content display method according to claim 1 or 2, wherein: the detection of the movement displacement of the terminal at step b) is performed to detect lengthwise and crosswise displacements around an area in which the content is displayed or is to be displayed, and an area of new partial content displayed on the screen to correspond to the detected displacements at step c) is a content area located away from the partial content area displayed at step a) by a distance corresponding to the detected lengthwise and crosswise displacements.
[5] The content display method according to claim 4, wherein: the step b) is performed so that, if an image sensor including predetermined light receiving pixels is used to detect the movement displacement of the terminal, the lengthwise and crosswise displacements are detected in multiples of distances between the light receiving pixels of the image sensor, and an area of new content displayed on the screen to correspond to the detected displacements at step c) is a content area located away from the partial content area displayed at step a) by multiples of distances between lengthwise and crosswise pixels, sensed by the image sensor.
[6] The content display method according to claim 5, wherein: the step b) comprises the steps of: bl) reading a frame T(n) sensed by the image sensor before the terminal is moved; b2) setting a reference area composed of unit pixels or pixel groups selected according to predetermined criteria based on shape, color tone and/or brightness, and coordinates of the reference area in the frame T(n); b3) reading a frame T(n+1), which is a subsequent frame sensed by the image sensor, after the terminal is moved; b4) detecting a location to which the reference area selected at step b2) is changed in the frame T(n+1) after the movement of the terminal, according to the criteria used to select the reference area at step b2), and determining coordinates of the changed reference area; b5) calculating movement displacement of the reference area based on previous and subsequent coordinates of the reference area before and after movement, respectively; and b6) detecting movement displacement of the terminal using the calculated movement displacement, and the step c) comprises the steps of: cl) calculating an area of new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal; and c2) updating on the screen of the terminal the content area to be displayed.
[7] The content display method according to claim 6, wherein the reference areas selected at steps b2) and b4), respectively, according to predetermined criteria are determined to be identical reference areas if the reference areas are identical to each other within predetermined threshold values.
[8] The content display method according to claim 6, wherein: a distance between the reference area set at step b2) and the terminal is also measured, and the area of the new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal and the distance between the reference area and the terminal is calculated at step cl).
[9] The content display method according to any of claims 1, 2, 6 or 8, wherein: if the movement displacement of the terminal detected at step b) exceeds an area of the content having a predetermined format to be displayed on the terminal, or a speed per unit time of the detected movement displacement exceeds a predetermined range, an exceptional process is executed, and the exceptional process comprises the steps of determining a current situation to be an error situation and reporting the error situation to the user, or stopping display of the content on the screen, or displaying content of a subsequent page on the screen of the terminal and repeatedly performing steps starting from step a) if the content to be displayed is composed of a plurality of pages.
[10] A mobile terminal, including a mobile phone or Personal Digital Assistant (PDA), for displaying content having a predetermined screen layout on a restricted size screen, comprising: a content acquisition unit for storing overall content to be displayed or receiving the overall content through predetermined communication means; a displacement detection unit for detecting movement displacement by which the terminal is moved in order for a user to view another area of the overall content when a partial area of the content, acquired by the content acquisition unit, is displayed on the screen; and a screen control unit for displaying the partial area of the content, acquired by the content acquisition unit, on the screen of the terminal, determining another partial area of the overall content placed to correspond to the displacement that is detected by the displacement detection unit, and displaying the determined partial area on the screen of the terminal.
[11] The mobile terminal according to claim 10, wherein the displacement detection unit comprises a movement confirmation unit manipulated by the user, so that, when the user moves the terminal after or while performing input using the movement confirmation unit, the movement confirmation unit confirms that the terminal is moved to view another area of the overall content.
[12] The mobile terminal according to claim 10, wherein the screen control unit sets coordinates of an entire area in which the overall content is to be displayed, and coordinates of a partial content area to be displayed on the screen depending on a size and resolution of the screen of the terminal.
[13] The mobile terminal according to claim 10 or 11, wherein: the displacement detection comprises an image sensor that includes predetermined light receiving pixels and is operated to set a reference area, composed of unit pixels or pixel groups selected according to predetermined criteria based on shape, color tone and/or brightness, and coordinates of the reference area, in a frame T(n) sensed by the image sensor before the terminal is moved, detect a location of the reference area in a frame T(n+1), which is a subsequent frame sensed by the image sensor after the terminal is moved, according to the predetermined criteria, calculate movement displacement of the reference area and detect movement displacement of the terminal, and the screen control unit calculates an area of new content to be displayed on the screen of the terminal to correspond to the movement displacement of the terminal detected by the displacement detection unit, and updates the calculated new content area on the screen of the terminal.
[14] The mobile terminal according to claim 10 or 11, wherein: the movement displacement of the terminal performed by the displacement detection unit is adapted to detect lengthwise and crosswise displacements around an area in which the content is displayed or is to be displayed, and the new partial content area, displayed by the screen control unit on the screen, to correspond to the displacements detected by the displacement detection unit is a content area located away from the displayed partial content area by a distance corresponding to the detected lengthwise and crosswise displacements.
[15] The mobile terminal according to claim 10 or 11, wherein the screen control unit is operated so that, if the movement displacement detected by the displacement detection unit exceeds an area of the content having a predetermined format to be displayed on the terminal, or a speed per unit time of the detected movement displacement exceeds a predetermined range, the screen control unit determines this situation to be an error situation and reports the error situation to the user, or stops the display of the overall content on the screen, or displays content of a subsequent page on the screen of the terminal to allow the subsequent page content to be provided if content to be displayed is composed of a plurality of pages.
[16] The mobile terminal according to claim 10 or 11, wherein the content acquisition unit is operated so that, if the content acquisition unit receives content through predetermined communication means, only portion of overall content, including a partial content area to be selectively displayed on the screen of the terminal, can be received, and if an area of new partial content corresponding to the movement displacement of the terminal detected by the displacement detection unit is not included in the content received by the content acquisition unit, another portion of the overall content, including the new partial content area, is received through the communication means.
PCT/KR2005/001647 2004-06-08 2005-06-02 Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof WO2005122415A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2004-0041799 2004-06-08
KR1020040041799A KR20050116661A (en) 2004-06-08 2004-06-08 Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof

Publications (1)

Publication Number Publication Date
WO2005122415A1 true WO2005122415A1 (en) 2005-12-22

Family

ID=35503438

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2005/001647 WO2005122415A1 (en) 2004-06-08 2005-06-02 Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof

Country Status (2)

Country Link
KR (1) KR20050116661A (en)
WO (1) WO2005122415A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007179565A (en) * 2007-02-19 2007-07-12 Sharp Corp Portable equipment
EP1887776A1 (en) * 2006-08-07 2008-02-13 Samsung Electronics Co., Ltd. Portable terminal and user interface control method thereof based on pattern recognition and analysis of image captured by camera
WO2008121986A1 (en) * 2007-03-30 2008-10-09 Google Inc. Document processing for mobile devices

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100648821B1 (en) * 2005-12-08 2006-11-23 삼성에스디에스 주식회사 Method for displaying push type contents and a mobile telecommunication terminal with the same
KR20070004466A (en) * 2006-11-03 2007-01-09 희 한 The vilture screen and mouse curcer moving method by movement of the display of hand helded information equipment
US10698591B2 (en) * 2014-03-31 2020-06-30 Microsoft Technology Licensing, Llc Immersive document interaction with device-aware scaling

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07271505A (en) * 1994-03-29 1995-10-20 Toshiba Corp Image display controller
JPH10333821A (en) * 1997-05-29 1998-12-18 Sony Corp Coordinate inputting device
JP2002366272A (en) * 2001-06-05 2002-12-20 Kyocera Corp Portable terminal device and method for scrolling display image
WO2003036452A1 (en) * 2001-10-24 2003-05-01 Sony Corporation Image information displaying device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040100122A (en) * 2003-05-21 2004-12-02 (주) 유비랩 Display apparatus for mobile phone and the method of same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07271505A (en) * 1994-03-29 1995-10-20 Toshiba Corp Image display controller
JPH10333821A (en) * 1997-05-29 1998-12-18 Sony Corp Coordinate inputting device
JP2002366272A (en) * 2001-06-05 2002-12-20 Kyocera Corp Portable terminal device and method for scrolling display image
WO2003036452A1 (en) * 2001-10-24 2003-05-01 Sony Corporation Image information displaying device

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1887776A1 (en) * 2006-08-07 2008-02-13 Samsung Electronics Co., Ltd. Portable terminal and user interface control method thereof based on pattern recognition and analysis of image captured by camera
US7693333B2 (en) 2006-08-07 2010-04-06 Samsung Electronics Co., Ltd. Portable terminal and user interface control method thereof based on pattern recognition and analysis of image captured by camera
EP2262221A1 (en) * 2006-08-07 2010-12-15 Samsung Electronics Co., Ltd. Portable terminal and user interface control method thereof based on pattern recognition and analysis of image captured by camera
JP2007179565A (en) * 2007-02-19 2007-07-12 Sharp Corp Portable equipment
WO2008121986A1 (en) * 2007-03-30 2008-10-09 Google Inc. Document processing for mobile devices

Also Published As

Publication number Publication date
KR20050116661A (en) 2005-12-13

Similar Documents

Publication Publication Date Title
CN111034181B (en) Image capturing apparatus, image display system, and operation method
US9565364B2 (en) Image capture device having tilt and/or perspective correction
US20120032988A1 (en) Display control apparatus that displays list of images onto display unit, display control method, and storage medium storing control program therefor
US20170220247A1 (en) Method and apparatus for providing poi information in portable terminal
JP5429060B2 (en) Display control apparatus, display control method, display control program, and recording medium on which this display control program is recorded
JP5449894B2 (en) Interest point display system, apparatus and method
US20120032982A1 (en) Manipulation of Graphical Objects
US20100169774A1 (en) Electronics apparatus, method for displaying map, and computer program
JP2006244329A (en) Portable terminal, information processor, and system
JP2005025170A (en) Electronic equipment, display control method, and program
US20100171863A1 (en) Method to enlarge and change displayed image and photographing apparatus using the same
WO2014034683A1 (en) Electronic apparatus, information provision system, control method, and control program
EP2423799A1 (en) Terminal device to store object and attribute information and method therefor
WO2005122415A1 (en) Method for displaying contents in mobile terminal having restricted size display and mobile terminal thereof
JP5278460B2 (en) Portable device program, portable device, and portable device control method
CN113676655B (en) Shooting method and device, mobile terminal and chip system
KR20160065673A (en) Method and system for controlling device and for the same
JP2008065837A (en) Electronic appliance, display control method and program
JP2008077655A (en) Electronic appliance, display controlling method, and display control program
US8941767B2 (en) Mobile device and method for controlling the same
US8866953B2 (en) Mobile device and method for controlling the same
JP2016224173A (en) Control device and control method
JP5446700B2 (en) Information processing apparatus, information processing method, and program
US20150253932A1 (en) Information processing apparatus, information processing system and information processing method
US9113053B2 (en) Input apparatus and method for acquiring a scan image

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase