KR20080045398A - Device and method for document display in a portable information terminal - Google Patents

Abstract

A device and a method of document display in a portable information terminal are provided to eliminate left and right scroll bars owing to the screen enlargement by recognizing characters and space based on the interface between a display region and a hidden region. A portable information terminal comprises a control unit(100), an input unit(200), a display unit(300), a memory unit(400) and a communication unit(500). The input unit transmits the user input to the control unit, and stores various documents in the memory unit. The display unit provides operation procedures and the results of the portable information terminal device to a user, and displays various documents stored in the memory unit on the screen. The memory unit stores an application program which converts the service data into the output data, for offering a system program and the service data to the user. The communication unit is able to perform voice communication and download various documents, by equipping a portable information terminal device, a mobile communication system and a mobile communication module. The control unit controls operations and signal flow of each device, stores the various documents in the memory unit, and displays the documents on the display unit.

Description

 DEVICE AND METHOD FOR DOCUMENT DISPLAY IN A PORTABLE INFORMATION TERMINAL}

1 is an exemplary view showing a screen enlargement due to a difference in resolution when displaying a document on a screen according to the prior art;

2 is a functional block diagram showing the configuration of a portable information terminal according to an embodiment of the present invention.

3 to 5 are exemplary diagrams illustrating a state of recognizing and opening a sentence that is out of the screen area of FIG. 1 according to an exemplary embodiment of the present invention.

6 is an exemplary view showing an application procedure of a sentence recognition method according to an embodiment of the present invention.

7 is a flowchart showing a character recognition method according to an embodiment of the present invention.

FIG. 8 is a flowchart illustrating a document display method for solving the problem of enlargement of a document due to a difference in resolution of a display apparatus by applying the character recognition method of FIG. 7.

<Description of the symbols for the main parts of the drawings>

10: screen position pointer 15: reference line

20: scroll bar 20a: horizontal scroll bar

20b: Vertical scroll bar 30: Sentence margin

35: character margin 40: sentence block

50: screen 60: first reference point

65: second reference point 70: search block

75: character block 80a, 80b: outline

100: control unit 200: input unit

250: external interface means 300: display unit

350: graphics processing means 400: memory

500: communication unit

The present invention relates to an apparatus and method for displaying a document of a portable information terminal, and more particularly, to an apparatus and method for displaying a document of a portable information terminal that can solve a problem of screen magnification due to a difference in resolution when reading a document for a PC stored in the portable information terminal. will be.

 Representative examples of portable information terminals are PDAs (Personal Disital Assistants), PMPs (Portable Multimedia Players), and smart phones.

A PDA is a type of portable computer. A portable personal digital assistant is a portable personal digital assistant that can store and move document files created by a computer at home or office. Say. Initially, it was used only for limited purposes such as calculation and schedule management, but as information and communication technology developed rapidly, users can connect to wireless network using PDA, browse web pages on the Internet, send and receive mail, view, edit and save work documents. PDAs are in the limelight as representative information communication means of post PCs.

PMP is also known as portable multimedia player, portable multimedia player, and next generation portable convergence device. The basic structure is the same as a conventional MP3 player. But unlike MP3 players that only play music, they can play videos and even have a digital camera. In addition to the MP3 player function, the PMP has various functions such as Internet function, text input function, game function, electronic dictionary function, video playback function and digital camera function.

Smartphones combine the merits of mobile phones and PDAs, incorporating PDA features such as calendaring, faxing, Internet access, schedulers and electronic dictionaries.

Such PDAs, PMPs and smartphones may be provided with a function for viewing PC documents among the above functions. The PC document may be a word document, an Excel document, a PowerPoint document, a Hangul document, a web page document, a scan document, or a simple document having various formats (pdf, doc, xls, hwp, ppt, txt, html, xml, etc.). It can be any document running on a PC, such as a text document. The user can store the document in a portable information terminal such as a PDA for viewing a PC document such as a text (txt) file or a scan (pdf) file, such as a novel or various documents, and browse the gap during the movement. Documents having various formats described above are displayed at a higher resolution than a portable information terminal such as a PC display resolution of 1204 × 768 bits or 1920 × 1080 bits, for example. Therefore, when you want to display such a PC document such as a PDF document or a web page document on a narrow 240 × 320 bit LCD screen of a user's portable information terminal, the screen size of the portable information terminal may be adjusted through a separate dithering operation. In addition, since the resolution of the PC document is higher than that of the portable information terminal, a bar for scrolling the screen is displayed to move horizontally and vertically so that the user can scroll and view the entire image.

However, if a dithering operation is required to fit the original document for PC to the resolution of the portable information terminal, that is, a resolution reset operation such as setting a coordinate value and a section to fit the width of the horizontal screen of the portable information terminal should be performed. This is accompanied by a waste of system resources due to the implementation of software or hardware.

In addition, when displaying a PC document on the screen of the portable information terminal without a separate dithering operation, a horizontal and vertical scroll bar 20 is displayed on the screen 50 of the portable information terminal in order to match the difference in resolution as described above. Although it does not matter when reading a simple document of one or two pages, when a large document such as a novel book is to be viewed, it is cumbersome to scroll horizontally hundreds of pages of documents one by one, resulting in user fatigue.

Therefore, in order to solve the above problems, there is an urgent need for a technology capable of automatically optimizing the left and right widths of portable information terminals without providing left and right scrolling in documents such as PDFs and web pages.

An object of the present invention is to solve the above problems, to provide a document display apparatus and method of a portable information terminal that can solve the screen magnification problem that may occur when displaying a PC document on the screen of the portable information terminal. have.

Another object of the present invention is to provide a display area for displaying the PC document on the screen of the portable information terminal to remove the left and right scroll bars due to the enlargement of the screen caused by the large resolution of the PC document displayed on the screen of the portable information terminal. A portable information terminal that checks whether a sentence is a linked sentence in a method of recognizing a sentence based on a boundary with a hidden area, and if it is a linked sentence, designates the linked sentence as a sentence block to perform a new line. A document display apparatus and method are provided.

In order to achieve the above object, a document display apparatus of a portable information terminal according to an embodiment of the present invention, a portable information terminal that receives and stores a PC document through an external interface and provides the PC document to a user through a screen. To display the PC document on the screen. And graphic processing means for recognizing a character or a margin on the basis of a screen boundary between the display area and the hidden area to designate a sentence block, and to break the sentence block to the next line.

In addition, the document display method provided by using the document display apparatus of the portable information terminal, when displaying a PC document on the portable information terminal screen, based on the boundary between the display area and the hidden area to automatically move the hidden area to the next row A display method of opening a line, comprising: a first step of distinguishing a display area and a hidden area of the PC document displayed on a screen by a screen position pointer or a reference line; A second step of generating a sentence block by investigating whether there is a character or a space that is over or adjacent to a reference line indicated by the screen position pointer through a character recognition method; And a third step of wrapping the sentence block spanning the reference line and the hidden region sentence block to the next row.

In addition, the character recognition method of the second step, the first sub-step for generating a first reference point on the screen; A second sub-step of generating a second reference point in a partial region of the character at the shortest distance by dividing a background color and a text color based on the first reference point; Generating a search block around the second reference point and causing the search block to expand the search section in the X-axis and Y-axis directions; When the search block completes the search of one letter and the search block includes one letter, the X-axis maximum value and the Y-axis maximum value may be used to remove an area other than the letter due to the size of the search block. A fourth substep of generating an outer line and removing an area other than the outer line; And a fifth sub-step of generating a character block that is a block that recognizes one character by combining the plurality of search blocks optimized in the fourth sub-step into one.

The above and other objects and features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, with reference to the accompanying drawings will be described an embodiment of the present invention; First, in adding reference numerals to the components of each drawing, the same components will be given the same reference numerals as much as possible, even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

2 is a functional block diagram showing the configuration of a portable information terminal according to an embodiment of the present invention.

2, a portable information terminal according to an exemplary embodiment of the present invention includes a control unit 100, an input unit 200, a display unit 300, a memory unit 400, and a communication unit 500.

In detail, the input unit 200 receives a user's command and transmits it to the control unit 100, and is connected to a separate computer device such as a PC as an external interface means and various documents (word file, Excel file, Korean file, scan file). , Web page files, text files, PowerPoint files, etc.) are stored in the memory unit. To this end, the external interface means 250 may establish a data communication channel with the computer device through the communication unit 500 to receive external data of the computer device. In addition, the input unit 200 may be connected to a mobile communication network through the communication unit 500 and connected to various web servers (content providing server, company file server, etc.) to store various document files in the memory unit 400. . In addition, the input unit 200 may include a voice input device such as a microphone, a keypad, a touch input device such as a touch pad or a touch screen, and a photographing device such as a camera.

The display unit 300 outputs and provides an operation process and a result of the portable information terminal to the user under the control of the controller 100. In addition, the display unit 300 displays documents stored in various computer devices stored in the memory unit 400 on the screen 50. In this case, the display of the horizontal scroll bar 20a may be canceled by recognizing the sentence region cut due to the size limitation of the screen 50 and changing to the next line during display of the document. To this end, the display unit 300 includes a graphic processing unit 350 implemented in hardware or software. When the graphic processing unit 350 displays a document on the screen of the portable information terminal, the graphic processing unit 350 applies a character recognition method based on the boundary between the display area and the hidden area to check whether the text is one linked sentence. The concatenated sentence is designated as a sentence block 40, so that a new line can be performed. A method of recognizing a sentence based on a boundary will be described later in detail with reference to FIGS. 3 to 5. In addition, the display unit 300 outputs an image such as a liquid crystal display device (LCD) or an electro luminescence display device (ELD) to provide a user with various data provided by the control unit 100 and various services provided from the mobile communication system. With a device.

Subsequently, the memory unit 400 stores a system program for driving the portable terminal and an application program for converting the service data into output data in order to provide the user with service data. Here, the system program includes an operating system (OS) for the overall operation and operation of the portable terminal, and a drive driver for initializing, driving, and operating the display unit 300, the input unit 200, and the communication unit 500. On the other hand, the graphic processing means 350 for automatically recognizing and opening a sentence that has spread or deviated from the screen 50 area by interworking with the aforementioned display unit 300 may be implemented in software or hardware. If implemented in software, it is stored in the memory unit 400 as a single application program, and when the user wants to view the document file, it is activated (loaded into the main memory device) under the control of the control unit 100 to display the display unit ( 300).

The communication unit 500 includes a portable information terminal and a mobile communication system and a mobile communication module capable of forming a communication channel in a manner of CDMA, FDMA, WCDMA, GSM, OFDMA, WIBRO, and HSDPA. You can download various documents by connecting to an internet web server or file server. In addition, it is possible to apply wired / wireless data communication methods such as wireless local area network (WLAN), Bluetooth, WIFI, Zigbee, IrDA or USB communication, and serial port for exchanging documents with external computer devices. It may be provided with a data communication module.

The controller 100 controls the operation and signal processing flow of each device such as the display unit 300, the input unit 200, the memory unit 400, the communication unit 500, and the input unit 200 and the communication unit 500. In addition to storing the various document files inputted from the memory unit 400, and displays the document file on the display unit 300 when the user reads. At this time, when displaying the document file, the graphics processing means 350 is controlled to open a sentence deviating from the screen 50.

Hereinafter, a document display method of a portable information terminal according to an embodiment of the present invention will be described.

3 to 5 are exemplary diagrams illustrating a state of recognizing and opening a sentence that is out of the screen area of FIG. 1 according to an exemplary embodiment of the present invention.

3 to 5, when various documents are displayed on the screen 50 of the portable information terminal according to a user's request, the document portion and the screen region displayed in the screen region as shown in FIG. 1 due to the difference in resolution. An external hidden document portion is created and a horizontal and vertical scroll bar 20 is provided to show the hidden document portion to the user. Unlike the vertical scroll bar 20b, the dual horizontal scroll bar 20a cannot switch the screen 50 left or right by using a mouse wheel. Therefore, the user places the mouse pointer on the horizontal scroll bar 20a and drags it. Only the part of the document cut by the screen 50 can be seen. Therefore, in the embodiment of the present invention, in order to eliminate the horizontal scroll bar 20a, the above problem is solved by activating the graphic processing means 350 by the controller 100 when the user displays the document on the screen 50. do. That is, the graphics processing means 350 indicates the maximum length that can be displayed on the screen 50, the character of the document to the screen position pointer 10 that is a coordinate indicator of the screen 50 that the user does not recognize. In detail, the graphic processing unit 350 recognizes characters, text margins 35, and sentence margins 30 from side to side based on the screen position pointer 10 and its reference line 15. For example, as shown in FIG. 3, the graphic processing unit 350 first recognizes the character 'difference' that spans the reference line 15 indicated by the screen position pointer 10 and continues to the left and right based on the character 'difference'. In addition to checking for the absence of text, the text margin (35), sentence margin (30) whether the existence of the question. In the sentence of FIG. 3, it is confirmed that there is no following character other than 'cha' and there is a sentence margin 30 based on the letter 'cha'. Therefore, the letter "cha" and the following sentence "is" is recognized as one sentence to be passed to the next line, that is, the sentence block 40, and a line break, or a line break, to the next line as shown in the [B] state. At this time, the graphic processing means 350 recognizes the period or the enter key at the end of the sentence, and decides whether to push the sentence of the second line and write it on the same line or the third line. Here it is "." Because there is a period at the end of the sentence, all the sentences on the second line are wrapped on the next line. In this manner, the clipped document portion of the first row shown in FIG. 1 is connected to the second row.

4, the graphic processing means 350 checks whether there is a sentence that spans the screen position pointer 10 and the reference line 15 continuously by changing rows. In [A] of FIG. 4, since the sentence "fall" spans the reference line, the character 'ga' is first recognized, and then the presence or absence of a character close to the left and right based on the character 'ga' is examined. The space is recognized by the letter 'a' before and after the graphic processing means 350 checks the length of the margin and if the margin is greater than or equal to the predetermined length, the predetermined length as the sentence margin 30 which is the margin between the word and the word. If less, it is recognized as the character margin 35, which is the margin between characters. The graphic processing unit 350 recognizes the characters between the sentence margins 30 as one connected sentence, that is, the sentence block 40, and if the sentence block 40 indicates that the screen position pointer 10 indicates a reference line ( 15, all sentence blocks after the block 40 are opened. Therefore, the graphic processing unit 350 recognizes the front margin as the sentence margin 30 and the rear margin as the character margin 35 based on the character 'ga' and the next recognized character 'a' with the 'ga'. Recognize one word, that is, a sentence that is linked, "fall". Then, the next space or character is recognized based on the character ',' and the character is recognized continuously until the end of the line, and the presence of a period or return character is examined. Through the above method, the graphic processing means 350 opens a new sentence after the sentence "fall". In addition, the graphic processing means 350 determines that the sentence is a sentence following the next line because there is no period or return character after the character 'star' and displays the words "stars" as shown in [B] of FIG. . Thereafter, the graphic processing unit 350 continuously examines each line to see if there are no characters that span the screen position pointer 10 and the reference line 15, and determines whether a line is broken as described above when detecting the characters. FIG. 5 illustrates how a document displayed on the screen of FIG. 1 is reconstructed according to an embodiment of the present invention.

Meanwhile, the sentence recognition method applied to FIGS. 3 to 5 will be described in detail with reference to FIG. 6. 6 is an exemplary view showing an application procedure of the character recognition method according to an embodiment of the present invention.

 Referring to FIG. 6, first, in order to recognize a single character on the screen 50, a background color and a color different from a background color in the X-axis Y-axis direction are searched about an arbitrary first reference point 60 at an outer corner of the original document. As shown in the state [A], when a specific part of the character 'end' located at the shortest distance from the first reference point 60 is searched, a second reference point 65 is generated at the position and the second reference point 65 is centered. A search block 70 having a predetermined size is generated to search in the X-axis and Y-axis directions. As in the state [B] and state [C], the search section is extended to the X-axis or Y-axis. Subsequently, as shown in the state [D], the search block 70 continues to search based on the second reference point 65, and due to the size of the search block 70, the end collection of the end of the letter 'end' on the X-axis. More than ', leaving spaces besides letters as in state [E]. In order to reduce the margins, the outlines 80a and 80b are generated based on the coordinate end points of the X-axis and Y-axes recognized as characters, and the margins of the search block 70 are removed after the outlines 80a and 80b. . As in the state [F], the search block 70 is combined into one character block 75 so as to be recognized as one character. In the above method, the character is recognized on the screen 50 of the portable information terminal, and the character, the character margin 35, and the sentence margin 30 are sequentially recognized to generate one sentence block 40. Thereafter, it is determined whether the generated sentence block 40 is lined up to the next row by the screen position pointer 10 and the reference line 15.

6 is a flowchart illustrating a character recognition method according to an embodiment of the present invention with reference to FIG.

Referring to FIG. 7, a first reference point 60 is generated in an arbitrary area on the screen (in the embodiment of the present invention, centered on the screen position pointer and the reference line) (S11).

Next, a second reference point 65 is generated in a partial region of the character closest to the first reference point 60 (S12). Here, the recognition method of the text and other areas uses the difference between the background color and the text color.

The search block 70 is generated centering on the second reference point 65, which is a point on the text, and the search section is expanded in the X-axis and Y-axis directions (S13).

Then, due to the size of the search block 70, a margin other than the character is generated, and the outer lines 80a and 80b are generated based on the maximum value of the X axis and the maximum value of the Y axis of the detected character to remove the margin. Areas other than letters are removed based on the outer lines 80a and 80b (S14).

Finally, the plurality of search blocks 70 are combined into one to generate a character block 75 which is a block in which one character is recognized (S15).

FIG. 8 is a flowchart illustrating a document display method for solving the problem of enlargement of a document due to a difference in resolution of a display apparatus by applying the character recognition method of FIG. 7.

Referring to FIG. 8, first, a document area displayed on the screen 50 and a hidden document area are divided based on the screen position pointer 10 which is a screen position pointer (S21).

Afterwards, the character, the text margin 35, and the sentence margin 30 are irradiated back and forth around the text or the margins that span the reference line 15 indicated by the screen position pointer 10 through the aforementioned character recognition method (S22). ).

Recognizes the character, character margin 35, and sentence margin 30 spanning the reference line to generate a sentence block 40 to be opened and all sentence blocks 40 of the hidden document portion including the sentence block 40. The line returns to the next line (S23). In this case, if there is a period or a return character at the end of the last sentence block of the hidden document portion, the sentence on the next line is lined up to the next line to increase the correlation and readability of the paragraph.

Meanwhile, the graphic processing unit according to the embodiment of the present invention may be implemented in hardware or software as described above. In FIG. 2, the graphic processing unit is included in the display unit, but is not limited thereto. Or may operate as a separate component.

The above description is merely illustrative of the present invention, and those skilled in the art will appreciate that various modifications may be made without departing from the essential features of the present invention. Therefore, the embodiments disclosed herein are not intended to limit the present invention but to describe the present invention, and the spirit and scope of the present invention are not limited by these embodiments. If the scope of the present invention is to be interpreted by the claims below, it should be interpreted that all techniques falling within the scope of the present invention are included in the scope of the invention.

As described above, the apparatus and method for displaying a document of a portable information terminal according to an embodiment of the present invention can solve a screen magnification problem that may occur when displaying a document for a PC on a screen of the portable information terminal.

In addition, the document display apparatus and method of a portable information terminal according to an embodiment of the present invention, the PC document to remove the left and right scroll bars due to the screen enlargement caused by the large resolution of the PC document displayed on the screen of the portable information terminal When displaying on the screen of the portable information terminal, the character and the margins are recognized based on the boundary between the display area and the hidden area to check whether it is one linked sentence. You can do a new line.

In addition, preferred embodiments of the present invention are disclosed for the purpose of illustration, those skilled in the art will be able to make various modifications, changes, additions, etc. within the spirit and scope of the present invention, such modifications and modifications belong to the scope of the claims You will have to look.

Claims (8)

In a portable information terminal for receiving and storing a PC document through an external interface and providing the PC document to the user through a screen, The resolution of the PC document due to the difference in resolution when the PC document is displayed on the screen. A graphic processing means for recognizing a character or a margin on the basis of a screen boundary between a display area and a hidden area and specifying a sentence block, and for breaking the sentence block to the next row; Document display device. The method of claim 1, wherein the graphic processing means, And a screen position pointer or a reference line positioned at the screen boundary for distinguishing the display area from the hidden area. The method of claim 1 or 2, wherein the sentence block, And a connected sentence generated by the graphic processing means by recognizing a character, a space between characters, or a space between sentences that is adjacent to or adjacent to the screen position pointer and the reference line. The method of claim 3, wherein the graphic processing means, Portable information terminal characterized in that if the end of the last sentence block in the hidden area of the PC document, if there is a period character or a return character, the entire sentence on the next line is lined up to the next line when the hidden area is opened. Document display device. A display method for automatically opening a new line to a next line based on a boundary between a display area and a hidden area when displaying a PC document on a screen of a portable information terminal. A first step of distinguishing a display area and a hidden area of the PC document displayed on the screen by a screen position pointer or a reference line; A second step of generating a sentence block by investigating whether there is a character or a space that is over or adjacent to a reference line indicated by the screen position pointer through a character recognition method; And And a third step of breaking the sentence block spanning the reference line and the hidden region sentence block into a next row. The method of claim 5, wherein the third step, Recognizing a period character or a return character at the end of the last sentence block of the hidden region, and when the sentence blocks of the hidden region are lined up to the next line, newline all sentences on the next line to the next line; Document display method of a portable information terminal characterized in that it further comprises. The method of claim 5, wherein the character recognition method of the second step, A first substep of generating a first reference point on the screen; A second sub-step of generating a second reference point in a partial region of the character at the shortest distance by dividing a background color and a text color based on the first reference point; Generating a search block around the second reference point and causing the search block to expand the search section in the X-axis and Y-axis directions; When the search block completes the search of one letter and the search block includes one letter, the X-axis maximum value and the Y-axis maximum value may be used to remove an area other than the letter due to the size of the search block. A fourth substep of generating an outer line and removing an area other than the outer line; And And a fifth sub-step of generating a character block that is a block that recognizes one character by combining the plurality of search blocks optimized in the fourth sub-step into one. The method of claim 5, wherein the margin is, A document display method of a portable information terminal, characterized in that it is a text margin which is a predetermined interval between characters and a sentence margin which is a predetermined interval between sentences.

Images