JP2013097626A - Mobile information terminal and book image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the convenience in browsing a book image on a mobile information terminal.SOLUTION: A mobile information terminal 100 includes: a normal display control unit 84 which displays image data showing an entire page of a book in such a size that the entire image data can be displayed on a touch panel 12; a row setting acceptance unit 76 which accepts information relating to the number of rows of the page of the book, from a user; a row extraction unit 80 which extracts a part corresponding to one row of the page of the book from the image data, as row data on the assumption that the image data includes the number of rows designated by the user; and an enlarging display control unit 86 which displays the extracted row data on a display in a size larger than the display size in which the image data is displayed by the normal display control unit 84.

Description

  The present invention relates to a data processing technique, and more particularly to a portable information terminal that displays an image of a book and a display method thereof.

  Portable information terminals that can display various types of image data have become widespread. In addition, a book on a paper medium may be converted into an electronic file using an image scanner, and the book may be browsed by taking the electronic file into a portable information terminal.

  In general, there is a restriction on the size of the display of the portable information terminal, and it has to be a relatively low resolution. On the other hand, image data obtained by scanning a book may be larger than the resolution of the display. . For this reason, when the image data of a book is displayed on a portable information terminal, the visibility of characters is lowered, and the convenience for the user may be reduced.

  The present invention has been made in view of these problems, and a main purpose thereof is to provide a technique for improving the convenience of browsing a book image on a portable information terminal.

  In order to solve the above-described problem, a portable information terminal according to an aspect of the present invention includes a first display control unit that displays image data indicating an entire book page in a size that can be displayed on a display, and the number of lines in the book page. A line information receiving unit that receives related information from the user, and an extraction unit that extracts a portion corresponding to one line of a book page from the image data as line data, assuming that the image data includes the number of lines specified by the user. And a second display control unit that displays the extracted row data on the display in a size larger than the display size by the first display control unit.

  Another aspect of the present invention is a book image display method. This method is a method executed by the portable information terminal, and includes a first display step of displaying image data indicating the entire book page in a size that can be displayed on the display, and information related to the number of rows of the book page. A line information receiving step for receiving the image data, an extraction step for extracting, as line data, a portion corresponding to one line of the book page from the image data, assuming that the image data includes the number of lines specified by the user, A second display step of displaying the line data on the display in a size larger than the display size in the first display step.

  It should be noted that any combination of the above-described constituent elements and a representation of the present invention converted between an apparatus, a method, a system, a program, a recording medium storing the program, and the like are also effective as an aspect of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, the convenience of browsing a book image in a portable information terminal can be improved.

It is a figure which shows the external appearance of the portable information terminal of embodiment. It is a figure which shows the state which displayed the book image on the touch display. It is a figure which shows the user interface which expands and displays the book image of FIG. It is a figure which shows the example of a display when the number of lines is set excessively in FIG. It is a figure which shows the example of a display when the next line button is pressed in FIG. It is a figure which shows the hardware constitutions of a portable information terminal. It is a block diagram which shows the function structure of a portable information terminal. It is a figure which shows the setting value hold | maintained at a setting information holding part. It is a figure which shows the setting value of FIG. 8 using a book expansion display screen. It is a figure which shows the pseudo code which transcribe | transfers the line image of a book image to the enlarged display area 22. FIG. It is a flowchart which shows operation | movement of a portable information terminal. It is a flowchart which shows the book expansion display screen process of S16 of FIG. 11 in detail. It is a flowchart which shows in detail the line expansion display process of S46 of FIG. It is a figure which shows the state which displayed the horizontally-written book image on the touch display. It is a figure which shows the user interface which expands and displays the book image of FIG.

  FIG. 1 shows an appearance of a portable information terminal 100 according to an embodiment. The portable information terminal 100 is an information processing device having a size that can be carried by a user. The portable information terminal 100 displays image data indicating a book page (hereinafter also referred to as “book image”) on a display in accordance with a user operation.

  The book image in the embodiment is image data (hereinafter, also referred to as “raster image”) in which the contents of a book page are stored in a raster image format, and may be a bitmap file, a JPEG file, or the like. The book image may be an electronic file obtained by reading a page of a paper book (for example, a literary book, a business book, or a magazine) with an image scanner. The portable information terminal 100 may be a portable game machine, a mobile phone, a smartphone, a tablet information terminal, or an electronic book viewing terminal.

  The portable information terminal 100 includes a touch panel 12 and a display 10, and the touch panel 12 is disposed over the entire surface of the display 10. Of course, the display 10 and the touch panel 12 may be configured integrally, and when the display 10 and the touch panel 12 are collectively referred to, they are referred to as “touch display 14”. Although not shown in FIG. 1, the display 10 further includes a rear touch panel 18. The back touch panel 18 is provided on a surface different from the surface on which the touch display 14 is provided in the portable information terminal 100. In the embodiment, the back touch panel 18 is provided on a surface (back surface) opposite to the surface on which the touch display 14 is provided. ing.

  The portable information terminal 100 further includes a controller 16 such as various buttons and a cross key for the user to operate the portable information terminal 100. However, in the following description, it is assumed that a user operation on the portable information terminal 100 is performed via the touch panel 12 and the rear touch panel 18.

  FIG. 2 shows a state in which the book image 20 is displayed on the touch display 14. Since the portable information terminal 100 is assumed to be carried by the user, there are restrictions on the housing size and the display size, and thus the display resolution is a relatively low value. For example, the case size may be 6.2 cm wide × 11.6 cm high, the display size may be 5.2 cm wide × 7.8 cm high, and the display resolution may be 320 pixels wide × 480 pixels high. On the other hand, a raster image obtained by scanning a paper medium book may be, for example, 1480 pixels wide by 2221 pixels high.

  In this example, when the book image 20 is displayed in the size of the touch display 14, the size of the book image 20 displayed on the touch display 14 is reduced to about 21% of the size of the original book image 20. . As a result, the characters are displayed very small, and the characters may be displayed in a collapsed manner, so that the visibility of the text deteriorates for the user, making it difficult to read.

  Therefore, the portable information terminal 100 according to the embodiment cuts out sentences described in the book image 20 in units of lines, and displays the image data of each line in a larger size than before. That is, the book image 20 is displayed in a size larger than the display size of each row when the book image 20 is displayed in the size of the touch display 14. Therefore, even when the size of the book image 20 is larger than the resolution of the touch display 14, the user can read the sentence in line units with an easy-to-read character size. Hereinafter, in the book image 20 of the embodiment, it is assumed that a sentence is described in vertical writing.

  FIG. 3 shows a user interface for enlarging and displaying the book image of FIG. The enlarged display area 22 is an area in which the text described in the book image 20 is enlarged and displayed in units of lines. The head position guide 24 is an object for the user to specify the start position where a sentence is described in the book image 20, for example, the position of the upper right corner in a vertically written sentence. The end position guide 26 is an object for the user to specify the end position where a sentence is described in the book image 20, for example, the position of the lower left corner in a vertically written sentence. As will be described later, by specifying the head position guide 24 and the tail position guide 26, a blank area in the book image 20 where no text is described is excluded from the enlarged display target.

  The line spacing adjustment area 30 is an operation area for the user to adjust the number of lines of the book image 20 (in other words, the line spacing and line width of the book image 20). The line guide 32 is an object indicating a virtual line provided with a line width corresponding to the adjustment result in the line space adjustment area 30. The enlarged line indicator 34 is an object indicating a line displayed in the enlarged display area 22, that is, a line that is currently an enlarged display target. Although shown by a thick frame in FIG. 3, it is needless to say that the row to be enlarged and the row not to be enlarged may be in other forms that can be visually distinguished. The previous line button 36 is a button object for returning the line targeted for enlargement display to the previous line, and the next line button 38 is a button object for moving the line targeted for enlargement display one step backward.

Next, a procedure for enlarging and browsing a book image will be described. The user performs the following three-step operation on the portable information terminal 100.
(Step 1) Setting of the enlargement target area 28:
The user drags the head position guide 24 and aligns the upper right end portion of the head position guide 24 with the start position of the sentence, typically the upper right end position of the rectangular area in which the text is described. Further, the tail position guide 26 is dragged so that the lower left end portion of the tail position guide 26 is aligned with the end position of the sentence, typically the lower left end position of the rectangular area in which the text is described. As a result, the enlargement target area 28 including one or more lines to be enlarged is set.

(Step 2) Setting of the number of lines in the enlargement target area 28:
The user performs a tap operation or a trace operation (in other words, a tracing operation) on the line spacing adjustment area 30 to increase or decrease the number of lines in the enlargement target area 28, and Adjust to fit the text on each line. For example, since the enlargement target area 28 in FIG. 3 has 19 lines, the number of lines is adjusted to 19 lines. In the embodiment, the closer the user's tap position or the end position of the trace operation is to the left end of the line spacing adjustment area 30, the more the number of lines increases. In other words, the line spacing narrows and the line width narrows. Conversely, the closer the user's tap position or the end position of the trace operation is to the right end of the line spacing adjustment area 30, the smaller the number of lines, in other words, the line spacing increases and the line width increases.

  FIG. 4 shows a display example when the number of rows is excessively set in FIG. This figure shows a display example when the number of lines is set to 24 lines in the line spacing adjustment area 30 where the text in the enlargement target area 28 is actually 19 lines. In this case, since only a part of one line of the book image 20 is accommodated between the lines of the line guide 32, only a part of one line of the book image 20 is displayed in the enlarged display area 22. Specifically, the left side of the character is not displayed. In the state of FIG. 4, the user decreases the number of rows while viewing the display state of the enlarged display area 22 and the display state of the line guide 32 in the enlargement target area 28. That is, the number of lines is reduced by tapping the position on the right side of the line spacing adjustment area 30 than before. Returning to FIG.

(Step 3) Browse by line:
As shown in FIG. 3, the user browses the first line of the enlargement target area 28 after adjusting the number of lines. After browsing the first row, the user taps the next row button 38 to display the second row of the enlargement target area 28 in the enlarged display area 22. FIG. 5 shows a display example when the next line button 38 in FIG. 3 is pressed. In the figure, the second line of the enlargement target area 28 is displayed in the enlargement display area 22, and the enlargement line indicator 34 is also moved from the first line to the second line of the enlargement target area 28. When the user finishes viewing the second row, the user taps the next row button 38 again to display the third row of the enlargement target area 28 in the enlarged display area 22. By repeating this, the user reads the book image 20 line by line.

  Although details will be described later, the portable information terminal 100 assumes that the book image 20 includes the number of lines specified by the user, and cuts out image data from the book image 20 in units of lines and displays the image data in the enlarged display area 22. . As a result, even if the raster image does not have information such as the number of rows and the row width, the image of each row can be cut out and presented to the user in a large size, and the convenience of browsing the book image by the user can be improved. it can. In the following, the user interface shown in FIG. 3 is also referred to as a “book enlargement display screen”, while the user interface shown in FIG. 2 is also referred to as a “book normal display screen”.

A configuration of the portable information terminal 100 that realizes the user interface described above will be described.
FIG. 6 shows a hardware configuration of the portable information terminal 100. The portable information terminal 100 includes a display 10 and a touch panel 12 collectively referred to as a touch display 14, a rear touch panel 18, a power supply unit 40, a CPU 42, a main memory 44, and a flash memory 46. These devices are connected directly or indirectly via a bus.

  The flash memory 46 holds an OS, various driver software, and a book image browsing application (hereinafter also referred to as “book browsing application”). The CPU 42 comprehensively controls the entire portable information terminal 100 by the OS stored in the flash memory 46, and executes a book image display process according to the book browsing application. The CPU 42 may include a GPU specialized for graphic processing such as product-sum operation. The main memory 44 is a temporary storage area for program modules executed by the CPU 42, and is also used as a work area for temporarily storing processing data of the CPU 42. The main memory 44 is composed of, for example, a RAM. The power supply unit 40 includes an AC adapter and a rechargeable battery, and supplies power to each device according to the control of the CPU 42.

  The display 10 displays various information according to the control of the CPU 42. Specifically, the book image data designated by the CPU 42 is converted into a video signal, and various information is displayed on the screen in accordance with the video signal. The display 10 may be a liquid crystal display or an organic EL display, for example. The touch panel 12 and the rear touch panel 18 include a coordinate detection device (not shown), detects a tap position tapped with a user's finger and a trace point traced with the user's finger, and detects the tap position and the trace point of the trace. The CPU 42 is notified of coordinate information indicating the position.

  FIG. 7 is a block diagram showing a functional configuration of the portable information terminal 100. The portable information terminal 100 includes a display 10, a touch panel 12, a back touch panel 18, a touch panel driver 50, a display driver 52, a back touch panel driver 54, a data holding unit 60, and a book browsing processing unit 70.

  Each block shown in the block diagram of the present specification can be realized in terms of hardware by elements and mechanical devices such as a CPU and a memory of a computer, and in terms of software, it can be realized by a computer program or the like. Then, the functional block realized by those cooperation is drawn. Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by a combination of hardware and software. For example, the book browsing processing unit 70 may be stored in the flash memory 46 as a book browsing application, and a program module corresponding to each functional block may be appropriately read into the main memory 44 and executed by the CPU 42. The data holding unit 60 may be realized by the flash memory 46 and the main memory 44.

  The touch panel driver 50, the display driver 52, and the back touch panel driver 54 are driver software that mediates the touch panel 12, the display 10, and the back touch panel 18 as hardware and the book browsing processing unit 70.

  The data holding unit 60 includes a book image holding unit 62 and a setting information holding unit 64. The book image holding unit 62 holds book image data browsed by the user, that is, raster image data indicating the contents of a book page. The book image data may be read by the portable information terminal 100 from an external scanner device or PC via a USB interface (not shown) and stored in the book image holding unit 62. The setting information holding unit 64 holds various setting values referred to in the book image enlargement display processing by the book browsing processing unit 70.

  FIG. 8 shows setting values held in the setting information holding unit 64. FIG. 9 shows the setting values of FIG. 8 using the book enlargement display screen. The “notation” column in FIG. 8 shows the notation in the following description. Also, the setting value set as a constant in the “Constant / variable” column may be set as a fixed value when the book browsing application is installed. For example, the display size specified by the model of the portable information terminal 100 or the display size input by the user at the time of installation may be set as the terminal screen width and the terminal screen height. In the embodiment, the maximum number of rows is 25, and the minimum number of rows is 10. A predetermined margin value (for example, the number of pixels) may be set for the upper margin, the lower margin, and the row margin. The set value set as a variable in the “Constant / variable” column is a predetermined initial value, but as will be described later, the value is dynamically changed by each functional block of the book browsing processing unit 70. Is done.

  Returning to FIG. 7, the book browsing processing unit 70 includes an operation detection unit 72, a text range reception unit 74, a line setting reception unit 76, a line area specification unit 78, a line extraction unit 80, and a display control unit 82. Including. The display control unit 82 executes display processing of a book image on the display 10 and includes a normal display control unit 84 and an enlarged display control unit 86.

  The operation detection unit 72 detects the content of the user's operation on the touch panel 12 based on the coordinate information input from the touch panel 12 via the touch panel driver 50. Further, the operation detection unit 72 detects the user's operation content on the rear touch panel 18 based on the coordinate information input from the rear touch panel 18 via the rear touch panel driver 54. The user operation content may be, for example, information indicating the fact and the tap position of the tap operation, the fact and the trace position of the trace operation. Further, when the start position of the trace operation is the display position of the head position guide 24 or the tail position guide 26, it is detected as a drag operation of the head position guide 24 or the tail position guide 26.

  The operation detection unit 72 is an operation for designating a book image held in the book image holding unit 62, and an operation for instructing to display the book image on the book normal display screen (hereinafter referred to as “normal display instruction”). Accept). Further, an operation for instructing to display the book image displayed on the book normal display screen on the book enlargement display screen (hereinafter also referred to as “enlargement display instruction”) is detected.

  The normal display control unit 84 controls the display of the normal book display screen illustrated in FIG. 2 when a predetermined operation indicating a normal display instruction for a book image is detected by the operation detection unit 72. Specifically, the book image data designated in the normal display instruction is acquired from the book image holding unit 62, and the entire book image is displayed in a screen size of the display 10.

  When displaying the book image, the normal display control unit 84 stores the width and height of the book image in the setting information holding unit 64 as IMAGEWIDTH and IMAGEHEGHT. Further, WIDTH / IMAGEWIDTH is stored in the setting information holding unit 64 as a display magnification (DISPRATIO). As a modification, HEIGHT / IMAGEHEIGHT may be used as the display magnification, and the smaller of WIDTH / IMAGEWIDTH and HEIGHT / IMAGEHEIGHT may be used as the display magnification. The normal display control unit 84 displays the book image in a reduced manner according to the display magnification. In other words, a reduced image having a size obtained by reducing the width and height of the book image by the display magnification is displayed on the display 10.

  The enlargement display control unit 86 controls the display of the book enlargement display screen shown in FIG. 3 when a predetermined operation indicating a book image enlargement display instruction is detected by the operation detection unit 72. Specifically, the enlarged display area 22, the head position guide 24, the tail position guide 26, the line spacing adjustment area 30, the line guide 32, and the enlarged line indicator 34 are superimposed on the book image displayed by the normal display control unit 84. Is displayed. Note that in the initial state in which the head position guide 24, the tail position guide 26, and the line spacing adjustment area 30 are not adjusted, the text of the book image and the line guide 32 do not normally match, so the display state as shown in FIG. Become.

The enlarged display control unit 86 calculates the set value of the enlarged display area 22 as follows, displays the enlarged display area 22 at the center of the display 10 according to the set value, and sets the set value to the setting information holding unit 64. To store. In the embodiment, the display size of the image in each row in the enlarged display area 22 is the original size of the book image.
ZOOMDISPHEGHT = (ENDY−STARTY) − (UPPERMARGIN + LOWERMARGIN)
ZOOMDISPLINENUM = (ENDY−STARTY) / DISPRATIO / ZOOMDISPHEIGHT
Note that the initial value of CURRENTLINE is 0, that is, the first line of the enlargement target area 28 (strictly, the position assumed to be the first line).

  When the operation detection unit 72 detects a drag operation of the head position guide 24 on the book enlargement display screen, the text range reception unit 74 acquires the upper right end coordinates of the head position guide 24 on the touch panel 12 from the operation detection unit 72. Then, the value of the upper right end coordinate is stored in the setting information holding unit 64 as STARTX and STARTY. Similarly, when the drag operation of the tail position guide 26 on the book enlargement display screen is detected by the operation detection unit 72, the lower left coordinates of the tail position guide 26 on the touch panel 12 are acquired from the operation detection unit 72. The values of the lower left corner coordinates are stored in the setting information holding unit 64 as ENDX and ENDY.

  When the operation detection unit 72 detects a drag operation of the head position guide 24 on the book enlargement display screen, the enlargement display control unit 86 acquires the coordinates of the locus point of the drag operation from the operation detection unit 72 and performs the drag operation. Accordingly, the display position of the head position guide 24 is changed. Similarly, when the drag operation of the tail position guide 26 on the book enlargement display screen is detected by the operation detection unit 72, the coordinates of the locus point of the drag operation are acquired from the operation detection unit 72, and the tail position is determined according to the drag operation. The display position of the guide 26 is changed. Further, the enlarged display control unit 86 specifies a rectangular area having (STARTX, STARTY) as the upper right end coordinates and (ENDX, ENDY) as the lower left coordinates as the enlargement target area 28. And in order to show a user the area | region which is not an expansion display object, area | regions other than the expansion object area 28 in the display 10 are displayed in the aspect of gray out.

  The line setting reception unit 76 acquires the coordinates of the tap position from the operation detection unit 72 when the operation detection unit 72 detects the user's tap operation in the line space adjustment area 30 of the book enlargement display screen. When the user's trace operation in the line spacing adjustment area 30 is detected by the operation detection unit 72, the coordinates of the trace end position are acquired from the operation detection unit 72. The tap position and the trace end position are collectively referred to as “user designated position”.

  The line setting receiving unit 76 determines the number of lines and the line width of the enlargement target area 28 based on the user designated position in the line spacing adjustment area 30. The width of the line adjustment area 30 is set to be the same as that of the enlargement target area 28 by the enlargement display control unit 86, and the width of the line adjustment area 30 is also changed when the width of the enlargement target area 28 is changed. It will be done.

Specifically, the line setting reception unit 76 calculates the number of lines and the line width as follows.
LINENUM = (Abscissa of user specified position-STARTX) / (ENDX-STARTX) x (MAXLINENUM-MINLINENUM) + MINLINENUM (rounded up to the nearest decimal point)
LINEWIDTH = (ENDX-STARTX) / LINENUM
That is, as the user-specified position in the line spacing adjustment area 30 is closer to the left end of the line spacing adjustment area 30, LINENUM becomes a larger value (that is, approaches 25) and LINEWIDTH becomes a smaller value. On the other hand, the closer the user-specified position is to the right end, the smaller the value of LINENUM (that is, closer to 10), and the larger the value of LINEWIDTH. The line setting receiving unit 76 stores LINENUM and LINEWIDTH in the setting information holding unit 64.

  The enlarged display control unit 86 updates the display of the line guide 32 when a user tap operation or trace operation in the line spacing adjustment area 30 on the book enlarged display screen is detected. Specifically, (LINENUM-1) line guides 32 are set on the enlargement target area 28 at intervals indicated by LINEWIDTH so that the enlarged display area 22 is divided into the number of lines indicated by LINENUM.

  In the embodiment, in order to indicate to the user that the number of lines increases as the left side of the line spacing adjustment area 30 is specified, the enlarged display control unit 86 has a line guide 32 positioned on the left side of the enlargement target area 28. The length is displayed long. As a modification, a line guide 32 independent of the enlargement target area 28 may be displayed in the line spacing adjustment area 30. The interval between the line guides 32 may be narrowed toward the left side of the line spacing adjustment area 30, or conversely, the space between the line guides 32 may be widened toward the right side of the line spacing adjustment area 30.

  The line area specifying unit 78 refers to the setting value stored in the setting information holding unit 64 and assumes that the enlargement target area 28 includes the number of lines indicated by LINENUM. An area in which one line of text is assumed to be described in the enlargement target area 28 is specified. In other words, the line area specifying unit 78 specifies an area corresponding to one line of text in the enlargement target area 28 on the assumption that the enlargement target area 28 has a line width indicated by LINEWIDTH. In other words, the line area specifying unit 78 estimates the area occupied by the description of one line of text in the book image according to LINENUM and LINEWIDTH.

  The line extraction unit 80 extracts the image data of the area specified by the line area specifying unit 78 as a “line image” from the book image. The enlargement display control unit 86 causes the line image extracted by the line extraction unit 80 to be displayed in the enlargement target area 28 in a folded manner. Specifically, the enlarged display control unit 86 refers to the setting value stored in the setting information holding unit 64, specifies an area where the line image should be transferred, and transfers the data of the line image to the area.

  FIG. 10 shows pseudo code for transferring a line image of a book image to the enlarged display area 22. The code block 90 in FIG. 9 shows the processing contents of the row area specifying unit 78, the code block 92 shows the processing contents of the line extraction unit 80, and the code block 94 shows the processing contents of the enlarged display control unit 86. ing. As shown in the figure, for each line of the enlargement target area 28, the copy source coordinates in the original book image are specified and a line image (in this case, means a part of one line of text in the original book image) is extracted. Is done. Then, for each line of the enlargement target area 28, the copy destination coordinates of the line image are specified, and the above line image is copied. Thereby, a part of one line image in the book image is displayed in each line of the enlarged display area 22. That is, an image of one line of text in the book image is displayed folded over a plurality of lines in the enlarged display area 22.

  When the operation detecting unit 72 detects a tap operation on the previous line button 36 on the book enlargement display screen, the line area specifying unit 78 decrements CURRENTLINE in the setting information holding unit 64, and the process of FIG. 10 is re-executed. . That is, the line area specifying unit 78 specifies an area in which the previous line of the enlargement target line in the book image 20 is described. The line extraction unit 80 extracts a new line image corresponding to the previous line in accordance with the area newly specified by the line area specifying unit 78, and the enlarged display control unit 86 replaces the previous line image with a new one. The line image is displayed in the enlarged display area 22.

  When the operation detecting unit 72 detects a tap operation on the next line button 38 on the book enlargement display screen, the line area specifying unit 78 increments CURRENTLINE of the setting information holding unit 64 and the process of FIG. 10 is re-executed. . That is, the line area specifying unit 78 specifies an area in which the next line of the line to be enlarged up to that point in the book image 20 is described. The line extracting unit 80 extracts a new line image corresponding to the next line in accordance with the area newly specified by the line area specifying unit 78, and the enlarged display control unit 86 replaces the previous line image with a new one. The line image is displayed in the enlarged display area 22.

  When a tap operation on the rear touch panel 18 is detected by the operation detection unit 72 during display of the book enlargement display screen, the book enlargement display screen is switched to the book normal display screen. Specifically, the enlarged display control unit 86 displays various objects (enlarged display area 22, line spacing adjustment area 30, etc.) displayed on the book image 20 on the book enlarged display screen by hiding them. 10 is returned to the book normal display screen. In the embodiment, when a predetermined operation indicating a book image enlargement display instruction is newly detected by the operation detection unit 72, the enlargement display control unit 86 displays the book enlargement display screen again. As a modification, when the rear touch panel 18 is tapped again, the enlarged display control unit 86 may display the book enlarged display screen again.

The operation of the portable information terminal 100 having the above configuration will be described below.
FIG. 11 is a flowchart showing the operation of the portable information terminal 100. The user of the portable information terminal 100 selects a book image to browse and performs a predetermined operation indicating a normal display instruction. When the operation detection unit 72 detects the operation (Y in S10), the normal display control unit 84 acquires the book image specified by the normal display instruction from the book image holding unit 62, and displays the entire book image on the touch display 14. Is reduced and displayed so as to fit within the screen size (S12). That is, the normal display control unit 84 displays the normal book display screen. When characters are difficult to read on the normal book display screen, the user performs a predetermined operation indicating an enlarged display instruction. When the operation detection unit 72 detects the operation (Y in S14), a book enlargement display screen process described later is executed (S16). If the enlarged display instruction is not accepted (N in S14), S16 is skipped.

  When switching from the book enlargement display screen to the book normal screen, the user taps the back touch panel 18. When the operation detection unit 72 detects a tap operation on the rear touch panel 18 (Y in S18), if the book enlarged display screen is being displayed (Y in S20), the enlarged display control unit 86 displays the book image 20 in an overlapping manner. Various objects on the book enlargement display screen, such as the book image 20 that has been made, are hidden. Thereby, it switches from a book expansion display screen to a book normal display screen, and returns to S14 (S22). If the tap operation on the rear touch panel 18 has not been detected (N in S18), S20 is skipped and a book image display end determination is executed. In addition, if the tap operation on the rear touch panel 18 is accepted but the book enlargement display screen is not being displayed (N in S20), the book image display end determination is executed.

  If the predetermined operation instructing the end of the book image display is not detected by the operation detection unit 72 (N in S24) and the book enlarged display screen is being displayed (Y in S26), the process returns to S16. On the other hand, if the book normal display screen is being displayed (N in S26), the process returns to S14. When a predetermined operation for instructing the end of the book image display is detected (Y in S24), the flow of FIG. If the normal display instruction for the book image is not detected (N in S10), the subsequent steps are skipped and the flow of this figure is terminated.

  FIG. 12 is a flowchart showing in detail the book enlargement display screen process in S16 of FIG. If the book enlargement display screen is not displayed (Y in S30), the enlargement display control unit 86 enlarges the book by displaying the various objects shown in FIG. 3 such as the enlargement display area 22 on the book image. A display screen is displayed (S32). If the book enlargement display screen has been displayed (N in S30), S32 is skipped. When the drag operation of the head position guide 24 or the tail position guide 26 is detected (Y in S34), the sentence range receiving unit 74 updates the coordinate values of STARTX and STARTY or ENDX and ENDY according to the drag operation. (S42). The enlargement display control unit 86 updates the display position of the head position guide 24 or the tail position guide 26 according to the drag operation, and updates the display area of the enlargement target area 28 (S44). Then, a later-described line enlargement display process is executed (S46).

  The user checks the display of the line image in the enlarged display area 22 and the display of the line guide 32 on the book image as needed, and determines whether the number of lines of the book image is set appropriately. When the character string does not fit between the lines in the enlarged display area 22 or when the character string does not fit between the lines of the line guide 32, the user increases or decreases the number of lines via the line spacing adjustment area 30. When the drag operation of the head position guide 24 or the tail position guide 26 is not detected (N in S34) and an operation on the line spacing adjustment area 30 is detected (Y in S36), the line setting reception unit 76 displays the line spacing adjustment area 30. The values of LINENUM and LINEWIDTH are updated according to the user-specified position at (S42). The enlarged display control unit 86 updates the number of line guides 32 and the line spacing (in other words, the line width) according to the user-specified position (S44). Then, a later-described line enlargement display process is executed (S46).

  When no operation is detected for the line spacing adjustment area 30 (N in S36) and a tap operation for the previous line button 36 is detected (Y in S38), the enlarged display control unit 86 decrements CURRENTLINE (S42). At the same time, the display position of the enlarged line indicator 34 is changed to the position of the previous line (S44). Then, a later-described line enlargement display process is executed (S46). When the tap operation on the previous line button 36 is not detected (N in S38) and the tap operation on the next line button 38 is detected (Y in S40), the enlarged display control unit 86 increments CURRENTLINE (S42). At the same time, the display position of the enlarged line indicator 34 is changed to the position of the next line (S44). Then, a later-described line enlargement display process is executed (S46). If the tap operation on the next line button 38 has not been detected (N in S40), S46 and S44 are skipped and S46 is executed.

  FIG. 13 is a flowchart showing in detail the line enlargement display process in S46 of FIG. The line area specifying unit 78 assumes that the book image 20 includes the number of lines of LINENUM, in other words, assumes that the book image 20 is composed of lines having a width of LINEWIDTH. The coordinates of the area occupied by the line are specified (S50). The line extraction unit 80 extracts image data of an area occupied by one line of text in the book image 20 from the book image 20 as a line image (S52). The enlarged display control unit 86 displays the extracted line image by folding it over a plurality of lines in the enlarged display area 22 (S54). Specifically, in S52, image data of each area obtained by dividing the area occupied by one line of text in the book image 20 is extracted, and in S54, each area image extracted in S52 is extracted in each line of the enlarged display area 22. Display data.

  According to the portable information terminal 100 of the present embodiment, even when the raster image of the book is larger than the size of the display 10, the user enlarges the text of the book in units of lines and is easy to read in units of lines. Can be read in character size. Further, by folding and displaying an image of one line of text in a raster image of a book, the entire text of one line can be stored in the enlarged display area 22 and displayed.

  Further, according to the portable information terminal 100, the result of adjusting the head position guide 24, the tail position guide 26, the line spacing adjustment area 30 and the like is immediately fed back to the display contents of the enlarged display area 22. Thus, the user can adjust the range of the enlargement target area 28 and the user-specified position of the line spacing adjustment area 30 while checking the display contents of the enlargement display area 22. Further, since the line guide 32 is displayed on the book image, the user can easily determine whether or not the setting of the number of lines is appropriate.

  In addition, since the object on the book enlargement display screen is hidden by a tap operation on the rear touch panel 18, the book image displayed on the back side until then is displayed on the front. That is, a tap operation on the rear touch panel 18 that is pushed from the back to the front makes the book image come out from the back to the front, and an intuitive operation means can be provided to the user. For example, if a book image contains a picture (such as an illustration or chart) other than text and the user wants to check the picture, the user can check the picture without tampering with the enlarged display area 22 by tapping the rear touch panel 18. it can.

  The present invention has been described based on the embodiments. This embodiment is an exemplification, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are also within the scope of the present invention. is there. A modification is shown below.

  A first modification will be described. Although the book image in the above-described embodiment is described with vertical writing text, the book image in the modification may be written with horizontal writing text. In this case, the enlarged display control unit 86 may display a book enlarged display screen for horizontally written book images. FIG. 14 shows a state in which a horizontally written book image is displayed on the touch display 14. FIG. 15 shows a user interface for enlarging and displaying the book image of FIG. 14 (that is, a book enlargement display screen).

  In FIG. 15, the first line of the horizontally written book image is enlarged and displayed in the enlarged display area 22. As shown in the figure, in the book enlargement display screen for horizontally written book images, the head position guide 24 is aligned with the upper left position of the rectangular area in which the text is described, and the end position guide 26 is set in the rectangular area in which the text is described. Align with the lower right position of. In addition, the number of lines increases as the tap position of the user or the end position of the trace operation is closer to the lower end of the line adjustment area 30 in the line adjustment area 30.

  When the enlarged display control unit 86 receives an instruction to enlarge the book image from the user, the enlarged display control unit 86 may cause the touch display 14 to display a selection screen (not shown) for allowing the user to specify whether the book image is vertically written and horizontally written. Good. When the user designates vertical writing, the vertical writing book enlarged display screen (FIG. 3) described in the embodiment is displayed, and when the user selects horizontal writing, the horizontal writing book described in the present modification example. An enlarged display screen (FIG. 15) may be displayed.

  A second modification will be described. Although not mentioned in the above embodiment, a plurality of book images may be associated with each other and stored in the book image holding unit 62. For example, a book image A indicating the contents of a certain page, a book image B indicating the contents of the previous page of the book image A, and a book image B indicating the contents of the next page of the book image A are viewed in B order. It may be held in the book image holding unit 62 together with information indicating that A → C.

  In this case, when the value of CURRENTLINE is equal to LINENUM as a result of incrementing CURRENTLINE with the tap of the next line button 38 on the book enlargement display screen for book image A, in other words, in the last line of the enlargement target area 28. When the next line button 38 is tapped, the normal display control unit 84 causes the touch display 14 to display the book image C whose browsing order is determined to be next to the book image A instead of the book image A. The enlarged display control unit 86 takes over other setting values in the book enlarged display screen for the book image A as they are in the enlarged display area 22 except for returning CURRENTLINE to 0 indicating the first line on the book enlarged display screen for the book image C. Display. For example, the LINENUM and LINEWIDTH of the book enlargement display screen for the book image A are used as they are as the LINENUM and LINEWIDTH of the book enlargement display screen for the book image C, and the line image is displayed in the enlargement display area 22.

  Since the number of lines is generally the same between pages in the same book, the user can adjust the line spacing by resetting the positions of the head position guide 24 and the tail position guide 26 on the book enlargement display screen for the book image C. Browsing in units of lines can be started without resetting the number of lines in the area 30.

  Further, on the book enlargement display screen for book image A, when CURRENTLINE is decremented as a result of decrementing CURRENTLINE in accordance with the tapping of the previous line button 36, in other words, in the first line of the enlargement target area 28, the previous line When the button 36 is tapped, the normal display control unit 84 causes the touch display 14 to display the book image B whose browsing order is determined to be before the book image A instead of the book image A. The enlargement display control unit 86 takes over other setting values on the book enlargement display screen for the book image A as it is, except that CURRENTLINE is set to (LINUM-1) indicating the last line on the book enlargement display screen for the book image B. The display area 22 is displayed. For example, the LINENUM and LINEWIDTH of the book enlarged display screen for the book image A are used as they are as the LINENUM and LINEWIDTH of the book enlarged display screen for the book image B, and the line image is displayed in the enlarged display area 22.

  Also in this case, if the user resets the positions of the leading position guide 24 and the trailing position guide 26 on the book enlargement display screen for the book image B, the line number is not reset in the line spacing adjustment area 30 and the line number is not reset. You can start browsing units.

  In the second modification, when the book image is changed, the values of STARTX, STARTY, ENDX, and ENDY are also inherited as they are. Therefore, when the position of the area in which the body text is described between the book images A to C (that is, the enlargement target area 28) does not change, the user does not reset the positions of the head position guide 24 and the tail position guide 26, You can continue browsing the units.

  A third modification will be described. In the above embodiment, the head position guide 24 and the tail position guide 26 can be dragged at any time during reading of the book image. However, as a modification, the drag operation is restricted at a predetermined timing, in other words, even if it is prohibited. Good. Hereinafter, for the sake of simplicity, the description will be made with the head position guide 24 as an object, but the same applies to the tail position guide 26.

  In this modification, the initial state of the head position guide 24 is a movable mode, which is displayed in a mode (for example, red) indicating the movable mode, and moves according to a user's drag operation. On the other hand, when a double tap operation (two consecutive tap operations) with respect to the head position guide 24 is detected, the enlarged display control unit 86 switches the head position guide 24 to the position determined mode, and determines the position determined mode. Is switched to a display mode (for example, blue). When the head position guide 24 is in the position determination mode, the enlarged display control unit 86 does not change the display position of the head position guide 24 even if a drag operation is detected. Similarly, the sentence range accepting unit 74 does not change STARX and STARTY even if a drag operation is detected when the head position guide 24 is in the position determination mode. The enlarged display control unit 86 returns the head position guide 24 to the movable mode when the head position guide 24 is in the position-determined mode and a double tap operation on the head position guide 24 is detected, and displays the movable mode. Return to the embodiment.

  According to the third modified example, even when the user accidentally touches the touch display 14 in browsing the moving book image, the leading position guide 24 and the trailing position guide 26 are not intended. It is possible to prevent the position from changing.

  A fourth modification will be described. In the above embodiment, the drag operation on the head position guide 24 and the tail position guide 26 is performed on the touch display 14. As a modification, the drag operation may be performed on the rear touch panel 18. For example, when a predetermined operation for moving the head position guide 24 is received, the head position guide 24 is moved. When the rear touch panel 18 is dragged in the movement mode, the head position guide 24 is moved according to the drag operation. The display position of 24 may be moved, and the values of STARTX and STARTY may be updated. The same applies to the tail position guide 26. According to this aspect, the user can adjust the positions of the leading position guide 24 and the leading position guide 24 without covering the document being browsed by the user's own hand.

  A fifth modification will be described. Although not mentioned in the above embodiment, the operation detection unit 72 may detect a user's trace operation in the enlarged display area 22. Further, the sentence range receiving unit 74 may change the positions of STARTX and STARTY according to the trace operation, and the enlarged display control unit 86 may change the display position of the head position guide 24 according to the trace operation. . Specifically, when a trace operation in the right direction is detected in the enlarged display area 22, the text range receiving unit 74 changes STARTX to a value larger than that, and the enlarged display control unit 86 displays the head position guide 24. Display to the left than before. As a result, in the enlarged display area 22, the character string that has been displayed so far is newly displayed in a manner in which it has moved to the right.

  When a trace operation in the left direction is detected in the enlarged display area 22, the sentence range accepting unit 74 changes STARTX to a smaller value, and the enlarged display control unit 86 moves the head position guide 24 to the right. To display. As a result, in the enlarged display area 22, the character string that has been displayed so far is newly displayed in a manner in which it has moved to the left. When a trace operation in the upward direction is detected in the enlarged display area 22, the text range accepting unit 74 changes STARTY to a smaller value than before, and the enlarged display control unit 86 raises the head position guide 24 above that. To display. As a result, in the enlarged display area 22, the character string that has been displayed so far is newly displayed in a manner in which it is moved downward.

  When an upward tracing operation is detected in the enlarged display area 22, the sentence range accepting unit 74 changes STARTY to a larger value than before, and the enlarged display control unit 86 lowers the head position guide 24 below that. To display. As a result, in the enlarged display area 22, the character string displayed so far is newly displayed in a manner in which it has been moved upward. According to the fifth modification, the display mode of the text is changed by an operation on the enlarged display area 22 in which the text is displayed in an enlarged manner. It becomes easy to adjust to an appropriate position.

  A sixth modification will be described. In the above embodiment, the line image of the book image is displayed in the enlarged size in the enlarged display area 22. As a modification, the line image of the book image may be displayed in a size different from the original size and in a display size on the normal display screen, in other words, a size larger than the display size reduced by the display magnification. Good.

  For example, if the original book image is the copy source (in other words, the source of line image extraction) and the number of enlarged screen lines (ZOOMDISPLINENUM) is less than or equal to a predetermined value, the original book image is copied as in the embodiment. An original book image may be extracted and displayed as a source. On the other hand, when the number of enlarged screen lines (ZOOMDISPLINENUM) exceeds a predetermined value, the original image is displayed at a second display magnification larger than the first display magnification when the original book image is displayed in the size of the touch display 14. A copy source image obtained by reducing the book image may be generated. In this case, a new enlarged screen line number may be set using the second display magnification as DISPRATIO, and a line image may be extracted from the copy source image according to the DISPRATIO and displayed in the enlarged display area 22. According to this modification, even when the original book image is large, the increase in the number of lines in the enlarged display area 22 can be suppressed, and the convenience of browsing can be prevented from being impaired due to the increase in the number of lines in the enlarged display area 22. .

  A seventh modification will be described. In the above embodiment, the number of lines of the book image is specified in the line spacing adjustment area 30. However, in the modified example, the width of one line in the book image (hereinafter also referred to as “line width”), in other words. The size between lines may be specified. In this case, the line setting reception unit 76 may set the line width specified in the line spacing adjustment area 30 to LINEWIDTH, and may calculate the number of lines (LINENUM) of the book image according to the line width. In other words, the “information relating to the number of lines” described in the claims may be the number of lines itself, the size of the line width for calculating the number of lines, or the size between lines. This will be understood by those skilled in the art.

  Any combination of the above-described embodiments and modifications is also useful as an embodiment of the present invention. The new embodiment generated by the combination has the effects of the combined embodiment and the modified examples.

  It should also be understood by those skilled in the art that the functions to be fulfilled by the constituent elements described in the claims are realized by the individual constituent elements shown in the embodiments and the modification examples or by their cooperation. For example, the extraction unit described in the claims may be realized by a combination of the row region specifying unit 78 and the row extraction unit 80.

  10 display, 12 touch panel, 18 back touch panel, 62 book image holding unit, 64 setting information holding unit, 74 sentence range receiving unit, 76 line setting receiving unit, 78 line area specifying unit, 80 line extracting unit, 84 normal display control unit 86 Enlarged display control unit, 100 portable information terminal.

Claims (10)

A first display control unit for displaying image data indicating the entire book page in a size that fits on the display;
A line information receiving unit that receives information related to the number of lines on the page of the book from the user;
Assuming that the image data includes the number of lines specified by the user, an extraction unit that extracts a portion corresponding to one line of the book page from the image data as line data;
A second display control unit for displaying the extracted row data on the display in a size larger than the display size by the first display control unit;
A portable information terminal comprising:   The portable information terminal according to claim 1, wherein the second display control unit wraps and displays an image of a sentence indicated by the line data in the display area of the line data. The second display control unit displays the row data so as to overlap an area where the entire page of the book is displayed,
The line information reception unit receives a change in the number of lines from a user who confirmed the display result of the line data,
The extraction unit extracts new row data from the image data based on the number of changed rows,
The portable information terminal according to claim 1 or 2, wherein the second display control unit displays the new row data instead of the previous row data.   The said 2nd display control part displays the virtual line according to the number of lines designated by the user on the page of the said book displayed on the display, The any one of Claim 1 to 3 characterized by the above-mentioned. The portable information terminal described in 1. When an instruction to view the next line on the book page is received from the user,
The extraction unit extracts, as new line data, a portion corresponding to the next line from the image data based on a distance from the first line of the book page to the next line.
The portable information terminal according to any one of claims 1 to 4, wherein the second display control unit displays the new row data instead of the previous row data. If the user receives an instruction to view the next line while zooming in on the last line of a page,
6. The extraction unit according to claim 5, wherein the extraction unit takes over the number of lines in the previous page as the number of lines in the next page, and extracts new line data from image data indicating the whole of the next page. Mobile information terminals. A range accepting unit that accepts a designation of a range in which text is described in the book page from a user;
7. The extraction unit according to claim 1, wherein the extraction unit extracts the row data from the image data on the assumption that the image data includes the number of rows in a range designated by a user. The portable information terminal described in 1. A back touch panel
The second display control unit displays the row data so as to overlap an area where the entire page of the book is displayed,
The display on the display is switched so that the row data is hidden and the entire page of the book is displayed when a user tap operation on the touch panel is detected. The portable information terminal according to any one of the above. A method performed by a mobile information terminal,
A first display step of displaying image data representing the entire book page in a size that fits on the display;
A line information receiving step for receiving information related to the number of lines on the book page from the user;
Assuming that the image data includes the number of lines specified by the user, an extraction step of extracting a portion corresponding to one line of the book page from the image data as line data;
A second display step of displaying the extracted row data on the display in a size larger than the display size in the first display step;
A book image display method comprising: On your mobile device,
A first display control function for displaying image data indicating an entire book page in a size that fits on the display;
A line information reception function for receiving information related to the number of lines on the book page from the user;
Assuming that the image data includes the number of lines specified by the user, an extraction function for extracting, as line data, a portion corresponding to one line of the book page from the image data;
A second display control function for displaying the extracted row data on the display in a size larger than the display size by the first display control function;
Computer program for realizing.

Images