JP4542637B2 - Portable information device and information storage medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a portable information device, an electronic book, and an information storage medium used for them.
[0002]
[Background Art and Problems to be Solved by the Invention]
In recent years, electronic books and portable information devices, which are publishing forms in which information such as characters, images, and voices are recorded on electronic media such as CD-ROMs and FDs and used like books, have been put into practical use.
[0003]
Such electronic books and portable information devices can overcome the physical limitations of paper books. Non-linear reading styles are also possible, and readers can enjoy reading from various perspectives.
[0004]
Furthermore, since it takes less money and hassle to publish, it is possible to realize the ideal image of publishing where everyone can publish easily or publish specialized things with limited subscribers. It becomes possible.
[0005]
By the way, storing map information in such an electronic book or portable information device is convenient because it can be carried with you when you go out or travel, and you can refer to the map image. Especially in e-books and portable information devices, unlike normal maps, it is possible to realize a wide range of functions such as free enlargement, reduction, and scrolling of necessary parts. Become. This is because electronic books and portable information devices can realize functions that are much more enriched than ordinary paper books in searching and using information.
[0006]
However, no matter how many functions can be realized, if the operation is complicated or difficult, such as troublesome operation, the treasure is lost. In particular, since an electronic book and a portable information device are small and conveniently formed for carrying, an input method and an operation method suitable for this are desired.
[0007]
The present invention has been made in view of the problems as described above. The object of the present invention is to rotate, enlarge, reduce, scroll, etc. a map image in a portable information device or an electronic book capable of displaying the map image. It is to provide an electronic book, a portable information device and an information storage medium used therefor that can realize the above functions with a user-friendly human interface.
[0008]
[Means for Solving the Problems]
The present invention is a portable information device including a display unit capable of displaying a map image, the finger motion detection means for detecting a movement history of a finger brought into contact with the display unit on which the map image is displayed, and the movement of the finger Based on the history, operation content determination means for determining that at least one operation of rotation, enlargement, reduction and scrolling of the map image has been input, and rotation, enlargement, reduction of the map image displayed on the display unit based on the determination. And map image generation means for generating a map image subjected to at least one scroll operation.
[0009]
According to the present invention, the user can input at least one operation of rotation, enlargement, reduction, and scrolling of the map image displayed on the display unit based on a finger movement history.
[0010]
The movement history of the finger in contact with the display unit is a concept including a temporal element, and is distinguished from an operation that does not include a temporal element as in the case of simply touching an input mark or the like with a finger.
[0011]
According to the present invention, various operations can be input based on the movement history of the finger, so that it is not necessary to provide hardware such as buttons and a keyboard on the housing, and a more compact portable information device can be provided. In addition, since an operation input mark display or the like is not required on the screen, effective use of a small screen suitable for carrying is promoted, and a screen display that is easier to view is possible.
[0012]
In addition, since it is difficult to input an execution instruction and execution contents at the same time with a single operation using a button or the like, a plurality of operations such as an operation for specifying execution contents and an operation for executing execution instructions are required, which is complicated. . However, since the present invention is input by the movement of the finger, it is possible to simultaneously specify the operation amount and the operation range by detecting the finger instruction range, the movement range, etc., and provide an easy-to-use human interface. Can do.
[0013]
According to the present invention, the operation content determination means determines at least one operation amount of a rotation amount, an enlargement amount, a reduction amount, and a scroll amount of the map image based on the movement history of the finger, and the map image generation means A map image obtained by performing at least one of rotation, enlargement, reduction, and scrolling on the map image displayed on the display unit based on the determined operation amount is generated.
[0014]
According to the present invention, the user can simultaneously input an operation amount as well as an instruction to execute at least one of rotation, enlargement, reduction, and scrolling of the map image displayed on the display unit according to a finger movement history. it can.
[0015]
The operation execution instruction means an instruction to execute any operation such as rotation, enlargement, reduction, scrolling, and the like. The operation amount is, for example, the rotation amount for a rotation operation, the enlargement amount for an enlargement operation, the reduction amount for a reduction operation, the scroll amount for a scroll operation, and the enlargement / reduction or rotation. This means specifying the range to be displayed by scrolling.
[0016]
According to the present invention, the operation amount of various operations can be input based on the movement history of the finger. Therefore, the user can input a desired operation amount by adjusting the finger operation according to his / her needs. .
[0017]
In addition, since it is difficult for a button or tag to give an execution instruction by specifying an arbitrary operation amount in one operation, a plurality of operations such as an operation amount specification and an execution instruction are required, which is complicated. However, since the present invention is input by the movement of the finger, it is possible to simultaneously specify the operation amount and the operation range by detecting the finger instruction range, the movement range, etc., and provide a simple and easy-to-use human interface can do.
[0018]
Further, in the present invention, when the finger motion detection unit detects an operation of moving two fingers that are in contact with the display unit on which the map image is displayed, the operation content determination unit performs the map image enlargement operation. And the map image generating means generates an enlarged map image.
[0019]
The operation of moving the two fingers in contact with the display unit on which the map image is displayed is an operation that gives an image of the enlargement of the map image, and the user can accept the operation as an enlargement operation without a sense of incongruity. In addition, it is possible to give an execution instruction that designates enlargement contents such as an enlargement range and an enlargement amount, etc., by a single action, depending on the action position and the action amount of the finger.
[0020]
Therefore, according to the present invention, it is possible to provide a portable information device capable of a user-friendly enlargement operation.
[0021]
Note that the map image may be enlarged at a constant rate by one operation, or may be enlarged at a rate corresponding to the movement distance of the finger. When enlarging at a rate corresponding to the movement distance of the finger, the user can perform the operation with a single execution instruction specifying the enlargement amount, and an easy-to-use interface can be provided.
[0022]
Moreover, it is preferable that the range of the map image displayed on the display unit as a result of the enlargement is a range including the map image at the position where the finger is in contact before the enlargement. In this way, the user can execute an execution instruction designating the expansion range in one operation, and can provide an easy-to-use interface.
[0023]
The mode of enlarging the map image is not limited to simply reducing the scale. For example, before the enlargement, the map portion is mainly a map image mainly of information such as topography and city position. This includes the case where the map is expanded to become a detailed map of a city based mainly on information such as buildings and roads.
[0024]
Further, in the present invention, when the finger motion detection unit detects an operation of bringing two fingers brought into contact with the display unit on which the map image is displayed, the operation content determination unit performs the map image reduction operation. And the map image generating means generates a reduced map image.
[0025]
The operation of bringing two fingers brought into contact with the display unit on which the map image is displayed is an operation that makes a reduction in the map image appear, and the user can accept the operation as a reduction operation without a sense of incongruity. In addition, it is possible to give an execution instruction specifying a reduction content such as a reduction range or a reduction amount by a single operation according to the movement position and movement amount of the finger.
[0026]
Therefore, according to the present invention, it is possible to provide a portable information device capable of a user-friendly reduction operation.
[0027]
The map image may be reduced at a constant rate by one operation, or may be reduced at a rate corresponding to the movement distance of the finger. When reduction is performed at a rate corresponding to the movement distance of the finger, the user can perform a single operation with an execution instruction specifying the reduction amount, and an easy-to-use interface can be provided.
[0028]
Moreover, it is preferable that the range of the map image displayed on the display unit as a result of the reduction is a range including the map image at the position where the finger is in contact before the enlargement. In this way, the user can execute an execution instruction designating a reduction range in one operation, and an easy-to-use interface can be provided.
[0029]
Also, the mode of reducing the map image is not only when the scale is simply increased, but, for example, before the enlargement, it is reduced from a town map-like map image mainly composed of information such as buildings and roads. This includes cases where the map image is mainly based on information such as topography and city position.
[0030]
According to the present invention, the finger motion detection means detects an operation of rotating another finger that is in contact with the display unit with one finger that is in contact with the display unit on which the map image is displayed as an axis. In this case, the operation content determination unit determines that a map image rotation operation has been input, and the map image generation unit generates a rotated map image.
[0031]
The operation of rotating the other finger that is in contact with the display unit around the one finger that is in contact with the display unit on which the map image is displayed is similar to the operation when the compass is used. For this reason, it is possible to imagine the rotation of the map image, and the user can accept the operation as a rotation operation without a sense of incongruity. In addition, it is possible to give an execution instruction specifying the rotation contents such as the rotation range and the rotation amount in one operation by the operation position and operation amount of the finger.
[0032]
Therefore, according to the present invention, it is possible to provide a portable information device capable of a user-friendly rotation operation.
[0033]
Further, when it is desired to match the orientation that the user is currently facing with the orientation on the screen, the map itself is rotated in the case of an actual map. However, in the case of the portable information device of the present invention, the same effect can be obtained by rotating the displayed map image. For this reason, the user can see the map image rotated in a desired direction with a simple operation, and can provide the provided portable information device that is easier to use than the actual map.
[0034]
Note that the map image may be rotated at a constant rate by one operation, or may be rotated at a rate corresponding to the movement distance of the finger. When the user rotates at a rate corresponding to the movement distance of the finger, the user can execute an execution instruction specifying the rotation amount in one operation, and an easy-to-use interface can be provided.
[0035]
Moreover, it is preferable that the range of the map image displayed on the display unit as a result of the rotation is a range including the map image at the position where the finger is in contact before the rotation. In this way, the user can perform an execution instruction specifying the rotation range in one operation, and can provide an easy-to-use interface.
[0036]
The present invention is the portable information device described above, which is used as an electronic book.
[0037]
That is, an electronic book including a display unit capable of displaying a map image, based on finger movement detection means for detecting a movement history of a finger brought into contact with the display unit on which the map image is displayed, and the movement history of the finger , An operation content determination unit that determines that at least one operation of rotation, enlargement, reduction, and scrolling of the map image has been input, and the operation content determination unit rotates and enlarges the map image displayed on the display unit based on the determination. And map image generation means for generating a map image subjected to at least one of reduction and scroll operations.
[0038]
In the electronic book, the operation content determination unit determines at least one operation amount of a rotation amount, an enlargement amount, a reduction amount, and a scroll amount of the map image based on the movement history of the finger, and the map image generation unit Is characterized by generating a map image obtained by performing at least one of rotation, enlargement, reduction, and scrolling on the map image displayed on the display unit based on the determined operation amount.
[0039]
In the electronic book, when the finger motion detection unit detects a motion of moving two fingers away from the display unit on which the map image is displayed, the operation content determination unit is configured to enlarge the map image. It is determined that an operation has been input, and the map image generation unit generates an enlarged map image.
[0040]
In the electronic book, when the finger movement detection unit detects an operation of bringing two fingers in contact with the display unit on which the map image is displayed, the operation content determination unit reduces the map image. It is determined that an operation has been input, and the map image generation means generates a reduced map image.
[0041]
Further, in the electronic book, the finger motion detection unit detects an operation of rotating another finger that is in contact with the display unit with one finger that is in contact with the display unit on which the map image is displayed as an axis. In this case, the operation content determination means determines that a map image rotation operation has been input, and the map image generation means generates a rotated map image.
[0042]
Further, the present invention is an information storage medium used for at least one of a portable information device and an electronic book capable of displaying a map image, for detecting a movement history of a finger touching a display unit on which the map image is displayed. , Information for determining that at least one operation of rotation, enlargement, reduction and scrolling of the map image has been input based on the movement history of the finger, and a map displayed on the display unit based on the determination Information for generating a map image in which at least one of rotation, enlargement, reduction, and scrolling is performed on the image is included.
[0043]
Further, in the information storage medium, at least one operation amount of a rotation amount, an enlargement amount, a reduction amount, and a scroll amount of the map image is determined based on the movement history of the finger, and displayed on the display unit based on the determined operation amount. It is preferable to include information for generating a map image that has been subjected to at least one of rotation, enlargement, reduction, and scrolling.
[0044]
Further, in the information storage medium, when an operation of moving two fingers away from the display unit on which the map image is displayed is detected, it is determined that a map image enlargement operation has been input, and the enlarged map image is displayed. It is preferable to comprise so that the information for producing | generating may be included.
[0045]
Further, in the information storage medium, when an operation of bringing two fingers brought into contact with the display unit on which the map image is displayed is detected, it is determined that a map image reduction operation has been input, and the reduced map image is displayed. It is preferable to comprise so that the information for producing | generating may be included.
[0046]
In addition, in the information storage medium, when an operation of rotating one finger that is in contact with the display unit around the one finger that is in contact with the display unit on which the map image is displayed is detected, It is preferable that the image rotation operation is determined to be input, and the information for generating the rotated map image is included.
[0047]
DETAILED DESCRIPTION OF THE INVENTION
1. Features of the present invention
A feature of the present invention is that in a form information device or an electronic book capable of displaying a map image, a map image can be rotated, enlarged, reduced, scrolled, etc. by performing a finger operation on the displayed map image. .
[0048]
FIG. 1 is a functional block diagram of a morphological information device and an electronic book having the characteristic functions of the present invention.
[0049]
The finger movement detection unit 10 is for detecting a movement history of a finger performed on a display unit on which a map image is displayed in order for a user to input operations such as enlargement, reduction, rotation, and scrolling of the map image. It is. The finger motion detection unit 10 is configured by overlaying a transparent touch panel or the like on the display unit 60. Detection data obtained by the finger motion detection unit 10 is input to the processing unit 20.
[0050]
The processing unit 20 performs processing for generating a map image based on the detection data, a given program, and the like. The function of the processing unit 20 can be realized by hardware such as a CPU (CISC type, RISC type), a DSP, a custom (gate array, etc.) IC, and a memory.
[0051]
The information storage medium 70 is for storing programs and data. The function of the information storage medium 70 can be realized by hardware such as a CD-ROM, cassette, IC card, MO, FD, DVD, hard disk, and memory. The processing unit 20 performs various processes based on the program and data from the information storage medium 70.
[0052]
The processing unit 20 includes an operation content determination unit 30, a map operation processing unit 40, and an image generation unit 50.
[0053]
The operation content determination unit 30 determines the operation content input by the user based on the finger movement history detected by the finger motion detection unit 10. Specifically, when the finger motion history detected by the finger motion detection unit 10 is a motion to move two fingers away, it is determined that a map image enlargement operation has been input. Further, for example, when the finger motion history detected by the finger motion detection unit 10 is an operation in which two fingers are brought closer together, it is determined that a map image reduction operation has been input. Further, for example, when the finger motion history detected by the finger motion detection unit 10 is an operation of rotating another finger around one finger, it is determined that a map image rotation operation has been input. To do. Further, for example, if the finger motion history detected by the finger motion detection unit 10 is a motion of moving one finger, it is determined that a map scroll operation has been input.
[0054]
The map operation processing unit 40 performs processing for generating a map image subjected to the operation determined by the operation content determination unit 30, and includes an enlargement processing unit 42, a reduction processing unit 44, a rotation processing unit 46, a scroll. A processing unit 48 is included.
[0055]
The enlargement processing unit 42 performs a process necessary for generating a map image enlarged according to the distance at which two fingers move away. The reduction processing unit 44 performs processing necessary to generate a map image reduced according to the distance at which two fingers approach. The rotation processing unit 46 performs processing necessary for generating a map image rotated according to one rotation angle.
[0056]
The scroll processing unit 48 performs a process necessary for generating a map image that is scrolled in accordance with the movement of one finger.
[0057]
The image generation unit 50 generates a map image to be output to the display unit based on the processing performed by the map operation processing unit 40. The map image may be generated by holding the image data with the maximum resolution and generating the image data by thinning out the image data according to the scale. Alternatively, the map image may be generated as vector data and calculated as needed. The method of generating
[0058]
2. Preferred embodiments of the present invention
Hereinafter, a preferred embodiment of the present invention will be described in detail using an electronic book as an example.
[0059]
(1) Appearance of e-book
2A, 2B, and 2C are external views of the electronic book of this embodiment.
2A is a front view of the appearance of the electronic book according to this embodiment in a closed state, and 120 is a side view. 130 is a diagram showing a state in which the electronic book of the present embodiment is opened. The electronic book of this embodiment is configured to be about the size of a paperback book when the electronic book is closed as indicated by 110 for convenience of carrying.
[0060]
FIG. 2B is a diagram showing a disk 140 in which software used for an electronic book is stored. As shown in FIG. 2C, the electronic book of this embodiment can provide information corresponding to the contents of various software by setting a disc 140 containing various software in the electronic book main body 150. .
[0061]
(2) Map image manipulation processing by finger movement
Next, a specific example of the map image operation by the finger movement in the electronic book of this embodiment will be described.
[0062]
FIG. 3 is a diagram showing an example of a screen displayed when travel information software is set. The center of the screen is mainly used as an information display area, and the end area of the screen is mainly used as a search tag area or a toolbar display area. In the information display area, the contents described in one page of the book are displayed as image information. Search tags 210 to 230 are displayed in the search tag area. In addition, images 240 and 242 simulating “book thickness” are displayed on the left and right edges of the display area.
[0063]
▲ 1 ▼ Map enlargement operation
When the user touches the “map” 220 field of the search tag with the finger 250, the entire map 260 of “India” is displayed on the screen (see FIG. 4). To obtain information about “Bombay”, place the thumb and index finger around “Bombay” on the screen with the thumb and index finger close as shown in FIG. 6B, and move the thumb and index finger away. An action of moving in the direction (map enlargement gesture) is performed (see FIG. 5).
In this way, a map image enlarged according to the movement history of the thumb and index finger is displayed. That is, the greater the degree of separation between the thumb and index finger, the smaller the scale and the more detailed the map is displayed.
[0064]
At this time, the map on the screen may be enlarged corresponding to the operation of moving the thumb and index finger away in real time. Further, after the final enlargement amount is determined when the finger stops moving, a map image enlarged according to the enlargement amount may be displayed.
[0065]
Further, as shown in FIG. 7, a case where the thumb is fixed and only the index finger is moved away from the thumb may be included in the map enlargement gesture.
[0066]
As a result of referring to the enlarged map, when it is desired to obtain a more detailed map image, a more detailed map image can be obtained by repeating the map enlargement gesture. In the present embodiment, when the city map is enlarged to some extent, a detailed map of the city such as a town map is displayed.
[0067]
▲ 2 ▼ Map scroll operation
Also, as shown in Fig. 8, if you put your finger on the screen and move it in the desired direction while pressing your finger on the screen (map scroll gesture), the map will move by the distance moved in the direction you moved. Displayed.
[0068]
▲ 3 ▼ Map reduction operation
For example, when the user wants to reduce the map, for example, when viewing a larger scale map image or displaying a wide range of information on the screen, the user first places the thumb and index finger as shown in FIG. On the map displayed on the screen in a separated state, an operation of moving the thumb and index finger closer to each other as shown in FIG. 9 (map reduction gesture) is performed. In this way, a map image reduced according to the movement history of the thumb and index finger is displayed. That is, the greater the degree of separation between the thumb and index finger, the smaller the scale and the more detailed the map is displayed.
[0069]
At this time, the map on the screen may be reduced in real time with the operation of bringing the thumb and index finger close together. Moreover, after the final reduction amount is determined when the finger stops moving, a map image reduced according to the reduction amount may be displayed.
[0070]
In contrast to FIG. 7, the map reduction gesture may also include a case where the thumb is fixed and only the index finger is moved closer to the thumb.
[0071]
As a result of referring to the reduced map, if it is desired to obtain a map image of a wider range, a map image of a wider range can be obtained by repeating the map reduction gesture. In the present embodiment, when the city map is reduced to some extent, the detailed map of the city such as a town map is changed to a normal map display and displayed.
[0072]
▲ 4 ▼ Map rotation operation
In addition, when it is desired to change the orientation of the displayed map image without changing the scale, as shown in FIG. 6 (A), the top of the map displayed on the screen is first displayed with the thumb and index finger separated. Then, one of the thumb and forefinger is fixed, and the other finger is rotated like a compass (map rotation gesture) with the fixed finger as the central axis (see FIG. 10). . In this way, a map image rotated according to the movement history of the thumb and index finger is displayed.
[0073]
As shown in FIG. 11, when one of the fingers is fixed to the point O and the other finger is rotated from the point A to the point B, it is rotated from A to B by the rotation angle Θ. A map image rotated in the direction 370 is displayed.
[0074]
At this time, the map on the screen may be rotated in real time with the rotation of either one of the fingers. Further, after the final rotation amount is determined when the finger stops moving, a map image reduced according to the rotation amount may be displayed.
[0075]
The finger movement is not limited to the case of performing with the thumb and forefinger, but may be performed with, for example, the thumb and middle finger or a combination of other fingers.
[0076]
(3) Search processing
Next, a specific example of search processing by finger movement in the electronic book of this embodiment will be described.
[0077]
▲ 1 ▼ Normal search operation
For example, when the user wants to obtain information on a hotel in “South India”, there is a method as shown in FIG. That is, first select the tag "South India", display the first page with information on "South India", then select the tag for accommodation, and the head with information on "South India accommodation" This is a method of displaying a page. When the user wants to obtain various information about “South India”, the user wants to display the first page on which information on “South India” is posted, and then searches for various information on “South India”. It is effective for etc.
[0078]
(2) Search operation with AND conditions
However, when the user needs only the “South India Accommodation” information, it is preferable that the first page on which the “South India Accommodation” information is directly displayed in one operation is preferably displayed. Therefore, in this embodiment, as shown in FIG. 13A, when the user touches the tag “South India” with the finger of the left hand and the tag “stay” with the finger of the right hand, for example, It is configured to display the first page with information on “South India” directly.
[0079]
When the information on “South India” is spread over a plurality of pages, the information described in the following pages can be read by performing page turning input as shown in FIG.
[0080]
(4) Page turning, bookmark processing, etc.
Next, a specific example of turning pages with the electronic book of this embodiment is described.
[0081]
▲ 1 ▼ Page turning input operation
In the electronic book of this embodiment, since various operations are input as finger operations on the screen, there are almost no buttons for operation input on the housing. Further, the screen on which the contents of the book are displayed is characterized in that there are almost no operation input marks on the screen (see FIG. 3).
[0082]
In the present embodiment, by setting the travel information software in the electronic book, the user can use the same as in the case of referring to the travel guidebook, and is similar to the actual book page on the screen as shown in FIG. You can refer to the contents of
[0083]
When the user wants to refer to the next page, if the user traces the information display area on the screen from the left to the right with his index finger as when turning a page of a paper book, the page appears as shown in FIG. The display screen is updated to the contents of the next page with an image that turns over.
[0084]
At this time, it is necessary for the user to move his / her finger in the horizontal direction so as to rub with a certain degree of strength by sliding the index finger or the like on the screen. In this embodiment, in order to distinguish the page turning input from other inputs, when the finger is touching the screen at a predetermined area or more and a predetermined pressure value or more and moving in the horizontal direction, This is because it is determined that turning has been input.
[0085]
Note that the page turning direction and page up / down differ depending on the vertical writing or horizontal writing as in the actual book. Therefore, in the case of a vertically written book, the page advances from the right to the left. Therefore, when the finger is moved as shown in FIG. 14, the next page is turned, but in the case of the horizontal writing, the previous page is turned. On the other hand, in the case of a vertically written book, the previous page is turned when tracing with the index finger from the right to the left, as opposed to FIG. 14, but in the case of horizontal writing, the next page is turned.
[0086]
In this way, the user can input the page turning in the same way as when handling a normal book, so that it is possible to provide a human interface that is easy to learn and easy to use.
[0087]
In addition, when inputting a page turning, an image in the middle of turning the page according to the movement of the finger may be displayed as shown in FIG. 14, but it may be configured to switch directly to the previous page screen or the next page screen.
[0088]
In addition, an image sound that can be associated with the sound of turning the page such as “para” corresponding to the page turning may be output.
[0089]
▲ 2 ▼ Continuous page turning input operation
As shown in FIG. 15, when the user continues to touch images 240 imitating “book thickness” (hereinafter referred to as “book thickness”) 240 and 242 for a predetermined time or more, the pages are flipped continuously. At this time, the page turning speed can be changed by changing the strength with which the user touches. That is, the user can increase the speed at which the page is turned by touching more strongly. Also, by reducing the strength of touching, you can slow down the page turning speed. When the user finds the page he / she wants to read, the user can release the “book thickness” to stop the continuous page turning and position the display screen on the page.
[0090]
As in the case of the page turning described above, the raising / lowering of the page differs depending on the vertical writing or the horizontal writing. Therefore, in the case of a vertically written book, if the thickness of the leftmost book is continuously touched as shown in FIG. 15, the page is continuously turned in the next page direction, but in the case of horizontal writing, the page is continuously turned in the previous page direction. Turn over. On the other hand, in the case of vertical writing, conversely to FIG. 15, if you keep touching the thickness of the rightmost book, the page will turn continuously in the previous page direction, but in horizontal writing, the page will continue in the next page direction. Turn over.
[0091]
In this way, the user can input the page turning in the same way as when handling a normal book, so that it is possible to provide a human interface that is easy to learn and easy to use.
[0092]
When continuous page turning is input, an image in the middle of turning the page may be displayed according to the movement of the finger as shown in FIG. 15, but it may be configured to switch directly to the previous page screen or the next page screen every predetermined time. Good.
[0093]
In addition, an image sound that can be associated with a sound that the page turns, such as “para-para-pala”, may be output corresponding to the page turning.
[0094]
▲ 3 ▼ Bookmark insertion, reference operation
Next, the bookmark function of this embodiment will be described. In this embodiment, it is possible to attach a bookmark to a page to be referred to again so that a bookmark is inserted at a position to be referred to again during normal reading.
[0095]
As shown in FIG. 16, a bookmark can be inserted into the page by dragging the arrow portion 260 and tracing it with the finger to the bottom of the screen. That is, after the above operation, the bookmark mark 270 is displayed on the screen as shown in FIG.
[0096]
When the user is referring to another page, a bookmark 270 is displayed at the lower end of the screen as shown in FIG.
[0097]
When the user wants to refer to the page with the bookmark, the user touches the bookmark 270 displayed at the bottom of the screen with a finger as shown in FIG. 18B, as shown in FIG. 18C. Then, the screen switches to a page with a bookmark.
[0098]
In addition, although it demonstrated taking the case where only one bookmark was pinched | interposed, it is not restricted to this. For example, when bookmarks are to be attached to a plurality of pages, bookmark marks of a plurality of colors may be displayed.
[0099]
(5) Today's folder usage example
Next, a specific example of using today's folder according to the present embodiment will be described.
[0100]
In FIG. 3, when the input icon 280 is touched with a finger, a toolbar composed of various operation icons (282, 284, 286, 288) is displayed at the bottom of the screen as shown in FIG.
[0101]
Reference numeral 282 denotes an icon to be touched when shifting to a mode for inputting various settings of the electronic book. Reference numeral 284 denotes an icon to be touched when shifting to a mode for shooting a moving image or a still image with a camera which is an accessory of the electronic book. Reference numeral 286 denotes an icon to be touched when shifting to a mode in which characters, figures, and the like are input by using a pen as an accessory part of the electronic book. Reference numeral 288 denotes an icon that is touched when the input data or information specified on the screen is stored in the today's folder, or when it is desired to refer to the contents of the today's folder. This today's folder is automatically created every day, and its usage is like a warehouse where data created in daily use scenes is always kept. Hereinafter, various usage examples of today's folder will be described.
[0102]
(1) An example of floating information stored in an electronic book
An example of floating and storing information stored in an electronic book will be described with reference to FIGS. For example, if you want to get information on “North India”, touch the index of “North India” to open the page and read it. Among them, the word “Tajma Heil” is displayed in red, so touch it (see FIG. 20A). Then, it is configured to automatically jump to the “Tajma Hail” page.
[0103]
For example, if you read about “Tajma Heil” in a regular paper book and want to copy this part and carry it with you, you can perform the following operations on this electronic book.
[0104]
That is, the user encircles the area in which the information that the user wants to cut is written with the index finger, and moves the finger away from the screen (see arrow 410 in FIG. 20B). Then, the enclosed portion is displayed as if it was raised on the screen (see 420 in FIG. 21). This is called floating.
[0105]
Then, press the floating part with your finger, move to the icon 288 of today's folder by dragging and dropping, and release your finger there (hereinafter referred to as "Drag and drop to today's folder") ) And (see FIG. 22), the floating part is stored in the folder of today. In this way, in this electronic book, if the content to be cut is designated with a finger and dragged and dropped into the today's folder, the content designated on the screen can be stored in the today's folder.
[0106]
Note that the area to be floated is not limited to an area formed by a closed curve or a polygon, but may be an area specified by a portion surrounded by the edge of the screen and a finger. For example, as shown in FIG. 42 (A), when a trace is drawn with a finger like 840 and the screen is traced, a portion 852 (shaded area) surrounded by the trace 840 and the edge line 850 at the end of the screen is floated. You may do it.
[0107]
Further, as shown in FIG. 42B, two points P1 and P2 on the screen are designated with a finger, and a rectangular region 854 (hatched region) having a line segment connecting the two points as a diagonal is floated. It may be.
[0108]
Further, as shown in FIG. 42 (C), three points P3, P4, and P5 on the screen are designated with a finger, and a circular region 856 (hatched region) having the three points on the circumference is floated. You may do it.
[0109]
(2) Example of storing still images and moving images
Next, an example of storing video captured by the camera in today's folder will be described with reference to FIGS.
[0110]
For example, when the user wants to share the contents of the timetable during the trip, if the electronic book is used, the camera lens 520 provided in the electronic book body is pulled out as shown in FIG. The timetable 510 can be photographed and the photographing data can be stored in an electronic book.
[0111]
That is, when the user pulls out the toolbar of the electronic book and touches the camera icon 284 with a finger, the camera enters the shooting mode, and a camera shooting operation display screen as shown in FIG. 23 is displayed. The user touches the screen switches 550 and 540 displayed on the finder screen 530 arranged largely on the left side of the screen with a finger to shoot a moving image or a still image. You can choose.
[0112]
For example, when the user touches the still image screen switch 540, the display of the shooting execution switch 560 changes to “shutter”. When the user points the camera lens toward the timetable 510, a timetable image captured by the camera lens 520 is displayed on the viewfinder screen 530. When the user touches the “shutter” button 560 with a finger, the image data that has been taken is automatically stored in the folder file together with the shooting date and time.
[0113]
The folder file is a file for storing information to be put in “today's folder”. The stored information is managed by date and time, and is formed so as to be readable in date units.
[0114]
Further, for example, when the user wants to shoot a moving image, when the moving image switch 550 is touched, the display of the shooting execution switch 560 changes to “waiting for recording”. When the user touches the “recording standby” button, shooting of a moving image starts.
[0115]
Note that as shown in FIG. 25, the camera lens 520 of the electronic book is a wireless type that can be detached from the electronic book main body 522, so that the user can shoot without hesitation in the surrounding people. When the user presses the shooting execution switch 560 displayed as “recording standby”, the display is switched to “shooting”. If the user wants to stop shooting, touching the “shooting” button with his / her finger stops shooting and the display switches to “waiting for shooting”. The captured image is automatically stored in the folder file together with the shooting date and time.
[0116]
(3) Example of storing notes
Next, an example of storing user memos will be described with reference to FIGS.
[0117]
When the user pulls out the toolbar at the bottom of the screen and touches the “memo” icon 286 with a finger, a memo input screen 600 as shown in FIG. 26 is displayed.
When the user inputs characters or the like on this screen with the pen 610 attached to the electronic book, the image data is recorded as it is. After the writing, as shown in FIG. 27, when the memo input screen is dragged and dropped to today's folder, the contents described in the memo input screen 600 can be stored in the folder file together with the storage date and time.
[0118]
▲ 4 ▼ Today's folder reference processing
When the user pulls out the tool bar at the bottom of the screen and touches the “Today's folder” icon 288 with a finger, the today's folder screen 700 of that day as shown in FIG. 28 is displayed. The data stored in today's folder on that day is displayed as icons (710, 720, 730, 740). In this electronic book, the data content stored by the user is converted into an icon as a reduced image as it is, so that the user can easily recall the contents of the data. Furthermore, since the time when the data is stored is displayed below the icon, it can be easily used as a user's action record, and is convenient for organizing the data later.
[0119]
When the user touches iconified data 710, 720, 730, 740 with a finger and drags and drops it to the “view contents” portion 750, the contents are displayed on the screen. Similarly, the contents can be automatically deleted by putting them in the trash box portion 780 marked “Discard”.
[0120]
Touching the portion 760 labeled “Previous Day” displays the “Today's Folder Screen” on the previous day, and touching the portion 770 labeled “Next Day” displays the “Today's Folder Screen” on the next day. Is displayed. The user can go back to the previous folder screen or return to the current folder screen by touching the “previous day” and “next day” portions.
[0121]
Also, as shown in FIG. 29, when the icons of related data are moved with a finger so as to touch, the data in contact are grouped. Therefore, it is convenient for data organization.
[0122]
FIG. 30 is a diagram for explaining an example of utilization of today's folder.
[0123]
For example, assume that a user carries this electronic book on a trip for about one month and stores various data in today's folder during the trip. When the user opens the electronic book, 30 today's folders are stored (see FIG. 30A).
[0124]
The user writes the data of today's folder stored in the electronic book 800 to another computer 810 connected to the Internet, and sends the data to the travel data collection company 820 using the Internet (see FIG. 30B).
[0125]
The travel data collection company 820 edits the collected data and supplies the latest travel data to the travel software publishing company 830. The travel software publishing company 830 releases travel software upgraded based on the latest data.
[0126]
If the electronic publishing industry develops in this way, it will be able to supply digital software that reflects the latest data. In addition, because it does not require money or hassle, publishing an ideal image of publishing that everyone can publish easily or can publish specialized things with limited subscribers. Is also possible.
[0127]
(6) Structure of electronic book
Next, a hardware configuration of the electronic book of this embodiment will be described with reference to FIG.
[0128]
As shown in FIG. 31, the electronic book of this embodiment includes a CPU (central processing unit) 1010, a memory 1020, a display controller 1030, a touch panel controller 1040, a bus 1050, a touch panel 1060, a display 1070, a disk drive controller 1080, and a disk. A drive 1090, an information storage medium 1220, a camera 1130, and a pen 1120 are included.
[0129]
The display 1070 is composed of a liquid crystal or the like, and the output is controlled by the display controller 1030.
[0130]
The touch panel 1060 is constituted by a panel such as an optical type, a resistance type, a capacitance type, and an ultrasonic type, and is controlled by a touch panel controller 1040. The touch panel 1060 is installed by overlapping a transparent touch sensor plate on the display 1070. When the user touches the display screen with a fingertip, a pen 1120, or the like, the touch panel 1060 can detect finger contact position information, contact pressure and contact area, and image data such as characters and figures input with the pen 1120.
[0131]
In this way, by integrating the transparent touch sensor plate on the surface of the display 1070 and integrating them, finger operation input and pen input on the display screen become possible.
[0132]
The CPU 1010 performs control of the entire apparatus, various data processing, and various processing described with reference to FIGS. The memory is composed of a ROM and a RAM, and the RAM is a storage means used as a work area of the CPU 1010 and stores a given content of the information storage medium 1220 and the ROM, a calculation result of the CPU 1010, and the like.
[0133]
A disk drive 1090 writes and reads data to and from an information storage medium 1220 such as a floppy disk, and is controlled by a disk drive controller 1080.
[0134]
The information storage medium 1220 mainly stores data for generating an image, a program, information for performing various processes described with reference to FIGS.
[0135]
The camera 1130 is for shooting moving images and still images.
[0136]
The pen 1120 is used for inputting a memo on the display screen, and may be anything as long as a pen-shaped stick or ink does not stick to the display.
[0137]
When the user performs various operations such as performing a finger operation on the display, inputting a memo, or taking a picture with a camera, the CPU 1010 executes an operation instructed by the user based on the input content.
[0138]
FIG. 32 is an example of a functional block diagram of the electronic book.
[0139]
The finger motion detection unit 1110 is for detecting a finger movement history, a contact pressure, and a contact area performed by the user on the display unit. The finger motion detection unit 1110 is configured by overlaying a transparent touch panel or the like on the display unit 1240. Detection data obtained by the finger motion detection unit 1110 is input to the processing unit 1100.
[0140]
The pen input unit 1120 is used by the user to input content written with a pen on the display unit. The pen input unit 1120 is configured such that when a user writes a character, a figure, or the like on the display unit 1240 with the previous pen 1120, a transparent touch panel or the like superimposed on the display unit detects the content as image data. Detection data obtained by the pen input unit 1120 is input to the processing unit 1100.
[0141]
The photographing unit 1130 is for the user to photograph at least one of a moving image and a still image. The photographing unit 1130 is configured by a camera or a video camera. Shooting data shot by the shooting unit 1130 is input to the processing unit 1100.
[0142]
The processing unit 1100 performs processing for generating an image to be displayed on the display unit, processing for storing the data in a folder file, and the like based on the detection data, photographing data, a given program, and the like by the finger movement and pen input. It is. The function of the processing unit 1100 can be realized by hardware such as a CPU (CISC type, RISC type), a DSP, a custom (gate array, etc.) IC, and a memory.
[0143]
The information storage medium 1220 is for storing programs and data.
The function of the information storage medium 1220 can be realized by hardware such as a CD-ROM, cassette, IC card, MO, FD, DVD, hard disk, memory, and the like. The processing unit 1100 performs various processes based on the program and data from the information storage medium 1220.
[0144]
The processing unit 1100 includes a processing content determination unit 1140, various processing units 1150, an image generation unit 1200, and a storage unit 1230.
[0145]
The processing content determination unit 1140 determines the content to be processed based on data input from the finger motion detection unit 1110, the pen input unit 1120, and the imaging unit 1130.
[0146]
The various processing units 1150 are an enlargement processing unit 1162, a reduction processing unit 1164, a rotation processing unit 1166, a scroll processing unit 1168, a normal search processing unit 1172, a logical product search processing unit 1174, a page turning processing unit 1182, and a continuous page turning processing. Section 1184, bookmark insertion processing section 1186, bookmark insertion position reference processing section 1188, floating processing section 1192, imaging processing section 1194, memo input processing section 1196, and folder reference processing section 1198, according to the processing content determination section 1140. , Map image enlargement processing, reduction processing, rotation processing, scroll processing, normal search processing, logical product search processing, page turning processing, continuous page turning processing, bookmark insertion processing, bookmark insertion location reference processing, floating processing, shooting processing Memo input processing, folder reference processing, and the like.
[0147]
The storage unit 1230 stores various types of information, and includes a folder file 1232 for storing data stored in today's folder.
[0148]
The image generation unit 1200 generates an image to be displayed on the display unit based on processing performed by the various processing units 1150.
[0149]
(7) Example of operation of this embodiment
33 to 41 are flowcharts showing an operation example of the electronic book of this embodiment.
[0150]
In the electronic book of the present embodiment, when there is an input such as finger movement, pen input, photographing, etc., the processing content is determined as follows (step S10 in FIG. 33). If it is the current shooting mode, shooting processing is performed (steps S20 and S30). Note that the normal input mode is selected, and when the camera icon on the tool bar is touched, the shooting mode is entered. When an input is detected in the shooting mode, the shooting process described with reference to FIGS. 23 to 25 is performed.
[0151]
For example, when it is detected that the user has pressed an operation button on the screen, processing corresponding to the button, for example, when a “moving image” or “still image” button is touched, selection processing of moving image and still image When the “Shutter” button is touched, a still image is shot, and the captured image data is stored in a folder file with the shooting date and time. When the “Recording standby” button is touched, , The process of starting the video recording, the process of ending the video recording when the “Recording” button is touched, and storing the captured image data in the folder file with the shooting date and time, etc. .
[0152]
If it is the current memo input mode, a memo input process is performed (steps S40 and S50). Note that the normal input mode is selected, and when the memo icon on the toolbar is touched, the memo input mode is entered. When an input is detected in the memo input mode, the memo input process described with reference to FIGS. 26 to 27 is performed.
[0153]
For example, when it is detected that the user has entered a character or the like with a pen on the screen, the input content is displayed in real time, and the input content is stored in the work area as image data. When the input content is dragged and dropped, a process of storing the image data stored in the work area in a folder file with the date and time of storage is performed.
[0154]
If it is the current folder reference mode, folder reference processing is performed (steps S52 and S54). Normally, the mode is the normal input mode, and when today's folder icon on the toolbar is touched, the mode shifts to the folder reference mode. When an input is detected in the folder reference mode, the folder reference process described with reference to FIGS. 28 to 29 is performed.
[0155]
For example, when it is detected that the user has touched an icon on the screen and dragged and dropped it to the “view contents” portion, processing for displaying the data contents on the screen is performed. Similarly, when it is detected that the object has been put in the trash box marked “discard”, a process of deleting the data is performed. When it is detected that the part labeled “Previous Day” is touched, the process of displaying the “Today's Folder Screen” of the previous day is performed, and the part labeled “Next Day” is touched. The next day “Today's folder screen” is displayed on the next day.
[0156]
In the normal input mode, when a finger touches the touch panel, the following processing is performed (see step S60 in FIG. 33 and FIG. 34).
[0157]
When there is contact with the icon on the tool bar, various icon processing (see FIG. 41) is performed (steps S70 and S80 in FIG. 34).
[0158]
In the case of contact with various input marks such as “search tag”, “book thickness”, “bookmark”, and “bookmark insertion arrow”, input mark operation processing (see FIG. 36) is performed (step 36). S90, S100).
[0159]
If there is a second touch on the touch panel, and if a map image is displayed, map operation processing is performed (steps S110, S120, S130).
[0160]
If there is no contact at the second point, it is detected whether or not the contact point is moving, and if it is moving, the processing content that is instructed by the contact area and the contact pressure is determined ( Steps S140 and S150).
[0161]
If the contact area and the contact pressure are equal to or greater than the predetermined values, scroll processing is performed if the displayed image is a map image, and page turning processing is performed if the displayed image is a normal book page image (step S160). , S180).
[0162]
When the contact area and the contact pressure are not equal to or greater than the predetermined value, the following processing is performed (see FIG. 35). If there is information surrounded by a finger when not dragging and dropping to “today's folder”, floating processing of the information surrounded by the finger is performed (steps S910, S960, and S970).
[0163]
In the case of drag and drop to “today's folder”, if it is a memo content, the memo content is stored as image data in a folder file with the storage date and time (steps S920 and S930).
[0164]
If it is floating data, the storage date is added to the floating data and stored in a folder file (steps S940 and S950).
[0165]
FIG. 36 is a flowchart for explaining detailed processing contents of the processing (step S100 in FIG. 34) when the touch to the input mark is detected.
[0166]
When the user's finger is in contact with the search tag, search processing is performed (steps S210 and S220).
[0167]
If the user's finger is in contact with the bookmark insertion arrow mark, bookmark insertion processing is performed (steps S230 and S240).
[0168]
If the user's finger is in contact with the bookmark mark, bookmark insertion location reference processing is performed (steps S250 and S260).
[0169]
If the user's finger is in contact with the continuous page turning mark, continuous page turning processing is performed (steps S270 and S280).
[0170]
FIG. 37 is a flowchart for explaining detailed processing contents of the map operation processing (step S130 in FIG. 34).
[0171]
A change in the distance between the two points is calculated (step S310), and if the distance between the two points is enlarged, an enlargement process corresponding to the enlarged distance is performed (steps S320 and S330).
[0172]
If the distance between the two points is reduced, a reduction process corresponding to the reduction distance is performed (steps S340 and S350).
[0173]
If the distance between the two points has not changed, a rotation process is performed (steps S360 and S370).
[0174]
FIG. 38 is a flowchart for explaining detailed processing contents of the search processing (step S220 in FIG. 36).
[0175]
If the second contact of the user's finger is not detected, a page containing information that satisfies the search conditions of the search tag that the user's finger is touching is searched, and the first page is displayed. Search processing is performed (steps S410 and S420).
[0176]
When the second contact of the user's finger is detected and the contact is on the search tag, if the AND of the search conditions of the two search tags is scheduled, A page in which information satisfying the condition corresponding to the logical product of the search conditions is searched is searched, and a logical product search process for displaying the first page on the display unit is performed (steps S440 and S450).
[0177]
FIG. 39 is a flowchart for explaining detailed processing contents of the page turning processing (step S180 in FIG. 34).
[0178]
When the contact position of the user's finger moves from left to right on the screen, if the displayed book is a vertical book, it is updated to the next page image, and if it is a horizontal book, The image of the previous page is updated (steps S510, S520, S530, S540).
[0179]
When the contact position of the user's finger moves from right to left on the screen, if the displayed book is a vertical book, it is updated to the previous page image, and if it is a horizontal book, The next page image is updated (steps S550, S560, S570, and S580).
[0180]
FIG. 40 is a flowchart for explaining detailed processing contents of the continuous page turning processing (step S280 in FIG. 36).
[0181]
The contact pressure of the user's finger is detected, and if it is not equal to or higher than the predetermined pressure value, continuous page turning is stopped (steps S610, S620, S630).
[0182]
If the pressure value is equal to or higher than the predetermined pressure value, continuous page turning is performed as follows.
[0183]
That is, if the contact position of the user's finger is the thickness of the rightmost book on the screen, if the displayed book is a vertically written book, the page is continuously turned in the previous page direction, and the horizontally written book In this case, page turning is continuously performed in the next page direction (steps S640, S650, S660, S670).
[0184]
If the contact position of the user's finger is the thickness of the book at the left end of the screen, if the displayed book is a vertically written book, the page will be turned continuously in the direction of the next page, and the horizontally written book will be displayed. In this case, page turning is continuously performed in the previous page direction (steps S640, S680, S690, and S700).
[0185]
FIG. 41 is a flowchart for explaining detailed processing contents of various icon processing (step S80 in FIG. 34).
[0186]
If the touch is on the camera icon, a camera shooting operation screen as shown in FIG. 23 is displayed and the mode is shifted to the shooting mode. (Steps S810 and S820).
Hereinafter, when there is an input during the shooting mode, the shooting process of step S30 in FIG. 33 is executed.
[0187]
If the touch is on the memo icon, a memo input screen as shown in FIG. 26 is displayed and the memo input mode is entered. (Steps S830 and S840). Hereinafter, when there is an input during the memo input mode, the memo input process of step S50 of FIG. 33 is executed.
[0188]
If the touch is on the today's folder icon, the today's folder screen as shown in FIG. 28 is displayed and the mode shifts to the folder reference mode. (Steps S850 and S860). When there is an input during the folder reference mode, the folder reference process in step S54 in FIG. 33 is executed.
[0189]
(8) Various other embodiments
In addition, this invention is not limited to this embodiment, A various deformation | transformation implementation is possible within the range of the summary of this invention.
[0190]
In this embodiment, the case where operation input is performed using the thumb and index finger has been described as an example, but the present invention is not limited to this. For example, the thumb and middle finger may be used, or other combinations of fingers may be used.
[0191]
In this embodiment, the case of an electronic book has been described as an example, so that the first page in which search information that is the logical product of search items is displayed is displayed. However, in the case of a portable information terminal other than an electronic book, There may be no concept. Therefore, information units may be displayed regardless of the page.
[0192]
In the present embodiment, the case where two search items are simultaneously touched with a finger and search information that is the logical product of the two items is output has been described as an example. However, the present invention is not limited to this. For example, three or more search items may be simultaneously touched with a finger, and search information that is a logical product of the three or more items may be output.
[0193]
Further, the search information is not limited to the case of touching with a finger at the same time, and search information that is a logical product may be output when touching with a finger within a predetermined time.
[0194]
In addition, when there is no information having a logical product relationship with a search condition corresponding to a plurality of search items touched with a finger at the same time or within a predetermined time, at least one of logical sum and a combination of logical sum and logical product is determined. You may comprise so that the means to output the information which it has to a display part may further be included.
[0195]
For example, when the tags “South India”, “Accommodation” and “Meals” are touched at the same time, the South India accommodation information and South India meal information may be output.
[0196]
In particular, when the information is displayed regardless of the page, it is effective to take such a configuration.
[0197]
For example, if an electronic book or a portable information terminal that stores phone numbers can be searched and output by phone number, specifying multiple phone number search items in the table of contents automatically performs an OR operation. And the case of listing telephone numbers having a logical product relationship. That is, for example, when an item in a common set of “A hospital in A district” such as “A district” and “hospital” is designated, information in a logical product relationship is retrieved and output, When items that are not related to a common set such as “A district” and “B district” or “hospital” and “library” are designated, information having a logical sum is retrieved and output. You may comprise.
[0198]
In this embodiment, the screen is illustrated as a full screen such as a memo input screen and a photo mode screen, but a partial display using a window may be used.
[0199]
[Brief description of the drawings]
FIG. 1 is a functional block diagram of a form information device and an electronic book having characteristic functions of the present invention.
FIGS. 2A, 2B, and 2C are external views of electronic books according to the present embodiment.
FIG. 3 is a diagram showing an example of a screen displayed when travel information software is set.
FIG. 4 is a diagram showing a display example of a map image.
FIG. 5 is a diagram for explaining an operation example of a map enlargement gesture in the present embodiment;
FIGS. 6A and 6B are diagrams for explaining an example of finger operation in the present embodiment. FIGS.
FIG. 7 is a diagram for explaining another operation example of a map enlargement gesture in the present embodiment;
FIG. 8 is a diagram for explaining an operation example of a map scroll gesture according to the present embodiment;
FIG. 9 is a diagram for explaining an operation example of a map reduction gesture in the present embodiment;
FIG. 10 is a diagram for explaining an operation example of a map rotation gesture in the present embodiment;
FIG. 11 is a diagram for explaining a rotation angle of a map in the present embodiment.
FIG. 12 is a diagram for describing an example of search processing according to the present embodiment;
FIG. 13 is a diagram for describing an example of a logical product search process according to the present embodiment;
FIG. 14 is a diagram for describing a page turning operation in the present embodiment;
FIG. 15 is a diagram for describing a continuous page turning operation in the present embodiment;
FIG. 16 is a diagram for explaining a bookmark insertion operation in the present embodiment.
FIG. 17 is a diagram for explaining a bookmark insertion operation in the present embodiment.
FIG. 18 is a diagram for describing a bookmark insertion location reference operation in the present embodiment;
FIG. 19 is a diagram for explaining an example of a screen on which a tool bar is displayed.
FIG. 20 is a diagram for describing an operation example of floating processing in the present embodiment;
FIG. 21 is a diagram for explaining an operation example of a floating process in the present embodiment;
FIG. 22 is a diagram for explaining an example of drag and drop operation in the present embodiment;
FIG. 23 is a diagram showing a camera photographing operation screen according to the present embodiment.
FIG. 24 is a diagram for describing still image shooting processing in the present embodiment;
FIG. 25 is a diagram for describing moving image shooting processing according to the present embodiment;
FIG. 26 is a diagram for explaining memo input processing in the present embodiment;
27 is a diagram for explaining a memo input drag-and-drop operation according to the present embodiment; FIG.
FIG. 28 is a diagram showing today's folder reference screen according to the present embodiment.
FIG. 29 is a diagram for explaining today's folder reference processing in the present embodiment;
FIG. 30 is a diagram for explaining an example of utilization of today's folder in the present embodiment;
FIG. 31 is a diagram for explaining a hardware configuration of the electronic book according to the embodiment;
FIG. 32 is an example of a functional block diagram of an electronic book according to the present embodiment.
FIG. 33 is a flowchart showing an operation example of this embodiment.
FIG. 34 is a flowchart showing an operation example of the present embodiment.
FIG. 35 is a flowchart showing an operation example of this embodiment.
FIG. 36 is a flowchart showing an operation example (input mark operation processing) of the present embodiment.
FIG. 37 is a flowchart showing an operation example (map operation process) of the present embodiment.
FIG. 38 is a flowchart showing an operation example (search process) of the present embodiment.
FIG. 39 is a flowchart showing an operation example (page turning process) of the present embodiment;
FIG. 40 is a flowchart showing an operation example (continuous page turning process) of the present embodiment.
FIG. 41 is a flowchart showing an operation example (various icon processing) of the present embodiment.
FIG. 42 is a diagram for describing another example of the operation of the floating process in the present embodiment.
[Explanation of symbols]
10 finger motion detector
20 processor
30 Operation content judgment section
40 Map operation processing section
42 Enlargement processing section
44 Reduction processing section
46 Rotation processing part
48 Scroll processing part
50 Image generator
60 Display section
70 Information storage media
1010 CPU (Central Processing Unit)
1020 memory
1030 Display controller
1040 Touch panel controller
1050 bus
1060 touch panel
1070 display
1080 Disk drive controller
1090 disk drive
1100 Processing unit
1110 Finger movement detection unit
1120 Input unit (pen)
1130 Camera (camera)
1140 Processing content determination unit
1150 Various processing units
1160 Map operation processing section
1162 Enlargement processing unit
1164 Reduction processing unit
1166 Rotation processing unit
1168 Scroll processing section
1170 Search processing unit
1172 Normal search processing unit
1174 AND Search Processing Unit
1182 Page turning processing part
1184 Continuous page turning processing part
1186 Bookmark Insertion Processing Unit
1188 Bookmark Insertion Location Reference Processing Unit
1192 Floating processing part
1194 Shooting processing unit
1196 Memo input processing unit
1198 Folder reference processing section
1200 Image generator
1220 Information storage media
1230 storage unit
1232 folder file
1240 Display unit

Claims (4)

Display means capable of displaying a part of the display target image;
At least one of rotation, enlargement, reduction and scrolling of the display target image displayed on the display means based on the movement history of the finger touching the display means on which a part of the display target image is displayed Operation content determination means for determining that an operation instruction has been input;
Image generation means for generating an image obtained by performing at least one of the rotation, enlargement, reduction, and scrolling on the display target image displayed on the display means based on the determined operation instruction;
With
The operation content determination means includes
If the movement history of the finger is an operation of rotating another finger around one finger, it is determined that a rotation operation instruction has been input;
If the movement history of the finger is an action of moving two fingers away, it is determined that an enlargement operation instruction has been input;
If the movement history of the finger is an operation of bringing two fingers closer together, it is determined that a reduction operation instruction has been input,
The image generating means includes
When the enlarged image is generated, the image displayed on the display unit is subjected to the enlargement operation as a result of performing the enlargement on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image,
When generating the reduced image, the image displayed on the display unit is subjected to the reduction operation as a result of performing the reduction on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image,
In the case of generating the rotated image, the image displayed on the display unit is subjected to the rotation operation as a result of performing the rotation on the display target image displayed on the display unit. A portable information device that generates an image including a touch position of a finger in the displayed display target image . In claim 1,
The operation content determination means is
Based on the movement history of the finger, determine at least one operation amount of a rotation amount, an enlargement amount, a reduction amount, and a scroll amount of the display target image displayed on the display means;
The image generating means
Based on the determined operation amount, generating an image to be displayed on the display unit in which at least one of rotation, enlargement, reduction, and scrolling is performed on the display target image displayed on the display unit. A portable information device characterized by A method for controlling a portable information device including display means capable of displaying a part of a display target image,
At least one of rotation, enlargement, reduction and scrolling of the display target image displayed on the display means based on the movement history of the finger touching the display means on which a part of the display target image is displayed An operation content determination step for determining that an operation instruction has been input;
An image generation step of generating an image obtained by performing at least one of the rotation, enlargement, reduction, and scrolling on the display target image displayed on the display unit based on the determined operation instruction;
With
The operation content determination step includes
When the movement history of the finger is an operation of rotating another finger around one finger as an axis, it is determined that a rotation operation instruction has been input,
When the movement history of the finger is an operation of moving two fingers away, it is determined that an enlargement operation instruction has been input,
When the movement history of the finger is an operation of bringing two fingers close together, it is determined that a reduction operation instruction has been input,
The image generation step includes
When the enlarged image is generated, the image displayed on the display unit is subjected to the enlargement operation as a result of performing the enlargement on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image,
When generating the reduced image, the image displayed on the display unit is subjected to the reduction operation as a result of performing the reduction on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image,
In the case of generating the rotated image, the image displayed on the display unit is subjected to the rotation operation as a result of performing the rotation on the display target image displayed on the display unit. A method for controlling a portable information device, comprising: generating an image including a finger contact position in the displayed display target image . An information storage medium storing a program for controlling a portable information device including display means capable of displaying a part of a display target image,
At least one of rotation, enlargement, reduction and scrolling of the display target image displayed on the display means based on the movement history of the finger touching the display means on which a part of the display target image is displayed Operation content determination means for determining that an operation instruction has been input;
An image generating means for generating an image obtained by performing at least one of the rotation, enlargement, reduction, and scrolling operations on the display target image displayed on the display means based on the determined operation instruction; The program that makes the
The operation content determination means includes
If the movement history of the finger is an operation of rotating another finger around one finger, it is determined that a rotation operation instruction has been input;
If the movement history of the finger is an action of moving two fingers away, it is determined that an enlargement operation instruction has been input;
If the movement history of the finger is an operation of bringing two fingers closer together, it is determined that a reduction operation instruction has been input,
The image generating means includes
When the enlarged image is generated, the image displayed on the display unit is subjected to the enlargement operation as a result of performing the enlargement on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image ,
When generating the reduced image, the image displayed on the display unit is subjected to the reduction operation as a result of performing the reduction on the display target image displayed on the display unit. Generate an image including a finger contact position in the displayed display target image,
In the case of generating the rotated image, the image displayed on the display unit is subjected to the rotation operation as a result of performing the rotation on the display target image displayed on the display unit. An information storage medium for generating an image including a finger contact position in the displayed display target image .

Images