JPH07319899A - Controller for turning and displaying of page - Google Patents

Abstract

PURPOSE:To provide a controller for turning and displaying of pages which improves affinity and retrieval efficiency by reducing the sense of incompatibility with book which is accustomed to in the real world. CONSTITUTION:The controller displays information on a display device in a page unit by the form of the book and displays an animation turning pages at the time of paging. A means 301 detecting the speed of turning pages which a user requests, a means 303 which automatically sets the turning speed of the pages and an angle between the pages based on the compared result of paging speed and previously decided visual limit speed and a means 43 generating the animation turning the pages from turning speed and the inter-page angle are provided.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a page turning display control apparatus for displaying various information such as document data and image data page by page in the form of a book and displaying an animation for turning the page when switching pages. .

[0002]

2. Description of the Related Art Generally, in a device for displaying various information such as document data and image data in page form in the form of a book, pages designated by a user are sequentially or suddenly displayed, or pages are scrolled on a screen. I was switching pages. However, with this device, it is difficult to know which page is being displayed as a whole, and the efficiency of searching for information is poor due to the two-dimensional scrolling on the limited display surface. Furthermore, the display suddenly changes when the page is switched, which makes it difficult to say that the display is familiar.

Therefore, there has been proposed a device which imitates a book familiar to humans and displays an animation of turning pages when switching pages. FIG. 33 shows a typical screen display example of animation for turning this page.

FIG. 33A is characterized by gradually displaying a page designated by the user while hiding the currently displayed page (hereinafter referred to as a display page) on the back side. The purpose is to enhance the user's affinity by giving the visual effect of turning a book. A known example of this is the "information display system having a turning function" disclosed in Japanese Patent Laid-Open No. 4-21068.

FIG. 33B is characterized in that a plurality of pages are shifted and displayed at the same time, and the displayed pages are shifted forward or backward when switching pages. It aims to improve search efficiency by displaying multiple pages at the same time. As a typical known example, there is a "document processing device" of Japanese Patent Laid-Open No. 3-201024.

FIG. 34 shows a typical conventional page turning operation example. As described above, conventionally, page turning is operated using a control panel imitating a video remote controller and buttons displaying operation names such as "fast forward", "reverse" and "one page".

[0007]

The prior art shown in FIG. 33 (A) is an animation in which the display page is gradually hidden on the next page or the previous page in a plane, so that the book is familiar to the real world. Is still uncomfortable. Also, because you can only flip one page at a time, search efficiency is not very good. On the other hand, even if you flip multiple pages at once, the displayed pages are hidden and search efficiency does not improve.

Since the conventional technique shown in FIG. 33B simultaneously displays a plurality of pages, it seems that the search efficiency is improved at first glance. However, since the displayed pages are hidden from each other, the effect of displaying multiple pages is small.
Further, since page turning is also an animation in which the displayed page is slid, the feeling of strangeness with a book familiar in the real world becomes greater than in FIG. 33 (A).

Therefore, a first object of the present invention is to provide a page-turning display control device that enhances affinity by reducing discomfort with a book familiar in the real world and also enhances search efficiency. .

In particular, in the prior art, in order to improve the efficiency of page turning retrieval, there is no way but to switch and display each page at high speed. However, in order to switch and display pages at high speed, a mechanism for displaying animation at high speed is required, which places a heavy burden on the hardware. In addition, since humans have a limit page display speed (visual limit speed) at which the content of a page can be confirmed (IEICE, IE 86-53, 1986), pages exceed the visible limit speed. The search efficiency did not improve even when switching to. Therefore, the present invention provides a page turning display control device capable of reducing the load on the hardware for increasing the search efficiency and increasing the search efficiency even if the page turning speed exceeds the visual limit speed. To do.

On the other hand, even in the page turning operation, FIG.
In the related art as shown in FIG. 4, the interface is far from the actual book operation. Therefore, even if the page turning display is brought closer to that of an actual book, on the contrary, a sense of incongruity with the page turning operation spreads, resulting in poor usability. Further, in the page turning operation shown in FIG. 34, since the direction and speed of the page turning are explicitly assigned to each operation button, the user must perform the page turning operation while being aware of the mode such as low speed turning or high speed turning. I have to. Moreover, since each mode is designated by pointing each operation button with the pointing device, the overhead of mode switching is large. In general, when retrieving information, the user dynamically changes the page turning state such as turning the page, turning the page, slowly turning the page, or turning the page quickly. For this reason, the interface shown in FIG. 34, in which the user is aware of the modes one by one and has a large overhead for mode switching, has poor search efficiency.

[0012] Therefore, another object of the present invention is to provide a page turning display control device which improves affinity and retrieval efficiency by making the page turning operation closer to the actual book operation.

[0013]

The page turning display control device of the present invention is based on the result of comparing the means for detecting the page turning speed requested by the user and the page turning speed with a predetermined visual limit speed. , A means to automatically set the rotation speed of the page and the angle between the pages,
And means for creating an animation for rotating the page from the rotation speed and the angle between pages.

The page-turning display control device of the present invention has means for detecting the number of pages that the user wants to turn at the same time, and means for creating the page thickness according to the number of pages, and rotates the page. There is provided a page turning display control device for displaying the thickness of the page according to an animation.

Further, according to the present invention, a means for displaying the thickness of the book on the left and right of the pages arranged in a two-page spread type, a means for pointing the thickness of the book by the user, and a thickness of either of the left and right books. A means to calculate the page turning speed from the position pointed by the user, and if the user points the thickness on the right side, the page turning direction is set to the forward direction, and conversely, if the thickness on the left side is pointed, the direction is set to the reverse direction. Have the means to do.

The page-turning display control device of the present invention has means for detecting a change in the page-turning direction and speed required by the user while the page is being rotated.
When a page-turning end request is detected during page rotation, an animation that the page falls due to gravity is displayed.

Further, the page-turning display control device of the present invention has a storage device for temporarily storing an animation for rotating a page generated in advance, an image compression means and an expansion means, and the storage device is provided in the storage device. There is provided a page turning display control device for compressing and storing the animation.

Furthermore, according to the present invention, two or four input means are provided on the left and right or the upper left and lower right of the case surrounding the display device, and page turning is performed based on the input from the two or four input means. To do.

[0019]

FIG. 2 shows an example of page turning display according to the present invention. Further, FIG. 3 is a view of the actual page turning of the book as viewed from the horizontal direction, and shows the principle of page turning display according to the present invention. Θ in FIG. 3 represents the angle formed by the rotating page and the stationary page, and will be referred to as the page angle hereinafter. Further, α represents an angle at which the page rotates per unit time, and is hereinafter referred to as a page angular velocity (or page rotation velocity). Further, β represents an angle between pages when a plurality of pages are turned at the same time, and is hereinafter referred to as an inter-page angle.

In FIG. 3 (A), the page turning speed is converted into the page angular speed α, and the page 1 is converted according to the page angular speed α.
2 and the page 13 corresponding to the back surface thereof rotate. At this time, page 11 and page 14 remain stationary. By projecting this on the projection surface 22 from the light source 21, the animation shown in FIG. 2 (A) is displayed. of course,
The page angular velocity α can be set to be smaller than that shown in FIG. 2A, and in that case, smoother page turning is performed. As described above, in the page turning display according to the present invention, the projective conversion processing is performed so that the page turning can be seen three-dimensionally, and therefore, the visual effect close to that of a book familiar in the real world is provided, and as a result, the affinity is high. Become.

Further, in FIG. 3B, the page turning speed is converted into a page angular speed α and an inter-page angle β, and a plurality of pages are rotated by the page angular speed α for each inter-page angle β. At this time, assuming that pages 11 to 20 are being turned over, pages 11 and 20 are stationary, and other pages 12 to 19 are rotating. By projecting this on the projection surface 22 from the light source 21 as before, the animation shown in FIG. 2B is displayed. Of course, it is possible to make the inter-page angle β smaller than that shown in FIG.
In that case, since more pages are displayed at the same time, the page turning is faster than that shown in FIG. This animation is processed by projective transformation so that page turning looks three-dimensional, giving a visual effect that is similar to "flip-turning" a book that you are used to in the real world. Moreover, even if a plurality of pages are displayed at the same time, the overlapping portion is small, so that not only the affinity is improved, but also the search efficiency is improved.

Generally, even if the animation shown in FIG. 2 (A) is displayed at high speed by increasing the page angular velocity, there is a limit to the visual recognition of pages that rotate at high speed, so the number of pages that can be displayed per second is limited. (Hereinafter, referred to as display throughput) is also limited. For example, as shown in FIG. 32, when the page angular velocity at the visual limit is 2πrad / sec, the display throughput is about 4 pages / sec. However, in the animation shown in FIG. 2B, even if the page angular velocity of the animation is at the visual limit, it is possible to increase the apparent display throughput by flipping multiple pages at once. For example, the inter-page angle is π / 3
When rad is set, three pages are displayed at one time, so that the display throughput is about three times the above, that is, about 12 pages / sec. By this method, it is possible to improve the search efficiency even if the page turning speed exceeds the visual recognition limit speed.

Further, FIG. 3C shows a case of jumping from one page to another page. At this time, page 1
The page 1 and the page 20 are stationary, and the page angular velocity α is maintained from the page 12 to the page 19 with the inter-page angle β = 0.
Is spinning at. By projecting this on the projection surface 22 from the light source 21 as before, the animation shown in FIG. 2C is displayed. This animation is also simply generated by converting the number of pages to be turned into the page thickness 26 at the same time and combining this with a page turning animation consisting of pages 11, 12, 19, and 20. This animation is processed so that page turning looks three-dimensional by projective transformation, and since the number of pages to skip is roughly known from the thickness of the page, it is similar to looking at a book familiar in the real world while skipping some places. Give a visual effect. That is, FIG. 2 (C)
Since the page jump display shown in is a display in consideration of human spatial cognitive ability, not only the affinity is improved, but also the search efficiency is increased.

Further, according to the present invention, the thickness 25 of the book is also displayed, and the direction and speed of page turning are specified by pointing this. This is similar to the operation of turning a finger on the thickness of a book in the real world and turning it while adjusting the direction and speed, so it can be said that it is an easy-to-use operation that is intuitive to the user. Moreover, by shifting the pointing position within the thickness 25 of the book, the direction and speed of page turning can be dynamically changed, so that the overhead for the user to change the direction and speed of page turning is reduced, and the search efficiency is improved.

Further, according to the present invention, the direction of page jump and the number of pages to be jumped are designated by dragging the thickness 25 of the book. This is similar to the operation of moving a finger inserted in the thickness of a book in the real world to the left or right to turn to the specified page all at once,
It can be said that this is an easy-to-use operation that suits the user's intuition.
Moreover, since the page to which the user jumps from the position where the drag is started is determined, the user can spatially specify the position of the page to be viewed within the thickness of the book, and the search efficiency is improved.

Further, according to the present invention, the user can change the direction and speed of turning the page while the page is rotating, and the change is made in synchronization with the drag operation of the pointing device. This is also similar to the operation of grabbing the edge of the page of a real-world book and turning it back and forth, and thus can be said to be an easy-to-use operation that suits the intuition of the user. In addition, it becomes possible to compare the currently displayed page with an arbitrary page.

Further, in the page-turning display control device according to the present invention, since a path for previously generating an animation for rotating a page is also provided, expensive hardware for performing image conversion processing in real time is not particularly required. Further, since the animation is stored at a low resolution, the amount of data is small and the load on the hardware for displaying the animation is reduced. This is because the user does not look at every corner of the page in detail during the page turning, and thus the performance is not deteriorated even if the animation during the page turning is displayed at a resolution enough to show the atmosphere of the page.

Further, according to the present invention, two or four input means for performing page turning operation are provided on the left, right, left, right and up and down of the case surrounding the display device. The two input means provided on the left and right sides of the case correspond to the forward turning and the backward turning, respectively, and it is possible to turn the pages with a sense of flipping while touching the thickness of the book with both hands. Also, the four input means provided on the left, right, top and bottom of the case correspond to the forward turning or the backward turning between the left and right input means, and similarly, the forward turning or the backward turning between the upper and lower input means. Because
You can turn pages with both hands or one hand. This is a user-friendly operation that is easy to use because it physically mimics the operation that the user is familiar with in the real world. Further, if these input means are buttons, for example, the page turning speed can be calculated as being proportional to the time the user holds down the buttons.
You can easily change the page turning direction and speed depending on the position of the push button and the length of time you press and hold it, which improves search efficiency.

[0029]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 shows the external appearance and basic configuration of a page turning display control device according to an embodiment of the present invention. Appearance of this device 3
0 is a portable type, and includes a bidirectional button switch 31 for page turning operation, and an electronic pen 32 (hereinafter referred to as pen) for performing page turning operation by pointing and dragging and other editing operation, The liquid crystal display 33 displays a page-turning animation or a still image. The bidirectional button switch 31 (hereinafter, referred to as a button) corresponds to the thickness of a book, and as shown in, for example, an operation example 34, the user can operate the page as if he / she touches the thickness of the book. The feature is that it is possible.

The basic configuration of this apparatus is as follows: a page-turning control section 40 that analyzes an input from a pen or a button and executes a page-turning command, and a material-data storage section 41 that stores document data, image data, and the like. And a page generation unit 42 for arranging document data and image data in a page,
It comprises a page-turning animation generating section 43 for continuously generating three-dimensional page-turning images by projectively converting a page or a group of pages, and a page-turning display section 44 for displaying the page-turning animation in real time.

The page turning control unit 40 detects the page turning speed requested by the user, the page turning speed and the predetermined visual limit speed 3
On the basis of the result of comparison with 02, means 303 for automatically setting the rotation speed of the page and the angle between the pages, means 304 for detecting the number of pages that the user wants to turn at the same time, and a direction in which the user wants to turn the page. And a means 305 for detecting. Each of the detecting means will be described together with a page turning operation method when describing a specific processing flow.

Further, the page-turning animation generating section 43 performs a bevel conversion means 45 for performing a bevel conversion of each material data in a page being turned or image data obtained by dumping the page (hereinafter referred to as a page image) on the projection surface. When,
It is characterized in that an image synthesizing means 46 is provided for synthesizing the image after the slanting shadow conversion with another still page image. Further, if the page image or page-turning animation cannot be generated in real time, the image or animation generated in advance is compressed by the image compression means 47 and temporarily stored in the page-turning data storage section 49. Then, in response to a request from the page turning control unit 40, the image or animation is expanded by the image expansion means 48 and displayed.

Further, the page-turning display section 44 is a means 311 for displaying moving images such as animation and still images.
And a means 312 for creating and displaying the thickness of the book according to the page number and a means 313 for creating and displaying the thickness of the page according to the number of pages that the user wants to turn at the same time. The user uses the pen 3
Operate page turning by pointing or dragging with 2.

Next, FIG. 4 to FIG. 8 show the processing flow of the page turning display control device according to the embodiment of the present invention. Further, these processes are performed by the page turning control unit 40 and the page turning display unit 44 of the page turning display control device except for the process of generating and displaying the page turning animation (steps surrounded by double lines in the figure). .

Before explaining a specific processing flow, an example of a screen will be described first with reference to FIG. Screen components include a book thickness button 25, a page scroll button 27, a page 28, and a material data group 23 arranged in the page 28.
And a menu button group 38 for editing functions and an end button 39. The thickness buttons 25a and 25b of the book here have a width proportional to the number of remaining pages and the current page number, respectively. For example, if the 30th page is currently displayed out of the total 100 pages, the book thickness button 25a has a width proportional to the remaining 70 pages, and the book thickness button 25b currently displays. The width is proportional to page number 30. As a result, the user can visually confirm where the currently displayed page is located in the entire book.

FIG. 4 shows a main process 50 centering on page turning display control of one application according to the present invention. In step 51, the program is initialized by generating and displaying a book cover, a book thickness button 25, and other buttons as shown in FIG. 9A. By turning the pages one by one from the cover, each page can be referred to as shown in FIG. 9B. First, when the book thickness button 25 is picked, the page turning process of step 60 is executed. On the other hand, if the book thickness button 25 is dragged, the page jump process of step 80 is executed. This page jump process is a keyword search,
It is also started when performing search processing such as table of contents search and index search. When the page scroll button 27 is picked, the page scroll process of step 100 is executed. Further, when the bidirectional button switch 31 is pressed, the page turning processing of step 120 is executed. By selecting the menu button group 38 as a process other than the page turning, the editing process in step 53 can be executed, but this will not be described here because it is out of the scope of the present invention. Above, steps 60, 80, 100, 12
The processes of 0 and 53 are repeated until the end button 39 is picked up and the loop 52 ends in step 54. Finally, in step 55, termination processing such as deleting the screen constituent element is performed.

Page-turning process 6 using the book thickness button
At 0, the animation shown in FIGS. 2A and 2B is controlled. The flow of the page turning process 60 will be described below with reference to the flowchart of FIG. 5, the operation example shown in FIG. 10, and the graphs shown in FIGS. 15 and 16. When the thickness button 25 of the book is picked with the cursor 29, first, in step 61, the page turning display portion is initialized. In the present embodiment, two types are provided, a path for displaying a still image in high definition and a path for displaying a moving image such as animation at high speed (details will be described later with reference to FIG. 31). Switching from the path to the video display path. In the next step 62, the page turning direction is set. Here, it is detected which of the left and right book thickness buttons is picked, and when the book thickness button 25a is picked, the page turning is set in the forward direction, and when the button 25b is picked, the reverse direction is set. Set. Then step 63
In step 64, timers for checking the page turning speed v and the pen state are set to initial values.
The timer is a timing control mechanism for executing a process at every designated fixed time. In step 65, the pen state is first detected in step 66 for each time designated by the timer. In the case of pen down, page turning processing from step 67 to step 71 is executed, and when pen up is detected, page turning is stopped and the loop of step 65 is exited. This allows the user to repeatedly perform page turning by continuing pen down. After pen-up and ending the loop 64, in the ending process of the page turning display unit in step 73, the moving image display path is switched to the still image display path.

The processing from step 67 to step 71 will be described below. First, in step 67, the page turning speed v is calculated. The page-turning speed v increases in proportion to the time when the book thickness button 25 is picked up (hereinafter referred to as the pressing time), and is fixed at a constant speed when the pressing time exceeds a certain time.

For example, as shown in FIG. 15, when the pressing time is within a fixed time from 0 to T1, the page turning speed v increases to V2 in proportion to the pressing time. When the pressing time exceeds T1, it remains fixed at V2 for a while. When the pressing time exceeds a certain time T1, as shown in the operation example 140 of FIG. 10, the page turning speed v changes depending on the position where the thickness button of the book is picked.

For example, when the thickness button 25a of the book is picked, moving the cursor 29 to the right or upper side increases the speed v, and moving it to the left or lower side lowers it. Of course, it is also possible to reverse the way of changing the speed v left and right or up and down by user's customization. The page turning speed v in the case of the operation example 140 is v =
It is calculated by A * m / M or v = A * n / N (A is the maximum page turning speed).

In the case of FIG. 15, since the position of the cursor 29 is fixed from the pressing time T1 to T2, the page turning speed v is also fixed at V2, and gradually moves to the right from T2 to T3. The speed v increases from V2 to V3, and from T3 to T4, it returns to the left side, so the speed v decreases from V3 to V1. On the contrary, when the thickness button 25b of the book is picked up, only the left and right are reversed, the right moves down and the left moves up. Through the above processing, the user can freely change the page turning speed v.

In this embodiment, the pressing time and the pick position are detected in step 67, and the page turning speed is calculated based on the above method. As another method of calculating the page-turning speed v, a method of calculating the page-turning speed by detecting only the pick position without considering the pressing time can be considered, but it is equivalent to the above method when T1 = 0. Since it is there, detailed explanation is omitted.

Next, at step 68, the page angular velocity α and the inter-page angle β are calculated from the page turning velocity v.
The page angular velocity α is an angle at which a page being rotated is rotated per unit time, and the inter-page angle β is an angle between pages when a plurality of pages are rotated.

FIG. 16 shows an example of calculation in step 68. The horizontal axis represents the page turning speed, the left vertical axis represents the page angular velocity, and the right vertical axis represents the inter-page angle. According to FIG. 16, the angular velocity α rises to a certain value (2π) in proportion to the page turning velocity v, and is fixed thereafter. Even if the angular velocity is increased above the human visual recognition limit (2π in this case), the information in the page cannot be visually recognized and the search efficiency does not increase.
This is the setting. The inter-page angle β is fixed at π when the page turning speed is low, and becomes a certain speed V0 at which the page turning speed gradually decreases when the angular speed becomes constant. Therefore, when the inter-page angle is π, the pages are turned one by one (see FIG. 2A), and when the angle is less than that, a plurality of pages are turned at the same time (FIG. 2).
(See (B)). Even if the page angular velocity is fixed within the human visual limit, by reducing the interpage angle from π and increasing the number of pages to be turned at the same time, the page turning speed can be increased and the search efficiency can be improved.

Next, at step 69, a page-turning animation is generated and displayed using the page-turning angular velocity α and the inter-page angle β as parameters. The method of generating and displaying the page-turning animation will be described later with reference to FIG.

This embodiment has a page counter for managing the currently displayed page number. Step 7
At 0, the page counter and the book thickness button 25 are updated. That is, when turning pages in the forward direction, the page number in the page counter is increased by the number of pages turned over, the width of the book thickness button 25a is narrowed in proportion to the remaining number of pages, and the width of the book thickness button 25b is increased. Spread in proportion to the current page number. If you flip it in the opposite direction,
The page number is reduced by the number of pages turned over, the width of the book thickness button 25a is expanded in proportion to the remaining number of pages, and the width of the book thickness button 25b is narrowed in proportion to the current page number.

Finally, in step 71, the timer is reset according to the page turning speed. If the page turning speed changes in step 67, the time from the start of turning the current page to the start of turning the next page also changes, so the timer must be adjusted to this time. On the contrary, if the timer is not set again, the page switching speed will remain unchanged even if the page turning speed is increased. Further, the calculation here is performed by the inter-page angle β / page angular velocity α.
For example, if the page turning speed is increased and β is fixed at π and α is changed from π to 2π, the time until the next page starts is changed from 1 second to 0.5 seconds, and the timer is also set to this. Set again together. In addition to the present embodiment, it is also possible to set a timer to a sufficiently short time and determine for each timer whether or not to start turning the next page before step 66. In this method, when the page angle θ exceeds the inter-page angle β, it is determined that the next page may be turned.

In the page jump processing 80, the animation shown in FIG. 2 (C) is controlled. The flow of the page jump process 80 will be described below with reference to the flowchart of FIG. 6 and the operation examples of FIGS. 11 and 12. First, when dragging on the book thickness button 25 in FIG. 11, in step 81, the page turning display unit is initialized as in step 61. Next, in step 82, the page jump direction is set to the forward direction when the book thickness button 25a is dragged leftward, and is set to the reverse direction when the book thickness button 25b is dragged rightward. . Here, in order to match the intuition of the user, the dragged direction and the page jump direction are matched. In step 83, the page angular velocity α
To the default value. The page angular velocity α can be changed by the user's operation, but in the present embodiment, the default value will not be changed. In step 84, the page number p of the page jump destination is set. Here, the page number p is calculated from the horizontal position where the dragging is started within the book thickness button 25a.

In the operation example 141 of FIG. 11, when the number of remaining pages is P, p = P * r / R is calculated. In this case, r represents the distance from the boundary line between the page and the book thickness button 25a to the drag start position, and R represents the width of the book thickness button 25a. When the book thickness button 25b is dragged, the page number p of the page jump destination is calculated by the same method as described above, where r is the distance from the boundary line between the page and the book thickness button 25b to the drag start position. This allows the user to specify the page to jump to at a spatial location within the book thickness button.

Next, at step 85, the number of pages from the current page to p pages is calculated, and the page thickness button 26 whose width is proportional to the number of pages is generated. The page thickness button 26 helps the user visually confirm the number of pages to skip. In step 86, the width corresponding to the thickness button 26 of the page is deleted from the book thickness button 25a on the jump start side (from 25b when the book thickness button 25b is dragged). Step 87
Then, a page turning animation is generated based on the page angular velocity α, and the page thickness button is combined and displayed. The method for generating and displaying the page-turning animation will be described later.

Further, in step 88, the page thickness button 26 is added to the book thickness button 25b on the jump end side (to 25a when the book thickness button 25b is dragged).
Add a width corresponding to the display. Finally, step 89
In the page turning display unit ending process, the moving image display path is switched to the still image display path, and the page jump processing 80 is ended.

The page jump process 80 can also be applied when the data of the search result by the keyword search, the table of contents search, the index search, etc. is on a page other than the currently displayed page. For example, in the keyword search of FIG. 12A, the keyword input window 14
When "Hitachi Ltd." is input in 5 and a search is executed, page jump processing up to page 147 including search results 146 8
Execute 0. Similarly, when the table of contents button 148 is picked in the table of contents search of FIG. 12B, the page jump process 80 is executed to the page 149 which is the search result.
In this case, a keyword management table including a keyword and a page number including the keyword and a table of contents management table including a table of contents button and a page number are created in advance. In step 83, the table is referred to and the page is referred to. Get the number p. The other processing is the same as the processing flow described in FIG. As a result, even if a process other than page turning such as keyword search is executed, a consistent user interface of page turning display can be provided.

FIG. 7 is a flow chart of the page scroll processing 100. Before explaining this flow chart, the concept of page scroll processing will be described with reference to FIG.
First, page scroll button 2 in the state of FIG.
When you pick 7a and start dragging to the left,
As shown in (C), the page is turned over following the movement of the pen. When the pen is further dragged to the left to move the position of the pen to the left page side, the back page is displayed as shown in FIG. Since the page turning is synchronized with the operation of the pen, the user can freely move between FIG. 13C and FIG. 13D by repeatedly dragging to the left or right. Similarly, when the page scroll button 27b is picked up and dragged in the right direction in the state of FIG. 13B, it follows the movement of the pen as shown in FIG. 13D, and then starts to flip in the opposite direction. . Then, the state of FIGS. 13C and 13D is transited by repeating dragging in the left direction or the right direction. FIG.
13 (C) or FIG. 13 (D), when the pen-up is completed and dragging is completed, the page is dropped according to gravity, and in the case of FIG. 13D), and in the case of FIG. 13D, the frame is advanced in the reverse direction and stopped in the state of FIG. 13B.
Although FIG. 13 shows an example in which only one page is scrolled, the page scrolling process 100 can also scroll a plurality of pages together. In this case, the animation shown in FIG. 2C moves in synchronization with the movement of the pen. This makes it possible to compare the currently displayed page with an arbitrary page.

The flow of this page scroll processing will be described below. First, in step 101, the page turning display unit is initialized as in step 61. Step 1
In 02, get the page number p for page scrolling,
In step 103, the number of pages from the current page to p pages is calculated and the page thickness button 26 is generated.
Then, in step 104, the width corresponding to the page thickness button 26 is deleted from the book thickness button 25 on the scroll start side. Next, at step 105, a timer for checking the pen state is set. Since the state of the pen needs to be known at all times in order to smoothly turn pages in synchronization with the movement of the pen, the timer is fixed as short as possible. In step 106, the pen state is first detected in step 107 for each time designated by this timer. In the case of pen down, in step 108 the page angle θ is calculated from the position of the pen.

FIG. 17 shows this calculation method, which is represented by X in the figure.
1 and X mean the distance from the central axis of the book to the current cursor position and the page width, respectively. Since it is only necessary to obtain the page angle θ such that the width when the page is obliquely transformed becomes X1, θ is calculated from X1 = X * COSθ using the inverse COS function. Conversely, if pen-up is detected,
The loop 106 is exited in step 109. In step 110, a page turning image is generated based on the page angle θ, and is combined with the page thickness button 26 and displayed. The method of generating and displaying this page-turning image will be described later. Since the position of the pen is detected every time designated by the timer and a page-turning image is generated and displayed from the position of the pen, page scrolling synchronized with the operation of the pen is possible. Next, when the loop 106 is exited in step 109, an animation in which a page in the middle of page scrolling falls due to gravity is displayed. Here, the processing is divided by the page angle θ at the time of pen-up, and if the page angle θ is smaller than π / 2, step 111 and step 11
2 is executed, and if it is π / 2 or more, the processes of step 113 and step 114 are executed.

For example, when pen-up is performed in the state of FIG. 13C, a frame advance animation up to the state of FIG.
Is displayed as a composite. Then, in step 112, a width corresponding to the page thickness button 26 is added to the right book thickness button 25a. Conversely, when pen-up is performed in the state of FIG. 13D, a frame-by-frame animation up to the state of FIG. 13B where θ = π is generated, and combined with the page thickness button 26 and displayed. Then, in step 114, a width corresponding to the page thickness button 26 is added to the left book thickness button 25b. Finally, step 115
In the end processing of the page-turning display section, the moving picture display path is switched to the still image display path. The method of generating and displaying the frame-by-frame animation will be described later.

In the page turning process 80 by the bidirectional button switch, the animation shown in FIG. 2 (A) or FIG. 2 (B) is controlled. FIG. 14 is a diagram of a state in which the user is using the page-turning display control device as viewed from the lateral direction. The user looks at the exterior 30 of the device by the fulcrum 36 of the hand 35.
The page turning is controlled while pressing the bidirectional button switch 31. As the bidirectional button switch 31, the upper right button 31a, the lower right button 31b, the upper left button 31c, and the lower left button 31d (in FIG.
There are four buttons (hidden on the back side of) and an operation example when each button is pressed is as shown in FIG. If you press each button once, the page will be turned one page at a time, and if you keep pressing it, the pages will be turned continuously, and the page turning speed will increase in proportion to the time of pressing. When the upper right button 31a or the lower left button 31d is pressed, the page is turned forward, and the lower right button 31b or the upper left button 31c is pressed.
Press to turn the page in the opposite direction. Therefore, the user can operate with either one hand or both hands. For example, when operating with the right hand, the upper right button 31a and the lower right button 3
When using 1b and operating with the left hand, top left button 31c
And the lower left button 31d are used, and when operating with both hands, the upper right button 31a and the upper left button 31c are used. In particular, the operation using both hands is similar to the feeling of turning pages while holding the actual thickness of a book with fingers, and thus has a high affinity for the user. Further, the upper and lower buttons are displaced in position so that the user can touch the positions of the thumb and the index finger when the user puts the hand 35 on the appearance 30. Further, as shown in the cross-sectional view 37, when the upper button is pushed, the lower button is pushed out by the amount corresponding to the push, and conversely, when the lower button is pushed, the upper button is pushed outside. It is also possible to move in conjunction with each other. In addition, in the page scroll processing and the page jump processing using the bidirectional button switch, a switch for switching the mode from the page turning processing is required separately. Further, instead of the bidirectional button switch, a configuration in which jog shuttles are arranged on the left and right of the outer appearance 30 can be considered.

FIG. 8 shows a flow chart of the page turning processing 120 by the bidirectional button switch. In step 121, the page turning display section is initialized. Step 122
Then, set the page turning speed to the initial value, and go to step 12.
In 3, the timer for checking the button state is set to the initial value. Then, in step 124, the state of the button is first detected in step 125 for each time designated by the timer. If the button is down, the page turning speed v is calculated in step 126. The page turning speed v is proportional to the time t during which the button is held down, so v = B * t
(B is a constant of proportionality). Further, in the case of a pressure-sensitive button, the page turning speed v may be proportional to the pushing force of the button. Next, in step 127, the page angular velocity α and the inter-page angle β are calculated from the page turning velocity v by the same method as in step 68. Next, the position of the button pressed by the user is detected, and if the upper right button or the lower left button is pressed, the forward page turning of step 128 is executed, and if the upper left button or the lower right button is pressed, the step is performed. 129 reverse page turning.

The above step 128 or step 129
Then, a forward or reverse page-turning animation is generated and displayed from the page angular velocity α and the inter-page angle β. Details of the method of generating and displaying the page-turning animation will be described later. In step 130, the page counter and the book thickness button are updated by the same method as in step 70, and in step 131, the timer corresponding to the page turning speed v is reset by the same method as in step 71. When button up is detected in step 125, page turning is stopped and loop 124 is exited. in this case,
Even if the button to be pressed during the loop 124 is changed from the middle, if the button is continuously pressed, the loop is not exited, so that page turning in the forward direction or the backward direction can be repeatedly executed at high speed. Button up and loop 12
After the step 4 is finished, in the process of ending the page turning display unit in step 133, the moving picture display path is switched to the still image display path.

A method of generating and displaying a page-turning animation will be described below. First, FIG. 18 shows the flow of processing. Steps 69 and 8 shown in FIGS. 5 to 8
7, 111, 113, 128, and 129 call step 150 using the page angular velocity α, the interpage angle β, the page turning direction (forward or reverse direction), and the initial value θ0 of the page angle θ as parameters. Step 151
Then, the page angle θ at which page turning is started is set to a given initial value θ0. Specifically, step 69,
When calling step 150 from 87, 128, 129, the initial value θ0 is set to 0 in the case of forward page turning and set to π in the case of backward page turning. On the other hand, when calling from step 111 or step 113 to step 150, the page angle at the time of pen-up is calculated by the calculation method (described above) shown in FIG. 17 and set as the initial value θ0. As a result, the frame-by-frame animation can be processed in the same manner as the page-turning animation.

Next, at steps 152 and 153, the terminal value θ1 of the page angle θ is calculated. In the case of forward page turning, θ1 = θ0 + β is calculated, and in the case of backward page turning, θ1 = θ0−β is calculated. Of course, θ1 is 0
Adjust so that it falls within the range from to π. Then step 154
Then, the page rotation angle γ per frame is calculated from the page angular velocity α.

Generally, an animation is composed of a plurality of continuous images (hereinafter referred to as frames), and each frame is displayed smoothly at a speed of about 30 frames per unit time so that the animation looks smooth. Also in the page turning animation, a page turning image for each frame is generated and continuously displayed. Therefore, it is necessary to convert the page rotation speed from the page angular speed α to the page rotation angle γ per frame. Here, the number F of frames that can be displayed per unit time depends on the hardware resources such as the speed of rewriting the video memory and is considered to be always fixed. Therefore, in step 154, γ = α / F is calculated. Further, in step 155, the processes shown in steps 156 to 159 are repeated until the page angle θ changes from the initial value θ0 to the terminal value θ1 at intervals of the page rotation angle γ.

First, in steps 156 and 157, the page angle θ of the current loop is calculated. To turn pages forward, add page rotation angle γ to page angle θ,
In the opposite direction, γ is subtracted from the page angle θ. Here, the check of the ending condition of the loop 155 is performed after step 156 or 157. Also, step 15
It is assumed that the calculation method of α and β shown in FIG. 16 is adjusted so that the loop 155 does not end without executing 8 and 159 once.

Next, at step 158, the page turning image generated based on the page angle θ and the inter-page angle β is displayed. As mentioned earlier, this page-turning image is displayed continuously in each frame of the animation. Also,
The processing performed in step 158 changes depending on the timing of generating the page-turning image, and this point will be described later. Finally, in step 159, the page thickness button 26 is arranged at a predetermined position on the page turning image. By repeating the loop 155, the page thickness button 26 moves in accordance with the page turning. Of course, as in step 69, step 128, step 129, etc., step 1 is performed without generating the page thickness button 26.
When calling 50, the process of step 159 is omitted.

The method of generating and displaying the page-turning image is as follows.
A method of creating a page-turning image in advance before executing page-turning and displaying the image at the time of execution (at step 158) and a method of creating a page-turning image component before executing page-turning (see above) There are three types: a method for combining and displaying those parts (in step 158) and a method for creating and displaying a page-turning image in real time (in step 158) when executing page-turning. These three types of methods are selectively used depending on the hardware resources of the page turning display control device. For example, when an image processing LSI is mounted, a real-time creation method is adopted, and when it is not, image processing cannot be performed in time, so a method of creating a page-turning image or a part in advance is adopted. 19, 20, and 2
FIG. 1 is a diagram in which the configuration of the page turning display control device shown in FIG.

First, in FIG. 19, a method is used in which a page-turning image is generated in advance before the page-turning is executed. The image created in advance is temporarily stored in the page turning data storage unit 49, and the corresponding image is called and displayed when the page turning is executed. The processing of each unit will be described below according to the flow of FIG. For example, after the editing process and the like are completed and the page layout is confirmed, the page generation unit 42 generates page image data that is bitmap data of the entire page. When the entire page is a single image, the image data is used as page image data, and when multiple images and text are mixed in the page, the display data obtained by expanding each data in the page is stored in the video memory. It is generated by reading it. Next, the projective transformation means 45 performs projective transformation on the page image data. A method of generating a page-turning image including this projective transformation process will be described later. Further, the image synthesizing means 46 synthesizes the image after projective transformation and the still page image to generate a page-turning image.

Next, the page turning image is compressed by the image compressing means 47, and is stored in the page turning data storage section 49 with a file name uniquely determined from the page angle θ, the interpage angle β and the page number. As an image compression method, for example, the JPEG method (Joint Photographic Exp
erts Group: International standard image compression method) is adopted.

When the user performs page turning, the page turning control unit 40 analyzes the user's command and specifies the page angle θ, the inter-page angle β, and the page turning direction. The image decompression means 48 calls and decompresses the corresponding page turning image. The decompressed image data is continuously reproduced on the page turning display unit 44. Further, a method of compressing and storing not the page-turning image but the page-turning animation itself in the page-turning data storage unit 49 is also conceivable. As a moving picture compression method at this time, an MPEG method (Motion Picture Experts Group:
International standard video compression method) is adopted.

The configuration shown in FIG. 19 does not require image processing hardware for performing projective transformation or image synthesis in real time, and image expansion can be performed in real time only by software depending on the image compression algorithm. You can configure the system to. However, since the page-turning data storage unit 49 requires a large capacity and the page-turning image needs to be recreated after the editing process is completed, the device is configured with a large-capacity device such as a CD-ROM that is not frequently rewritten. Suitable for the system.

Next, in FIG. 20, a method is adopted in which the parts of the page-turning image are created before the page-turning is executed, and these parts are combined at the time of execution. Therefore, the connection method of each means in the page turning animation generating unit 43 and the data stored in the page turning data storage unit 49 are different from those in FIG. The page image projectively transformed by the projective transformation unit 45 is compressed by the image compression unit 47, and the page turning data storage unit 4 is stored with a file name uniquely determined from the projective transformed page angle and page number.
9 is stored. When the user performs page turning, the page turning control unit 40 analyzes the command and obtains the page number, the page angle θ, the inter-page angle β, and the page turning direction. All the relevant component images are read out, expanded by the image expansion means 48, and combined by the image combining means 46. The combined page-turning images are continuously reproduced on the page-turning display section 44. Further, a method of synthesizing an image as it is with compressed data and then expanding the image is also considered.

In the configuration shown in FIG. 20, the load on the page turning data storage unit 49 is smaller than that in the configuration shown in FIG.
Also, since only the parts need be created in the pre-processing for page turning, the time required for the pre-processing can be reduced. However, a mechanism for performing high-speed image composition at the time of page turning is required.

Further, in FIG. 21, a page-turning image is created in real time. When the user performs page turning, the page turning control unit 40 specifies the page number, the page angle θ, the inter-page angle β, and the page turning direction. In accordance with these parameters, the projective transformation unit 45 performs projective transformation on the page image, and the image synthesis unit 46 synthesizes the respective component images. The created page-turning images are continuously displayed on the page-turning display section 44. The configuration of FIG. 21 requires a mechanism for executing projective transformation at high speed. Therefore, in the projective transformation means 45, a method of reducing the load of the projective transformation process by subjecting the material data forming the page and the frame of the page to the projective transformation and synthesizing both by the image synthesizing unit 46 is also considered. To be

The method of generating the page-turning image will be described below. 23, 24, and 25 are diagrams illustrating an example of a method of generating a page-turning image. First, FIG. 23 shows an example of generating page-turning images 190 and 191 when turning pages one by one. As page images in the memory, page image 170 of N page, page image 171 of N + 1 page, and page image 1 of N + 3 page
There is 73. In order to create the page-turning image 190, first, the page image 171 is projectively transformed according to a given page angle, and the projectively transformed image 180 is combined with the page image 170 and the page image 173. At this time, the page image 173 is synthesized so as to be hidden behind the projective transformation image 180, or a partial image of the page image 173 is cut out and synthesized. Page turning image 19 in the same way
Also create 1.

Next, FIG. 24 shows an example of generating a page turning image 192 for turning a plurality of pages. As before, the page image 170 of N page, the page image 172 of N + 2 page, the page image 173 of N + 3 page, and N
A page image 175 of +5 pages and a page image 177 of N + 7 pages are created in the memory. Among these, the page image 172, the page image 173, and the page image 175 are projectively transformed at given page angles, and the projective transformed image 182, the projective transformed image 183, and the projective transformed image 184.
To create. A page turning image 192 is created by synthesizing the page image 170, the projective transformation image 182, the projective transformation image 183, the projective transformation image 184, and the page image 177. Similar to FIG. 23, the page image 170 and the page image 177 are combined so as to be hidden behind each projective transformation image, or partial images of the page images 170 and 173 are cut out and combined.

Further, FIG. 25 shows an example in which the page thickness button 26 is combined with the page turning image 193 when a page jump or a plurality of pages are scrolled at once. In this process, first, the page turning image 190 shown in FIG. 23 is created, and the page thickness button 26 is combined with one end (the position shown in FIG. 25) of the page being turned. The thickness button 26 of the page and the thickness button 25 of the book described above may be designed so as to look like the actual thickness of the book or page by inserting a vertical stripe pattern.

FIG. 22 is a flow chart of a method of generating a page turning image. First, in step 161, steps 162 to 16 are performed for each page being turned.
The projective transformation process up to 6 is executed. In FIG. 23 and FIG. 25, since only one page is turned, step 161 is completed by one loop. However, in the case of FIG. 24, since three pages are turned over at the same time, step 1
61 repeats the loop three times.

In step 162, the page angle δ for projective transformation is acquired. As shown in FIGS. 23 and 25, 1
If only the pages are turned, the given page angle θ is set as δ. On the other hand, when a plurality of pages are turned at the same time as shown in FIG. 24, the page angle δ is calculated for each page. In the case of forward turning, the page angle θ is calculated by adding the inter-page angle β by the page interval, and in the case of backward turning, it is subtracted.

For example, if FIG.
The page angle δ for projective transformation of the page image 175 is equal to the page angle θ, and the page angle δ for projective transformation of the page image 173 is θ + β obtained by adding the interpage angle β to θ,
The page angle δ for projective transformation of the page image 172 is β to θ
Is added by the interval of two pages, and θ + β * 2. vice versa,
If FIG. 24 is turned in the opposite direction, this time the page image 17
The page angle δ for projective transformation of 2 is equal to the page angle θ, and the page angle δ for projective transformation of the page image 173 is θ.
Is θ-β obtained by subtracting the inter-page angle β from, and the page angle δ for projectively converting the page image 174 is θ-β * 2 obtained by subtracting β from θ by two page intervals.

Before describing the projective transformation process from step 163 to step 166, the concept of the projective transformation process will be described with reference to FIG. The horizontal direction of the projection plane is the X axis,
When the vertical direction is the Y-axis and the vertical direction is the Z-axis, a cross-sectional view (viewed from the vertical direction) on the Y = 0 plane is shown in (A), and a cross-sectional view on the X = 0 plane (viewed from the horizontal direction). A sectional view is shown in (B). When the page 201 is projected from the light source 21 onto the projection surface 22, the image 20
You can do 2. This image 202 is the page after projective transformation. As can be seen from FIG. 26, the page width w becomes W after projective transformation, and the page height 2 * h becomes 2 after projective transformation.
* H. Also, any point (x,
y) is converted to (X, Y). The conversion from (x, y) to (X, Y) can be geometrically calculated by Equations 1 and 2. Here, k represents the distance from the light source 21 to the projection surface 22.

[0080]

[Equation 1]

[0081]

[Equation 2]

The algorithm of the projective transformation process will be described below. In step 163, as shown in FIG. 27, the coordinates of the four corners of the page after projective transformation are obtained. For example, in FIG.
Considering the case of converting the inside point 203 into the point 204, it is sufficient to substitute x = w and y = h in the equations 1 and 2. The results are shown in Equations 3 and 4.

[0083]

[Equation 3]

[0084]

[Equation 4]

In step 164, the processes of steps 165 and 166 are repeated at each point in the page after the projective transformation.

In step 165, the coordinates of each point in the page after the projective transformation in the original page are calculated.
As shown in FIG. 28, this process is an inverse transform of the projective transform process of FIG. 27, and the calculation formulas are as shown in Formulas 5 and 6.

[0087]

[Equation 5]

[0088]

[Equation 6]

In step 166, the coordinate value of the coordinate is approximated and used as the coordinate value at each point in the page after projective transformation. As a method of approximating this coordinate value, there is a nearest neighbor method in which the coordinate value of the point closest to the coordinate calculated in step 165 is used as shown in FIG. In addition, a method of proportionally dividing the coordinate values of the points surrounding the calculated coordinates and adding the coordinate values may be considered.

[0090]

[Equation 7]

After the projective transformation process, in step 167, the projective transformed image 206 and the still page images 205 and 207 are combined. At this time, the projective transformation image 206 is superimposed on the page image 207 to be synthesized. Alternatively, since the width W of the projective transformation image 206 can be calculated from Equation 3, partial images of the page image 207 may be obtained and combined as shown in FIG. 30 and Equation 8.

[0092]

[Equation 8]

Table 1 shows problems and solutions for the display method of the page turning animation.

[0094]

[Table 1]

First, the problem and solution of item No. 1 will be described. In the configuration of FIG. 19 or 20, the image data is read from the page turning data storage unit 49 when the page turning is executed. However, when the page-turning data storage unit 49 is a hard disk or an optical disk, the data reading speed from the disk is generally low, and thus page-turning images may not be continuously displayed.

For example, a page-turning image is stored on a CD-ROM.
If it is stored in the CD-ROM, the data read speed of the CD-ROM is about 150 KB / sec at most (when not in the double speed mode).
Since there is only one, it is impossible to read out the page turning image data of 100 KB per sheet in real time. Therefore, paying attention to the fact that the resolution of the moving image during page turning may be lowered, the page turning image data is stored at a high compression rate to reduce the load when reading from the disk. In general, we do not look at every corner of a book as we turn it over, so we can display page-turning images at a resolution that gives a good impression of the page.

FIG. 31 shows a data flow in the page turning display control device. The page-turning data storage unit 49 stores two types of image data, page-turning image data 210 and a high-definition page image data 211 whose compression rate is increased to reduce the capacity. When turning pages (Fig. 3
In 1 (B), the page-turning image data 210 is read. When the page turning is stationary ((A) in FIG. 31), the page image data 211 is read in order to switch the screen from a low-resolution blurred image to a high-definition image. At this time, in order to prevent the user from being aware of this switching, it is possible to prepare a high-definition image in the memory in advance. Further, in consideration of the trade-off between the animation display speed and the display resolution, the page-turning image data 210 may be divided into a plurality of compression rates and stored in the page-turning data storage section 49.

Next, the problem and solution of item No. 2 will be described. The page turning image data 210 read from the page turning data storage unit 49 is expanded by the image expanding means 48. When transferring the image data 213 after the image expansion to the page turning display unit 44, this time, the data bus 21
4 becomes a transfer neck. For example, when the page turning display control device is composed of a normal personal computer,
Since the transfer speed of the data bus 214 is at most about 1 MB / sec, it cannot be said to be a sufficient speed to transfer the image data 213 which has returned to 100 KB after the image expansion. Therefore, as shown in FIG. 31B, the image expanding means 48 and the page turning display section 44 are connected by a high-speed dedicated data bus 215. This makes it possible to continuously display page-turned images at high speed. Furthermore, when the page turning is stationary ((A) of FIG. 31) and when the page turning is executed (FIG. 3).
The existing data bus 214 and the dedicated data bus 215 are selectively used in order to smoothly perform the switching of 1 (B)). As a result, the user is less likely to notice that the screen is switched between a low resolution image and a high definition image.

[0099]

According to the present invention, when the page turning speed requested by the user exceeds a predetermined visual limit speed, the page rotation speed remains fixed and the angle between pages is gradually reduced. It is possible to display a plurality of pages at one time at a rotation speed at which the contents of the page can be visually recognized. As a result, even if the page turning speed exceeds the visual recognition limit speed, the search efficiency is improved.

Further, according to the present invention, in addition to the animation for rotating the page, the width changes depending on the page thickness corresponding to the number of pages the user wants to turn at the same time and the page number currently displayed. Since the thickness of the book is displayed, there is an effect that the user is provided with a visual effect similar to a book familiar in the real world, and as a result, affinity is increased.

Further, according to the present invention, the user can perform the page turning operation by pointing or dragging the thickness of the book with a pointing device such as an electronic pen, so that the user puts a finger on the thickness of the book in the real world. There is an effect that the user is given an operation feeling similar to the turning operation while adjusting the direction and speed, and as a result, the affinity is increased.

Further, according to the present invention, two or four input means are provided on the left, right, upper left and lower right of the case surrounding the display device, and page turning is performed based on the input from the two or four input means. To do. Since this physically mimics the operation that the user is familiar with in the real world, it is possible to provide an easy-to-use operation that suits the user's intuition.

[Brief description of drawings]

FIG. 1 is an explanatory diagram showing an appearance and a basic configuration of a page turning display control device according to the present invention.

FIG. 2 is an explanatory diagram showing an example of a page turning display according to the present invention.

FIG. 3 is an explanatory diagram showing the principle of page turning display according to the present invention.

FIG. 4 is a process flow chart showing a main process of the page turning display control device according to the embodiment of the present invention.

FIG. 5 is a process flow chart showing a page turning process by a book thickness button according to an embodiment of the present invention.

FIG. 6 is a processing flowchart showing page jump processing according to an embodiment of the present invention.

FIG. 7 is a process flow diagram showing a page scroll process according to an embodiment of the present invention.

FIG. 8 is a process flow chart showing a page turning process by a bidirectional button switch according to an embodiment of the present invention.

FIG. 9 is a diagram showing an example of a display screen of the page turning display control device according to the embodiment of the present invention.

FIG. 10 is an explanatory diagram showing an operation example of page turning processing using a book thickness button according to an embodiment of the present invention.

FIG. 11 is an explanatory diagram showing an operation example of page jump processing according to an embodiment of the present invention.

FIG. 12 is an explanatory diagram showing a page jump process by a keyword search and a table of contents search according to an embodiment of the present invention.

FIG. 13 is an explanatory diagram showing an operation example of page scroll processing according to the embodiment of the present invention.

FIG. 14 is an explanatory diagram showing an operation example of page turning processing by a bidirectional button switch according to an embodiment of the present invention.

FIG. 15 is a graph showing an example of the relationship between the pressing time of the book thickness button and the page turning speed according to the embodiment of the present invention.

FIG. 16 is a graph showing an example of the relationship between the page turning speed, the page angular speed, and the angle between pages according to the embodiment of the present invention.

FIG. 17 is an explanatory diagram showing a method of obtaining a page angle from a cursor position according to an embodiment of the present invention.

FIG. 18 is a processing flowchart of generation and display of a page turning animation according to an embodiment of the present invention.

FIG. 19 is an explanatory diagram in which the basic configuration of FIG. 1 is rewritten according to the flow of processing for generating a page-turning animation.

FIG. 20 is an explanatory diagram in which the basic configuration of FIG. 1 is rewritten according to another processing flow for generating a page-turning animation.

FIG. 21 is an explanatory diagram in which the basic configuration of FIG. 1 is rewritten according to the flow of yet another process for generating a page-turning animation.

FIG. 22 is a processing flowchart showing a page-turning image generation process according to an embodiment of the present invention.

FIG. 23 is an explanatory diagram showing a page-turning image generation process when turning pages one by one according to an embodiment of the present invention.

FIG. 24 is an explanatory diagram showing a page-turning image generation process when a plurality of pages are turned at the same time according to an embodiment of the present invention.

FIG. 25 is an explanatory diagram showing a process of generating a page thickness image and a page turning image according to an embodiment of the present invention.

FIG. 26 is an explanatory diagram of the principle of the projective transformation process of the present invention.

FIG. 27 is an explanatory diagram showing a calculation method of projective transformation processing according to an embodiment of the present invention.

FIG. 28 is an explanatory diagram showing a calculation method of projective transformation processing according to an embodiment of the present invention.

FIG. 29 is an explanatory diagram showing a calculation method of projective transformation processing according to an embodiment of the present invention.

FIG. 30 is an explanatory diagram showing a calculation method of projective transformation processing according to an embodiment of the present invention.

FIG. 31 is an explanatory diagram showing a data flow in the page turning display control device according to the embodiment of the present invention.

FIG. 32 is an explanatory diagram showing the effect of the present invention.

FIG. 33 is an explanatory diagram showing a typical example of page turning display in the conventional technique.

FIG. 34 is an explanatory diagram showing another typical example of the page turning operation in the conventional technique.

[Explanation of symbols]

21 ... Light source, 22 ... Projection plane, 25 ... Book thickness button, 2
6 ... Page thickness button, 27 ... Page scroll button, 29 ... Cursor, 30 ... Appearance of page turning display control device, 31 ... Bidirectional button switch, 32 ... Electronic pen, 33 ... Display surface, 34 ... Bidirectional button switch Operation example by.

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification number Office reference number FI technical display location 9071-5L G06F 15/62 340 K

Claims (20)

[Claims] 1. A device for displaying information page by page in the form of a book on a display device and displaying an animation for rotating the page when turning the page, and detecting a page turning speed required by a user. Means, means for automatically setting the rotation speed of the page and the angle between the pages based on the comparison result of the page turning speed and the predetermined visual limit speed, and the page from the rotation speed and the angle between the pages. And a means for creating an animation for rotating the page. 2. The page turning speed is compared with the visual limit speed, and when the page turning speed is within the visual limit speed, the rotation speed increases in proportion to the page turning speed and the inter-page angle is π. The page turning display according to claim 1, wherein the page speed is fixed at radians, and conversely, when the page turning speed exceeds the visual limit speed, the rotation speed is fixed and the interpage angle gradually decreases from π radians. Control device. 3. A means for detecting the number of pages that the user wants to turn at the same time, and a means for creating the thickness of the page according to the number of pages are provided, and the thickness of the page is displayed in accordance with the animation of rotating the page. 3. The page turning display control device according to claim 1 or 2, characterized in that. 4. A means for displaying the thickness of the book and a means for the user to drag the thickness of the book with a pointing device are provided, and the number of pages to be turned at the same time within the thickness of the book from the position where the user started dragging is determined. 4. The page-turning display control device according to claim 3, wherein the page-turning direction is calculated and the page-turning direction is set from the dragging direction. 5. A means for displaying the thickness of a book on the left and right of a page arranged in a two-page spread type and a means for the user to point the thickness of the book are provided, and the user points within the thickness of either the left or right book. The page turning speed is calculated from the position, and when the user points the right side thickness, the direction of the page turning is set to the forward direction, and conversely, when the left side thickness is pointed, the direction is set to the reverse direction. The page turning display control device according to any one of claims 1 to 4. 6. A device for displaying information on a page-by-page basis in the form of a book on a display device, wherein the thickness of the book is displayed on the left and right sides of a two-page spread type page, and a user displays the thickness of the book. A means for pointing, a means for calculating the page turning speed from the position pointed by the user within the thickness of the left or right book, and a direction for turning the page forward when the user points the thickness on the right side, On the contrary, the page turning display control device is provided with means for setting the left side thickness in the opposite direction when pointing. 7. The page turning according to claim 5 or 6, wherein the pointing state within the thickness of the book is detected every certain time, and the page turning speed is changed according to the pointing state. Display controller. 8. The page turning display control according to claim 7, wherein the position of pointing within the thickness of the book is detected every certain time, and the page turning speed is changed according to the change of the pointing position. apparatus. 9. The page according to claim 7, wherein the user detects the duration for which the user continues to point within the thickness of the book every certain time, and increases the page turning speed in proportion to the pointing duration. Turning display control device. 10. The page turning display control device according to claim 4, wherein the thickness of the book is changed according to the page turning. 11. A means for detecting a change in the direction and speed of page turning requested by the user while the page is being rotated, and when the page turning end request is detected during the page rotation, the page is gravitated. The page-turning display control device according to any one of claims 1 to 4, wherein an animation of falling according to the above is displayed. 12. A means for dragging a part of a book with a pointing device is provided, a change in page turning direction and speed is detected from a drag operation, the page is rotated in synchronization with the drag operation, and after the drag is completed. 12. The page-turning display control device according to claim 11, wherein an animation in which a page in the middle of rotation falls due to gravity is displayed. 13. A storage device for temporarily storing an animation for rotating a page generated in advance,
6. The page turning display control device according to claim 1, further comprising image compression means and decompression means, wherein the animation is compressed and stored in the storage device. 14. An image compression means and an expansion means can change a compression rate, and an animation read from a storage device at the time of page turning has a higher compression rate than an image displayed when the page turning is stationary. The page-turning display control device according to claim 13. 15. The method according to claim 13, wherein there are provided two types of paths from the image expansion means to the display device, a path for transferring a high-definition still image and a path for transferring a page-turning animation at high speed. Item 14. A page turning display control device according to item 14. 16. A device for displaying information registered in a storage device on a page-by-page basis in the form of a book on a display device, wherein two input means are provided on the left and right sides of a case enclosing the display device. A page-turning display control device characterized by executing a page-turning based on an input from an input means. 17. A page turning in the forward direction is executed when an input from an input means provided on the right side of the case surrounding the display device is detected, and a page turning in the reverse direction is performed when an input from the input means provided on the left side is detected. The page turning display control device according to claim 16, which is executed. 18. A device for displaying information registered in a storage device on a page-by-page basis in the form of a book on a display device, wherein four input means are provided on the left, right, top and bottom of a case surrounding the display device, A page-turning display control device, which executes a page-turning based on inputs from four input means. 19. A forward page turning is executed when an input from an input means provided on the upper right side of a case surrounding a display device is detected, and a reverse direction is detected when an input from an input means provided on the left upper side is detected. When the input from the input means provided on the lower right side is detected, the page is turned in the opposite direction, and when the input from the input means provided on the lower left side is detected, the page is turned in the forward direction. The page turning display control device according to claim 18, which is executed. 20. The state of each input means is checked every certain time, and while the input is continued, the page turning is continuously executed regardless of the position of the input means where the input is detected, and the page is proportional to the input continuation time. 20. The page turning display control device according to claim 16, wherein the turning speed is increased.