JP3359948B2 - Document presentation device and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a document presenting apparatus and method for automatically turning a document.

[0002]

2. Description of the Related Art In recent years, computers have been used for various aspects of music, such as automatic performance of musical instruments, reading of musical scores, creation of a music database, composition and arrangement. Especially for electronic musical instruments, MIDI (Musical Instrument Digital Interfa
ce) It is standardized and the exchange of performance information is common. A plurality of performance supports for MIDI musical instruments have been commercialized, and there are systems for presenting musical scores and accompanying accompaniments following performances. Many electronic keyboards have a teaching function of indicating the position of a key to be played next with an LED.

[0003] However, acoustic instruments to which MIDI is not applied still exist. There is known a system for storing and reproducing performance information, such as an automatic piano performance system, for practicing such non-electronic musical instruments or for demonstration performance. There is no system for presenting.

[0004] Therefore, as in the past, the player has no choice but to look at the score of the paper or to perform the memorization. When turning the score, if the music is continuous, the performance must be interrupted and broken. It is easy for the score to be damaged, torn, to be turned over, or for the score to fall. Also, depending on the place where the performance is performed and the eyesight of the performer, the score may be difficult to see, which is a psychological and physical burden on the performer.
In addition, there is a practice in which a person other than the performer turns a page and turns the page only when accompaniment is performed with another instrument on the piano. The psychological burden of is large.

Recently, a technique has been developed which extracts performance information from recorded performance data and associates the information with a recognition result of a printed musical score. As a relatively easy method using such a technique, it is possible to extract a pitch from performance data and associate it with a musical score.

[0006] However, these techniques are still insufficient in accuracy, and often occur during actual performance or practice, such as errors, omissions, ad-libs, when starting a performance from the middle of a song, or repetition at an arbitrary position. And so on. For example, in the case of a song in which exactly the same phrase appears many times, it is impossible to specify the position of the score only by the performance data. Attempts to solve these problems would be large and expensive, and would not replace paper music.

On the other hand, when turning to a general material presenting apparatus, it is considered that a page turning instruction is given using various types of interfaces, such as a keyboard, a mouse, a pen, a touch panel, a remote controller, a foot pedal, and voice recognition. Have been.

However, in a nervous situation where time delay is not permissible, both hands cannot be used and it is not possible to give a command aloud,
In situations where the foot pedal is also difficult to use, the above interface is not sufficient.

For example, in the case of broadcasting, theater, music studios, etc., voices communicate with other rooms, such as instructing lighting, stage equipment, sound effects, sound mixing, camera switching, and the like. It is thought that there are cases where it is difficult to operate the foot pedal because both hands are dark and the feet are dark and there is no room to turn the script page, and the TV announcer is facing the camera and the script It is possible to turn the document at hand, but in any case, the conventional page turning instruction method is insufficient.

Similarly, recently, the number of presentations at customer sites and conferences has been increasing, but the operation of OHP and video has become a heavy burden for nervous presenters (presenters). Of course, it is unsightly for the audience, and the break in the conversation hinders interest in the presentation. When there is an operator other than the presenter such as a slide, an instruction is given to the operator using the voice of the presenter, but it is still hard for the audience to hear. Often, there is no time to rehearse at the venue,
The timing desired by the presenter is not transmitted to the operator, and mistakes are likely to occur when switching slides.

Recently, a computer such as a personal computer and a monitor are prepared near the presenter, and the same display screen as the monitor is projected on the screen to turn pages of the presentation material, and to play, interrupt, rewind, and fast-forward the video. There is also a presentation device for giving instructions such as using a mouse or the like. For a presenter who is a computer, OH
It is less burdensome than replacing P or operating the video remote control. However, the burden on general presenters may increase. In the case of using a computer, an accurate operation cannot be performed unless the computer is located in front of a monitor or a screen at hand. Operation tools such as a mouse take up space and cannot be carried around freely. For this reason, the presenter must give a presentation while sitting in front of the computer,
The radius of action becomes extremely small. In order to make use of the presenter's own expressiveness, he must be able to move around freely during the presentation.

Further, if the computer explicitly interrupts between the presenter and the audience, a problem arises that it is difficult to establish a close relationship with the audience. The presenter is so immersed in the operation of the computer that he or she is indifferent to the state of the audience, and the audience is so concentrated on the presentation screen of the computer that the interest in the presenter's own words is lost. Aside from a two-way communication function, a direct communication should be the primary purpose when the presenter and the audience are actually present. The presence of the computer must not be more prominent than the presenter. For that purpose, an interface that makes both the presenter and the audience unaware of page turning instructions is indispensable. At present, there is no presentation device that solves such a problem.

[0013] Attempts to utilize the viewpoint position calculated from the position and orientation of the human head as input information of a computer have been made in fields such as real-world meetings, virtual reality, and remote monitoring. ing. By associating the actual viewpoint position with the viewpoint position in the space displayed on the display, the display content can be changed by a natural operation such as swinging. However, these are inadequate for page turning instructions because of their low accuracy and large equipment. As a highly accurate method, there is a method of directly calculating a viewpoint position from eye movement or the like. In order to indicate an object displayed on a display or an icon indicating a specific operation, there is a system in which a user stares at the object for a certain period of time. However, human viewpoint control is often performed unconsciously, especially in extreme situations where both hands cannot be used. It cannot be an instruction interface.

[0014]

As described above, the material presenting device is used to turn over a musical score when playing a musical instrument, turn over a script when producing a performance in a broadcast, theater, music studio, or the like. For various uses, such as turning pages of presentation materials projected on the screen at the time of presentations at meetings and conferences, etc., it is considered that there are materials that turn pages properly according to these uses. At present, there is no one that is sufficiently satisfactory for users.

The present invention has been made in view of the above circumstances, and has as its object to provide a material presenting apparatus and method capable of presenting materials while properly turning pages.

[0016]

According to the present invention, there is provided a material presenting apparatus for storing page content data, page control data which is the order and location of the page content data, and the storage means. Display means for displaying the page content data stored in the storage device, gazing point detecting means for detecting a position and time at which the user gazes at the display means, and user action detection for detecting the action of the user Means, a user action detected by the user action detecting means, and a page turning determination for instructing page turning of page content data based on the user's gaze position and time detected by the fixation point detecting means. Means and means for displaying each page content data for the display means in accordance with page control data stored in the storage means, based on a page turning instruction by the page turning determination means. Characterized by comprising a page data presentation means for.

According to the present invention, there is provided a material presentation method for presenting page content data to display means based on page control data which is a presentation order and a presentation position of the page content data.
A gaze position and time of the display means by the user are detected, and the behavior of the user is detected. Based on the detected behavior of the user and the detected gaze position and time of the user, the page turning data of the page content data is detected. Is generated, and based on the page turning instruction, each page content data is displayed on the display means in accordance with the page control data.

[0018]

[0019]

As a result, according to the present invention, the timing of turning pages can be automatically determined from the user's point of regard and the history of actions, so that even when both hands cannot be used, such as when playing a musical instrument, By switching pages at appropriate timing, the physical and psychological burden associated with the user's page turning operation can be reduced.

[0020]

[0021]

An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows a schematic configuration of the embodiment. Here, an example is shown in which the present invention is applied to an electronic musical score which enables a musical score to be turned when playing a musical instrument.

In the figure, reference numeral 11 denotes a data input unit, which is constituted by an FD drive or the like, and stores actual data of page contents (score data for each page), song titles, and the order relation of each page. Data (page control data), etc.
For example, the data is read from a 3.5-inch floppy disk (FD). The data read by the input unit 11 is sent to a storage unit 12 such as a hard disk. The storage unit 12 stores the page content data storage unit 1
21, a page control data storage unit 122, and a history storage unit 123.

Here, the page content data storage section 121 stores the actual data of the page content (score data for each page) provided from the input section 11, and the page control data storage section 122 is provided from the input section 11. Data (page control data) such as a song title and the order relation of each page is stored. The history storage unit 123 receives outputs from the user action extraction unit 17, the point of interest detection unit 18, the page turning instruction detection unit 15, and the page data presentation unit 13, and outputs the user's action and point of interest, page turning instruction, and the like. , The page turning instruction information of the user and the information indicating whether or not the user is performing music are associated with each other, and a history of page operations is stored.

Outputs from the page content data storage unit 121 and the page control data storage unit 122 of the storage unit 12 are as follows:
The page control data storage unit 12
2 and the output from the history storage unit 123 are sent to the page turning determination unit 16.

The page turning determining section 16 is provided with user page turning instruction information given through the page turning instruction detecting section 15, page control data of the page control data storage section 122 of the storage section 12, and history information from the history storage section 123. Then, it is determined which page is to be presented at which timing at which timing.

The page data presenting section 13 is based on the page control data of the page control data storage section 122 and the page turning information sent from the page turning determining section 16, and displays the page contents of the page content data storage section 121 to be displayed next. The data is sent to the display unit 14. The display unit 14 displays the page content data sent from the page turning determination unit 16 at a designated position.

The user action extraction unit 17 detects whether the user is playing a musical instrument based on the current action of the user.
The gaze point detection unit 18 detects a position on the display where the user is currently gazing, and detects information such as a time at which the user started gazing and a duration time. FIG.
This shows the appearance of an electronic musical score configured as described above.

In this case, reference numeral 20 denotes an electronic musical score main body. The electronic musical score main body 20 has a folding structure of A4 × 2 sheets and has a thin display 21 capable of simultaneously displaying two pages as the display section 14. ing. In this case, the external appearance of the electronic musical score main body 20 is not limited to the shape shown in FIG.

At the top of each display 21 of the electronic musical score main body 20, a small camera 24 of the gazing point detecting unit 18 is provided. In this case, as shown in the figure, if the apparatus is provided separately on the left and right pages, a device for emitting a weak laser beam on the left and right and a small camera can be prepared to detect which page is being watched. Then, information on which page has been watched and for how long is sent to the history storage unit 123 described above.

A built-in microphone 23 of the user action detection unit 17 is provided above one display 21 of the electronic musical score main body 20. In this case, the built-in microphone 23 collects surrounding acoustic data, and determines the current state of the user, such as whether or not the user is performing, depending on whether or not performance data of the target musical instrument is included. Then, the current state information of the user is sent to the history storage unit 123 described above.

A page turning key 22 is provided below each display 21 of the electronic musical score main body 20. The page turning key 22 enables a manual turning operation when a hand can be used.

The data input to the data input unit 11 of FIG. 1 is, for example, character information 31 such as the title of a musical score and the name of a composer of each musical score shown in FIG. Chord data (or image data) of the score body 32
And music score structure data 33 indicating the presentation order of the page data of each song shown in FIG.
The music score of the desired music is stored in an inch floppy or the like, and the user selects the music title, etc.
And into the page control data storage unit 122.

When the new musical score data is read into the storage section 12, the page data presentation section 13 uses the presentation order data from the page control data storage section 122 to store the page content storage section 121.
Is read out from the top of the score main body stored in the first page, and the first page is displayed on the left side and the second page is displayed on the right side as an initial state as shown in FIG. Will be displayed. These display states are stored in the history storage unit 1.
23 and stored.

Here, when the user wants to view the next page, if the user can use the hand, the user can perform the page turning operation by hand. In this case, the page turning key 22 shown in FIG. 2 is operated. Then, page turning information is given from the page turning instruction detecting unit 15 to the page turning determining unit 16, and based on this information, the page content data of the page content data storage unit 121 to be displayed next is displayed on the display unit 14. .

FIGS. 5 (a), 5 (b), 5 (c) and 5 (d) show specific examples of the display provided on the page turning key 22, and FIG. 5 (a) shows the display according to the page turning direction. The arrow 51, FIG. 4B shows an icon 52 showing the state of turning the page, and FIG. 4C shows a simulated display 53 showing the state of the lower part of the page where the key itself is broken. In the parentheses (), a key display 54 is arranged one set at the bottom of the right page and at the bottom of the left page, so that the page can be easily turned by either the left or right hand.

When these keys 22 are depressed, two pages can be turned at the same time as in the case of turning over pages of paper. That is, the next key and the next page are displayed on the right and left keys, respectively, and the next and previous pages are displayed on the left and right pages, respectively.

FIG. 4C shows the state of the display unit 14 after the right page turning key 22 shown in FIG. 22 is pressed. The third page is displayed on the left page, and the fourth page is displayed on the right page.
In this case, only the left page may be rewritten first (FIG. 4B), and after a short time, the right page may be rewritten (FIG. 4C). It is also possible to change the time setting during this time.

It is also possible to turn only one page. In this case, a key for turning only one page may be separately prepared. In this case, when the left page is turned, a state as shown in FIG. 4B is obtained, and when an instruction to turn the page only on the right page is given, the state shown in FIG. 4C is obtained. Then, the page turning operation in these manual operations and information on which page is currently being displayed by that operation are sent to the history storage unit 123 and stored. While the user is playing the instrument, automatic page turning is mainly performed. The operation of the page turning determining unit 16 for realizing automatic page turning in this case will be described with reference to FIG.

Now, it is assumed that the score is composed of a total of four pages, and the display section 14 initially displays the score of the first page on the left page and the second page on the right page as shown in FIG. It shall be displayed.

First, the page turning judgment unit 16 looks at the page after the page currently displayed from the history storage unit 123, compares this page with the data in the page control data storage unit 122, and presents it next. Determine whether pages remain (step 6)
1). In this case, since the latest page to be displayed is the second page, two pages to be presented remain.

Next, the current state of the user is determined by the user action detector 17 (step 62). in this case,
The acoustic data collected by the built-in microphone 23 as shown in FIG. 2 is analyzed, and it is determined whether or not the user is performing based on whether or not the performance data of the target musical instrument is included. Then, the result of detection as to whether or not the performance is being performed is stored in the history storage unit 123. If the performance is not being performed, the state of step 62 is held until the performance starts.

When the user is performing, the time during which the performance has been continued (continuous performance time) is stored in the history storage unit 123.
Calculated from the data of If the continuous performance time exceeds the reference time A seconds, the process proceeds to the next step 64, and if not, the process returns to the step 62 (step 63).

In this state, the gazing page is detected by the gazing point detector 18. In this case, the small camera 24 shown in FIG. 2 detects which page has been watched for what time and for how many seconds, and this detection information is sequentially sent to the history storage unit 123 and stored.

Here, the gaze state is defined as that which time point of view remains on one of the pages, and it is not determined that the user gazes for a very short time. In other words, cases that are seen for a quick check are omitted.

Thus, if the performance starts and the continuous performance time exceeds A seconds, the previous page (the first page in this case) being displayed is finally changed using the point-of-interest history information up to the present. Calculate how much time has passed since the gaze (non-gaze time). And the non-gaze time is the reference time B
If it exceeds the second, the process proceeds to the next step 65, and if not, the process returns to the step 62 (step 64).

If the non-gaze time for the previous page exceeds B seconds, the total gaze time for the latest displayed page (in this case, the second page) is stored in the gaze point of the history storage unit 123. Calculation is performed using the history information, and the total time is compared with the reference time C seconds (step 65).

Here, if the total time exceeds C seconds,
An instruction is sent to the page data presenting unit 13 to display the page data to be displayed next for the display position of the previous page (step 66). On the other hand, if it does not exceed, the non-gazing time to the latest page is calculated and compared with the reference time D seconds (step 6).
7) If the time exceeds the reference time D, an instruction to rewrite the previous page is output. If not, the process returns to step 62.

In the page data presenting section 13, when an instruction to rewrite the previous page is given from the page turning determining section 16, the left page displaying the data of the first page is rewritten to the data of the third page in accordance with the instruction. ((B) of FIG. 4). When the performance continues, the point of gaze moves to the third page, and the non-gaze time for the second page elapses B seconds, the right page is rewritten to the fourth page.

Thus, while the user is playing the musical instrument, the first to fourth pages of the musical score are automatically turned over according to the detection information from the user action detecting section 17 and the gazing point detecting section 18. Become.

If such a history of performance is stored together with the score data, even when automatic page turning does not work well, the turning timing can be learned manually.

In this case, after the performance, page turning timing data as shown in FIG. 7 is cut out from the contents of the history storage unit 123 and stored as additional information of the page control data. Also, using the stored page turning timing data, it is possible to turn the page at the same timing as the previous time from the start to the end of the performance.

In this case, as shown in FIGS.
An editor for editing page turning timing data can be provided, and only pages for which automatic page turning does not work can be designated to turn pages at a predetermined time.

For example, when a “timing” button 81 is pressed as shown in FIG. 8A, as shown in FIG.
A list of page turning timing data corresponding to the currently displayed musical score is displayed.

When the cursor button 82 is pressed from such a list, for example, the cursor position indicated by oblique lines moves up and down. In this example, a message 80 for guiding the operation is displayed at the bottom of the screen.

When the cursor is moved to the position of the desired timing data in accordance with the message and the select button 83 is pressed, the timing data is displayed as shown in FIG. In this example, the operation of manually turning a page has a hand-shaped mark.

Here, as shown in FIG. 9B, the cursor position indicated by oblique lines is set to "manual page turning" 84, and
When the above selection button 83 is pressed, a change screen 89 is displayed. Then, when the cursor is moved to “time” 85 on the change screen 89 and the select button 83 is pressed, the time can be changed. After changing the time, the user presses the select button 83, moves the cursor in the same manner, and selects the "operation" 86 shown in FIG. 10A. The operation is changed from "manual" to "timing". Will do. In addition, although it was an operation to turn the pages at the same time manually,
By selecting the “right page” 87 in FIG. 10B, the right page can be left unchanged.

Finally, "change" 88 shown in FIG. 10C is selected to complete the data change. Similarly, it is possible to specify that all the pages are turned in time. By storing the edited timing data together with the page control data in this way, it can be reused. Next, it is possible to write memo information, such as speed and performance method instructions, on the musical score during the practice in the same manner as on a musical score. In this case, for example, an input is made using an input device such as an electronic pen, and the input is stored together with the musical score data.

FIG. 11 shows a screen for instructing a method for presenting chords such as memo information, note names, and dynamic symbols prepared in advance. Also, on this screen, it is possible to specify a performance support function such as displaying only a part of the memo information, blinking the dynamics symbol, and changing the color.

FIG. 12 shows a display example in which memo information 121 is written in a musical score. In this case, instead of FIG. 11, the memo information 131 may be directly displayed as shown in FIG. 13, and the presence / absence of the display and the display method may be designated. In addition, if a display scale is specified, it is possible to zoom in on a complicated portion of a musical score or a person with insufficient visual acuity. Next, another embodiment of the present invention will be described. In another embodiment, the above-described method of turning pages of a musical score is applied to a presentation material presenting apparatus.

In this case, the action of the user is detected not by the performance data of the musical instrument but by the speech to be given. Also,
As shown in FIG. 14, two monitor screens 141 and 142 are prepared for the presenter. Monitor 14 in this case
Reference numerals 1 and 142 are, for example, large enough to be spread on a desk, and characters can be seen while standing.

The pages of the monitors 141 and 142 of the presenter are turned in the same manner as the score. And
For the audience, the same display as one of the presenter's monitors 141 and 142 is projected on the screen 143. However, switching of the data to be projected on the screen 143 is as follows.
Instead of synchronizing with the page turning of the monitors 141 and 142, the data of the monitors 141 and 142 which the presenter watches continuously for a certain reference time (E seconds) is shown.
Next, the operation will be briefly described.

In this case, when the presenter gazes at the left monitor 141 for E seconds in FIG.
In the display of No. 3, the same material as the left monitor 141 is presented. Next, as shown in FIG. 6B, when the presenter gazes at the right monitor 142 for E seconds, the display on the screen 143 is switched to the same second material as the right monitor 142.

In the meantime, the presenter may look at the left monitor 141, the audience, or the screen 143. If less than E seconds, the presenter may glance at the right monitor 142 for confirmation, or freely. It is also possible to move around.

After the state of FIG. 14 (b) is reached, the reference time is set to C seconds and the left monitor 141 is displayed on the left monitor 141 as shown in FIG. 3 is displayed, and if the left monitor 141 is gazed at for E seconds or more, the display on the screen 143 is switched to that of the left monitor 141 as shown in FIG.

In this way, when presenting a new material to the audience, the presenter always looks closely at the new material, so that the material to be presented can be switched very naturally. However, if the reference time E is too long, the switching is delayed, and if the reference time E is too short, malfunctions increase, so that it is necessary to be able to change the time for each presenter. Next, another embodiment of the present invention will be described.

FIG. 16 shows a schematic configuration of another different embodiment. In the figure, reference numeral 161 denotes a scanner for reading an original 160. Image data read by the scanner 161 is stored in an image data storage unit 1 of a storage unit 162.
621 is written. If the document 160 covers a plurality of pages during this image reading, the page data is stored in the page data storage unit 1622.

The image data stored in the image data storage unit 1621 is not subjected to code conversion (recognition), but the position information of the character (for example, how many lines or how many characters) is stored in the character position detection unit 163. Is detected by

On the other hand, reference numeral 168 denotes a keyboard, from which text written on the document 160 is input as kana information. The input kana information is provided to a kana-kanji conversion unit 169, where the kana-kanji conversion is performed with reference to the dictionary 170, and the same contents as the text of the document 160 are stored in the code data storage unit 1623 as code data.

The cursor position indicating the input position of the code data input from the keyboard 168 is detected by the cursor position detector 167. Then, based on the input position of the code data of the cursor position detection unit 167, the scroll instruction unit 166 outputs a display area change or page break information according to the input amount of the code data, and sends a scroll instruction to the data presentation control unit 164. Given as information.

The data presentation control unit 164 receives the data content of the image data storage unit 1621 and the data content data of the code data storage unit 1623, and displays these data on the display unit 165. The display unit 165 displays data from the image data storage unit 1621 and the code data storage unit 1623 in a scanner image area A and a word processing character area B prepared on the same screen as shown in FIG.

In this state, the code data storage unit 1623
Is compared with the number of characters (data amount) detected by the character position detection unit 163, and an image data portion corresponding to the data in the code data storage unit 1623 is displayed in the area A. . That is, the display unit 1
The display in the area A is changed so that the image data of the image data in the area B at 65 is optimally viewed by the user.

Accordingly, in this manner, an image area A obtained by scanning a handwritten document and an area B for displaying data input by a word processor can be displayed on the same screen. In other words, the feature is that the manuscript can be viewed on the display screen together with the word processor input, and the area A scrolls according to the amount of word processing data input by the user, and the area A can be easily viewed according to the user input data. Will move and break the page. For example, if there is an undisplayed part in the same line, move (scroll) left or right, or if there is an undisplayed line on the same screen, scroll up and down,
Also, a page break is performed for the next page.

In the above description, the code data display area B input by a word processor is displayed side by side with respect to the display area A of the scanner image data on the display unit 165. However, the scanner image data and the code data are displayed in two rows. May be displayed. The present invention is not limited to the above-described embodiment, and can be appropriately modified and implemented without changing the gist.

[0074]

According to the present invention, the timing of turning pages can be automatically determined from the user's point of regard and the history of actions, so that even when both hands cannot be used, such as when playing a musical instrument, the present invention is applicable. Switching pages at the right time makes it possible to turn the page naturally, causing eye strain even when compared with the conventional method of detecting the position of the viewpoint, which has to look at a specific position on the screen. Difficult
It is possible to reduce the physical and psychological burden associated with the user's page turning operation. In particular, when used as electronic musical scores, the burden of managing and transporting printed musical scores is greatly reduced. Further, if the present invention is applied to a presentation device, there is also an advantage that the presenter and the audience can concentrate on the content of the presentation without being bothered by the page turning operation.

[0075]

[Brief description of the drawings]

FIG. 1 is a diagram showing a schematic configuration of an embodiment of the present invention.

FIG. 2 is a diagram showing an appearance of one embodiment.

FIG. 3 is a diagram showing an example of input data.

FIG. 4 is a diagram showing a change in a display state due to page turning.

FIG. 5 is a view showing a display example of a page turning key.

FIG. 6 is a diagram showing a flow of processing of a page turning determination unit.

FIG. 7 is a diagram showing an example of page turning timing data.

FIG. 8 is a diagram showing an example of an editor for editing page turning timing data.

FIG. 9 is a view showing an example of an editor for editing page turning timing data.

FIG. 10 is a diagram showing an example of an editor for editing page turning timing data.

FIG. 11 is a diagram showing an example of an instruction screen of a memo information presentation method.

FIG. 12 is a diagram showing a presentation example of memo information.

FIG. 13 is a diagram showing a presentation example of memo information.

FIG. 14 is a diagram showing an example of application to a presentation material presenting apparatus according to another embodiment of the present invention.

FIG. 15 is a diagram showing an example of application to a presentation material presenting apparatus.

FIG. 16 is a diagram showing a schematic configuration of another different embodiment of the present invention.

FIG. 17 is a diagram showing an example of a display screen.

[Explanation of symbols]

11 data input unit, 12 storage unit, 121 page content data storage unit, 122 page control data storage unit, 123 history storage unit, 13 page data presentation unit, 14 display unit, 15
... Page turning instruction detecting section, 16 ... Page turning determining section, 17 ...
User action extraction unit, 18: fixation point detection unit, 20: electronic score body, 21: display, 22: page turning key, 2
3: Built-in microphone, 24: small camera, 141: monitor,
142 monitor, 143 screen, 160 manuscript,
161, an image data storage unit; 162, a storage unit;
21 ... image data storage unit, 1622 ... page data storage unit, 1623 ... code data storage unit, 163 ... character position detection unit, 164 ... data presentation control unit, 165 ... display unit
167: Cursor position detector, 168: Keyboard, 1
69 ... Kana-Kanji conversion unit, 170 ... Dictionary.

────────────────────────────────────────────────── ─── Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI G09G 5/00 530 G09G 5/00 530T G11B 27/00 G11B 27/00 E (56) References JP-A-4-302381 (JP) JP-A-4-282129 (JP, A) JP-A-4-15772 (JP, A) JP-A-3-173000 (JP, A) JP-A-2-194470 (JP, A) 4-45489 (JP, A) JP-A-3-256112 (JP, A) JP-A-1-122799 (JP, A) Yoshinori Sakai, Visual Interface, Information Processing, Japan, Information Processing Society of Japan, Vol. 33, No. 15, February 15, 1992. 2, pp. 128-133. Yamaguchi et al., A study of image quality in the method of displaying the gaze portion in detail, Technical Report of the Television Society of Japan, Television Society of Japan, February 15, 1990, Vol. 14, No. 12, pp. 57-62. Shio et al., Intelligent Telemonitoring Using Image Recognition Technology, Technical Report of the Institute of Television Engineers of Japan, The Institute of Television Engineers of Japan, May 29, 1992, Vol. 16, No. 31 pp. 7-12. (58) Field surveyed (Int.Cl. ⁷ , DB name) G06F 17/30 380 G06F 17/30 110 G06F 17/30 310 G06F 17/21 564 G09G 5/00 510 G09G 5/00 530 G11B 27/00 JICST file (JOIS)

Claims (2)

(57) [Claims] And [claim 1] page content data, the presentation of the page content data
To display the serial <br/>憶means for storing the page control data is the order the presenting position, the page contents data stored in the storage means
A display means, a user action detection means for detecting a gaze point detection means for the gaze position and time to the display unit by a user to detect <br/>, the behavior of the user, this user behavior a behavior of the user detected from the detecting means, before SL on the basis of the note <br/> vision position and time of the user detected by the gaze point detecting means, a page for instructing the turning page of the page content data turning determination Means and a page turning instruction by the page turning determining means,
The display according to the page control data stored in the storage means;
Page data for displaying each page content data for the means
A document presenting device comprising : a data presenting means. 2. Presenting the page content data with the page content data
Display means based on the page control data which is the order and the presentation position
In the method of presenting a material for presenting on a display device, the gaze position and time of the user on the display means are detected.
And detects the user's behavior, and detects the detected user's behavior and the detected user's gaze position
Finger to turn the page content data based on location and time
The page control data based on the page turning instruction.
Displaying each page content data on the display means;
Material presentation method characterized by the following.