JP2008158630A - Image output device and image output method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image output device and an image output method that can change presentation image data along the content of presentation. <P>SOLUTION: If the recognition result of a voice input from a presenter matches a character string for a page change included in a first page of presentation document data during the output of a first page of presentation image data 201, a presentation device 110 changes the image data output to a projection device 107 from the first page of presentation image data to a second page of presentation image data. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image output apparatus and an image output method.

  2. Description of the Related Art Conventionally, a projection device (display device) such as a projector that projects an input image is known. A presentation image output from an image output device such as a PC is input to the projection device. The projection device performs the presentation by enlarging the input presentation image and projecting it on the screen.

  A PC as an image output device recognizes that a specific key (enter key) or mouse button of the PC has been pressed, and switches which page of a plurality of presentation images is output to the projection device. .

  However, the method of switching pages using a keyboard or a mouse has a problem in that a presentation is not smoothly performed because it is necessary for an instructor to temporarily interrupt the explanation and perform a page switching operation.

In order to solve this problem, a method of previously registering a keyword (for example, “next slide”) for switching presentation images of a plurality of pages in the image output apparatus is conceivable. In this method, when a registered keyword is input by voice, a presentation is smoothly performed by switching presentation images (see, for example, Patent Document 1).
JP-A-8-339198

  However, the method of Patent Literature 1 switches pages using the same keyword (for example, “next slide”) for any page when switching presentation images of a plurality of pages. Therefore, since keywords that are not related to the contents spoken by the presenter in the presentation are uttered on each page, the presentation becomes unnatural.

  The present invention has been made in view of the above-described problem, and does not require a complicated operation from the presenter (presenter) of the presentation when switching image data of a plurality of pages, and the image data according to the contents of the presentation. It is an object to provide an image output apparatus and an image output method capable of switching between the two.

  In order to achieve the above object, an image output device of the present invention is an image output device that outputs image data to a display device, and is a page unit that combines image data and document data associated with the image data. Storage means for storing a plurality of pages of presentation data, and image output means for switching image data for a plurality of pages stored in the storage means to the display device by switching one page at a time based on a page switching instruction. A voice recognition means for recognizing the voice of the presenter of the presentation data, and data for switching pages included in the document data of the first page during display of the image data of the first page by the display device When the recognition result is input, the image data to be output to the display device is the image of the first page. And having a page switching instruction means for outputting the page switching instruction for switching from the over data to the image data of the second page following the first page to the image output unit.

  The image output method of the present invention is an image output method for switching and outputting a plurality of pages of image data to a display device, and the description of the image data during display of the first page of image data by the display device A speech recognition process for recognizing a person's voice and a recognition result corresponding to data for page switching included in the document data associated with the image data of the first page is input in the speech recognition process And switching the image data to be output to the display device from the image data of the first page to the image data of the second page subsequent to the first page-page switching step.

  According to the present invention, when switching image data of a plurality of pages, an image output apparatus capable of switching image data according to the contents of the presentation without requiring a complicated operation from the presenter (presenter) of the presentation. And an image output method.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.

<First Embodiment>
FIG. 1 is a block diagram illustrating a configuration of a presentation apparatus with a voice recognition function according to the first embodiment.

  The presentation device 110 includes a data input unit 100, a data extraction unit 101, a first audio data generation unit 102, an audio input unit 103, a second audio data generation unit 104, an audio data determination unit 105, a presentation image output unit 106, A storage unit 111 is included.

  The data input unit 100 receives presentation data from a network such as a LAN or an external device 109 such as a PC connected one-to-one, and outputs the input presentation data to the data extraction unit 101.

  As shown in FIG. 2, the presentation data is data in units of pages in which presentation image data 201 and presentation document data 202 corresponding to the presentation image are combined. The presentation image data 201 shown in FIG. 2 includes a heading 210 and texts 211a and 211b, which are text objects, and image objects 212a and 212b. The presentation document data 202 is composed of a character string corresponding to a speech uttered by the presenter (presenter) with respect to the presentation image data 201.

  FIG. 3 is a diagram showing a data structure 220 of the presentation data 200. The data structure 220 includes a page number element 221, a presentation image element 222, a title element 223, a text element 224, an image object element 225, an explanation original element 226, and the like.

  The data extraction unit 101 extracts presentation image data 201 and presentation document data 202 from the presentation data 200 input in units of pages from the data input unit 100, and outputs them to the first audio data generation unit 102. The presentation image data extracted by the data extraction unit is stored in the storage unit 111 in association with the page information.

  The first audio data generation unit 102 generates audio comparison data corresponding to the character string included in the presentation document data 202 input from the data extraction unit 101, and outputs it to the storage unit 111. The storage unit 111 stores the presentation image data 201 extracted by the data extraction unit 101 and the audio comparison data generated by the first audio data generation unit 102 in association with each other. Here, the voice comparison data is composed of a table 300 as shown in FIG. In the example of FIG. 4, the voice comparison data is stored in the storage unit 111 by being divided into 19 clauses.

  The table 300 includes a presentation page number 301 indicating a page number in the presentation data 200 and character string data 302 obtained by dividing a character string in the explanatory document data by a predetermined unit. In addition, importance data 303 indicating weighting for each character string data is included. Importance data is assigned using a predetermined method. In FIG. 3, importance 1 is assigned to a character string that matches a text object in a presentation image, and other character strings are assigned. An importance level of 0 is assigned.

On the other hand, the voice input unit 103 receives a voice signal from the voice input device 108 such as a microphone, and outputs it to the second voice data generation unit 104. The second voice data generation unit 104 performs voice recognition processing based on the input voice signal, and outputs the voice comparison data generated by converting the recognized voice to a character string to the voice data determination unit 105. . Here, as a speech recognition processing method, a method of analyzing input speech as a time series of feature vectors at a certain time interval is known. In this method, input speech is analyzed by performing pattern patching between a feature vector sequence and a word model that is a recognition candidate output from a speech dictionary (not shown). As a pattern matching technique, a technique as shown in the following document is known.
・ "Digital audio processing" (by Sadahiro Furui, 1985, Tokai University Press)
・ "Voice recognition by established model" (Seiichi Nakagawa, 1988, IEICE)
The voice data determination unit 105 determines whether the voice comparison data acquired from the storage unit 111 matches the voice comparison data generated by the second voice data generation unit 104 on a page basis. When it is determined that all of the audio comparison data for one page matches the audio comparison data generated by the second audio data generation unit 104, the audio data determination unit 105 displays the page determination end information as the presentation image. Output to the output unit 106. The voice comparison data shown in FIG. 4 is composed of 19 clauses. The presentation device 110 determines that the character string of a phrase in the table 300 matches the character string of the voice comparison data generated by the second voice data generation unit 104. Then, the presentation device 110 next determines whether or not the character string of the subsequent phrase in the table 300 matches the character string of the voice comparison data generated by the second voice data generation unit 104. By making such a determination for each of the 19 clauses, it is determined whether the audio comparison data for one page matches the audio comparison data generated by the second audio data generation unit 104.

  The presentation image output unit 106 outputs the presentation image data 201 acquired from the storage unit 111 to the projection device 107 such as a projector. In addition, when the presentation image output unit 106 receives the page determination end information from the audio data determination unit 105, the presentation image output unit 106 switches the presentation image being output to the projection device 107 to the presentation image of the next page.

  Next, processing executed by the presentation device 110 according to the first embodiment will be described with reference to the flowchart shown in FIG.

  Each step in the flowchart illustrated in FIG. 5 is started by the presentation device 110 when the presentation data 200 is input from the external device 109.

  First, in step 500, the presentation device 110 performs structural analysis on the presentation data 200 input to the data extraction unit 101. Then, the presentation apparatus 110 detects the presentation image element 222 and the explanatory document element 226, and extracts the presentation image data 201 and the presentation document data 202 corresponding to the presentation image data. Further, the presentation device 110 detects the text element 224 included in the presentation image data 201 and extracts a text object included in the presentation image data 201. In addition, the presentation device 110 acquires the number of pages of the presentation image data 201 included in the presentation data 200.

  The presentation apparatus 110 stores the presentation image data 201 extracted by the data extraction unit 101 in the storage unit 111. On the other hand, the presentation device 110 outputs the text objects included in the presentation document data 202 and the presentation image data 201 to the first audio data generation unit 102.

  In step 501, the presentation apparatus 110 generates audio comparison data based on the extraction result in step 500 in the first audio data generation unit 102. First, the presentation device 110 decomposes the presentation document data 202 into meaningful minimum unit clauses based on the text object and the presentation document data 202 included in the presentation image data 201. Then, the presentation device 110 generates a table 300 that constitutes audio comparison data based on the extracted clause (word string). Here, importance 1 is assigned to the phrase of the presentation document data 202 that matches the text object included in the presentation image data 201. On the other hand, importance 0 is assigned to the clause of the presentation document data 202 that does not match the text object included in the presentation image data 201. As a method of assigning importance, in addition to the above-described method, importance may be determined in advance for each type of part of speech or unique character string. The voice comparison data generated by the first voice data generation unit 102 is output to the voice data determination unit 105.

  In step 502, the presentation device 110 determines whether or not the operator of the presentation device 110 (presenter of the presentation) has instructed the start of the presentation operation. If there is a start instruction by the presenter of the presentation, the presentation image data of the first page stored in the storage unit 111 is output to the projection device 107 via the presentation image output unit 106.

  In step 503, the presentation apparatus 110 determines whether or not a voice is input from the voice input apparatus 108 in the voice input unit 103. If there is an input, the process proceeds to step S504. If there is no voice input, the presentation apparatus 110 enters a waiting state.

  In step 504, the presentation apparatus 110 performs voice recognition processing in the second voice data generation unit 104, and generates voice comparison data including character string data. The second audio data generation unit 104 outputs the generated audio comparison data to the audio data determination unit 105, and the process proceeds to step 505.

  In step 505, the audio data determination unit 105 performs a comparison process between the audio comparison data for the first page acquired from the storage unit 111 and the audio comparison data input from the second audio data generation unit 104. The voice data determination unit 105 creates a voice comparison result table 500 based on the voice comparison data acquired from the storage unit 111. The audio comparison result table 500 is shown in FIG. 6 and includes a presentation page number 501 obtained from the table 300 included in the audio comparison data acquired from the storage unit 111 and a character string 502 included in the presentation document data 202. Furthermore, the audio comparison result table 500 is a comparison indicating the comparison result between the character string included in the presentation document data 202 and the audio comparison data generated from the input audio, in addition to the importance 503 of each phrase of the character string 502. It has a flag 504. Then, the voice data determination unit 105 compares the voice comparison data input from the second voice data generation unit 104 with the voice comparison data acquired from the storage unit 111 for each phrase. The table in FIG. 6 exemplifies a case where the character string input as a result of the speech recognition is “Let's tell about tomorrow's weather”. “I will tell you the weather tomorrow” will match the words “Okay”, “Tomorrow ’s weather”, “O” and “I will tell you” included in the audio comparison data acquired from the storage unit 111. A value of 1 is written as a compared flag for each character string (sentence). Note that 0 is set as the initial value of the compared flag, and the value of the compared flag for character strings that have not been compared is 0. After making the determination in step S505, the presentation apparatus 110 proceeds to step S506, and updates the compared flag 504 based on the comparison result in step S505.

  After updating the comparison result in step S506, the presentation apparatus 110 advances the processing to step 507, and determines whether or not all the phrases included in the presentation document data 202 of the current page (first page) have been compared. . Specifically, the value of the compared flag for all the clauses included in the current page is confirmed, and if all the flags indicate a value (= 1) indicating that the comparison has been completed, the comparison within the page has been completed. Then, the process proceeds to step 508. On the other hand, if it is not determined in step S507 that the comparison within the page has been completed, the process proceeds to step S503 to wait for the next voice input.

  Here, regarding the determination method of whether or not the comparison in step S507 has been completed, only the compared flag for the phrase having a high importance may be determined as a determination target with reference to the importance 503 in FIG. Specifically, the presentation device 110 determines that the in-page comparison is completed if all of the compared flags of the clauses having the importance level 503 of 1 in the audio comparison result table 500 are 1.

  In step S <b> 508, the presentation apparatus 110 determines whether or not the comparison of the presentation document data 202 for all pages has been completed for the presentation data 200 for a plurality of pages. Specifically, the presentation device 110 determines whether the number of presentation pages acquired in step S500 matches the presentation page number 501. If they match, the processing ends. If they do not match, the process proceeds to step S509.

  In step S509, the presentation device 110 acquires the presentation image data 201 of the next page following the current page from the storage unit 111 in the presentation image output unit 106, outputs the presentation image data 201 to the projection device 107, and transitions to step S510.

  In step S510, the presentation apparatus 110 acquires the presentation document data 202 of the next page from the storage unit 111, sets it in the audio data determination unit 105, and proceeds to step S503.

  By the processing routine described above, when switching presentation image data of a plurality of pages, it is possible to switch presentation image data according to the contents of the presentation without requiring a complicated operation from the presenter (presenter) of the presentation. it can.

Second Embodiment
Hereinafter, a second embodiment of the present invention will be described.

  The first embodiment relates to an example in which presentation image data of a plurality of pages is switched in units of pages by voice input. On the other hand, the second embodiment relates to an example in which new image data is added to the presentation image data and displayed in accordance with the input of sound.

  Note that the second embodiment is a modification of the first embodiment, and is the same as the first embodiment except for the points specifically described below, and thus the description thereof is omitted.

  An example of presentation data including additional image data will be described with reference to FIG.

  In FIG. 7, presentation data 600 is composed of presentation image data 601 and presentation document data 602.

  The presentation data 600 has the same configuration as the presentation data 200 shown in FIG. Specifically, each page of one or more presentation data 600 is composed of data obtained by combining presentation image data 601 and presentation document data 602.

  The presentation image data 601 shown in FIG. 7 includes a heading 610, a body 611a and 612a, which are text objects, and image objects 611b and 611c.

  In performing a presentation, it is more effective to add an object to each page later than simply switching presentation image data of a plurality of pages in units of pages. For example, if only the heading 610 is displayed as background image data first, and then the text 611a and 612a are displayed, the contents of the text are effectively transmitted to the viewer of the presentation. In the second embodiment, image data that is newly added to the background image data and displayed is referred to as additional image data. The additional image data may be a text object or an image object, and an object obtained by combining a plurality of them may be used as the additional image data. In the example of FIG. 7, a combination of a text object 611a and image objects 611b and 611c is used as additional image data A611. The text object 612a is used as additional image data B612.

  As shown in FIG. 8, the presentation device 110 displays only the heading 610 as background image data when the execution of the presentation is started. Next, as shown in FIG. 9, the presentation device 110 adds additional image data A 611 to the heading 610 that is background image data, and outputs the result to the projection device 107. Finally, as shown in FIG. 10, the presentation apparatus 110 adds the additional image data A611 and the additional image data B612 to the heading 610 that is the background image data, and outputs the result to the projection apparatus 107.

  The switching from FIG. 8 to FIG. 9 and FIG. 9 to FIG. 10 is performed when a designated character string for designating additional image data included in the presentation document data 602 is detected.

  Specifically, the presentation document data 602 includes “##” as a character string for adding the additional image data, and the presentation apparatus 110 recognizes this character string, thereby adding the additional image data. Is added.

  Here, the data structure 620 of the presentation data 600 will be described with reference to FIG. The data structure 620 includes a page number element 621, a presentation image element 622, a title element 623, a text element 624, an image object element 625, and an explanation original element 626. Each element constituting the data structure 620 further has animation attributes 630a and 630b indicating animation group information and animation order attributes 631a and 631b indicating animation execution order. Here, the element having the animation attribute 630a and the animation order attribute 631b belongs to the additional image data A611, and indicates that the image data is first added to the background image data on this page. The element having the animation attribute 630b belongs to the additional image data B612, and indicates that the image data is the second image data added to the background image data on this page. Various methods are conceivable for adding image data to the background image data. For example, a method of displaying the additional image data as an animation by moving it from the left and right of the background image data is conceivable.

  Next, a table of audio comparison data of presentation data including additional image data will be described with reference to FIGS.

  The table 700 has the same configuration as the table 300 described above. However, in addition to the table 300, animation attribute data 704 indicating animation attributes and an animation execution position designation flag 705 indicating whether the character string is a character string designating an animation execution position are provided.

  The animation attribute data 704 has the same value in the character string included in one additional image data, and takes one of the animation attribute values a1 and a2 in the example of FIG. For character strings not included in the additional image data, a value of 0 is taken as animation attribute data.

  The initial value of the animation execution position designation flag 705 is 0, but a value of 1 is assigned when a previously designated animation execution position designation character string (“###” in the second embodiment) is detected. Is done.

  FIG. 13 is a diagram showing an animation management table 710 that associates the animation execution order with animation attribute data.

  Next, processing executed by the presentation apparatus according to the second embodiment will be described with reference to the flowchart shown in FIG. 14 and FIGS. 15 and 16.

  Each step in the flowchart shown in FIG. 14 is started when the presentation device 110 receives presentation data from the external device 109.

  First, in step 800, the presentation device 110 performs structural analysis on the presentation data 600 input to the data extraction unit 101. Then, the presentation apparatus 110 detects the presentation image element 622 and the explanatory document element 626 and extracts the presentation image data 601 and the presentation document data 602 corresponding to the presentation image data. In addition, the presentation apparatus 110 detects the text object element 624 included in the presentation image data 601 and extracts the text object included in the presentation image data 601. Furthermore, animation attributes 630a and 630b are extracted. In addition, the presentation device 110 acquires the number of pages of the presentation image data 601 included in the presentation data 600.

  The presentation device 110 stores the presentation image data 601 extracted by the data extraction unit 101 in the storage unit 111. On the other hand, the presentation device 110 outputs the text objects included in the presentation document data 602 and the presentation image data 601 to the first audio data generation unit 102.

  In step 801, the presentation device 110 uses the first audio data generation unit 102 to generate audio comparison data based on the extraction result in step 800. First, the presentation apparatus 110 breaks down the presentation document data 602 into meaningful minimum unit clauses based on the text object included in the presentation image data 601 and the presentation document data 602. Then, the presentation device 110 generates a table 300 that constitutes audio comparison data based on the extracted clause (word string). Here, importance 1 is assigned to the phrase of the presentation document data 602 that matches the text object included in the presentation image data 601. On the other hand, importance 0 is assigned to the clause of the presentation document data 602 that does not match the text object included in the presentation image data 601. As a method of assigning importance, in addition to the above-described method, importance may be determined in advance for each type of part of speech or unique character string. The voice comparison data generated by the first voice data generation unit 102 is output to the voice data determination unit 105. Further, when an animation execution position designation character string designated in advance (“##” in the second embodiment) is detected, the value of the animation character position designation flag is set to 1. Furthermore, animation attribute data 704 is generated according to the animation attribute extracted in step 800. Further, the above-described animation management table 710 in which animation attributes are associated with the animation execution order is generated.

  In step 802, the presentation device 110 determines whether or not the operator of the presentation device 110 (presenter of the presentation) has instructed the start of the presentation operation. If there is a start instruction by the presenter of the presentation, the presentation image data of the first page stored in the storage unit 111 is output to the projection device 107 via the presentation image output unit 106.

  In step 803, the presentation apparatus 110 determines whether or not voice is input from the voice input apparatus 108 in the voice input unit 103. If there is an input, the process proceeds to step S804, and if there is no voice input, the presentation apparatus 110 enters a waiting state.

  In step 804, the presentation apparatus 110 performs voice recognition processing in the second voice data generation unit 104, and generates voice comparison data including character string data. The second audio data generation unit 104 outputs the generated audio comparison data to the audio data determination unit 105, and the process proceeds to step 805.

  In step 805, the audio data determination unit 105 performs a comparison process between the audio comparison data for the first page acquired from the storage unit 111 and the audio comparison data input from the second audio data generation unit 104. The voice data determination unit 105 creates a voice comparison result table 900 based on the voice comparison data acquired from the storage unit 111. The audio comparison result table 900 is shown in FIG. 15 and includes a presentation page number 901 obtained from the table 700 included in the audio comparison data acquired from the storage unit 111 and a character string 902 included in the presentation document data 602. Furthermore, the voice comparison result table 900 includes importance 903 of each phrase of the character string 902, animation attribute data 904 corresponding to the animation attribute, and animation execution position flag 905. In addition, the audio comparison result table 900 includes a compared flag 906 that indicates a comparison result between the character string included in the presentation document data 602 and the audio comparison data generated from the input audio. Further, the presentation device 110 creates an animation execution management table 910 based on the animation management table 710. Then, the voice data determination unit 105 compares the voice comparison data input from the second voice data generation unit 104 with the voice comparison data acquired from the storage unit 111 for each phrase. The table in FIG. 15 exemplifies a case where the character string input as a result of the speech recognition is “Let's tell about tomorrow's weather”. “I will tell you the weather tomorrow” will match the words “Okay”, “Tomorrow ’s weather”, “O” and “I will tell you” included in the audio comparison data acquired from the storage unit 111. A value of 1 is written as a compared flag for each character string (sentence). Note that 0 is set as the initial value of the compared flag, and the value of the compared flag for character strings that have not been compared is 0. After making the determination in step S805, the presentation apparatus 110 advances the process to step S806, and updates the compared flag 806 based on the comparison result in step S805.

  In step S807, the presentation apparatus 110 refers to the animation execution position data 905 and the compared flag 906 in the table 900, and determines whether or not the animation execution position is to execute the display of the additional image data. The presentation apparatus 110 refers to the compared flag 906, and if the value of the compared flag 906 corresponding to the character string positioned before the animation execution position flag 905 is a value 1 indicating that all have been compared, step S808. Transition to. Otherwise, the process proceeds to step 809.

  In step S808, the presentation apparatus 110 refers to the animation execution management table 910 and displays the additional image data (executes the animation) according to the animation execution order 911. After displaying the additional image data, the presentation device 110 sets the value of the executed flag 913 to 1 and proceeds to step 809.

  In step 809, the presentation device 110 determines whether all the phrases included in the presentation document data 202 of the current page (first page) have been compared. Specifically, the value of the compared flag for all the clauses included in the current page is confirmed, and if all the flags indicate a value (= 1) indicating that the comparison has been completed, the comparison within the page has been completed. Then, the process proceeds to step 810. On the other hand, if it is not determined in step S809 that the in-page comparison is completed, the process proceeds to step S803, and the next voice input waiting state is entered.

  Here, regarding the determination method as to whether or not the comparison in step S809 has been completed, only the compared flag for the phrase having a high importance may be determined as a determination target with reference to the importance 903 in FIG. Specifically, the presentation device 110 determines that the in-page comparison is completed if all of the compared flags of the phrase having the importance 903 value of 1 in the audio comparison result table 900 are 1.

  In step S810, the presentation apparatus 110 determines whether or not the comparison of the presentation document data 602 for all the pages has been completed for the presentation data 600 for a plurality of pages. Specifically, the presentation device 110 determines whether or not the number of presentation pages acquired in step S800 matches the presentation page number 901. If they match, the processing ends. If they do not match, the process proceeds to step S811.

  In step S811, the presentation apparatus 110 acquires the presentation image data 601 of the next page following the current page from the storage unit 111 in the presentation image output unit 106, outputs the presentation image data 601 to the projection apparatus 107, and transitions to step S812.

  In step S812, the presentation apparatus 110 acquires the presentation document data 602 of the next page from the storage unit 111 and sets it in the audio data determination unit 105, and the process proceeds to step S803.

  By the processing routine described above, when switching presentation image data of a plurality of pages, it is possible to switch presentation image data according to the contents of the presentation without requiring a complicated operation from the presenter (presenter) of the presentation. it can.

  Furthermore, in the second embodiment, the presentation image data is composed of background image data and additional image data. By displaying an additional image on the background image data based on the result of the speech recognition, it is effective for the viewer of the presentation without requiring a complicated operation from the presenter (presenter) of the presentation. A presentation can be performed.

(Third embodiment)
Next, a third embodiment of the present invention will be described.

  The presentation apparatus 110 in the first and second embodiments described above outputs presentation image data based on presentation data input from the external apparatus 109. On the other hand, the presentation apparatus 110 according to the third embodiment shows an example in which presentation data is generated based on image data obtained by reading a paper document. Except for the points described below, the processing executed by the presentation device 110 according to the third embodiment is the same as the processing executed by the presentation device 110 according to the first embodiment or the second embodiment. Is omitted.

  FIG. 17 is a diagram illustrating a configuration of the presentation device 110 according to the third embodiment. An image reading device 1701 is connected to the presentation device 110 instead of the external device 109 in FIG.

  The image reading apparatus 1701 is an apparatus that obtains image data obtained by converting an image recorded on a recording sheet into an electrical signal using an image input sensor such as a CCD. The presenter of the presentation inputs image data to the data input unit 100 by setting a recording sheet on which an image as shown in FIG.

  FIG. 18 shows an image recorded on a recording sheet, which includes presentation image data 1801 and presentation document data 1802. An operator of the presentation apparatus 110 (presentation instructor) sets a recording sheet as shown in FIG. 18 on the image reading apparatus 1701 and instructs the reading of the image to start reading the image on the recording sheet. Note that the recording sheet is composed of a plurality of sheets, and the image reading device 1701 reads the plurality of recording sheets page by page to obtain page unit image data. Image data is input to the data input unit 100 from the image reading device 1701 in units of pages. Then, the data input unit 100 outputs the input page unit image data to the data extraction unit 101.

  The data extraction unit 101 extracts presentation image data 1801 and presentation document data 1802 from presentation data 1800 as image data input in units of pages from the data input unit 100. Then, the data extraction unit 101 outputs the data to the first audio data generation unit 102. The presentation image data extracted by the data extraction unit is stored in the storage unit 111 in association with the page information.

  The data extraction unit 101 cuts out a portion corresponding to 1801 in the input image data and extracts it as presentation image data 1801. On the other hand, the data extraction unit 101 cuts a portion corresponding to 1802 in the input image data, performs character recognition processing on the cut portion, and converts the image data into a character string. In the character recognition process, character pattern data obtained by converting a plurality of characters into image data is stored in the storage unit 111 in advance, and which character pattern data stored in the storage unit 111 matches the cut image data. It is only necessary to judge and recognize. The character string obtained as a result of recognition is stored in the storage unit 111 as presentation document data 1802 in association with the presentation image data 1801. By performing such processing for each of a plurality of pages, the storage unit 111 stores a plurality of pages of presentation data. Accordingly, the image recorded on the recording paper can be read and the data extraction unit 101 can store the presentation image data 1801 and the presentation document data 1802 in combination.

  By the processing routine described above, when switching presentation image data of a plurality of pages, it is possible to switch presentation image data according to the contents of the presentation without requiring a complicated operation from the presenter (presenter) of the presentation. it can.

  In addition, since presentation data combining presentation image data and presentation document data can be generated by reading an image on a recording paper, a presentation using the recording paper on which the image is recorded can be easily performed.

(Other examples)
Although the embodiment has been described in detail above, the present invention can take an embodiment as a system, apparatus, method, program, storage medium (recording medium), or the like. Specifically, the present invention may be applied to a system composed of a plurality of devices, or may be applied to an apparatus composed of a single device.

  According to the present invention, a software program that realizes the functions of the above-described embodiments is supplied directly or remotely to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Is also achieved. Here, the program indicates a program corresponding to the flowchart shown in the drawing in the embodiment.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the recording medium for supplying the program include a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. Further, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  In addition, the program can be supplied by connecting to a homepage on the Internet using a browser of a client computer and downloading the computer program of the present invention from the homepage. It can also be supplied by downloading a compressed file including an automatic installation function to a recording medium such as a hard disk. It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. There is also a way to make it. This method can also be realized by executing an encrypted program using the key information and installing it on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Further, based on the instructions of the program, the OS running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  Furthermore, a method is conceivable in which a program read from a recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. In this case, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the written program instruction, and the functions of the above-described embodiments are realized by the processing. .

It is a block diagram which shows the structure of the presentation apparatus with a speech recognition function. 3 is a conceptual diagram showing a configuration of presentation data 200. FIG. 3 is a diagram showing a data structure 220 of presentation data 200. FIG. It is a figure explaining the data for audio | voice comparison. 5 is a flowchart showing processing executed by the presentation device 110. It is a figure which shows an audio | voice comparison result table. It is a figure which shows an example of the presentation data containing additional image data. It is a figure which shows an example of the presentation image data output to a projection apparatus. It is a figure which shows an example of the presentation image data output to a projector. It is a figure which shows an example of the presentation image data output to a projection apparatus. 6 is a diagram showing a data structure 620 of presentation data 600. FIG. It is a figure explaining the data for audio | voice comparison. It is a figure which shows the animation management table 710. 5 is a flowchart showing processing executed by the presentation device 110. It is a figure which shows an audio | voice comparison result table. It is a figure which shows an animation execution management table. It is a block diagram which shows the structure of the presentation apparatus with a speech recognition function. It is a figure which shows an example of the recording paper which an image reading apparatus reads.

Explanation of symbols

110 Presentation Device 200 Presentation Data 201 Presentation Image Data 202 Presentation Document Data 500 Audio Comparison Result Table 600 Presentation Data 601 Presentation Image Data 602 Presentation Document Data 611 Additional Image Data A
612 Additional image data B

Claims (10)

An image output device that outputs image data to a display device,
Storage means for storing, for a plurality of pages, page-by-page presentation data combining image data and document data associated with the image data;
Image output means for switching the image data for a plurality of pages stored in the storage means to the display device by switching one page at a time based on a page switching instruction;
Voice recognition means for recognizing the voice of the presenter of the presentation data;
An image to be output to the display device when the recognition result corresponding to the page switching data included in the document data of the first page is input during the display of the image data of the first page by the display device Page switching instruction means for outputting the page switching instruction for switching the data from the image data of the first page to the image data of the second page following the first page, to the image output means;
An image output apparatus comprising: The image data includes background image data and additional image data to be added to the background image data,
The document data includes data for displaying the additional image data associated with the additional image data,
When the recognition result corresponding to the data for displaying the additional image data included in the document data of the first page is input during the display of the background image data of the first page by the display device, Additional image data instruction means for outputting an instruction to add the additional image data to one page of background image data to the image output means;
The image output apparatus according to claim 1, further comprising: The document data includes a plurality of data for page switching,
The page switching instruction means outputs the page switching instruction to the image output means when a plurality of recognition results of the voice recognition means and a plurality of data for page switching match. The image output apparatus according to 1 or 2. Generating means for generating presentation data in units of pages by reading a paper original and combining the image data and the document data;
The image output apparatus according to claim 1, wherein the storage unit stores the presentation data in units of pages generated by the generation unit.   5. The image output apparatus according to claim 1, further comprising a second page switching instruction unit that receives a page switching instruction by the explainer and outputs the page switching instruction to the image output unit. 6. . An image output method for switching image data of a plurality of pages and outputting it to a display device,
A voice recognition step of recognizing the voice of the explainer of the image data during the display of the image data of the first page by the display device;
When the recognition result corresponding to the data for page switching included in the document data associated with the image data of the first page is input in the voice recognition step, the image data to be output to the display device is Switching from image data of the first page to image data of a second page subsequent to the first page-a page switching step;
An image output method comprising: The image data includes background image data and additional image data to be added to the background image data,
The document data includes data for displaying the additional image data associated with the additional image data,
When the recognition result corresponding to the data for displaying the additional image data included in the document data of the first page is input during the display of the background image data of the first page by the display device, An additional step of adding the additional image data to the output of one page of the background image data and outputting;
The image output method according to claim 6, further comprising: The document data includes a plurality of data for page switching,
The page switching instruction step switches from the image data of the first page to the image data of the second page when a plurality of recognition results in the voice recognition step and a plurality of data for page switching match. The image output method according to claim 6, wherein the image output method is characterized in that:   The image output method according to claim 6, further comprising a generation step of reading a paper document and generating presentation data in units of pages by combining the image data and the document data.   10. The method according to claim 6, further comprising: a second page switching step of receiving a page switching instruction from the presenter and switching the presentation image data of the first page to the presentation image data of the second page. The image output method described in 1.

Images