JP2011248444A - Display controller and presentation method used therewith - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display images corresponding to, for example, a question on a display device without any particular device for a questioner and any particular operation by a questioner.SOLUTION: A display controller comprises: an image storage part 15A for storing a plurality of images GP to be displayed on a display device 5; an image output part 12A for outputting images stored in the image storage part to display the images on the display device; a keyword storage part 15B for storing keywords configured corresponding to each of the plurality of images; a voice analysis part 131 for analyzing input voice to output phrases WS corresponding to the voice; a retrieval part 14 for retrieving the keyword storage part on the basis of the phrases WS; and a control display part 122 for controlling the image output part so as to display images corresponding to the keywords retrieved by the retrieval part on the display device.

Description

  The present invention relates to a display control device that controls an image displayed on a display device, and a presentation method using the display control device.

  Conventionally, presentations using a display device such as a projector or a monitor (for example, a thin display device) are often performed.

  When the presentation is performed, the presenter prepares a number of images (image data) as materials (material images) in advance. In the presentation, the presenter displays the prepared document image on a display device connected to a PC (Personal Computer) or the like, and explains or explains with reference to each displayed image.

  In other words, during the presentation, the presenter or the operator of the PC sequentially feeds pages according to the presenter's presentation. After the presentation, there will usually be a question and answer time. In the question-and-answer session, there is a case where it is desired to display a corresponding page of the material image according to the question content of the questioner (auditor).

  In such a case, the presenter or the operator usually operates the PC to search for and display a page corresponding to the question content. However, the displayed page may not match the page considered by the questioner. Further, when the number of pages of the material image is large, it may take time to search for the corresponding page.

  Regarding such a problem, while the presenter sequentially displays images in the presentation, the questioner transmits the identification information from the terminal as necessary to store the identification information and the image in association with each other. It has been proposed to redisplay an image having identification information (Patent Document 1).

  Also, a local operation permission mode that allows operation of the display means from a plurality of terminals and a local operation prohibition mode that prohibits the operation are provided, and in question and answer, the questioner directly sends a page as the local operation permission mode. It has been proposed to do this (Patent Document 2).

  Also, during the presentation, the questioner's remarks can be identified for each individual questioner, so that the display image when each individual questioner speaks is stored and the sound and the image are associated with each other. Is disclosed (Patent Document 3).

JP 2002-351434 A JP 2002-351435 A JP 2009-65262 A

  In the method of Patent Document 1 described above, a question can be asked only while a document image is displayed. Therefore, even if a questioner comes up with a question later, the question cannot be asked. Therefore, there is no flexibility when a related question comes up during the question. In addition, it is necessary for all the interrogators to carry out a special operation with the remote control device, which makes preparation difficult and disadvantageous in terms of cost.

  In the method of Patent Document 2, it is necessary for the questioner himself to switch pages to find out, and the questioner's operation is difficult. Moreover, a terminal must be prepared for the interrogator, which is disadvantageous in terms of cost.

  In the method of Patent Document 3, the questioner does not need to perform a special operation, but the questioner must speak at the time of presentation presentation. It cannot be applied to.

  The present invention has been made in view of the above-described problems, and it is not necessary to prepare a special device for a questioner or the like, and it is not necessary for the questioner or the like to perform a special operation. An object is to enable an image to be displayed on a display device.

  An apparatus according to the present invention is a display control device that controls an image displayed on a display device, and stores an image storage unit that stores a plurality of images to be displayed on the display device, and the image storage unit. An image output unit that outputs one or more images of the plurality of images to be displayed on the display device, and one or more keywords set in correspondence with each of the plurality of images are stored A keyword storage unit, a speech analysis unit that analyzes speech input from the speech input means and outputs a phrase corresponding to the speech, and searches the keyword storage unit based on the phrase output from the speech analysis unit And a control display unit that controls the image output unit to display the image corresponding to the keyword searched by the search unit on the display device.

  According to the present invention, it is not necessary to prepare a special device for a questioner or the like, and the questioner or the like does not need to perform a special operation, and an image corresponding to the question or the like can be displayed on the display device. .

It is a figure which shows the structural example of the outline of the display system of this embodiment. 1 is a block diagram functionally showing a schematic configuration of a display system of an embodiment. It is a block diagram which shows the example of a functional structure of a display control apparatus. It is a figure which shows the example of the keyword database memorize | stored in the keyword memory | storage part. It is a figure which shows the example of the image memorize | stored in the image memory | storage part. It is a figure which shows the example of the keyword set with respect to each image. It is a figure which shows the example of the presentation using a display system. It is a figure which shows the other example of the presentation using a display system. It is a flowchart which shows the outline flow of the processing operation in a display system. It is a flowchart which shows the flow of the processing operation which switches the display of an image with a question.

  In FIG. 1, the display system 1 can be used for presentation. It can also be used for presentation preparation.

  As shown in FIG. 1, the display system 1 includes a terminal device 3, a voice input device 4, and a projector (display device) 5. These are connected to each other by a LAN (Local Aria Network) or a dedicated cable, and can communicate with each other.

  The terminal device 3 is, for example, a personal computer, and a notebook type or desktop type can be used. Further, various devices having a computer function, such as an image forming device or an image processing device, may be used instead of the terminal device 3.

  The voice input device 4 amplifies voice (voice signal) input from the microphone MC and converts it into digital voice data. In addition, various processes for voice recognition or voice analysis may be performed as necessary. One or more microphones MC are provided for the questioner at the presentation venue. The microphone MC and the voice input device 4 are examples of voice input means in the present invention.

  The projector 5 projects and displays an image (image data) output from the terminal device 3 as a document image on a screen (not shown). A thin display device may be used instead of the projector 5.

  As the terminal device 3, the voice input device 4, and the projector 5, it is also possible to use a device in which all or a part of these are integrated. For example, the voice input device 4 may be incorporated in the terminal device 3. In that case, the microphone MC is directly connected to the terminal device 3. Further, the voice input device 4 and the projector 5 may be incorporated in the terminal device 3.

  In FIG. 2, the terminal device 3 includes an overall control unit 11, an image control unit 12, a voice recognition unit 13, a search unit 14, a storage unit 15, an operation unit 16, and the like.

  The overall control unit 11 controls each block of the terminal device 3 and controls the whole.

  The image control unit 12 controls the image (image data) stored in the storage unit 15, and configures and outputs one or a plurality of images projected and displayed by the projector 5. The image control unit 12 also controls the projector 5 to display an image corresponding to the keyword searched by the search unit 14. The image control unit 12 includes an image output unit 12A described later.

  The voice recognition unit 13 performs processing for voice recognition, voice analysis, and speaker identification based on the voice data input from the voice input device 4. The speech recognition unit 13 outputs a phrase corresponding to the input speech data, a pronunciation data that identifies a speaker who has produced the speech, a phrase corresponding to attribute information acquired based on the pronunciation data, and the like. .

  The search unit 14 searches the storage unit 15 based on the words output from the voice recognition unit 13. That is, the search unit 14 searches for a keyword KW corresponding to the phrase from the speech recognition unit 13. When there is a corresponding keyword KW, for example, a page PG corresponding to the keyword KW is output. Alternatively, the keyword KW itself is output.

  The storage unit 15 stores a plurality of images GP to be displayed by the projector 5, one or a plurality of keywords KW set corresponding to each of the plurality of images GP, and the like. The image GP includes a photograph, a line drawing, a figure, a character, and the like.

  The storage unit 15 can be configured by a semiconductor memory or a magnetic disk device. The storage unit 15 is provided with an image storage unit 15A and a keyword storage unit 15B, which will be described later.

  When the user operates this, the operation unit 16 performs operations for starting image display, page turning in the normal display mode, mode switching, and other operation inputs. The operation unit 16 can be configured by a keyboard or a mouse.

  The overall control unit 11, the image control unit 12, the voice recognition unit 13, the search unit 14, and the like can be realized by a CPU or the like executing a program (computer program) stored in a ROM or the like. Such a program can be installed via an appropriate storage medium, or can be downloaded via a network. Moreover, it is realizable also by the combination with appropriate hardware with the software by execution of those programs.

  In FIG. 3, the image output unit 12 </ b> A outputs one or a plurality of images GP among the images GP stored in the image storage unit 15 </ b> A for display on the display device 5.

  The image output unit 12A is provided with a normal display unit 121 and a control display unit 122. The normal display unit 121 controls the image GP to be displayed on the display device 5 to be switched based on a user operation input. For example, each time the user presses or clicks a predetermined button, the displayed image GP is paged. The mode displayed by the control of the normal display unit 121 is the “normal display mode”.

  The control display unit 122 controls the display device 5 to display the image GP corresponding to the keyword KW searched by the search unit 14. For example, the image GP of the page PG designated from the control display unit 122 is read from the image storage unit 15 </ b> A and output to the display device 5. When a plurality of pages PG are designated, the plurality of images GP are read from the image storage unit 15A and output in a state where they are reduced and arranged side by side so that they can be displayed simultaneously on one screen.

  The mode displayed by the control display unit 122 is the “control display mode”. In the control display mode, whenever a questioner's question is made, the keyword KW is selected based on the content or voice of the question, and the image GP corresponding to the keyword KW is narrowed down in real time. Once one image GP is determined, the image G is fixed and displayed. In that case, for example, the processing in the voice recognition unit 13 is stopped.

  Further, when the next question starts, by releasing the fixation of the image G, the processing in the voice recognition unit 13 is resumed, and the image GP corresponding to the question is selected and confirmed.

  Next, the speech recognition unit 13 is provided with a speech analysis unit 131, a sound generator identification unit 132, an attribute word / phrase detection unit 133, and an attribute information storage unit 134.

  The voice analysis unit 131 analyzes voice (voice data) input from the microphone MC (voice input device 4) and outputs a phrase (phrase data) WS corresponding to the voice.

  The sound generator specifying unit 132 analyzes the sound input from the microphone MC (speech input device 4) and outputs data for specifying the sound generator who has emitted the sound.

  When the data specifying the sound generator is output from the sound generator specifying section 132, the attribute word / phrase detecting section 133 acquires attribute information corresponding to the sound generator from the attribute information storage section 134. Then, the phrase corresponding to the acquired attribute information, for example, the phrase WZ included in the attribute information is output to the search unit 14.

  The attribute information storage unit 134 stores attribute information corresponding to the sound generator. The attribute information includes, for example, the department to which the pronunciation belongs, the title, the specialized field, the business charge, and the belonging project. Specifically, for example, “Technology Department”, “Sales Department”, “Development Department”, “Information Processing Project”, and the like.

  The image storage unit 15A stores a material GS including a large number of images GP used in the presentation. A plurality of images GP used in one presentation are grouped as one material GS. A plurality of materials GS can be stored in the image storage unit 15A.

  The keyword storage unit 15B stores a keyword database DB created corresponding to each material GS. Therefore, for example, in the keyword storage unit 15B, the correspondence between the plurality of images GP included in each of the plurality of materials GS and the corresponding keyword is stored in various formats such as a table.

  Note that the image storage unit 15A and the keyword storage unit 15B can be provided by partitioning a storage area in the same storage unit. Moreover, since the data stored in them are related to each other, it is possible to store the data in association with each other.

  FIG. 4 shows a part of the keyword database DB.

  In FIG. 4, the keyword database DB1 has items such as a material number NGS, a page PG, a keyword KW, and a setting method SH.

  The material number NGS is identification information for identifying each material GS existing in a plurality in the keyword database DB. In this example, the material number NGS is “1”.

  The page PG is identification information for identifying each image GP in one material GS. The pages PG are given “1”, “2”, “3”,... In the order of display in the presentation.

  The keyword KW is set corresponding to each image GP. There may be one keyword KW for one image GP, or there may be a plurality of keywords. The phrases used as the keyword KW are as follows.

  That is, for example, attribute information given to the image GP, for example, a phrase included in the title therein is used. In that case, when a title consists of compound words, each word which comprises a compound word is used. Further, a phrase indicating the type, color, or shape of the content of each image GP is used.

  Examples of content types include graphs, diagrams, tables, and animations. The color of the content is a color used in the image GP, particularly a conspicuous color, an impressive color, or an overall color of the image GP. The shape of the content includes a shape used in the image GP, particularly a conspicuous shape, an impressive shape, and an overall shape of the image GP.

  These attribute information may be managed as attribute information by an application program that handles the image GP for presentation. In that case, the attribute information managed by such an application program can be processed to be automatically transferred as the keyword KW in the keyword database DB1.

  Further, the keyword KW can be freely selected and set by the user. For example, in the image GP or explanation, the keyword KW is selected assuming the phrase used for the explanation, the content of the question that will be asked by the audience, the phrase that is likely to be used in the question, and the department or department that is likely to ask the question. And input.

  The setting method SH is an item indicating on what basis the keyword KW is selected and set. For example, when the keyword KW is selected from the title of the image GP, “Title” is selected, and when the keyword KW is selected from the content type of the image GP, the “Type” is changed from the content color of the image GP to the keyword KW. When selected, “color” is set. When the user freely selects and sets, the setting method SH is “free”.

  The keyword database DB1 shown in FIG. 4 corresponds to the image GP shown in FIGS. 5 and 6 described next.

  FIG. 5 shows an example of the image GP for the material GS whose material number NGS is “1”.

  In FIG. 5, the material GS is composed of 17 images GP. In each image GP, a page PG is shown in the upper right part. Although not shown in the figure, the image GP includes a portion indicated by colors such as red, blue, green, yellow, and purple.

  In the image GP shown in FIG. 5, the pages PG from “1” to “14” are sequentially displayed in the normal display mode in the presentation. That is, the image GP whose page PG is “14” is a specific image GPT indicating that a question and answer will be entered from now on, and is set to be displayed at the end of the image to be displayed in the normal display mode in the presentation.

  When the specific image GPT is displayed in the normal display mode, the normal display mode is switched to the control display mode automatically or based on a user operation input. This will be described later.

  In addition, images of pages PG from “15” to “17” are images GPS as reference materials created specifically for question and answer.

  FIG. 6 shows an example of the keyword KW set in each image GP corresponding to the material GS shown in FIG.

  In FIG. 6, for example, “cover” which is the title of the image GP is set as the keyword KW for the image GP of the page PG “1”. For the image GP of the page PG “4”, “effect”, “prediction”, “detail” as the title of the image GP and “table” as the content type of the image GP are set as the keyword KW. .

  Next, a presentation method using the display system 1 will be described.

  As described above, as preparation before the presentation, the material GS is prepared, and the keyword KW is set for each image GP.

  When a presentation is performed, a presenter who is a user first selects a corresponding material GS from among a large number of materials GS stored in the image storage unit 15A. In the normal display mode, necessary explanations and announcements are made while sequentially displaying the images GP of the material GS in accordance with the page PG.

  When the specific image GPT that is the final page PG in the presentation is displayed, the normal display mode is switched to the control display mode at that time. This switching can be automatically performed, and can be switched by an operation input of the presenter.

  A question and answer session is performed in the control display mode. When the questioner asks a question, the voice is input from the microphone MC and the voice data is input to the voice recognition unit 13.

  In the speech recognition unit 13, the word / phrase WS included in the questioner's question and the word / phrase WZ corresponding to the attribute information acquired based on the sound generator specified by the sound generator specifying unit 132 are extracted and output.

  Based on these words WS and WZ, the search unit 14 searches the keyword database DB1 of the keyword storage unit 15B. When the search results in a hit, the search unit 14 outputs the hit page PG.

  The image output unit 12A reads the image GP of the page PG specified by the search unit 14 from the image storage unit 15A and outputs the image GP to the display device 5. At this time, if a plurality of pages PG are designated from the search unit 14, a plurality of images GP corresponding to the pages are read out, laid out so as to enter one screen, and output.

  The display device 5 displays those images GP. The questioner looks at the image GP displayed on the display device 5, and continues to ask the question as it is. When a plurality of images GP are displayed, when the questioner continues to ask questions, the images GP are further narrowed down based on the questions, and usually only one image GP is finally displayed. .

  When the presenter knows that the finally displayed image GP is the image GP intended by the questioner, the presenter performs an operation input for determining the image GP. As this operation input, for example, a predetermined button is pressed. In addition, in order to determine the image GP, control is performed so as to automatically determine the image GP when a predetermined time has elapsed since the display of one image GP instead of the operation input of the presenter. May be.

  In the explanation for the question, the presenter can display the image GPS as reference material as necessary.

  In addition, when the question after the image GP is determined is finished, the presenter or the operator cancels the determination of the image GP to prepare for another next question.

  Next, such a presentation is shown with some specific examples.

  In FIG. 7A, a specific image GPT which is the final image GP of the presentation is displayed. When the specific image GPT is displayed, the normal display mode is switched to the control display mode in accordance with a user operation input or the like.

  In the control display mode, first, as shown in FIG. 7B, all images GP used in the presentation are displayed as a list image SN. Switching to display of the list image SN may be performed automatically, or may be performed based on an operation input from a presenter or the like.

  The questioner makes a question with reference to the list image SN as necessary. For example, the questioner says "At the expense ...", "At the explanation ...", etc., and says what the question is.

  As described above, the list image SN is narrowed down based on the words WS and WZ obtained from the questioner's question. In FIG. 7C, a narrowed image GS1 narrowed down to two images GP with “cost” as a keyword KW is displayed. In this state, when the questioner further says, for example, “the graph ...”, as shown in FIG. 7D, one image (refined image) GP5 narrowed down using “graph” as the keyword KW. Is displayed.

  In a state where one image GP5 is displayed, the display of the image GP5 is fixed by an operation input of the presenter or the like. And the question by a questioner is continued. When the question by the questioner ends, the list image SN shown in FIG. 7B is displayed again by an operation input by the presenter or the like. Then, based on another question, the image GP is narrowed down as described above.

  In the example shown in FIG. 8, when the questioner says “It is XX of □□ part…” in the state where the list image SN of FIG. 8B is displayed, “□□ part” is set as the keyword KW. A narrowed-down image GS2 as shown in FIG.

  In addition, when the questioner says “It is about delivery date…” in a state where the narrowed-down image GS2 shown in FIG. 8C is displayed, the “delivery date” is set as the keyword KW and the two images GP are narrowed down. A narrowed-down image GS3 as shown in FIG. 8 (D) is displayed.

  In this way, the image is finally narrowed down to one image GP. However, the display image can be determined in a state where two or more images GP are displayed as the narrowed-down images GS by the operation input of the presenter. In this case, the question is continued with a plurality of images GP displayed.

  Thus, in the question and answer mode, the mode is switched to the control display mode, and the image GP is automatically narrowed down according to the contents of the questioner's question. Therefore, the image GP corresponding to the question or the like can be displayed easily and quickly.

  In addition, it is not necessary to prepare a special device for a questioner or the like as in the prior art, and the questioner or the like does not need to perform a special operation, so that the operation is easy and advantageous in terms of cost. .

  Incidentally, when the questioner asks a question, it is rare to make a statement that uniquely identifies the page, such as the page number of the image GP. It is assumed that the question part is often specified by. In addition, it is assumed that the questioner often specifies in the form of content, such as “in the graph ...”, “in the diagram ...”, etc., instead of the keyword in the explanatory text. Furthermore, it is assumed that interstitial people often say their departments and positions before questions.

  As described above, the part to be queried differs depending on the position of the questioner, but the words WS and WZ for search are detected based on the contents of the utterance (question) of the questioner, and the image GP is narrowed down based on this. Therefore, the appropriate image GP corresponding to the question can be displayed accurately and quickly.

  Even if the questioner does not say the department to which he belongs, the speaker (questioner) is identified and the department is detected, and the image GP is narrowed down based on this, so the question can be asked more accurately and quickly. The image GP corresponding to the can be displayed.

  Further, even when a plurality of images GP are displayed as a result of the narrowing down, the image GP can be determined in that state, so that the question can be continued while viewing the plurality of images GP related to the question. it can.

  Next, an outline flow of processing operations in the display system 1 will be described with reference to a flowchart.

  In FIG. 9, in order to make a presentation, the presenting state, that is, the normal display mode is set (# 11). In this state, when the presenter or the operator performs operation input, page feed of the image GP is performed (# 12).

  When the specific image GPT indicating that the question and answer session is entered is displayed (Yes in # 13), all images GP of the material GS used in the presentation are displayed as the list image SN (# 14). In this state, a question-and-answer session is in progress, the display mode is switched to the control display mode (# 15), and the image GP is narrowed down according to the content of the questioner's question (speak).

  In FIG. 10, in the control display mode, when there is a question (Yes in # 21), the words WS and WZ for search are generated according to the question of the questioner (# 22). The keyword database DB1 is searched based on the generated words WS and WZ. When the corresponding phrase is hit in the keyword database DB1 (Yes in # 23), the image GP of the page PG is displayed on the display device 5 (# 24).

  When there are two or more displayed images GP, the images GP are narrowed down according to the content of the questioner's statement. When the number of displayed images GP becomes one, or in response to an operation input from a presenter or the like, the image GP in the question is determined (# 25).

  As described above, in the presentation using the display system 1, the step of sequentially displaying the image GP for presentation on the display device 5 in the normal display mode, the step of switching to the control display mode after giving the presentation, And switching the image GP according to the sound input from the sound input device 4 in the display mode and displaying the image GP on the display device 5.

  In the embodiment described above, the contents, configuration, items, and the like of the keyword database DB1, the image storage unit 15A, and the attribute information storage unit 134 can be variously changed in addition to those described above.

  In the embodiment described above, the image control unit 12, the image output unit 12A, the voice recognition unit 13, the search unit 14, the storage unit 15, the image storage unit 15A, the keyword storage unit 15B, the terminal device 3, the voice input device 4, The configuration, structure, circuit, processing content, processing order, processing timing, screen content, display method, and the like of each part or the whole of the display device 5 or the display system 1 can be appropriately changed in accordance with the gist of the present invention. .

1 Display system 3 Terminal device 3
4 voice input device 5 display device 12 image control unit 12A image output unit 13 voice recognition unit 14 search unit 15 storage unit 15A image storage unit 15B keyword storage unit 16 operation unit 121 normal display unit 122 control display unit 131 voice analysis unit 132 pronunciation Person specifying unit 133 attribute phrase detection unit 134 attribute information storage unit GP image GPT specific image KW keyword WS, WZ phrase DB keyword database

Claims (9)

A display control device for controlling an image displayed on a display device,
An image storage unit for storing a plurality of images to be displayed on the display device;
An image output unit for outputting one or more images of the plurality of images stored in the image storage unit for displaying on the display device;
A keyword storage unit for storing one or more keywords set corresponding to each of the plurality of images;
A voice analysis unit that analyzes a voice input from the voice input means and outputs a phrase corresponding to the voice;
A search unit that searches the keyword storage unit based on a phrase output from the speech analysis unit;
A control display unit that controls the image output unit to display the image corresponding to the keyword searched by the search unit on the display device;
A display control device comprising: When the control display unit controls the display device to display a plurality of images corresponding to the keyword searched by the search unit, the control display unit displays the plurality of images by the keyword further searched by the search unit. Control to narrow down and display on the display device,
The display control apparatus according to claim 1. The image output unit has, as an image display mode, a normal display mode for switching an image to be displayed on the display device based on a user operation input, and a control display mode for display by control of the control display unit.
The display control apparatus according to claim 1 or 2. A specific image is stored in the image storage unit,
The image output unit is switched to the control display mode automatically or based on a user operation input when outputting to display the specific image on the display device in the normal display mode.
The display control apparatus according to claim 3. The specific image is set to be displayed at the end of the image to be displayed in the normal display mode.
The display control apparatus according to claim 4. The keyword stored in the keyword storage unit includes a phrase included in a title which is attribute information given to the image.
The display control apparatus according to claim 1. The keyword stored in the keyword storage unit includes a phrase indicating the type, color, or shape of the content of each image,
The display control apparatus according to claim 1. A sound generator specifying unit for analyzing a sound input from the sound input means and specifying a sound generator who has emitted the sound;
An attribute information storage unit for storing attribute information corresponding to the pronunciation person;
An attribute word / phrase detection unit that acquires attribute information corresponding to the sound generator specified by the sound generator specifying unit from the attribute information storage unit, and outputs a word / phrase corresponding to the acquired attribute information to the search unit;
The display control device according to claim 1, comprising: A presentation method using the display control device according to claim 4 or 5,
Sequentially displaying images for presentation on the display device in the normal display mode;
Switching to the control display mode after giving a presentation;
Switching the image according to the sound input from the sound input means in the control display mode and displaying the image on the display device;
Presentation method.

Images