JP2024001625A - Information display control device and information display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To appropriately display reference information, from a keyword based on utterance contents.

SOLUTION: An information display control device 20 that controls an information display device 10 to display information on a display unit 12, comprises: an utterance recognition unit 21 that recognizes utterance of an utterer; an extraction unit 26 that extracts a keyword requiring reference information, from the utterance recognized by the utterance recognition unit 21; an information acquisition unit 27 that acquires reference information to the keyword extracted from the extraction unit 26; the display control unit 28 that displays the reference information acquired by the information acquisition unit 27 on the display unit; and a history recording control unit 25A that performs control to record a display history of the keyword that the display control unit 28 displays the reference information. The display control unit 28 performs weighting on the basis of the display history recorded by the history recording control unit 25A and displays corresponding reference information on the display unit 12.

SELECTED DRAWING: Figure 3

COPYRIGHT: (C)2024,JPO&INPIT

Description

The present invention relates to an information display control device and an information display method.

2. Description of the Related Art In a meeting or conversation, a technique for displaying additional information on words and phrases uttered by the other party is known (for example, see Patent Document 1).

JP 2021-007003 Publication

Additional information displayed in a device such as that disclosed in Patent Document 1 is information that provides explanations for abbreviations and difficult keywords. In meetings and conversations, the same words and phrases may be used repeatedly. However, if the reference information is displayed each time, the user may become distracted from listening to the content of the conference by looking at the additional information.

The present disclosure has been made in view of the above, and an object of the present disclosure is to appropriately display reference information from keywords based on utterance content.

In order to solve the above-mentioned problems and achieve the purpose, an information display control device according to the present disclosure is an information display control device that controls an information display device to display information on a display unit, and which controls the information display device to display information on a display unit, and an extraction unit that extracts a keyword requiring reference information from the utterance recognized by the utterance recognition unit; and an information acquisition unit that acquires the reference information for the keyword extracted by the extraction unit; A display control unit that displays the reference information acquired by the information acquisition unit on the display unit, and a history recording control unit that controls the display control unit to record a display history of keywords for which reference information has been displayed. , the display control section performs weighting based on the display history recorded by the history record control section, and displays the corresponding reference information on the display section.

An information display method according to the present disclosure is an information display method executed by an information display device that displays information on a display unit, and includes a speech recognition step of recognizing an utterance of a speaker, and a speech recognition method based on the utterance recognized in the speech recognition step. , an extraction step of extracting a keyword requiring reference information; an information acquisition step of acquiring the reference information for the keyword extracted in the extraction step; and displaying the reference information acquired in the information acquisition step on the display unit. a display control step; and a history record control step for controlling to record a display history of the keyword for which the reference information was displayed in the display control step, and in the display control step, the display history of the keyword for which the reference information was displayed is controlled to be recorded. Weighting is performed based on the display history and corresponding reference information is displayed on the display unit.

According to the present disclosure, there is an effect that reference information can be appropriately displayed from a keyword based on the content of the utterance.

FIG. 1 is a schematic diagram showing an example of how an information display device is used. FIG. 2 is a schematic diagram showing another example of how the information display device is used. FIG. 3 is a block diagram showing a configuration example of an information display device having an information display control device according to the first embodiment. FIG. 4 is a diagram showing an example of keyword information. FIG. 5 is a diagram showing an example of history information. FIG. 6 is a flowchart showing an example of the flow of processing in the information display control device according to the first embodiment. FIG. 7 is a flowchart illustrating an example of the flow of processing in the information display control device according to the second embodiment. FIG. 8 is a flowchart showing an example of the flow of processing in the information display control device according to the third embodiment. FIG. 9 is a flowchart illustrating an example of the flow of processing in the information display control device according to the fourth embodiment.

Embodiments of an information display control device and an information display method according to the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the following embodiments.

[First embodiment]
<Information display device>
FIG. 1 is a schematic diagram showing an example of how an information display device is used. FIG. 2 is a schematic diagram showing another example of how the information display device is used. FIG. 3 is a block diagram showing a configuration example of an information display device 10 having an information display control device (hereinafter referred to as "control device") 20 according to the first embodiment. The information display device 10 displays reference information of keywords included in utterances of participants in at least utterance communication such as a meeting or conversation.

As shown in FIG. 1, the information display device 10 is used in a conference (hereinafter referred to as a "real conference") or conversation in which a plurality of participants gather in one place. The information display device 10 used in this case may be implemented as one of the functions of an information terminal device such as a smartphone used by the participant, for example. The real conference shown in FIG. 1 includes a presenter M11, another participant M12, another participant M13, another participant M14, and another participant M15. Another participant M15 is using the information display device 10.

As shown in FIG. 2, the information display device 10 is used in an online conference (hereinafter referred to as a "WEB conference") or conversation in which a plurality of participants participate. The information display device 10 used in this case is, for example, an information terminal device such as a notebook personal computer or a smartphone used when participating in an online web conference or conversation via a web conference system (not shown). It may be implemented as one of the functions.

In the following description, a case will be described in which the system is used in either a real conference or a web conference. When there is no particular need to distinguish between a real conference and a web conference, they are referred to as a conference.

The information display device 10 performs weighting based on the display history of keywords based on the contents of utterances of participants in a conference, and displays corresponding reference information. As shown in FIG. 3, the information display device 10 includes a microphone 11, a display section 12, a history information storage section 15, a keyword information storage section 18, a communication section 19, and a control device 20. The information display device 10 used for the web conference further includes a camera (not shown).

The microphone 11 is a microphone that picks up the voices of participants in the conference who are using the information display device 10 . The microphone 11 outputs the collected audio data to the speech recognition unit 21 of the control device 20 . As shown in FIG. 1, in the case of an information display device 10 used for a real conference, a microphone 11 picks up the voice of a speaker. As shown in FIG. 2, when the information display device 10 is used for a web conference, the microphone 11 picks up the voices of users who are participants and who use the information display device 10.

The display unit 12 is a display including, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 12 displays video based on the video signal output from the display control unit 28 of the control device 20.

The display unit 12 displays reference information corresponding to keywords included in the utterances of conference participants. The range in which reference information is displayed on the display unit 12 is referred to as a reference information display range 110. As shown in FIG. 1, in the case of the information display device 10 used for a real conference, the reference information display range 110 may be displayed on the entire surface of the display unit 12. As shown in FIG. 2, in the case of the information display device 10 used for a web conference, the reference information display range 110 is displayed on a part of the display unit 12, for example, at the bottom, top, left side, or right side. Good too. In the case of the information display device 10 used for a web conference, the reference information display range 110 may be displayed as a pop-up on the display unit 12. The reference information display range 110 is, for example, a range in which about three lines or less of characters are displayed.

As shown in FIG. 2, in the case of the information display device 10 used for a web conference, the display unit 12 displays images of participants, screen-shared materials, and the like.

The keyword information storage unit 18 stores reference information for each keyword as keyword information. The keyword information storage unit 18 is, for example, a recording medium such as a semiconductor memory device such as a RAM or a flash memory. The keyword information storage section 18 may be an external recording section wirelessly connected via the communication section 19.

Keywords are words that require supplementary explanation. Keywords include, for example, words that are not generally known, technical terms, abbreviations, difficult words, and buzzwords.

The reference information is, for example, the meaning and specific explanation of the keyword. If the keyword is an abbreviation, the reference information may be the full, abbreviated name. Note that the explanation may be, for example, a photograph or a diagram in addition to text. The reference information may be, for example, additional information that is additional information about the keyword.

The reference information may have a number of characters, for example, about 100 characters or less, which can be read by a person in about a few seconds.

FIG. 4 is a diagram showing an example of keyword information. In the keyword information shown in FIG. 4, reference information is stored for each keyword, and reference information is searched based on the keyword. The reference information may be stored in advance in addition to information searched using the communication unit 19, which will be described later. For example, for the keyword "○○○", the reference information "○...○" is stored. For example, for the keyword "△△△", the reference information "△...△" is stored.

When reference information is searched on the web by the communication unit 19, for example, information from a specific web media such as Wikipedia (registered trademark) for a keyword, the latest news regarding the keyword, etc. are searched. Furthermore, if the keyword is a product name or service name, the website of the provider that provides the product or service is searched. Furthermore, the content displayed at the top of the results searched by a search engine on the web, excluding advertisements, may be used as reference information.

The history information storage unit 15 stores history information indicating the display history of keywords for which reference information has been displayed. The history information storage unit 15 is, for example, a recording medium such as a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory. The history information storage section 15 may be an external recording section wirelessly connected via the communication section 19.

The display history stored as history information includes, for example, the most recently displayed date and time, the most recently displayed date and time for a predetermined number of times, all displayed dates and times within a predetermined period, or all displayed dates and times. It is.

FIG. 5 is a diagram showing an example of history information. In the history information shown in FIG. 5, the date and time when reference information was displayed is stored for each keyword, and the history information is searched based on the keyword.

The communication section 19 is a communication unit for performing wireless communication and the like. The communication unit 19 communicates using a communication method using, for example, Wi-Fi (registered trademark) or a mobile phone line, and is connected to an intranet or the Internet. Communication of the communication unit 19 is controlled by a communication control unit 29 of the control device 20 . As shown in FIG. 1, in the case of the information display device 10 used for a real conference, the communication section 19 acquires keyword information from the keyword information storage section 18, which is an external recording section, and searches for reference information. As shown in FIG. 2, in the case of the information display device 10 used for a web conference, the communication unit 19 communicates audio and video of participants with the information display device 10 used by other participants. and searches for reference information. More specifically, the communication unit 19 transmits the participant's voice captured by the microphone 11 and the participant's video captured by the camera to the information display device 10 used by other participants. The communication unit 19 receives audio and video of other participants from the information display device 10 used by the other participants.

In the following description, the input voice is the voice picked up by the microphone 11 in the case of the information display device 10 used for a real conference. Inputted audio includes, in the case of the information display device 10 used for the web conference, the audio collected by the microphone 11 and the information display device used by other participants acquired via the communication unit 19. This is the voice of another participant obtained from 10.

<Information display control device>
The control device 20 controls each part of the information display device 10. The control device 20 controls the information display device 10 to display information on the display unit 12. The control device 20 is, for example, an arithmetic processing device (control device) configured with a CPU (Central Processing Unit), an MPU (Micro Processing Unit), etc., and has a storage device such as a RAM or a ROM (Read Only Memory). The control device 20 loads a stored program into memory and executes instructions included in the program. The control device 20 includes an internal memory such as the above-mentioned RAM, and the internal memory is used for temporary storage of data in the control device 20. The control device 20 includes an utterance recognition section 21, a history record control section 25A, a history information acquisition section 25B, an extraction section 26, and an information acquisition section 27 as components such as functional blocks realized by executing a program. , a display control section 28, and a communication control section 29.

The utterance recognition unit 21 recognizes at least the utterances of participants participating in communication through speech. The speech recognition unit 21 analyzes the input speech and recognizes the content of the speech contained in the speech. The utterance recognition unit 21 performs acoustic model analysis for each phoneme or word on input speech, and recognizes the content of the utterance by comparing the acoustic model with a phoneme model and a language model.

The history recording control unit 25A controls the display control unit 28 to record, in the history information storage unit 15, history information indicating the display history of the keyword for which reference information has been displayed. When the display control unit 28 displays reference information, the history recording control unit 25A records history information of the corresponding keyword. The keyword display history information includes date and time information and number of times the reference information for each keyword was displayed. The reference information may be reset at a predetermined period of time, such as 5 days, or at the end of the conference. Therefore, weighting can be performed based on the display history of reference information for each predetermined period or for each meeting.

The history information acquisition unit 25B acquires history information from the history information storage unit 15. Obtaining historical information also includes referencing historical information.

The extraction unit 26 extracts keywords requiring reference information from the utterance recognized by the utterance recognition unit 21.

The information acquisition unit 27 acquires reference information for the keyword extracted by the extraction unit 26, that is, the keyword for which the extraction unit 26 determines that reference information is required. In this embodiment, the information acquisition unit 27 acquires reference information for keywords based on information on the web.

The display control unit 28 controls the display of images on the display unit 12. The display control unit 28 outputs a video signal of a video to the display unit 12.

The display control unit 28 controls the display of the reference information acquired by the information acquisition unit 27 on the display unit 12. The display control unit 28 outputs a video signal for displaying the reference information corresponding to the keyword extracted by the extraction unit 26 in the reference information display range 110 of the display unit 12. The display control unit 28 displays the reference information for a predetermined display period of about 5 seconds to 10 seconds, for example. When displaying the next reference information while displaying the reference information, the display control unit 28 may change the display to the next reference information even before the predetermined display period has elapsed.

The display control unit 28 performs weighting based on the display history of the keyword recorded by the history recording unit 15 based on the history information acquired by the history information acquisition unit 25B, and displays the corresponding reference information on the display unit 12. . In the present embodiment, if the display control unit 28 determines that reference information has been displayed within a predetermined period in the past based on the history information acquired by the history information acquisition unit 25B, the display control unit 28 displays the corresponding reference information on the display unit. Do not display on 12. If the display control unit 28 does not determine that reference information has been displayed within a predetermined period in the past based on the history information acquired by the history information acquisition unit 25B, the display control unit 28 displays the corresponding reference information on the display unit 12. This is because if the same keyword is used repeatedly and reference information has been displayed within a predetermined period in the past, there is a high possibility that the user remembers the reference information.

The predetermined period is, for example, a period from the start of one conversation or conference to the present. The predetermined period may be, for example, from the start to the end of a web conference, from the start to the end of use of an information display application, etc. The predetermined period may be, for example, the last five days.

When the information display device 10 is used for a web conference, the display control unit 28 controls the display of images of the web conference. The display control unit 28 outputs a video signal of the web conference video including the video captured by the camera.

The communication control unit 29 controls communication by the communication unit 19. As shown in FIG. 1, in the case of the information display device 10 used in a real conference, the communication control unit 29 receives keyword information from the keyword information storage unit 18, which is an external recording unit, via the communication unit 19. , controls to search for reference information. As shown in FIG. 2, when the information display device 10 is used for a web conference, the communication control unit 29 communicates with the information display device 10 used by other participants via the communication unit 19. It communicates the audio and video of the participants with each other and controls the search for reference information. More specifically, the communication control unit 29 transmits, via the communication unit 19, the participant's voice captured by the microphone 11 and the participant's video captured by the camera to an information display device used by other participants. 10. The communication control unit 29 controls the communication unit 19 to receive audio and video of other participants from the information display device 10 used by the other participants.

<Information processing in the information display control device>
Next, the flow of processing in the control device 20 will be explained using FIG. 6. FIG. 6 is a flowchart showing an example of the flow of processing in the information display control device according to the first embodiment. The process shown in FIG. 6 is started by starting an application for displaying reference information in the case of the information display device 10 used for a real conference as shown in FIG. As shown in FIG. 2, in the case of the information display device 10 used for a web conference, the process starts by activating an application for holding a web conference or by starting a web conference. In this case, the application for conducting the web conference may include a function for displaying reference information, and the function for displaying reference information may be turned on or off by user operation. When the information display device 10 is activated, the processing of the flowchart shown in FIG. 6 is started.

The control device 20 starts speech recognition (step S101). More specifically, the control device 20 uses the speech recognition unit 21 to analyze the input speech and recognize the speech content included in the speech. The control device 20 proceeds to step S102.

The control device 20 determines whether a keyword has been extracted (step S102). More specifically, the control device 20 uses the extraction unit 26 to extract keywords requiring reference information from the utterance recognized by the utterance recognition unit 21. If the control device 20 determines that the keyword has been extracted (Yes in step S102), the process proceeds to step S103. If the control device 20 does not determine that the keyword has been extracted (No in step S102), the process proceeds to step S105.

When determining that the keyword has been extracted (Yes in step S102), the control device 20 determines whether reference information has been displayed within a predetermined period in the past (step S103). The control device 20 determines whether the reference information was displayed within a predetermined period in the past based on the history information acquired by the history information acquisition unit 25B. If the control device 20 determines that the reference information has been displayed within the past predetermined period (Yes in step S103), the process proceeds to step S105. If the control device 20 does not determine that the reference information has been displayed within the past predetermined period (No in step S103), the process proceeds to step S104.

If it is not determined that the reference information has been displayed within the past predetermined period (No in step S103), the control device 20 acquires the reference information and displays it for a predetermined display period (step S104). More specifically, the control device 20 uses the information acquisition unit 27 to acquire reference information for the extracted keyword. The control device 20 causes the display control unit 28 to output a video signal of reference information corresponding to the keyword extracted by the extraction unit 26 for a predetermined display period. The control device 20 records the history information of the keyword whose reference information is displayed in the history information storage unit 15 using the history recording control unit 25A. The control device 20 proceeds to step S105.

The control device 20 determines whether or not to end the process (step S105). For example, the power of the information display device 10 is turned off, an operation unit (not shown) is operated, or an operation is performed to terminate the application that triggered the start of the flowchart shown in FIG. 6. Due to this, it is determined that the process is to be terminated. When the control device 20 determines to end the process (Yes in step S105), it ends the process. If the control device 20 does not determine to end the process (No in step S105), it executes the process in step S102 again.

<Effect>
As described above, in this embodiment, weighting is performed based on the display history of keywords, and the corresponding reference information is displayed on the display unit 12. In this embodiment, for example, if it is not determined that reference information has been displayed within a predetermined period in the past, the corresponding reference information is displayed on the display unit 12. In the present embodiment, when the same keyword is repeatedly used in a conference, reference information can be suppressed from being displayed each time. This embodiment can reduce the possibility that the user will not listen to the content of the meeting by looking at the reference information. In this manner, according to the present embodiment, reference information can be appropriately displayed based on keywords based on the content of the utterance.

[Second embodiment]
The information display device 10 according to this embodiment will be described with reference to FIG. 7. FIG. 7 is a flowchart illustrating an example of the flow of processing in the information display control device according to the second embodiment. The information display device 10 has the same basic configuration as the information display device 10 of the first embodiment. In the following description, components similar to those of the information display device 10 are denoted by the same or corresponding symbols, and detailed description thereof will be omitted. In the present embodiment, the information display device 10 causes the display unit 12 to display reference information preferentially for keywords whose reference information was displayed at an earlier time in a meeting. In this embodiment, the processing in the display control unit 28 is different from the first embodiment. When reference information for a keyword is displayed a long time ago, it means that the period from when reference information for a keyword is displayed until when the same keyword is extracted is long.

In the present embodiment, the display control unit 28 causes the display unit 12 to display reference information preferentially for keywords for which the reference information was displayed earlier, based on the history information acquired by the history information acquisition unit 25B. When there are multiple keywords for which reference information is to be displayed, the display control unit 28 preferentially displays the reference information for keywords for which the reference information was displayed earlier, based on the history information acquired by the history information acquisition unit 25B. is displayed on the display unit 12. This is because there is a higher possibility that the user has forgotten reference information that was displayed earlier than reference information that is newer.

Next, the flow of processing in the control device 20 will be described using FIG. 7. The processes in steps S111, S112, S115, and S116 shown in FIG. 7 are similar to steps S101, S102, S104, and S105 in the flowchart shown in FIG.

When determining that a keyword has been extracted (Yes in step S112), the control device 20 determines whether there are multiple keywords for which reference information is to be displayed (step S113). The control device 20 determines from the extraction result of the extraction unit 26 whether there are a plurality of keywords for which reference information is to be displayed. If the control device 20 determines that there are multiple keywords for which reference information is to be displayed (Yes in step S113), the process proceeds to step S114. If the control device 20 does not determine that there are multiple keywords for displaying reference information (No in step S113), the process proceeds to step S115.

If it is determined that there are multiple keywords for which reference information is to be displayed (Yes in step S113), the control device 20 acquires the reference information for the keyword for which the previous reference information display is older and displays it for a predetermined display period ( Step S114). More specifically, the control device 20 uses the information acquisition unit 27 to acquire reference information for the keyword whose previous reference information display is older, based on the history information acquired by the history information acquisition unit 25B. The control device 20 causes the display control unit 28 to output, for a predetermined display period, a video signal of reference information corresponding to the keyword whose previous reference information display is older. The control device 20 proceeds to step S116.

For example, if keyword A requiring reference information and keyword B requiring reference information are extracted, which was determined as Yes in step S113, the reference information for keyword A is displayed one hour ago, and the reference information for keyword B is displayed 1 hour ago. If the keyword A has been displayed minutes ago, reference information for the keyword A is displayed in step S114. In this case, keyword A is a keyword whose previous reference information display is older than keyword B.

When extracting keywords based on the utterances of the same speaker, multiple keywords are not extracted at the same time, but are extracted with a time difference. Therefore, for example, if keyword A is extracted, the display of reference information for keyword A is started, and keyword B is extracted before the predetermined period for displaying the reference information has elapsed, the reference information for keyword B will not be displayed. The reference information for keyword A continues to be displayed. In addition, if keyword B is extracted and the display of reference information for keyword B is started, and keyword A is extracted before the predetermined period for displaying reference information has elapsed, instead of displaying the reference information for keyword B, Reference information for keyword A is displayed.

<Effect>
As described above, in the present embodiment, reference information is preferentially displayed on the display unit 12 for keywords for which reference information was displayed at an earlier time based on history information. According to this embodiment, reference information for keywords required by the user can be displayed with priority.

[Third embodiment]
The information display device 10 according to this embodiment will be described with reference to FIG. 8. FIG. 8 is a flowchart showing an example of the flow of processing in the information display control device according to the third embodiment. The basic configuration of the information display device 10 is the same as that of the information display device 10 of the first embodiment. In this embodiment, the information display device 10 causes the display unit 12 to display reference information preferentially for keywords for which the number of times the reference information has been displayed is small. In this embodiment, the processing in the display control unit 28 is different from the first embodiment.

The display control unit 28 causes the display unit 12 to display reference information preferentially for keywords for which the number of times the reference information has been displayed is small, based on the history information acquired by the history information acquisition unit 25B. In the present embodiment, the display control unit 28 displays the reference information on the display screen when the number of times the reference information has been displayed does not exceed a predetermined number of times, which is a threshold value, based on the history information acquired by the history information acquisition unit 25B. 12 may be displayed. For example, the display control unit 28 may not display the reference information on the display unit 12 if the number of times the reference information has been displayed exceeds a predetermined number of times based on the history information acquired by the history information acquisition unit 25B. . This is because the more times the same keyword is used repeatedly and the reference information is displayed, the more likely the user will remember the reference information.

Next, the flow of processing in the control device 20 will be described using FIG. 8. The processes in steps S121, S122, S124, and S125 shown in FIG. 8 are similar to steps S101, S102, S104, and S105 in the flowchart shown in FIG.

When determining that the keyword has been extracted (Yes in step S122), the control device 20 determines whether the reference information has been displayed a predetermined number of times (step S123). The control device 20 determines whether the number of times the reference information has been displayed exceeds a predetermined number of times based on the history information acquired by the history information acquisition unit 25B. If the control device 20 determines that the reference information display has exceeded the predetermined number of times (Yes in step S123), the process proceeds to step S125. If the control device 20 does not determine that the reference information display has exceeded the predetermined number of times (No in step S123), the process proceeds to step S124.

For example, if the predetermined number of times for which the answer in step S123 is Yes is set to twice per meeting, reference information will not be displayed for the same keyword that requires reference information until the second extraction from the start of the meeting. Ru. After the third extraction for the same keyword, reference information will not be displayed until the end of the meeting.

<Effect>
As described above, in this embodiment, reference information is preferentially displayed on the display unit 12 for keywords for which the number of times reference information has been displayed is small. According to this embodiment, reference information for keywords required by the user can be displayed with priority.

[Fourth embodiment]
The information display device 10 according to this embodiment will be described with reference to FIG. 9. FIG. 9 is a flowchart illustrating an example of the flow of processing in the information display control device according to the fourth embodiment. The basic configuration of the information display device 10 is the same as that of the information display device 10 of the first embodiment. In this embodiment, when there are multiple keywords for which reference information is to be displayed simultaneously, the information display device 10 causes the display unit 12 to display the reference information for the prioritized keyword. In this embodiment, the processing in the display control unit 28 is different from the first embodiment.

When there are multiple keywords whose reference information is to be displayed simultaneously, the display control unit 28 causes the display unit 12 to display the reference information for the prioritized keyword. In the present embodiment, the display control unit 28 causes the display unit 12 to preferentially display the reference information for the keyword whose reference information is displayed less often, for example, based on the history information acquired by the history information acquisition unit 25B. Good too.

Next, the flow of processing in the control device 20 will be described using FIG. 9. The processing from step S131 to step S133, step S135, and step S136 shown in FIG. 9 is the same as the processing from step S111 to step S113, step S115, and step S116 of the flowchart shown in FIG.

If it is determined that there are multiple keywords for which reference information is to be displayed (Yes in step S133), the control device 20 acquires the reference information for the keyword with fewer reference information display times and displays it for a predetermined display period ( Step S134). More specifically, the control device 20 uses the information acquisition unit 27 to acquire reference information for the keyword whose reference information is displayed fewer times, based on the history information acquired by the history information acquisition unit 25B. The control device 20 causes the display control unit 28 to output a video signal of the reference information corresponding to the keyword whose reference information is displayed fewer times for a predetermined display period. The control device 20 proceeds to step S136.

For example, if keyword A requiring reference information and keyword B requiring reference information are extracted, which was determined as Yes in step S133, the reference information for keyword A is displayed once within the same meeting, and the reference information for keyword B is displayed once. If the information has been displayed three times, reference information for keyword A is displayed in step S134. In this case, keyword A is a keyword whose reference information is displayed fewer times than keyword B.

When extracting keywords based on the utterances of the same speaker, multiple keywords are not extracted at the same time, but are extracted with a time difference. Therefore, for example, if keyword A is extracted, the display of reference information for keyword A is started, and keyword B is extracted before the predetermined period for displaying the reference information has elapsed, the reference information for keyword B will not be displayed. The reference information for keyword A continues to be displayed. In addition, if keyword B is extracted and the display of reference information for keyword B is started, and keyword A is extracted before the predetermined period for displaying reference information has elapsed, instead of displaying the reference information for keyword B, Reference information for keyword A is displayed.

<Effect>
As described above, in this embodiment, when there are multiple keywords whose reference information is to be displayed at the same time, the reference information for the keyword whose reference information is displayed fewer times is preferentially displayed on the display unit 12. According to this embodiment, reference information for keywords required by the user can be displayed with priority.

[Modification 1]
The past predetermined period in the first embodiment described above may be changed depending on the level of necessity of the keyword. For example, the higher the necessity level, the shorter the past predetermined period may be. For example, the higher the difficulty level, the shorter the past predetermined period may be. For example, the higher the public knowledge level, the longer the past predetermined period may be.

Explain the level of need. The keyword information storage unit 18 stores, as keyword information, a necessity level and reference information for each keyword. The necessity level is a level indicating a guideline for displaying reference information for each keyword, and includes, for example, a difficulty level and a well-known level.

The difficulty level indicates the difficulty of a keyword that is a difficult word. For example, the difficulty level is indicated in five stages using numerical values from 1 to 5. Regarding the difficulty level, the higher the difficulty, that is, the more difficult the word is, the larger the numerical value becomes. The popularity level indicates the popularity of a keyword, such as a phrase, a technical term, or an abbreviation that is not generally known. The well-known level is indicated by a numerical value from 1 to 5, for example, in five stages. As for the well-known level, the higher the well-known word, that is, the more well-known the word, the larger the numerical value becomes.

[Modification 2]
The threshold value of the number of times in the third embodiment described above may be changed depending on the level of necessity of the keyword. For example, the higher the necessity level, the smaller the threshold value for the number of times. For example, the higher the difficulty level, the smaller the threshold value for the number of times. For example, the higher the well-known level, the larger the threshold value for the number of times may be set.

The information display device according to the present disclosure may be implemented in various different forms other than the embodiments described above.

Each component of the illustrated information display device is functionally conceptual, and does not necessarily have to be physically configured as illustrated. In other words, the specific form of each device is not limited to what is shown in the diagram, and all or part of it may be functionally or physically distributed or integrated into arbitrary units depending on the processing load and usage status of each device. It's okay.

The configuration of the information display device is realized by, for example, a program loaded into a memory as software. The above embodiments have been described as functional blocks realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms using only hardware, only software, or a combination thereof.

The above-mentioned components include those that can be easily imagined by those skilled in the art and that are substantially the same. Furthermore, the above configurations can be combined as appropriate. Furthermore, various omissions, substitutions, or changes in the configuration are possible without departing from the gist of the present invention.

10 Information display device 11 Microphone 12 Display section 15 History information storage section 18 Keyword information storage section 19 Communication section 20 Control device (information display control device)
21 Speech recognition unit 25A History record control unit 25B History information storage unit 26 Extraction unit 27 Information acquisition unit 28 Display control unit 29 Communication control unit

Claims (5)

An information display control device that controls an information display device to display information on a display section,
a speech recognition unit that recognizes the speech of the speaker;
an extraction unit that extracts a keyword requiring reference information from the utterance recognized by the utterance recognition unit;
an information acquisition unit that acquires the reference information for the keyword extracted by the extraction unit;
a display control unit that displays the reference information acquired by the information acquisition unit on the display unit;
a history recording control unit that controls the display control unit to record a display history of keywords for which reference information has been displayed;
Equipped with
The display control unit performs weighting based on the display history recorded by the history record control unit and displays the corresponding reference information on the display unit.
Information display control device. The display control unit causes the display unit to display the reference information preferentially for keywords for which the reference information was displayed earlier.
The information display control device according to claim 1. The display control unit causes the display unit to display the reference information preferentially for keywords for which the reference information has been displayed less frequently.
The information display control device according to claim 1. The display control unit causes the display unit to display the reference information for the keyword prioritized based on the display history when there are multiple keywords for which the reference information is displayed at the same time.
The information display control device according to any one of claims 1 to 3. An information display method executed by an information display device that displays information on a display unit, the method comprising:
a speech recognition step for recognizing the utterance of the speaker;
an extraction step of extracting keywords requiring reference information from the utterances recognized in the utterance recognition step;
an information acquisition step of acquiring the reference information for the keyword extracted in the extraction step;
a display control step of displaying the reference information acquired in the information acquisition step on the display unit;
a history recording control step of controlling to record a display history of the keyword for which the reference information was displayed in the display control step;
including;
In the display control step, weighting is performed based on the display history recorded in the history recording control step, and corresponding reference information is displayed on the display unit.
Information display method.

Images