US20200159801A1 - Display Device - Google Patents

Display Device Download PDF

Info

Publication number
US20200159801A1
US20200159801A1 US16/618,094 US201816618094A US2020159801A1 US 20200159801 A1 US20200159801 A1 US 20200159801A1 US 201816618094 A US201816618094 A US 201816618094A US 2020159801 A1 US2020159801 A1 US 2020159801A1
Authority
US
United States
Prior art keywords
term
search
unit
page
extraction unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/618,094
Other languages
English (en)
Inventor
Kiyoshi Sekine
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Interactive Solutions Inc
Original Assignee
Interactive Solutions Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Interactive Solutions Inc. filed Critical Interactive Solutions Inc.
Publication of US20200159801A1 publication Critical patent/US20200159801A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/332—Query formulation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G06F16/43—Querying
    • G06F16/438—Presentation of query results
    • G06F16/4387—Presentation of query results by the use of playlists
    • G06F16/4393—Multimedia presentations, e.g. slide shows, multimedia albums
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9538—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/3332—Query translation
    • G06F16/3334—Selection or weighting of terms from queries, including natural language queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/953—Querying, e.g. by the use of web search engines
    • G06F16/9535—Search customisation based on user profiles and personalisation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1815—Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L2015/088—Word spotting
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Definitions

  • the present invention relates to a display device for supporting conversation capable of proposing an appropriate page of presentation corresponding to conversation during conversation.
  • Japanese Patent No. 4551105 discloses a conference support system using voice recognition.
  • the voice recognition recognizes voice as text, so that it cannot read out an appropriate slide.
  • the term does not necessarily match with a search term associated with the slide, failing to appropriately read out the slide.
  • the present invention aims to provide a presentation system that effectively displays a keyword for selecting a next slide during presentation.
  • the present invention is basically based on a knowledge that a page candidate of presentation material associated with conversation is made to be extracted using not only a term included in conversation but also a term associated with the term to enable to appropriately propose a page candidate of presentation material associated with conversation.
  • the present invention relates to a display device including a computer and a mobile terminal.
  • the display device is capable of displaying information to read out a page of presentation material associated with conversation.
  • the display device includes a voice recognition unit 53 , a conversation-derived term extraction unit 55 , a search keyword storage unit 57 , a search keyword extraction unit 59 , a material storage unit 61 , a relevant page information extraction unit 63 , a selection term extraction unit 65 , and a selection term display unit 71 .
  • the voice recognition unit 53 is an element to perform voice recognition.
  • the conversation-derived term extraction unit 55 is an element that extracts a plurality of conversation-derived terms from conversation information recognized by the voice recognition unit 53 .
  • the search keyword storage unit 57 is an element for storing conversation-derived term and search keyword in an associated manner.
  • the search keyword extraction unit 59 is an element for extracting a plurality of search keywords from the search keyword storage unit 57 using a plurality of conversation-derived terms extracted by the conversation-derived term extraction unit 55 .
  • the material storage unit 61 is an element for storing each page of a plurality of presentation materials, search term of each page, and score of each search term in an associated manner.
  • the relevant page information extraction unit 63 is an element for extracting a page of presentation material associated with search keyword from the material storage unit 59 using the search keyword extracted by the search keyword extraction unit 59 as a search term.
  • the selection term extraction unit 65 is an element for extracting a search keyword as a selection term for selecting a slide in a case where a page of presentation material extracted by the relevant page information extraction unit 63 exists.
  • the selection term display unit 71 is an element for making the display unit 69 display the selection term extracted by the selection term extraction unit 65 .
  • the above-mentioned display device includes the above-mentioned each unit, enabling to display selection term on the display unit 69 .
  • the relevant page information extraction unit 63 may extract one or a plurality of search terms having high score from the material storage unit 59 as a page of presentation material associated with search keyword using the search keyword extracted by the search keyword extraction unit 59 as search term.
  • the display unit 69 may be a display screen of a terminal, and
  • the selection term display unit ( 71 ) may make the selection term extracted by the selection term extraction unit ( 65 ) in a selection term display area 73 existing at a lower portion of the display screen, and
  • the display device may further include a selection term input unit 75 that receives information indicating that the selection term displayed is selected, and
  • a page candidate read out unit 77 that, using the selection term input by the selection term input unit 75 , reads out a page candidate of the plurality of presentation materials associated with the selection term.
  • the display device may further include
  • a page selection information input unit 79 that receives information indicating that a specific page of presentation material is selected from among the plurality of page candidates of presentation material read out by the page candidate read out unit 77 .
  • the display device is capable of displaying the page of presentation material selected on the display unit 69 using the information related to the page of presentation material selected by the page selection information input unit 79 .
  • the display device preferably further includes
  • a search material information storage device 23 including
  • a term extraction unit 3 that extracts a term in material that is a term included in a certain page of material
  • a keyword storage unit 5 that stores a term that becomes a keyword associated with the term in material
  • a keyword extraction unit 7 that extracts a plurality of keywords that become a keyword associated with the term in material from the keyword storage unit 5 using the term in material extracted by the term extraction unit 3 ,
  • a topic word storage unit 9 that stores a topic word associated with the key word
  • a topic word extraction unit 11 that, using the plurality of keywords extracted by the keyword extraction unit 7 , extracts the topic word associated with the keywords from the topic word storage unit 9 ,
  • search term candidate extraction unit 13 that extracts a candidate of search term of a certain page of the material from the topic word extracted by the topic word extraction unit 11 and the plurality of keywords extracted by the keyword extraction unit 7 ,
  • search term candidate display unit 17 that makes a display unit 15 display the candidate of search term extracted by the search term candidate extraction unit 13 ,
  • a search term input unit 19 that receives an input indicating being a search term among candidates of search term displayed on the display unit 15 , and
  • a material search information storage unit 21 that stores the search term input by the search term input unit 19 and information related to the certain page of the material in an associated manner.
  • the present invention also provides a program and a computer readable recording medium that records the program, the program causing a computer to function as the display device including
  • a voice recognition unit 53 that performs voice recognition
  • a conversation-derived term extraction unit 55 that extracts a plurality of conversation-derived terms from conversation information recognized by the voice recognition unit 53 ,
  • search keyword storage unit 57 that stores conversation-derived term and search keyword in an associated manner
  • search keyword extraction unit 59 that extracts a plurality of search keywords from the search keyword storage unit 57 using the plurality of conversation-derived terms extracted by the conversation-derived term extraction unit 55 ,
  • a material storage unit 61 that stores each page of a plurality of presentation materials, a search term of each page, and a score of the search term in an associated manner
  • a relevant page information extraction unit 63 that, using a search keyword extracted by the search keyword extraction unit 59 as the search term, extracts a page of presentation material associated with the search keyword from the material storage unit 59 ,
  • a selection term extraction unit 65 that extracts the search keyword as a selection term for selecting a slide when the page of presentation material extracted by the relevant page information extraction unit 63 exists
  • a selection term display unit 71 that causes the selection term extracted by the selection term extraction unit 65 to be displayed on a display unit 69 , whereby
  • the selection term is displayed on the display unit 69 .
  • the present invention is capable of providing a presentation system for effectively displaying a keyword for selecting a next slide during presentation.
  • FIG. 1 is a block diagram for illustrating a display device according to the present invention.
  • FIG. 2 is a block diagram illustrating a basic configuration of a computer.
  • FIG. 3 is a conceptual diagram illustrating a system example of the present invention.
  • FIG. 4 is an example of a certain page of presentation material.
  • FIG. 5 is a conceptual diagram illustrating a storage example of a keyword storage unit.
  • FIG. 6 is a conceptual diagram illustrating a storage example of a topic word storage unit.
  • FIG. 7 is a conceptual diagram illustrating a storage example of a category word storage unit.
  • FIG. 8 is a conceptual diagram illustrating extracted (category word), topic word, keyword, and term in material.
  • FIG. 9 is an example of a display screen.
  • FIG. 10 is a flowchart for illustrating a usage example of a search material information storage device according to the present invention.
  • FIG. 11 is a conceptual diagram for illustrating a usage example of the search material information storage device according to the present invention.
  • FIG. 12 is a block diagram for illustrating the search material information storage device according to the present invention.
  • FIG. 13 is a flowchart for illustrating an example of a step of displaying a selection term and a step of displaying a page of presentation material associated with the selection term.
  • FIG. 14 is a conceptual diagram illustrating a display example of a display unit before displaying a selection term.
  • FIG. 15 is a conceptual diagram illustrating a display example of the display unit in a case where a selection term is displayed.
  • FIG. 16 is a conceptual diagram illustrating a state where a page candidate is displayed on the display unit.
  • the present invention relates to a display device including a computer and a mobile terminal.
  • the display device is capable of displaying information to read out a page of presentation material associated with conversation.
  • FIG. 1 is a block diagram for illustrating a display device according to the present invention.
  • This device is a processing device by a computer.
  • the computer may be one of a mobile terminal, a desk-top personal computer, and a server, or a combination of two or more of them. These are typically connected by the Internet (Intranet) or the like so as to be able to transmit and receive information.
  • Functions may be shared by using a plurality of computers, for example, by making any of the computers have some function.
  • FIG. 2 is a block diagram illustrating a basic configuration of the computer.
  • the computer includes an input unit 31 , an output unit 33 , a control unit 35 , an arithmetic unit 37 , and a storage unit 39 , and each element is connected by a bus 41 or the like to be able to transmit and receive information.
  • a control program may be stored in the storage unit, and various kinds of information may be stored in the storage unit.
  • the control unit reads out the control program stored in the storage unit.
  • the control unit appropriately reads out information stored in the storage unit and transmits the information to the arithmetic unit.
  • the control unit also appropriately transmits input information to the arithmetic unit.
  • the arithmetic unit performs arithmetic processing using the various kinds of information received, and an arithmetic result is stored in the storage unit.
  • the control unit reads out the arithmetic result stored in the storage unit and output it from the output unit. In this manner, various kinds of processing are executed. The various kinds of processing are executed by each unit.
  • FIG. 3 is a conceptual diagram illustrating a system example according to the present invention.
  • the system system including the device of the present invention
  • the system may include a mobile terminal 45 connected to the Internet or an intranet 43 , and a server 47 connected to the Internet or the Intranet 43 .
  • a single computer or mobile terminal may function as the device of the present invention, or a plurality of servers may exist.
  • a monitor or a display of the mobile terminal 45 may function as a display unit 69 .
  • the display device includes a voice recognition unit 53 , a conversation-derived term extraction unit 55 , a search keyword storage unit 57 , a search keyword extraction unit 59 , a material storage unit 61 , a relevant page information extraction unit 63 , a selection term extraction unit 65 , and a selection term display unit 71 .
  • the voice recognition unit 53 is an element to perform voice recognition.
  • Voice recognition is known.
  • a microphone for collecting voice and a voice analyzation unit for analyzing the voice input from the microphone are typically included.
  • Voice recognition itself is known as described in Japanese Patent No. 6127422, Japanese Patent No. 6114210, and Japanese Patent No. 6107003 besides Japanese Patent No. 4551105 (Patent Literature 1).
  • the voice recognition unit 53 enables to input voice included in conversation in the device as an input to store a term included in the conversation as data.
  • the voice recognition unit 53 appropriately stores a term included in conversation in the storage unit.
  • the voice recognition unit 53 may store a term as well as information related to volume or change in volume.
  • the conversation-derived term extraction unit 55 is an element that extracts a plurality of conversation-derived terms from conversation information recognized by the voice recognition unit 53 .
  • a term included in conversation is appropriately stored in the storage unit.
  • the storage unit also stores a term capable of being used for search.
  • the term may be, for example, noun.
  • the storage unit may include a term extraction database storing term for term extraction to extract the term included in conversation in accordance with usage such as medical use or bank use.
  • the conversation-derived term extraction unit 55 is sufficient to read out a term for term extraction with reference to the term extraction database, and determine whether the term for extracting term matches with a conversation-derived term stored in the storage unit.
  • the term for term extraction is sufficient to be stored in the storage unit as a “conversation-derived term” in a case where there is a conversation-derived term that matches with the term for term extraction.
  • information related to appearance frequency of “conversation-derived term” and volume or change in volume in conversation during a predetermined period may be stored together in the storage unit.
  • the term extraction database may also store a score indicating probability of becoming to search term for each term together with the term for term extraction.
  • the conversation-derived term extraction unit 55 may extract a candidate of “conversation-derived term” using any one or more of “conversation-derived term” having a high score, “conversation-derived term” having a high frequency, “conversation-derived term” changed in volume (increased in volume), score, frequency, and change in volume as an index.
  • coefficients may be stored for the above-mentioned respective elements to obtain score of conversation-derived term by multiplying the various coefficients. For example, when the coefficient is 1, no change occurs in the score. In contrast, when volume is largely increased, score of conversation-derived term can be adjusted by allocating the coefficient to be from 1.1 to 1.9 depending on degree of the change.
  • the search keyword storage unit 57 is an element for storing conversation-derived term and search keyword in an associated manner.
  • the conversation-derived term is basically term assumed to be included in conversation (e.g., conversation between salesman and customer). In contrast, there is a discrepancy between the term assumed to be included in conversation and the term that is suitable to be used for search. A difference between so called spoken word and written word is also one of the discrepancies. Accordingly, in the present invention the search keyword storage unit 57 stores conversation-derived term and search keyword in an associated manner and converts into search keyword suited for search.
  • the search keyword storage unit 57 may be achieved by the storage unit (storage device), or achieved by a database and a database management system.
  • the storage device stores search keyword corresponding to conversation-derived term for a plurality of conversation-derived terms.
  • the storage device may also record a score used for search in association with search keyword.
  • conversation-derived terms are “losing weight”, “thin”, “slim”, and examples of search keywords corresponding to them are “sliming” “fatness”, body shape”, “physical examination”.
  • the search keyword extraction unit 59 is an element for extracting a plurality of search keywords from the search keyword storage unit 57 using a plurality of conversation-derived terms extracted by the conversation-derived term extraction unit 55 .
  • the search keyword extraction unit 59 extracts search keyword stored in association with conversation-derived term in the search keyword storage unit 57 for each of the plurality of conversation-derived terms.
  • the search keyword extraction unit 59 may extract the score stored with the search keyword.
  • the search keyword extraction unit 59 stores the search keyword (and score) extracted in the storage unit.
  • the search keyword (and score) is extracted from the search keyword storage unit 57 for every (or a predetermined number of) conversation-derived term to store them in the storage unit.
  • the search keyword extraction unit 59 extracts a search keyword using the search keyword (and its score) temporally stored in the storage unit.
  • the search keyword extraction unit 59 may extract a search keyword having a high score.
  • the search keyword extraction unit 59 stores the search keyword extracted in the storage unit.
  • the search keyword extraction unit 59 may store a plurality of search keywords together with scores of the respective search keywords.
  • the material storage unit 61 is an element for storing each page of a plurality of presentation materials, search term of each page, and score of each search term in an associated manner.
  • the relevant page information extraction unit 63 is an element for extracting a page of presentation material associated with search keyword from the material storage unit 59 using the search keyword extracted by the search keyword extraction unit 59 as a search term.
  • Each page of presentation material associated with search term is stored in the material storage unit 61 (together with, for example, score and ranking).
  • the relevant page information extraction unit 63 obtains information for extracting each page of presentation material having high score or ranking from the material storage unit 61 using search keyword.
  • the relevant page information extraction unit 63 may extract one or a plurality of search terms having high score from the material storage unit 59 as a page of presentation material associated with search keyword using the search keyword extracted by the search keyword extraction unit 59 as search term.
  • the selection term extraction unit 65 is an element for extracting a search keyword as a selection term for selecting a slide in a case where a page of presentation material extracted by the relevant page information extraction unit 63 exists.
  • the selection term may be one or plural.
  • the number of search terms may be a predetermined number, for example, three, four, five, or six.
  • the number of search terms may be determined using size of an area of the display unit in which selection term is displayed, font size of selection term, and the number or characters of selection term. In this case, for example, the selection term extraction unit 65 obtains information related to the length of the area in which selection term is displayed. Next, the selection term extraction unit 65 obtains information related to size of character at a portion where selection term is displayed in the display unit.
  • the selection term extraction unit 65 obtains information related to a size other than the size per one-character portion in a case where selection term is displayed.
  • the selection term extraction unit 65 extracts a selection term having a high priority one by one for the reason of, for example, high score or ranking, obtains a length of the selection term portion displayed on the display unit when selection terms are displayed, for example, when one, two, three, four, five, six selection terms are displayed, and compares the length of the selection term portion and the length of the portion where selection terms are displayed. Then, when the length of the selection term portion is shorter than the display portion, one selection term is added. In this manner, the selection term extraction unit 65 can extract the appropriate number of selection terms.
  • the selection term display unit 71 is an element for making the display unit 69 display the selection term extracted by the selection term extraction unit 65 .
  • the above-mentioned display device includes the above-mentioned each unit, enabling to display selection term on the display unit 69 .
  • FIG. 13 is a flowchart for illustrating an example of a process of displaying selection term and a process of displaying the page of presentation material associated with the selected term. S denotes step.
  • a person in charge possessing the above-mentioned display device performs conversation with a customer (start conversation: S 01 ).
  • the voice recognition unit 53 voice-recognizes information related to the conversation including a term including in the conversation (voice recognition step: S 02 ).
  • the information (including term) related to the conversation voice-recognized is appropriately stored in the storage unit.
  • the display device may store a coefficient corresponding to a change of voice such as frequency of term in a predetermined time, increase or decrease of volume in a case where a certain term is uttered, or change of wavelength of voice to read out the predetermined coefficient in association with the term in a case where the information related to the conversation is analyzed.
  • the conversation-derived term extraction unit 55 appropriately reads out the information related to the conversation recognized by the voice recognition unit 53 from the storage unit, and extracts a plurality of conversation-derived terms using the information read out (conversation-derived term extraction step: S 03 ). Since including a database related to conversation-derived term, the display device can select noun or an effective term for search from among the terms included in the conversation by referencing to the database. In this manner, a conversation-derived term is extracted. As to conversation-derived term, a score of the conversation-derived term may be stored in association with the conversation-derived term in consideration of possibility of being used for search.
  • the search keyword storage unit 57 stores conversation-derived term and search keyword in an associated manner.
  • a score of the search keyword may be stored in association with the search keyword in consideration of possibility of being used for search.
  • the search keyword extraction unit 59 extracts a plurality of search keywords from the search keyword storage unit 57 using the pluralities of conversation-derived terms extracted by the conversation-derived term extraction unit 55 (by appropriately reading out from the storage unit) (search keyword extraction step: S 04 ). In this manner, search is performed using not conversation-derived term (there is a case where conversation-derived term is search keyword as it is), but search keyword converted from conversation-derived term, making it possible to search an appropriate page of presentation material.
  • the material storage unit 61 stores each page of a plurality of presentation materials, search term of each page, and score of each search term in an associated manner. Then, using the search keyword extracted by the search keyword extraction unit 59 as a search term, the relevant page information extraction unit 63 extracts a page of presentation material associated with the search keyword from the material storage unit 59 (page extraction step: S 05 ).
  • the page of presentation material need not be displayed in this stage, and one or a plurality of related pages of presentation material is sufficient to exist and information for reading out the related pages (e.g., information related to material ID and the number of pages) is sufficient to be read out.
  • the information for reading out associated page extracted is appropriately stored in the storage unit.
  • the relevant page information extraction unit 63 may extract one or a plurality of search terms having high score from the material storage unit 59 as a page of presentation material associated with search keyword using the search keyword extracted by the search keyword extraction unit 59 as search term.
  • the selection term extraction unit 65 determines whether page of presentation material extracted by the relevant page information extraction unit 63 exists, and when determined that page exists, the selection term extraction unit 65 extracts a search keyword as a selection term to make a slide be selected (selection term extraction step: S 06 ). Note that the search keyword may be extracted as a selection term as it is. Then, the selection term extracted is appropriately stored in the storage unit.
  • the selection term display unit 71 (appropriately reads out the selection term extracted by the selection term extraction unit 65 from the storage unit and) makes the display unit 69 display the selection term extracted by the selection term extraction unit 65 (selection term display step: S 07 ).
  • FIG. 14 is a conceptual diagram illustrating a display example of the display unit before displaying selection term.
  • FIG. 15 is a conceptual diagram illustrating a display example of the display unit in a case where selection term is displayed.
  • selection terms are displayed in a selection term display area 73 existing at a lower portion of a display screen.
  • the display unit is of a touch panel type, and a plurality of selection terms (five selection terms in the example) are display area in the selection term display area 73 . In this manner, selection term is to be displayed on the display unit.
  • any of the selection terms displayed on the touch panel is touched by a person in charge (user) (or a selection term is selected in a state where a cursor is moved by a mouse or the like in a case where the display unit is a monitor of desk-top computer).
  • a selection term input unit 75 inputs information indicating that a specific selection term is selected in the display device, and the display device receives the input information (selection information input step: S 08 ).
  • selection information input step: S 08 selection information input step: The information related to the specific selection term input is appropriately stored in the storage unit.
  • a page candidate read out unit 77 reads outs information related to a page candidate of the plurality of presentation materials related to selection term using the selection term (by appropriately reading out the selection term from the storage unit) input by the selection term input unit 75 .
  • a reduced screen for page candidate is created using the read-out information and the reduced screen is displayed on the display unit (page candidate display step: S 09 ).
  • FIG. 16 is a conceptual diagram illustrating a state where page candidates are displayed on the display unit. In the example illustrated in FIG.
  • a lower portion of the selection term display area 73 or the selection term display area 73 may be moved on an upper direction, and the plurality of page candidates of presentation material made small in their size may be displayed in an aligned manner. Note that the page candidate display step may be omitted.
  • a person in charge (user) presses an upper portion of a page candidate iconified. This makes the display device determine that a specific candidate is selected. That is, a page selection information input unit 79 receives information indicating that a specific page of presentation material is selected from among the plurality of page candidates of presentation material read out by the page candidate read out unit 77 . The information received is input to the display device. The information input (information indicating that a specific page is selected, or information related to specified page) is appropriately stored in the storage unit.
  • the display device makes the page of presentation material selected be displayed on the display unit 69 using the information related to the page of presentation material selected by the page selection information input unit 79 (by appropriately reading out the information from the storage unit unit) (page display step: S 10 ).
  • the display device preferably further includes
  • a search material information storage device 23 including
  • a term extraction unit 3 that extracts a term in material that is a term included in a certain page of material
  • a keyword storage unit 5 that stores a term that becomes a keyword associated with the term in material
  • a keyword extraction unit 7 that extracts a plurality of keywords that become a keyword associated with the term in material from the keyword storage unit 5 using the term in material extracted by the term extraction unit 3 ,
  • a topic word storage unit 9 that stores a topic word associated with the key word
  • a topic word extraction unit 11 that, using the plurality of keywords extracted by the keyword extraction unit 7 , extracts the topic word associated with the keywords from the topic word storage unit 9 ,
  • search term candidate extraction unit 13 that extracts a candidate of search term of a certain page of the material from the topic word extracted by the topic word extraction unit 11 and the plurality of keywords extracted by the keyword extraction unit 7 ,
  • search term candidate display unit 17 that makes a display unit 15 display the candidate of search term extracted by the search term candidate extraction unit 13 ,
  • a search term input unit 19 that receives an input indicating being a search term among candidates of search term displayed on the display unit 15 , and
  • a material search information storage unit 21 that stores the search term input by the search term input unit 19 and information related to the certain page of the material in an associated manner.
  • the search material information storage device includes the term extraction unit 3 , the keyword storage unit 5 , the keyword extraction unit 7 , the topic word storage unit 9 , the topic word extraction unit 11 , the search term candidate extraction unit 13 , the search term candidate display unit 17 , the search term input unit 19 , and the material search information storage unit 21 .
  • Each unit is a unit by a computer, and achieves each processing by collaboration between hardware and software.
  • the term extraction unit 3 is a unit for extracting term in material that is term included in a certain page of material.
  • material is so called a presentation material. Format of the presentation material is not specifically limited. Examples of presentation software include Microsoft (registered trademark), PowerPoint (registered trademark), KINGSOFT (registered trademark) KINGSOFT Office (registered trademark), Apache (registered trademark), OpenOffice Impress (registered trademark), Keynote (registered trademark), Lotus ⁇ Freelance (registered trademark), Illustrator (registered trademark), PDF (registered trademark), and Prezi (registered trademark).
  • An example of material is, for example, a material created by any of the presentation software.
  • the presentation software is software capable of displaying content for each page on, for example, the display unit such as a screen.
  • FIG. 4 is an example of a certain page of presentation material.
  • the presentation material includes a plurality of texts input by a creator.
  • the user can view a plurality of characters.
  • the computer stores information such as text input by the user and input information related to the text (size of character, color of character, presence or absence of animation) with the text.
  • a preferable example of the term extraction unit 3 is to apply evaluation (score) of a text in accordance with input information related to the text (size of character, color of character, presence or absence of animation) when the text is extracted. For example, a possibility of indicating the content of presentation material becomes higher as character becomes larger, so that high score is applied.
  • the term extraction unit 3 is sufficient to store evaluation (score) of effect associated with the text, read out the evaluation as a text related score when term is extracted, and add it to or multiply it to another score for evaluation when a score described below is calculated.
  • the presentation material includes a plurality of kinds of text information.
  • the presentation material is stored in, for example, the server storage unit or the storage unit (in the computer).
  • the term extraction unit 3 reads out each page of presentation material stored, and reads out text included in each page. Then, the term extraction unit 3 subjects the text read out to word class analyzation.
  • word class database exists in the storage unit, and various terms and their word classes are stored therein.
  • score as search term of various terms may be also stored together in the storage unit in accordance with usage.
  • a high score may be assigned to various disease names as compared with general noun. Also, a high score higher may be assigned to various drug names and active ingredients as compared with general noun although the score is lower than that of disease names.
  • the term extraction unit 3 is sufficient to extract term (noun in particular) included in text to extract one or a plurality of terms in material using its frequency or the score of the term stored in the storage unit.
  • the term extraction unit 3 extracts term A, term B, and term C from a certain page, the term C is appeared by two times, the term A and term B are appeared by one time, and scores of the terms A, B, and C stored in the storage unit are respectively 5, 50, and 40, scores of the term A, B, and C are sufficient to be respectively determined to be 5, 50, and 80.
  • the term extraction unit 3 is sufficient to extract the terms C and B as terms in material.
  • the terms in material (terms C and B) extracted are stored in the storage unit in association with the information related to page that allows to read out the page. This enables to read out the terms C and B with their pages.
  • extraction unit 3 is one that identifies a portion where the largest font is used in a certain page of presentation.
  • the term extraction unit 3 applies a predetermined coefficient to a term in material included in the portion where the largest font is used.
  • the coefficient (first coefficient: a 1 ) is sufficient to be stored in the storage unit.
  • the term extraction unit 3 stores the first coefficient in the storage unit together with the term in material included in the portion where the largest font is used.
  • the term extraction unit 3 may also store a coefficient (second coefficient: a 2 ) that depends on the size of font together with the term in material in the storage unit.
  • the keyword storage unit 5 is a unit to store term that becomes a keyword associated with the term in material.
  • the keyword storage unit 5 is sufficient to be provided by a storage unit and an element for reading out information from the storage unit (e.g., control program).
  • the keyword is a term to make search of each page easy by using not only a plurality of terms in material but also a term associated therewith as a search term when each page is searched. This reduces search terms stored in association with each page, enabling quick search.
  • a term in material may be a keyword as it is.
  • the keyword can be regarded as a first conversion word related to term in material.
  • the keyword may be a term suitable to be used for search selected from a plurality of kinds of terms in material.
  • the term in material is a term included in presentation. Accordingly, in some cases, the term in material does not match with search term or is not suitable as search term.
  • a term of ob gene and ob/ob mouse is supposed to be included in presentation. The terms are associated with obesity gene (and obesity, obesity experimental animal).
  • the keyword storage unit 5 stores, in association with ob gene and ob/ob mouse that are terms in material, obesity gene (and obesity, obesity experimental animal) that is their keyword.
  • search term stored in association with each page becomes a unified term. This makes it possible to quickly read out an associated page in search.
  • FIG. 5 is a conceptual diagram illustrating a storage example of the keyword storage unit.
  • the keyword storage unit stores one or a plurality of keywords for each of a plurality of terms in material in an associated manner, and stores scores (this score is referred to as b 1 ) of the respective keywords in an associated manner.
  • the scores are preferably preliminarily input such that the score becomes higher as the keyword becomes more suitable as a term used for search.
  • the keyword extraction unit 7 is a unit for, using a term in material extracted by the term extraction unit 3 , extracting words that become a plurality of keywords associated with the term in material from the keyword storage unit 5 .
  • the keyword storage unit 5 stores a term that becomes a keyword in association with the term in material. This enables the keyword extraction unit 7 to read out a term that becomes a keyword associated with the term in material from the keyword storage unit 5 using the term in material.
  • a plurality of terms in material is extracted from a certain page. Accordingly, a term that becomes a keyword for a certain page is typically extracted by a plurality of times. Also, the number of terms that become a keyword associated with term in material is also plural typically (score may be assigned to each of the terms).
  • a term that becomes a keyword for a certain page is typically extracted by a plurality of times.
  • a term in material is a term that becomes a keyword. That is, a term in material may be extracted as a keyword as it is.
  • the keyword extraction unit 7 may evaluate the score of each of the keywords using the coefficient of term in material and the score of keyword stored in the storage unit.
  • An example of score of keyword is a 1 ⁇ a 2 ⁇ b 1 .
  • a control program for performing the above-mentioned calculation is stored in the storage unit, so that the control unit is sufficient to read out the control program, read out each coefficient and score stored in the storage unit, make the arithmetic unit perform calculation for obtaining a 1 ⁇ a 2 ⁇ b 1 , and make the storage unit store a calculation result.
  • appearance frequency of term in material (this coefficient is referred to as a 21 ) and an addition coefficient in a case where a specific keyword is extracted from among a plurality of types of terms in material (this coefficient is referred to as a 22 ) may be made to be stored in the storage unit, and a score of keyword may be obtained by obtaining a 1 ⁇ a 2 ⁇ a 21 ⁇ a 22 ⁇ b 1 to store the score in the storage unit.
  • a strong coefficient may be applied for an emphasis color included in a certain page.
  • the keyword extraction unit 7 is sufficient to include a unit for analyzing color of term from page, and a storage unit for storing a coefficient for each color, and read out the coefficient related to the color from the storage unit using the color of term analyzed. It is sufficient that coefficient and score are stored for various elements for not only keyword but also topic word and category word in the same manner basically, the coefficient and score are read out, a score is obtained by multiplication, addition, or the like, the score of each word is stored for comparation to obtain a leading candidate.
  • the topic word storage unit 9 is a unit that stores a topic word associated with a keyword.
  • the topic word storage unit 9 is sufficient to be provided by a storage unit and an element (e.g., control program) for reading out information from the storage unit.
  • the topic word storage unit is sufficient to store a topic word such as obesity in association with a keyword such as obesity gene, obesity, or obesity experimental animal).
  • the topic word may be a term that further unifies a plurality of keywords or a term made to be a superordinate concept. Using the topic word enables quick search. Examples of topic word include disease name, drug name, active ingredient name, and pharmaceutical company name. That is, the topic word can be regarded as a second conversion word related to term in material.
  • the topic word may be a term obtained by assigning a term suitable to be used for search for a plurality of kinds of keywords. Also, the topic word may be related to message.
  • the topic word extraction unit 11 is a unit for extracting a topic word associated with a keyword from the topic word storage unit 9 using a plurality of keywords extracted by the keyword extraction unit 7 .
  • a topic word associated with a keyword is stored in the topic word storage unit 9 . Accordingly, the topic word extraction unit 11 extracts a topic word associated with a keyword from the topic word storage unit 9 using the plurality of keywords extracted by the keyword extraction unit 7 .
  • FIG. 6 is a conceptual diagram illustrating a storage example of the topic word storage unit.
  • the topic word storage unit stores one or a plurality of topic words for each of a plurality of keywords in an associated manner, and stores a score of each of the topic words in an associated manner.
  • the scores are preferably preliminarily input such that the score becomes higher as the keyword becomes more suitable as a term used for search.
  • the search term candidate extraction unit 13 is a unit for extracting a candidate of search term of a certain page of material from among the topic word extracted by the topic word extraction unit 11 and the plurality of keywords extracted by the keyword extraction unit 7 .
  • one or a plurality of topic words supposed to be associated with a certain page are stored in the storage unit. Also, a plurality of keywords supposed to be associated with a certain page is stored.
  • the search term candidate extraction unit 13 determines every topic word read out as a candidate of search term and determines the four keywords as candidates of search term.
  • the keyword storage unit 5 may store a plurality of keywords and scores or the respective keywords in an associated manner and the keyword extraction unit 7 may extract the scores of the respective keywords with the plurality of keywords. In this case, for example, a keyword having a high score is extracted as a candidate of search term.
  • the topic word storage unit 9 may store topic words and scores of the respective topic words in an associated manner, and the topic word extraction unit 11 may determine a predetermined number (one or two or more) of keywords having high score from among the plurality of keywords extracted by the keyword extraction unit 7 as topic word leading candidates to extract a topic word associated with the predetermined number (one or two or more) of topic ward leading candidates from the topic word storage unit 9 .
  • the above-mentioned search material information storage device may further include
  • the category word storage unit 25 is a unit for storing category word associated with topic word.
  • the category word extraction unit 27 is a unit for extracting category word associated with topic word from the category word storage unit 25 using the topic word extracted by the topic word extraction unit 11 .
  • the category word can be regarded as a third conversion word related to term in material.
  • the category word may be a selected term suitable to be used for category search for a plurality of kinds of topic words.
  • An example of category word may be one that indicates a target probably having an interest in material. For example, when a certain page of material is of a certain drug for diabetes for the MR (the drug is, for example, sufficient to be stored in association with topic word), examples of category words may be “MR”, “diabetes”, “medicine”.
  • FIG. 7 is a conceptual diagram for illustrating a storage example of the category word storage unit.
  • the category word storage unit stores one or a plurality of category words for each of a plurality of topic words in an associated manner, and stores scores of the respective category words in an associated manner.
  • the scores are preferably preliminarily input such that the score becomes higher as the keyword becomes more suitable as a term used for search.
  • FIG. 8 is a conceptual diagram illustrating (category word), topic word, keyword, and term in material, which are extracted.
  • the search term candidate extraction unit 13 may extract a predetermined number (one or two or more) of keywords having high score from among the plurality of keywords extracted by the keyword extraction unit 7 as candidates of search term.
  • the search term candidate extraction unit 13 may extract a predetermined number (one or two or more) of topic words from among the topic wards extracted by the topic word extraction unit 11 using score of keyword and score of topic word as candidates of search term.
  • the topic word storage unit 9 stores topic words and scores or the respective topic words in an associated manner.
  • the keyword storage unit 5 stores a plurality of keywords and scores of the respective keywords in an associated manner. An original keyword exists for a certain topic word. That is, topic word is one read out using keyword. Topic word results in being constantly associated with one or a plurality of keywords.
  • the search term candidate extraction unit 13 reads out the scorer related to a certain topic word from the topic word storage unit 9 as well as reads out scores of respective keywords that become extraction originates of the topic word from the keyword storage unit 5 . Then, when a plurality of keywords exists for a certain topic word, the search term candidate extraction unit 13 makes the arithmetic unit sum scores of respective keywords as well as multiplies the score of topic word by the score of keyword (or total score of keywords). In this manner, tallied score related to topic word is obtained to make the storage unit store the tallied score.
  • the search term candidate extraction unit 13 reads out the tallied score for a plurality of topic words and makes the arithmetic unit compare the tallied scores to extract a predetermined number (one or two or more) of topic words. In this manner, the search term candidate extraction unit 13 can extracts a predetermined number of topic words even when the number of topic words to be extracted is determined.
  • the search term candidate display unit 17 is a unit for making the display unit 15 display a candidate of search term extracted by the search term candidate extraction unit 13 .
  • the display unit 15 may make the display unit 15 display, as candidates of search term, a predetermined number of (one or two or more) keywords extracted as candidates of search term and a predetermined number of (one or two or more) topic words extracted as candidates of search term,
  • search term input unit 19 when the search term input unit 19 receives an input indicating that one of the preliminary candidates of search term is determined as a search term, may determine the one of the preliminary candidates of search term as a search term, and
  • the candidates of search term may determine the candidates of search term as search terms except one of the candidates for which an input indicating not a search term is received.
  • the material search information storage unit 21 is a unit for storing the search term input by the search term input unit 19 and information related to a certain page of material in an associated manner.
  • the device of the present invention may be one that further displays a candidate of content type in accordance with a kind of presentation material and stores the content type in association with each page of presentation (or presentation itself).
  • the device of the present invention reads out format of presentation (Power Point (registered trademark), PDF (registered trademark), Word (registered trademark), or the like) stored in the storage unit.
  • the device of the present invention reads out text included in the format read out.
  • the device of the present invention includes a term database for analyzing content storing term for analyzing content.
  • the device of the present invention analyzes type of content using the term stored in the term database for analyzing content.
  • FIG. 9 is an example of the display screen.
  • a certain page of presentation material is displayed at an upper half portion of the display screen.
  • an icon for adoption and rejection (checkbox) as well as a candidate of each search term are displayed Candidates of search term are aligned in the order of category word, topic word, and keyword from left in the example of FIG. 9 .
  • Term in material may be also displayed on the display unit.
  • a checkbox for adoption is marked for the term extracted by the search term candidate extraction unit 13 as a search term.
  • An authentication button exists at a lower portion of the display screen, and when the user inputs an authentication instruction to the computer (terminal) using the authentication button, candidate of search term is authenticated.
  • the device 1 that has received an input from the computer stores the search terms authenticated (and scores of respective search terms) for a certain page of presentation in the storage unit in an associated manner.
  • the search term input unit 19 is a unit for receiving an input indicating being a search term among the candidates of search term displayed on the display unit 15 .
  • an input in a checkbox functions as search term input unit 19 .
  • a checkbox for rejection is marked.
  • the device 1 makes the candidate of search term instructed be in rejection state.
  • the user inputs an authentication instruction to the computer (terminal) using the authentication button, the candidate of search term is rejected.
  • the device 1 may reduce score of candidate of search term rejected (e.g.
  • a checkbox for rejection is marked (or any checkbox is not marked) for the term that has not been extracted as a search term by the search term candidate extraction unit 13 .
  • a checkbox for adoption is marked.
  • the device 1 makes the candidate of search term instructed be in adoption state.
  • the candidate of search term is adopted. That is, the search term is stored in association with a certain page as a search term of the certain page.
  • the search term may be stored in a state where its score is added or multiplied.
  • FIG. 10 is a flowchart for illustrating a usage example of the search material information storage device of the present invention. That is, FIG. 10 is a diagram for illustrating a search material information storage method using the search material information storage device. S denotes step (process) in the drawing.
  • the user creates presentation material (S 101 ).
  • the terminal or computer of the user stores presentation material in the storage unit (or the storage unit of the server).
  • the device 1 for each page of presentation material, extracts a term in material that is a term included in the page (S 102 ).
  • the device 1 may apply a score to the term in material. For example, when appearance frequency of the term in material is high, or when the term in material is bold letter, colored character, or accompanied by animation or the like, an additional point may be preliminarily registered to apply a score to the term in material using the additional point information registered.
  • the device 1 may have a dictionary of term in material, term in material and score may be stored in an associated manner for various terms in material in the dictionary, and the device 1 may read out score of term in material.
  • score of term in material may be obtained using score of term in material existing in the dictionary and score related to the additional point (e.g., by addition or multiplication).
  • the term in material having a high score may be determined as a term in material.
  • the device 1 uses one or the plurality of terms in material extracted, the device 1 extracts a plurality of keywords associated with the one or the plurality of terms in material from the storage unit (S 103 ).
  • a term that becomes a keyword associated with term in material is recorded in the storage unit.
  • the device 1 can extracts a keyword associated with a term in material from the storage unit by using the term in material.
  • a score as a search term may be applied for each keyword.
  • additional point related to high frequency of keyword may be registered and additional point in accordance with duplicate count of keyword may be read out for addition or multiplication with score. In this manner, a plurality of keywords (and scores of the respective keywords) can be obtained.
  • the processing is similar to the extraction step of keyword.
  • the device 1 may extract a category word associated with a topic word from the storage unit using the topic word extracted (S 105 ). This step is an optional step.
  • the device 1 extracts a candidate of search term of a certain page of material from among a topic word and a plurality of keywords (and the category word) (S 106 ).
  • the device 1 is sufficient to preliminarily store a control command for extracting candidate of search term, and extract candidate of search term of a certain page of material from among the topic word, the plurality of keywords (and the category word) in accordance with the control command.
  • An example of the control command is to extract four keywords having high score from among the plurality of keywords, two topic words having high score among topic words (, and every category word) as candidates of search term. In this manner, a candidate of search term for a certain page of presentation material is automatically extracted.
  • the storage unit may store the candidate of search term extracted as a search term of the certain page.
  • the candidate of search term extracted may be made to be displayed on the display unit by the device 1 (S 107 ).
  • a target page of presentation reduced in size
  • a topic word and a plurality of keywords (and category word) that have not been determined as candidates of search term may be displayed together on the display unit. In this case, the user becomes possible to select search term.
  • the terminal receives an input related to the authentication, and the candidate of search term extracted by the device 1 is stored in the storage unit as search term associated with a certain page of presentation material as it is (S 111 ).
  • a candidate of search term reflecting correction of the cases is determined as a search term associated with the certain page in the storage unit (S 121 ).
  • the terminal receives an input related to the authentication, and a candidate of search term corrected is stored in the storage unit as a search term associated with the certain page of presentation material (S 122 ).
  • the present invention also provides
  • a term extraction unit 3 that extracts a term in material that is a term included in a certain page of material
  • a keyword storage unit 5 that stores a term that becomes a keyword associated with the term in material
  • a keyword extraction unit 7 that extracts a plurality of keywords that become a keyword associated with the term in material from the keyword storage unit 5 using the term in material extracted by the term extraction unit 3 ,
  • a topic word storage unit 9 that stores a topic word associated with the key word
  • a topic word extraction unit 11 that, using the plurality of keywords extracted by the keyword extraction unit 7 , extracts the topic word associated with the keywords from the topic word storage unit 9 ,
  • search term candidate extraction unit 13 that extracts a candidate of search term of a certain page of the material from the topic word extracted by the topic word extraction unit 11 and the plurality of keywords extracted by the keyword extraction unit 7 ,
  • search term candidate display unit 17 that makes a display unit 15 display the candidate of search term extracted by the search term candidate extraction unit 13 ,
  • a search term input unit 19 that receives an input indicating being a search term among candidates of search term displayed on the display unit 15 , and
  • a material search information storage unit 21 that stores the search term input by the search term input unit 19 and information related to the certain page of the material in an associated manner.
  • FIG. 11 is a conceptual diagram (block diagram) for illustrating a usage example of the search material information storage device according to the present invention.
  • This example includes a content DB, a customer DB, a log DB, and a DB storing other information as a basic database (DB).
  • the databases are connected with an engine called Interactive-Pro Framework via an interface.
  • the engine is configured to be able to receive and transmit information from and to various types of terminals (e.g., PC tablet, mobile terminal, mobile phone) via an API (application programming interface).
  • the engine is also configured to receive and transmit information from and to a control program, an application, HTML data, movie data, PowerPoint data, PDF data, document data, and database management software, which are in client.
  • the engine is also configured to be synchronized with the server (cloud) to be able to receive and transmit information.
  • server cloud
  • transmission and reception of information are made possible to and from various databases including business Intelligence (BI), customer relationship management (CRM), and data warehouse (DWH) of customer, and software via the server.
  • BI business Intelligence
  • CRM customer relationship management
  • DWH data warehouse
  • the present invention also provides
  • a voice recognition unit 53 that performs voice recognition
  • a conversation-derived term extraction unit 55 that extracts a plurality of conversation-derived terms from conversation information recognized by the voice recognition unit 53 ,
  • search keyword storage unit 57 that stores conversation-derived term and search keyword in an associated manner
  • search keyword extraction unit 59 that extracts a plurality of search keywords from the search keyword storage unit 57 using the plurality of conversation-derived terms extracted by the conversation-derived term extraction unit 55 ,
  • a material storage unit 61 that stores each page of a plurality of presentation materials, a search term of each page, and a score of the search term in an associated manner
  • a relevant page information extraction unit 63 that, using a search keyword extracted by the search keyword extraction unit 59 as the search term, extracts a page of presentation material associated with the search keyword from the material storage unit 59 ,
  • a selection term extraction unit 65 that extracts the search keyword as a selection term for selecting a slide when the page of presentation material extracted by the relevant page information extraction unit 63 exists
  • a selection term display unit 71 that causes the selection term extracted by the selection term extraction unit 65 to be displayed on a display unit 69 , whereby
  • the selection term is displayed on the display unit 69 .
  • the present invention is usable in display terminal industry, information and telecommunications industry, software development, pharmaceutical industry, financial industry, and the like.
US16/618,094 2017-06-01 2018-05-07 Display Device Abandoned US20200159801A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2017-109340 2017-06-01
JP2017109340 2017-06-01
PCT/JP2018/017600 WO2018221120A1 (ja) 2017-06-01 2018-05-07 表示装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/017600 A-371-Of-International WO2018221120A1 (ja) 2017-06-01 2018-05-07 表示装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/498,077 Continuation US20240078276A1 (en) 2017-06-01 2023-10-31 Display Device Displaying a Keyword for Selecting a Next Slide During Presentation

Publications (1)

Publication Number Publication Date
US20200159801A1 true US20200159801A1 (en) 2020-05-21

Family

ID=64455802

Family Applications (2)

Application Number Title Priority Date Filing Date
US16/618,094 Abandoned US20200159801A1 (en) 2017-06-01 2018-05-07 Display Device
US18/498,077 Pending US20240078276A1 (en) 2017-06-01 2023-10-31 Display Device Displaying a Keyword for Selecting a Next Slide During Presentation

Family Applications After (1)

Application Number Title Priority Date Filing Date
US18/498,077 Pending US20240078276A1 (en) 2017-06-01 2023-10-31 Display Device Displaying a Keyword for Selecting a Next Slide During Presentation

Country Status (6)

Country Link
US (2) US20200159801A1 (ja)
JP (2) JP6664784B2 (ja)
CN (2) CN112307185A (ja)
CA (1) CA3063019C (ja)
SG (1) SG10202104109UA (ja)
WO (1) WO2018221120A1 (ja)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220150084A1 (en) * 2019-05-14 2022-05-12 Interactive Solutions Corp. Automatic Report Creation System
US11443736B2 (en) * 2020-01-06 2022-09-13 Interactive Solutions Corp. Presentation support system for displaying keywords for a voice presentation
US11475884B2 (en) * 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US11630525B2 (en) 2018-06-01 2023-04-18 Apple Inc. Attention aware virtual assistant dismissal
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11809886B2 (en) 2015-11-06 2023-11-07 Apple Inc. Intelligent automated assistant in a messaging environment
US11838579B2 (en) 2014-06-30 2023-12-05 Apple Inc. Intelligent automated assistant for TV user interactions
US11837237B2 (en) 2017-05-12 2023-12-05 Apple Inc. User-specific acoustic models
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11862151B2 (en) 2017-05-12 2024-01-02 Apple Inc. Low-latency intelligent automated assistant
US11862186B2 (en) 2013-02-07 2024-01-02 Apple Inc. Voice trigger for a digital assistant
US11893992B2 (en) 2018-09-28 2024-02-06 Apple Inc. Multi-modal inputs for voice commands
US11907436B2 (en) 2018-05-07 2024-02-20 Apple Inc. Raise to speak
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11954405B2 (en) 2015-09-08 2024-04-09 Apple Inc. Zero latency digital assistant
US11979836B2 (en) 2007-04-03 2024-05-07 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6749705B2 (ja) * 2019-01-25 2020-09-02 株式会社インタラクティブソリューションズ プレゼンテーション支援システム
JP6841535B1 (ja) * 2020-01-29 2021-03-10 株式会社インタラクティブソリューションズ 会話解析システム
JP6771251B1 (ja) 2020-04-24 2020-10-21 株式会社インタラクティブソリューションズ 音声解析システム
JP6884442B2 (ja) * 2020-08-06 2021-06-09 株式会社インタラクティブソリューションズ プレゼンテーション支援システム
JP7049010B1 (ja) * 2021-03-02 2022-04-06 株式会社インタラクティブソリューションズ プレゼンテーション評価システム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050149516A1 (en) * 2002-04-25 2005-07-07 Wolf Peter P. Method and system for retrieving documents with spoken queries
US20050283369A1 (en) * 2004-06-16 2005-12-22 Clausner Timothy C Method for speech-based data retrieval on portable devices
US20150379094A1 (en) * 2005-08-19 2015-12-31 At&T Intellectual Property Ii, L.P. System and Method for Using Speech for Data Searching During Presentations
US9449080B1 (en) * 2010-05-18 2016-09-20 Guangsheng Zhang System, methods, and user interface for information searching, tagging, organization, and display

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05151264A (ja) * 1991-12-02 1993-06-18 Fuji Electric Co Ltd 情報検索装置
JP3427674B2 (ja) * 1997-05-27 2003-07-22 富士ゼロックス株式会社 関連語提示装置及び関連語提示用プログラムを記録した媒体
US7389343B2 (en) * 2002-09-16 2008-06-17 International Business Machines Corporation Method, system and program product for tracking web user sessions
US20080235018A1 (en) * 2004-01-20 2008-09-25 Koninklikke Philips Electronic,N.V. Method and System for Determing the Topic of a Conversation and Locating and Presenting Related Content
JP4946187B2 (ja) * 2006-06-09 2012-06-06 富士ゼロックス株式会社 関連語表示装置、検索装置、その方法及びプログラム
JP5178109B2 (ja) * 2007-09-25 2013-04-10 株式会社東芝 検索装置、方法及びプログラム
US9384186B2 (en) * 2008-05-20 2016-07-05 Aol Inc. Monitoring conversations to identify topics of interest
KR102228455B1 (ko) * 2013-08-05 2021-03-16 삼성전자주식회사 대화의 소재를 제공하는 장치, 서버 및 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050149516A1 (en) * 2002-04-25 2005-07-07 Wolf Peter P. Method and system for retrieving documents with spoken queries
US20050283369A1 (en) * 2004-06-16 2005-12-22 Clausner Timothy C Method for speech-based data retrieval on portable devices
US20150379094A1 (en) * 2005-08-19 2015-12-31 At&T Intellectual Property Ii, L.P. System and Method for Using Speech for Data Searching During Presentations
US9449080B1 (en) * 2010-05-18 2016-09-20 Guangsheng Zhang System, methods, and user interface for information searching, tagging, organization, and display

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11979836B2 (en) 2007-04-03 2024-05-07 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US11862186B2 (en) 2013-02-07 2024-01-02 Apple Inc. Voice trigger for a digital assistant
US11838579B2 (en) 2014-06-30 2023-12-05 Apple Inc. Intelligent automated assistant for TV user interactions
US11954405B2 (en) 2015-09-08 2024-04-09 Apple Inc. Zero latency digital assistant
US11809886B2 (en) 2015-11-06 2023-11-07 Apple Inc. Intelligent automated assistant in a messaging environment
US11862151B2 (en) 2017-05-12 2024-01-02 Apple Inc. Low-latency intelligent automated assistant
US11837237B2 (en) 2017-05-12 2023-12-05 Apple Inc. User-specific acoustic models
US11907436B2 (en) 2018-05-07 2024-02-20 Apple Inc. Raise to speak
US11630525B2 (en) 2018-06-01 2023-04-18 Apple Inc. Attention aware virtual assistant dismissal
US11893992B2 (en) 2018-09-28 2024-02-06 Apple Inc. Multi-modal inputs for voice commands
US11475884B2 (en) * 2019-05-06 2022-10-18 Apple Inc. Reducing digital assistant latency when a language is incorrectly determined
US20230131018A1 (en) * 2019-05-14 2023-04-27 Interactive Solutions Corp. Automatic Report Creation System
US20220150084A1 (en) * 2019-05-14 2022-05-12 Interactive Solutions Corp. Automatic Report Creation System
US11570014B2 (en) * 2019-05-14 2023-01-31 Interactive Solutions Corp. Automatic report creation system
US11790914B2 (en) 2019-06-01 2023-10-17 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US11443736B2 (en) * 2020-01-06 2022-09-13 Interactive Solutions Corp. Presentation support system for displaying keywords for a voice presentation
US11914848B2 (en) 2020-05-11 2024-02-27 Apple Inc. Providing relevant data items based on context
US11838734B2 (en) 2020-07-20 2023-12-05 Apple Inc. Multi-device audio adjustment coordination
US11750962B2 (en) 2020-07-21 2023-09-05 Apple Inc. User identification using headphones
US11696060B2 (en) 2020-07-21 2023-07-04 Apple Inc. User identification using headphones

Also Published As

Publication number Publication date
SG10202104109UA (en) 2021-06-29
CN110678859A (zh) 2020-01-10
JPWO2018221120A1 (ja) 2020-01-09
CA3063019C (en) 2021-01-19
CA3063019A1 (en) 2019-12-02
US20240078276A1 (en) 2024-03-07
JP2020102231A (ja) 2020-07-02
JP6783483B2 (ja) 2020-11-11
WO2018221120A1 (ja) 2018-12-06
CN112307185A (zh) 2021-02-02
CN110678859B (zh) 2020-11-24
JP6664784B2 (ja) 2020-03-13

Similar Documents

Publication Publication Date Title
US20240078276A1 (en) Display Device Displaying a Keyword for Selecting a Next Slide During Presentation
US20210042339A1 (en) Search Document Information Storage Device
US10552539B2 (en) Dynamic highlighting of text in electronic documents
Bednarek et al. Computer-assisted digital text analysis for journalism and communications research: introducing corpus linguistic techniques that do not require programming
US11704484B2 (en) Cross channel digital data parsing and generation system
JP6710007B1 (ja) 対話管理サーバ、対話管理方法、及びプログラム
JP7345909B2 (ja) プレゼンテーション評価システム
US20170329763A1 (en) System and method for detecting meaningless lexical units in a text of a message
Sultana Translingual practices and national identity mediated in the semiotized digital spaces
WO2023079647A1 (ja) 相談支援制御装置、方法およびプログラム
Bohnemeyer Semantic typology: the crosslinguistic study of semantic categorization
JPS63175965A (ja) 文書処理装置
Paulus et al. “In Minutes Instead of Weeks”: Discursive Constructions of Generative AI and Qualitative Data Analysis
JP2023096472A (ja) 情報処理システム、情報処理方法および情報処理プログラム
JP2021002278A (ja) 情報処理装置、制御方法、及びプログラム
JP2020052593A (ja) 分析装置及び分析プログラム
Baptista Book Review: Language Evolution: Contact, Competition and Change
Wagner An Introduction to the Utilization and Application of Text Analysis

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCV Information on status: appeal procedure

Free format text: NOTICE OF APPEAL FILED

STCV Information on status: appeal procedure

Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS

STCV Information on status: appeal procedure

Free format text: BOARD OF APPEALS DECISION RENDERED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION