JP6880556B2 - Information presentation device, information presentation method, information presentation system, and program - Google Patents

Description

The present invention relates to an information presentation device, an information presentation method, an information presentation system, and a program.

There is an interactive information presenting device that acquires information indicating an act of conveying an intention such as an utterance from a user, generates information indicating a response content based on the acquired information, and presents the information to the user. For example, an online assistant service, a car navigation system, and a response generator as described in Patent Document 1 are also such information presenting devices.

Japanese Unexamined Patent Publication No. 2013-205523

In the conventional information presenting device, the expressive power for presenting the response content may be poor, for example, the information indicating the response content is generated mainly by the text information (or only by the text information). For example, in response to a user inquiry "I want to know how to make a recording reservation", a response content "Please refer to page 12 of the manual" is generated. As described above, the conventional information presenting device improves the user's understanding of the response content due to the lack of expressive power for expressing the response content and the insufficient coordination between the information presenting device and the content of the response content. There was a problem that it was difficult. Further, in the conventional information presenting device that generates the response contents centered on the text information (or only by the text information), the response contents for various inquiries must be expressed by characters. Therefore, in the conventional information presenting device, there is a problem that the response sentence becomes redundant and the generation and management of the response contents become complicated.

The present invention has been made in view of the above points, and it is possible to improve the expressiveness in presenting the response contents, strengthen the cooperation between the contents, and facilitate the generation and management of the response contents. It provides devices, information presentation methods, information presentation systems, and programs.

(1) The present invention has been made to solve the above problems, and one aspect of the present invention is an information presenting device having a function of presenting a response to an input by at least one or more users. , A dialogue rule construction unit that collects content, generates a dialogue rule from the collected content, and generates an extended rule from the collected content and the dialogue rule, and obtains a rule corresponding to the input from the dialogue rule. A control unit, which is a control unit that controls a two-way dialogue with a user, and a specific unit that acquires extended presentation information corresponding to the acquired rule from the extended rule, based on the extended presentation information. A specific part that specifies either an identifier that specifies an element of the content used in the response or a specifier that specifies a subset of the components of the content used in the response, and the identified identifier or the designation. The dialogue rule is a rule that defines a correspondence relationship between an input and a rule , and includes a presentation unit that performs an extended presentation that attracts attention to a specific area in the content together with the content based on a child. The extended rule is a rule that defines a correspondence relationship between a rule and extended presentation information, and the extended presentation information includes at least information indicating a portion to be extended and presented in the content. It is a device.
Further, one aspect of the present invention is an information presenting device having a function of presenting a response to an input by at least one or more users, and generating a dialogue rule from a dialogue history which is a history of the input and the response. , A dialogue rule construction unit that generates an extended rule from the dialogue history and the dialogue rule, and a control unit that acquires a rule corresponding to the input from the dialogue rule, and controls two-way dialogue with the user. A unit and a specific unit that acquires extended presentation information corresponding to the acquired rule from the extended rule, and is an identifier that specifies an element of content used in the response based on the extended presentation information, or the response. A specific part that specifies one of the specifiers that specifies a subset of the components of the content to be used, and a specific area within the content with the content based on the identified identifier or the specifier. The dialogue rule, which comprises a presentation unit that performs an extended presentation that attracts attention, is a rule that defines a correspondence relationship between an input and a rule, and the extended rule is a correspondence relationship between a rule and the extended presentation information. It is a defined rule, and the extended presentation information is an information presenting device characterized in that it includes at least information indicating a portion to be extendedly presented in the content.

(2) As one aspect of the present invention, the extended presentation includes selection / movement of content, superimposed drawing of annotations and supplementary information, hiding of non-attention areas, and hue / saturation between attention areas and non-attention areas. The information presenting apparatus according to (1), wherein the presentation is performed by differentiating the brightness or the transparency and using at least one of the temporal presentation state changes of the region of interest.

(3) As one aspect of the present invention, the presenting unit is the information about the route followed by the user in the extended presentation using the selection / movement of the content, and in the case of the content having a hierarchical structure, the current hierarchy. The information presenting device according to (2), which presents information on the nature of the hierarchy, or information on the route followed by the user and the remaining routes when a plurality of movements are involved.

(4) In one aspect of the present invention, the content is content having a structured document as a part of the constituent elements, and the specific unit includes an identifier indicating the content element or a subset of the constituent elements of the content. The information presenting apparatus according to (2), wherein at least one of the indicated specifiers can be extracted.

(5) In one aspect of the present invention, the structured document is a document structured by a hierarchy in which the content elements are repeated in parallel or recursively, and the specific part is a hierarchy in which the document is structured. The identifier required for the extended presentation by means of recognizing a structure as a tree structure and designating the position of a specific element in the tree structure, or by designating a subtree that constitutes a specific element or less in the tree structure. Alternatively, the information presenting device according to (4), characterized in that the specifier is specified.

(6) In one aspect of the present invention, the content is content having a still image or a moving image as a part of a component, and the specific part is an identifier indicating the content element or a subset of the component of the content. The information presenting apparatus according to claim (2), wherein at least one of the specifiers indicating the above can be extracted.

(7) As one aspect of the present invention, the information presenting device according to (6), wherein the specific unit specifies at least one of the identifier and the pre-learned specifier.

(8) In one aspect of the present invention, the content is content having an acoustic signal as a part of the component, and the specific unit indicates an identifier indicating the content element or a subset of the component of the content. The information presenting apparatus according to (2), wherein at least one of the specifiers can be extracted.

(9) One aspect of the present invention is characterized in that the specifier specifies at least one or more of metadata, lyrics, chapters, or time codes associated with an acoustic signal (8). The information presentation device described.

(10) In one aspect of the present invention, the content is content having a three-dimensional model as a part of the constituent elements, and the specific unit includes an identifier indicating the content element or a subset of the constituent elements of the content. The information presenting apparatus according to (2), wherein at least one of the indicated specifiers can be extracted.

(11) One aspect of the present invention is the information presenting device according to (10), wherein the specifier specifies a vertex coordinate set, an edge set, or a face set.

(12) In one aspect of the present invention, the presentation unit is a dialogue rule that defines a correspondence between the input and the response, an identifier indicating the content element, or a portion of the content element that is a component of the content. The information presenting apparatus according to (1), wherein the extended presentation is performed using at least one of a specifier that specifies a set and an extended rule that defines a correspondence between the dialogue rule.

(13) In one aspect of the present invention, the extended presentation is a method of describing the identifier or the specifier in a direct expression when defining the relationship between the identifier or the specifier and the dialogue rule, or , A method described in an indirect expression using the symbol string from a data group in which an arbitrary identifier or a symbol string unique to the specifier is recorded as a pair is used. It is an information presentation device.

(14) One aspect of the present invention is an information presentation method using a computer having a function of presenting a response to an input by a user, in which a dialogue rule construction unit collects content and uses the collected content. A dialogue rule construction step that generates a dialogue rule and generates an extended rule from the collected contents and the dialogue rule, and a control unit acquires a rule corresponding to the input from the dialogue rule and bidirectionally with the user. The control step that controls the dialogue and the specific unit are specific units that acquire the extended presentation information corresponding to the acquired rule from the extended rule, and are elements of the content used in the response based on the extended presentation information. A specific step that specifies either an identifier that specifies, or a specifier that specifies a subset of the content components used in the response, and a presenter based on the identified identifier or the specifier. It has a presentation step of performing an extended presentation that attracts attention to a specific area in the content, and the dialogue rule is a rule that defines a correspondence relationship between an input and a rule, and the extended rule is a rule. , The rule defines the correspondence between the rule and the extended presentation information, and the extended presentation information is an information presentation method characterized in that it includes at least information indicating a portion to be extended presentation in the content.

(15) One aspect of the present invention is an information presentation system having a function of presenting a response to an input by a user, wherein the information presentation system has a terminal device and an information presentation device, and the terminal device. Includes an input unit that accepts the input and a transmission unit that transmits the request information input from the input unit to the information presenting device. The information presenting device collects content and uses the collected content. A dialogue rule construction unit that generates a dialogue rule and generates an extended rule from the collected contents and the dialogue rule, and a control unit that acquires a rule corresponding to the input from the dialogue rule, and is bidirectional with the user. A control unit that controls the dialogue of the above, and a specific unit that acquires the extended presentation information corresponding to the acquired rule from the extended rule, and specifies an element of the content used in the response based on the extended presentation information. A specific part that specifies either an identifier or a specifier that specifies a subset of the components of the content used in the response, and in the content along with the content based on the identified identifier or the specifier. The dialogue rule is a rule that defines a correspondence between an input and a rule, and the extended rule is a rule and an extended presentation. It is a rule that defines a correspondence relationship with information, and the extended presentation information is an information presentation system characterized in that it includes at least information indicating a portion to be extended presentation in the content.

(16) As one aspect of the present invention, content is collected on a computer having a function of presenting a response to input by a user, a dialogue rule is generated from the collected content, and the collected content and the dialogue rule are generated. A dialogue rule construction step that generates an extended rule from, a control step that acquires a rule corresponding to the input from the dialogue rule and controls a two-way dialogue with the user, and extended presentation information corresponding to the acquired rule. Is obtained from the extended rule, and based on the extended presentation information , either an identifier that specifies an element of the content used in the response or a specifier that specifies a subset of the components of the content used in the response. A program for executing a specific step for specifying a specific step and an extended presentation for attracting attention to a specific area in the content based on the specified identifier or the specifier . The dialogue rule is a rule that defines the correspondence between the input and the rule, the extended rule is a rule that defines the correspondence between the rule and the extended presentation information, and the extended presentation information is at least the said. It is a program that includes information indicating the parts to be extended and presented in the content.

According to the present invention, it is possible to improve the expressiveness in presenting the response content and facilitate the generation and management of the response content.

It is the schematic which shows an example of the structure of the information presentation system 1 which concerns on embodiment of this invention. It is a figure which shows an example of extended presentation of the content in the terminal apparatus 10 of the information presentation system 1 which concerns on embodiment of this invention. It is a figure which shows an example of the dialogue processing in the conventional dialogue system. It is a figure which shows an example of the information presentation processing of the information presentation system 1 which concerns on embodiment of this invention. It is a block diagram which shows the functional structure of the information presentation apparatus 20 of the information presentation system 1 which concerns on embodiment of this invention. It is a flowchart which shows the operation of the information presentation processing of the information presentation system 1 which concerns on embodiment of this invention. It is a flowchart which shows the operation of the response processing of the information presentation system 1 which concerns on embodiment of this invention. It is a flowchart which shows the operation of the rule construction processing of the information presentation system 1 which concerns on embodiment of this invention. Is a schematic diagram showing an example of an information presentation screen presented by the information presentation system 1 according to the embodiment of the present invention.

(Embodiment)
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(Configuration of information presentation system)
FIG. 1 is a schematic view showing an example of the configuration of the information presentation system 1 according to the embodiment of the present invention.

The information presentation system 1 includes a terminal device 10 and an information presentation device 20. The terminal device 10 of the information presentation system 1 acquires an information presentation request from the user and transmits the request information indicating the information presentation request to the information presentation device 20. The information presenting device 20 stores the content to be presented in the response to the information presentation request, the extended presentation information which is the information used to extend the presentation of the content, and the rule corresponding to the request information in association with each other. doing. The information presenting device 20 analyzes the request information acquired from the terminal device 10 and extracts a rule (dialogue rule) corresponding to the request information. Then, the information presenting device 20 expands and presents the content corresponding to the extracted rule based on the extended presentation information corresponding to the extracted rule.

The configuration of the information presentation system 1 according to the embodiment of the present invention will be described in more detail below.
The terminal device 10 is a terminal used by a user who requests the presentation of information, for example, a smartphone or a tablet type terminal. The terminal device 10 acquires the voice of the user's utterance (information presentation request) by the input unit (not shown, for example, a microphone) included in the terminal device 10. The terminal device 10 converts the acquired voice into voice data (request information). The terminal device 10 transmits the voice data (request information) to the information presenting device 20 via a communication network by a transmission unit (not shown, for example, an antenna) included in the terminal device 10.

The information presenting device 20 generates content for responding to an information presenting request based on voice data (request information) acquired from the terminal device 10. The information presenting device 20 is a server device that presents the generated content to the terminal device 10, for example, a general-purpose computer or a personal computer.

The information presenting device 20 converts the voice data acquired from the terminal device 10 into character data indicating an information presentation request by the voice recognition technology. Further, the information presenting device 20 is used to extend a rule representing the pattern of the information presentation request indicated by the character data, the content to be presented to the terminal device 10 when the rule is applicable, and the presentation of the content. The extended presentation information, which is the information to be received, is stored in association with each other (or an algorithm for associating is held).
The information presenting device 20 analyzes the converted character data and extracts a rule corresponding to the character data. The information presenting device 20 presents the content corresponding to the extracted rule, and expands and presents the content based on the extended presentation information corresponding to the extracted rule.

The content may be stored in the information presenting device 20, or may be acquired by the information presenting device 20 from at least one content server 30 which is an external server device. In that case, the information presenting device 20 includes a rule representing the pattern of the information presenting request, information indicating the storage location of the content to be presented to the terminal device 10 when the rule is met (for example, a URL), and extended presentation information. , Are associated and stored.

In the present embodiment, the information presenting device 20 converts the voice data into the character data, but the present invention is not limited to this. For example, the terminal device 10 may convert the voice data into character data and transmit the character data to the information presenting device.
Alternatively, the information presenting device 20 transmits the voice data acquired from the terminal device 10 to an external server (not shown) capable of converting the voice data into character data, and acquires the character data from the external server. You may do it.

In the present embodiment, the information presentation request from the user is input by the microphone (not shown) included in the terminal device 10, but the present invention is not limited to this. For example, any device (or sensor) capable of communicating human intentions may be used. For example, the character information may be input by a keyboard or a touch panel. Alternatively, for example, the information presented by the human gesture may be input by the camera.

In the present embodiment, the terminal device 10 and the information presenting device 20 are separate devices, but the present invention is not limited to this. For example, the function of the terminal device 10 and the function of the information presenting device 20 according to the present embodiment may both be provided in the smartphone possessed by the user.
In the present embodiment, the presentation information determined by the information presentation device 20 may not include the extended presentation information. For example, a closed question that responds with "yes / no".

(Example of extended presentation of content)
Next, an example of an extended presentation of the content based on the extended presentation information (hereinafter, also referred to as an extended presentation) will be described.
FIG. 2 is a diagram showing an example of extended presentation of contents in the terminal device 10 of the information presentation system 1 according to the embodiment of the present invention.
As shown in FIG. 2A, the content ct01 is displayed on the display unit 100 (display in this embodiment) included in the terminal device 10. In this embodiment, the content ct01 is a website that provides various types of information. In addition to the content ct01, which is a website, the display unit 100 displays the extended presentation ext01 and the extended presentation ext02.

The extended presentation ext01 is an extended presentation for attracting the user's attention by enclosing a part of the wording (the part to be the target of the extended presentation) included in the content ct01 with a thick line and coloring the enclosed portion. Further, the extended presentation ext02 is an extended presentation for presenting supplementary information about the target portion of the extended presentation to the user by displaying a balloon pointing to the target portion of the extended presentation. Like the extended presentation ext01, the extended presentation ext02 is also an extended presentation for displaying a balloon with a thick line and coloring the inside of the balloon to attract the attention of the user.
In the extended presentation, in addition to coloring the range of the extended presentation target, for example, the hue, saturation, lightness, or transparency of the range of the extended presentation target and the outside of the range of the extended presentation target are different. It may be done by differentiating by.

Further, the extended presentation ext01 and the extended presentation ext02 are both displayed in a semi-transparent manner, and are displayed as if they are superimposed on the content ct01 (superimposed drawing). As a result, the information presenting device 20 can prevent the information contained in the content ct01 from being obscured by the extended presentation ext01 and the extended presentation ext02 and becoming invisible to the user.

The specification of a specific part of the content ct01 is, for example, XPath (XML Path Language;), which is a language syntax for designating a specific part of a document conforming to the markup language XML (XML (XML) Language). It can be done by using XML path language).

As described above, the information presenting device 20 includes the content (for example, the content ct01 or the data indicating the storage location of the content ct01), the extended presentation (for example, the extended presentation ext01 and the extended presentation ext02), and the information presentation request. It is stored in association with the rule representing the pattern.

In the example of the extended presentation shown in FIG. 2A, the extended presentation portion (attention area) is colored, but as shown in FIG. 2B, for example, a range that is not the extended presentation portion ( The non-attention area, that is, the area other than the extended presentation ext03 and the extended presentation ext04) is conversely darkened (hidden) to make it inconspicuous, so that the extended presentation portion in the content ct02 is attracted by the user. It may be.

Further, instead of changing the background color of the content or the background color of the extended presentation portion as described above, for example, the character color of the characters included in the content or the character color of the characters presented by the extended presentation should be changed. It may be an extended presentation.

Further, for example, the extended presentation may be such that a part of the content is not displayed by deleting a part of the tags in the HTML code constituting the website which is the content. The tag can be deleted by using, for example, JQuery (JQuery) which is a Javascript (registered trademark) library.

Further, for example, it is an extended presentation in which the presentation state of only the part to be extended presentation (or only the range other than the part to be extended presentation) is displayed changing with time (change in presentation state with time). You may.

For example, in an extended presentation in which the character size (font size) of the character string included in the extended presentation location and the image size of the image included in the extended presentation location are repeatedly enlarged / reduced (such as enlarged / reduced display) over time. There may be. Further, it may be an extended presentation that changes the font design of the character string.

Further, for example, an extended presentation (for example, extended presentation ext01, extended presentation ext02, extended presentation ext03, and extended presentation ext04 in FIG. 2) to be displayed as if superimposed on the content is displayed over time (for example, in the depth direction of the display). It may be an extended presentation that makes the display appear to be rotating (such as rotating the display).

Further, for example, the extended presentation (for example, the extended presentation ext01, the extended presentation ext02, the extended presentation ext03, and the extended presentation ext04 in FIG. 2) to be displayed as if superimposed on the content is blinked and displayed (blinking display). It may be an extended presentation (such as).

Although the content ct01 in this embodiment is assumed to be a website, the type of content is not limited to this. The content may be any content having a structure that can specify (identifiable) a subset that is a content element that is an element that constitutes the content. For example, the content can be a document built on a structured document such as a website, PDF, or a manual created in a Word file, a still image, a video, an acoustic signal (eg, audio or music), or a three-dimensional shape. It may be model data (three-dimensional data).
The document (structured document) referred to here is, for example, a document structured by a hierarchy in which content elements that are constituent elements of the document are repeated in parallel or recursively, and the information presenting device 20 responds to the structuring. The content element is specified by means of performing navigation and designating a specific content element.

Further, for example, the subset in the document is a wording included in the range surrounded by the extended presentation ext01 in the present embodiment. Further, for example, a subset in a still image is a part of an image area included in an image. Further, for example, a subset in a moving image or music is a part of a chapter, or a part of a reproduction range starting from a time when a specific time elapses from the start of reproduction of the moving image or music (that is, a specific time code). Further, for example, a subset in music is a reproduction range based on metadata, lyrics, and the like associated with acoustic information. Further, for example, the subset in the three-dimensional shape model data is a vertex coordinate set, an edge set, a face set, or the like.

As a result, for example, when the content is a still image, the information presenting device 20 makes an extended presentation that surrounds a part of the area included in the image, or adds a balloon to the range surrounded by the extended presentation to supplement the content. Further extended presentations such as presenting information can be made.
Further, for example, when the content is a moving image or music, the information presenting device 20 does not reproduce from the beginning of the moving image or music, but reproduces only a specific part in the moving image or music. Or you can make an extended presentation that displays supplementary information on the screen when a specific part of the video or music is playing.

(Example of rule extraction)
Next, an example of a process in which the information presenting device 20 analyzes request information indicating an information presentation request from a user, extracts a rule, and determines an extended presentation corresponding to the extracted rule will be described.
First, an example of general (most naive) rule extraction and dialogue processing in a conventional dialogue system will be described with reference to the drawings.
FIG. 3 is a diagram showing an example of dialogue processing in a conventional dialogue system.

Each line in FIG. 3 shows a step representing a single question from the user to the dialogue system (eg, an information presentation request) or a single response from the dialogue system to the user.
As shown in the figure, for example, in step st01, the speaker is a user, and the user asks the dialogue system "hello" (step st01).

The dialogue system acquires voice data based on the user's utterance, and acquires the character data of "hello" by voice recognition technology. The dialogue system stores in advance a table showing the correspondence between the rule and the response content. The dialogue system searches the table for the rule corresponding to the acquired character string "hello". In the table, for example, the rule "Hello *" and the data indicating the response content of "Hello" are stored in association with each other. "* (Asterisk)" is an expression method in the basic regular expression, and represents an arbitrary character string of 0 or more characters. That is, this rule indicates that if the first character string in the question from the user is "hello", the response is "hello". Based on this rule, the dialogue system responds to the user with "hello" (step st02). The response may be made by voice through the speaker or by characters displayed on the screen.

Next, suppose that the user asks the dialogue system "What is your name?" (Step st03).

The dialogue system acquires voice data based on the user's utterance, and acquires character data such as "What is your name?". The dialogue system searches the table for the rule corresponding to the acquired character string "What is your name?". In the table, for example, the rule "* name * what *" and the data indicating the response content "xx" are stored in association with each other. That is, this rule indicates that when the character string included in the question from the user is "* name * what *", the response "is xx" is given. Based on this rule, the dialogue system responds to the user as "xx" (step st04).

Next, the rule extraction and the information presentation process in the information presentation system 1 according to the embodiment of the present invention will be described with reference to the drawings.
FIG. 4 is a diagram showing an example of information presentation processing of the information presentation system 1 according to the embodiment of the present invention.
Similar to FIG. 3, each line in FIG. 4 shows a step representing one question from the user to the information presentation system 1 (information presentation request) or one response from the information presentation system 1 to the user. ..

As shown in the figure, it is assumed that the user first asks the information presentation system 1 "Tell me the method of XX" (step st11).

The information presentation system 1 acquires voice data based on the user's utterance, and acquires character data "Tell me the method of XX" by voice recognition technology. The information presentation system 1 stores in advance a table in which rules, contents, and extended presentation information are associated with each other. The information presentation system 1 searches the table for the rule corresponding to the acquired character string "Tell me the method of XX". On the table, for example, the rule "{recording | playback} * method * teaching *" and "move: {http: // ...} annotate1: {<h1>} annotate2: {...}" The data is stored in association with the data.

"| (Vertical line)" is an expression method in the extended regular expression, and represents "or" (OR condition). Further, "move: {specifier X}" indicates that the user moves to a location designated by the URL associated with "{specifier X}". Further, "annotate1: {designator Y}" indicates that the tag described in "{specifier Y (<h1>)}" is a tag to be extended presentation. In addition, "<h1>" is a tag representing the top heading. Further, "annotate2: {specifier Z}" adds a character string described in "{specifier Z}" as an annotation to the tag specified by "annotate2: {specifier Z}". Represents that.

That is, this rule is that when the character string included in the question from the user corresponds to "(recording or playback) * method * teaching *", for example, the website specified by the URL of "specifier X". Indicates that the extended presentation that highlights the top-level heading part in the above is performed, and the annotated content is presented by superimposing and drawing a balloon on the highlighted part. The information presentation system 1 makes a response to present information to the user based on this rule (step st12). (It is assumed that the "XX" part of the user's utterance contains the character string "recording" or "playback".)

The description format of the extended presentation information including the dialogue rule and the extended rule includes, for example, XML, JSON (Javascript® Object Notation; Jason), PHP (PHP) serialization, or CSV (Comma-). Any description format may be used, such as Serialized Values (CS Buoy).

It should be noted that the dialogue rule does not have to be composed only of text information as in FIGS. 3 and 4. Similarly, matching can be performed not only by exact text matching, but also by partial matching, vector distance, similarity, and the like. When using a vector, the value obtained by vectorizing the text is retained instead of the text information, and a response based on the score calculated by using the algorithm for obtaining the distance and similarity is returned.

As described above, the information presentation system 1 according to the present embodiment stores the content (or the storage location of the content) and the extended presentation information in association with the rule representing the pattern of the user's information presentation request. , It is possible to improve the expressiveness in presenting the response content as compared with the conventional dialogue system. Further, in the information presentation system 1 according to the present embodiment, since it is not necessary to express all the response contents with character data, it becomes easy to generate the response contents stored in advance, and the cost of creating the response contents is reduced. Can be reduced.

(Configuration of information presentation device)
Next, the functional configuration of the information presentation device 20 will be described with reference to the drawings.
FIG. 5 is a block diagram showing a functional configuration of the information presentation device 20 of the information presentation system 1 according to the embodiment of the present invention.
The information presentation system 1 includes an acquisition unit 201, an analysis unit 202, a language / concept knowledge storage unit 203, a dialogue control unit 204, a dialogue rule storage unit 205, a response generation unit 206, and an extended rule storage unit 207. , A presentation unit 208, a dialogue history storage unit 209, and a dialogue rule construction unit 210.

The acquisition unit 201 is an external input interface that acquires request information indicating an information presentation request from the terminal device 10. The acquisition unit 201 outputs the acquired request information to the analysis unit 202.

As described above, the information presenting device 20 itself may be configured to receive input directly from the user. In that case, the acquisition unit 201 includes, for example, a microphone, a keyboard, a camera, and the like.

The analysis unit 202 converts the request information input from the acquisition unit 201 into character data. The type of data of the request information differs depending on the user interface input by the user. For example, if the input interface is a microphone, the request information is audio data, and if the input interface is a camera, the request information is image data. Further, if the input interface is a keyboard, the analysis unit 202 does not need to convert the data format because the request information is already character data.

The analysis unit 202 converts the request information into character data based on the language / concept knowledge information stored in the language / concept knowledge storage unit 203. Language / conceptual knowledge information is information in which relationships such as synonymous relationships and upper / lower relationships are converted into data in a graph structure, and information in which more complicated relationships and relationships are also converted into data (for example, "eat"). The subject of "is human or animal, and the object is food, etc.). Further, for example, it may include information stored in association with character data such as voice data and image data. The language / concept knowledge information is stored in the language / concept knowledge storage unit 203 in advance via an external API (Application Programming Interface).

The language / conceptual knowledge storage unit 203 includes a storage medium, for example, an HDD (Hard Disk Drive), a flash memory, an EEPROM (Electrical Erasable Programmable Read Only Memory), a ROM (Read Only Memory), and a ROM (Read Only Memory). , RAM (Random Access read / write memory), or any combination thereof.
The analysis unit 202 outputs the converted character data (indicating the user's information presentation request) to the dialogue control unit 204.
Further, the analysis unit 202, the dialogue control unit 204 described later, the response generation unit 206 described later, and the dialogue rule building unit 210 described later include, for example, a CPU (Central Processing Unit).

The dialogue control unit 204 controls a two-way dialogue between the information presentation request from the user of the information presentation system 1 and the response by the information presentation system 1 to the information presentation request.
The dialogue control unit 204 determines a list of rules stored in the dialogue rule storage unit 205, and acquires a rule (dialogue rule) corresponding to the character data input from the analysis unit 202. For example, the character data "Tell me the method of XX" shown in FIG. 4 is input from the analysis unit 202, and the dialogue control unit 204 has the rule "{recording | playback} * method *" corresponding to the character data. "Teaching *" is acquired from the dialogue rule storage unit 205. The dialogue rule storage unit 205 is configured to include a storage medium such as an HDD, a flash memory, an EEPROM, a ROM, a RAM, or any combination thereof.
The dialogue control unit 204 outputs the rules and character data acquired from the dialogue rule storage unit 205 to the response generation unit 206.

The response generation unit 206 determines the data in which the rule and the extended presentation information are associated with each other stored in the extended rule storage unit 207, and extends the extended presentation information corresponding to the rule input from the dialogue control unit 204. Obtained from the storage unit 207. The extended presentation information includes the content itself (or information indicating the storage location of the content) used in the response to the information presentation request, information indicating the location of the extended presentation (for example, highlighting) in the content, and the extended presentation target. Supplementary information (for example, information indicating annotations) to be displayed in the place of is included. The extended rule storage unit 207 is configured to include a storage medium such as an HDD, a flash memory, an EEPROM, a ROM, a RAM, or any combination thereof.
The response generation unit 206 (specific unit) specifies a location (either a specific area of the content or a content element) to be extended presentation based on the information indicating the location to be extended and presented.
The response generation unit 206 outputs the extended presentation information, the rule, and the character data input from the extended rule storage unit 207 to the presentation unit 208.

Based on the extended presentation information input from the response generation unit 206, the presentation unit 208 generates the content indicated by the extended presentation information with the extended presentation indicated by the extended presentation information. The presentation unit 208 transmits data indicating the generated content to the terminal device 10 in response to a request from the terminal device 10. Alternatively, the presentation unit 208 push-distributes the data indicating the generated content to the terminal device 10.

As described above, the information presenting device 20 itself may be configured to directly present information to the user. In that case, the presentation unit 208 includes a display, for example, a liquid crystal display, an organic EL (Electroluminescence) display, and the like.

In addition, the presentation unit 208 outputs the generated content, extended presentation information, rules, and character data to the dialogue history storage unit 209.

The data used in the above information presentation is stored as history data in the dialogue history storage unit 209.
The dialogue rule construction unit 210 uses the history data stored in the dialogue history storage unit on a regular basis (for example, every day) to learn, for example, the tendency of information presentation request (dialogue tendency) by machine learning. It is reflected in the rule stored in the dialogue rule storage unit 205 and the extended presentation information stored in the extended rule storage unit 207.

As a method for the dialogue rule construction unit 210 to extract common rules (dialogue rules) from a large amount of documents (character data), for example, morphological analysis, parsing, predicate term structure analysis, matching / abbreviation analysis, etc. You may use a method that combines natural language processing technology, co-occurrence, and pattern mining.
Further, as a method for the dialogue rule construction unit 210 to extract a subset of components constituting an image based on the image data from the image data, for example, a general object recognition technique may be used. For example, in photographic data showing a photograph showing a human and a horse, which area (coordinates) is the area (coordinates) indicating a human and which area (coordinates) is the area (coordinates) indicating a horse. , The dialogue rule construction unit 210 may be specified by using a general object recognition technique.

When the dialogue rule building unit 210 updates the extended presentation information stored in the extended rule storage unit 207, the dialogue rule building unit 210 displays the content indicated by the updated extended presentation information as a content group (for example, a content server). It may be obtained from 30).

(Operation of information presentation system)
Next, the operation of the information presentation system 1 will be described with reference to the drawings. First, among the operations of the information presentation system 1, the operation of the information presentation processing will be described.
FIG. 6 is a flowchart showing the operation of the information presentation process of the information presentation system 1 according to the embodiment of the present invention.
The flowchart shown in FIG. 6 is started, for example, when the user who uses the information presentation system 1 is authenticated or when session information such as Cookie is available.

(Step st001) The terminal device 10 transmits user information, for example, a user ID (identifier) that identifies a user, or the like to the information presenting device 20. The information presenting device 20 receives the user information transmitted from the terminal device 10 by the acquisition unit 201. The acquisition unit 201 stores the received user information in a storage unit (not shown) included in the information presenting device 20.
The authentication unit (not shown) performs authentication (personal identification) based on the received user information. If the authentication is successful, the process proceeds to step st002. If not, the process proceeds to step st003.

(Step st002) The analysis unit 202 reads the user parameters based on the user information stored in the storage unit (not shown). The reading of the user parameter referred to here means, for example, a user for setting the information presenting device 20 so that a user using the information presenting system 1 can generate a response based on an optimized dialogue rule or an extended rule. Information reading process.
Then, the process proceeds to step st003.

(Step st003) The analysis unit 202 reads the overall optimum parameter. The reading of the overall optimum parameter referred to here is, for example, an information presentation device so that a response is generated based on an overall optimized dialogue rule or an extended rule regardless of who is the user who uses the information presentation system 1. This is a process of reading setting information for setting 20.
After that, the process proceeds to step st004.

(Step st004) In the terminal device 10, request information indicating a user's information presentation request is input based on an input operation (for example, utterance) by the user. The terminal device 10 transmits the input request information to the information presenting device 20. The information presenting device 20 receives the request information transmitted from the terminal device 10 by the acquisition unit 201. The acquisition unit 201 outputs the received request information to the analysis unit 202.
Then, the process proceeds to step st005.

(Step st005) The analysis unit 202 analyzes the request information input from the acquisition unit 201 and performs a conversion process for converting into character data.
When the conversion process is successful and the character data can be acquired, the analysis unit 202 outputs the acquired character data to the dialogue control unit 204. Then, the process proceeds to step st006.
If the conversion process is not successful and the character data cannot be acquired, the process proceeds to step st008.

(Step st006) Based on the character data output from the analysis unit 202, the dialogue control unit 204, the response generation unit 206, and the presentation unit 208 perform response processing to the information presentation request from the user. The details of the operation of this response processing will be described later.
Then, the process proceeds to step st007.

(Step st007)
When the acquisition unit 201 of the information presentation device 20 acquires information indicating that the information presentation request from the user has been completed, the processing of this flowchart ends. The information indicating that the information presentation request from the user has ended (for example, the dialogue has ended) is, for example, information indicating that the user of the terminal device 10 has performed an input operation indicating that the dialogue has ended. Information indicating that the input (for example, speech) from the user has not been performed for a certain period of time, information indicating that the communication connection between the terminal device 10 and the information presenting device 20 has been disconnected, and the like.
If the acquisition unit 201 has not acquired the information indicating that the information presentation request from the user has been completed, the process proceeds to step st008.

(Step st008) The analysis unit 202 updates the user status data stored in the storage unit (not shown) based on the content, extended presentation information, rules, and character data generated in the above process.
In addition to user status data (local optimization), it also retains and updates status data for overall optimization of dialogue control.
After that, the process returns to step st002.
This is the end of the description of the flow chart processing shown in FIG.

Next, the details of the operation of the response processing performed in step st004 of the information processing presentation processing shown in FIG. 6 will be described with reference to the drawings.
FIG. 7 is a flowchart showing the operation of the response processing of the information presentation system 1 according to the embodiment of the present invention.
The flowchart shown in FIG. 7 starts when the analysis unit 202 of the information presenting device 20 outputs the above-mentioned character data to the dialogue control unit 204.

(Step st101) The dialogue control unit 204 acquires a processing request by acquiring the above character data output from the analysis unit 202.
Then, the process proceeds to step st102.

(Step st102) The dialogue control unit 204 matches the list of rules stored in the dialogue rule storage unit 205 with the character data input from the analysis unit 202.
Then, the process proceeds to step st103.

As a method of performing the above matching, for example, the response is determined based on rule-based matching such as template matching, or some scoring such as vector similarity (even if the exact match does not occur as in rule-based). Any matching method is used, such as the method of performing.
Further, in the present embodiment, the input character data and the dialogue rule (rule) are matched, but further, the matching using both the input character data and the user status data is also performed. May be good.

(Step st103) When the dialogue control unit 204 searches the list of rules stored in the dialogue rule storage unit 205 and extracts a rule (dialogue rule) that matches the character data input from the analysis unit 202, The extracted rule and response data are output to the response generation unit 206. Then, the process proceeds to step st104.
If the dialogue control unit 204 does not extract a rule that matches the character data input from the analysis unit 202, the process proceeds to step st109.

(Step st104) The response generation unit 206 searches for the data in which the rule and the extended presentation information are associated with each other stored in the extended rule storage unit 207, and the extended presentation corresponding to the rule input from the dialogue control unit 204. Information is acquired from the extended rule storage unit 207. The response generation unit 206 generates a response based on the acquired extended presentation information. The extended presentation information includes, for example, data indicating the content itself (or information indicating the storage location of the content) used in response to the information presentation request, and information indicating a portion of the content to be extendedly presented (for example, highlighted). , And supplementary information (for example, information indicating annotations) to be displayed in the extended presentation location.
Then, the process proceeds to step st105.

(Step st105) If the extended presentation information acquired in step st104 above indicates that external cooperation (for example, content acquisition from an external content server 30 or the like) is required, the process proceeds to step st106. move on.
Further, when the extended presentation information acquired in step st104 above indicates that external cooperation is not necessary (for example, the extended presentation information includes the content itself used for responding to the information presentation request). In the case), the response generation unit 206 outputs the extended presentation information, the response information, the rule, and the character data input from the extended rule storage unit 207 to the presentation unit 208. Then, the process proceeds to step st107.

(Step st106) The response generation unit 206 externally obtains the external information (for example, the content) indicated by the extended presentation information via the external information acquisition unit (not shown) or the dialogue rule construction unit 210 included in the information presentation device 20. (For example, the content server 30).
Then, the process proceeds to step st107.

(Step st107) Based on the extended presentation information and the response information input from the response generation unit 206, the presentation unit 208 generates the content indicated by the extended presentation information with the extended presentation indicated by the extended presentation information. The presentation unit 208 transmits data indicating the generated content to the terminal device 10 in response to a request from the terminal device 10. Alternatively, the presentation unit 208 delivers the generated content-indicating data to the terminal device 10 in a push-type manner.
Then, the process proceeds to step st108.

(Step st108) The analysis unit 202 stores the user status stored in the storage unit (not shown) based on at least one of the content, the extended presentation information, the rule, and the character data generated in the above process. Update the data.
This completes the processing of this flowchart.

(Step st109)
The dialogue control unit 204 causes the user to make a presentation for prompting the user to re-enter the information presentation request via the presentation unit 208. For example, the dialogue control unit 204 generates character data indicating a response such as "I did not understand the content of the inquiry. Excuse me, but please speak again in another language." The dialogue control unit 204 causes the user to present the response content based on the generated character data via the presentation unit 208.
Or, after returning the content with the highest score of context match as a provisional response and getting the user's reaction, the presentation prompting re-entry is "○○○○○? If so, I'm sorry, but please enter it again in a different expression. "
This completes the processing of this flowchart.
This is the end of the description of the flow chart processing shown in FIG. 7.

Next, the operation of the rule construction process of the information presentation system 1 according to the present embodiment will be described with reference to the drawings.
FIG. 8 is a flowchart showing the operation of the rule construction process of the information presentation system 1 according to the embodiment of the present invention.
The flowchart shown in FIG. 8 starts when the dialogue rule building unit 210 of the information presenting device 20 acquires information indicating an execution command of the rule building process. Information indicating an execution command of the rule construction process is periodically output to the dialogue rule construction unit 210 from, for example, a timer (not shown) included in the information presenting device 20.
Alternatively, the flowchart shown in FIG. 8 starts when the acquisition unit 201 of the information presentation device 20 acquires information indicating that the information presentation request from the user has ended (that is, when the dialogue ends, etc.).

(Step st201) The dialogue rule construction unit 210 collects contents (for example, documents and images on the Web). The content may be collected automatically (for example, by a crawler) or manually (for example, by the operator of the information presenting device 20).
Then, the process proceeds to step st202.

(Step st202) The dialogue rule construction unit 210 analyzes the collected contents and constructs data indicating the dialogue rules (rules). The dialogue rule construction unit 210 updates the list of dialogue rules (rules) stored in the dialogue rule storage unit 205 with the data indicating the constructed dialogue rules (rules).
Then, the process proceeds to step st203.

(Step st203) Further, the dialogue rule construction unit 210 constructs data indicating an extended rule (extended presentation information) based on the collected contents and the dialogue rule (rule) constructed in step st202.
Then, the process proceeds to step st204.

(Step st204) The dialogue rule construction unit 210 extracts the content data indicating the content included in the extended rule (extended presentation information) constructed in step st203 from the content data collected in step st201.
Then, the process proceeds to step st205.

(Step st205) The dialogue rule construction unit 210 detects the type of the extracted content data. The types of content data include, for example, text data, still image data, moving image data, audio data, three-dimensional shape model data (three-dimensional data), and the like. The dialogue rule construction unit 210 extracts a specifier from the extracted content data by a method according to the type of the content data.

The specifier is, for example, a tag or the like if the content is text data described in a markup language. Further, the specifier is, for example, a chapter, a time code, or the like if the content is video data or audio data. Further, the specifier is, for example, coordinate data or the like if the content is still image data or three-dimensional data.
The dialogue rule construction unit 210 updates the extended presentation information by adding information indicating the specifier extracted above to the extended rule (extended presentation information) constructed in step st203.
Then, the process proceeds to step st206.

(Step st206) The dialogue rule construction unit 210 associates the dialogue rule (rule) constructed in step st202 with the extended presentation information updated in step st205. The dialogue rule construction unit 210 updates the data indicating the extension rule stored in the extension rule storage unit 207 by the associated data.
This completes the processing of this flowchart.
This is the end of the description of the operation of the information presentation system 1 according to the present embodiment.

(Example of information presentation screen)
An example of a screen for presenting information will be described below with reference to the drawings.
FIG. 9 is a schematic view showing an example of an information presentation screen presented by the information presentation system 1 according to the embodiment of the present invention.

First, as illustrated in FIG. 9A, the information presentation system 1 acquires data indicating an inquiry about the purchase method of the product X, such as "How to purchase the product X?" Based on the input from the user. The information presentation system 1 executes response processing and presents the content ct03 indicating the purchase page of the product X on the EC site. In FIG. 9A, the target part of the extended presentation in the content ct03 to be presented is the "Add to cart" button.

The information presentation system 1 presents the extended presentation ext05, which is an arrow-shaped image pointing to the position of the “add to cart” button, so as to be superimposed on the content ct03. Further, the information presentation system 1 presents the extended presentation ext06, which is an image showing a balloon pointing to the position of the "add to cart" button, so as to be superimposed on the content ct03. As shown in the figure, the balloon based on the extended presentation ext06 displays the words "Please click this button".

As described above, the information presentation system 1 according to the embodiment of the present invention not only presents and responds to the information presentation request based on the user's input (for example, utterance), but also presents the content in an extended manner. It is possible to specify a location and present the content to which the extended presentation is applied to the extended presentation location to respond.

In the case of this embodiment, the information presentation system 1 not only presents the purchase page of the product X on the EC site in response to the inquiry from the user "How to purchase the product X?", But also presents the "cart" of the purchase page. An image of an arrow pointing to the position of the "Add to" button is added, and a balloon stating "Click this button" is added to the position of the "Add to cart" button on the purchase page. can do.
As a result, the information presentation system 1 according to the embodiment of the present invention can present information that attracts (promotes attention) the user's attention to the extended presentation target portion in the content.

Next, when an input indicating that the "Add to cart" button shown in FIG. 9A is clicked by the user is made, the information presentation system 1 sets the information as shown in FIG. 9B. Display the presentation screen.
As shown in the figure, the information presentation system 1 presents the content ct04 indicating the purchase page of the product X on the EC site. In FIG. 9B, the target portion of the extended presentation in the content ct04 to be presented is the "Proceed to checkout" button.

The information presentation system 1 superimposes and draws the extended presentation ext07, which is an image showing a balloon indicating the position of the “go to cash register” button, on the content ct04 and presents it. As shown in the figure, the balloon based on the extended presentation ext07 displays the words "Please click this button".

Similar to the above description in FIG. 9A, in the present embodiment, the information presentation system 1 presents the purchase page of the product X on the EC site in response to the user's input of clicking the "add to cart" button. In addition to this, it is possible to give a response by adding a balloon stating "Please click this button" to the position of the "Proceed to checkout" button on the purchase page.
As a result, the information presentation system 1 according to the embodiment of the present invention can present information that attracts (promotes attention) the user's attention to the extended presentation target portion in the content.

Further, when presenting with content movement, assuming that the user performs the same operation, a route as shown in the upper right of FIG. 9B is presented to facilitate understanding of the operation flow.

As described above, the information presentation system 1 according to the embodiment of the present invention not only presents and responds to the information presentation request from the user, but also extends the presentation information (for example, supplementary information). Since it is possible to present and respond to the content with the above, the expressive power of the response content can be enhanced as compared with the conventional technique of generating the response content centered on the text information (or only with the text information). .. As a result, the information presentation system 1 according to the embodiment of the present invention can improve the user's understanding of the response content.

In addition, the information presentation system 1 according to the embodiment of the present invention includes not only text information but also existing data in various data formats such as websites, still images, moving images, sounds, and three-dimensional model data (three-dimensional data) (three-dimensional data). Alternatively, since the response content may be generated by combining the data storage location) and the extended presentation information, the response content is compared with the conventional technique in which the response content to the request from various users must be expressed in characters. It is possible to facilitate the generation and management of data indicating the contents.

As described above, the information presentation system 1 according to the embodiment of the present invention can improve the expressive power in presenting the response contents and facilitate the generation and management of the response contents.

Although the embodiments of the present invention have been described in detail above, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the gist of the present invention. is there.

In addition, a part or all of the terminal device 10 and the information presenting device 20 in the above-described embodiment may be realized by a computer. In that case, the program for realizing this control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed.

The "computer system" referred to here is a computer system built into the terminal device 10 and the information presenting device 20, and includes hardware such as an OS and peripheral devices. Further, the "computer-readable recording medium" refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, or a CD-ROM, or a storage device such as a hard disk built in a computer system.

Furthermore, a "computer-readable recording medium" is a medium that dynamically holds a program for a short period of time, such as a communication line when a program is transmitted via a network such as the Internet or a communication line such as a telephone line. In that case, a program may be held for a certain period of time, such as a volatile memory inside a computer system serving as a server or a client. Further, the above-mentioned program may be a program for realizing a part of the above-mentioned functions, and may be a program for realizing the above-mentioned functions in combination with a program already recorded in the computer system.

Further, the terminal device 10 and the information presentation device 20 in the above-described embodiment may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each functional block of the terminal device 10 and the information presenting device 20 may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of making an integrated circuit is not limited to the LSI, and may be realized by a dedicated circuit or a general-purpose processor. Further, when an integrated circuit technology that replaces an LSI appears due to advances in semiconductor technology, an integrated circuit based on this technology may be used.

1 ... Information presentation system, 10 ... Terminal device, 20 ... Information presentation device, 30 ... Content server, 100 ... Display unit, 201 ... Acquisition unit, 202 ... Analysis unit , 203 ... Language / concept knowledge storage unit, 204 ... Dialogue control unit, 205 ... Dialogue rule storage unit, 206 ... Response generation unit, 207 ... Extended rule storage unit, 208 ... Presentation unit, 209 ... Dialogue history storage unit, 210 ... Dialogue rule construction unit, ct01 to ct04 ... Contents, ext01 to ext07 ... Extended presentation

Claims (16)

An information presentation device having a function of presenting a response to an input by at least one user.
A dialogue rule construction unit that collects content, generates a dialogue rule from the collected content, and generates an extended rule from the collected content and the dialogue rule.
A control unit that acquires a rule corresponding to the input from the dialogue rule, and controls a two-way dialogue with the user.
An identifier that specifies an element of the content used in the response based on the extended presentation information, or a content used in the response, which is a specific unit that acquires the extended presentation information corresponding to the acquired rule from the extended rule. A specific part that specifies one of the specifiers that specifies a subset of the components of
A presentation unit that performs an extended presentation that draws attention to a specific area in the content together with the content based on the identified identifier or the specifier.
With
The dialogue rule is a rule that defines the correspondence between the input and the rule.
The extended rule is a rule that defines the correspondence between the rule and the extended presentation information.
The extended presentation information includes at least information indicating a portion to be extendedly presented in the content.
An information presentation device characterized by the fact that. An information presentation device having a function of presenting a response to an input by at least one user.
A dialogue rule construction unit that generates a dialogue rule from the dialogue history, which is a history of the input and the response, and generates an extended rule from the dialogue history and the dialogue rule.
A control unit that acquires a rule corresponding to the input from the dialogue rule, and controls a two-way dialogue with the user.
An identifier that specifies an element of the content used in the response based on the extended presentation information, or a content used in the response, which is a specific unit that acquires the extended presentation information corresponding to the acquired rule from the extended rule. A specific part that specifies one of the specifiers that specifies a subset of the components of
A presentation unit that performs an extended presentation that draws attention to a specific area in the content together with the content based on the identified identifier or the specifier.
To prepare
The dialogue rule is a rule that defines the correspondence between the input and the rule.
The extended rule is a rule that defines the correspondence between the rule and the extended presentation information.
The extended presentation information includes at least information indicating a portion to be extendedly presented in the content.
An information presentation device characterized by the fact that. A dialogue rule storage unit that stores the dialogue rule and
An extended rule storage unit that stores the extended rule,
With
The dialogue rule stored in the dialogue rule storage unit is updated by the dialogue rule generated by the dialogue rule construction unit.
The information presenting device according to claim 1 or 2, wherein the extended rule stored in the extended rule storage unit is updated by the extended rule generated by the dialogue rule building unit. The extended presentation includes selection / movement of content, superimposed drawing of annotations and supplementary information, hiding of non-attention areas, differentiation of hue / saturation / brightness or transparency between attention areas and non-attention areas, and the above-mentioned. It is a presentation using at least one of the temporal presentation state changes of the region of interest.
The information presenting device according to claim 1 to 3, wherein the information presenting device is characterized by the above. The content is content that has a structured document as a part of its components.
The specific part can extract at least one of an identifier indicating a content element or a specifier indicating a subset of the components of the content.
The information presenting device according to claim 4, wherein the information presenting device is characterized by the above. The structured document is a document structured by a hierarchy in which the content elements repeat in parallel or recursively.
The specific part recognizes the hierarchical structure for structuring the document as a tree structure, and means to specify the position of a specific element in the tree structure, or a subtree that constitutes a specific element or less in the tree structure. Identifying the identifier or specifier required for the extended presentation by means of designation.
The information presenting device according to claim 5. The content is content having a still image or a moving image as a part of a component, and the specific part extracts at least one of an identifier indicating the content element or a specifier indicating a subset of the component of the content. Can be done
The information presenting device according to claim 4, wherein the information presenting device is characterized by the above. The identification unit identifies at least one of the identifier or the pre-learned specifier.
The information presenting device according to claim 7. The content is content having an acoustic signal as a part of a component.
The specific part can extract at least one of an identifier indicating a content element or a specifier indicating a subset of the components of the content.
The information presenting device according to claim 4, wherein the information presenting device is characterized by the above. The specifier specifies at least one or more of the metadata, lyrics, chapters, or timecodes associated with the acoustic signal.
The information presenting device according to claim 9. The content is content having a three-dimensional model as a part of its components.
The specific part can extract at least one of an identifier indicating a content element or a specifier indicating a subset of the components of the content.
The information presenting device according to claim 4, wherein the information presenting device is characterized by the above. The specifier specifies a vertex coordinate set, an edge set, or a face set.
The information presenting device according to claim 11. The presenting unit makes the extended presentation using at least one of the dialogue rule, an identifier indicating the content element, or a specifier that specifies a subset of the content element that is a component of the content, and the extended rule. ,
The information presenting device according to claim 1 to 3, wherein the information presenting device is characterized by the above. It is an information presentation method using a computer having a function of presenting a response to input by a user.
A dialogue rule construction step in which the dialogue rule building unit collects content, generates a dialogue rule from the collected content, and generates an extended rule from the collected content and the dialogue rule.
A control step in which the control unit acquires a rule corresponding to the input from the dialogue rule and controls a two-way dialogue with the user.
The specific unit is a specific unit that acquires the extended presentation information corresponding to the acquired rule from the extended rule, and is an identifier that specifies an element of the content used in the response based on the extended presentation information, or the response. A specific step that identifies one of the specifiers that specifies a subset of the content components used in
A presentation step in which the presentation unit makes an extended presentation that draws attention to a specific area in the content based on the identified identifier or the specifier.
Have,
The dialogue rule is a rule that defines the correspondence between the input and the rule.
The extended rule is a rule that defines the correspondence between the rule and the extended presentation information.
The extended presentation information includes at least information indicating a portion to be extendedly presented in the content.
An information presentation method characterized by the fact that. An information presentation system that has a function of presenting a response to user input.
The information presentation system includes a terminal device and an information presentation device.
The terminal device is
An input unit that accepts the input and
A transmission unit that transmits the request information input from the input unit to the information presenting device, and a transmission unit.
With
The information presenting device is
A dialogue rule construction unit that collects content, generates a dialogue rule from the collected content, and generates an extended rule from the collected content and the dialogue rule.
A control unit that acquires a rule corresponding to the input from the dialogue rule, and controls a two-way dialogue with the user.
An identifier that specifies an element of the content used in the response based on the extended presentation information, or a content used in the response, which is a specific unit that acquires the extended presentation information corresponding to the acquired rule from the extended rule. A specific part that specifies one of the specifiers that specifies a subset of the components of
A presentation unit that performs an extended presentation that draws attention to a specific area in the content together with the content based on the identified identifier or the specifier.
With
The dialogue rule is a rule that defines the correspondence between the input and the rule.
The extended rule is a rule that defines the correspondence between the rule and the extended presentation information.
The extended presentation information includes at least information indicating a portion to be extendedly presented in the content.
An information presentation system characterized by this. To a computer that has the ability to provide a response to user input
A dialogue rule building step that collects content, generates dialogue rules from the collected content, and generates extended rules from the collected content and the dialogue rules.
A control step that acquires a rule corresponding to the input from the dialogue rule and controls a two-way dialogue with the user, and
An identifier that acquires extended presentation information corresponding to the acquired rule from the extended rule and specifies an element of the content used in the response based on the extended presentation information, or a portion of a component of the content used in the response. A specific step that identifies one of the specifiers that specifies the set, and
A presentation step of performing an extended presentation that draws attention to a specific area in the content based on the identified identifier or specifier.
It is a program to execute
The dialogue rule is a rule that defines the correspondence between the input and the rule.
The extended rule is a rule that defines the correspondence between the rule and the extended presentation information.
The extended presentation information includes at least information indicating a portion to be extendedly presented in the content.
program.

Images