JP2019197486A - Information processing apparatus and program - Google Patents

Abstract

To make a smooth transition from browsing of a content to an interactive exchange.SOLUTION: A browsing summary specification unit 104, when a plurality of contents are displayed (or being displayed) on a user terminal 20, specifies a content browsed (or being browsed) by a user. A display processing unit 108 performs display processing for displaying an input promoting image for promoting an input according to the content specified by the browsing summary specification unit 104. A transition processing unit 109, when an operation to select the input promoting image is performed on a screen on which the input promoting image is displayed (or being displayed), performs transition processing for making a transition from the screen to a screen including the input promoting image and option images. When any one of the displayed options is selected, next input promoting image and options are then displayed.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a user interface technology.

  2. Description of the Related Art There is known a technique for providing information or the like through interactive exchange that prompts a user for some input from the apparatus side. Patent Document 1 discloses a technique for providing a response to the user based on a dialogue scenario that defines the progress of the dialogue with the user in response to voice input from the user.

JP 2006-277519 A

As an opportunity to start the above interactive communication, for example, when a user is viewing a web page or viewing a content such as a list of links (represented by thumbnail images and titles) to a plurality of web pages. It is possible to be when.
Therefore, an object of the present invention is to facilitate the transition from content browsing to interactive exchange.

  In order to achieve the above object, according to the present invention, there is provided a first processing unit that performs a display process for displaying an image that prompts an input corresponding to content displayed on a user terminal on the user terminal, and the image is displayed. When a predetermined operation is performed on the screen, a transition is made to transition to a screen that includes an option that is a candidate for the input and displays an image that prompts the next input when selected and an image that prompts the input of the option An information processing apparatus including a second processing unit that performs processing is provided.

  In addition, when a plurality of contents are displayed on the user terminal, the information processing apparatus includes a specifying unit that specifies content to be browsed by the user, and the first processing unit performs input according to the content specified by the specifying unit. A process for displaying an urging image on the user terminal may be performed as the display process.

  In addition, the time for displaying an image that prompts input according to the content is determined for the content, and the first processing unit performs the display processing at the time determined for the displayed content. Also good.

  In addition, a related information acquisition unit that acquires related information about a user who uses the user terminal is provided, and the first processing unit is configured to acquire the related information that satisfies a condition defined for the displayed content. The display process may be performed.

  Further, the information processing apparatus includes a related information acquisition unit that acquires related information about a user who uses the user terminal, and the second processing unit selects an option corresponding to the displayed content and the acquired related information as the input candidate. A process for making a transition to a screen included as an option may be performed as the transition process.

  In addition, the information processing apparatus includes a terminal information acquisition unit that acquires terminal information related to the user terminal, and the second processing unit selects an option corresponding to the displayed content and the acquired terminal information as an option for the input. You may perform the process for making it change to the screen to include as the said transition process.

  A history acquisition unit configured to acquire history information of the content displayed on the user terminal, wherein the second processing unit selects an option corresponding to the displayed content and the acquired history information as the input candidate; A process for making a transition to a screen included as an option may be performed as the transition process.

  In addition, an environment information acquisition unit that acquires environment information indicating an environment in the location of the user terminal is provided, and the second processing unit is configured to input options according to the displayed content and the acquired environment information. You may perform the process for changing to the screen included as a candidate choice as said transition process.

  In addition, the image processing apparatus includes a related information acquisition unit that acquires related information about a user who uses the user terminal, and the first processing unit uses, as the image, a character string that prompts the input with a ending corresponding to the acquired related information. A process for displaying may be performed as the display process.

  Further, the present invention provides a first processing unit that performs a display process for causing a computer to display an image that prompts an input corresponding to content displayed on a user terminal on the user terminal, and a screen on which the image is displayed. When a predetermined operation is performed, a transition process is performed for transitioning to a screen including an option that displays an image that prompts the next input when it becomes a candidate for the input and is selected, and an image that prompts the user to input the option. A program for functioning as a second processing unit is provided.

  According to the present invention, the transition from content browsing to interactive exchange can be facilitated.

The figure showing the whole structure of the interactive user assistance system which concerns on an Example. The figure showing the hardware constitutions of a server apparatus and a user terminal Diagram showing functional configuration realized by interactive user support system Diagram showing an example of a summary Diagram showing an example of a dialogue scenario Diagram showing an example of the displayed summary list A figure showing an example of the displayed dialogue image A diagram showing an example of a switched dialogue image The figure showing an example of the displayed input promotion image and choice image A figure showing an example of the displayed dialogue image The figure showing an example of the operation procedure of each apparatus in support processing The figure showing an example of the functional composition realized by a modification The figure showing an example of the functional composition realized by a modification The figure showing an example of the functional composition realized by a modification The figure showing an example of the functional composition realized by a modification The figure showing an example of the functional composition realized by a modification A figure showing an example of a word usage table

[1] Embodiment FIG. 1 shows an overall configuration of an interactive user support system 1 according to an embodiment. The interactive user support system 1 is a system for supporting a user through an interactive user interface (UI). An interactive UI is a UI in which a device that behaves like a person or an animal presents necessary information, functions, and the like while communicating to the user such as asking and responding. The interactive user support system 1 supports a user by, for example, presenting information that the user wants to obtain or guiding to a site where the user can perform a desired process.

  The interactive user support system 1 includes a network 2, a server device 10, and a user terminal 20. The network 2 is a communication system including a mobile communication network and the Internet, and relays data exchange between devices accessing the own system. The server device 10 is accessing the network 2 via wired communication, and the user terminal 20 is accessing via wireless communication. Access to the network 2 may be either wired communication or wireless communication.

  The server device 10 is an information processing device that processes screen information displayed in the interactive UI. The server device 10 stores data such as a dialogue scenario representing how to proceed with the dialogue, and controls display on the interactive UI using the data. The user terminal 20 is a display device such as a smartphone having a display function for displaying an image on a display surface, and is used by a user.

  The user terminal 20 displays an interactive UI by displaying an image indicated by the data transmitted from the server device 10, and accepts an input from the user to change the screen of the interactive UI. The input here includes input for selecting a manipulator image that receives a user operation, input for selecting one of displayed options, input for scrolling the screen, and the like in addition to input of characters and the like. In addition to manual input, voice input and gesture input are also included.

  FIG. 2 shows a hardware configuration of the server device 10 and the user terminal 20. Each of the server device 10 and the user terminal 20 is a computer including each device such as a processor 11, a memory 12, a storage 13, a communication device 14, an input device 15, an output device 16, and a bus 17. Note that the term “apparatus” here can be read as a circuit, a device, a unit, or the like. Each device may include one or a plurality of devices, or some of the devices may not be included.

  The processor 11 controls the entire computer by operating an operating system, for example. The processor 11 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, a register, and the like. Further, the processor 11 reads programs (program codes), software modules, data, and the like from the storage 13 and / or the communication device 14 to the memory 12, and executes various processes according to these.

  The number of processors 11 that execute various processes may be one, two or more, and the two or more processors 11 may execute various processes simultaneously or sequentially. Further, the processor 11 may be implemented by one or more chips. The program may be transmitted from the network via a telecommunication line.

  The memory 12 is a computer-readable recording medium, and includes, for example, at least one of ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), RAM (Random Access Memory), and the like. May be. The memory 12 may be called a register, a cache, a main memory (main storage device), or the like. The memory 12 can store the above-described program (program code), software module, data, and the like.

  The storage 13 is a computer-readable recording medium such as an optical disc such as a CD-ROM (Compact Disc ROM), a hard disc drive, a flexible disc, a magneto-optical disc (eg, a compact disc, a digital versatile disc, a Blu- ray (registered trademark) disk, smart card, flash memory (eg, card, stick, key drive), floppy (registered trademark) disk, magnetic strip, or the like.

  The storage 13 may be called an auxiliary storage device. The above-described storage medium may be, for example, a database including the memory 12 and / or the storage 13, a server, or other suitable medium. The communication device 14 is hardware (transmission / reception device) for performing communication between computers via a wired and / or wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module.

  The input device 15 is an input device (for example, a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that accepts an input from the outside. The output device 16 is an output device that performs output to the outside (for example, a display, a speaker, an LED lamp, etc.). The user terminal 20 has a configuration (touch screen) in which the input device 15 and the output device 16 are integrated.

  The devices such as the processor 11 and the memory 12 are accessible to each other via a bus 17 for communicating information. The bus 17 may be composed of a single bus or may be composed of different buses between devices. The server device 10 and the like include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), and a field programmable gate array (FPGA). It may be comprised including.

  Moreover, part or all of each functional block may be implement | achieved by the said hardware as for the server apparatus 10 grade | etc.,. For example, the processor 11 may be implemented by at least one of these hardware. The server device 10 and the user terminal 20 store a program provided in the present system, and a function group described below is realized by the processor of each device executing the program and controlling each unit.

  FIG. 3 shows a functional configuration realized by the interactive user support system 1. The user terminal 20 includes a summary list display unit 201, a display operation reception unit 202, a dialogue image display unit 203, and a selection operation reception unit 204. The server device 10 includes a data storage unit 101, a summary list generation unit 102, a summary list transmission unit 103, a browsing summary identification unit 104, an input promotion image generation unit 105, a dialogue image data transmission unit 106, and an option image. And a generation unit 107.

  The data storage unit 101 of the server device 10 stores data for realizing an interactive UI. Specifically, the data storage unit 101 stores scenario data indicating a plurality of interaction scenarios and summary data indicating a summary (summary) of these interaction scenarios. This summary is an example of the “content” of the present invention. Scenario ID and summary ID for identifying each are assigned to scenario data and summary data.

  A dialogue scenario is a set of branches, such as what kind of response, inquiry, information presentation, etc. are performed in response to a user's input along the flow of dialogue. For example, product information and service information Etc. or used to guide users to mail order sites and reservation sites. The scenario data is data representing an image that prompts the user to input (an input promoting image) and an image (option image) indicating options that are candidates for input, which are presented in the dialogue scenario.

  An input promotion image is, for example, an image representing a sentence that prompts input directly such as “Please input ~”, “I can input ~”, and “Do you have any questions?” . However, even if the text doesn't seem to prompt you to enter it directly, for example, you can display the text “There is such a product” with a link to the product introduction page, or “It ’s a nice weather today.” If these sentences are displayed together with a link to the introduction page of the resort, those sentences prompt the input for selecting those links (an example of options).

The summary data is data indicating the theme (theme), summary, representative option image, and the like of the dialogue scenario, and the summary is used as an entrance to the dialogue scenario.
FIG. 4 shows an example of the summary. 4A shows a summary A1 with the theme of “new model information”, and FIG. 4B shows a summary A2 with the theme of “travel information”. FIG. 4C shows a summary A3 with the theme of “gourmet information”, and FIG. 4D shows a summary A4 with the theme of “weather information”. In each summary, a representative option image presented in the dialog scenario to be summarized and a character string describing details of the theme are displayed.

  FIG. 5 shows an example of a dialogue scenario. In the example of FIG. 5, a dialogue scenario B2 corresponding to the summary A2 of “travel information” is represented. In the dialogue scenario B2, when the branch “travel information” is selected, options such as “tour around Tohoku” and “Okinawa remote island” are presented. When these options are selected, they are used as the next branch. For example, when the option “Tour Tohoku” is selected, options such as “Aizu Wakamatsu Castle”, “Zao Mt. Ryoku” and “Shirakami Mountains” are presented when this option is taken as the next branch.

  When “Aizuwakamatsu Castle” is further selected, options such as “Introduction to Castle”, “Hotel Search”, “Gourmet Search”, “Higashiyama Onsen” and “Oyakuen” are presented. As for the options after “Aizu Wakamatsu Castle”, only when “Higashiyama Onsen” is selected, the options “Introducing Onsen”, “Hotel Search”, and “Day Trip Onsen” are presented. As described above, in the dialogue scenario, the depth of the hierarchy (the number of times of selection) may be different depending on the selected option.

  In addition to one-way from the upper layer to the lower layer, the selection may return to the upper layer when presented and the options may be presented (for example, after selecting “Aizuwakamatsu Castle” If you choose the option “Other tourist spots”, you will be presented with “Zao Mt. These branches and options are assigned option IDs for identifying them, and the scenario data includes those option IDs.

  The summary list generation unit 102 of the server apparatus 10 generates a summary list using the summary data stored in the data storage unit 101. In this embodiment, the summary list generation unit 102 extracts summary data in order from the latest update date, for example, and generates a summary list in which the summaries indicated by the extracted summary data are arranged. The summary list generating unit 102 generates list data indicating the generated summary list, the size of the entire summary list on the screen, the size of each summary on the screen, and the summary ID assigned to each summary to generate a summary. The data is supplied to the list transmission unit 103.

  The summary list transmission unit 103 transmits the summary list generated by the summary list generation unit 102 to the user terminal 20 by transmitting the supplied list data to the user terminal 20. The generation and transmission of the summary list are performed in response to a request from the user terminal 20 that has been operated to display the summary list, for example. The summary list display unit 201 of the user terminal 20 receives the list data transmitted from the server device 10, and displays one screen from the summary list indicated by the received list data.

  FIG. 6 shows an example of the displayed summary list. In the example of FIG. 6, the summary list display unit 201 displays a summary list screen C1 in which the summaries A1, A2, A3, and A4 shown in FIG. 4 are arranged in order from the top of the screen. These summaries represented in FIG. 6 are part of the summary list. The summary list display unit 201 displays a scroll bar D1 indicating the position represented by the currently displayed summary in the summary list, using the size of the entire list indicated by the list data and the size of each summary.

  The summary list display unit 201 supplies display position information indicating the position of each summary being displayed and the position of the scroll bar D1 to the display operation reception unit 202. The display operation accepting unit 202 accepts an operation on the summary list screen displayed (displayed) by the summary list display unit 201. The display operation reception unit 202 determines the operation content of the user based on the supplied display position information.

  The display operation accepting unit 202 accepts an operation of tapping any summary as a selection operation for selecting the summary. Further, the display operation receiving unit 202 receives an operation of dragging the summary display area or the scroll bar D1 as a scroll operation in the drag direction. When receiving these operations, the display operation receiving unit 202 supplies operation data indicating the contents of the received operations to the summary list display unit 201.

  When the supplied operation data indicates a scroll operation, the summary list display unit 201 scrolls and displays the displayed summary list. Further, when the supplied operation data indicates a selection operation, the summary list display unit 201 generates selection notification data (data indicating the summary ID of the selected summary) to notify the selected summary, and the server device 10. Send to.

  The summary list display unit 201 displays display notification data (displayed at that position) for notifying the summary displayed at a predetermined position among the currently displayed summaries regardless of whether or not an operation is performed. Data indicating the summary ID of the summary) is also generated. As the predetermined position, for example, a position that is most likely to be browsed by the user among the displayed summaries is used, and in this embodiment, the position is near the center in the vertical direction of the display surface. The browsing position E1 where the second summary from the top is displayed is used.

  In the example of FIG. 6, since the summary list display unit 201 displays the summary A2 at the browsing position E1, it generates display notification data for notifying the summary A2. The summary list display unit 201 transmits the generated selection notification data and display notification data to the server device 10. Upon receiving the transmitted selection notification data and display notification data, the summary list transmission unit 103 of the server device 10 supplies the display notification data to the browsing summary specifying unit 104 and supplies the selection notification data to the option image generation unit 107. To do.

  When a plurality of contents (a plurality of summaries in the present embodiment) are displayed (displayed) on the user terminal 20, the browsing summary specifying unit 104 is browsed (viewed) by the user among the plurality of contents. Identify the content. The browsing summary specifying unit 104 is an example of the “specifying unit” in the present invention. In this embodiment, the browsing summary specifying unit 104 specifies the summary indicated by the supplied display notification data (summary displayed at the browsing position E1) as the content being browsed by the user.

  The summary list display unit 201 may generate display notification data for notifying the summary A2 when the summary A2 is displayed (displayed) for a predetermined time or longer at the browsing position E1. By doing so, the browsing summary specifying unit 104 does not specify a summary that only passes through the browsing position E1 while scrolling as browsing content, but only browses the summary displayed at the browsing position E1 for a predetermined time or longer. Is identified as content that has been The browsing summary identification unit 104 supplies the summary ID of the identified summary to the input promotion image generation unit 105.

  The input promotion image generation unit 105 generates an image (input promotion image) that prompts input according to the content displayed on the user terminal 20. An input promotion image is an image representing a sentence that speaks to prompt the user to input something, for example. In this embodiment, the input promotion image generation unit 105 generates an image that prompts input according to the content specified by the browsing summary specification unit 104 as an input promotion image.

  In this embodiment, each scenario data includes a sentence that prompts input in accordance with a summary corresponding to the dialogue scenario indicated by each scenario data. When the travel summary summary A2 is specified by the browsing summary specification unit 104, the input promotion image generation unit 105 reads the travel information dialogue scenario B2 from the data storage unit 101, and is included in the dialogue scenario B2. An image indicating a sentence prompting input corresponding to the summary A2 is generated as an input promotion image.

  The input promotion image generation unit 105 supplies the generated input promotion image to the dialogue image data transmission unit 106. The interactive image data transmission unit 106 generates data indicating the supplied input promotion image as interactive image data for performing interactive display, and transmits the generated interactive image data to the user terminal 20. The interactive image display unit 203 of the user terminal 20 receives the interactive image data transmitted from the server device 10, and displays the input promotion image indicated by the received interactive image data as an interactive image for interactive display. .

  FIG. 7 shows an example of the displayed dialogue image. In the example of FIG. 7, the dialogue image display unit 203 displays the avatar F1 and the balloon image G1 as input promotion images (dialogue images) superimposed on the summary list screen C1 shown in FIG. The avatar F1 is an image showing an avatar that is an anthropomorphic representation of an apparatus that is a partner of a user's dialogue in an interactive UI. The balloon image G1 is an image representing a message from the avatar to the user.

  In the example of FIG. 7, a sentence “There is a recommended travel destination!” Is displayed as a message for the user. When an image that is clearly a message for the user is displayed in this way, it is generally known that some input is necessary to see the continuation of the message. Therefore, it can be said that the avatar F1 and the speech balloon image G1 prompt the input for seeing the continuation of the message.

  When the summary list screen is displayed by making an inquiry to the summary list display unit 201, the dialogue image display unit 203 displays the dialogue image superimposed on the summary list screen. As described above, the input promotion image generation unit 105 and the dialogue image data transmission unit 106 function as the display processing unit 108 that performs display processing for causing the user terminal 20 to display the input promotion image described above. The display processing unit 108 is an example of the “first processing unit” in the present invention.

  In this embodiment, the display processing unit 108 performs display processing for displaying an input promotion image that prompts input according to the content specified by the browsing summary specifying unit 104 as described above. When the user performs an operation of scrolling the summary list, the summary displayed (displayed) at the browsing position E1 is switched, so that the content specified by the browsing summary specifying unit 104 is also switched. The display processing unit 108 performs a display process for displaying an input promotion image that prompts input according to the new content that has been switched each time the content specified in this way is switched.

  FIG. 8 shows an example of the switched dialogue image. In FIG. 8A, since the summary A3 of “gourmet information” is displayed at the browsing position E1, the display processing unit 108 has identified the sentence “Would you like to search for nearby shops?” Display processing is performed to display an input promotion image that prompts input according to the content (summary A3). In FIG. 8B, since the summary A4 of “weather information” is displayed at the browsing position E1, the display processing unit 108 reads the sentence “The weather looks good today” as the specified content ( Display processing is performed to display an input promotion image that prompts input according to the summary A4).

  The dialogue image display unit 203 supplies display position information indicating the position of the input promotion image being displayed to the selection operation reception unit 204. The selection operation reception unit 204 receives a selection operation for selecting an input promotion image displayed (displayed) by the dialogue image display unit 203. When an operation of tapping a position indicated by the supplied display position information is performed, the selection operation reception unit 204 receives the operation as an input promotion image selection operation. The selection operation performed on the screen on which the input promotion image is displayed (displayed) is an example of the “predetermined operation” in the present invention.

  Upon receiving this selection operation, the selection operation receiving unit 204 generates selection operation data indicating the summary ID of the content (summary) corresponding to the input promotion image for which the selection operation has been received, and transmits the selection operation data to the server device 10. The transmitted selection operation data is supplied to the option image generation unit 107 of the server device 10. The option image generation unit 107 generates an option image indicating options to be selected by the user.

  The option image generation unit 107 reads scenario data corresponding to the summary of the summary ID indicated by the supplied selection operation data from the data storage unit 101. When the selection operation is performed on the input promotion image shown in FIG. 7 and the selection operation data indicates the summary ID of the summary A2, the option image generation unit 107 displays the scenario data of the dialogue scenario B2 corresponding to the summary A2. read out. The option image generation unit 107 generates an option image indicating the options indicated in the read scenario data (dialog scenario B2).

  The dialog scenario is associated with a branch presented when a corresponding summary is selected. For example, in the case of the dialogue scenario B2, a branch “travel information top” is associated with the summary A2. When the supplied selection operation data indicates the summary A2, the option image generation unit 107 selects options (“Tohoku Tour” and “Tohoku Tour” and “Tour Tohoku”) that are branches corresponding to the summary A2 in the dialogue scenario B2. An option image indicating “Okinawa remote island” or the like is generated.

  The scenario data includes a thumbnail image (which may be just an image) indicating each option, an explanatory text, and the like. For example, in the case of the “Tohoku Tour” option, a thumbnail image of a photo that images Tohoku and an explanatory text that includes the names of representative tourist spots in the Tohoku region are included (only a thumbnail image or an explanatory text may be used). . For each option, the option image generation unit 107 generates an option image using these thumbnail images, explanations, and the like.

  The option image generation unit 107 supplies the generated option image to the dialogue image data transmission unit 106. The dialog image data transmission unit 106 generates data indicating the supplied option image and the input promotion image on which the selection operation has been performed when generating the option image as the dialog image data. The generated dialog image data It transmits to the user terminal 20. The interactive image display unit 203 of the user terminal 20 displays the input promotion image and the option image indicated by the transmitted interactive image data as the interactive image.

  FIG. 9 shows an example of the displayed input promotion image and option image. In the example of FIG. 9, the dialogue image display unit 203 includes the input promotion image (avatar F1 and the balloon image G1) shown in FIG. 7 and “Tohoku tour”, “Okinawa remote island” included in the dialogue scenario B2 shown in FIG. A travel information screen C2 including option images H1, H2, and H3 indicating each option “Hida Takayama” is displayed. Further, the dialogue image display unit 203 displays a scroll bar D2 indicating the position represented by the currently displayed option image among all the option images.

  In the example of FIG. 9, the dialogue image display unit 203 displays the option images side by side so that all option images are displayed by scrolling horizontally. However, the dialog image display unit 203 displays the input promotion image with a fixed display position even when the option image is scrolled in the horizontal direction. Thereby, the user can confirm all the options while always confirming the input promotion image.

  When the option image is displayed by the dialog image display unit 203, the selection operation receiving unit 204 receives a selection operation for selecting one of the option images. When an operation of tapping an option image is performed, the selection operation reception unit 204 receives the operation as an option image selection operation. The selection operation reception unit 204 generates selection operation data indicating the option ID assigned to the option indicated by the option image that has received the selection operation, and transmits the selection operation data to the server device 10.

  The transmitted selection operation data is supplied to the input promotion image generation unit 105 and the option image generation unit 107 of the server device 10. The option image generation unit 107 generates an option image indicating options that allow the user to make further selections when the option indicated by the supplied option data is the next branch. For example, if the option image H1 shown in FIG. 9 is selected, the option image generation unit 107 selects an option (““ Tohoku Tour ”) that is an option indicated by this option image H1 in the dialogue scenario B2 (“ Option images indicating “Aizuwakamatsu Castle”, “Mt. Zao” and “Shirakami Mountains”) are generated.

  On the other hand, the input promotion image generation unit 105 generates, as an input promotion image, an image that prompts input according to the option image selected by the selection operation. The scenario data includes a sentence that prompts input corresponding to each option for each option selected in the branch. When the option image H1 is selected by the selection operation, the input promotion image generation unit 105 generates an image indicating a sentence indicating that the option indicated by the option image H1 has been selected as the input promotion image.

  Further, the input promotion image generation unit 105 reads out scenario data indicating the dialogue scenario B2 from the data storage unit 101, and inputs according to “Tohoku tour” which is an option indicated by the option image H1 included in the dialogue scenario B2. An image showing a sentence prompting the user is generated as an input promotion image. The dialog image data transmission unit 106 is supplied with both the input promotion image generated by the input promotion image generation unit 105 and the option image generated by the option image generation unit 107.

  The dialog image data transmission unit 106 generates data indicating the supplied input promotion image and option image as dialog image data, and transmits the generated dialog image data to the user terminal 20. The dialogue image display unit 203 displays the input promotion image and the option image indicated by the received dialogue image data as a dialogue image.

  FIG. 10 shows an example of the displayed dialogue image. In the example of FIG. 10, the dialogue image display unit 203 includes an option (balloon image G11) selected on the previous screen, a newly generated input promotion image (avatar F1, balloon image G12), and a dialogue scenario B2. A travel information screen C3 including option images H11, H12, H13, and H14 indicating the respective options of “Aizu Wakamatsu Castle”, “Mt. Zao Mt.”, “Shirakami Mountains”, and “Osanyama” included is displayed.

  The balloon image G11 in which the character string “Tohoku Tour” is shown indicates that the user has selected the option “Tohoku Tour” in the previous branch. A balloon image G12 in which a character string “There is such a sightseeing spot in Tohoku!” Indicates a sentence that prompts input according to “Tohoku tour”. In addition, each option image indicates an option prepared next when the option “tour around Tohoku” selected by the user is branched.

  As described above, the input promotion image generation unit 105, the dialogue image data transmission unit 106, and the option image generation unit 107 display (display the input promotion images (for example, the avatar F1 and the balloon image G1 illustrated in FIG. 7). ) Functions as a transition processing unit 109 that performs a transition process for transitioning the screen (also the summary list screen C1) to a screen including the input promotion image and the option image (the travel information screen C2 shown in FIG. 9). The transition processing unit 109 is an example of the “second processing unit” in the present invention.

  In the example of FIGS. 7 and 9, when the input promotion image selection operation is performed on the summary list screen C1, the transition processing unit 109 selects options (option images H1) that are candidates for input prompted by the input promotion image. , H2 and H3) and a transition process for transitioning to a screen (travel information screen C2) including an input promotion image (avatar F1 and balloon image G1) that prompts the user to input those options.

  The options (option images H1, H2, and H3) displayed on the screen transitioned by this transition processing are selected as one of the input promotion images that prompt the next input (the avatar shown in FIG. 10). F1, a balloon image G12) and an image as a manipulator on which options (candidate images H11, H12, H13, and H14 shown in FIG. 10) that are candidates for the next input are displayed.

  When the selection operation for selecting the option image H1, for example, is performed on the travel information screen C2, the transition processing unit 109 further prompts the next input (the avatar F1, the balloon images G11 and G12 shown in FIG. 10), the next Transition processing for transitioning to the travel information screen C3 including the options (option images H11, H12, H13, and H14 shown in FIG. 10) is performed. In addition, when the selection operation for selecting, for example, the option image H11 is performed on the travel information screen C3, the transition processing unit 109 performs the transition process in the same manner.

Each device provided in the interactive user support system 1 performs support processing for supporting a user with an interactive UI based on the above configuration.
FIG. 11 shows an example of the operation procedure of each device in the support process. This operation procedure is started, for example, when a user performs an operation for displaying a summary list. First, the server device 10 (summary list generation unit 102) generates a summary list using summary data stored in the own device (step S11).

  Next, the server device 10 (summary list transmission unit 103) transmits the summary list generated in step S11 to the user terminal 20 (step S12). The user terminal 20 (summary list display unit 201) displays one screen from the transmitted list data (step S13). Subsequently, the user terminal 20 (display operation reception unit 202) receives an operation on the summary list screen displayed (displayed) on the terminal itself (step S21). Note that the operation in step S21 is performed only when the user performs a display operation.

  Next, the user terminal 20 (summary list display unit 201) generates display notification data for notifying the summary displayed (displayed) at the browsing position among the currently displayed summaries (step S22). The generated display notification data is transmitted to the server device 10 (step S23). When a plurality of summaries are displayed on the user terminal 20, the server device 10 (browsing summary specifying unit 104) specifies a summary that is browsed (viewed) by the user (step S24).

  Next, the server device 10 (input promotion image generation unit 105) generates an image that prompts input according to the summary specified in step S24 as an input promotion image (step S25). Subsequently, the server device 10 (interactive image data transmission unit 106) generates interactive image data indicating the input promotion image generated in step S25 (step S26), and transmits the generated interactive image data to the user terminal 20. (Step S27).

  The user terminal 20 (interactive image display unit 203) displays the input promotion image indicated by the transmitted interactive image data as in the example shown in FIG. 7, for example (step S28). Next, the user terminal 20 (selection operation accepting unit 204) accepts a selection operation for selecting an input promotion image displayed (displayed) on the terminal (step S31), and corresponds to the selected input promotion image. The selection operation data indicating the summary ID of the summary to be generated is generated and transmitted to the server device 10 (step S32).

  The server device 10 (the option image generation unit 107) generates an option image indicating options under the branch associated with the summary selected by the selection operation indicated by the transmitted selection operation data in the dialogue scenario ( Step S33). Next, the server device 10 (interactive image data transmission unit 106) displays interactive image data indicating the option image generated in step S33 and the input promotion image on which the selection operation has been performed when the option image is generated. It produces | generates (step S34) and transmits the produced | generated dialogue image data to the user terminal 20 (step S35).

  The user terminal 20 (interactive image display unit 203) displays the input promotion image and option image indicated by the transmitted interactive image data as in the example shown in FIG. 9, for example (step S36). Next, the user terminal 20 (selection operation reception unit 204) receives a selection operation for selecting an option image displayed (displayed) on the terminal (step S41), and a selection operation indicating the selected option image Data is generated and transmitted to the server device 10 (step S42).

  The server device 10 (option image generation unit 107) generates an option image indicating options under the branch associated with the option image indicated by the transmitted selection operation data in the dialogue scenario (step S43). Next, the server device 10 (input promotion image generation unit 105) generates an image that prompts input according to the option image selected by the selection operation as an input promotion image (step S44). Note that steps S43 and S44 may be performed in reverse order or in parallel.

  Subsequently, the server device 10 (interactive image data transmission unit 106) generates interactive image data indicating the option image generated in step S43 and the input promotion image generated in step S44 (step S45). The interactive image data thus transmitted is transmitted to the user terminal 20 (step S46). The user terminal 20 (interactive image display unit 203) displays the input promotion image and option image indicated by the transmitted interactive image data as in the example shown in FIG. 10, for example (step S47).

  In this embodiment, when a summary list is displayed, an input promotion image is displayed as shown in FIG. 7, and when a selection operation for selecting the input promotion image is performed, interactive exchanges are performed as shown in FIG. Be started. Thereby, when browsing a plurality of contents such as a summary list, it is possible to make the transition to interactive interaction smoother than when the input promotion image is not displayed.

  In this embodiment, an input promotion image corresponding to the summary specified as being browsed by the user in the summary list is displayed. Thus, when the screen displaying the content such as the summary list is switched to the interactive screen such as the travel information screen C2 shown in FIG. 9, the interactive communication according to the content that the user is browsing Is started.

[2] Modifications The above-described embodiments are merely examples of the present invention, and may be modified as follows.

[2-1] Input Promotion with Time Determined In the embodiment, the input promotion image is displayed for all contents (summary), but the present invention is not limited to this. For example, depending on the content, the time for displaying the input promotion image for the content may be determined. For example, it is determined that the input promotion image of the content “cherry-blossom viewing information” is displayed only during the cherry-blossom viewing time, and the input promotion image of the content “Typhoon information” is determined to be displayed only during the summer to autumn time.

  Further, the input promotion image of the content “product information” is determined to be displayed only during the campaign period of the product. In the present modification, the display processing unit 108 performs display processing at a time determined for the content displayed on the user terminal 20. Specifically, the display processing unit 108 stores a time table in which summary IDs are associated with displayable times.

  The display processing unit 108 performs display processing for displaying an input promotion image when the current date and time are included in the time associated with the summary ID of the browsing summary specified by the browsing summary specifying unit 104. If not, display processing is not performed. As a result, content (summary) that is not suitable for providing interactively in a timely manner can be prevented from transitioning to an interactive screen even if the user is browsing the content.

[2-2] Presence / absence of display of input promotion image The presence / absence of display may be different for each input promotion image. For example, content (summary) for displaying the input promotion image and content (summary) for which the input promotion image is not displayed may be different for each user.
FIG. 12 shows an example of a functional configuration realized in this modification. In the example of FIG. 12, a server device 10 a including a user related information acquisition unit 111 in addition to the units illustrated in FIG. 3 is illustrated.

  The user-related information acquisition unit 111 acquires user-related information that is information regarding a user who uses the user terminal 20. The user related information acquisition unit 111 is an example of the “related information acquisition unit” in the present invention. The user-related information acquisition unit 111, for example, own attribute information (age, sex, residential area, contract date of the user terminal 20, etc.) and preference information (users who use the interactive user support system 1) are registered in advance. Hobbies, favorite foods, special skills, etc.) are associated with the user ID and stored as user-related information.

  In this modification, the user terminal 20 stores the user ID of the user who uses the terminal, and adds the user ID when transmitting the display notification data. This user ID is transmitted to the input promotion image generation unit 105. The input promotion image generation unit 105 notifies the user related information acquisition unit 111 of the user ID and requests user related information in order to determine whether or not to generate an input promotion image.

  Upon receiving this request, the user related information acquisition unit 111 acquires user related information stored in association with the notified user ID. The user related information acquisition unit 111 supplies the acquired user related information to the input promotion image generation unit 105. The input promotion image generation unit 105 is input when user-related information satisfying a condition (generation condition) defined for the content specified by the browsing summary specifying unit 104 (summary displayed on the user terminal 20) is acquired. Generate a promotion image.

  As the generation condition, for example, if the content is new model information, a condition that is satisfied when user-related information indicating the contract date of the user terminal 20 two years or more before the present is acquired is used. In addition, if the content is travel information, conditions that are satisfied when user-related information indicating travel as a hobby is acquired. If the content is gourmet information, user-related information indicating meal, eating out, etc. as hobbies. A condition that is satisfied when is acquired is used.

  Instead of determining whether or not the input promotion image generation unit 105 satisfies the generation condition, user-related information that satisfies the condition (transmission condition) defined for the specified content is generated by the dialog image data transmission unit 106. In this case, interactive image data indicating an input promotion image may be transmitted. In any case, the display processing unit 108 performs display processing when user-related information that satisfies a condition (generation condition or transmission condition) defined for content displayed (displayed) on the user terminal 20 is acquired. I do.

  In this modified example, by using a condition that is satisfied when user-related information indicating that the user is likely to be interested in the content is acquired, the user who is likely to be interested in the content is used. The input promotion image is displayed only on the terminal 20, and the transition to the interactive exchange is smoothly performed. Further, when viewed from the same user, the input promotion image is displayed only for the content that the user is interested in.

  The more input promotion images that are displayed, the more difficult it is to find input promotion images of content that the user is really interested in. By narrowing down the input promotion image displayed as described above, it is possible to make it easier for the user to select the input promotion image of the content that he is interested in, compared to the case where such a narrowing down is not performed.

[2-3] Display of Option Image for Each User The displayed option image may be different for each user.
FIG. 13 shows an example of a functional configuration realized in this modification. In the example of FIG. 13, a server device 10 b including a user related information acquisition unit 111 in addition to the units illustrated in FIG. 3 is illustrated. The user related information acquisition unit 111 has the same function as that shown in FIG.

  In the example of FIG. 13, the user related information acquisition unit 111 supplies the acquired user related information to the option image generation unit 107. The option image generation unit 107 generates an option image indicating input options corresponding to the content displayed (displayed) on the user terminal 20 and the user related information acquired by the user related information acquisition unit 111. In the dialogue scenario, a plurality of selectable options are associated with each scenario branch.

  For example, if the branch is “Aizu Wakamatsu Castle” shown in FIG. 5, options such as “hotel search”, “gourmet search”, “Higashiyama hot spring”, and “Oyakuen” are associated with each other. When the option “Aizu Wakamatsu Castle” is selected by the user, the option image generation unit 107 responds to the acquired user related information among the options below the branch associated with this option in the dialogue scenario B2. An option image indicating the selected option is generated.

  Specifically, the option image generation unit 107 relates to “gourmet search” and “hot spring” related to “restaurant” if user-related information indicating “restaurant” and “hot spring” is acquired as a hobby. An option image showing “Higashiyama Onsen” as an option is generated. In addition, the option image generation unit 107 indicates “garden lover” as a hobby, and user-related information indicating a residential area where the distance from Aizu Wakamatsu is 300 km or more (having to live far enough to require accommodation). If it has been acquired, an option image indicating “Oyakuen” related to “garden” and “hotel search” related to a person coming from a distant place as options is generated.

  As described above, the input option corresponding to the user-related information is, for example, an option related to the preference indicated by the user-related information, and is an option having a reason that is easily selected by the user having the attribute indicated by the user-related information. That is. The option image generation unit 107 stores an option table in which, for example, user-related information and options indicated by an option image generated when the user-related information is acquired, and refers to the option table It is determined whether to generate an option image.

  Instead of the option image generation unit 107 generating an option image corresponding to the user related information, the dialog image data transmitting unit 106 displays only the option image corresponding to the user related information among the generated option images. Data may be sent. In any case, the transition processing unit 109 includes input options corresponding to the content (summary) displayed (displayed) on the user terminal 20 and the user-related information acquired by the user-related information acquisition unit 111. Processing for transitioning to the screen is performed as transition processing.

  As described above, in this modification, for example, an option image indicating an option related to the user's interest or an option that is easy for the user to select (for example, a distant user often checks accommodation). Is displayed. By narrowing down the option images in this way, it is possible to make it easier for the user to select those options than when no narrowing down is performed.

[2-4] Display of option images for each user terminal The displayed option images may be different for each user terminal.
FIG. 14 shows an example of a functional configuration realized in this modification. In the example of FIG. 14, a server device 10 c including a terminal related information acquisition unit 112 in addition to the units illustrated in FIG. 3 is illustrated. The terminal related information acquisition unit 112 acquires terminal related information that is information related to the user terminal 20. The terminal related information acquisition unit 112 is an example of the “terminal information acquisition unit” in the present invention.

  The terminal related information acquisition unit 112, for example, contract information (product name, OS (Operating System) name, usage period, etc.) and usage information (utilization) of the user terminal 20 registered in advance by a user who uses the interactive user support system 1. Service name, application name used, etc.) are associated with the terminal ID and acquired as terminal related information. Note that the terminal-related information acquisition unit 112 may acquire the terminal-related information from the carrier system of the user terminal 20 that is a smartphone.

  The terminal related information acquisition unit 112 supplies the acquired terminal related information to the option image generation unit 107. The option image generation unit 107 generates an option image indicating input options corresponding to the content (summary) displayed (displayed) on the user terminal 20 and the terminal related information acquired by the terminal related information acquisition unit 112. To do. The option image generation unit 107 stores, for example, an option table in which terminal-related information is associated with options indicated by an option image generated when the terminal-related information is acquired, and whether to generate an option image. Is determined for each option.

  For example, when the summary “new product information” is selected, the option image generation unit 107 selects an option corresponding to the acquired terminal-related information among the options below the branch associated with this summary in the dialogue scenario. Is generated. Specifically, the option image generation unit 107 selects “OSα” when content indicating an advertisement of “application AP1” operating on “OSα” and “application AP2” operating on “OSβ” is included as an option. When the terminal-related information indicating “” is acquired, the option image of “application AP1” is generated, and the option image of “application AP2” is not generated.

  In addition, when the terminal-related information indicating “OSβ” is acquired, the option image generation unit 107 generates an option image of “application AP2” and does not generate an option image of “application AP1”. In addition to this, when content indicating an advertisement of “use service Δ” that is an extension service of “use service γ” is included as an option, the option image generation unit 107 displays a terminal indicating “use service γ”. An option image of “use service Δ” is generated only when related information is acquired.

  As described above, the input option corresponding to the terminal-related information is, for example, a selectable option (for example, an option for an operable product; an option for an inoperable product) in the contract status or usage service status indicated by the terminal-related information. Options are excluded), and options that are not desired to be selected (for example, options for products that can easily realize the operating environment. Options for products that require labor and cost to realize the operating environment are excluded. ) Or both.

  Instead of the option image generating unit 107 generating an option image corresponding to the terminal related information, the dialog image data transmitting unit 106 shows only the option image corresponding to the terminal related information among the generated option images. Data may be sent. In any case, the transition processing unit 109 includes input options corresponding to the content (summary) displayed (displayed) on the user terminal 20 and the terminal related information acquired by the terminal related information acquisition unit 112. Processing for transitioning to the screen is performed as transition processing.

  In this modification, for example, only option option images related to products and services that can be used (or can be easily used) on the user terminal 20 are displayed, and option option images related to products and services that are not. Is not displayed. As a result, the option images are displayed after being narrowed down to those more useful to the user, so that those useful options can be easily selected as compared with the case where such narrowing is not performed.

[2-5] Content Browsing History The displayed option images may be different depending on the content browsing history.
FIG. 15 shows an example of a functional configuration realized in this modification. In the example of FIG. 15, a server device 10 d that includes a history information acquisition unit 113 in addition to the units illustrated in FIG. 3 is illustrated. The history information acquisition unit 113 acquires history information indicating a history of content (summary) displayed on the user terminal 20, that is, content (summary) browsed by the user. The history information acquisition unit 113 is an example of the “history acquisition unit” in the present invention.

  The history information acquisition unit 113 acquires, for example, the summary ID (summary ID of the summary displayed at the browsing position) indicated by the display notification data transmitted to the summary list transmission unit 103 as history information. The history information acquisition unit 113 supplies the acquired history information to the option image generation unit 107. The option image generation unit 107 generates an option image indicating input options corresponding to the content (summary) displayed (displayed) on the user terminal 20 and the history information acquired by the history information acquisition unit 113.

  For example, the option image generation unit 107 categorizes the summary displayed on the user terminal 20 (for example, history, gourmet, sports, hot spring, travel, etc.), and history information indicating each genre and its genre (viewing the summary of the genre) When the history information indicating the history) is acquired, an option table in which options for generating option images are associated is stored. Here, for example, it is assumed that the option “Aizuwakamatsu Castle” is selected by the user.

  In that case, the option image generation unit 107 generates an option image indicating “gourmet search” as an option if history information indicating the genre of “gourmet” is acquired for the user. Also, the option image generation unit 107 generates an option image indicating “Higashiyama hot spring” as an option if history information indicating the genre “hot spring” is acquired. As described above, the input options corresponding to the browsing history are options that match the browsing tendency of the summary indicated by the browsing history.

  Instead of the option image generating unit 107 generating option images according to the history information, the dialog image data transmitting unit 106 generates dialog image data indicating only option images corresponding to the history information among the generated option images. You may send it. In any case, the transition processing unit 109 displays a screen including a content (summary) displayed (displayed) on the user terminal 20 and an input option corresponding to the history information acquired by the history information acquisition unit 113. Processing for transition is performed as transition processing.

  In this modification, option images are displayed only for options that match the browsing tendency of the user's past contents (summary). The browsing tendency of the content represents the user's preference or the field of interest of the user, so by narrowing down to the options that match it and presenting the option image, compared to the case where no narrowing is performed, It is possible to make it easy for the user to select those options.

[2-6] Ambient Environment The displayed option images may be different depending on the surrounding environment of the user terminal 20. The environment here includes, for example, a natural environment such as weather and temperature, and an environment that affects social activities such as traffic conditions.
FIG. 16 shows an example of a functional configuration realized in this modification. In the example of FIG. 16, a server device 10e including a terminal position acquisition unit 114 and an environment information acquisition unit 115 in addition to the units illustrated in FIG.

  The terminal location acquisition unit 114 acquires location information of the user terminal 20. In this modification, the user terminal 20 includes positioning means such as GPS (Global Positioning System), and when transmitting display notification data or the like to the server device 10e, position data indicating the latitude and longitude of the measured position is also included. Send. The terminal position acquisition unit 114 acquires the latitude and longitude indicated by the transmitted position data as the position information of the user terminal 20.

  The terminal location acquisition unit 114 supplies the acquired location information to the environment information acquisition unit 115. The environment information acquisition unit 115 acquires environment information indicating the environment at the location of the user terminal 20. The environment information acquisition unit 115 is an example of the “environment information acquisition unit” in the present invention. The environment information acquisition unit 115 specifies the location of the user terminal 20 based on the position indicated by the position information supplied from the terminal position acquisition unit 114. The location is represented by an administrative area such as a municipality.

  If the weather information is the environment information, the environment information acquisition unit 115 accesses the site of the Japan Meteorological Agency and acquires the weather information of the specified location. In addition, if the traffic information is the environment information, the environment information acquisition unit 115 accesses a site that provides real-time traffic information and acquires the traffic information of the specified location. The environment information acquisition unit 115 supplies the acquired environment information to the option image generation unit 107.

  The option image generation unit 107 generates an option image indicating input options according to the content (summary) displayed (displayed) on the user terminal 20 and the environment information acquired by the environment information acquisition unit 115. If the weather information is environment information, the option image generation unit 107 stores an option table in which each weather is associated with an option for generating an option image when weather information indicating the weather is acquired, for example. Keep it.

  For example, when the option “Aizuwakamatsu Castle” is selected by the user, the option image generation unit 107 has good weather such as “Oyakuen” and “Lake Inawashiro” if weather information indicating “sunny” is acquired. Option images that indicate places you want to visit from time to time are generated, and if weather information indicating “rain” is acquired, options such as “hotel search”, “gourmet search” and “Higashiyama hot spring” are less susceptible to rain. Is generated.

  In addition, for example, when a summary of gourmet information is selected by the user, the option image generation unit 107 generates an option image indicating, as options, a store that can be reached from the location of the user without passing through the “traffic jam” area. An option image indicating a store that does not arrive unless it passes through the “traffic jam” area is not generated. In addition, the option image generation unit 107 does not generate an option image indicating, as an option, a store that does not arrive unless it is on the “busy” route from the user's location.

  As described above, the input option corresponding to the environment history is an option recommended for the user in the environment indicated by the environment history (an option for introducing a scenic place in an environment with good weather). Options that should be avoided in the environment indicated by the environmental history (options that are not recommended to the user. For example, options that pass through the traffic jam area in a traffic jam environment) (options that do not pass through the traffic jam area) May be an input option according to the environmental history.

  Instead of the option image generation unit 107 generating an option image corresponding to the environment information, the dialog image data transmission unit 106 generates dialog image data indicating only the option image corresponding to the environment information among the generated option images. You may send it. In any case, the transition processing unit 109 displays a screen including a content (summary) displayed (displayed) on the user terminal 20 and an input option according to the environment information acquired by the environment information acquiring unit 115. Processing for transition is performed as transition processing.

  In this modification, depending on the environment (weather or traffic conditions) at the user's location, option images that are not recommended in that environment (such as options that introduce a garden on a rainy day) are not displayed. , It is possible to display option images only for options recommended in the environment (such as options for introducing a garden on a sunny day). In this way, by narrowing down the display to the options, it is possible to make it easier for the user to select an option recommended for the user in the current environment as compared with a case where the selection is not performed.

[2-7] Input Promotion Image In the embodiment, the transition processing unit 109 displays a screen including the same input promotion image at the first transition by the transition process (at the time of transition from the summary list screen C1 to the travel information screen C2). However, the present invention is not limited to this, and the screen may be changed to a screen including a different input promotion image. In this case, for example, two types of sentences that prompt input according to the summary are included in the scenario data.

  And the transition process part 109 should just make it change to the screen containing the input promotion image which shows the text different from the input promotion image displayed on the summary list screen. For example, on the summary list screen C1, the display processing unit 108 displays an input promotion image indicating a sentence “There is a recommended travel destination!”, And on the travel information screen C2, the transition processing unit 109 displays “ Display the input promotion image showing the sentence "I recommend it first!"

  In this case, since the content of the dialogue indicated by the input promotion image proceeds next when the screen changes, it is possible to feel a dialogue with a good tempo. On the other hand, if the input promotion image is made common as in the embodiment, it is possible to clearly tell that the continuation from the summary list screen is made when the screen is changed to a screen for interactive exchange.

  In addition, the display processing unit 108 and the transition processing unit 109, when performing display processing and transition processing of a screen including an input promotion image, respectively, use an image indicating any one of a plurality of sentences prompting input as an input promotion image. It may be used. For example, when the weather information summary shown in FIG. 8B is specified as the browsing summary, the display processing unit 108 causes the environment information acquisition unit 115 shown in FIG. 16 to acquire the weather information and matches the weather of the day. An input promotion image representing a sentence may be displayed.

  For example, if the probability of precipitation is less than 20%, the display processing unit 108 displays an input promotion image “The weather looks good today” as shown in FIG. 8B. If the wind speed is 5 m or more, an input promotion image such as “Please watch out because the wind is strong today” is displayed. A plurality of these display conditions may be set, and when two or more display conditions are satisfied, the input promotion images may be displayed randomly or sequentially.

  These display conditions (precipitation and wind speed conditions) and text are included in the weather information scenario data in association with the top branch of the weather information, and the display processing unit 108 includes the scenario data and the weather information. Based on this, an input promotion image is displayed. As a result, it is possible to change the input promotion image, and to prevent the interaction of interactive interaction.

[2-8] Word Usage Since the input promotion image is an image for interactive display, the word usage may be changed depending on the partner of the dialog. In this modification, a server device 10a shown in FIG. 12 is used. The user-related information acquisition unit 111 illustrated in FIG. 12 supplies the acquired user-related information to the input promotion image generation unit 105.

The input promotion image generation unit 105 generates, as an input promotion image, a character string that prompts input with a ending in accordance with the user related information acquired by the user related information acquisition unit 111. The input promotion image generation unit 105 determines which ending is to be used, for example, using a word usage table in which the gender, age, and ending indicated by the user-related information are associated with each other.
FIG. 17 shows an example of a word usage table. In the example of FIG. 17, the “male” “less than teenage” is associated with the ending “--do, do ??”.

  Similarly, the “male” “teens” will end with the word “~ da ze, will i do? ...”, and the “male” “20s and above” will be “~”. The suffix “?” Is associated. Also, in the case of “female”, the ending is “~ Da, do you want to do?” For “under 10s”, and “I ’d like to do? The ending is "?" And the ending is "~, do you want to do?

  The input promotion image generation unit 105 generates an input promotion image with a character string representing a sentence using a ending corresponding to the sex and age of the user indicated by the acquired user-related information. For example, in the input promotion image shown in FIG. 7, if it is less than a teenager, it is expressed as “Recommended travel destination!” If it is a female teenager, it is expressed as “recommended travel destination!”, 20 If it is more than a teenager, it says "There are recommended travel destinations!"

  The dialog image data transmission unit 106 transmits data indicating the input promotion image generated in this way to the user terminal 20 as dialog image data. As described above, in the present modification, the display processing unit 108 displays a process for displaying a character string that prompts input with an ending in accordance with the user-related information acquired by the user-related information acquisition unit 111 as an input promotion image. As a process. In this modified example, since the ending dialogue information according to the dialogue partner is displayed, it is possible to make it easier to have an affinity in interactive exchanges compared to the case where the ending portion is uniform.

[2-9] Content In the embodiment, when the display processing unit 108 performs display processing, what is displayed on the user terminal 20 is a summary list, that is, a plurality of contents, but is not limited thereto. For example, the display processing unit 108 may perform the display process when one screen or one content to be displayed while scrolling the screen is displayed on the user terminal 20 and the displayed content is switched by switching the screen. .

  In this case, the browsing summary specifying unit 104 specifies the content displayed (displayed) on the user terminal 20 as the content browsed (viewed) by the user, and the display processing unit 108 is specified. Display processing for displaying an input promotion image that prompts input according to the content is performed. Thereby, a new input promotion image is displayed every time the screen displaying the content of the user terminal 20 is switched.

[2-10] Browsing Content Identification Method The browsing content (browsing summary in the embodiment) identification method may be different from the embodiment. For example, the position at the top of the screen may be used as the position where the user is most likely to browse (because some people often look at the top of the screen).

  Moreover, the content currently displayed on the user terminal 20 like the said modification may be specified as browsing content. In addition, when the user terminal includes a means for photographing the display surface side, the browsing summary specifying unit 104 detects the line of sight from the photographed user image, and displays a summary of the position where the line of sight is directed. May be specified.

[2-11] Apparatus for Implementing Each Unit The apparatus for realizing each function illustrated in FIG. 3 and the like is not limited to the apparatus illustrated in those drawings. For example, the user terminal may realize a function included in the server device 10. In that case, the user terminal is an example of the “information processing apparatus” of the present invention. In this user terminal, in addition to the input promotion image generation unit 105 and the dialogue image data transmission unit 106, the dialogue image display unit 203 provided in the user terminal functions as the display processing unit 108.

  In this case, the display processing unit 108 performs not the process of transmitting the interactive image data indicating the input promotion image but the process of outputting the input promotion image to the display of the user terminal as the display process. In addition, in this user terminal, in addition to the input promotion image generation unit 105, the dialogue image data transmission unit 106, and the option image generation unit 107, the dialogue image display unit 203 provided in the user terminal functions as the transition processing unit 109.

  In this case, the transition processing unit 109 performs, as a transition process, a process of outputting the input promotion image and the option image to the display instead of the process of transmitting the dialogue image data indicating the input promotion image and the option image. Further, two or more devices may share and realize each function provided in the server device 10. In short, as long as these functions are realized as the entire interactive user support system, the interactive user support system may include any number of devices.

[2-12] Category of Invention In addition to information processing apparatuses such as user terminals and server apparatuses, the present invention can be understood as an information processing system such as an interactive user support system including these apparatuses. In addition, the present invention can be understood as an information processing method for realizing processing performed by each device, or as a program for causing a computer that controls each device to function. This program may be provided in the form of a recording medium such as an optical disk in which it is stored, or may be provided in the form of being downloaded to a computer via a network such as the Internet, installed and made available for use. May be.

[2-13] Processing Procedures, etc. The processing procedures, sequences, flowcharts, and the like of each embodiment described in this specification may be switched in order as long as there is no contradiction. For example, the methods described herein present the elements of the various steps in an exemplary order and are not limited to the specific order presented.

[2-14] Handling of input / output information and the like Input / output information and the like may be stored in a specific location (for example, a memory) or may be managed by a management table. Input / output information and the like can be overwritten, updated, or additionally written. The output information or the like may be deleted. The input information or the like may be transmitted to another device.

[2-15] Software Software, regardless of whether it is called software, firmware, middleware, microcode, hardware description language, or another name, is an instruction, instruction set, code, code segment, program code, program , Subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, execution threads, procedures, functions, etc. should be interpreted broadly.

  Also, software, instructions, etc. may be transmitted / received via a transmission medium. For example, software may use websites, servers, or other devices using wired technology such as coaxial cable, fiber optic cable, twisted pair and digital subscriber line (DSL) and / or wireless technology such as infrared, wireless and microwave. When transmitted from a remote source, these wired and / or wireless technologies are included within the definition of transmission media.

[2-16] Information, Signals The information, signals, etc. described herein may be represented using any of a variety of different technologies. For example, data, commands, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description are voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these May be represented by a combination of

[2-17] System, Network As used herein, the terms “system” and “network” are used interchangeably.

[2-18] Meaning of “based on” As used herein, the phrase “based on” does not mean “based only on”, unless expressly specified otherwise. In other words, the phrase “based on” means both “based only on” and “based at least on.”

[2-19] “and”, “or”
In the present specification, for a configuration that can be implemented by either “A and B” or “A or B”, a configuration described in one expression may be used as a configuration described in the other expression. For example, when “A and B” is described, it may be used as “A or B” as long as it is feasible without inconsistency with other descriptions.

[2-20] Variations of Aspect, etc. Each embodiment described in this specification may be used alone, in combination, or may be used by switching according to execution. In addition, notification of predetermined information (for example, notification of being “X”) is not limited to explicitly performed, but is performed implicitly (for example, notification of the predetermined information is not performed). Also good.

  Although the present invention has been described in detail above, it will be apparent to those skilled in the art that the present invention is not limited to the embodiments described herein. The present invention can be implemented as modified and changed modes without departing from the spirit and scope of the present invention defined by the description of the scope of claims. Therefore, the description of the present specification is for illustrative purposes and does not have any limiting meaning to the present invention.

DESCRIPTION OF SYMBOLS 1 ... Interactive user support system, 10 ... Server apparatus, 20 ... User terminal, 101 ... Data storage part, 102 ... Summary list production | generation part, 103 ... Summary list transmission part, 104 ... Browse summary specific part, 105 ... Input promotion image Generation unit 106 ... Dialog image data transmission unit 107 ... Option image generation unit 108 ... Display processing unit 109 ... Transition processing unit 111 ... User related information acquisition unit 112 ... Terminal related information acquisition unit 113 ... History information Acquisition unit, 114 terminal location acquisition unit, 115 environment information acquisition unit, 201 summary list display unit, 202 display operation reception unit, 203 interactive image display unit, 204 selection operation reception unit

Claims (10)

A first processing unit that performs a display process for causing the user terminal to display an image that prompts input according to content displayed on the user terminal;
When a predetermined operation is performed on the screen on which the image is displayed, the screen includes an option for displaying an image that is a candidate for input and that prompts the next input when selected, and an image that prompts input of the option An information processing apparatus comprising: a second processing unit that performs a transition process for transition. When a plurality of contents are displayed on the user terminal, a specifying unit that specifies contents to be browsed by the user is provided,
The information processing apparatus according to claim 1, wherein the first processing unit performs a process for causing the user terminal to display an image that prompts input according to the content specified by the specifying unit as the display process. The content has a time when an image that prompts input according to the content is displayed.
The information processing apparatus according to claim 1, wherein the first processing unit performs the display process at the time determined for the displayed content. A related information acquisition unit that acquires related information about a user who uses the user terminal;
The information processing apparatus according to any one of claims 1 to 3, wherein the first processing unit performs the display process when the related information that satisfies a condition defined for the displayed content is acquired. A related information acquisition unit that acquires related information about a user who uses the user terminal;
The second processing unit performs, as the transition process, a process for transitioning to a screen that includes an option corresponding to the displayed content and the acquired related information as an option that is a candidate for the input. 5. The information processing apparatus according to any one of 4. A terminal information acquisition unit for acquiring terminal information related to the user terminal;
The second processing unit performs, as the transition process, a process for transitioning to a screen that includes an option corresponding to the displayed content and the acquired terminal information as an option that is a candidate for the input. 6. The information processing apparatus according to any one of 5 above. A history acquisition unit that acquires history information of content displayed on the user terminal;
The second processing unit performs, as the transition process, a process for transitioning to a screen that includes an option corresponding to the displayed content and the acquired history information as an option that is a candidate for the input. The information processing apparatus according to any one of 6. An environment information acquisition unit for acquiring environment information indicating an environment in the location of the user terminal;
The second processing unit performs, as the transition process, a process for transitioning to a screen that includes an option corresponding to the displayed content and the acquired environment information as an option that is a candidate for the input. 8. The information processing apparatus according to any one of items 7. A related information acquisition unit that acquires related information about a user who uses the user terminal;
The said 1st process part performs the process for displaying the character string which prompts the said input with the ending according to the acquired said relevant information as said image as said display process. The information processing apparatus described. Computer
A first processing unit that performs a display process for causing the user terminal to display an image that prompts input according to content displayed on the user terminal;
When a predetermined operation is performed on the screen on which the image is displayed, the screen includes an option for displaying an image that is a candidate for input and that prompts the next input when selected, and an image that prompts input of the option A program for functioning as a second processing unit that performs transition processing for transition.

Images