JP2013025609A - Explanation support system, explanation support method and explanation support program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an explanation support system, an explanation support method and an explanation support program for supporting an explanation given by utilizing a computer terminal.SOLUTION: A control part 21 of a tablet terminal 20 specifies an explanation obligation list and executes keyword extraction processing. When an explanation obligation item is determined, the control part 21 executes negation processing of the explanation obligation list. Further, the control part 21 acquires a negation situation of the explanation obligation list. When an item not negated remains even when the notification determination reference time exceeds, the control part 21 executes warning processing. Also, when an NG word is determined, the control part 21 outputs a warning, and when determined that it is already dealt with, executes elimination processing of the warning. Then, the control part 21 executes backyard notification processing.

Description

  The present invention relates to an explanation support system, an explanation support method, and an explanation support program for supporting an explanation performed using a computer terminal.

  When explaining a product in a sales activity or the like, there are cases where attention must be paid to the expression or the like (see, for example, Patent Document 1). For example, in the sale of financial products, it is necessary to explain to buyers important matters such as various risks and restrictions such as the exercise of rights and cancellation of mid-term. Usually, such products face important buyers and explain important matters such as product risks.

  Also, an operator work support method for pointing out the inappropriateness of expressions used by operators in a call center has been studied (see, for example, Patent Document 2). The technique described in this document performs speech recognition that converts input speech into text. And the keyword contained in text data is detected from the paraphrase rule memory | storage means which memorize | stored the keyword, and detection information is output.

Japanese Patent Laying-Open No. 2005-293221 (page 3) International Publication No. 2007/094344 (first page, FIG. 1)

  As described in the patent literature, in the product description, it is necessary to pay attention to various expressions and to pay attention to items that have an obligation to explain. In such a case, it is necessary to call attention in a timely manner.

  In addition, it may be better for a third party such as an administrator to confirm the expression of the person in charge. In this case, it is necessary for a third party to accurately grasp the situation at the time of explanation. Furthermore, it is desirable that the burden of grasping the situation is light.

  The present invention has been made to solve the above-described problems, and provides an explanation support system, an explanation support method, and an explanation support program for supporting an explanation performed using a computer terminal.

  In order to solve the above-mentioned problem, the invention described in claim 1 is a data storage means for storing an explanatory material file, a checklist associated with the explanatory material file and recorded with a keyword, and the description An explanation support system comprising a computer terminal comprising a display for displaying a document file, a recognition result storage means for recording a speech recognition result, and a control means connected to a backyard terminal, the control means comprising: Means for specifying a checklist based on the explanatory material file displayed on the display; means for recording a voice recognition result obtained by converting the collected voice into text by voice recognition; and the voice recognition. In the results, if a keyword included in the checklist is detected, the detected keyword is included. And a means for extracting a speech recognition result at the sound collection time of the keyword from the recognition result storage means and transmitting an explanation status to the backyard terminal. .

  According to a second aspect of the present invention, in the explanation support system according to the first aspect, the keyword is an NG word that is avoided during the explanation, and the control means has a caution corresponding to the NG word on the display. The gist is to output an alert message.

  According to a third aspect of the present invention, in the explanation support system according to the second aspect of the present invention, an input corresponding to the detected NG word is performed by the control means in response to the alert message displayed on the display. In this case, the gist of the present invention is further provided with means for transmitting the speech recognition result up to the corresponding input time to the backyard terminal.

  The invention according to claim 4 is the explanation support system according to claim 2 or 3, wherein the NG word is composed of a combination of a plurality of keywords, and the control means corresponds to the NG word on the display. The gist is to output the alert message.

  According to a fifth aspect of the present invention, in the explanation support system according to any one of the first to fourth aspects, the control means receives support information corresponding to the explanation situation from the backyard terminal. The gist of the invention is that it further includes means for outputting support information to the display.

  According to a sixth aspect of the present invention, in the explanation support system according to any one of the first to fifth aspects, the keyword is a keyword for an item that needs to be explained, and the control means includes the check list. Is displayed on the display, and an item related to the keyword included in the check list displayed on the display is erased based on the voice recognition result.

  According to a seventh aspect of the present invention, there is provided a data storage means for storing an explanatory material file, a check list associated with the explanatory material file and recorded with a keyword, a display for displaying the explanatory material file, an audio A method for providing explanation support using an explanation support system comprising a computer terminal comprising a recognition result storage means for recording a recognition result and a control means connected to a backyard terminal, wherein the control means comprises: Identifying a checklist based on the explanatory material file displayed on the display, recording a voice recognition result obtained by converting the collected voice into text by voice recognition in the recognition result storage means, and the voice recognition In the result, if a keyword included in the checklist is detected, the detected keyword is And a step of extracting a voice recognition result of the keyword sound collection time from the recognition result storage means and transmitting an explanation status to the backyard terminal. To do.

  According to an eighth aspect of the present invention, there is provided data storage means for storing an explanatory material file, a check list associated with the explanatory material file and recorded with a keyword, a display for displaying the explanatory material file, an audio A program for providing explanation support using an explanation support system comprising a computer terminal comprising a recognition result storage means for recording a recognition result and a control means connected to a backyard terminal, the control means Means for specifying a checklist based on the explanatory material file displayed on the display, means for recording a voice recognition result obtained by converting the collected voice into text by voice recognition, in the recognition result storage means, the voice recognition In the result, if a keyword included in the checklist is detected, the detected key Display a message including a message on the display, extract a voice recognition result of the keyword sound collection time from the recognition result storage means, and cause the backyard terminal to function as a means for transmitting an explanation status. The gist.

(Function)
According to the first, seventh, or eighth aspect of the invention, the control means specifies the check list based on the explanatory material file displayed on the display. Then, the voice recognition result obtained by converting the collected voice into text by voice recognition is recorded in the recognition result storage means. When a keyword included in the checklist is detected in the speech recognition result, a message including the detected keyword is displayed on the display, and the speech recognition result of the keyword sound collection time is extracted from the recognition result storage unit. Then, the explanation status is transmitted to the backyard terminal. As a result, the contents of the explanation can be confirmed using the check list. Further, in the backyard terminal, the explanation status can be confirmed from the voice recognition result.

  According to the second aspect of the present invention, an NG word that is avoided during the explanation is used as a keyword. And a control means outputs a warning message about NG word. Thus, when an NG word is included, it is possible to call attention and correct it.

  According to the third aspect of the present invention, when the control means performs a corresponding input for the detected NG word in response to the alert message displayed on the display, the voice until the time when the corresponding input is performed is performed. The recognition result is transmitted to the backyard terminal. Thereby, a response | compatibility state can be confirmed in a backyard terminal.

  According to the fourth aspect of the present invention, the NG word is composed of a combination of a plurality of keywords, and the control means outputs a warning message corresponding to the NG word on the display. As a result, it is possible to prompt a response even when a problem occurs due to the combination.

  According to the fifth aspect of the present invention, when the control means receives support information corresponding to the explanation situation from the backyard terminal, the control means outputs the support information on the display. Thereby, it can respond with the support from a backyard.

  According to the sixth aspect of the present invention, a keyword for an item that needs to be explained is used as a keyword. And a control means displays the check list about the item which needs description on a display. Based on the voice recognition result, items related to the keyword included in the check list displayed on the display are erased. Thereby, the content which should be demonstrated can be grasped | ascertained. Therefore, items that need to be explained can be explained without omission.

  According to the present invention, it is possible to provide an explanation support system, an explanation support method, and an explanation support program for supporting an explanation performed using a computer terminal.

Explanatory drawing of the description assistance system of embodiment of this invention. Explanatory drawing of the functional block of the tablet terminal used in this embodiment. Explanatory drawing of the display screen in the tablet terminal of this embodiment. Explanatory drawing of the process sequence of this embodiment. Explanatory drawing of the process sequence of this embodiment. Explanatory drawing of the process sequence of this embodiment. Explanatory drawing of the process sequence of this embodiment.

  Hereinafter, an embodiment of an explanation support system embodying the present invention will be described with reference to FIGS. In the present embodiment, a case will be described in which a salesperson performs product explanation using explanatory materials in face-to-face sales with a customer. In the present embodiment, as illustrated in FIG. 1, a tablet terminal 10 (second terminal) and a tablet terminal 20 (first terminal) installed in a wireless communicable range are used. Furthermore, the tablet terminal 20 is connected to the backyard terminal 30 via a network.

  The tablet terminal 10 is a computer terminal (child device) used by a customer who receives a product description. On the other hand, the tablet terminal 20 is a computer terminal (master) used by a salesperson who explains a product. The tablet terminal 10 and the tablet terminal 20 communicate with each other as described later. As a communication method, for example, near field communication is performed by using Bluetooth (registered trademark) or the like. Then, the explanatory material displayed on the tablet terminal 20 that is the parent device is also displayed on the tablet terminal 10 that is the child device to explain the product. Note that the communication method is not limited to wireless communication, and wired communication can also be used.

  As illustrated in FIG. 1, the tablet terminal 10 includes a control unit 11, a data storage unit 12, a touch panel display 15, a microphone 16, and a wireless communication unit 17. On the other hand, the tablet terminal 20 includes a control unit 21, a data storage unit 22, a touch panel display 25, a microphone 26, and a wireless communication unit 27.

  The touch panel display (15, 25) functions as an input / output means, outputs information on the display, and when a touch on the display surface is detected, specifies a touch position (coordinate) and performs various operation processes (pointing process, Key input processing).

  As shown in FIG. 3, a synchronization area 151 is set on the touch panel display 15, and a synchronization area 251 is set on the touch panel display 25. The content displayed in the synchronization area 251 of the touch panel display 25 is enlarged and displayed in the synchronization area 151 (synchronization screen) of the touch panel display 15. In the present embodiment, an explanation material file is displayed in the synchronization area (151, 251). When the frame in the synchronization area 251 is slid while being touched, control is performed to move the frame horizontally. As a result, the entire synchronization area 251 can be moved, enlarged or reduced.

  Further, a position a1 (first pointer position) touched in the synchronization area 251 of the touch panel display 25 of the tablet terminal 20 is displayed on the touch panel display 15 of the tablet terminal 10 as will be described later. ) Is displayed. In addition, a position b2 (second pointer position) touched on the touch panel display 15 of the tablet terminal 10 is displayed as a slave unit pointer a2 (second pointer display) on the touch panel display 25 of the tablet terminal 20 as described later. The

  Further, on the touch panel display 25, a synchronization start button 252, a synchronization stop button 253, an explanation obligation list display area 254, a backyard support request button 255, a backyard message area 256, etc. are displayed in a screen area other than the synchronization area 251. The

  The synchronization start button 252 is an icon for instructing the start of synchronization processing for displaying the display contents of the synchronization area 251 in the synchronization area 151. On the other hand, the synchronization stop button 253 is an icon for instructing to stop the synchronization process.

  The explanation obligation list display area 254 displays an explanation obligation list in which items to be explained are listed in the product explanation using the explanation material file. In the explanation obligation list display area 254, items that have already been explained are displayed as disappeared.

  The backyard support request button 255 is an icon for requesting support from an administrator who uses the backyard terminal 30. When a message from the administrator is received from the backyard terminal 30, it is displayed in the backyard message area 256 of the touch panel display 25.

The microphones (16, 26) function as sound collecting means. Here, the microphone 16 mainly collects customer's voice and the microphone 26 mainly collects salesperson's voice.
The wireless communication units (17, 27) perform wireless communication with other communication terminals existing within a communicable distance range by the above-described communication method. The wireless communication units (17, 27) hold data relating to terminal identifiers for communicating with other communication terminals by pairing.

  The control unit 11 of the tablet terminal 10 that is a slave unit includes control means (CPU, RAM, ROM, etc.), and each of the processes (screen operation stage, display control stage, recording stage, pointer transfer stage, recording stage, etc.) to be described later. Process). By executing the explanation support program (for the slave unit) for that purpose, the control unit 11, as shown in FIG. 2, displays the screen operation means 110, the display control means 111, the recording means 113, the pointer transfer means 114, and the recording means 115. Function as.

The screen operation means 110 executes processing for acquiring input information by a touch operation on the touch panel display 15.
The display control unit 111 executes processing for controlling display on the touch panel display 15. In the present embodiment, the screen data of the synchronization area 251 is acquired from the tablet terminal 20 and displayed on the synchronization area 151 of the touch panel display 15 of the tablet terminal 10. The display control unit 111 displays the synchronization area 151 as large as possible on the touch panel display 15. Specifically, a synchronization area 151 having a shape similar to that of the synchronization area 251 is generated, and the width or height of the synchronization area 151 is displayed so as to match the width or height of the touch panel display 15.

  The recording unit 113 generates captured image data obtained by periodically capturing a screen displayed on the touch panel display 15. Then, a process of recording in the data storage unit 12 as a recording file is executed in association with the display time information. The recording unit 113 records a recording file during a period in which screen synchronization processing is performed between the tablet terminal 10 and the tablet terminal 20.

  The pointer transfer means 114 executes a process of specifying the position b2 touched on the touch panel display 15 and transmitting the position information to the tablet terminal 20 of the parent device. Here, coordinate information for specifying a relative position in the synchronization area 151 is transferred. For example, coordinate information expressed by a ratio to the horizontal width and height of the synchronization area 151 is used.

  The recording unit 115 generates a recording file using the sound collected by the microphone 16 and executes a process of recording in the data storage unit 12 in association with the recording time information. The recording unit 115 records the recording file during the period from the instruction start instruction acquired from the tablet terminal 20 to the instruction end instruction.

  In the data storage unit 12, a recording file and a recording file are recorded. In the present embodiment, a recording file generated by the recording unit 115 and a recording file generated by the recording unit 113 are recorded. The recording file area functions as recording data storage means. In the recording file area and the recording file area, audio data and recording data associated with time-related information (recording time and display time information) are recorded.

  The control unit 21 of the tablet terminal 20 that is a parent device includes control means (CPU, RAM, ROM, etc.), and will be described later (screen operation stage, display control stage, synchronization area setting stage, screen transfer stage, pointer transfer stage. Etc.). By executing the explanation support program (for the master unit) for that purpose, the control unit 21, as shown in FIG. 2, causes the screen operation means 210, display control means 211, synchronization area setting means 212, screen transfer means 213, pointer It functions as the transfer means 214. Further, the control unit 21 performs processing described later (recording stage, keyword extraction stage, NG word confirmation stage, explanation obligation confirmation stage, backyard contact stage, etc.). As shown in FIG. 2, the control unit 21 functions as a recording unit 215, a keyword extraction unit 216, an NG word confirmation unit 217, an explanation obligation confirmation unit 218, and a backyard communication unit 219.

The screen operation unit 210 executes processing for controlling a screen operation by a touch operation on the touch panel display 25.
The display control unit 211 executes processing for controlling display on the touch panel display 25.

  The synchronization area setting unit 212 executes processing for specifying a synchronization display area (synchronization area 251) designated on the touch panel display 25. The synchronization area setting unit 212 stores data relating to the coordinates of the synchronization area 251 designated on the touch panel display 25. An image displayed in the synchronization area 251 is displayed on the touch panel display 15 of the tablet terminal 10 of the slave unit.

The screen transfer unit 213 executes processing for transferring the content (image data) displayed in the synchronization area 251 to the tablet terminal 10.
The pointer transfer unit 214 executes a process of transferring the position information of the position a1 touched on the touch panel display 25 to the tablet terminal 10. Here, coordinate information specifying the relative position in the synchronization area 251 is transferred. For example, coordinate information expressed by a ratio to the width and height of the synchronization area 251 is used.

The recording unit 215 generates a recording file using the sound collected by the microphone 26 and executes a process of recording in the data storage unit 22.
The keyword extraction unit 216 executes a process of recording the voice recognition result converted into the text into the data storage unit 22 by the voice recognition process of the voice collected by the microphone 26. Then, the keyword extraction unit 216 executes a process (keyword spotting process) for matching the voice recognition result with the keywords recorded in the explanation obligation list and the NG word list of the data storage unit 22.

  The NG word confirming means 217 executes a process of specifying an NG word included in the utterance using the keyword spotted text. Further, the NG word confirmation unit 217 holds data related to the NG word notification determination reference time for determining whether or not the backyard terminal 30 needs to be notified in accordance with the response status to the NG word. Furthermore, the NG word confirmation unit 217 holds data relating to the recording period (predetermined time) of the recording data to be transmitted to the backyard terminal 30.

The explanation obligation confirmation means 218 executes processing for confirming the explanation status of the contents to be explained using the text spotted by the keyword. Furthermore, the accountability confirmation means 218 holds data related to the accountability notification determination reference time for determining whether the backyard terminal 30 needs to be notified in accordance with the extinction status of the accountability item. Further, the accountability confirmation means 218 holds data relating to the recording period (predetermined time) of the recording data to be transmitted to the backyard terminal 30.
The backyard contact means 219 executes processing for notifying the backyard terminal 30 of the explanation status (consumption status of the explanation duty item and response status of the NG word).

  The data storage unit 22 stores an explanation material file, an explanation obligation list, an NG word list, confirmation target data, a recording file, and a voice recognition result file. In the present embodiment, the explanation obligation list and the NG word list function as a check list in which keywords are recorded.

  A document file used in the product description is recorded in the explanation material file area. In this embodiment, a slide format file is used. In the explanation material file, a merchandise code and a merchandise name for specifying a merchandise to be explained are associated and recorded.

  The accountability list associated with the product code is recorded in the accountability list area. In the explanation obligation list, keywords of items that need to be explained at the time of explanation of the commodity of this commodity code are recorded. When there are a plurality of items to be explained, keywords corresponding to all items are recorded.

In the NG word list area, keywords (NG words) included in expressions that should be noted, such as words that should not be used during product descriptions, are recorded.
In the confirmation target data area, the explanation obligation list of the target product of the product description and the detected NG word are temporarily stored. In this explanation obligation list, data relating to the time when the explanation material file is opened (explanation start time) is recorded in association with each other. Furthermore, each item in the explanation obligation list is associated with data related to the time (confirmation time) when the keyword is detected in the voice recognition. In addition, data relating to the detection time at which the NG word is detected is associated with the NG word and recorded. Further, when a corresponding input is made, data relating to the corresponding time is recorded in association with the NG word.

  The recording file area functions as recording data storage means. The recording file generated by the recording unit 215 is recorded in the recording file area. Audio data is recorded in the recording file in association with information (recording time information) related to the time when the audio is collected.

  The voice recognition result file area functions as a recognition result storage unit. In the voice recognition result file area, a recognition result file obtained by converting voice into text by voice recognition processing is recorded. Information related to the time (sound collection time) when the sound that generated the text is collected is associated with the voice recognition result file, and the voice data is recorded.

  The backyard terminal 30 is a computer terminal used by an administrator who supports a sales representative. The backyard terminal 30 includes output means such as a display, and input means including a microphone, a pointing device, and a keyboard. Further, the backyard terminal 30 includes voice recognition means for converting the voice collected by the microphone into text.

  Next, the operation of this explanation support system will be described with reference to FIGS. Here, the screen cooperation process, the keyword handling process, the NG word handling process, and the backyard support process will be described in this order.

(Screen linkage processing)
First, the screen cooperation process will be described with reference to FIG. This process is performed when a product explanation is given in the face of a customer. In this case, the tablet terminal 10 and the tablet terminal 20 are paired via the wireless communication unit (17, 27).

  And the control part 21 of the tablet terminal 20 performs an explanation start process (step S1-1). Specifically, when a sales representative gives an explanation of a product to a customer, the explanation support program is activated on the tablet terminal 20 and an instruction to start explanation is input. Then, the sales representative selects the icon of the explanation material file used for the product explanation from the explanation material files stored in the data storage unit 22 of the tablet terminal 20. In this case, the screen operation means 210 of the control unit 21 performs an expansion process of the explanatory material file corresponding to the icon. Then, the display control unit 211 displays an explanation material file on the touch panel display 25.

  The control unit 21 of the tablet terminal 20 that has detected the input of the explanation start instruction executes a recording process (step S1-2). Specifically, the recording unit 215 of the control unit 21 starts collecting sound at the microphone 26. Then, the recording unit 215 generates a recording file of the collected voice in association with the recording time and records it in the data storage unit 22. Furthermore, the recording unit 215 transmits a recording start instruction to the tablet terminal 10 via the wireless communication unit 27.

  The control unit 11 of the tablet terminal 10 that has received the recording start instruction via the wireless communication unit 17 executes a recording process (step S1-3). Specifically, the recording unit 115 of the control unit 11 starts collecting sound in the microphone 16. Then, the recording unit 115 generates a recording file of the collected voice in association with the recording time, and records it in the data storage unit 12.

  When the sales representative ends the product description for the customer, the tablet terminal 20 inputs the end of the description. In this case, the recording unit 215 ends the recording process (step S1-2), and transmits a recording end instruction to the tablet terminal 10 via the wireless communication unit 27. Then, the recording unit 115 also ends the recording process (step S1-3).

  Next, the control unit 21 of the tablet terminal 20 executes a synchronization area setting process (step S1-4). Specifically, the synchronization area setting unit 212 of the control unit 21 outputs a message prompting the setting of the synchronization area to the touch panel display 25. In this case, the sales representative inputs coordinates for specifying the synchronization area on the touch panel display 25. In the present embodiment, on the touch panel display 25, by touching the position that is the start point and the end point of the synchronization area, a rectangular area having both points on the diagonal line is set as the synchronization area 251. For example, when the entire explanation document file displayed on the touch panel display 25 is used in the product description, the area where the explanation document file is displayed is set as the synchronization area 251. Further, in the product description, when the description is made using a part of the display of the explanatory material file, the part used for the description is set as the synchronization area 251. When the set synchronization area 251 is reduced, enlarged or slid, the user touches the frame of the synchronization area 251 and slides it.

  Next, the control part 21 of the tablet terminal 20 performs a synchronization start process (step S1-5). Specifically, the synchronization area setting unit 212 of the control unit 21 displays a synchronization start button 252 and a synchronization stop button 253 in an area other than the synchronization area 251 on the touch panel display 25. Here, when the screen operation unit 210 detects selection of the synchronization start button 252, the screen transfer unit 213 is instructed to start synchronization processing.

  And the control part 21 of the tablet terminal 20 performs a screen synchronization process (step S1-6). Specifically, the screen transfer unit 213 of the control unit 21 transfers the content (screen data) displayed in the synchronization area 251 to the tablet terminal 10 via the wireless communication unit 27. This screen synchronization process is continued until the synchronization stop button 253 is selected.

  The control unit 11 of the tablet terminal 10 that has received the screen data via the wireless communication unit 17 executes screen display processing (step S1-7). Specifically, the display control unit 111 of the control unit 11 sets the synchronization area 151 on the touch panel display 15 according to the size of the screen data. In the present embodiment, as described above, the synchronization area 151 is set to match the horizontal width or height of the touch panel display 15. Then, the display control unit 111 displays the screen data acquired from the tablet terminal 20 in the synchronization area 151 on the touch panel display 15.

  Furthermore, the control part 11 of the tablet terminal 10 performs a screen recording process (step S1-8). Specifically, the recording unit 113 of the control unit 11 generates a recording file that periodically captures the content displayed on the touch panel display 15 and records it in the data storage unit 12 in association with the display time.

  When the product description is interrupted or terminated, the control unit 21 of the tablet terminal 20 executes a synchronization stop process (step S1-9). Specifically, when the screen operation unit 210 of the control unit 21 detects selection of the synchronization stop button 253, it instructs the screen transfer unit 213 to stop screen transfer. When synchronizing again, by selecting the synchronization start button 252, the processing from step S 1-5 is repeated. Further, the screen transfer unit 213 transmits a recording stop instruction to the tablet terminal 10.

  The control unit 11 of the tablet terminal 10 that has received the recording stop instruction executes a recording stop process (step S1-10). Specifically, the recording unit 113 of the control unit 11 stops recording the recording file.

  Further, during the screen synchronization process (step S1-6), the salesperson points to a predetermined location of the explanation material file as necessary and explains. In this case, the control unit 21 of the tablet terminal 20 executes an instruction detection process on the screen (step S1-11). Specifically, the screen operation unit 210 of the control unit 21 detects a touch on the synchronization area 251. In this case, the screen operation means 210 displays a pointer at this position a1. Then, the screen operation unit 210 notifies the pointer transfer unit 214 of the touch position (coordinates) on the synchronization area 251.

  In this case, the control unit 21 of the tablet terminal 20 executes a notification process of the designated position (step S1-12). Specifically, the pointer transfer unit 214 of the control unit 21 specifies relative coordinates on the synchronization area 251 for the touch position. The pointer transfer unit 214 transmits a pointer display instruction to the tablet terminal 10 via the wireless communication unit 27. This pointer display instruction includes the specified position information (relative coordinates).

  The control unit 11 of the tablet terminal 10 that has received the pointer display instruction via the wireless communication unit 17 executes pointer display processing (step S1-13). Specifically, the display control means 111 of the control unit 11 displays the parent device pointer b1 at the coordinates corresponding to the position information acquired from the tablet terminal 20 in the synchronization area 151 (positions facing the synchronization area 251). . The parent device pointer b1 displayed in this way is also recorded in the recording file in the screen recording process (step S1-8).

  Further, the customer may point to a predetermined part of the explanation material file as necessary. In this case, the control unit 11 of the tablet terminal 10 executes an instruction detection process on the screen (step S1-14). Specifically, the screen operation unit 110 of the control unit 11 detects a touch on the synchronization area 151. In this case, the screen operation means 110 displays a pointer at this position b2. Then, the screen operation unit 110 notifies the pointer transfer unit 114 of the touch position (coordinates) on the synchronization area 151. The pointer displayed at the position b2 is also recorded in the recording file in the screen recording process (step S1-8).

  In this case, the control unit 11 of the tablet terminal 10 executes a notification process of the designated position (step S1-15). Specifically, the pointer transfer unit 114 of the control unit 11 specifies relative coordinates on the synchronization area 151 for the touch position. The pointer transfer unit 114 transmits a pointer display instruction to the tablet terminal 20 via the wireless communication unit 17. This pointer display instruction includes the specified position information (relative coordinates).

  The control unit 21 of the tablet terminal 20 that has received the pointer display instruction via the wireless communication unit 27 executes a pointer display process (step S1-16). Specifically, the display control unit 211 of the control unit 21 outputs the child device pointer a2 to the coordinates corresponding to the position information acquired from the tablet terminal 10 in the synchronization area 251 (the position opposite to the synchronization area 151). To do.

(Keyword handling process)
Next, the keyword correspondence processing will be described with reference to FIG. This keyword handling process is executed when the sales representative is explaining the product using the tablet terminal 20.

  Here, the control unit 21 of the tablet terminal 20 executes a description obligation list specifying process (step S2-1). Specifically, the explanation obligation confirmation unit 218 of the control unit 21 specifies the product code of the explanation material file displayed on the touch panel display 25. Next, the explanation obligation confirmation unit 218 extracts the explanation obligation list associated with the product code from the data storage unit 22 and records it in the confirmation target data area. Then, the explanation obligation confirmation unit 218 records the explanation start time in association with the explanation obligation list recorded in the confirmation target data area.

  Next, the control part 21 of the tablet terminal 20 performs a description obligation list display process (step S2-2). Specifically, the explanation obligation confirmation means 218 of the control unit 21 outputs the explanation obligation list to the explanation obligation list display area 254 on the touch panel display 25 as shown in FIG. At this stage, all items in the accountability list are displayed in an unapplied state.

  Next, the control part 21 of the tablet terminal 20 performs an audio | voice acquisition process (step S2-3). Specifically, the keyword extraction unit 216 of the control unit 21 acquires the sound collected by the microphone 26.

  Next, the control part 21 of the tablet terminal 20 performs a keyword extraction process (step S2-4). Specifically, the keyword extraction means 216 of the control unit 21 performs a speech recognition process on the acquired speech and converts it into text. Then, the keyword extracting unit 216 records this text as a voice recognition result in the voice recognition result file of the data storage unit 22 in association with the sound collection time. Next, the keyword extraction unit 216 identifies words included in the text by morphological analysis in the speech-recognized text. Then, the keyword extracting means 216 compares the explanation obligation list of the explanation target product (the explanation obligation list recorded in the confirmation target data area) and the keyword recorded in the NG word list with the voice recognized word.

  Next, the control part 21 of the tablet terminal 20 performs the determination process about whether it is an explanation duty item (step S2-5). Specifically, the keyword extraction means 216 of the control unit 21 determines that the keyword is recognized as a description obligation item when the keyword recognized as a voice is recorded as a keyword in the explanation obligation list.

  If it is determined that the item is an explanation obligation item (in the case of “YES” in step S2-5), the control unit 21 of the tablet terminal 20 executes the explanation obligation list clearing process (step S2-6). Specifically, the explanation obligation confirmation unit 218 of the control unit 21 records the confirmation time when the keyword is detected in the explanation obligation list recorded in the confirmation target data area of the data storage unit 22. Further, the explanation obligation confirmation unit 218 performs an extinction display of an item corresponding to the identified keyword in the explanation obligation list displayed in the explanation obligation list display area 254 of the touch panel display 25. Then, the process returns to step S2-3.

  On the other hand, when it is determined that the item is not an explanation obligation item (in the case of “NO” in step S2-5), the control unit 21 of the tablet terminal 20 executes a determination process as to whether or not it is an NG word (step S2-7). Specifically, the keyword extraction unit 216 of the control unit 21 determines that the keyword is recognized as a NG word when the keyword recognized as a voice is recorded as a keyword in the NG word list.

Here, when it determines with it not being an NG word (in the case of "NO" in step S2-7), the control part 21 of the tablet terminal 20 repeats the process after step S2-3.
On the other hand, if it is determined as an NG word (“YES” in step S2-7), the control unit 21 of the tablet terminal 20 executes an NG word handling process (step S2-8). Here, for the detected NG word, the NG word corresponding process shown in FIG. 6 is executed, and the processes after step S2-3 are repeated.

And the control part 21 of the tablet terminal 20 performs the condition confirmation process of a description duty item regularly.
Here, the control part 21 of the tablet terminal 20 performs the acquisition process of the extinction status of a description obligation list (step S2-9). Specifically, the explanation obligation confirmation unit 218 of the control unit 21 acquires the recording status of the confirmation time in the explanation obligation list recorded in the confirmation target data area.

  Next, the control part 21 of the tablet terminal 20 performs the determination process about whether the unapplied item remains (step S2-10). Specifically, the explanation obligation confirmation unit 218 of the control unit 21 determines that there is an unapplied item when there is an item for which the confirmation time is not recorded.

When there is no unapplied item remaining (in the case of “NO” in step S2-10), the control unit 21 of the tablet terminal 20 ends the explanation confirmation item status confirmation process.
On the other hand, when an unapplied item remains (in the case of “YES” in step S2-10), the control unit 21 of the tablet terminal 20 executes a determination process as to whether or not the time is exceeded (step S2-11). ). Specifically, the explanation duty confirmation unit 218 of the control unit 21 acquires the current time from the system timer, and calculates the elapsed time from the explanation start time to the current time. Then, the elapsed time is compared with the explanation duty notification determination reference time to determine whether or not the reference time is exceeded.

If the description obligation notification determination reference time has not been exceeded (in the case of “NO” in step S2-11), the process of acquiring the explanation obligation list consumption state is continued.
On the other hand, when it is determined that the explanation obligation notification determination reference time has been exceeded (in the case of “YES” in step S2-11), the control unit 21 of the tablet terminal 20 executes an alerting process (step S2-12). ). Specifically, the explanation duty confirmation unit 218 of the control unit 21 outputs a message indicating that there is an explanation duty item that is not explained in the explanation duty list to the touch panel display 25. Further, the explanation obligation confirmation unit 218 instructs the backyard contact unit 219 to contact the backyard terminal 30. In this case, the backyard contact means 219 transmits an explanation status notification to the backyard terminal 30. This explanation status notification includes data relating to unapplied items. The administrator confirms the explanation status at the backyard terminal 30. Then, the administrator uses the backyard terminal 30 to transmit a message to the tablet terminal 20 as necessary.

(NG word processing)
Next, the NG word handling process will be described with reference to FIG. This NG word handling process is executed when an NG word is detected.

  Here, the control unit 21 of the tablet terminal 20 executes a warning output process (step S3-1). Specifically, the NG word confirmation unit 217 of the control unit 21 records the detected NG word and the detection time in the confirmation target data area of the data storage unit 22. Next, the NG word confirmation unit 217 outputs a warning screen to the touch panel display 25. This warning screen includes an NG word detected by voice recognition. Furthermore, the NG word correspondence button is included in this alerting screen. This NG word corresponding button is selected when the NG word is corrected to an accurate explanation or when an NG word is erroneously detected.

  Next, the control part 21 of the tablet terminal 20 performs the determination process about whether it is correspondence (step S3-2). Specifically, the NG word confirmation unit 217 of the control unit 21 confirms whether or not there remains an NG word in which the corresponding time is not recorded in the NG word recorded in the confirmation target data area.

  When the corresponding time is not recorded and there is an NG word that has not been input and has been input (in the case of “NO” in step S3-2), the control unit 21 of the tablet terminal 20 determines whether or not the time is exceeded. A determination process is executed (step S3-3). Specifically, the NG word confirmation unit 217 of the control unit 21 acquires the current time from the system timer, and calculates the elapsed time from the detection time of the NG word to the current time. Then, the elapsed time is compared with the NG word notification determination reference time to determine whether or not the reference time is exceeded.

If it is determined that the NG word notification determination reference time has not been exceeded (“NO” in step S3-3), the process of step S3-2 is continued.
On the other hand, when the NG word corresponding button is selected on the alert screen and it is determined that the correspondence has been completed (in the case of “YES” in step S3-2), the control unit 21 of the tablet terminal 20 executes the alert deletion process. (Step S3-4). Specifically, the NG word confirmation unit 217 of the control unit 21 records the corresponding time in association with the NG word recorded in the confirmation target data area of the data storage unit 22.

  After executing the alert deletion process or when the NG word notification determination reference time is exceeded (in the case of “YES” in step S3-3), the control unit 21 of the tablet terminal 20 performs the backyard notification process. Execute (Step S3-5). Specifically, the NG word confirmation unit 217 of the control unit 21 specifies the detection time of the NG word, and the speech recognition in the sound collection time range (sound collection time) for a predetermined time before and after the detection time in the recognition result file. Extract the results. Here, for the NG word in which the corresponding time is recorded, the speech recognition result from the predetermined time before the detection time to the corresponding time is extracted. Then, the NG word confirmation unit 217 instructs the backyard contact unit 219 to contact the backyard terminal 30. In this case, the backyard contact means 219 transmits an NG word notification to the backyard terminal 30. This NG word notification includes the correspondence status (detection time and correspondence time) for the NG word recorded in the confirmation target data area, and the voice recognition result extracted by the NG word confirmation means 217.

  Next, the backyard terminal 30 performs a confirmation process (step S3-6). Specifically, the backyard terminal 30 that has received the NG word notification outputs the NG word notification to the display. In this case, the administrator using the backyard terminal 30 confirms the NG word notification acquired from the tablet terminal 20. Furthermore, the administrator browses the voice recognition result acquired from the tablet terminal 20 and confirms the NG word detection status and the subsequent response.

  Next, the backyard terminal 30 executes message transmission processing as necessary (step S3-7). Specifically, the administrator checks the detection status and response status of the NG word, and inputs a message if it is determined that support is necessary. In this case, the backyard terminal 30 transmits an administrator message to the tablet terminal 20.

  Next, the control part 21 of the tablet terminal 20 performs a message display process (step S3-8). Specifically, the display control unit 211 of the control unit 21 outputs a message acquired from the backyard terminal 30 to a backyard message area 256 provided outside the synchronization area 251 of the touch panel display 25.

(Backyard support processing)
Next, the backyard support process will be described with reference to FIG. This backyard support process is executed when the backyard supports the sales staff.

  First, the control unit 21 of the tablet terminal 20 executes a backyard support request input process (step S4-1). Specifically, the backyard contact means 219 of the control unit 21 displays a backyard support request button 255 on the touch panel display 25. When the screen operation unit 210 detects selection of the backyard support request button 255, the backyard support unit 219 is notified of the detection of the backyard support request.

  Next, the control part 21 of the tablet terminal 20 performs the extraction process of description status information (step S4-2). Specifically, the backyard contact means 219 of the control unit 21 extracts the speech recognition result in the time range from the time going back a predetermined time to the current time from the speech recognition result file recorded in the data storage unit 22. .

  Next, the control part 21 of the tablet terminal 20 performs the transmission process of a backyard assistance request (step S4-3). Specifically, the backyard contact means 219 of the control unit 21 transmits a backyard support request to the backyard terminal 30. This backyard support request includes the speech recognition result extracted from the speech recognition result file in the data storage unit 22.

  Next, the backyard terminal 30 performs a confirmation process (step S4-4). Specifically, the backyard terminal 30 that has received the backyard support request outputs the backyard support request to the display. In this case, the administrator who uses the backyard terminal 30 browses the voice recognition result acquired from the tablet terminal 20 and confirms the explanation status.

  Next, the backyard terminal 30 executes a message creation process (step S4-5). Specifically, the backyard terminal 30 displays a message input screen and prompts text input. Further, the backyard terminal 30 may acquire the administrator's voice through a microphone and recognize the voice to create a text.

  Next, the backyard terminal 30 executes message transmission processing (step S4-6). Specifically, the backyard terminal 30 transmits a support message (support information) to the tablet terminal 20. This support message includes text created by voice recognition. Furthermore, a file used for product description may be transmitted together with a message.

  Next, the control part 21 of the tablet terminal 20 performs a message output process (step S4-7). Specifically, the display control unit 211 of the control unit 21 outputs a message acquired from the backyard terminal 30 to a backyard message area 256 provided outside the synchronization area 251 of the touch panel display 25. In addition, when a file used for product description is received from the backyard terminal 30, the icon of this file is displayed in an area other than the synchronization area 251. Then, the sales representative confirms this message and file and continues the product description.

As described above, according to the present embodiment, the following effects can be obtained.
(1) In the embodiment described above, the control unit 21 of the tablet terminal 20 executes a synchronization area setting process (step S1-4). And the control part 21 of the tablet terminal 20 performs a synchronization start process (step S1-5) and a screen synchronization process (step S1-6). The control unit 11 of the tablet terminal 10 that has received the screen data via the wireless communication unit 17 executes screen display processing (step S1-7). This screen synchronization process is continued until the synchronization stop process (step S1-9). Thereby, only the required part can be displayed on the touch panel display 25 of the tablet terminal 10 which is a subunit | mobile_unit in the content displayed on the touch panel display 25 of the tablet terminal 20 which is a main | base station.

  (2) In the above embodiment, the control unit 11 of the tablet terminal 10 executes screen recording processing (step S1-8). Thereby, since the recording file is recorded, it is possible to grasp the explanation state of the product made to the customer.

  (3) In the said embodiment, the control part 21 of the tablet terminal 20 performs the instruction | indication detection process (step S1-11) on a screen, and the notification process (step S1-12) of an instruction | indication position. The control unit 11 of the tablet terminal 10 that has received the pointer display instruction via the wireless communication unit 17 executes pointer display processing (step S1-13). Thereby, the customer can grasp | ascertain on the touch panel display 15 of the tablet terminal 10 the position which the sales staff pointed in the synchronous area 251. FIG.

  (4) In the said embodiment, the control part 11 of the tablet terminal 10 performs the instruction | indication detection process (step S1-14) on a screen, and the notification process (step S1-15) of an instruction | indication position. The control unit 21 of the tablet terminal 20 that has received the pointer display instruction via the wireless communication unit 27 executes a pointer display process (step S1-16). Thereby, the sales representative can grasp the position indicated by the customer in the synchronization area 151 on the touch panel display 25 of the tablet terminal 20.

  (5) In the said embodiment, the control part 21 of the tablet terminal 20 performs a recording process (step S1-2). And the control part 11 of the tablet terminal 10 which received the recording start instruction | indication via the wireless communication part 17 performs a recording process (step S1-3). Thereby, a sales representative and a customer's remark can be recorded in the tablet terminal (10, 20) at hand. Then, by confirming this recording file, it is possible to grasp the explanation status of the product.

  (6) In the above embodiment, the control unit 21 of the tablet terminal 20 executes the explanation obligation list specifying process (step S2-1) and the explanation obligation list display process (step S2-2). And the control part 21 of the tablet terminal 20 performs an audio | voice acquisition process (step S2-3) and a keyword extraction process (step S2-4). When it is determined that the item is an explanation obligation item using a keyword (in the case of “YES” in step S2-5), the control unit 21 of the tablet terminal 20 executes an explanation obligation list clearing process (step S2-6). Thereby, the salesperson using the tablet terminal 20 can grasp the contents to be explained in the product description. Then, the product description can be performed in consideration of the explanation obligation items.

  (7) In the above-described embodiment, the control unit 21 of the tablet terminal 20 executes the acquisition process of the extinction status of the explanation obligation list (step S2-9). If it is determined that the unapplied item remains and the time exceeds the explanation obligation notification determination reference time (in the case of “YES” in steps S2-10 and S2-11), the tablet terminal 20 The control unit 21 executes an alerting process (step S2-12). Thereby, when the explanation about the item for which explanation is required is delayed, the sales representative can be alerted.

  (8) In the above embodiment, in the NG word handling process, the control unit 21 of the tablet terminal 20 executes a warning output process (step S3-1). Thereby, when the NG word is included, the sales representative can be alerted.

  Furthermore, the control part 21 of the tablet terminal 20 performs the determination process about whether it has corresponded (step S3-2). When the NG word corresponding button is selected on the alert screen and it is determined that the correspondence has been completed (“YES” in step S3-2), the control unit 21 of the tablet terminal 20 deletes the alert (step S3-4). ), Backyard notification processing (step S3-5) is executed. As a result, the backyard terminal 30 can confirm the response status to the NG word.

  (9) In the above embodiment, in the backyard support process, the control unit 21 of the tablet terminal 20 performs the backyard support request input process (step S4-1), the explanation status information extraction process (step S4-2), The backyard support request transmission process (step S4-3) is executed. Thereby, when a sales representative desires support, a support request can be made to the backyard terminal 30. In the backyard terminal 30, by confirming the voice recognition result, it is possible to grasp the explanation situation and provide support.

  (10) In the above embodiment, the backyard terminal 30 executes the message creation process (step S4-5) and the message transmission process (step S4-6), and the tablet terminal 20 performs the message output process (step S4-7). Run. Thereby, support information can be provided efficiently using the backyard terminal 30. Further, since the message from the backyard terminal 30 is displayed in an area other than the synchronization area 251, the message can be confirmed without being known to the customer.

In addition, you may change the said embodiment into the following aspects.
In the above embodiment, the present invention is applied in the product description, but the application range is not limited to the product description, and can be applied to the description using two displays. Further, the first and second terminals are not limited to tablet terminals, and for example, a notebook personal computer can be used.

  In the above embodiment, an NG word list is recorded in the data storage unit 22. Here, the NG word list may be changed for each explanation material file. In this case, an NG word list is recorded in the data storage unit 22 in association with the product code. Then, the control unit 21 specifies the NG word list using the product code of the explanation material file displayed on the touch panel display 25. The NG word list is recorded in the confirmation target data area, and the control unit 21 executes a determination process as to whether or not it is an NG word (step S2-7). Thereby, the NG word according to the description content can be detected.

  In the above embodiment, the control unit 21 of the tablet terminal 20 executes screen synchronization processing (step S1-6). Specifically, the screen transfer unit 213 of the control unit 21 transfers the content (screen data) displayed in the synchronization area 251 to the tablet terminal 10 via the wireless communication unit 27. Instead, an explanation material file is also stored in the data storage unit 12 of the tablet terminal 10 and a screen synchronized with the synchronization area 251 of the tablet terminal 20 is output using the explanation material file. Good. In this case, the control unit 21 receives the synchronization data including the file identifier of the explanatory material file displayed in the synchronization area 251, the display page, and the data related to the coordinates where the synchronization area 251 is set on this page. Send to. The control unit 11 of the tablet terminal 10 that has received the synchronization data stores the content specified by the display page and coordinates in the synchronization document 151 on the touch panel display 15 in the explanation file of the file identifier recorded in the data storage unit 12. indicate.

  In the NG word handling process of the above embodiment, when it is determined that the item is not an explanation obligation item (in the case of “NO” in step S2-5), the control unit 21 of the tablet terminal 20 performs a determination process as to whether it is an NG word. Execute (Step S2-7). Here, it is also possible to determine a NG word by combining a plurality of keywords. Specifically, in the NG word list, a plurality of keywords are combined and recorded as NG words. For example, the keyword “absolutely” is combined with the keywords “profit” and “revenue”. When the control unit 21 detects one word included in the combination of keywords recorded in the NG word list, the control unit 21 determines whether another word included in the combination can be detected in a utterance within a predetermined time. Then, when a combination of keywords recorded in the NG word list is detected in a statement within a predetermined time, an NG word handling process is executed (step S2-8). Thereby, it is possible to detect an utterance including an expression that should not be used by a combination of keywords.

  Further, in the determination process as to whether or not the word is an NG word, the context of keywords may be taken into consideration. In this case, the context is recorded in the NG word list together with the combination of keywords. When keywords are detected in the order of the context recorded in the NG word list, NG word handling processing is executed (step S2-8). Thereby, it is possible to detect an utterance including an expression that should not be used, based on the context of the keyword.

  Furthermore, in the determination process as to whether or not the word is an NG word, the sentence structure in the content of the statement may be considered. In this case, a sentence structure is specified by a sentence break detected in speech recognition. Then, when the combination of keywords recorded in the NG word list is included in the sentence structure (for example, one sentence), an NG word handling process is executed (step S2-8). As a result, it is possible to detect an utterance including an expression that should not be used, based on the keyword sentence structure.

  It is also possible to use a combination of these determinations as to whether the word is an NG word. In this case, in the NG word list, information specifying a determination method (one word, combination, context, sentence structure, etc.) is recorded in association with the keyword.

  In the NG word handling process of the above embodiment, when it is determined that the item is not an explanation obligation item (in the case of “NO” in step S2-5), the control unit 21 of the tablet terminal 20 performs a determination process as to whether it is an NG word. Execute (Step S2-7). Here, the handling process may be changed by weighting the NG word. Specifically, a weighting value is recorded for the NG word in the NG word list. Then, when an NG word having a small weight value is detected, the control unit 21 outputs a warning to the touch panel display 25 as the first corresponding process. On the other hand, when the weighting value is large, the control unit 21 outputs a warning and notifies the backyard terminal 30 as the first handling process. Thereby, it is possible to respond to the occasion according to the importance of the NG word.

  In the above embodiment, the data storage unit 22 records the explanation obligation list associated with the product code. Instead of this, an explanation obligation item may be displayed corresponding to the page of the explanation material. In this case, in the explanation obligation list, keywords for explanation obligation items are set for the pages of the explanation material file associated with the product code. Then, the control unit 21 of the tablet terminal 20 outputs an explanation obligation item to the page of the explanation material file displayed in the synchronization area 251 on the touch panel display 25. Thus, items to be explained can be confirmed according to the contents of each page of the explanation material file.

  -In the NG word corresponding | compatible process of the said embodiment, the control part 21 of the tablet terminal 20 performs a backyard notification process (step S3-5). Here, a voice recognition result in a predetermined time range before and after the detection time is transmitted to the backyard terminal 30. Further, in the backyard support process, the control unit 21 of the tablet terminal 20 executes an extraction process of the explanation status information (Step S4-2). Here, a speech recognition result in a time range from a time going back a predetermined time to the current time is extracted. Here, instead of transmitting the voice recognition result, voice data may be transmitted. In this case, audio data in a predetermined time range is extracted from the recording file recorded in the data storage unit 22 and transmitted to the backyard terminal 30. As a result, the backyard terminal 30 can grasp the explanation status from the voice data.

  In the above embodiment, the control unit 21 of the tablet terminal 20 executes a synchronization area setting process (step S1-4). Specifically, on the touch panel display 25, by touching the position that is the start point and the end point of the synchronization area, a rectangular area having both points on the diagonal line is set as the synchronization area 251. In addition to this synchronization area, an area that is not synchronized may be provided. In this case, an asynchronous area is designated within the synchronous area on the touch panel display 25. In this case, similarly to the synchronous area 251, a rectangular area having both points on the diagonal line is specified as an asynchronous area by touching the position that is the start point and end point of the area. Further, the painted area may be specified as an asynchronous area by using a marker function or a brush function in the drawing tool. Then, after specifying the asynchronous area, the synchronization start process is executed (step S1-5). Thereby, by setting an asynchronous area in the synchronization area 251, information that is hidden in the synchronization area 151 of the tablet terminal 10 and is not desired to be shown to the other party can be partially hidden. In the synchronous area 251 of the tablet terminal 20, the contents of the asynchronous area may be displayed or may not be displayed.

  In the above embodiment, after executing the alert deletion process or when the NG word notification determination reference time is exceeded (in the case of “YES” in step S3-3), the control unit 21 of the tablet terminal 20 The backyard notification process is executed (step S3-5). The content notified to the backyard is not limited to these. Notification may also be made when an NG word is detected. Further, notification may be made only when the NG word notification determination reference time is exceeded.

  DESCRIPTION OF SYMBOLS 10,20 ... Tablet terminal, 11, 21 ... Control part, 12, 22 ... Data storage part, 15, 25 ... Touch panel display, 16, 26 ... Microphone, 17, 27 ... Wireless communication part, 151,251 ... Synchronization area, DESCRIPTION OF SYMBOLS 110 ... Screen operation means, 111 ... Display control means, 113 ... Recording means, 114 ... Pointer transfer means, 115 ... Recording means, 210 ... Screen operation means, 211 ... Display control means, 212 ... Synchronization area setting means, 213 ... Screen Transfer means, 214 ... pointer transfer means, 215 ... recording means, 216 ... keyword extraction means, 217 ... NG word confirmation means, 218 ... accountability confirmation means, 219 ... backyard contact means, 30 ... backyard terminal.

Claims (8)

A data storage means for storing an explanation material file and a check list in which keywords are recorded in association with the explanation material file;
A display for displaying the explanation material file;
A recognition result storage means for recording a voice recognition result;
An explanation support system comprising a computer terminal comprising control means connected to a backyard terminal,
The control means is
Means for identifying a checklist based on the explanatory material file displayed on the display;
Means for recording the voice recognition result obtained by converting the collected voice into text by voice recognition in the recognition result storage means;
When a keyword included in the checklist is detected in the voice recognition result, a message including the detected keyword is displayed on the display, and voice recognition of the sound collection time of the keyword is performed from the recognition result storage unit. An explanation support system comprising means for extracting a result and transmitting an explanation status to the backyard terminal. The keyword is an NG word that is avoided during explanation,
The explanation support system according to claim 1, wherein the control unit outputs a warning message corresponding to the NG word to the display. The control means is
In response to a warning message displayed on the display, when a corresponding input to the detected NG word is performed, the voice recognition result until the corresponding input time is further transmitted to a backyard terminal. The explanation support system according to claim 2 characterized by things. The NG word is composed of a combination of a plurality of keywords,
4. The explanation support system according to claim 2, wherein the control means outputs a warning message corresponding to the NG word to the display.   The said control means is further provided with the means to output assistance information to the said display, when the assistance information according to the said description condition is received from the said backyard terminal. The explanation support system according to any one of the above. The keyword is a keyword for an item that needs to be explained,
The control means further comprises means for displaying the checklist on the display;
6. The explanation support system according to claim 1, wherein an item related to a keyword included in a check list displayed on the display is erased based on the voice recognition result. A data storage means for storing an explanation material file and a check list in which keywords are recorded in association with the explanation material file;
A display for displaying the explanation material file;
A recognition result storage means for recording a voice recognition result;
A method for providing explanation support using an explanation support system comprising a computer terminal comprising control means connected to a backyard terminal,
The control means is
Identifying a checklist based on the explanatory material file displayed on the display;
Recording the voice recognition result obtained by converting the collected voice into text by voice recognition in the recognition result storage means;
When a keyword included in the checklist is detected in the voice recognition result, a message including the detected keyword is displayed on the display, and voice recognition of the sound collection time of the keyword is performed from the recognition result storage unit. An explanation support method comprising: extracting a result and transmitting an explanation situation to the backyard terminal. A data storage means for storing an explanation material file and a check list in which keywords are recorded in association with the explanation material file;
A display for displaying the explanation material file;
A recognition result storage means for recording a voice recognition result;
A program for providing explanation support using an explanation support system comprising a computer terminal comprising control means connected to a backyard terminal,
The control means;
Means for identifying a checklist based on the explanatory material file displayed on the display;
Means for recording the voice recognition result obtained by converting the collected voice into text by voice recognition in the recognition result storage means;
When a keyword included in the checklist is detected in the voice recognition result, a message including the detected keyword is displayed on the display, and voice recognition of the sound collection time of the keyword is performed from the recognition result storage unit. An explanation support program that extracts a result and functions as means for transmitting an explanation status to the backyard terminal.

Images