JP2014085988A - Data terminal having related-data acquisition support function - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique improving usability and convenience of a reminder function.SOLUTION: For each memo data stating matters to be checked and the like, an information terminal 1 stores reminder management information including an address of an action partner automatically acquired from a server that manages terminals in the vicinity and attendants of a conference, action execution notification timing, execution/non-execution of the action, responce check notification timing, and receipt/non-receipt of the response. When there exists reminder management information in which the execution/non-execution of the action is "unexecuted" and the action execution notification timing has come, the information terminal displays a reminder notification prompting to execute the action on the basis of the reminder management information. When there exists reminder management information in which the execution/non-execution of the action and the reception/non-reception of the response are "executed" and "unexecuted" respectively and the responce check notification timing has come, the information terminal displays a reminder notification prompting to check the response on the basis of the reminder management information.

Description

  The present invention relates to an information management apparatus having a reminder function.

  During a meeting, a memo may be taken so as not to forget that the other party requested the material or requested the other party. However, you may forget that you took the note itself and may not remember it when you need it. Therefore, the memo contents such as what to do and what to check are registered together with the notification timing (reminder registration), and when the notification timing arrives, the contents of the memo associated with this notification timing There has been proposed an information management apparatus having a reminder function for notifying the user.

  For example, Patent Document 1 discloses an information recall search system that realizes a reminder function that recalls what has come to mind or something that must not be forgotten. This information recall system searches for information that the user has come up with or should not forget, the content of the information, the title, the situation when it came up (partner, location, action, date and time), the situation to remember (partner, (Location, action, date) are stored in the information storage database. Then, information including a situation that should be remembered that matches the desired date and time, priority, or timing according to the schedule is detected from the information storage database and notified to the user, or the situation when it comes to mind and the situation that should be remembered The information storage database is searched using at least a part as a search condition, and the search result is notified to the user.

JP 2006-163943 A

  However, when trying to register information about the requesting material and the information of the person requesting the material with the conventional reminder function, if the meeting participant is not known in advance, If participants change, there may be a leak in the registration of the person requesting the material.

  In addition, even if the user can execute an action by reminding what to do or confirm using the reminder function, the user forgets that the action has been executed, It may be unknown whether there was a response. In an information management apparatus having a conventional reminder function including the information recall system described in Patent Document 1, in order to avoid such a situation, a reminder registration for the response of this action is performed separately from the reminder registration for the action. It is necessary to do this, and the work is complicated and time-consuming.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a technique capable of improving the usability and convenience of the reminder function.

  In order to solve the above problems, the present invention acquires the address of the information management device from other information management devices existing in the vicinity, for each memo data that describes what to do, what to check, etc. Reminder management information including memo data, action type of action to be executed, notification timing prompting action execution, presence / absence of action execution, action partner address, notification timing prompting response confirmation, presence / absence of response reception, and management ID Are stored, and the notification timing for prompting the execution of the action of each reminder management information and the notification timing for prompting the response confirmation are monitored. If there is reminder management information indicating whether or not the action has been executed is “not executed” and the notification timing for urging action execution has arrived, the reminder management information is notified to the operator. Also, if there is reminder management information that indicates whether the action has been executed and whether the response has been received is "executed" or "not received", and there is a reminder management information that prompts you to confirm the response, operate this reminder management information The person in charge.

For example, the present invention is an information management apparatus having a reminder function, which is displayed on data corresponding to a predetermined part of voice data input from a voice input unit provided in the own data terminal or on a display unit provided in the own data terminal. A query item designating unit that designates data corresponding to a predetermined part of the displayed data as a query item, a query item is designated by the query item designating unit, and a specific operation for designating a query destination address has been performed. A query item storage means for storing the designated query item in association with a query destination address, a query time, and a reply time limit, and a query time or a reply time limit relating to the query item stored in the query item storage means Alerting means to alert at a predetermined timing that the
Address information of other data terminals present in the vicinity or addresses for accessing those attending the meeting from the conference server storing information related to attendees of the meeting Address acquisition means for acquiring information, and when the inquiry item is specified by the inquiry item specification means, the own data terminal activates the address acquisition means, and the address information acquired by the address acquisition means Is automatically stored in the inquiry item storage means as the inquiry destination address.

  According to the present invention, it is possible to check not only whether or not an action is performed on the same memo data but also whether or not a response is received for this action at a desired timing. This improves the usability and convenience of the reminder function.

FIG. 1 is a sequence diagram for explaining an operation example of the information terminal 1 according to the embodiment of the present invention. FIG. 2 is a sequence diagram for explaining an operation example of the information terminal 1 according to the embodiment of the present invention, and is a continuation of FIG. FIG. 3 is a diagram showing a display example of call content data and document data in the action side information terminal 1. FIG. 4 is a diagram showing a display example of an input form of reminder management information in the action side information terminal 1. FIG. 5 is a diagram showing a display example of a reminder notification that prompts the action execution on the action side information terminal 1. FIG. 6 is a diagram illustrating a display example of a reminder notification for prompting response confirmation in the action side information terminal 1. FIG. 7 is a diagram illustrating a display example of a reminder notification that prompts the user to execute an action on the response side information terminal 1. FIG. 8 is a schematic functional configuration diagram of the information terminal 1. FIG. 9 is a diagram schematically illustrating an example of registered contents in the reminder management information storage unit 105. FIG. 10 is a diagram for explaining a processing flow relating to reminder management information registration in the information terminal 1. FIG. 11 is a diagram for explaining the processing flow regarding the reminder management information registration in the information terminal 1, and is a continuation of FIG. FIG. 12 is a diagram for explaining a processing flow regarding the reminder notification in the information terminal 1. FIG. 13 is a diagram for explaining the processing flow regarding the reminder notification in the information terminal 1, and is a continuation of FIG.

  An embodiment of the present invention will be described below.

  1 and 2 are sequence diagrams for explaining an operation example of the information terminal 1 according to the present embodiment.

  It is assumed that a call is started between the two information terminals 1 by the telephone function provided in each information terminal 1 (S100). Here, the information terminal 1 on the side that executes an action such as an inquiry or a request for material after the call is finished is called an action side information terminal 1, and the information terminal 1 on the side that executes a response such as answering or sending a material to this action. Is called the response side information terminal 1.

  When the action-side information terminal 1 receives a call display instruction from the operator (S101), the action-side information terminal 1 performs voice recognition processing on the call voice data received from the response-side information terminal 1 to express text data (hereinafter, referred to as call data). Call content data) is generated, and the call content data is displayed on the display screen (S102). Further, when the action side information terminal 1 receives an instruction to display desired document data stored in the action side information terminal 1 such as material data of a product being explained by a call from an operator (S103), Desired document data is displayed on the display screen (S104).

  FIG. 3 is a diagram showing a display example of call content data and document data in the action side information terminal 1. In this example, two display windows 201 and 202 are provided on the display screen 200 of the action side information terminal 1, and the call content data of the other party is displayed on one display window 201, and the other display window is displayed. In 202, document data designated by the operator is displayed. Here, the operator uses a mouse, a touch panel or the like to select any text related to what he / she wants to confirm after the call is finished or to inquire from the call content data and document data being displayed on the display windows 201 and 202. It is possible to select a column.

  Next, the action-side information terminal 1 is related to the fact that the operator confirmed after the call ended from the call content data and document data displayed in the display windows 201 and 202 of the display screen 200, and that he wanted to make an inquiry. When an arbitrary text string is selected (S105), the selected text string is specified as memo data (S106).

  The display window 202 displays partner image data in conversation captured by the camera included in the own information terminal 1 or received from the partner information terminal 1 in communication, and is to be confirmed using a mouse, a touch panel, etc. You may make it select the display part relevant to what you want to inquire, etc., and specify the text string which converted image data into character data as memo data.

  After specifying the memo data, the action side information terminal 1 transmits a mail address request (S107).

  The mail address request uses, for example, Probe Request defined by IEEE 802.11.

  As the transmission destination of the mail address request, the ID of the information terminal 1 included in the presence notification packet transmitted by the response information terminal at a predetermined timing, for example, every 30 seconds is specified.

  The presence notification packet includes, for example, an ID of the information terminal 1 that transmits the presence notification packet by using a Probe Request defined by IEEE 802.11.

  For example, a MAC address is used as the ID of the information terminal 1.

  Note that the action side information terminal 1 also transmits the presence notification packet at a predetermined timing.

  When the response-side information terminal 1 receives the mail address request (S200), the response-side information terminal 1 transmits its own e-mail address held in the information terminal 1 in advance to the partner who transmitted the mail address request (S201).

  For e-mail address transmission, for example, Probe Response defined by IEEE 802.11 is used.

  When the action side information terminal 1 receives the mail address (S108), the action side information terminal 1 holds it as the mail address of the neighboring terminal (S109).

  In the present embodiment, the present application described on the assumption that the information terminal 1 on the action side and the information terminal 1 on the response side communicate on a one-to-one basis is not limited to this. There may be a plurality of information terminals 1 on the response side. Further, the action-side information terminal 1 can hold a plurality of mail addresses of neighboring terminals.

  After that, it is assumed that the call between the action side information terminal 1 and the response side information terminal 1 has ended (S110).

  When the action side information terminal 1 receives an input form display instruction from the operator (S111), the action side information terminal 1 displays the input form of the reminder management information on the display screen (S112), and accepts the reminder management information from the operator (S113). .

  FIG. 4 is a diagram showing a display example of an input form of reminder management information in the action side information terminal 1. In this example, the input form 210 is displayed over the display windows 201 and 202 on the display screen 200 of the action side information terminal 1. The input form 210 includes a management ID display field 211, a memo data input field 212, an action type selection field 213 of an action to be executed, an action partner e-mail address input field 214, and an action execution notification timing. It has an input field 215, an input field 216 for response confirmation notification timing of a response to this action, and a comment input field 217.

  In the memo data input field 212, a text string selected by the operator from the call content data and document data displayed in the display windows 201 and 202 is displayed. Can be edited arbitrarily. In the action type selection column 213, an action type list can be displayed in a pull-down manner, and the operator can select a desired action type from the action type list. Action types include, for example, document request, inquiry, request, and contact. Further, in the input column 214 of the action partner's email address, the email address of the nearby terminal (here, the response side information terminal 1) held in step 109 is displayed. The mail address can be arbitrarily edited by the operator. Also, the date and time for displaying the reminder notification that prompts the action execution is input in the action execution notification timing input field 215, and the reminder notification that prompts the user to confirm the response to the action is displayed in the response confirmation notification timing input field 216. The date and time are entered. The comment input field 217 is used for inputting a supplementary comment of memo data.

  In the comment input field 217, in addition to inputting and displaying text data, voice data from a microphone provided in the own information terminal 1 may be input and reproduced.

  In the input field 214 for the email address of the action partner, when the memo data is specified (S106), the conference information acquired from the conference server storing the information related to the attendees of the conference by the own information terminal An e-mail address may be displayed for access to those attending.

  Next, when the action side information terminal 1 receives the memo data, the action type, the email address of the action partner, the action execution notification timing, the response confirmation notification timing, etc. from the operator via the input form 210, Reminder management information including these information and the management ID displayed in the display field 211 of the input form 210, whether or not the action is executed “not executed”, and whether or not the response is received “not received” is stored (S114). . Then, the arrival of the action execution notification timing and response confirmation notification timing included in the reminder management information is monitored.

  When the action-side information terminal 1 detects that the action execution notification timing included in the reminder management information has arrived (S115), the action execution information included in the reminder management information is “not executed”. Is confirmed, and a reminder notification prompting action execution including at least the management ID, the memo data, the action type, and the email address of the action partner included in the reminder management information is started (S116). ).

  FIG. 5 is a diagram illustrating a display example of a reminder notification that prompts an action execution in the action side information terminal 1. In this example, a reminder notification display window 220 that prompts execution of an action is displayed on the display screen 200 of the action side information terminal 1. The reminder notification display window 220 includes a management ID display field 221 included in the reminder management information to be notified of a reminder, a display field 222 indicating that the reminder notification is for prompting action execution, Memo data, action type, action partner e-mail address and comment display fields 223 to 226 included in the reminder management information, and a check field 227 indicating whether or not an action is included in the reminder management information Have. When the operator checks the check column 227, the action side information terminal 1 updates the presence / absence of the action execution included in the reminder management information from “not executed” to “executed”.

  When the action-side information terminal 1 detects that the action execution notification timing has arrived, the reminder notification display window 220 that prompts the user to execute the action until the presence / absence of action execution included in the reminder management information becomes “executed”. Is displayed regularly (for example, every hour).

  Next, when the action-side information terminal 1 accepts an e-mail creation instruction from the operator in a state where the reminder notification display window 220 for urging action execution is displayed on the display screen 200 (S117), the action-side information terminal 1 receives the reminder notification target. The email address of the action partner (response side information terminal 1) included in the reminder management information is the transmission destination address, the action type included in the reminder management information is the subject (email title), and An action mail is created in which the management ID, memo data, response confirmation notification timing, and comment included in the reminder management information are described in a predetermined format in the mail body. Then, if necessary, after receiving an editing operation for this action mail, a file attachment operation, etc. from the operator, this action mail is transmitted to the response side information terminal 1 which is the action partner (S118).

  Thereafter, the action-side information terminal 1 updates the presence / absence of action execution included in the reminder management information to be notified of reminders from “not executed” to “executed” (S119), and a reminder notification for prompting action execution The display is terminated (S120).

  On the other hand, when the response side information terminal 1 receives the action mail from the action side information terminal 1 (S202), the response to the subject (action type) of the action mail is set as the action type of the action to be executed. The sender address is the email address of the action partner, the response confirmation notification timing described in the email body of this action email is the action execution notification timing, and this information and the email body of this action email are described. Reminder management information including a management ID, memo data, and a comment, and whether or not an action is executed is “not executed” is generated and stored (S203). Then, the arrival of the action execution notification timing included in the reminder management information is monitored.

  When the action-side information terminal 1 detects that the reminder confirmation notification timing included in the reminder management information has arrived (S121), the action execution included in the reminder management information and the presence / absence of the reminder have been received. Confirm that each is “executed” and “not received”, and at least include the management ID, memo data, action type, and email address of the action partner included in this reminder management information The display of the reminder notification for prompting is started (S122).

  FIG. 6 is a diagram illustrating a display example of a reminder notification for prompting response confirmation in the action side information terminal 1. In this example, a reminder notification display window 230 for prompting response confirmation is displayed on the display screen 200 of the action side information terminal 1. The reminder notification display window 230 includes a management ID display field 231 included in the reminder management information to be notified of a reminder, a display field 232 indicating that the reminder notification prompts response confirmation, and the reminder management. Memo data, action type, action partner e-mail address and comment display fields 233 to 236 included in the information, and a check field 237 indicating whether or not a response is received included in the reminder management information, Have. When the operator puts a check in the check field 237, the action side information terminal 1 updates the presence / absence of reception of the response included in the reminder management information from “not received” to “received”.

  When the action side information terminal 1 detects that the response confirmation notification timing has arrived, this response receipt confirmation reminder notification display window is displayed until the presence / absence of the response reception included in the reminder management information becomes “received”. 230 is displayed regularly (for example, every hour).

  On the other hand, when the response-side information terminal 1 detects that the action execution notification timing included in the reminder management information has arrived (S204), the presence or absence of the action execution included in the reminder management information is “not executed”. Is confirmed, and a reminder notification prompting action execution including at least the management ID, the memo data, the action type, and the email address of the action partner included in the reminder management information is started (S205). ).

  FIG. 7 is a diagram illustrating a display example of a reminder notification that prompts the user to execute an action on the response side information terminal 1. In this example, a reminder notification display window 240 that prompts the user to execute an action is displayed on the display screen 200 of the response side information terminal 1. The reminder notification display window 240 includes a management ID display field 241 included in the reminder management information targeted for reminder notification, a display field 242 indicating that the reminder notification prompts action execution, and this reminder management. Memo data, action type, action partner e-mail address and comment display fields 243 to 246 included in the information, and a check field 247 indicating whether or not the action is included included in the reminder management information, Have. Here, a response to the action type described in the action mail received from the action side information terminal 1 is displayed as the action type 244. When the operator checks the check field 247, the response side information terminal 1 updates the presence / absence of action execution included in the reminder management information from “not executed” to “executed”.

  When the response-side information terminal 1 detects that the action execution notification timing has arrived, a reminder notification display window that prompts the user to execute the action until the presence / absence of the action execution included in the reminder management information becomes “executed” 240 is displayed periodically (for example, every hour).

  Next, when the response-side information terminal 1 receives an e-mail creation instruction from the operator in a state where the reminder notification display window 240 that prompts the action execution is displayed on the display screen 200 (S206), the response-side information terminal 1 receives the reminder notification target. The email address of the action partner (action side information terminal 1) included in the reminder management information is the transmission destination address, the action type included in this reminder management information is the subject (email title), and A response mail is created in which the management ID, memo data, and comments included in the reminder management information are described in the mail body. Then, if necessary, after receiving an editing operation for this response mail, a file attachment operation, etc. from the operator, this response mail is transmitted to the action side information terminal 1 which is the action partner (S207).

  Thereafter, the response-side information terminal 1 updates the presence / absence of the action execution included in the reminder management information to be notified of the reminder from “not executed” to “executed” (S208), and a reminder notification for prompting the action execution The display is terminated (S209).

  When the action side information terminal 1 receives the response mail from the response side information terminal 1 (S123), the action side information terminal 1 searches for the reminder management information using the management ID described in the mail body of the response mail as a key. Then, the presence / absence of the response included in the reminder management information is updated from “not received” to “received” (S124), and the display of the reminder notification for prompting the response confirmation based on the reminder management information is ended. (S125).

  FIG. 8 is a schematic functional configuration diagram of the information terminal 1.

  As illustrated, the information terminal 1 includes a communication interface unit 101, a man-machine interface unit 102, a telephone processing unit 103, an e-mail processing unit 104, a reminder management information storage unit 105, and a reminder management information update unit 106. A notification timing monitoring unit 107, a voice recognition unit 108, a document data storage unit 109, a main control unit 110, and a nearby terminal detection unit 111.

  The communication interface unit 101 is an interface for communicating with other information terminals 1 via a wireless communication network.

  The man-machine interface unit 102 includes a telephone handset, a display screen 200 such as an LCD for displaying various information to the user, and an operation panel such as a keyboard and a touch sensor for receiving various operations from the user.

  The telephone processing unit 103 performs outgoing / incoming control according to a predetermined call control protocol such as SIP (Session Initiation Protocol), and performs communication during a call according to a predetermined transmission protocol such as RTP (Real Time Transport Protocol). A telephone function is realized in cooperation with the interface unit 101 and the man-machine interface unit 102.

  The e-mail processing unit 104 performs e-mail reception control according to a mail reception protocol such as POP3 (Post Office Protocol), and performs e-mail transmission control according to a mail transmission protocol such as SMTP (Simple Mail Transfer Protocol). The e-mail function is realized in cooperation with the communication interface unit 101 and the man-machine interface unit 102.

  The reminder management information storage unit 105 stores reminder management information.

  FIG. 9 is a diagram schematically illustrating an example of registered contents in the reminder management information storage unit 105.

  As shown in the figure, the reminder management information storage unit 105 stores a record 1050 for each reminder management information. A record 1050 includes a field 1051 for registering a management ID for identifying the reminder management information, a field 1052 for registering memo data describing what the operator should do and confirm, an inquiry, and a document request Alternatively, a field 1053 for registering an action type of an action to be executed such as a response to these, a field 1054 for registering an action execution notification timing, a field 1055 for registering whether or not an action is executed, and an email address of an action partner It has a field 1056 for registering, a field 1057 for registering response confirmation notification timing, a field 1058 for registering whether or not a response has been received, and a field 1059 for registering a supplementary comment for memo data. . Here, the management ID is composed of, for example, the terminal ID and serial number of the information terminal 1, and is determined to be unique for each reminder management information between the action side information terminal 1 and the response side information terminal 1.

  The reminder management information update unit 106 updates the registration content of the reminder management information storage unit 105 in accordance with an instruction from the main control unit 110.

  The notification timing monitoring unit 107 detects the arrival of the action execution notification timing registered in the field 1054 and the response confirmation notification timing registered in the field 1057 for each record 1050 stored in the reminder management information storage unit 105. Monitor. Then, when the record 1050 at which the action execution notification timing has arrived is detected, if the presence / absence of action execution registered in the field 1055 of this record 1050 is “not executed”, the main control unit 110 is The arrival of the action execution notification timing is notified together with this record 1050. When a record 1050 for which a response confirmation notification timing has arrived is detected, the presence / absence of action execution and the presence / absence of response reception registered in the fields 1055 and 1058 of the record 1050 are “executed” and “not received”, respectively. If so, the main control unit 110 is notified of the arrival of the response confirmation notification timing together with the record 1050.

  The voice recognition unit 108 acquires call voice data of the other party from the telephone processing unit 103 in accordance with an instruction from the main control unit 110. Then, the obtained call voice data is subjected to voice recognition processing, converted into call content data composed of text data, and the call content data is passed to the main control unit 110.

  The document data storage unit 109 stores document data such as material data and catalog data received in advance from the other party.

  The main control unit 110 comprehensively controls the units 101 to 109 and 111 of the information terminal 1.

  Further, when the main control unit 110 receives a notification that the action execution notification timing has arrived from the notification timing monitoring unit 107 together with the record 1050, the main control unit 110 executes the action based on the reminder management information registered in the record 1050. When a reminder notification for prompting is displayed on the man-machine interface unit 102 and a notification that the response confirmation notification timing has arrived is received from the notification timing monitoring unit 107 together with the record 1050, the reminder management information registered in the record 1050 is used. The reminder notification for prompting the response confirmation is displayed on the man-machine interface unit 102.

  In addition, the main control unit 110 follows an operator instruction received via the man-machine interface unit 102, or an action mail or response mail transmitted / received by the e-mail processing unit 104, or an address received by the nearby terminal detection unit 111. Then, the reminder management information update unit 106 is made to update the registered content of the reminder management information storage unit 105.

  Further, the main control unit 110 causes the voice recognition unit 108 to execute voice recognition processing in accordance with an operator instruction received via the man-machine interface unit 102, and converts the call voice data of the other party into call content data. The call content data is displayed on the man-machine interface unit 102, or desired document data stored in the document data storage unit 109 is displayed on the man-machine interface unit 102.

  The neighboring terminal detection unit 111 holds the address of the own information terminal 1 in advance. The address of the own information terminal 1 receives an input from the man-machine interface unit 102 and stores it in the neighboring terminal detection unit 111 via the main control unit 110. The nearby terminal detection unit 111 transmits and receives a presence notification via the communication interface unit 101. The nearby terminal detection unit 111 transmits and receives an address via the communication interface unit 101, and holds the address as the address of the nearby terminal. The nearby terminal detection unit 111 uses the main control unit 110 and the reminder management information update unit 106 to set the registered content in the field 1056 for registering the email address of the action partner in the reminder management information storage unit 105 to the address of the nearby terminal. Update.

  FIG. 10 and FIG. 11 are diagrams for explaining a processing flow related to reminder management information registration in the information terminal 1.

  When the presence notification timing has arrived (YES in S300), the neighboring terminal detection unit 111 of the information terminal 1 transmits a presence notification packet (S301).

  When the proximity terminal detection unit 111 of the information terminal 1 detects the presence notification packet transmitted by another information terminal 1 via the communication interface unit 101 (YES in S302), the information terminal 1 included in the received presence notification packet Is stored (S303).

  When the information terminal 1 receives a memo data specifying operation from the operator (YES in S304), the information terminal 1 transmits a mail address request to the other party who has transmitted the presence notification packet (S305).

  When the neighboring terminal detection unit 111 of the information terminal 1 receives a mail address from another information terminal 1 existing in the vicinity via the communication interface unit 101 (YES in S306), the neighboring terminal detection unit 111 holds the mail address of the neighboring terminal (S307). ).

  When the neighboring terminal detection unit 111 of the information terminal 1 receives a mail address request from another information terminal 1 via the communication interface unit 101 (YES in S308), the neighboring terminal detection unit 111 transmits the mail address request to the partner who transmitted the mail address request. The e-mail address is transmitted (S309).

  When the main control unit 110 receives a call display instruction from the operator via the man-machine interface unit 102 during a call (both YES in S310 and S311), the main control unit 110 instructs the voice recognition unit 108 to perform voice recognition processing. In response to this, the voice recognition unit 108 acquires the call voice data of the other party from the telephone processing unit 103, performs voice recognition processing on the call voice data, and uses the call voice data as the contents of the call made up of text data. Convert to data. Then, this call content data is passed to the main control unit 110. The main control unit 110 displays the call content data received from the voice recognition unit 108 on the man-machine interface unit 102, for example, like the display window 201 shown in FIG. 3 (S312).

  Further, when the main control unit 110 receives a document display instruction accompanied by specification of document data from the operator via the man-machine interface unit 102 (YES in S313), the main control unit 110 receives the document data specified from the document data storage unit 109. The document data is read out and displayed on the man-machine interface unit 102, for example, like the display window 202 shown in FIG. 3 (S314).

  When main controller 110 receives at least one of the call content data and document data on man-machine interface unit 102 and receives selection of a text string from the operator on these display data (in S315). (YES), the selected text data is specified as memo data indicating that the operator wants to confirm or inquire (S316). Then, if the call content data is being displayed on the man-machine interface unit 102 (YES in S317), the main control unit 110 acquires the address information of the neighboring terminal held by the neighboring terminal detection unit 111, and the action The acquired address information is specified as the other party's e-mail address (S318).

  When the main control unit 110 receives an input form display instruction from the operator via the man-machine interface unit 102 (YES in S319), the main control unit 110 generates a management ID and configures reminder management information from the operator. An input form 210 (see FIG. 4) for receiving memo data, action type, action partner e-mail address, action execution notification timing, response confirmation notification timing, comments, etc. is displayed (S320). The main control unit 110 displays the generated management ID in the display field 211 of the input form 210, and if the memo data has been specified (YES in S321), the specified memo data is defaulted in the input field 212 of the input form 210. Is displayed (S322). At this time, if the e-mail address of the action partner has already been specified, this e-mail address is also displayed in the input field 214 of the input form 210 by default.

  Next, the main control unit 110 receives memo data, action type, action partner e-mail address, action execution notification timing, response confirmation notification timing, and comment from the operator via the input form 210 ( These pieces of information are transferred to the reminder management information update unit 106 together with the management ID. In response to this, the reminder management information update unit 106 adds a new record 1050 to the reminder management information storage unit 105, and receives the fields 1051 to 1054, 1056, 1057, and 1059 of this record 1050 from the main control unit 110. Management ID, memo data, action type, action execution notification timing, action partner address, response confirmation notification timing, and comment are registered. Further, the presence / absence of action execution and the presence / absence of response reception in the fields 1055 and 1058 are set to “not executed” and “not received”, respectively (S324).

  Further, when the e-mail processing unit 104 receives an action mail from another information terminal 1 via the communication interface unit 101 (YES in S325), the e-mail processing unit 104 notifies the main control unit 110 of the received action mail. In response, the main control unit 110 receives the management ID, memo data, response confirmation notification timing, and comment described in the mail text of the action mail, the management ID of the reminder management information newly generated, and the memo data. , Action execution notification timing, and comment. In addition, the response to the action type described in the subject of this action mail is set to the action type of the newly generated reminder management information, and the sender address of this action mail is set to the newly generated reminder management information. Set to the email address of the action partner.

  Here, the determination that the received e-mail is an action mail is made by confirming that the subject of the e-mail is not a response to some action, or the management ID included in the e-mail body of the e-mail is other This can be done by confirming that it is issued by the information terminal 1. Note that a flag indicating that the e-mail is an action mail may be included in the e-mail.

  Then, the main control unit 110 passes the management ID, memo data, action type, action execution notification timing, email address of the action partner, and comment of the newly generated reminder management information to the reminder management information update unit 106. In response to this, the reminder management information update unit 106 adds a new record 1050 to the reminder management information storage unit 105, and the management information received from the main control unit 110 in the fields 1051 to 1054, 1056, and 1059 of this record 1050. ID, memo data, action type, action execution notification timing, e-mail address of the action partner, and comment are registered. In addition, the presence / absence of action execution in the field 1055 is set to “not executed” (S326). Note that the response confirmation notification timing in the fields 1057 and 1058 and the presence / absence of response reception are null data.

  In addition, when receiving a response mail from another information terminal 1 via the communication interface unit 101 (YES in S327), the e-mail processing unit 104 notifies the main control unit 110 of the received response mail. In response to this, the main control unit 110 searches the record 1050 in which the management ID described in the mail text of the response mail is registered in the field 1051 via the reminder management information update unit 106. Then, the presence / absence of response reception registered in the field 1058 of the retrieved record 1050 is updated to “received” (S328).

  Here, whether the received e-mail is a response mail is determined by confirming that the subject of the e-mail is a response to some action or the management ID included in the e-mail body of the e-mail is This can be done by confirming that it is issued by the information terminal 1. Note that a flag indicating that this e-mail is a response mail may be included in the e-mail.

  FIG. 12 and FIG. 13 are diagrams for explaining the processing flow regarding the reminder notification in the information terminal 1.

  The notification timing monitoring unit 107 periodically checks the fields 1054 and 1057 of all records 150 in the reminder management information storage unit 105.

  First, when the notification timing monitoring unit 107 detects from the reminder management information storage unit 105 the record 1050 that has registered the action execution notification timing registered in the field 1054 (YES in S400), the notification timing monitoring unit 107 registers it in the field 1055 of the record 1050. It is checked whether or not the executed action is “not executed” (S401). When the presence or absence of action execution is “not executed” (YES in S401), a predetermined time (for example, 1 hour) has elapsed since the main control unit 110 was notified of the arrival of the action execution notification timing together with the record 1050 last time. If it has elapsed or this time is the first notification of the arrival of the action execution notification timing (YES in S402), the main control unit 110 is notified of the arrival of the action execution notification timing together with this record 1050.

  In response to this, the main control unit 110 displays a reminder notification for encouraging action execution on the man-machine interface unit 102 based on the record 1050 (S403). For example, reminder notification display windows 220 and 240 that prompt the user to execute an action as shown in FIGS. 5 and 7 are displayed.

  Thereafter, if the main control unit 110 receives an e-mail creation instruction from the operator via the man-machine interface unit 102 (YES in S404), the action type registered in the field 1053 of the record 1050 is set. It is checked whether the response is for some action (S405). If the action type is not a response to any action (NO in S405), the main control unit 110 passes this record 1050 to the e-mail processing unit 104 to instruct creation of an action mail. In response to this, the e-mail processing unit 104 sets the action partner's e-mail address registered in the field 1056 of the record 1050 received from the main control unit 110 as the transmission destination address, and the action type registered in the field 1053. And an action mail in which the management ID, memo data, response confirmation notification timing, and comment registered in the fields 1051, 1052, 1057, and 1059 are described in the mail body in a predetermined format are created. Then, if necessary, after receiving an editing operation for this action mail, a file attachment operation, etc. from the operator via the man-machine interface unit 102, this action mail is transmitted from the communication interface unit 101 (S406). .

  On the other hand, if the action type is a response to some action (YES in S405), the main control unit 110 passes this record 1050 to the e-mail processing unit 104 and instructs the creation of a response mail. In response to this, the e-mail processing unit 104 sets the action partner's e-mail address registered in the field 1056 of the record 1050 received from the main control unit 110 as the transmission destination address, and the action type registered in the field 1053. And a response mail in which the management ID, memo data, and comments registered in the fields 1051, 1052, and 1059 are described in the mail body in a predetermined format. Then, if necessary, after receiving an editing operation for the response mail, a file attachment operation, etc. from the operator via the man-machine interface unit 102, the response mail is transmitted from the communication interface unit 101 (S407). .

  In S405, it is determined that an action mail is created when the action type registered in the field 1053 of the record 1050 is not a response to any action, and a response mail is created when it is a response. An action mail is created when the management ID registered in the field 1051 of 1050 is the management ID issued by the own information terminal 1, and a response mail is created when the management ID is issued by another information terminal 1. You may decide to do.

  Then, the main control unit 110 determines whether or not to execute the action registered in the field 1055 of this record 1050 stored in the reminder management information storage unit 105 via the reminder management information update unit 106 from “not executed” to “ Update to “executed” (S410). Thereafter, the display of the reminder notification prompting the action execution based on the record 1050 is stopped (S411).

  Further, when the main control unit 110 receives an instruction to stop the display of a reminder notification that prompts the user to execute an action via the man-machine interface unit 102 (YES in S408), the main control unit 110 receives the operator via the man-machine interface unit 102 If an update instruction indicating whether or not an action has been executed (checks for the check fields 227 and 247 provided in the reminder notification display windows 220 and 240 shown in FIGS. 5 and 7) has not been received (NO in S409), this record 1050 Is stopped (S411), and if received (YES in S409), the reminder management information storage unit 105 stores the reminder notification via the reminder management information update unit 106. Registered in the field 1055 of this record 1050 The presence or absence of action run from the "non-execution" is updated to "Executed" (S410), and then, based on this record 1050, to stop the display of the reminder notification to prompt the action execution (S411).

  Further, when the notification timing monitoring unit 107 detects from the reminder management information storage unit 105 the record 1050 that has arrived at the response confirmation notification timing registered in the field 1057 (YES in S412), the notification timing monitoring unit 107 registers it in the field 1055 of this record 1050. It is checked whether or not the execution of the action being executed is “executed” (S413), and whether or not the response received registered in the field 1058 is “not received” (S414). . Then, when the presence / absence of action execution is “executed” (YES in S413) and the presence / absence of response reception is “not received” (YES in S414), the arrival of the response confirmation notification timing in the previous record 1050 At the same time, if a predetermined time (for example, 1 hour) has passed since the notification to the main control unit 110, or if this is the first notification that the response confirmation notification timing has arrived (YES in S415), the main control unit 110 is Thus, the arrival of the response confirmation notification timing is notified together with this record 1050.

  In response to this, the main control unit 110 displays a reminder notification for prompting a response confirmation based on the record 1050 on the man-machine interface unit 102 (S416). For example, a reminder notification display window 230 for prompting response confirmation as shown in FIG. 6 is displayed.

  Thereafter, when the main control unit 110 receives an instruction to stop the display of the reminder notification that prompts the response confirmation from the operator via the man-machine interface unit 102 (YES in S417), the main control unit 110 receives an instruction from the operator via the man-machine interface unit 102. If an update instruction indicating whether or not a response has been received (check on the check field 237 provided in the reminder notification display window 230 shown in FIG. 6) has not been received (NO in S418), a reminder for prompting response confirmation based on this record 1050 If the notification is stopped (S420) and received (YES in S418), it is registered in the field 1058 of this record 1050 stored in the reminder management information storage unit 105 via the reminder management information update unit 106. Response received Free update from the "not received" to "receive completed" (S419), then, to stop the display of the reminder notification to prompt a response confirmation based on this record 1050 (S420).

  The embodiment of the present invention has been described above.

  In the present embodiment, the information terminal 1 performs memo data, an action type of an action to be executed by the operator, an action execution notification timing for each memo data in which what the operator should do and what to check is described. , The presence / absence of action execution, the email address of the action partner, the response confirmation notification timing, the presence / absence of response reception, and the reminder management information including the management ID, and the action execution notification timing and response confirmation notification timing of each reminder management information Monitor the arrival of. If the action execution status is “not executed” and there is reminder management information for which the action execution notification timing has arrived, a reminder notification for urging action execution is displayed based on the reminder management information. In addition, if there is reminder management information that indicates whether the action has been executed and whether the response has been received is “executed” or “not received”, and the response confirmation notification timing has arrived, the response is based on this reminder management information. Display reminder reminder to confirm.

  For this reason, according to the present embodiment, it is possible to make the operator confirm at a desired timing not only whether or not an action is performed on the same memo data but also whether or not a response is received for this action. Therefore, the usability and convenience of the reminder function are improved.

  Further, in the present embodiment, the information terminal 1 follows the operator's e-mail creation instruction, and the memo data, action type, and response confirmation notification included in the reminder management information corresponding to the reminder notification that prompts execution of the action being displayed. An action mail in which at least the timing and management ID are described is generated, transmitted to the email address of the action partner included in the reminder management information, and the reminder management information stored in the reminder management information storage unit 105 Update the presence / absence of the action execution included in “Executed”.

  Therefore, according to the present embodiment, the reminder management information is obtained by causing the operator to take action (send action mail for confirmation, document request, inquiry, etc.) in response to the reminder notification for encouraging action execution. As a result, it is possible to automatically update the presence or absence of the action execution included in the, so that the usability and convenience of the reminder function is further improved.

  In this embodiment, when the information terminal 1 receives a response mail in which at least the memo data, the action type, and the management ID are described, the information terminal 1 includes the management ID described in the response mail and manages the reminder. Whether the response of the reminder management information stored in the information storage unit 105 is received or not is updated to “received”.

  Therefore, according to the present embodiment, by receiving the response mail, it is possible to automatically update the presence / absence of the response confirmation included in the reminder management information corresponding to the response mail. The nature is further improved.

  In the present embodiment, the information terminal 1 displays the document data display window 202 designated by the operator. If a text string is selected from the document data being displayed on the display window 202 by the operator, the text form is used as memo data, and the memo provided in the input form 210 for receiving the reminder management information from the operator. Displayed in the data input field 212 by default.

  For this reason, according to the present embodiment, a point of interest on the document data is entered as memo data in the memo data input field 212 provided in the input form 210 or copied. Since the labor can be omitted, the usability and convenience of the reminder function is further improved.

  Further, in the present embodiment, the information terminal 1 has a telephone function, performs voice recognition processing on call voice data received from the call partner, converts the call voice data into call content data consisting of text data, and The display window 201 is displayed. Then, if a text string is selected from the call content data being displayed on the display window 201 by the operator, this text string is used as memo data in the input form 210 for accepting reminder management information from the operator. Displayed in the memo data input field 212 by default.

  For this reason, according to the present embodiment, it is possible to eliminate the trouble of inputting text in the input field 212 for memo data provided in the input form 210 using points of interest in the call as memo data. Convenience and convenience are further improved.

  In the present embodiment, when the information terminal 1 receives the action mail, the information terminal 1 includes the management ID and memo data included in the action mail, and sets the response confirmation notification timing included in the action mail. The action execution notification timing is set, the response to the action type included in this action mail is set as the action type, and the reminder management information is automatically generated with the sender address of this action mail as the e-mail address of the action partner. And stored in the reminder management information storage unit 105.

  For this reason, according to the present embodiment, the reminder notification for the execution of the response of the received action mail can be automatically managed, so that the usability and convenience of the reminder function are further improved.

  Further, in the present embodiment, the information terminal 1 creates the operator's e-mail when the action type included in the reminder management information corresponding to the reminder notification that prompts the execution of the action being displayed is a response to some action. In accordance with the instruction, a response mail in which at least the memo data, action type, and management ID included in the reminder management information are described is generated and transmitted to the email address of the action partner included in the reminder management information. The presence / absence of action execution included in the reminder management information stored in the information storage unit 105 is updated to “executed”.

  For this reason, according to the present embodiment, the action is sent in response to the reminder notification that prompts the user to execute the action (the transmission of a response mail for sending materials, answers, etc.), so that it is included in the reminder management information. Therefore, the usability and convenience of the reminder function can be further improved.

  Further, in the present embodiment, the information terminal 1 transmits and receives presence notifications and addresses and uses them as addresses of neighboring terminals.

  For this reason, according to the present embodiment, the email address of the action partner can be obtained at the meeting place without obtaining the email address of the attendee in advance, so that the reminder function is easy to use. And convenience is further improved.

  In addition, this invention is not limited to said embodiment, Many deformation | transformation are possible within the range of the summary.

  For example, in the above embodiment, the information terminal 1 may have a telephone function corresponding to multi-party calls. In this case, the input field 214 of the input form 210 displays a list of e-mail addresses of the information terminals 1 other than the own information terminal 1 participating in the multi-party call, from which a desired e-mail address is selected. You may make it selectable. Alternatively, a mobile phone number may be registered in the reminder management information instead of the e-mail address, and an action mail or a response mail may be transmitted using a short message service.

  In the above embodiment, the functional configuration of the information terminal 1 shown in FIG. 8 may be realized by an integrated logic IC such as ASIC (Application Specific Integrated Circuit) or FPGA (Field Programmable Gate Array). Alternatively, it may be realized by software by a computer such as a DSP (Digital Signal Processor). Alternatively, in a general-purpose computer such as a PC (Personal Computer) equipped with an auxiliary storage device such as a CPU, memory, HDD, DVD-ROM, and a communication interface such as a NIC (Network Interface Card) and a modem, the CPU executes a predetermined program. It may be realized by loading from an auxiliary storage device onto a memory and executing it.

  In the above embodiment, the case where the present invention is applied to the information terminal 1 having a telephone function has been described as an example. However, the present invention can be widely applied to an information management apparatus having a reminder function. .

DESCRIPTION OF SYMBOLS 1: Information terminal 101: Communication interface part 102: Man-machine interface part 103: Telephone processing part 104: E-mail processing part 105: Reminder management information storage part 106: Reminder management information update part 107: Notification Timing monitoring unit 108: Voice recognition unit 109: Document data storage unit 110: Main control unit 111: Neighboring terminal detection unit

Claims (3)

A data terminal having a function of supporting acquisition of related data related to voice during a meeting or presentation material being displayed,
The data corresponding to the predetermined part of the voice data input from the voice input unit provided in the own data terminal or the data corresponding to the predetermined part of the display data displayed on the display unit provided in the own data terminal is designated as the inquiry item. Inquiry item specification means;
When a specific operation is performed, a query item is designated by the query item designating means and a query destination address is designated, and the designated query item is stored in association with the query destination address, query time, and answer deadline. Inquiry item storage means to perform,
Attention means for alerting at a predetermined timing that the inquiry time or answer deadline related to the inquiry item stored in the inquiry item storage means is approaching,
Address information of other data terminals present in the vicinity or addresses for accessing persons attending the meeting from the conference server storing information related to the attendees of the conference Address acquisition means for acquiring information,
When the inquiry item is specified by the inquiry item specifying means, the data terminal itself activates the address acquisition means, and the address information acquired by the address acquisition means is automatically stored in the inquiry item storage means as the inquiry destination address. A data terminal having a related data acquisition support function characterized in that it is stored in memory. The data terminal according to claim 1, wherein
Display data conversion means for converting display data displayed on the display unit into character data;
When the specific operation is performed,
The display data conversion means converts display data corresponding to a part designated by the specific operation into character data,
The data terminal having a related data acquisition support function, wherein the inquiry item storage means stores the character data converted by the display data conversion means in association with an inquiry destination designated by the specific operation. The data terminal according to claim 1 or 2,
It further has partner image capture means for capturing partner image data during conversation that is captured by a camera provided in the host data terminal or received from a partner terminal in communication,
The related data acquisition support characterized in that the image data captured by the counterpart image capture means is inserted into an inquiry item stored by the inquiry item storage means or stored in association with an inquiry destination designated by the specific operation A functional data terminal.

Images