JP2014010816A - Information processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To output necessary information associated with actions for a user through simple constitution.SOLUTION: An information processing device includes: a memory for associatively storing at least one kind of voiceprint data, at least one word data constituted on a plurality of characters, and information associated with next actions corresponding to the word data; speech acquisition means for acquiring speech of utterance; an extraction unit 103 for extracting a voiceprint from the acquired speech; an utterance character acquisition unit 104 which acquires character data on speech to be acquired; an information readout unit 105 which reads out, from the memory, information associated with a next action corresponding to word data matching the character data acquired by the utterance character acquisition unit 104 among word data related to voiceprint data matching the extracted voiceprint; and information output means for making an output unit output the information read out by the information readout unit 105.

Description

  The present invention relates to an information processing apparatus, and more particularly, to an information processing apparatus that reads information from a memory and presents the information identified from acquired speech.

  Conventionally, a user often uses a schedule function of a mobile phone in order to manage his / her schedule. According to this schedule function, a function of notifying information registered at a registered time by an alarm from a mobile phone is provided.

  For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2010-72677) discloses a left-behind item check function for carried items when the user goes out. That is, the terminal device has a schedule function for storing a plurality of schedule information, stores the identification information of the article in association with each schedule information, and acquires identification information by an IC tag attached to the article from a nearby article Then, the schedule information stored in the schedule function is specified, the acquired identification information is compared with the identification information stored in association with the specified schedule information, and processing according to the comparison result is performed.

JP 2010-72677 A

  Although the terminal device of patent document 1 performs the thing left behind check of a carried item when a user goes out and shows the result, it is not excellent in usability. That is, it is troublesome for the user to attach an IC tag to the belongings in advance. Further, even if a belonging corresponding to the identification information associated with the schedule information is carried, if the IC tag is forgotten to be attached to the belonging, it will be checked as a forgotten thing and the user will be confused.

  SUMMARY OF THE INVENTION Therefore, an object of the present invention is to provide an information processing apparatus that outputs necessary information regarding actions to a user with a simple configuration.

  An information processing apparatus according to an aspect of the present invention stores at least one type of voiceprint data, at least one word data composed of a plurality of characters, and information related to the next action corresponding to the word data in association with each other. Memory, voice acquisition means for acquiring voice of speech, extraction means for extracting voiceprint from the acquired voice, speech character acquisition means for acquiring character data of the acquired voice, and extraction means Information read out from the memory for information on the next action corresponding to the word data that matches the character data acquired by the spoken character acquisition means among the word data associated with the voice print data that matches the voice print extracted by And information output means for causing the output unit to output the information read by the information reading means.

  Preferably, the information processing apparatus further includes a time measuring unit for measuring a time when the sound is acquired. The memory further stores time data indicating the time at which the information should be output corresponding to the information on the next action. The information reading means is information on the next action corresponding to the word data that matches the character data acquired by the utterance character acquisition means among at least one word data associated with the voice print data indicating the extracted voice print. If the time measured by the time measuring means coincides with or falls within the time data corresponding to the information related to the next action, the information related to the action is read out.

  Preferably, the at least one word data includes first word data indicating a word uttered upon departure of the speaker, and information on a next action corresponding to the first word data in the memory is carried on departure. Item information indicating a portable item to be included is included. The information reading means includes article information reading means for reading the article information corresponding to the first word data indicating the word when the character data acquired by the spoken character acquiring means indicates a word uttered upon departure.

  Preferably, the information regarding the next action corresponding to the first word data in the memory is an article to be carried under the weather corresponding to each of a plurality of types of weather indicating at least one of weather and a probability of precipitation. Weather acquisition means for acquiring weather data relating to the weather when the voice is acquired by the voice acquisition means or the weather predicted thereafter is included. When the character data acquired by the spoken character acquisition unit indicates a word uttered at the time of departure, the item information reading unit stores the item information indicating the item to be carried under the weather corresponding to the first word data indicating the word. Among these, a means for reading out information corresponding to the type of weather indicated by the weather data acquired by the weather acquisition means is included.

  Preferably, the portable article includes a portable terminal, and the information processing apparatus obtains position information for acquiring position information indicating the position of the portable terminal and the acquired position information. Distance determining means for determining whether or not the distance is equal to or more than a predetermined distance, the article information reading means indicates the words that the character data acquired by the spoken character acquisition means indicates when starting, and the distance And a means for reading article information indicating a portable article including a portable terminal corresponding to the first word data indicating the word when it is determined that the distance is determined by the determination means.

  Preferably, the memory further stores data of a communication address of the communication terminal for each of at least one type of voiceprint data. The information processing apparatus further uses the data of the communication address stored in the memory for the voice print data corresponding to the information on the next action when the information on the next action is output to the output unit by the information output unit. And an information transmission means for transmitting information on the next action to the communication terminal.

  Preferably, the apparatus further includes a distance detecting means for detecting whether or not the speaker is away from the information processing apparatus. The information transmitting means responds to the information related to the next action when the information output means outputs information related to the next action to the output unit and then detects that the speaker is away by the distance detecting means. Means for transmitting information on the next action to the communication terminal using the data of the communication address stored in the memory for the voiceprint data to be transmitted.

  Preferably, the output unit includes a screen for displaying information, and the information processing apparatus further includes operation detection means for detecting a predetermined operation of the person. The information output means is means for changing the output mode of the information related to the next action when the predetermined action is detected by the action detection means when the information related to the next action is output to the output unit. including.

  Preferably, the memory further stores data of a communication address of the communication terminal for each of at least one type of voiceprint data. When information related to the next action is output to the output unit, if the predetermined action is not detected by the action detection unit, the information processing apparatus displays the information related to the next action on the voice print data indicating the extracted voice print. Is transmitted to the communication terminal using the data of the communication address of the memory.

  Preferably, the memory stores identification data for identifying each person corresponding to each of at least one type of voiceprint data. The information processing apparatus further includes, in the memory, when the predetermined action is not detected by the action detection unit when the information related to the next action is output to the output unit, the action related to the information related to the next action Writing means for writing information indicating that no action is detected, information on the next action associated with information indicating that no action is detected, and identification corresponding to voiceprint data associated with information on the next action Means for reading data from the memory and outputting the read information to an output unit.

  Preferably, the at least one word data includes second word data indicating a word uttered upon the speaker's return, and information on the next action corresponding to the second word data in the memory includes message information, The reading means includes means for reading information of a message corresponding to the second word data indicating the word when the character data acquired by the spoken character acquiring means indicates a word uttered at the time of return.

  An information processing method according to another aspect of the present invention is an information processing method for reading information from a memory, wherein the memory includes at least one type of voiceprint data, at least one word data composed of a plurality of characters, Information relating to the next action corresponding to the word data is stored in association with each other, and the step of extracting the voiceprint from the voice of the utterance, the step of acquiring the character data of the voice of the utterance, and the voiceprint extracted in the step of extracting Of the word data associated with the matching voiceprint data, the information on the next action corresponding to the word data that matches the character data acquired in the acquiring step is read in the memory and the reading step. And outputting the information to the output unit.

  According to still another aspect of the present invention, a program for causing a processor to execute an information processing method for reading information from a memory is provided.

  The memory stores at least one type of voiceprint data, at least one word data composed of a plurality of characters, and information on the next action corresponding to the word data in association with each other. The program causes the processor to extract a voiceprint from speech speech, to acquire character data of speech speech, and to extract word data associated with voiceprint data that matches the voiceprint extracted in the extraction step. Among them, the step of reading from the memory information about the next action corresponding to the word data that matches the character data acquired in the step of acquiring, the step of outputting the information read in the step of reading to the output unit, Is executed.

  According to the present invention, a person who speaks is determined by acquiring word data represented by voiceprint data and character data of speech voice from speech voice, and should be taken when the word registered in the memory is spoken. Output information about the person's next action. Therefore, it is possible to output necessary information regarding the behavior to the user with a simple configuration.

It is a figure showing the external appearance of the information processing apparatus which concerns on embodiment of this invention. It is a block diagram showing the hardware constitutions of the information processing apparatus which concerns on embodiment of this invention. It is the schematic which shows the function structure which the information processing apparatus which concerns on embodiment of this invention has. It is a figure which shows an example of the information of the possession list memory | storage part which concerns on embodiment of this invention. It is a figure which shows an example of the information of the message memory | storage part which concerns on embodiment of this invention. It is a figure which shows the example of an output of the information at the time of the departure which concerns on embodiment of this invention, and return. It is a processing flowchart for registration of information concerning an embodiment of the invention. It is a flowchart of the output process of the information which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. It should be noted that the same components are denoted by the same reference symbols in the respective drawings, and detailed description thereof will not be repeated.

  In the embodiment of the present invention, the information processing apparatus reads out and outputs information related to the behavior of the speaker corresponding to the utterance content acquired from the utterance at the time of departure or return of the user from the memory.

<Hardware configuration>
A configuration of information processing apparatus 100 according to the present embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a diagram illustrating an appearance of the information processing apparatus 100. FIG. 2 is a block diagram illustrating a hardware configuration of the information processing apparatus 100.

  The function of the information processing apparatus 100 may be provided, for example, as one of the functions of a server device in the home, or may be provided as a dedicated device.

  The information processing apparatus 100 includes a processor 10, a ROM (Read Only Memory) 15, a RAM (Random Access Memory) 16, an HDD (Hard Disk Drive) 17, a communication unit 18 that connects an antenna 19, and a memory driver 20. including. The processor 10 includes a CPU 11 and a timer 12 for measuring time.

  The communication unit 18 includes a telephone communication unit 181 for communication using a telephone line and a short-range communication unit 182 for short-range communication by radio. The information processing apparatus 100 can perform communication via an external network (not shown) such as transmission of an e-mail via the telephone call unit 181.

  The memory driver 20 is attached with various storage media such as a CD-ROM (Compact Disk Read Only Memory) 21 detachably from the outside, and accesses the stored storage media to store the data stored therein. In addition to reading, the data from the processor 10 is written to the storage medium.

  The processor 10 is connected to a graphic memory 13, a camera 4, a microphone 5, and a speaker 6 to which a display driver 14 related to the tablet 2 is connected. Although not shown, the processor 10 has an input interface for inputting a subject image captured and output by the camera 4 and a sound collected by the microphone 5. The input interface has a function of performing A / D (Analog / Digital) conversion on an input image and sound. In addition, it has an output interface for converting the sound into D / A (Digital / Analog) and outputting it to the speaker 6. The input interface corresponds to a sound acquisition unit for acquiring speech sound using the microphone 5. The function of the output interface and the function of writing display data to the graphic memory 13 correspond to an information output unit for causing the output unit (the microphone 5 and the display unit 202) to output information.

  The tablet 2 integrally includes a touch panel 201 and a display unit 202. The display unit 202 corresponds to an LCD (Liquid Crystal Display) panel or the like, and a touch panel 201 is placed on the display screen. Display data for the display unit 202 is written into the graphic memory 13 by the processor 10, and the display driver 14 drives the display unit 202 using the display data in the graphic memory 13 to display data for display in the display unit 202. Display an image that complies with. The image displayed on the display screen is a visible image that is visible through the touch panel 201. That is, the user can visually recognize the display image on the display unit 202 from the outside via the touch panel 201 made of a transparent member.

  The imaging direction of the camera 4 is directed to the direction in which the user who confirms the information displayed on the display unit 202 of the tablet 2 is located. The microphone 5 has a function capable of collecting sound at least around the information processing apparatus 100, more specifically, around the tablet 2. The sound from the speaker 6 is output around the information processing apparatus 100, more specifically around the tablet 2.

  Here, the camera 4, the microphone 5, and the speaker 6 are provided integrally with the tablet 2, but may be individually installed.

  The information processing apparatus 100 may be connected to the keyboard 3 by wire or wirelessly.

<Functional configuration>
In the present embodiment, it is assumed that the tablet 2 shown in FIG. 1 is placed at, for example, an entrance. The information processing apparatus 100 is used when the user identifies the user from the voice of the user's utterance when leaving the entrance or returning from the outside through the entrance, and a word indicating the content of the utterance is issued. The information regarding the next action of the user should be output.

  Specifically, an article that identifies a user from the voice of the user's utterance when leaving the entrance, and indicates a portable article corresponding to the user from the words (for example, “I will go”) indicated by the contents of the utterance Information is displayed by the tablet 2. Thereby, attention can be urged (reminded) so that there is no thing left behind when going out. In addition, the user is identified from the voice of the user's utterance when returning to the house from the outside through the entrance, and the message left to the user from the words (for example, “Tadaima”) indicated by the content of the utterance Is displayed by the tablet 2. This prompts confirmation of the message when returning.

  Here, as the information about the next action of the user to be taken when the word indicated by the utterance is issued, it is the information of the article to be carried when going out or the message to be confirmed when returning, but it is limited to this information. It is not something.

  FIG. 3 is a schematic diagram illustrating a functional configuration of the information processing apparatus 100 according to the embodiment of the present invention. FIG. 3 shows functions included in the processor 10 and peripheral portions related to these functions. The functions of the processor 10 in FIG. 3 are realized by a program or a combination of a program and a circuit. The program is stored in a storage area such as the ROM 15 in advance, and the function is realized by the CPU 11 described later reading and executing the program from the storage area.

  The peripheral portion includes the RAM 16 in which the belonging list storage unit 431 and the message storage unit 432 are stored. It is assumed that the belonging list storage unit 431 and the message storage unit 432 are rewritable and are stored in the nonvolatile storage area of the RAM 16.

  The processor 10 stores information for writing information to the input receiving unit 101, the belonging list storage unit 431, and the message storage unit 432 for receiving input to the information processing apparatus 100 by a user operation from the output of the touch panel 201. Section 102, belonging list storage section 431 and message storage section 432, information reading section 105 for reading information from these storage sections, and search for giving information necessary for searching the storage section to information reading section 105 Includes data acquisition unit.

  Furthermore, an information output unit 113 for causing the output unit (display unit 202 or speaker 6) to output the information read by the information reading unit 105, and for transmitting the information read by the information reading unit 105 to an external communication terminal. The information transmitting unit 115, the writing unit 116 for writing check data 62 to be described later to the belonging list storage unit 431, and the information associated with the check data 62 are read from the belonging list storage unit 431 and the output unit (display unit 202). Alternatively, an association information output unit 117, an operation detection unit 118, and a separation detection unit 119 for outputting by the speaker 6) are included.

  The information output unit 113 includes an output mode changing unit 114 for changing the output mode of displayed information. The motion detection unit 118 detects a predetermined motion of a person when information is output from the information output unit 113. The predetermined operation is, for example, touching the touch panel 201 or uttering a predetermined content (for example, “having” words). The touch operation is determined by an output from the touch panel 201 via the input receiving unit 101. Further, the utterance content is determined by the words indicated by the utterance content output from the utterance character acquisition unit 104.

  The separation detection unit 119 detects whether or not the user who is a speaker is moving away from the information processing apparatus 100, more specifically from the tablet 2.

  The information reading unit 105 includes an article information reading unit 106 for reading article information from the belonging list storage unit 431. The article information reading unit 106 reads the article information for each weather from the belonging list storage unit 431 and the message information reading unit 108 for reading information indicating the message from the message storage unit 432. Have

  The search data acquisition unit described above includes an extraction unit 103, an utterance character acquisition unit 104, a distance determination unit 109, a position acquisition unit 110, a weather acquisition unit 111, and a timer unit 112. Details of these parts will be described later.

  In this embodiment, “weather” indicates at least one of the type of weather (sunny, rainy, cloudy, etc.) and the probability of precipitation.

<Information of storage unit>
FIG. 4 is a diagram showing an example of information in the belonging list storage unit 431 according to the embodiment of the present invention, and FIG. 5 is a diagram showing an example of information in the message storage unit 432 according to the embodiment of the present invention. is there.

  Referring to FIG. 4, belonging list storage unit 431 associates at least one type of voiceprint data 50, at least one word data 51 composed of a plurality of characters, and information on the next action corresponding to word data 51. Remember.

  More specifically, for each of one or more persons, voiceprint data 50 indicating a voiceprint that is the voice feature of the person, one or more word data 51 representing words, identification data (name, nickname, etc.) of the person 52), belonging list 53, date data 54 and time data 55 indicating the time to output the belonging list, sub belonging list 60, check data 62, and communication address data 63 of the communication terminal owned by the person. Are stored in association with each other.

  The belongings list 53 indicates article information indicating portable articles that the person should carry when the corresponding person utters the words of the word data 51. The sub-item list 60 indicates article information indicating portable articles that the person should carry when the corresponding person utters the words of the word data 51. It includes a belonging list 61 by distance and a belonging list 70 by weather. The personal belongings list 61 by distance indicates information of one or more terminals (hereinafter referred to as portable terminals) that the person should carry when the corresponding person utters a word indicating the word data 51. The distance-based belonging list 61 is output when the mobile terminal and the information processing apparatus 100 are separated by a predetermined distance or more. The information of each mobile terminal in the personal belongings list 61 by distance includes the type of the mobile terminal (mobile (abbreviation of mobile phone), security buzzer terminal, tablet terminal, etc.) and the communication address of the mobile terminal.

  In the present embodiment, it is assumed that the user always carries the mobile terminal. Therefore, although the article indicated by the belonging list 53 does not include the portable terminal, it may be included.

  The personal belongings list 70 according to the weather includes rain data 71, warning data 72, snow data 73, and low temperature data 74.

  These data in the personal belongings list 70 according to the weather indicate information (such as umbrellas, raincoats, boots, etc.) of portable articles to be carried under the weather for each type of weather. That is, it is a list that stores information on portable articles (umbrellas, raincoats, boots, etc.) that should be carried based on the type of weather in association with each other. For example, if the type of weather is rain, an umbrella is associated and stored, but not only the type of weather, but if the precipitation probability is `` what percentage or more of rain '', an umbrella is supported It doesn't matter how you remember it.

  The check data 62 is a predetermined operation (a touch on the touch panel 201 or “having a touch” indicating that the user has confirmed the output information when the belonging list 53 or the sub-item list 60 is output to the output unit. The initial value is stored as “F” (not detected), but when a predetermined operation is detected The value of the check data 62 is rewritten from “F” to “T” by the writing unit 116.

  Referring to FIG. 5, message storage section 432 stores at least one type of voiceprint data 80, at least one word data 81 composed of a plurality of characters, and information related to the next action corresponding to word data 81. To do.

  More specifically, for each of one or more persons, voiceprint data 80 indicating a voiceprint that is the voice feature of the person, one or more word data 81 representing words, identification data (name, nickname, etc.) of the person 82), message data 83 indicating a message to the person, message data 84 indicating the name of the person who left the message, and date data 85 are stored. The date data 85 indicates the date on which the message indicated by the corresponding message data 83 should be output from the output unit.

  In FIG. 4 and FIG. 5, for the sake of explanation, the belonging list storage unit 431 and the message storage unit 432 are shown as separate items, but they are associated with each other. Specifically, these two storage units use the linking function (functions such as pointers P1 and P2) as indicated by the solid line arrows in the figure, and the voice print data 50 indicating the same person, that is, the same voice print. The voiceprint data 80 is linked. Thereby, when one voiceprint data is acquired, information associated with the person corresponding to the voiceprint data can be searched in both the belonging list storage unit 431 and the message storage unit 432.

<Description of each function>
The function of each unit shown in FIG. 3 will be described with reference to the belonging list storage unit 431 and the message storage unit 432 shown in FIGS. 4 and 5.

  The information storage unit 102 stores information according to the user input received by the input receiving unit 101 in the belonging list storage unit 431 or the message storage unit 432.

  The extraction unit 103 has a function of extracting a voice print unique to a person from the voice of the person collected by the microphone 5 which is a sound collection unit. For example, a voiceprint is extracted from the sound collected by the microphone 5 based on the frequency of the sound. The spoken character acquisition unit 104 converts the recognition result into a character string composed of a plurality of kana characters by voice recognition from the voice collected by the microphone 5. A word representing the content of the utterance indicated by the voice collected by the microphone 5 is acquired by the kana character string acquired by the voice recognition. The spoken character acquisition unit 104 compares the kana character string indicated by the speech recognition result with a kana character string representing a predetermined word (such as “I will”, “I ’m right”, “I have”). Thus, it is determined whether or not the content of the utterance represents these words. In addition, said predetermined word is an example and is not limited to this.

  The information reading unit 105 uses the character data 51 (or 81) associated with the voice print data 50 (or 80) indicating the extracted voice print to match the character string of the word acquired by the utterance character acquisition unit 104. Information corresponding to the word data 51 (or 81) indicating the column (the belonging list 53, the sub-item list 60, the message data 83, etc.) is read from the belonging list storage unit 431 and the message storage unit 432.

  The timer unit 112 uses the timer 12 to measure the time during which the voice of the utterance is acquired via the microphone 5. The article information reading unit 106 corresponds to the word data representing the utterance content acquired by the utterance character acquisition unit 104 among the one or more word data 51 associated with the voiceprint data 50 indicating the voiceprint extracted by the extraction unit 103. The inventory list 53 or the sub inventory list 60 is read. Further, when time data (date data 54 and time data 55) is stored corresponding to the word data, the belonging list 53 or the sub belonging list 60 corresponding to the time data indicating the time counted by the time measuring unit 112. Read out.

  The message information reading unit 108 includes message data 83 corresponding to the word data representing the utterance content acquired by the utterance character acquisition unit 104 among the word data 81 associated with the voiceprint data 80 indicating the voiceprint extracted by the extraction unit 103. Read. When time data (date data 85) is stored corresponding to the word data, the message data 83 corresponding to the date data 85 indicating the time measured by the time measuring unit 112 is read. The corresponding message data 84 may be read together with the message data 83.

  Thereby, even if the same word is emitted, the information to be output can be varied depending on the time or the weather when the word is emitted. For example, if the user is engaged in shift work such as night shift, he / she will say “I will go” even during evening hours. It is effective to make them different.

(Presentation of information on belongings according to the weather)
The weather-specific information reading unit 107 uses the weather data from the weather acquisition unit 111 to read information indicated by the weather-specific inventory list 70. Here, the weather acquisition unit 111 sends, via the communication unit 18, the weather data related to the weather in a predetermined area when the sound when the microphone 5 speaks is collected or the weather predicted thereafter. , Acquired from an external server (not shown). When the weather-specific information reading unit 107 determines that the word represented by the utterance content acquired by the utterance character acquisition unit 104 indicates a word (for example, “I will go”) that is uttered at the time of departure, the word data 51 indicating the word Information corresponding to the type of weather indicated by the weather data acquired by the weather acquisition unit 111 (any one or more of rain data 71 to low temperature data 74) is read out. The predetermined area includes a departure area where the information processing apparatus 100 is located and a destination.

  Thereby, when the user who has spoken is going to leave, the information of the portable article according to the weather can be presented.

(Information presentation on mobile devices)
Further, the article information reading unit 106 reads information on the portable terminal from the distance-based belonging list 61 based on the determination result of the distance determination unit 109. Here, it is assumed that the mobile terminal of each user acquires his / her position information using a GPS (Global Positioning System) function and transmits the acquired position information to the information processing apparatus 100.

  The position acquisition unit 110 acquires position information from the mobile terminal via the short-range communication unit 182. An address indicating the mobile terminal that is the transmission source is added to the acquired position information. The position acquisition unit 110 transmits the position information to be acquired from the user's portable terminal by comparing the address of the portable terminal registered in the personal belongings list for each distance 61 and the address added to the position information. It is determined whether it is a thing. If it is determined that the information is transmitted from the portable terminal, the position acquisition unit 110 outputs position information to the distance determination unit 109.

  The distance determination unit 109 determines whether the mobile terminal is separated from the information processing apparatus 100 by a predetermined distance or more from the position information. Specifically, the distance between the position information of the mobile terminal and the position information acquired in advance of the information processing apparatus 100 is calculated, the calculated distance is compared with a predetermined distance, and the comparison is performed. From the result, it is determined whether or not the mobile terminal is more than a predetermined distance, and the determination result is output to the article information reading unit 106.

  The article information reading unit 106 is a word (for example, “I will go”) that is expressed by the utterance content acquired by the utterance character acquisition unit 104 for the corresponding user, and from the distance determination unit 109. When the determination result indicates “they are more than a predetermined distance”, the distance-based belonging list 61 corresponding to the word data 51 for the user is read.

  Thereby, when it is determined that the mobile terminal is away from the information processing apparatus 100 when the user who has spoken is about to leave, that is, when the user does not have the mobile terminal, the information of the mobile article to be output is carried Terminal information can be included. Thereby, it is possible to alert the user that the portable terminal has been forgotten.

(Transfer of mobile goods information)
Further, the information read by the information reading unit 105 may be output via the output unit and may be transmitted to a communication terminal owned by the user who has spoken.

  When the information read by the information reading unit 105 is output to the output unit by the information output unit 113, the information transmission unit 115 uses the data 63 of the address in the belonging list storage unit 431 for the person corresponding to the information. Then, the information is transferred to a person's communication terminal via the communication unit 18. Thereby, the user can confirm the information through his / her communication terminal along with the confirmation of the information by the output unit.

  The portable article information may be transferred to the user's communication terminal as necessary. That is, information may be transferred when the distance detection unit 119 detects that the speaker is away from the information processing apparatus 100 after speaking.

  Specifically, the separation detection unit 119 determines whether or not the speaker continues to separate from the information processing apparatus 100 using the captured image data from the camera 4. Here, it is assumed that the speaker is positioned in the imaging direction of the camera 4 when speaking, and the subject image is sufficiently within the imaging range. The separation detection unit 119 inputs image data when sound is acquired from the microphone 5 from the camera 4, and performs partial image matching by pattern matching using facial feature (eye, nose, mouth, eyebrow, etc.) data from the image data. The face image data of a person is extracted. Thereby, the face image data of the speaker is extracted. When the detected face image data and captured image data are used to detect that the face image has moved out of the imaging range and then does not return within the imaging range even after a predetermined time has elapsed, It is determined that the information processing apparatus 100 continues to be separated.

  When it is assumed that the speaker is carrying the mobile terminal, the distance detection unit 119 determines from the distance between the mobile terminal calculated using the GPS function and the information processing apparatus 100 described above. Also good. That is, when the distance detection unit 119 starts to acquire the distance between the mobile terminal and the information processing apparatus 100 from when the sound is acquired through the microphone 5, and determines that the distance to be acquired increases with time. Is detected that the speaker continues to leave the information processing apparatus 100.

  The portable article information may be transferred to the user's communication terminal when the motion detection unit 118 detects a predetermined motion of the person. The predetermined operation is an operation indicating that the user has confirmed the information of the portable article output by the output unit. For example, based on the input received by the input receiving unit 101, the touch on the screen of the touch panel 201 or the utterance of a word (for example, “had”) indicating that the article is carried. The motion detection unit 118 detects the touch operation from the output of the input reception unit 101, and detects the utterance of the words ("had") representing the carrying from the utterance character acquisition unit 104.

  When the information output unit 113 outputs the information via the output unit and the operation detection unit 118 does not detect the predetermined operation, the information transmission unit 115 sends the output information to the communication terminal. Forward.

  It should be noted that it may be possible to selectively specify in advance for each user whether the predetermined operation is the above-mentioned utterance or touch on the screen. In addition, the types of operations determined in advance are not limited to these.

  Thus, according to the information transfer by the information transmission unit 115, when the information output by the user is not performed when the information of the portable article is output, the information is transferred to the user's communication terminal. Even if the user leaves without confirming the output information, the information can be provided to the user at the destination. Specifically, the user can display and confirm the information transferred by the communication terminal, and when he / she notices a forgotten thing, he / she can purchase it at the destination.

(Change of information output mode)
The information output unit 113 may change the information output mode based on the output from the motion detection unit 118 when the information on the portable article is output by the output unit.

  That is, when a predetermined motion is detected by the motion detection unit 118, the output mode change unit 114 changes the display mode of the information on the portable article displayed on the screen. For example, the information is erased from the screen, displayed in reverse video, or displayed with a special check mark added. Further, when information is output from the speaker 6 by voice, for example, the voice output of the information is stopped.

  By changing the output mode in this way, the user can sensuously know visually or audibly whether the information on the presented portable article has been confirmed or not yet confirmed.

(Follow processing)
In the present embodiment, it is possible to follow (track) whether or not a predetermined operation for the above confirmation on the information of the output portable article has been performed. The writing unit 116 and the associated information output unit 117 are used for following.

  Specifically, when the writing unit 116 determines that the above-described predetermined operation is detected for the output information of the portable article based on the output from the operation detecting unit 118, the belonging list Write “T” in the check data 62 related to the information in the storage unit 431. Therefore, when it is determined that the predetermined operation is not detected, the check data 62 related to the information in the belonging list storage unit 431 remains “F” and is not updated to “T”.

  Thereafter, when the user operates the touch panel 201 to input a check command, the association information output unit 117 is associated with the check data 62 indicating “F” based on the command indicated by the output of the input receiving unit 101. The inventory list 53 (or the sub inventory list 60) and the identification data 52 are read from the inventory list storage unit 431, and the read information is output to the output unit.

  As described above, the information on the portable article that has not been confirmed by the user can be confirmed by outputting the portable article indicated by the information and the name indicated by the identification data 52 to the output unit. Thereby, for example, it becomes possible for the mother to confirm the information on the article that the child would have forgotten to take and deliver the article to the child at the destination.

  The output method by the “output unit” includes a method of displaying information on the display unit 202 of the tablet 2, a method of transmitting information to a mail address designated in advance via the communication unit 18, and the like.

(Output of message information)
In the above example, when the word represented by the content of the utterance is a word that is uttered at the time of departure (for example, “I will go”), the information in the belonging list storage unit 431 is output. In the case of (for example, indicating “just now”), the message information in the message storage unit 432 is output.

  When the information reading unit 105 determines that the content of the utterance acquired based on the output of the utterance character acquisition unit 104 indicates the words at the time of return, the message information reading unit 108 includes the extraction unit 103 and the utterance character acquisition unit 104. The message storage unit 432 is searched based on the output of the timer unit 112. The voiceprint data 80 indicating the voiceprint of the speaker acquired by the extraction unit 103 by the search, the word data 81 represented by the content of the utterance acquired by the utterance character acquisition unit 104, and the date data 85 indicating the output from the timing unit 112 Message data 83 (or message data 83 and message data 84) associated with the message is read from the message storage unit 432 and provided to the information output unit 113. The information output unit 113 causes the output unit to output message data 83 (or message data 83 and message data 84).

  In this embodiment, the message data 83 is associated with the date data 85, and the message data 83 is output only when the return date indicates the date indicated by the date data 85. May be output when an utterance representing the return word is acquired, regardless of the date.

  By using the message information reading unit 108, when a user returns, the message left for the user is output, so that the message to be transmitted can be reliably presented to the user at the time of return. .

  FIG. 6 is a diagram showing an output example of information at the time of departure and return described above, and details thereof will be described later.

<Data registration process>
FIG. 7 is a process flowchart for information registration according to the embodiment of the present invention. Information registration processing will be described with reference to this flowchart.

  Here, the information processing apparatus 100 has a plurality of types of operation modes, and the operation modes include a registration mode for storing information in the belonging list storage unit 431 and the message storage unit 432 by a user operation.

  First, it is assumed that the operation mode of the information processing apparatus 100 is set to the information registration mode in the belonging list storage unit 431.

  Each user speaks into the microphone 5 to acquire voiceprint data 50 and word data 51 (step S1). That is, the extraction unit 103 and the utterance character acquisition unit 104 acquire voiceprint data and words (such as “I will go”) represented by the content of the utterance from the voice of the utterance collected by the microphone 5 and use them as information. The data is output to the storage unit 102.

  In addition, the user operates the touch panel 201 to input his or her name or nickname (step S3). The input receiving unit 101 outputs the input information to the information storage unit 102.

  The information storage unit 102 stores the output from the extraction unit 103, the spoken character acquisition unit 104, and the input reception unit 101 in the belonging list storage unit 431 in association with the voiceprint data 50, the word data 51, and the identification data 52 (step S5). ).

  Subsequently, the user operates the touch panel 201 to input further information (step S7). Specifically, the personal belonging list 53 indicating information of articles to be carried at the time of departure, date and time data 54 and 55 for which the personal belonging list 53 is desired to be presented, and data for the sub personal belonging list 60 are input. Enter. Furthermore, the data 63 of the communication address of the portable terminal possessed by the user is input.

  The information storage unit 102 receives data input by the user in step S7 via the input receiving unit 101, and the voice list data 50, the word data 51, and the identification data stored in step S3 in the inventory list storage unit 431. The data is stored in association with 52 (step S9). Thereby, the data 50-63 in the belonging list storage part 431 about the said user are stored. At this time, “F” is set in the check data 62.

  In this manner, the data list is similarly stored for each user according to the flowchart of FIG. 7, thereby completing the belonging list storage unit 431.

  Here, the storing operation of the data in the belonging list storage unit 431 is shown, but the information storage unit 102 also performs the voice storage data 80, the word data 81, and the identification data 82 when the user speaks in the same manner for the message storage unit 432. Can be stored. Then, a person who wants to leave a message for the user registered in the message storage unit 432 operates the touch panel 201 and inputs the user's name and message message.

  When the user name and message message are input via the input receiving unit 101, the information storage unit 102 searches the message storage unit 432 based on the user name, and associates the message with the identification data 82 indicating the user name. The message is stored as message data 83. Further, a person who wants to leave a message operates the touch panel 201 to input his / her name and a date on which he / she wants to output a message, whereby message data 84 and date data 85 are stored in the information storage unit 102 as a message storage unit 432. Can be stored.

  In the present embodiment, the information storage unit 102 can also rewrite (delete, change, add, etc.) information in the belonging list storage unit 431 and the message storage unit 432 from an input via the touch panel 201. For example, you may make it store message data from whereabouts. That is, message data is transmitted from the outside to the information processing apparatus 100, and the information storage unit 102 of the information processing apparatus 100 stores the message data in the message storage unit 432 when receiving the message data via the communication unit 18.

<Information output processing>
FIG. 8 is a flowchart of the information output process according to the embodiment of the present invention. Here, it is assumed that information corresponding to the inventory list storage unit 431 and the message storage unit 432 has already been registered in the microphone 5 for all users of the information processing apparatus 100.

  In the present embodiment, the camera 4 is always powered on, and the microphone 5 and the display unit 202 are normally powered off for power saving, but a person approaches the information processing apparatus 100. When detected, the power is switched from OFF to ON. Thereafter, after the information read from the belonging list storage unit 431 or the message storage unit 432 is output, the microphone 5 and the display unit 202 are turned off.

  First, the CPU 11 detects the approach of a person to the information processing apparatus 100, more specifically the approach of a person to the tablet 2 (step S11). Specifically, it is determined from a time-series subject image captured by the camera 4 whether or not a person has entered the imaging range of the camera 4. This determination is made based on whether or not a face image including face features (eyes, nose, mouth, eyebrows) and the like is detected in the subject image.

  The detection of a person is not limited to using a captured image from the camera 4, and a human sensor is used to determine a change in the absence of a person → the presence of the person using the detection result of infrared rays emitted from the human body. It may be.

  If the approach of a person is not detected (NO in step S11), the process of step S11 is repeated, but if the approach is detected (YES in step S11), the CPU 11 turns on the microphone 5 and the display unit 202 (step S13). . Note that the display unit 202 may be powered on in advance.

  Next, the processor 10 determines whether or not sound is input based on the output of the microphone 5 (step S15). While it is determined that no sound is input (NO in step S15), the process of step S15 is repeated. However, if it is determined that a sound is input (YES in step S15), the process proceeds to step S17.

  The extraction unit 103 extracts voiceprint data from the voice of the utterance output from the microphone 5 (step S17). The CPU 11 searches the belonging list storage unit 431 and the message storage unit 432 based on the extracted voiceprint data, and reads the identification data 52 associated with the voiceprint data (step S19). Thereby, the person who uttered the sound can be determined.

  Subsequently, the utterance character acquisition unit 104 acquires word data represented by the content of the utterance from the voice of the utterance output from the microphone 5 (step S21).

  Subsequently, the time measuring unit 112 acquires the time when the voice by the utterance is acquired from the microphone 5 using the timer 12 (step S23).

  Subsequently, based on the output of the utterance character acquisition unit 104, the information reading unit 105 determines whether or not the acquired word indicates a departure word (for example, “I will go”) (step S25). If it is determined that it indicates a word to be issued upon departure (YES in step S25), the information reading unit 105 causes the belonging list storage unit 431 to be based on the voiceprint data acquired in step S17 or the identification data 52 determined in step S19. A search is performed, and information associated with the voiceprint data or identification data 52 is read out.

  Specifically, it is determined whether there is a time corresponding to the time acquired in step S23 among the times indicated by the associated date and time data 54 and 55 (step S27). If it is determined that there is no corresponding date and time data 54 and 55 (NO in step S27), the process proceeds to step S31 described later.

  On the other hand, if it is determined that the corresponding date and time data 54 and 55 are stored (YES in step S27), the information reading unit 105 displays the inventory list 53 associated with the date and time data 54 and 55. The read information output unit 113 is provided (step S29).

  The weather acquisition unit 111 acquires data related to the weather (step S31). The weather-specific information reading unit 107 searches the personal belongings list 60 of the personal belongings list storage unit 431 based on the output from the weather acquisition unit 111, and the personal belongings list 70 corresponding to the weather-related data acquired by the search. Is stored (step S33).

  For example, if the acquired data regarding weather indicates, for example, “sunny”, according to the belonging list storage unit 431 of FIG. 5, the weather-specific belonging list 70 is not stored (NO in step S33). In such a case, the process proceeds to step S37.

  At this time, the article information reading unit 106 may read the personal belongings list 61 by distance. FIG. 6A shows an output example when the distance-based belonging list 61 is read. In this output example, an article based on the distance-based belonging list 61 is output to a user who has spoken “I will go”.

  On the other hand, if the acquired data relating to the weather indicates, for example, “rain”, the rain data 71 of the personal belonging list 70 according to the weather is read according to the personal belonging list storage unit 431 in FIG. 5 (YES in step S33, step S35). The read-out personal belongings list 70 by weather is given to the information output unit 113.

  The information output unit 113 causes the output unit to output information including the weather-specific information reading unit 107 from the information reading unit 105 (step S37). Specifically, the information from the information reading unit 105 is converted into display data and written into the graphic memory 13, or is output by voice through the speaker 6. As a result, information indicating the portable article is displayed on the display unit 202 as display data and is output from the speaker 6 by voice (step S37).

  An output example at this time is shown in FIG. In the output example, “umbrella” is output as the weather-specific personal belonging list 70 together with the personal belongings list 53 to the user who has spoken “I will go”. Further, FIG. 6C shows a state where the user who has confirmed the information output as shown in FIG. 6B utters “have” as a response to the information output.

  The process returns to step S25. If it is determined that the word represented by the acquired utterance content does not indicate “I will go” (NO in step S25), the information reading unit 105 returns the word based on the output of the utterance character acquisition unit 104. It is determined whether or not a word (for example, “just now”) that is sometimes spoken is expressed (step S39).

  If it is determined that the word is not a return word (NO in step S39), other voice processing is performed (step S47), and the process returns to step S15.

  Here, the other voice processing includes, for example, a message output such as “This word is not registered”.

  On the other hand, when the information reading unit 105 determines that the word represented by the utterance content based on the output of the utterance character acquisition unit 104 is a word (for example, "I'm right") uttered at the time of return (YES in step S39), the message information reading The unit 108 searches the message storage unit 432 based on the voiceprint data acquired in step S17 or the name data determined in step S19, and reads information associated with the voiceprint data or name data.

  Specifically, it is determined whether there is a date indicating the date corresponding to the time acquired in step S23 among the dates indicated by the associated date data 85 (step S41). If it is determined that the message is not stored (NO in step S41), the process ends, but if it is determined that the message is stored (YES in step S41), the message information reading unit 108 reads the corresponding message from the message storage unit 432. Data 83 (or message data 83 and message data 84) is read, and the read data is provided to information output unit 113 (step S43).

  The information output unit 113 converts the message data 83 or the like output from the message information reading unit 108 into display data and stores it in the graphic memory 13 or causes the speaker 6 to output it as sound (step S45). As a result, a message for the user who has returned is displayed on the display unit 202 or is output from the speaker 6 by voice.

  An output example at this time is shown in FIG. In the output example, a message is output to the user who has spoken “I'm right”.

(Effects of the embodiment)
According to the present embodiment, the person who speaks by acquiring voiceprint data from the voice of the utterance is discriminated, and the article information to be carried appropriately and necessary for each of the items registered in the belonging list storage unit 431 in advance. Can be automatically notified, so you can prevent forgotten items.

  Furthermore, by presenting article information to be carried from weather forecast information acquired from the outside such as a weather forecast, it becomes possible to live a comfortable life according to the weather on the go.

  Further, when the information output function of the information processing apparatus 100 is used for a child, it becomes possible to provide necessary information even if a guardian is absent, and attention is given to the child whether there is anything left behind. Can be encouraged.

  Further, by adopting voice recognition, it is possible to recognize a person without limiting a place such as a standing position. For example, as in the case of face authentication, it is possible to remove a limiting condition that authentication is not performed unless the face is directed to the camera, which is excellent in usability.

[Other embodiments]
In the above-described embodiment, the program according to each flowchart is stored in the ROM 15 in advance, and the CPU 11 reads the program from the ROM 15 and executes it. Such a program is stored in the CD-ROM 21 attached to the information processing apparatus 100 or the like. In this way, the program can be provided as a program product by being recorded on a non-temporary recording medium that can be read by the CPU 11 of the processor 10. Alternatively, the program can be provided by receiving via the antenna 19 and the communication unit 18 via a network (not shown) and downloading to the storage area of the RAM 16 or the HDD 17.

  The provided program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  2 Tablets, 4 cameras, 5 microphones, 6 speakers, 10 processors, 12 timers, 13 graphic memories, 14 display drivers, 50, 80 voice print data, 51, 81 word data, 52, 82 identification data, 53 belongings list, 54 dates Data, 55 Time data, 60 Sub inventory list, 61 Distance inventory list, 62 Check data, 70 Weather inventory list, 83 Message data, 84 Messager data, 100 Information processing device, 101 Input reception unit, 102 Information storage unit , 103 extraction unit, 104 spoken character acquisition unit, 105 information reading unit, 106 article information reading unit, 107 weather information reading unit, 108 message information reading unit, 109 distance determination unit, 110 position acquisition unit, 111 weather acquisition unit, 112 Timekeeping section, 113 Information output section, 114 Output Force mode change unit, 115 information transmission unit, 116 writing unit, 117 associated information output unit, 118 operation detection unit, 119 away detection unit, 202 display unit, 431 belonging list storage unit, 432 message storage unit.

Claims (13)

A memory for associating and storing at least one kind of voiceprint data, at least one word data composed of a plurality of characters, and information on the next action corresponding to the word data;
Voice acquisition means for acquiring the voice of the utterance;
Extraction means for extracting a voiceprint from the acquired voice;
An utterance character acquisition means for acquiring character data of the acquired voice;
Of the word data associated with the voice print data that matches the voice print data extracted by the extraction means, information on the next action corresponding to the word data that matches the character data acquired by the spoken character acquisition means, Information reading means for reading from the memory;
An information output device comprising: information output means for causing the output unit to output information read by the information reading means. It further comprises a timing means for timing the time when the sound is acquired,
The memory further includes:
Corresponding to the information about the next action, time data indicating the time when the information should be output is stored,
The information reading means includes
Of the at least one word data associated with the voice print data indicating the extracted voice print, information on the next action corresponding to the word data matching the character data acquired by the spoken character acquisition means. The information related to the action is read out when the time measured by the time measuring means matches or falls within the range of the time data corresponding to the information related to the next action. Information processing device. The at least one word data includes first word data indicating words uttered on departure of the speaker,
The information relating to the next action corresponding to the first word data in the memory includes article information indicating a portable article to be carried on departure,
The information reading means includes
The article information reading means for reading the article information corresponding to the first word data indicating the word when the character data acquired by the spoken character acquisition means indicates a word uttered upon the departure. 2. The information processing apparatus according to 2. The information on the next action corresponding to the first word data in the memory is an article to be carried under the weather corresponding to each of a plurality of types of weather indicating at least one of weather and a probability of precipitation. Including product information indicating
Weather acquisition means for acquiring weather data related to the weather when the voice is acquired by the voice acquisition means or the weather predicted thereafter;
The article information reading means includes
When the character data acquired by the spoken character acquisition means indicates a word uttered at the time of departure, among the item information indicating the item to be carried under the weather corresponding to the first word data indicating the word, The information processing apparatus according to claim 3, further comprising means for reading information corresponding to a type of weather indicated by weather data acquired by the weather acquisition means. The portable article includes a portable terminal,
The information processing apparatus includes:
Position acquisition means for acquiring position information indicating the position of the mobile terminal;
Distance determining means for determining whether or not the portable terminal is separated from the information processing apparatus by a predetermined distance or more from the acquired position information,
The article information reading means includes
The portable terminal corresponding to the first word data indicating the word when the character data acquired by the spoken character acquisition means indicates a word uttered at the departure and is determined to be separated by the distance determination means The information processing apparatus according to claim 3, further comprising means for reading article information indicating a portable article including In the memory, for each of the at least one type of voiceprint data, data of a communication address of a communication terminal is stored,
The information processing apparatus further includes:
When information related to the next action is output to the output unit by the information output unit, the voice address data corresponding to the information related to the next action is then used using the data of the communication address stored in the memory. The information processing apparatus according to claim 1, further comprising information transmission means for transmitting information related to the next action to the communication terminal. A distance detecting means for detecting whether or not the speaker is away from the information processing apparatus,
The information transmitting means includes
When information related to the next action is output to the output unit by the information output means, the information corresponding to the next action is detected when it is detected that the speaker is away by the distance detection means. The information processing apparatus according to claim 6, further comprising means for transmitting information on the next action to the communication terminal using the data of the communication address stored in the memory for the voiceprint data. The output unit includes a screen for displaying information,
The information processing apparatus includes:
A motion detecting means for detecting a predetermined motion of the person,
The information output means includes
Means for changing the output mode of information relating to the next action when the predetermined action is detected by the action detecting means when the information relating to the next action is output to the output unit; The information processing apparatus according to claim 1, further comprising: In the memory, for each of the at least one type of voiceprint data, data of a communication address of a communication terminal is stored,
The information processing apparatus includes:
When the information relating to the next action is output to the output unit, if the predetermined action is not detected by the action detecting means, the information relating to the next action is converted to the voiceprint data indicating the extracted voiceprint. The information processing apparatus according to claim 8, wherein data of the communication address in the memory is transmitted to the communication terminal. The memory stores identification data for identifying each person corresponding to each of the at least one kind of voiceprint data.
The information processing apparatus further includes:
When the information regarding the next action is output to the output unit and the predetermined action is not detected by the action detection unit, the action is detected in the memory in relation to the information about the next action. Writing means for writing information indicating that it is not performed;
Information that is read from the memory, the information related to the next action associated with information indicating that the operation is not detected, and the identification data corresponding to the voiceprint data associated with the information related to the next action are read from the memory The information processing apparatus according to claim 8, further comprising: means for outputting the information to the output unit. The at least one word data includes second word data indicating words to be spoken upon the speaker's return;
The information on the next action corresponding to the second word data in the memory includes message information,
The information reading means includes
The character information acquired by the spoken character acquisition means includes means for reading out the information of the message corresponding to the second word data indicating the word when the character data indicates a word uttered upon the return. The information processing apparatus according to any one of the above. An information processing method for reading information from a memory,
The memory stores at least one type of voiceprint data, at least one word data composed of a plurality of characters, and information related to the next action corresponding to the word data,
Extracting a voiceprint from the voice of the utterance;
Obtaining character data of speech of the utterance;
Of the word data associated with the voiceprint data that matches the voiceprint data extracted in the extracting step, the information regarding the next action corresponding to the word data that matches the character data acquired in the acquiring step, Reading from the memory;
And outputting the information read in the reading step to an output unit. A program for causing a processor to execute an information processing method for reading information from a memory,
The memory stores at least one type of voiceprint data, at least one word data composed of a plurality of characters, and information related to the next action corresponding to the word data,
The program is stored in the processor.
Extracting a voiceprint from the voice of the utterance;
Obtaining character data of speech of the utterance;
Of the word data associated with the voiceprint data that matches the voiceprint data extracted in the extracting step, the information regarding the next action corresponding to the word data that matches the character data acquired in the acquiring step, Reading from the memory;
Causing the output unit to output the information read in the step of reading.

Images