JP5418347B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program suitable for presenting information desired by a user.

  Information processing apparatuses are known in which information is transmitted and received between a local information processing apparatus and another information processing apparatus through a communication circuit network such as the Internet. Patent Document 1 discloses a technique in which, when a user who owns another information processing apparatus transmits predetermined information to the own information processing apparatus, the predetermined information is presented to the own information processing apparatus. By transmitting and receiving information between the information processing devices, users who own the information processing devices can communicate with each other.

JP 2005-253006 A

  However, in the information processing apparatus described in Patent Document 1, information transmitted from another information processing apparatus and presented to the information processing apparatus does not match information desired by the user who owns the information processing apparatus. In some cases, some users may feel frustrated that the desired information is not presented. Therefore, a new method suitable for presenting information desired by the user is demanded.

  SUMMARY An advantage of some aspects of the invention is that it provides an information processing apparatus and a program suitable for presenting information desired by a user.

In order to achieve the above object, an information processing apparatus according to the first aspect of the present invention provides:
An information processing apparatus,
A face information acquisition unit that acquires face information data indicating the face information of the user of the information processing apparatus;
An environment information acquisition unit that acquires environment information data indicating environment information of the information processing apparatus;
A communication unit that receives voice data representing voice uttered by a user of the other information processing apparatus from another information processing apparatus other than the information processing apparatus;
The received voice data is obtained by referring to a correspondence table in which a plurality of voice information, environmental conditions that are conditions related to the environmental information, and face conditions that are conditions related to the user's face information are stored in association with each other. A specifying unit that specifies the environmental condition and the face condition corresponding to the voice information stored in the correspondence table at least partially matching the voice information represented by the voice represented by:
Determination that determines whether the environmental information indicated by the acquired environmental information data satisfies the specified environmental condition and the facial information indicated by the acquired face information data satisfies the specified facial condition And
A presentation unit that presents a voice represented by the received voice data to a user of the information processing apparatus according to a determination result of the determination unit;
It is characterized by providing.

The program according to the second aspect of the present invention is:
A program that causes a computer to function as an information processing device,
A face information acquisition unit for acquiring face information data indicating the face information of the user of the computer;
An environmental information acquisition unit that acquires environmental information data indicating environmental information of the computer;
A communication unit that receives voice data representing a voice uttered by a user of the other computer from a computer other than the computer;
The received voice data is obtained by referring to a correspondence table in which a plurality of voice information, environmental conditions that are conditions related to the environmental information, and face conditions that are conditions related to the user's face information are stored in association with each other. A specifying unit that specifies the environmental condition and the face condition corresponding to the voice information stored in the correspondence table at least partially matching the voice information represented by the voice represented by:
Determination that determines whether the environmental information indicated by the acquired environmental information data satisfies the specified environmental condition and the facial information indicated by the acquired face information data satisfies the specified facial condition And
A presentation unit that presents a voice represented by the received voice data to a user of the computer according to a determination result of the determination unit;
It is characterized by functioning.

  According to the present invention, information desired by a user can be presented.

It is a block diagram which shows the hardware constitutions of the digital photo stand by which the information processing apparatus which concerns on embodiment of this invention is implement | achieved. It is a schematic external view of a digital photo stand. It is a schematic block diagram which shows the connection of the digital photo stand through a communication network. It is a block diagram which shows the function of each part of the information processing apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the correspondence table memorize | stored in a memory | storage part. It is a flowchart which shows the flow of the registration process performed with an information processing apparatus. It is a figure which shows an example of the information registered. It is a flowchart which shows the flow of a process of another information processing apparatus. It is a figure which shows the example of presentation of the user information shown to another information processing apparatus. It is a flowchart which shows the flow of a process of a self-information processing apparatus. It is a figure which shows the example in which the audio | voice represented by audio | voice data is shown in the own information processing apparatus. (A)-(c) is a figure which shows the example in which the audio | voice which audio | voice data represent is not shown in the own information processing apparatus.

  The information processing apparatus according to the embodiment of the present invention will be described below. In the following description, a digital photo stand on which a digital photograph or the like is displayed is described as an example of the information processing apparatus. However, the present invention is not limited to this. For example, a digital camera, various computers, a PDA (Personal Digital Assistant), a mobile phone, The present invention can be applied to any information processing apparatus. In other words, the embodiments described below are for illustrative purposes and do not limit the scope of the present invention. Therefore, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

  FIG. 1 is a block diagram showing a hardware configuration of a typical digital photo stand 10 in which an information processing apparatus according to an embodiment of the present invention is realized. FIG. 2 shows an external view of the digital photo stand 10. Hereinafter, description will be given with reference to these drawings.

  The digital photo stand 10 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, a storage device 13, a media controller 14, an input key 15, a drive circuit 16, a display panel 17, and audio. A sensor 18, an image sensor 19, a memory card 20, a speaker 21, a NIC (Network Interface Card) 22, an RTC (Real Time Clock) 23, and an environment sensor 24 are provided.

  The CPU 11 controls the operation of the entire digital photo stand 10 and is connected to each component to exchange control signals and data.

  The RAM 12 is for temporarily storing data and programs. The RAM 12 holds programs, data, and other data necessary for the operation of the digital photo stand 10.

  The storage device 13 is composed of, for example, a hard disk or a flash memory, and stores arbitrary data such as image data read from the memory card 20. Here, the memory card 20 is configured by, for example, a flash memory and stores various data. The memory card 20 stores image data such as a digital photograph obtained by photographing with a digital camera.

  The media controller 14 reads and writes data from and to the memory card 20.

  For example, as shown in FIG. 2, a memory card insertion slot 14a for inserting a memory card 20 is provided on the side surface of the digital photo stand 10, and the memory card 20 is inserted into the memory card insertion slot 14a. The memory card 20 and the media controller 14 are connected. When the connection between the memory card 20 and the media controller 14 is confirmed, the image data recorded on the memory card 20 is read.

  The input key 15 is a key for accepting an operation instruction from the user. The input key 15 includes, for example, a selection key used for selecting a photograph desired by the user, a playback / stop key used for starting and stopping a so-called slide show for sequentially displaying photograph images, and the like. As shown in FIG. 2, the input key 15 is disposed, for example, at the lower part of the frame of the display panel 17 of the digital photo stand 10, and outputs an ON signal or the like corresponding to the user's pressing operation as operation information.

  The drive circuit 16 drives the display panel 17 according to the image data stored in the storage device 13 or the memory card 20, and displays an image, an operation screen, or the like on the display panel 17.

  The display panel 17 is composed of, for example, a liquid crystal panel, an organic EL (Electro Luminescence) panel, and the like, and displays an arbitrary image based on the operation of the drive circuit 16. As shown in FIG. 2, the display panel 17 is disposed on the front surface of the digital photo stand 10, for example.

  The voice sensor 18 is a sensor that detects a voice uttered by a user and surrounding voices. The audio sensor 18 is composed of, for example, a microphone. As shown in FIG. 2, the audio sensor 18 is provided, for example, on the frame of the display panel 17 of the digital photo stand 10. When a voice is emitted from the user, the voice sensor 18 acquires voice data representing the voice.

  The image sensor 19 is a sensor for acquiring image data representing an image. The image sensor 19 is configured by a camera such as a CCD (Charge Coupled Device) type or a CMOS (Complementary Metal Oxide Semiconductor) type, for example. As shown in FIG. 2, the image sensor 19 is provided, for example, on the frame of the display panel 17 of the digital photo stand 10. The image sensor 19 typically captures an image around the digital photo stand 10 an arbitrary number of times at an arbitrary timing. The image sensor 19 can also capture a moving image. Then, the captured image is stored in the storage device 13 or the memory card 20.

  The speaker 21 outputs voice and music. When the audio data stored in the storage device 13 or the memory card 20 is reproduced, the speaker 21 outputs the audio represented by the audio data.

  The NIC 22 is for connecting the digital photo stand 10 to a communication circuit network such as the Internet. The NIC 22 conforms to the 10BASE-T / 100BASE-T standard used for configuring a LAN (Local Area Network), a telephone, Analog modem to connect to the Internet using a line, ISDN (Integrated Services Digital Network) modem, ADSL (Asymmetric Digital Subscriber Line) modem, cable modem to connect to the Internet using a cable television line, wireless communication For example, a modem and the like, and an interface (not shown) that mediates between the modem and the like.

  FIG. 3 is a schematic configuration diagram showing the connection of the digital photo stand 10 through the communication circuit network. The plurality of digital photo stands 10 (10 a to 10 d) are connected to a communication circuit network through the NIC 22, and data is exchanged between the digital photo stands 10 via the server device 30. For example, when data is transmitted from the digital photo stand 10a, the digital photo stands 10b to 10d receive the data and present information represented by the data to the user. Data transmitted from the digital photo stand 10 is stored in the server device 30 connected to the communication circuit network.

  Returning to FIG. 2, the RTC 23 is composed of, for example, a crystal resonator, an oscillation circuit, and the like, and measures (counts) the date and time (including year / month / day / hour / minute / second and day of the week). The RTC 23 functions as a calendar or a clock by measuring the date and time.

  The environmental sensor 24 is a sensor that acquires environmental information indicating temperature, humidity, atmospheric pressure, and the like. The environmental sensor 24 includes, for example, a thermometer, a hygrometer, a barometer, and the like, and acquires environmental information indicating the temperature, humidity, and the like around the digital photo stand 10.

  Hereinafter, unless otherwise noted, the information processing apparatus to be described later will be described with reference to the digital photo stand 10 shown in FIGS. The information processing apparatus can be appropriately replaced with elements such as a general computer and a digital camera as necessary, and these embodiments are also included in the scope of the present invention.

(Configuration of information processing device)
A schematic configuration of the information processing apparatus 100 according to the present embodiment will be described with reference to FIG. The information processing apparatus 100 includes a control unit 110, a storage unit 120, a communication unit 130, a presentation unit 140, an acquisition unit 150, a specification unit 160, and a determination unit 170. Hereinafter, each component of the information processing apparatus 100 will be described.
In addition, although the function of each part is mutually linked | related, the acceptance / rejection of each part can be changed suitably according to a use.

  The control unit 110 controls the overall operation of the information processing apparatus 100 and is connected to each component to exchange control signals and data.

  The CPU 11, the RAM 12, and the like operate in cooperation to function as the control unit 110.

  The storage unit 120 stores image data representing an image presented by the presentation unit 140 to the user, audio data representing sound, and the like. In addition, the storage unit 120 includes face information data representing the face of the user who operates the information processing apparatus 100, sound data representing the voice uttered by the user, environment information data representing the environment information, sound information, and conditions regarding the environment information A correspondence table in which a plurality of environmental conditions and face conditions that are conditions related to user face information are stored in association with each other, setting data set by the user, a control program for controlling the information processing apparatus 100, and the like Arbitrary data / information is stored.

Here, the face information data refers to data representing face information.
The face information refers to information indicating a person's face area, and includes information indicating the position and size of eyes, nose, mouth, ears, and the like.
Moreover, audio | voice data means the data showing an audio | voice.
The voice information refers to information indicating one or more words or documents grasped by voice.
The environmental information data refers to data representing environmental information. The environmental information typically includes information including date information, time information, temperature information, humidity information, atmospheric pressure information, or weather information. Say.
The correspondence table is a table in which a plurality of voice information, environmental conditions that are conditions related to environmental information, and face conditions that are conditions related to user face information are stored in association with each other. 5 is a table used for specifying the environmental condition and the face condition associated with each other.

  FIG. 5 is a diagram illustrating an example of the correspondence table stored in the storage unit 120. As shown in the figure, voice information representing a voice, a face condition, and an environmental condition are stored in association with each other. The correspondence table shown in the figure is an example, and arbitrary conditions can be set.

  The RAM 12, the storage device 13, the memory card 20, and the like operate in cooperation to function as the storage unit 130.

  The communication unit 130 transmits information data to the other information processing apparatus 100 via the NIC 22 and the communication circuit network such as the Internet, and receives information data transmitted from the other information processing apparatus 100. The communication unit 130 can also transmit and receive information data to and from the other information processing apparatus 100 by wireless communication through the NIC 22.

  The CPU 11, the NIC 22, and the like operate in cooperation to function as the communication unit 120.

  The presenting unit 140 presents the image represented by the image data and / or the sound represented by the audio data to the user based on the control from the control unit 110. For example, the presentation unit 110 displays the image data stored in the storage unit 120 or the image represented by the image data transmitted from the other information processing apparatus 100 one after another at a certain time interval, or displays a screen. It is also possible to divide into a large number and display images simultaneously on the divided screens. In addition, the presentation unit 140 outputs voice data stored in the storage unit 120 or voice represented by voice data transmitted from another information processing apparatus 100. The presentation unit 140 can present an arbitrary image and sound to the user based on an arbitrary method.

  The CPU 11, the drive circuit 16, the display panel 17, the speaker 21, and the like operate in cooperation to function as the presentation unit 140.

  The acquisition unit 150 includes a face information acquisition unit 151, an audio information acquisition unit 152, an environment information acquisition unit 153, and an input information acquisition unit 154. Below, each component of the acquisition part 150 is demonstrated.

  The face information acquisition unit 151 acquires face information data representing the face of the user who operates the information processing apparatus 100. The face information acquisition unit 151 acquires image data at an arbitrary timing, for example, when the user is in front of the information processing apparatus 100, when there is an instruction from the user, when a predetermined time comes, and the like Face information data representing the user's face is acquired by detecting the user's face area from the image data. Here, the front surface of the information processing apparatus 100 typically refers to a range in which a user's face area can be detected, and refers to an arbitrary range in which a user who operates the information processing apparatus 100 can be specified. The face information acquisition unit 151 can determine that the user is in front of the information processing apparatus 100 when the face information data representing the user's face can be acquired. For example, the face information acquisition unit 151 captures an image (captured image) such as a person and a background in the imaging direction through the image sensor 19 to generate an imaging signal, and generates image data representing the image based on the imaging signal. get.

  In order to detect the face area of a person, the face information acquisition unit 151 searches (searches) for the face area of the person that is the attention area in the envelopment represented by the image data. Here, the attention area is an area in which a main subject (person) is shown, and typically refers to a face area in which a person's face is shown. The face information acquisition unit 151 uses, for example, a template image that is prepared in advance and includes an image of a predetermined face (main subject) to search for an area that is similar to the template image by a template matching or the like. Such an area is an attention area, and if this area exists, the face information acquisition unit 151 detects this area as the attention area. A known technique (so-called face detection technique or the like) can be used for such attention area search and detection.

  In addition, when there are a plurality of candidates for the attention area, for example, the face information acquisition unit 151 can set one of the candidates determined at random as the attention area. In addition, when the face information acquisition unit 151 cannot detect the attention area using one image data, the face information acquisition section 151 can also detect the attention area using the image data acquired next. . Further, the face information acquisition unit 151 can acquire image data with arbitrary settings (for example, shooting direction, magnification, shutter speed, aperture, etc.).

  The CPU 11, the input key 15, the image sensor 19, and the like operate in cooperation to function as the face information acquisition unit 151.

  The voice information acquisition unit 152 acquires voice data representing the voice uttered by the user through the voice sensor 18. For example, the voice information acquisition unit 152 acquires voice data representing voices such as “good morning”, “good evening”, “rain rain”, and “hot” issued by the user, and stores the voice data. 120 is stored. Audio data is transmitted and received between the information processing apparatuses 100.

  The CPU 11, the input key 15, the voice sensor 18, and the like operate in cooperation to function as the voice information acquisition unit 152.

  The environmental information acquisition unit 153 acquires environmental information data indicating environmental information through, for example, the communication circuit network and the environmental sensor 24. For example, the environmental information acquisition unit 153 acquires arbitrary environmental information data such as a room temperature and humidity in which the information processing apparatus 100 is installed, date and time, weather, and the like, and stores the environmental information data in the storage unit 120. . The environment information acquisition unit 153 measures (counts) the current date and time (including year, month, date, hour, minute, second, and day of the week), and acquires the current date and time. The environment information acquisition unit 153 acquires weather information indicating the current weather from the server device 30 connected to the communication circuit network, for example, via the NIC 22.

  The CPU 11, the input key 15, the NIC 22, the RTC 23, the environment sensor 24, and the like work together to function as the environment information acquisition unit 153.

  The input information acquisition unit 154 acquires instruction input information by receiving an instruction input from the user. For example, the input information acquisition unit 154 receives an instruction input from the user through the input key 15. Then, the information processing apparatus 100 operates based on the received instruction input. Further, the input information acquisition unit 154 acquires image data representing an image of “landscape” or “person” taken based on an instruction input from the user.

  The CPU 11 and the input key 15 and the like operate in cooperation to function as the input information acquisition unit 154.

  The acquisition unit 150 acquires the information data acquired by the face information acquisition unit 151, the voice information acquisition unit 152, the environment information acquisition unit 153, and the input information acquisition unit 154, and stores the information data in the storage unit 120. The acquisition unit 150 acquires arbitrary information data from the user through the input key 15 and the voice sensor 18 and stores the information data in the storage unit 120.

  The CPU 11, the input key 15, the voice sensor 18, the image sensor 19, the NIC 22, the RTC 23, the environment sensor 24, and the like work together to function as the acquisition unit 150.

  In the correspondence table shown in FIG. 5, the specifying unit 160 corresponds to the voice information at least partially matching the voice information represented by the voice represented by the voice data received by the communication unit 130. And specify. First, the specifying unit 160 is stored in the voice information represented by the voice represented by the voice data transmitted from the other information processing apparatus 100 and received by the communication unit 130, and the correspondence table shown in FIG. The voice information is collated, and it is determined whether there is voice information that at least partially matches the voice information transmitted from the other information processing apparatus 100. The identification unit 160 converts the voice represented by the voice data into a character string in order to collate the voice information, and extracts one or more words or documents from the character string. Since the voice information is information indicating one or more words or documents grasped by voice, the extracted one or more words or documents become voice information represented by the voice represented by the voice data. Next, the specifying unit 160 includes voice information represented by one or more words or documents stored in the correspondence table and voice information represented by one or more words or documents transmitted from another information processing apparatus 100. Collate and determine if one or more words match. When one or more words match, the specifying unit 160 specifies the boundary condition and the face condition corresponding to the matched voice information stored in the correspondence table.

Here, the face condition refers to a condition for determining whether to present a voice by collating a user based on face information representing the user's face.
In addition, the environmental condition is to determine whether or not to present a voice by comparing date information, time information, temperature information, humidity information, atmospheric pressure information, weather information, or the like included in the environmental information. Say conditions. The environmental conditions include at least one of a date condition related to date, a time condition related to time, a temperature condition related to temperature, a humidity condition related to humidity, a pressure condition related to atmospheric pressure, or a weather condition related to weather, and these conditions. If any of the above is satisfied, it is determined that the environmental condition is satisfied. The date condition, time condition, temperature condition, humidity condition, atmospheric pressure condition, or weather condition refers to a condition for determining in the related date, time, temperature, humidity, atmospheric pressure, or weather, respectively.

  The identifying unit 160 performs a phonetic character conversion process to collate the voice information. For the phonetic character conversion process, for example, a technique described in JP 2009-294269 A is used. Specifically, the specifying unit 160 generates a phonetic symbol based on speech data to be converted and information in which phonemes and phonetic symbols are associated with each other. Next, the specifying unit 160 acquires a word corresponding to the phonetic symbol based on the generated phonetic symbol and a word dictionary in which a character representing the word and the phonetic symbol are associated with each other in advance. And the specific | specification part 160 performs a phonetic character conversion process by producing | generating the character data showing a character based on the said acquired word.

  The CPU 11, the RAM 12, etc. operate in cooperation to function as the specifying unit 160.

  The determining unit 170 determines whether the face information acquired by the face information acquiring unit 151 satisfies the face condition specified by the specifying unit 160 and whether the environment information acquired by the environment information acquiring unit 153 is the specifying unit. It is determined whether the environmental condition specified by 160 is satisfied. When the determination unit 170 determines that the two conditions of the face condition and the environmental condition are satisfied at the same time, the voice transmitted from the other information processing apparatus 100 is presented to the user. On the other hand, if the determination unit 170 determines that only one of the face condition and the environmental condition is satisfied, or if it determines that neither condition is satisfied, the sound transmitted from the other information processing apparatus 100 Is not presented to the user.

  The CPU 11, the RAM 12, and the like operate in cooperation to function as the determination unit 170.

  Next, user face information registration processing executed by the information processing apparatus 100 according to the present embodiment will be described. FIG. 6 is a flowchart showing the flow of registration processing. Hereinafter, a description will be given with reference to FIG.

  First, the input information acquisition unit 154 acquires arbitrary information for specifying a user by receiving an input from the user (step S101). For example, the input information acquisition unit 154 acquires a user name, a mail address of the user, a MAC (Media Access Control address) address of the information processing apparatus 100 in which the user is registered, and the like input by the user.

  Next, the face information acquisition unit 151 acquires face information data representing the face of the user who operates the information processing apparatus 100 (step S102). For example, the face information acquisition unit 151 receives an instruction from the user, acquires image data showing the user based on the instruction, and detects a face area from the image data. Then, the face information acquisition unit 151 acquires face information represented by face information data representing the face area.

  Next, the storage unit 120 stores the user name and the user's email address acquired by the input information acquisition unit 154 and the face image represented by the face information acquired by the face information acquisition unit 151 in association with each other. Registration as user information (step S103).

  FIG. 7 is a diagram illustrating an example of registered information. As shown in the figure, the user name, the face image represented by the face information data of the user, the mail address of the user, the MAC (Media Access Control address) address of the information processing apparatus 100 in which the user is registered, etc. It is added and registered as user information. Here, the user information refers to arbitrary information that can specify the user, such as an email address and face information.

  Through the above processing, user information for identifying a user who operates the information processing apparatus 100 can be registered in the information processing apparatus 100.

  Next, processing of another information processing apparatus executed by the information processing apparatus 100 according to the present embodiment will be described. FIG. 8 is a flowchart showing the flow of processing of the other information processing apparatus. Hereinafter, a description will be given with reference to FIG.

  In the following description, the reference numeral of the other information processing apparatus is 100a, and the reference information processing apparatus is 100b. The other information processing apparatus 100 a and the own information processing apparatus 100 b have the same functions as the information processing apparatus 100. The other information processing apparatus 100a and the own information processing apparatus 100b are connected to each other via a communication circuit network, and arbitrary information data can be exchanged between the other information processing apparatus 100a and the own information processing apparatus 100b. Done. Moreover, although the number of the other information processing apparatuses 100a and the own information processing apparatus 100b is arbitrary, for ease of explanation, the number of the other information processing apparatuses 100a and the own information processing apparatus 100b will be described as one.

  First, the face information acquisition unit 151 included in the other information processing apparatus 100a acquires face information data representing the face of the user in front of the other information processing apparatus 100a (step S201), and the face represented by the acquired face information data It is determined whether information is registered (step S202).

  When the face information represented by the acquired face information data is not registered (step S202; No), this process ends, assuming that the user does not have authority to operate the other information processing apparatus 100a. In addition, after this process is complete | finished, the face information showing a user's face can also be registered by performing the registration process mentioned above.

  On the other hand, when the face information represented by the acquired face information data is registered (step S202; Yes), the voice information acquisition unit 152 passes, for example, “Good morning” or “Rain” issued by the user through the voice sensor 18. The voice data representing the voice “Ne” is acquired (step S203).

  Next, the input information acquisition unit 154 receives the MAC address of the information processing apparatus input by the user through the input key 15 and the mail address of the user who operates the information processing apparatus, thereby indicating the transmission destination of the audio data. Information is acquired (step S204). Here, it is assumed that self-information processing apparatus 100b is designated as the transmission destination of the audio data.

  Next, the communication unit 130 transmits the audio data acquired by the audio information acquisition unit 152 to the own information processing apparatus 100b connected to a communication circuit network such as the Internet specified by the user as a transmission destination (step S205). ).

  Note that the communication unit 130 sends audio data to an arbitrary information processing apparatus 100 such as the information processing apparatus 100 in which the MAC address is registered or all the information processing apparatuses 100 connected to the communication circuit network. It can also be sent. FIG. 9 is a diagram illustrating an example of presentation of user information presented to the other information processing apparatus 100a. For example, when user information representing the user B is registered in the other information processing apparatus 100b, and a face image representing the user B and an image representing the mail address are displayed on the screen as shown in FIG. The unit 130 can also transmit the audio data to the information processing apparatus including the displayed user's mail address or the MAC address registered in association with the user.

  Next, the communication unit 130 determines whether there is audio data returned from the information processing apparatus 100b (step S206).

  When there is voice data returned from the information processing apparatus 100b (step S206; Yes), the presentation unit 140 presents the returned voice to the user (step S207).

  For example, when voice data representing the voice “good morning” uttered by the user B in front of the information processing apparatus 100b is returned from the information processing apparatus 100b to the other information processing apparatus 100a, the other information processing apparatus 100a The provided presentation unit 140 reproduces voice data representing the voice “Good morning” and presents the voice indicated by the voice data to the user. The presentation unit 140 can also display an image representing the user B who operates the information processing apparatus 100b that has transmitted the audio data.

  On the other hand, when there is no voice data returned from the information processing apparatus 100b (step S206; No), this process ends. Since there is no voice data returned from the information processing apparatus 100b, the presentation unit 140 continues to present the currently presented information.

  Through the above processing, voice data can be transmitted to registered users. Further, when there is a reply from a registered user, it is possible to present the voice indicated by the voice data returned by the user.

  Next, the process of the information processing apparatus executed by the information processing apparatus 100 according to the present embodiment will be described. FIG. 10 is a flowchart showing a flow of processing of the information processing apparatus 100b. Hereinafter, a description will be given with reference to FIG. In addition, when the presentation unit 140 included in the information processing apparatus 100b presents an image to the user in advance, the information processing apparatus 100b functions as the digital photo stand 10 on which a digital photograph or the like is displayed.

  First, the communication unit 130 included in the information processing apparatus 100b determines whether audio data is transmitted from the other information processing apparatus 100a (step S301).

  When the audio data is not transmitted (step S301; No), the communication unit 130 waits until the audio data is transmitted from the other information processing apparatus 100a, and determines again whether or not the audio data is transmitted ( Step S301). Since there is no sound to be presented to the user, the presentation unit 140 continues to present the image presented in advance to the user.

  On the other hand, when audio data is transmitted (step S301; Yes), the face information acquisition unit 151 and the environment information acquisition unit 153 include face information data representing the face of the user in front of the information processing apparatus 100b, and Environmental information data is acquired (step S302). The face information acquisition unit 151 acquires image data and acquires face information data representing the user's face by detecting the user's face area from the image data. In addition, the environment information acquisition unit 153 acquires arbitrary environment information data such as a room temperature and a room humidity in which the information processing apparatus 100b is installed, a date, weather, an outside temperature, and the like.

  Next, the specifying unit 160 collates the voice information represented by the voice represented by the transmitted voice data with the voice information stored in the correspondence table shown in FIG. It is determined whether there is audio information that matches (step S303). For example, when the transmitted voice data represents the voice “Good morning”, the specifying unit 160 stores the voice information that matches the voice information represented by the voice “Good morning” in the correspondence table shown in FIG. It is determined whether or not. In the correspondence table shown in FIG. 5, since the voice information represented by the voice “Good morning” is stored, the specifying unit 160 stores voice information that matches the transmitted voice information in the correspondence table. Is determined. On the other hand, when the transmitted voice data is a voice “I will do my best”, the voice information indicating the voice “I will do my best” is not stored in the correspondence table shown in FIG. It is determined that voice information that matches the voice information is not stored in the correspondence table.

  When the voice information that matches the transmitted voice information is stored in the correspondence table (step S303; Yes), the specifying unit 160 specifies the face condition and the environmental condition corresponding to the matching voice information (step S303). S304). For example, when the matching voice information is “good morning”, the face condition and the environmental condition corresponding to the “good morning” are “there is a user registered in front of the information processing apparatus”, as shown in FIG. , “The time is between 6:00 and 10:00”. Here, the registered user refers to a user whose information for specifying the user is stored in the storage unit 120, and is typically referred to as a user registered by a face information registration process.

  On the other hand, when the voice information that matches the transmitted voice information is not stored in the correspondence table (step S303; No), this process ends. And the presentation part 140 continues presentation of the image currently shown previously.

  In step S303, typically, a phonetic character conversion process is performed in which voice data is converted into character data representing characters.

  For example, in the case where the voice data is voice information representing the voice “Mr. B, it's raining today”, voice character conversion processing is performed, and character data representing the character “Mr. B, it's raining today” Converted. Then, it is determined whether or not the character information represented by the converted character data is stored in the correspondence table shown in FIG. In this case, since the converted character information “Mr. B, it's raining today” is stored in the correspondence table, “Yes” is returned in step S303. In step S304, the face condition corresponding to “Mr. B, it's raining today” is “Mr. B is in front of the information processing apparatus” and the environmental condition is “weather is rainy”. Identified.

  In step S304, the specifying unit 160 extracts information representing a person's name, date / time, weather, temperature, and the like from the character information represented by the character data converted from the voice data, and the extracted information is shown in FIG. It can also be determined whether it is stored in the correspondence table. For example, when the character information converted from the voice information represents a character that is not stored in the correspondence table “Oh, it's raining, Mr. B”, the identifying unit 160 changes the character information to the correspondence table. The stored characters “rain” and “Mr. B” are extracted. Then, the specifying unit 160 determines whether or not character information including both the characters “rain” and “Mr. B” is stored in the correspondence table. Here, the characters “Mr. B, it's raining today” stored in the correspondence table include both the characters “Rain” and “Mr. B”. Since the extracted character is collated with “Mr. B, it's raining today” stored in the correspondence table, the determination unit 160 does not store the correspondence table “Oh, it's raining, B It can be determined that even the characters "" are stored in the correspondence table. Thereby, it is also possible to determine whether or not speech information (character information converted from speech information) that is not stored in the correspondence table shown in FIG. 5 is stored in the correspondence table.

  Next, the determination unit 170 determines whether the face information acquired by the face information acquisition unit 151 and the environment information acquired by the environment information acquisition unit 153 satisfy the specified face condition and environment condition. (Step S305). For example, when the identified face condition and environmental condition are “there is a user registered on the front face of the information processing apparatus” and “the time is between 6 o'clock and 10 o'clock”, the determination unit 170 determines the face It is determined whether the user detected from the face information acquired by the information acquisition unit 151 is a registered user as shown in FIG. 7, and is included in the environment information acquired by the environment information acquisition unit 153 It is determined whether the current time is between 6 and 10 o'clock.

  Next, when the acquired face information and environment information satisfy the specified face condition and environment condition (step S305; Yes), the presentation unit 140 presents the voice indicated by the voice data to the user (step S305). S306). FIG. 11 is a diagram illustrating an example in which the voice represented by the voice data is presented in the information processing apparatus 100b. As shown in FIG. 5, the face condition and the environmental condition corresponding to the voice information represented by the voice “good morning” are “there is a user registered in front of the information processing apparatus” and “the time is from 6:00 to 10”. It's time. " As shown in FIG. 11, when the acquired current time is “9:30”, the current time is between 6:00 and 10:00, so the environmental condition is satisfied. When the acquired face information is “user B”, as shown in FIG. 7, since user B has been registered as a user, the face condition is satisfied. Since the two conditions of the face condition and the environmental condition are satisfied at the same time, the user A who operates the other information processing apparatus 100a utters a voice “Good morning” and is transmitted from the other information processing apparatus 100a to the own information processing apparatus 100b. “Good morning” is presented to user B. The presentation unit 140 can also present image information representing the user A who operates the other information processing apparatus 100a to which the voice “Good morning” is transmitted.

  When the face condition and the environmental condition corresponding to the voice information representing the voice “Mr. B, today is raining” are specified, the determination unit 170 is acquired by the environment information acquisition unit 153 in step S305. Whether the current weather information included in the environment information is “rain” and whether the user detected from the face information acquired by the face information acquisition unit 151 is “Mr. B”. Check. If the current weather information included in the environment information is “rain” and the user detected from the acquired face information matches “Mr. B”, the answer is Yes in step S305. When the voice information includes personal name information representing the name of “Mr. B”, the voice information is desired information for Mr. B. On the other hand, for Mr. C other than Mr. B, the voice information is It is not the desired information. Before the voice information is presented to the user, it is determined whether or not the voice information is desired by the user, and it is determined whether or not the voice is presented based on the determination result.

  In addition, when the face condition and the environmental condition corresponding to the voice information representing the voice “Today is ○ month × day” are specified, the determination unit 170 acquires the environment information acquisition unit 153 in step S305. The current date information included in the environmental information is “○ month × day” and the user detected from the face information acquired by the face information acquisition unit 151 is “registered Check if it is a “user”. When the current date information included in the environment information is “○ month × day” and the user detected from the acquired face information matches “registered user”, Yes in step S305. It becomes.

  In addition, when the face condition and the environmental condition corresponding to the voice information representing the voice “It is hot” are specified, the determination unit 170 is included in the environmental information acquired by the environmental information acquisition unit 153 in step S305. It is confirmed whether the current temperature information is “30 degrees or more” and whether the user detected from the face information acquired by the face information acquisition unit 151 is “registered user”. . If the current temperature information included in the environment information is “30 degrees or more” and the user detected from the acquired face information matches “registered user”, “Yes” in step S305 Become.

  When the face condition and the environmental condition corresponding to the voice information representing the voice “Mr. C, today is hot” are specified, the determination unit 170 is acquired by the environmental information acquisition unit 153 in step S305. Check whether the current temperature information included in the environment information is “30 degrees or more” and whether the user detected from the face information acquired by the face information acquisition unit 151 is “Mr. C” Confirm. If the current temperature information included in the environmental information is “30 degrees or more” and the user detected from the acquired face information matches “Mr. C”, “Yes” is set in step S305.

  When the face condition and the environmental condition corresponding to the voice information representing the voice “sultry” is specified, the determination unit 170 is included in the environmental information acquired by the environmental information acquisition unit 153 in step S305. It is confirmed whether the current humidity information is “70% or more” and whether the user detected from the face information acquired by the face information acquisition unit 151 is “registered user”. . If the current temperature information included in the environmental information is “70% or more” and the user detected from the acquired face information matches “registered user”, Yes in step S305 Become.

  When the face condition and the environmental condition corresponding to the sound information representing the sound “Typhoon is coming” are specified, the determination unit 170 determines the environment acquired by the environment information acquisition unit 153 in step S305. Check whether the current barometric pressure information included in the information is “980 hPa or less”, and whether the user detected from the face information acquired by the face information acquisition unit 151 is “registered user” Confirm. If the current temperature information included in the environmental information is “980 hPa or less” and the user detected from the acquired face information matches “registered user”, the result is Yes in step S305. .

  Date conditions related to date, time conditions related to time, temperature conditions related to temperature information, humidity conditions related to humidity, atmospheric pressure conditions related to atmospheric pressure, or environmental conditions including weather conditions related to weather are determined. Audio can be presented to the user in humidity, atmospheric pressure, and weather.

  On the other hand, when the acquired face information and environment information do not satisfy the specified face condition and environment condition (step S305; No), the face information acquisition unit 151 and the environment information acquisition unit 153 wait for a predetermined time, Similar to the process of S302, the face information data representing the face of the user in front of the information processing apparatus 100b and the environment information data are acquired again (step S309), and the determination unit 170 determines the specified environmental condition, Then, it is determined again whether or not the specified face condition is satisfied (step S305). The determination is continued until the environmental condition and the facial condition are satisfied, and when the environmental condition and the facial condition are satisfied, the voice represented by the voice data transmitted from the other information processing apparatus 100a is presented to the user. For this reason, when two conditions are satisfied, the voice is immediately presented to the user. This makes it possible to present a voice to the user at just the right time. Further, it is possible to prevent the voice from being presented.

12A to 12C are diagrams illustrating an example in which the voice represented by the voice data is not presented in the information processing apparatus 100b.
FIG. 12A is a diagram illustrating an example in which no sound is presented because the environmental condition is satisfied but the face condition is not satisfied. As shown in FIG. 5, the face condition and the environmental condition corresponding to the voice information representing the voice “good morning” are “there is a user registered in front of the information processing apparatus” and “the time is from 6:00 to 10”. It's time. " As shown in FIG. 12A, when the acquired current time is “9:30”, the current time is between 6:00 and 10:00, so the environmental condition is satisfied. However, when the acquired face information is “user C”, as shown in FIG. 7, the user C is not registered as a user, and thus the face condition is not satisfied. For this reason, the voice “good morning” transmitted from the other information processing apparatus 100a is not presented to the user.

  FIG. 12B is a diagram illustrating an example in which no voice is presented because the face condition is satisfied but the environmental condition is not satisfied. As shown in FIG. 7, when the acquired face information is “user B”, as shown in FIG. 7, since user B has been registered as a user, the face condition is satisfied. However, when the acquired current time is “15:00”, the current time is a time other than 6 o'clock to 10 o'clock, so the environmental condition is not satisfied. For this reason, the voice “good morning” transmitted from the other information processing apparatus 100a is not presented to the user.

  FIG. 12C is a diagram illustrating an example in which no voice is presented because the face condition and the environmental condition are not satisfied. As shown in the figure, when the acquired face information is “user C”, as shown in FIG. 7, the user C is not registered as a user, and thus the face condition is not satisfied. When the acquired current time is “15:00”, the current time is a time other than 6 o'clock to 10 o'clock, so the environmental condition is not satisfied. For this reason, the voice “good morning” transmitted from the other information processing apparatus 100a is not presented to the user.

  “Good morning” is a language that expresses greetings, and is generally used between 6 and 10 o'clock. For this reason, when the voice “Good morning” is presented at a time between 6 o'clock and 10 o'clock, it becomes information desired by the user. On the other hand, at times other than the time, the language “good morning” is not generally used, and thus is not information desired by the user. Before the audio information is presented to the user, it is determined whether or not the environmental condition and the face condition are satisfied, that is, whether or not the audio information is desired by the user, and the audio is determined based on the determination result. It is determined whether or not is presented. Therefore, information desired by the user can be presented.

  In addition, since it is considered that a user who has not been registered does not desire the voice transmitted from the other information processing apparatus 100a, the user is presented only by presenting the voice to the user who has been registered. Can present desired information.

  Next, the acquisition unit 150 acquires arbitrary information data from the user who has been registered (step S307). The acquisition unit 150 typically acquires the audio data acquired by the audio information acquisition unit 153. For example, when the audio information representing the voice “Good morning” is transmitted from the other information processing apparatus 100a and the voice represented by the voice data is reproduced in the own information processing apparatus 100b, the audio information acquisition unit 152 reproduces the reproduced “ The voice data represented by the voice “Good morning” or “I am fine” in response to the voice “Good morning” is acquired from the user B.

  Next, the communication unit 130 transmits the audio data acquired by the audio information acquisition unit 153 to the other information processing apparatus 100a (step S308), and this process ends.

Before the sound is presented to the user, it is determined whether the sound information satisfies the environmental condition and the face condition. If the condition is not satisfied, no voice is presented to the user. On the other hand, when the condition is satisfied, a voice is presented to the user. Therefore, information desired by the user can be presented.
With the above processing, voice is presented to the user when the environmental condition and the face condition are satisfied. Therefore, information desired by the user can be presented.

  In addition, this invention is not limited to said embodiment, A various deformation | transformation and application are possible.

  The server apparatus 30 can also perform the above-described processing executed by the information processing apparatus 100 (the other information processing apparatus 100a and the own information processing apparatus 100b). For example, the communication unit 130 included in the information processing apparatus 100 transmits the user information registered in the registration process, the acquired environment information data, the correspondence table, and the like to the server apparatus 30, thereby storing the data in the server apparatus 30. Let Then, based on the data stored in the server device 30, the server device 30 transmits audio from the other information processing device 100 a to the own information processing device 100 b and from the own information processing device 100 b to the other information processing device 100 a. Data can also be sent and received.

  For example, the server device 30 receives voice data, face information data, and environment information data acquired by the other information processing device 100a and the own information processing device 100b, and stores the data. The server device 30 determines whether or not the received audio data satisfies the condition based on the correspondence table shown in FIG. When the condition is satisfied, the server device 30 can also transmit and receive audio data from the other information processing device 100a to the own information processing device 100b and from the own information processing device 100b to the other information processing device 100a. . Thereby, information desired by the user can be presented.

  The above-described hardware configuration and flowchart are examples, and can be arbitrarily changed and modified.

  A central part that performs processing of the information processing apparatus 100 including the control unit 110, the storage unit 120, the communication unit 130, the presentation unit 140, the acquisition unit 150, the identification unit 160, the determination unit 170, etc. Regardless, it can be realized using a normal computer system. For example, a computer program for executing the above operation is stored in a computer-readable recording medium (flexible disk, CD-ROM, DVD-ROM, etc.) and distributed, and the computer program is installed in the computer. Thus, the information processing apparatus 100 that executes the above-described processing may be configured. Further, the information processing apparatus 100 may be configured by storing the computer program in a storage device included in a server device on a communication circuit network such as the Internet and downloading the computer program from a normal computer system.

  Further, when the functions of the information processing apparatus 100 are realized by sharing an OS (operating system) and an application program, or by cooperation between the OS and the application program, only the application program part is stored in a recording medium or a storage device. May be.

  It is also possible to superimpose a computer program on a carrier wave and distribute it via a communication network. For example, the computer program may be posted on a bulletin board (BBS) on a communication network, and the computer program may be distributed via the network. The computer program may be started and executed in the same manner as other application programs under the control of the OS, so that the above-described processing may be executed.

  As described above, according to the present invention, an information processing apparatus and a program suitable for presenting information desired by a user can be provided.

  DESCRIPTION OF SYMBOLS 10 ... Digital photo stand, 11 ... CPU, 12 ... RAM, 13 ... Storage device, 14 ... Media controller, 14a ... Memory card insertion slot, 15 ... Input key, 16 ... Drive circuit, 17 ... Display panel, 18 ... Audio sensor , 19 ... Image sensor, 20 ... Memory card, 21 ... Speaker, 22 ... NIC, 23 ... RTC, 24 ... Environmental sensor, 30 ... Server device, 100 ... Information processing device, 110 ... Control unit, 120 ... Storage unit, 130 ... Communication part 140 ... Presentation part 150 ... Acquisition part 151 ... Face information acquisition part 152 ... Voice information acquisition part 153 ... Environment information acquisition part 154 ... Input information acquisition part 160 ... Identification part 170 ... Determination Part

Claims (4)

An information processing apparatus,
A face information acquisition unit that acquires face information data indicating the face information of the user of the information processing apparatus;
An environment information acquisition unit that acquires environment information data indicating environment information of the information processing apparatus;
A communication unit that receives voice data representing voice uttered by a user of the other information processing apparatus from another information processing apparatus other than the information processing apparatus;
The received voice data is obtained by referring to a correspondence table in which a plurality of voice information, environmental conditions that are conditions related to the environmental information, and face conditions that are conditions related to the user's face information are stored in association with each other. A specifying unit that specifies the environmental condition and the face condition corresponding to the voice information stored in the correspondence table at least partially matching the voice information represented by the voice represented by:
Determination that determines whether the environmental information indicated by the acquired environmental information data satisfies the specified environmental condition and the facial information indicated by the acquired face information data satisfies the specified facial condition And
A presentation unit that presents a voice represented by the received voice data to a user of the information processing apparatus according to a determination result of the determination unit;
An information processing apparatus comprising: The presenting unit waits until the specified environmental condition and the specified facial condition are satisfied, and presents the voice represented by the received audio data when the facial condition and the environmental condition are satisfied To
The information processing apparatus according to claim 1. The environmental information includes at least one of date information, time information, temperature information, humidity information, atmospheric pressure information, or weather information,
The environmental condition includes at least one of a date condition related to date, a time condition related to time, a temperature condition related to temperature information, a humidity condition related to humidity, an atmospheric pressure condition related to atmospheric pressure, or a weather condition related to weather,
The determination unit acquires whether the date information acquired by the environment information acquisition unit satisfies the date condition, or whether the time information acquired by the environment information acquisition unit satisfies the time condition, or is acquired by the environment information acquisition unit Whether the temperature information is satisfied with the temperature condition, the humidity information acquired by the environmental information acquisition unit satisfies the humidity condition, or the atmospheric pressure information acquired by the environmental information acquisition unit satisfies the atmospheric pressure condition, Or, it is determined whether the weather information acquired by the environmental information acquisition unit satisfies the weather condition, the determined date condition, the determined time condition, the determined temperature condition, the determined humidity condition, When either the determined atmospheric pressure condition or the determined weather condition is satisfied, the environmental condition is determined to be satisfied.
The information processing apparatus according to claim 1 or 2. A program that causes a computer to function as an information processing device,
A face information acquisition unit for acquiring face information data indicating the face information of the user of the computer;
An environmental information acquisition unit that acquires environmental information data indicating environmental information of the computer;
A communication unit that receives voice data representing a voice uttered by a user of the other computer from a computer other than the computer;
The received voice data is obtained by referring to a correspondence table in which a plurality of voice information, environmental conditions that are conditions related to the environmental information, and face conditions that are conditions related to the user's face information are stored in association with each other. A specifying unit that specifies the environmental condition and the face condition corresponding to the voice information stored in the correspondence table at least partially matching the voice information represented by the voice represented by:
Determination that determines whether the environmental information indicated by the acquired environmental information data satisfies the specified environmental condition and the facial information indicated by the acquired face information data satisfies the specified facial condition And
A presentation unit that presents a voice represented by the received voice data to a user of the computer according to a determination result of the determination unit;
A program characterized by making it function.

Images