JP2018195101A - Information providing method and information providing device - Google Patents

Abstract

To provide information corresponding to a photographed image of a user of a device to the user of the device.SOLUTION: The information providing device 200 includes a determining unit 51 for determining whether or not a photographed image P photographed by an imaging unit 11 provided in a portable device 100 includes an image of a user of the device 100 and a specific image, and a providing unit 55 for providing the user with information T corresponding to the photographed image P when the determining unit 51 determines that the image of the user and the specific image are included in the photographed image P.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for providing information to a user of a portable device.

  Conventionally, a technique for providing information related to a subject photographed by a portable device has been proposed. For example, Patent Document 1 discloses a configuration that provides information according to a person image taken by a user using a device.

JP 2009-171176 A

  In the technique of Patent Document 1, if a person of a photographed person image is a person registered in the built-in memory, information corresponding to the person is provided. However, there is a desire to provide the user with information about the user of the device that captures the person image. In view of the above circumstances, an object of the present invention is to provide a user of a device with information corresponding to an image obtained by photographing the user with the device.

  In order to solve the above-described problems, an information providing method according to a preferred aspect of the present invention includes an image of a user of the device and a specific image captured by an imaging unit provided in a portable device. A determination step for determining whether or not an image is included, and a determination in accordance with the captured image when it is determined in the determination step that the user image and the specific image are included in the captured image. Providing the information to the user.

  The information providing apparatus according to a preferred aspect of the present invention determines whether a captured image captured by an imaging unit provided in a portable device includes an image of a user of the device and a specific image. A determining unit that determines, and a providing unit that provides information to the user according to the captured image when the determining unit determines that the user's image and the specific image are included in the captured image It comprises.

It is a block diagram of the information provision system which concerns on embodiment of this invention. It is explanatory drawing of the condition of the user which concerns on embodiment of this invention. It is explanatory drawing of the picked-up image which concerns on embodiment of this invention. It is a flowchart of the process which the control part of the information provision apparatus which concerns on embodiment of this invention performs.

  FIG. 1 is a configuration diagram of an information providing system 1 according to an embodiment of the present invention. The information providing system 1 is a computer system for providing information to a user U of a portable device (hereinafter referred to as “portable device”) 100. Specifically, the information providing system 1 provides the user U with information (hereinafter referred to as “provided information”) T corresponding to an image (hereinafter referred to as “captured image”) P captured by the portable device 100. As illustrated in FIG. 1, the information providing system 1 includes a portable device 100 and an information providing device 200. The portable device 100 and the information providing apparatus 200 can communicate with each other via a communication network 70 such as a mobile communication network or the Internet. In this embodiment, as illustrated in FIG. 2, a user U in front of the mirror M is assumed so that his / her appearance is reflected.

  The portable device 100 of the present embodiment is an information terminal that can be worn by the user U. As illustrated in FIG. 2, for example, a glasses-type information terminal can be suitably used as the portable device 100. Specifically, the portable device 100 includes an imaging unit 11, a communication unit 13, a sound emitting unit 15, and a mounting unit 17 as illustrated in FIG.

  The imaging unit 11 is configured to include, for example, an imaging element and a lens that can capture an image, and captures a captured image P according to an instruction from the user U. The communication unit 13 is a communication device that communicates with the information providing apparatus 200 via the communication network 70. The communication between the communication unit 13 and the communication network 70 is preferably wireless, but can be wired. Specifically, the communication unit 13 transmits the captured image P captured by the imaging unit 11 to the information providing apparatus 200 and receives the provision information T corresponding to the captured image P from the information providing apparatus 200. The sound emitting unit 15 reproduces a sound corresponding to the provided information T transmitted from the information providing apparatus 200. As illustrated in FIG. 2, an earphone (an inner ear type, a canal type, or an overhead type) worn on the ear of the user U is preferably used as the sound emitting unit 15.

  The mounting unit 17 in FIG. 1 is an instrument that can be mounted on the body (in the embodiment, the head) of the user U. For example, glasses are preferably used as the mounting portion 17. The imaging unit 11, the communication unit 13, and the sound emitting unit 15 are installed in the mounting unit 17. As illustrated in FIG. 2, the imaging unit 11 can be mounted on the upper part of the front (front frame) of the mounting unit 17 so that the optical axis of the lens faces the front of the user U. That is, the imaging unit 11 can capture the captured image P including the viewpoint of the user U. The mounting position of the imaging unit 11 with respect to the mounting unit 17 is arbitrary. For example, the imaging unit 11 can be mounted on a temple of the mounting unit 17. The communication unit 13 is mounted at an arbitrary location on the mounting unit 17. The sound emitting unit 15 is installed at the end of the cord extending from the mounting unit 17. As illustrated in FIG. 2, the user U can wear the portable device 100 by putting the wearing unit 17 on his / her ear.

  It is assumed that the user U who is in front of the mirror M with the portable device 100 attached is looking at his / her own appearance in the mirror M (that is, the user U's viewpoint is in the mirror M). Therefore, the captured image P captured by the capturing unit may include an image of the user U reflected in the mirror M as illustrated in FIG. The captured image P captured by the imaging unit is transmitted to the information providing apparatus 200 by the communication unit 13.

  As shown in FIG. 1, the information providing apparatus 200 of FIG. 1 includes a communication unit 21, a storage unit 23, and a control unit 25, and provides provided information T corresponding to the captured image P to the user U. For example, a web server that can communicate with the portable device 100 via the communication network 70 can be suitably employed as the information providing apparatus 200. Note that the information providing apparatus 200 is realized as a single apparatus, and is also realized as a set of a plurality of apparatuses configured separately from each other. The communication unit 21 is a communication device that communicates with the portable device 100 via the communication network 70. The communication unit 21 of the present embodiment receives the captured image P transmitted from the portable device 100 and transmits the provision information T corresponding to the captured image P to the portable device 100 according to an instruction from the control unit 25.

  The storage unit 23 stores programs executed by the control unit 25 and various data used by the control unit 25. For example, a known recording medium such as a semiconductor recording medium or a magnetic recording medium can be adopted as the storage unit 23. Specifically, the storage unit 23 stores a reference image A, a reference image B, and a state table. The reference image A is an image of the face of the user U (hereinafter referred to as “face image”). The reference image B is an image of the portable device 100. The reference image A and the reference image B are captured in advance and stored in the storage unit 23.

  As illustrated in FIG. 1, the state table is a data table in which information indicating the state of the subject of the captured image P (hereinafter referred to as “state information”) and provision information T are registered in association with each other. The state information of the present embodiment indicates the state of the user U. In the present embodiment, the facial expression of the user U (for example, emotions such as “joy”, “anger” or “sadness”) is exemplified as the state of the user U. The provision information T of the present embodiment is a sound signal that represents a voice that is a sound of a character string corresponding to the state information (for example, an impression related to the state indicated by the state information). For example, in association with the state information “joy”, provision information T indicating a sound signal representing a voice uttering the character string “cute” is registered in the state table.

  The control unit 25 is configured by an arithmetic processing circuit such as a CPU (Central Processing Unit), for example, and comprehensively controls each element of the information providing apparatus 200. Specifically, the control unit 25 executes a program stored in the storage unit 23 to thereby provide a plurality of functions (determination units 51, 51) for providing the user U with the provided information T corresponding to the captured image P. The specifying unit 53 and the providing unit 55) are realized. A configuration in which a part of the function of the control unit 25 is realized by a dedicated electronic circuit, or a configuration in which the function of the control unit 25 is distributed to a plurality of devices may be employed.

  The determination unit 51 determines whether the captured image P received by the communication unit 21 includes an image of the user U of the portable device 100 and a specific image. In the present embodiment, the face image of the user U is illustrated as an image of the user U, and the image of the portable device 100 is illustrated as a specific image. That is, it is determined whether or not the captured image P includes both the face image and the portable device 100 image. For determining whether or not the face image of the user U is included in the captured image P (that is, identity recognition), a known image analysis technique using the reference image A stored in the storage unit 23 is arbitrarily employed. . For example, when the feature amount of the face image detected by the face detection process from the photographed image P approximates the feature amount of the user U face image included in the reference image A, the face image of the user U is approximated to the photographed image P. Is determined to be included. If the face image cannot be detected from the captured image P, or if the feature amount of the face image detected from the captured image P deviates from the feature amount of the face image of the reference image A, the user U is included in the captured image P. It is determined that no face image is included. That is, the reference image A is an image that is compared with the captured image P in order to determine whether or not the captured image P includes the image of the user U. For determining whether or not the image of the portable device 100 is included in the captured image P, a known image analysis technique using the reference image B stored in the storage unit 23 is arbitrarily employed. That is, the reference image B is an image that is compared with the captured image P in order to determine whether the captured image P includes the image of the portable device 100.

  The specifying unit 53 specifies the state of the user U from the captured image P. Specifically, the identifying unit 53 generates state information indicating the state of the user U by analyzing the captured image P. The specifying unit 53 of the present embodiment specifies the facial expression of the user U (specifically, facial expression) from the captured image P as the state of the user U. For example, emotions such as “joy”, “anger” or “sadness” can be specified as the facial expression of the user U. For the process of specifying the facial expression of the user U from the captured image P, a known facial expression recognition technique can be employed. For example, a facial expression having a feature quantity that most closely approximates the feature quantity of the face image included in the photographed image P among the feature quantities prepared in advance for each of a plurality of facial expressions is specified. For example, when the state of the user U is identified as “joy” from the captured image P, the identifying unit 53 generates state information indicating “joy”. Note that the facial image of the reference image A and the facial image detected from the captured image P are compared to specify the facial expression of the user U, or the user U's smile level is calculated to calculate the user U's smile level. It is also possible to specify the facial expression.

  The providing unit 55 provides providing information T corresponding to the captured image P to the user U. The providing unit 55 of the present embodiment provides the providing information T corresponding to the captured image P when the determining unit 51 determines that the face image of the user U and the image of the portable device 100 are included. To provide. In the present embodiment, information corresponding to the state (that is, state information) of the user U specified by the specifying unit 53 is exemplified as the provision information T. Specifically, the providing unit 55 identifies the provision information T corresponding to the state information generated by the identifying unit 53 from the state table, and sends the identified provision information T to the portable device 100 to the communication unit 21. Instruct. For example, in the case of the state information “joy” generated by the specifying unit 53, a sound signal indicating a voice uttering the character string “cute” is specified as the provision information T. The communication unit 21 transmits the provision information T specified by the provision unit 55 to the portable device 100.

  The communication unit 13 of the portable device 100 supplies the provided information T received from the information providing apparatus 200 to the sound emitting unit 15. The sound emitting unit 15 emits the sound represented by the sound signal indicated by the provision information T supplied from the communication unit 13. Note that the sound signal can be supplied from the communication unit 13 to the sound emitting unit 15 by wireless communication. As understood from the above description, when the user U wearing the portable device 100 is in front of the mirror M with a joyful expression, the voice “cute sound” is provided to the user U by sound emission.

  FIG. 4 is a flowchart of processing executed by the control unit 25 of the information providing apparatus 200. 4 is executed in response to reception of the captured image P. When the process of FIG. 4 is started, the determination unit 51 determines whether the face image of the user U of the portable device 100 and the image of the portable device 100 are included in the captured image P (S1). . When it is determined that both the face image of the user U and the image of the portable device 100 are included in the captured image P (S1: YES), the specifying unit 53 specifies the state of the user U (S2). . Specifically, the identifying unit 53 generates state information indicating the state of the user U by analyzing the captured image P. The providing unit 55 specifies provided information T corresponding to the captured image P (S3). Specifically, the providing unit 55 identifies the provision information T corresponding to the state information generated by the identifying unit 53 from the state table. The providing unit 55 instructs the communication unit 21 to transmit the specified providing information T to the portable device 100 (S4). The processes in steps S3 and S4 are processes for providing the user U with the provision information T corresponding to the captured image P. If it is determined that one or both of the face image of the user U and the image of the portable device 100 is not included in the captured image P (S1: NO), the processing in FIG. It should be noted that the processing after step S1 and step S2 is unquestioned. That is, regardless of whether or not the captured image P includes the face image of the user U of the portable device 100 and the image of the portable device 100, the state of the user U can be specified.

  As understood from the above description, in the present embodiment, when the captured image P captured by the imaging unit 11 provided in the portable device 100 includes an image of the user U of the portable device 100, the image is captured. Provided information T corresponding to the image P can be provided to the user U. Further, when the captured image P captured by the imaging unit 11 includes the face image of the user U of the portable device 100 and the image of the portable device 100, the provided information T corresponding to the captured image P is used. Provided to person U. Here, for example, in the configuration in which only the presence or absence of the image of the user U in the captured image P is taken into account in the provision of the provision information T (that is, the configuration in which the presence or absence of a specific image in the captured image P is not considered), the user U is specified. Information is provided whether or not On the other hand, in this embodiment, when the captured image P includes an image of the user U and a specific image (an image of the portable device 100 attached to the user U), provision according to the captured image P is provided. Since the information T is provided to the user U, information corresponding to the captured image P is provided when the user U shown in the captured image is assumed to be in a specific situation. In the present embodiment, the specific situation of the user U is a situation where the portable device 100 is attached and the user U is in front of the mirror.

<Modification>
The form illustrated above can be variously modified. Specific modifications that can be applied to the above-described embodiment will be exemplified below. Two or more aspects arbitrarily selected from the following examples can be appropriately combined as long as they do not contradict each other.

(1) In the above-described embodiment, in determining whether the captured image P includes the image of the user U and the specific image, the face image of the user U is exemplified as the user U image, and the specific image Although the image of portable device 100 was illustrated as an image, user U's image and a specific image are not limited to the above illustration. For example, an image of a part of the user U's face (for example, eyes or nose) or an image other than the face of the user U (for example, palm) can be used as the image of the user U. As the specific image, an image other than the image of the user U is suitable. For example, from the viewpoint of providing the provision information T when it is assumed that the user U is wearing the portable device 100 and is in front of the mirror M, for example, an image of a specific mark (for example, ◯ or Δ) Or the structure which makes the image of the edge of a mirror a specific image can also be employ | adopted. By placing a mark on the mirror in advance, it is possible to capture a captured image P including the image of the user U and the image of the mark. Therefore, the provision information T can be provided to the user U only when the user U is in front of the mirror with the mark. In addition, it is also possible to make a mark (for example, a peace sign) using his / her hand so that the user U is reflected in the mirror, and take a photographed image P including the image of the user U and the image of the mark. .

(2) In the above-described embodiment, the facial expression of the user U is exemplified as the state of the user U. However, the type of the state of the user U is arbitrary as long as the information can be specified from the appearance of the user U. For example, the hair style or makeup of the user U can be set to the state of the user U. In the above configuration, the state information indicating the state of the user U is generated by analyzing the makeup (for example, the color component of the face image) or the hairstyle of the face image specified from the captured image P. For example, state information “natural makeup” generated by analysis of makeup of a face image may be generated, and state information “short hair” may be generated by analysis of a hairstyle of the face image. Provision information T corresponding to the state information “natural makeup” or the state information “short hair” is provided to the user U. Alternatively, the user U's clothes (for example, a pattern or a color) can be set to the state of the user U. In the above configuration, by analyzing the clothes of the user U specified from the captured image P, for example, the state information “striped pattern” indicating the state of the user U is generated, and according to the state information “striped pattern” Provision information T is provided to the user U. As understood from the above description, various types of information that can be specified from the appearance of the user U can be adopted as the state of the user U. It is also possible to generate state information by combining two or more pieces of information (for example, hairstyle and makeup) that can be identified from the appearance of the user U.

(3) In the above-described form, the information corresponding to the state (that is, state information) of the user U specified by the specifying unit 53 is provided to the user U as the providing information T. However, the providing information T provided to the user U is provided. Is not limited to information according to the state of the user U. For example, the user U generates state information by analyzing clothes (for example, a pattern or a color) applied to the body in front of the mirror M from the captured image P, or the wall of the space where the user U is located It is also possible to generate state information by analyzing the pattern from the captured image P. That is, the state information generated by the specifying unit 53 is arbitrary as long as it can be specified by analysis of the captured image P. As understood from the above description, the provision information T provided to the user U can be comprehensively expressed as information corresponding to the captured image P. In addition, according to the above-described form in which the information according to the state of the user U is provided information T, it is possible to provide appropriate information for the state of the user U.

(4) In the above-described embodiment, the earphone is exemplified as the sound emitting unit 15 that presents the provision information T to the user U, but the type of the sound emitting unit 15 is not limited to the above examples. For example, a speaker may be employed as the sound emitting unit 15. It is also possible to display the provision information T as a character string on a display unit connected to the communication unit 13. That is, the provision information T is not limited to a sound signal representing voice. For example, the provided information T can be expressed by a character string or an image.

(5) In the above-described embodiment, the configuration in which the provision information T is a sound signal representing the sound of the character string corresponding to the state information, but the sound signal indicated by the provision information T is not limited to the sound. For example, a configuration in which the sound information representing the performance sound of music used as BGM is provided information T is also preferably employed. In the above configuration, for example, the pattern or color of the clothing of the user U is specified from the photographed image P, and a sound signal representing the performance sound of the music corresponding to the specified pattern or color is provided to the user U as the provision information T To do.

(6) In the above-described embodiment, the configuration in which the state information and the provision information T are registered in the state table in a one-to-one correspondence is illustrated, but the correspondence relationship between the state information and the provision information T is limited to the above examples. Not. For example, one piece of provision information T can be associated with a plurality of state information and registered in the state table. Alternatively, a configuration in which a plurality of pieces of provision information T are associated with one piece of state information and registered in the state table may be employed. In the above configuration, a plurality of provision information T is provided to the user U.

(7) In the above-described form, the provision information T corresponding to the state information generated by the specifying unit 53 is specified from the state table. However, information other than the state information can be taken into account in specifying the provision information T. For example, the providing unit 55 provides the provided information T according to the state information generated by the specifying unit 53 and the user information indicating the age (10's, 20's,...) Or sex (male or female) of the user U. Is identified from the state table. User information is stored in the storage unit 23 in advance. For example, a plurality of sound signals representing voices that sound different character strings for each age representing equivalent contents are registered in the state table in association with common state information. That is, provision information T representing each of a plurality of ages is associated with one piece of state information. For example, when the status information “joy” is specified, if the age indicated by the user information is a teenager, a sound signal representing a voice uttering the character string “cute” is specified as the provision information T, When the age indicated by the user information is in the twenties, a sound signal representing the voice uttering the character string “beautiful” is specified as the provision information T. Further, the provision information T registered in the state table can be adjusted according to the user information (for example, by adjusting the prosody represented by the sound signal) and provided to the user U. By registering an SNS (Social Networking Service) ID in the information providing apparatus 200 in advance, the personal information of the user U registered in the SNS or the content written by the user U in the SNS is stored. It is also possible to take into account the specification of the provision information T.

(8) In the above-described embodiment, the provision information T is specified using the state table. For example, the provision information T is specified using a statistical model representing the relationship between the feature amount of the state information and the provision information T. Is also possible. For example, various pattern recognition models such as a neural network or Bayes classification are suitable as the statistical model. Specifically, the providing unit 55 is highly valid for the feature amount assigned to the statistical model under the relationship established between the feature amount in the existing many state information and the provision information T. The provision information T is specified.

(9) In the above-described embodiment, the provided information T is presented to the user U using the sound emitting unit 15 of the portable device 100. For example, the terminal device capable of communicating with the information providing apparatus 200 via the communication network 70. It is also possible to present the provided information T to the user U using a presentation unit (sound emitting unit or display unit) of a smartphone (for example, a smartphone or a tablet). Specifically, the portable device 100 transmits the captured image P captured by the imaging unit 11 to the information providing apparatus 200. The information providing apparatus 200 identifies the provision information T corresponding to the captured image P transmitted from the portable device 100, and transmits the identified provision information T to the terminal device. The terminal device presents the provision information T received from the information provision device 200 to the user U.

(10) In the above-described embodiment, the web server that can communicate with the portable device 100 via the communication network 70 is exemplified as the information providing apparatus 200. However, the portable device 100 and the communication network 70 or via short-range wireless communication are exemplified. A configuration in which a communicable terminal device (for example, a smartphone or a tablet) is used as the information providing device 200 may be employed. In the above configuration, it is possible to capture the captured image P and present the provided information by using the imaging unit and the presentation unit of the terminal device. That is, a configuration in which the portable device 100 and the information providing apparatus 200 are integrated may be employed.

(11) In the above-described embodiment, the eyeglass-type portable device 100 that can be worn by the user U is exemplified, but the specific form of the portable device 100 is arbitrary. For example, the portable device 100 of any form such as a necklace type that can be worn on the neck of the user U or an earring type that can be worn on the user's U pinna can be adopted. However, from the viewpoint of photographing the captured image P including the viewpoint of the user U, the spectacle-type portable device 100 is preferable. In addition, a configuration in which the portable device 100 is a terminal device (for example, a smartphone or a tablet) that can communicate with the information providing apparatus 200 via the communication network 70 may be employed. In the above configuration, for example, the captured image P is captured using the imaging unit of the terminal device held by the user U in front of the mirror M. As understood from the above description, the portable device 100 is not limited to a form that the user U can wear. However, from the viewpoint of photographing the user U reflected in the mirror, the portable device 100 of the above-described form that employs the portable device 100 that can be worn by the user U is preferable.

(12) The information providing apparatus 200 according to the above-described form is realized by the cooperation of the control unit 25 and the program as illustrated in the above-described form. The program may be provided in a form stored in a computer-readable recording medium and installed in the computer. The recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disk) such as a CD-ROM is a good example, but a known arbitrary one such as a semiconductor recording medium or a magnetic recording medium This type of recording medium can be included. Note that the non-transitory recording medium includes any recording medium except for a transient propagation signal (transitory, propagating signal), and does not exclude a volatile recording medium. It is also possible to provide a program to a computer in the form of distribution via the communication network 70.

(13) The present invention can also be specified as an operation method (information providing method) of the information providing apparatus 200 according to the above-described embodiment. Specifically, the information providing method according to a preferred aspect of the present invention includes an image of the user U of the portable device 100 and a specific image captured by the imaging unit 11 provided in the portable device 100. Provided information according to the captured image P when it is determined in the determination step that determines whether or not the image is included, and in the determination step that the image of the user U and the specific image are included in the captured image P Providing T to the user U.

(14) From the form illustrated above, for example, the following configuration is grasped.
<Aspect 1>
In the information providing method according to a preferred aspect (aspect 1) of the present invention, an image of a user of the device and a specific image are included in the captured image captured by the imaging unit provided in the portable device. A determination step for determining whether or not the user image and the specific image are included in the captured image, the information corresponding to the captured image is determined in the determination step. Providing step. According to the above method, when the image of the device user is included in the captured image captured by the imaging unit, information corresponding to the captured image can be provided to the user. Further, in the above method, when the captured image captured by the imaging unit provided in the portable device includes an image of the user of the portable device and a specific image, the captured image corresponds to the captured image. Information is provided to the user. Here, for example, when a captured image includes a user's image, the method of providing information to the user according to the captured image provides information regardless of whether the user is in a specific situation. The On the other hand, according to the above-described method, when a captured image includes a user image and a specific image, information corresponding to the captured image is provided to the user. When it is assumed that the user is in a specific situation, information corresponding to the captured image is provided.

<Aspect 2>
In the information providing method according to the preferred example (aspect 2) of aspect 1, the specific image is an image of the device. In the above method, when the captured image captured by the imaging unit provided in the portable device includes an image of the user of the portable device and an image of the portable device, the image is captured according to the captured image. Information is provided to users.

<Aspect 3>
The information providing method according to a preferred example (aspect 3) of aspect 1 or aspect 2 includes a specifying step of specifying the state of the user from the photographed image, and in the providing step, the user image and the specific When it is determined in the determination step that an image is included in the captured image, information corresponding to the state of the user specified in the specifying step is provided to the user as information corresponding to the captured image. . According to the above method, when the captured image captured by the imaging unit provided in the portable device includes the user image and the specific image, the user's state specified from the captured image is determined. Since the information is provided to the user as information corresponding to the captured image, it is possible to provide information appropriate for the user's condition.

<Aspect 4>
In the information providing apparatus according to a preferred aspect (aspect 4) of the present invention, an image of a user of the device and a specific image are included in a captured image captured by an imaging unit provided in the portable device. When the determination unit determines that the captured image includes a determination unit that determines whether or not the user image and the specific image are included, information corresponding to the captured image is transmitted to the user. Providing part to provide. In the above configuration, when the captured image captured by the imaging unit provided in the portable device includes the image of the user of the portable device and the specific image, information corresponding to the captured image is displayed. Provided to users. Here, for example, when the user's image is included in the captured image, the configuration that provides the user with information corresponding to the captured image provides the information regardless of whether the user is in a specific situation. The On the other hand, according to the above-described configuration, when the captured image includes the user's image and the specific image, information corresponding to the captured image is provided to the user. When it is assumed that the user is in a specific situation, information corresponding to the captured image is provided.

DESCRIPTION OF SYMBOLS 1 ... Information provision system, 100 ... Portable apparatus, 11 ... Imaging part, 13 ... Communication part, 15 ... Sound emission part, 17 ... Wearing part, 200 ... Information provision apparatus, 21 ... Communication , 23... Storage unit, 25... Control unit, 51... Determination unit, 53.

Claims (4)

A determination step of determining whether a captured image captured by an imaging unit provided in a portable device includes an image of a user of the device and a specific image;
An information providing step of providing information corresponding to the captured image to the user when it is determined in the determining step that the image of the user and the specific image are included in the captured image; Method. The information providing method according to claim 1, wherein the specific image is an image of the device. A specifying step of specifying the state of the user from the captured image;
In the providing step, when it is determined in the determining step that the user image and the specific image are included in the captured image, information corresponding to the state of the user specified in the specifying step is obtained. The information providing method according to claim 1, wherein the information is provided to the user as information corresponding to the captured image. A determination unit that determines whether a captured image captured by an imaging unit provided in a portable device includes an image of a user of the device and a specific image;
An information provision unit comprising: a provision unit that provides information corresponding to the photographed image to the user when the determination unit determines that the user image and the specific image are included in the photographed image apparatus.

Images