JP2016118926A - Electronic apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus capable of obtaining the action history of an object person and transmitting it to an external apparatus.SOLUTION: An electronic apparatus comprises: a recognition unit (118 or 310) for recognizing an article using at least one of a proximity communication unit (114 or 304) and an imaging unit (102 or 302); an acquisition unit (118 or 310) for acquiring storage information on the article recognized by the recognition unit stored in a storage unit using at least one of the proximity communication unit (114 or 304) and the imaging unit (102 or 302); and a transmission unit (118 or 310) for transmitting the storage information to an external apparatus (50) by using the proximity communication unit (114 or 304) or a communication unit (116 or 306) different from the proximity communication unit.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an electronic device.

  There has been proposed a system that makes it possible to easily and accurately notify a user of an action history related to a position using human body communication (see, for example, Patent Document 1).

JP 2010-39789 A

  In the conventional method, in order to acquire the position information of the object, it is necessary for the target person to touch the object-side human body communication unit, and the usability is not sufficient.

  The present invention has been made in view of the above problems, and provides an electronic device that can easily transmit position information of an article to an external device.

  The electronic apparatus according to the present invention includes a recognition unit (118 or 310) that recognizes an article using at least one of the proximity communication unit (114 or 304) and the imaging unit (102 or 302), the proximity communication unit, and the imaging. An acquisition unit (118 or 310) that acquires storage information in the storage unit of the article recognized by the recognition unit using at least one of the units, and the storage communication unit or the proximity communication unit Includes a transmission unit (118 or 310) that transmits to an external device using a different communication unit (116 or 306).

  In this case, in the electronic device of the present invention, at least one of the proximity communication unit and the imaging unit may be held by a storage person who stores the article.

  In the electronic device of the present invention, the imaging unit may start imaging in response to the start of proximity communication by the proximity communication unit.

  The electronic device of the present invention uses at least one of the first proximity communication unit (114) and the first imaging unit (102) to recognize the article (118), the second proximity communication unit (304), Using at least one of the second imaging unit (302), an acquisition unit (118) that acquires storage information in the storage unit of the article recognized by the recognition unit; and the storage information as the first proximity communication unit Or a transmission unit (118) that transmits to an external device using a communication unit (116) different from the first proximity communication unit and the second proximity communication unit.

  In this case, in the electronic device of the present invention, at least one of the first proximity communication unit and the first imaging unit may be held by a storage person who stores the article.

  In the electronic apparatus according to the aspect of the invention, the first imaging unit starts imaging in response to the start of the proximity communication by the first proximity communication unit, and / or the second imaging unit is the second proximity You may start imaging | photography according to the start of the near field communication by a communication part.

  In the electronic device of the present invention, the recognition unit may recognize information on an owner of the article.

  In the electronic device of the present invention, the transmission unit may transmit the storage information of the article recognized by the recognition unit and image data of the article to the external device.

  The electronic device according to the present invention is configured to establish a proximity communication between the position detection unit (120) that detects position information, a proximity communication unit (114) that performs proximity communication with the article, and the article and the proximity communication unit. In response, the imaging unit (102) that images the article, the image data of the article captured by the imaging unit, and the position information detected by the position detection unit are different from the proximity communication unit or the proximity communication unit. A transmission unit (118) that transmits to an external device using the communication unit (116).

  In this case, in the electronic device of the present invention, the position detection unit may detect position information in accordance with establishment of proximity communication between the article and the proximity communication unit.

  In the electronic device of the present invention, the proximity communication unit may receive information related to the article.

  In the electronic device of the present invention, the transmission unit may transmit the information related to the article to the external device using a communication unit different from the proximity communication unit or the proximity communication unit.

It is a block diagram which shows the structure of the electronic device system which concerns on 1st Embodiment. It is a perspective view of a 1st mounting apparatus. Fig.3 (a) is a figure which shows the chiffon which is an example of the storage provided with the apparatus for storages, and FIG.3 (b) is a perspective view which expands and shows one of the drawers which a chance has. 4A and 4B are diagrams illustrating an example of the data structure of the clothing DB. It is a flowchart (the 1) which shows an example of the process which the control part of the apparatus for storages performs. It is a flowchart (the 2) which shows an example of the process which the control part of the apparatus for storages performs. It is a flowchart which shows an example of the process which the control part of a 1st mounting apparatus performs. It is a figure which shows an example of the data structure of storage DB. It is a flowchart which shows an example of the process which the control part of a 2nd mounting apparatus performs. It is a figure which shows an example of the data structure of clothing DB. It is a block diagram which shows the structure of the electronic device system which concerns on 2nd Embodiment. It is a flowchart which shows an example of the process which the control part of a 1st mounting apparatus performs. It is a flowchart which shows an example of the process which the control part of the apparatus for storages performs. It is a block diagram which shows the structure of the electronic device system which concerns on 3rd Embodiment. FIG. 15A and FIG. 15B are diagrams illustrating an example of the data structure of the product DB. It is a flowchart (the 1) which shows an example of the process which the control part of a 1st mounting apparatus performs. It is a flowchart (the 2) which shows an example of the process which the control part of a 1st mounting apparatus performs. It is a figure which shows an example of the data structure of purchase DB. It is a flowchart which shows an example of the process which the control part of a 2nd mounting apparatus performs.

<< First Embodiment >>
Hereinafter, the electronic device system according to the first embodiment will be described in detail with reference to FIGS. FIG. 1 is a block diagram showing the configuration of an electronic device system 1000 according to the first embodiment.

  As shown in FIG. 1, the electronic device system 1000 includes a first mounting device 10, a second mounting device 20, a storage device 30, an article device 40, and an information processing device 50. The electronic device system 1000 according to the present embodiment acquires a history related to housework performed by a user (for example, a grandmother) wearing the first mounting device 10 and transmits the history to the information processing apparatus 50, so that the user (for example, the grandmother) travels. This is a system in which a user (for example, a grandmother) who wears the second wearing device 20 can live by using his / her behavior history even when he / she goes to or is hospitalized.

(First mounting device 10)
The first wearing device 10 is a glasses-type terminal worn by a user (a grandmother who performs housework) on the body (face). As shown in FIG. 1, the first mounting device 10 includes an imaging unit 102, a display unit 104, an operation unit 106, a microphone 108, a speaker 110, a storage unit 112, a first communication unit 114, a second communication unit 116, and a control. Part 118 is provided. FIG. 2 shows the first mounting device 10 in a perspective view. As shown in FIG. 2, the first mounting device 10 includes a glasses-type frame 130. The configuration of the first mounting device 10 illustrated in FIG. 1 and not illustrated in FIG. 2 is provided inside the frame 130 or a part of the frame 130.

  The imaging unit 102 includes a lens, an imaging device, an image processing unit, and the like, and captures images such as still images and moving images. As shown in FIG. 2, the imaging unit 102 is provided near the end of the frame 130 (for example, near the right eye of the user). For this reason, in a state where the user wears the first wearing device 10, an image in a direction in which the user is facing (viewing) can be taken.

  The display unit 104 includes a projector provided in or near the frame 130, and a prism for guiding a projection image from the projector to the user's eyes. The display unit 104 displays various information under the instruction of the control unit 118. A user who wears the first wearing device 10 can visually recognize the information projected by the display unit 104 and can visually recognize an external image by see-through. Note that the display unit 104 illustrated in FIG. 2 is an example, and the size and the design can be changed as appropriate.

  The operation unit 106 is a touch pad provided on the frame 130, detects the movement of the user's finger, receives an operation from the user, and transmits the received operation information to the control unit 118. That is, in the present embodiment, the operation unit 106 is a contact type operation unit. It should be noted that the operation unit 106 may be omitted.

  Details of the imaging unit 102, the display unit 104, and the operation unit 106 are also disclosed in, for example, US Published Patent No. 2013/0044042.

  The microphone 108 is provided on the frame 130 and collects voices uttered by a user wearing the first wearing device 10. The voice collected by the microphone 108 is recognized by a voice recognition unit (not shown), and the result of the voice recognition is transmitted to the control unit 118. The control unit 118 executes processing based on voice recognition (for example, command execution processing). Note that the control unit 118 may perform voice recognition.

  The speaker 110 is provided on the frame 130 and outputs sound under the instruction of the control unit 118. As the speaker 110, in addition to the earphone and the headphone, a speaker that has directivity and can mainly provide sound toward the ear of the user wearing the first wearing device 10 can be employed.

  The storage unit 112 is a non-volatile semiconductor memory such as a flash memory, for example, image data captured by the imaging unit 102, output data output to the display unit 104 or the speaker 110, audio data collected by the microphone 108, Data received by the first communication unit 114 and the second communication unit 116 is stored. The storage unit 112 may store identification information (attribute information) of a user who wears the first mounting device 10. In this case, the user may store the identification information by voice using the microphone 108 in the storage unit 112, and display the identification information such as gender and age on the display unit 104 and select the user by operating the operation unit 106. Alternatively, the identification information may be selected by detecting the user's line of sight with a line-of-sight detection device (not shown). The identification information stored in the storage unit 112 is stored in association with a unique number or ID such as a manufacturing number of the first mounting device 10. This user identification information is executed under the control of the control unit 118.

  The first communication unit 114 performs near field communication (for example, communication using NFC (Near Field Communication), TransferJet (registered trademark), RFID (Radio Frequency Identification), etc.) with other devices (for example, the storage device 30). .

  The second communication unit 116 performs wireless communication (for example, communication using a mobile phone line, Bluetooth (registered trademark), Wi-Fi (registered trademark), etc.) with other devices (for example, the storage device 30). The communication distance of the second communication unit 116 is longer than that of the first communication unit 114.

  The control unit 118 includes a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. In the control unit 118, the CPU controls the entire first mounting device 10 by executing a program stored in a ROM or the like. Details of processing executed by the control unit 118 will be described later.

(Second mounting device 20)
The second wearing device 20 is a glasses-side terminal worn by a user (grandmother) different from the user (grandmother) wearing the first wearing device 10 on the body (face). As shown in FIG. 1, the second mounting device 20 includes an imaging unit 202, a display unit 204, an operation unit 206, a microphone 208, a speaker 210, a storage unit 212, a first communication unit 214, 2 communication unit 216 and control unit 218. The second mounting device 20 has the same external shape as that in FIG. 2, and includes an imaging unit 202, a display unit 204, an operation unit 206, a microphone 208, a speaker 210, a storage unit 212, a first communication unit 214, and a second communication unit. The communication unit 216 and the control unit 218 include the imaging unit 102, the display unit 104, the operation unit 106, the microphone 108, the speaker 110, the storage unit 112, the first communication unit 114, the second communication unit 116, and the first mounting device 10. And has the same or equivalent function as the control unit 118. In the present embodiment, the second communication unit 216 performs wireless communication with the information processing apparatus 50.

(Storage device 30)
The storage device 30 is a device externally attached to a storage for storing articles or built in the storage. In the present embodiment, an example will be described in which the article to be stored is clothing and the storage is chest. As shown in FIG. 1, the storage device 30 includes an imaging unit 302, a first communication unit 304, a second communication unit 306, a storage unit 308, and a control unit 310.

  FIG. 3A is a view showing a chest 320 that is an example of a storage provided with the storage device 30, and FIG. 3B is an enlarged perspective view showing one of the drawers 324 included in the chest 320. FIG. As shown in FIG. 3A, the dresser 320 includes a plurality of drawers 324 that are fitted into the plurality of cavities provided in the main body 322. A space for storing clothes is formed in the drawer 324, and a first communication unit 304 of the storage device 30 is provided at the bottom of the space, as shown in FIG. . The configuration of the storage device 30 illustrated in FIG. 1 and not illustrated in FIGS. 3A and 3B is provided in a part of the main body 322 and the drawer 324. .

  The imaging unit 302 includes a lens, an imaging element, an image processing unit, and the like, and captures images such as still images and moving images. One imaging unit 302 may be provided for each chase 320, or one imaging unit 302 may be provided for each of the plurality of drawers 324. In the case where one imaging unit 302 is provided for the chiffon 320, for example, the imaging unit 302 is arranged so that the front of the chase 320 can be photographed. When the imaging unit 302 is provided in each of the plurality of drawers 324, for example, the imaging unit 302 is arranged so that the inside of the drawer 324 can be photographed. Note that the imaging unit 302 may be separated from the chest 320 and provided at a position where the above-described imaging is possible (for example, a ceiling or a lighting fixture).

  The first communication unit 304 performs proximity communication (for example, communication using NFC, TransferJet (registered trademark), RFID, or the like) with other devices (for example, the first mounting device 10 and the product device 40). As shown in FIG. 3B, the first communication unit 304 is provided at the bottom of each of the plurality of drawers 324, for example.

  The second communication unit 306 communicates with other devices (for example, the first mounting device 10 and the information processing device 50) using wireless communication (for example, a mobile phone line, Bluetooth (registered trademark), Wi-Fi (registered trademark), or the like. )I do. The communication distance of the second communication unit 306 is longer than that of the first communication unit 304.

  The storage unit 308 is a non-volatile semiconductor memory such as a flash memory, for example, image data captured by the imaging unit 302 or the like, identification information for identifying a chest, the first communication unit 304 and the second communication unit 306. The received data (for example, clothing information), clothing storage location information, and the like are stored.

  The control unit 310 includes a CPU, a RAM, a ROM, and the like, and controls the entire storage device 30 by executing a program. Details of the processing executed by the control unit 310 will be described later.

  In addition, the storage provided with the storage device 30 is not limited to the chest, but may be another storage as long as the storage stores goods such as a cupboard and a refrigerator. In addition to clothing, the stored item may be, for example, a passbook, insurance policy, or stamp, and if the storage is a cupboard, it may be food or tableware. When the storage is a refrigerator, food may be used.

(Apparatus 40)
The article device 40 is an apparatus (IC tag) attached to an article (clothing). As shown in FIG. 1, the article device 40 includes a proximity communication unit 402, a storage unit 404, and a control unit 406. The article to which the article device 40 is attached may be an article stored in a storage such as food or tableware in addition to clothing.

  The proximity communication unit 402 performs proximity communication (for example, communication using NFC, TransferJet (registered trademark), RFID, or the like) with other devices (for example, the storage device 30). The communication distance of the proximity communication unit 402 is shorter than the first communication units 114 and 214 that perform proximity communication between the first mounting device 10 and the second mounting device 20.

  The storage unit 404 is a non-volatile semiconductor memory built in the article device 40, an SD card that can be attached to and removed from the article device 40, and the like. The storage unit 404 stores information related to clothing to which the article device 40 is attached. Here, an example of the information (clothing DB 42) stored in the storage unit 404 will be described based on FIGS. 4 (a) and 4 (b).

  4A and 4B show an example of the data structure of the clothing DB 42. FIG. As shown in FIGS. 4A and 4B, the clothing DB 42 has fields such as type, object, size, color, and design. In the type field, the type of clothing (socks, polo shirt, etc.) is stored. In the target field, information on what kind of clothes for men (for men, women, etc.) is stored. The size field stores information on the size of clothing (S, M, number, cm, etc.). The color field stores information on clothing colors (black, candy, white, etc.). The design field stores information on clothing designs (one point, striped pattern, etc.). Each data in the clothing DB 42 may be input by a store clerk who sells the clothing before the sale of the article, or may be input by the manufacturer of the clothing. Moreover, the purchaser who purchased the goods may input each data of clothing DB42 using a personal computer (PC).

  If the article to which the article device 40 is attached is a food product (for example, canned food or retort food), the storage unit 404 stores information on the product such as the product name, raw material, country of origin or manufacturer, and importer. May be.

  The control unit 406 includes a CPU and the like, and controls the entire article device 40. The control unit 406 operates by an electromotive force from the first communication unit 304 of the storage device 30, for example.

(Information processing apparatus 50)
The information processing apparatus 50 is a home server installed in a residence, for example. As illustrated in FIG. 1, the information processing apparatus 50 includes a communication unit 502, a storage unit 504, and a control unit 506.

  The communication unit 502 wirelessly communicates with other devices (for example, the second mounting device 20 and the storage device 30) (for example, communication using a mobile phone line, Bluetooth (registered trademark), Wi-Fi (registered trademark), or the like). I do.

  The storage unit 504 is, for example, a nonvolatile semiconductor memory such as a flash memory, a hard disk drive, or the like. The storage unit 504 stores clothing information, storage position information, and the like of articles (clothes) stored in a storage (chance).

  The control unit 506 includes a CPU, a RAM, a ROM, and the like, and controls the information processing apparatus 50 as a whole.

(Information collection process)
Next, information collection processing executed in cooperation by the first mounting device 10, the storage device 30, and the article device 40 will be described. 5 and 6 are flowcharts illustrating an example of processing executed by the control unit 310 of the storage device 30, and FIG. 7 is a flowchart illustrating an example of processing executed by the control unit 118 of the first mounting device 10. It is. In this process, when the user (grandmother) wearing the first wearing device 10 stores clothes (such as laundry) in the chiffon, the storage device 30 acquires information on the storage position of the clothes, This is processing to be transmitted to the information processing apparatus 50.

  In the process of FIG. 5, first, in step S <b> 10, the control unit 310 of the storage device 30 approaches the first mounting device 10 when the user (grandmother) who wears the first mounting device 10 approaches the chiffon. Wait until communication is established. The control unit 310 proceeds to step S12 when the proximity communication with the first mounting device 10 is established. The control unit 310 acquires the ID and identification number of a device that is a communication partner when establishing near field communication. In this flowchart, the control unit 310 acquires the ID of the first mounting device 10. At this time, the control unit 310 may acquire user identification information. The first communication unit 304 of the storage device 30 and the first attachment of the second communication unit 306 of the storage device 30 are triggered by the establishment of proximity communication between the first communication unit 304 of the storage device 30 and the first communication unit 114 of the first attachment device 10. Wireless communication with the second communication unit 116 of the device 10 is started. At this stage, even if the user (grandmother) who wears the first wearing device 10 holds clothes including the article device 40, the communication distance of the proximity communication unit 402 of the article device 40 is equal to the first wearing device. It is assumed that the proximity communication between the storage device 30 and the article device 40 is not established because it is shorter than the first communication unit 114 that performs ten proximity communication.

  In step S12, the control unit 310 determines whether or not a predetermined time (a time indicating a timeout, for example, 10 seconds) has elapsed since the establishment of the proximity communication in step S10. When the determination in step S12 is negative, the process proceeds to step S14, and the control unit 310 determines whether or not the proximity communication with the article device 40 is established. As shown in FIG. 3B, the first communication unit 304 that performs proximity communication of the storage device 30 is provided at the bottom of the drawer 324. For this reason, when the user (grandmother) who wears the first wearing device 10 stores the clothes in the drawer, the proximity communication unit 402 of the article device 40 and the first communication unit 304 of the storage device 30 approach each other. Proximity communication is established.

  If the proximity communication with the article device 40 has not been established, the determination in step S14 is denied, the process returns to step S12, and the control unit 310 repeats steps S12 and S14 until a predetermined time has elapsed. On the other hand, when the predetermined time has elapsed, the determination in step S12 is affirmed, and thus the control unit 310 ends all the processes in FIGS. In the present embodiment, by performing the determinations in steps S12 and S14, when the user (grandmother) who wears the first wearing device 10 approaches the chiffon other than for the purpose of storing clothes, FIG. 5 and FIG. The process can be terminated.

  On the other hand, if the proximity communication with the article device 40 is established within a predetermined time, the determination in step S14 is affirmed and the process proceeds to step S16. If transfering it to step S16, the control part 310 will request | require transmission of the information regarding clothing with respect to the apparatus 40 for articles | goods. Specifically, the control unit 310 requests the control unit 406 of the article device 40 to transmit information on the clothing DB 42 stored in the storage unit 404. On the other hand, the control part 406 transmits the information of clothing DB42 to the apparatus 30 for storage (control part 310) using the near field communication part 402 in the stage which received the request | requirement.

  On the other hand, after step S16, control unit 310 is on standby until it receives information on clothing DB 42 from article device 40 in step S18. Therefore, control unit 310 receives information on clothing DB 42 from article device 40. The process proceeds to step S20. In addition, the control part 310 uses a speaker etc. which are not illustrated, when the information of clothing DB42 cannot be received by the time (time which shows a timeout, for example, 3 second) passes since the process of step S16. The user may be informed that reception is not possible. In addition, a timekeeping unit may be provided in the storage device 30 and the time when the information on the clothing DB 42 is received from the product device 40 may be stored in the storage unit 308.

  In step S20, the control unit 310 requests the first mounting device 10 to transmit the image data captured by the imaging unit 102. In this case, the control unit 310 requests that image data captured by the imaging unit 102 be transmitted at the timing when the information on the clothing DB 42 is received from the article device 40. This is because the image data photographed at such a timing is highly likely to be image data obtained by photographing clothing stored in the drawer. Note that the control unit 310 may transmit the time information measured by the time measuring unit to the first mounting device 10 when the image data transmission request is made. After step S20, the process proceeds to step S22 in FIG. 6, and the control unit 310 waits until image data is received.

  In addition, the control part 118 of the 1st mounting apparatus 10 is performing repeatedly the process of FIG. 7, while the process of FIG. 5, FIG. 6 is performed in the control part 310 of the apparatus 30 for storage. That is, as shown in FIG. 7, the control unit 118 waits until the near field communication with the storage device 30 is established (S40), and when the near field communication is established (S40: affirmative), the imaging unit 102 performs the image capturing. Is started (S42). Then, the control unit 118 stands by until a transmission request for image data taken from the storage device 30 is received (S44). In this case, when the process of step S20 in FIG. 5 is performed in the control unit 310 of the storage device 30 (S44: Yes), the control unit 118 stores the data in the clothing DB 42 from the image data captured by the imaging unit 102. Image data captured at the timing of receiving the information is extracted and transmitted to the storage device 30 via the second communication unit 116 (S46). Note that the control unit 118 may use time information received from the storage device 30 when extracting image data. Note that the control unit 310 of the storage device 30 may request the first mounting apparatus 10 to transmit image data without specifying the timing. In this case, the control unit 118 of the first mounting apparatus 10 transmits all the image data captured after step S42 to the control unit 310, and the control unit 310 extracts the image data captured at the above timing. May be.

  Returning to FIG. 6, when the control unit 310 receives image data from the first mounting device 10, the control unit 310 proceeds to step S <b> 24. Note that the control unit 310 uses a speaker (not shown) or the like when the image data cannot be received until a predetermined time (a time indicating a timeout, for example, 3 seconds) elapses after the process proceeds to step S22. Then, the user may be notified that reception is not possible.

  If transfering it to step S24, the control part 310 will acquire the storage location information which shows in which drawer | drawer of clothes the clothes which received clothing information by step S18 were accommodated. In this case, the control unit 310 identifies the first communication unit 304 that is in close proximity communication with the article device 40 from among the first communication units 304 provided in each of the plurality of drawers 324, thereby identifying which drawer 324 Determine if clothing has been stored.

  Next, in step S <b> 26, the control unit 310 associates the received clothing information (S <b> 18) and clothing storage position information (S <b> 24) with the clothing image data (S <b> 22) and stores them in the storage unit 308. In this case, the control unit 310 may store the identification information of the user of the first mounting device 10 in addition to the ID of the first mounting device 10. As a result, the control unit 310 can determine who has stored what and where. For example, when clothes are stored in a drawer different from the drawer 324 that is always stored by the grandmother when the grandmother stores, the control unit 310 notifies the second mounting device 20 that the grandmother is wearing (for example, the grandmother stores the clothes). Drawer).

  FIG. 8 shows an example of the data structure of information (storage DB 44) stored in the storage unit 308. As shown in FIG. 8, the storage DB 44 has fields such as clothing information, storage position information, and image data. In the field of clothing information, fields such as type, object, size, color, and design are included. Information received from the article device 40 is stored in the type, target, size, color, and design fields. The storage location information field includes fields such as storage information and detailed information. In the storage information field, information on clothes (for example, name of clothes) in which clothes are stored is stored. In the detailed information field, detailed position information (for example, the uppermost drawer) indicating where the clothes are stored in the chest is stored. The image data field stores image data of clothing.

  Returning to FIG. 6, in the next step S <b> 28, the control unit 310 determines whether or not the proximity communication with the first mounting device 10 continues to be established. When the proximity communication with the first mounting device 10 continues to be established, there is a possibility that another clothing may be stored, so the process proceeds to step S30 and the control unit 310 performs the proximity communication with the article device 40. It is determined whether or not it is established. If the proximity communication with the article device 40 is established, the determination in step S30 is affirmed, and the control unit 310 returns to step S16. On the other hand, if the proximity communication with the article device 40 is not established, the determination in step S30 is denied, and the control unit 310 returns to step S28.

  On the other hand, when the proximity communication with the first mounting device 10 is not established (S28: No), the storage of clothing by the user is completed, and the process proceeds to step S32. In step S <b> 32, the control unit 310 transmits information (clothing information, storage position information, image data) in the storage DB 44 to the information processing device 50 via the second communication unit 306.

  Here, the control unit 506 of the information processing apparatus 50 accumulates the storage DB 44 information received from the storage device 30 in the storage unit 504. As a result, information on which garment is stored in which drawer of which chase is stored in the storage unit 504. Note that the control unit 506 may receive information from the storage device 30 that the same clothing as the clothing already stored in the storage unit 504 has been stored in the chiffon. That is, the control unit 506 stores a clothing (for example, socks) similar to clothing information and image data stored in the storage unit 504 again in the same position or a different position. May be received. In such a case, the control unit 506 updates the information stored in the storage unit 504 with the newly received information. Accordingly, even when the clothes stored in the chiffon are taken out, worn, washed, etc., and stored again in the chiffon, the storage unit 504 stores only information on the latest storage position. It is like that. In the case where the clothes are discarded after being taken out from the dresser, the user may separately input the disposal information to the information processing apparatus 50. Thereby, the information on the discarded clothes can be deleted from the storage unit 504.

(Information usage processing)
Next, information usage processing executed in cooperation between the second mounting device 20 and the information processing device 50 will be described. FIG. 9 is a flowchart illustrating an example of processing executed by the control unit 218 of the second mounting device 20. In addition, this process is a process for notifying the user (grandmother) of the information on the storage position of the clothing when the user (grandmother) wearing the second wearing device 20 is looking for clothing.

  In the process of FIG. 9, first, in step S <b> 50, the control unit 218 of the second mounting device 20 is on standby until it acquires information about clothes that the user is looking for from the user (grandmother). When the user's voice “Where is the man's black socks?” Is input to the microphone 208 or when the information “Polo shirt with heel and white stripe pattern” is input from the operation unit 206, the control unit 218. Acquires “black socks” and “skin and white striped polo shirt” as information on the clothing being searched for, and proceeds to step S52. Note that the control unit 218 acquires the stored image data from the storage unit 504 of the information processing apparatus 50 and displays the acquired image data on the display unit 204, and also relates to the clothing being searched for based on the image data selected by the user. Information may be acquired.

  In step S <b> 52, the control unit 218 transmits information on the clothing that the user is looking for to the control unit 506 of the information processing device 50 via the second communication unit 216, and transmits storage position information corresponding to the information. Request. On the other hand, the control unit 506 transmits information (storage position information) indicating where the clothing the user is looking for is stored to the control unit 218 of the second mounting device 20.

  After step S52, the control unit 218 waits until receiving the storage position information from the information processing apparatus 50 in step S54. Therefore, when the storage position information is received from the information processing apparatus 50, the control unit 218 proceeds to step S56. To do.

  In step S56, the control unit 218 notifies the storage position information using the display unit 204 and the speaker 210. As a result, the user (grandmother) can easily find the clothes he is looking for.

  Note that the control unit 506 of the information processing device 50 may transmit all candidates to the control unit 218 when there are a plurality of storage position information candidates, or based on user information or the like. The candidates may be narrowed down for transmission. For example, if the user can recognize that he is a grandmother, the candidates for the storage location information are narrowed down based on the grandmother's individual dimension information (foot size and clothes size), the gender's gender information, and the like. What should I do?

  When the storage position information is transmitted, the control unit 506 of the information processing apparatus 50 may delete the storage position information from the storage DB 44. As a result, it is possible to delete the information on the clothes taken out from the dresser (which is likely to be taken out) from the storage DB 44.

  As described above in detail, according to the first embodiment, the control unit 310 of the storage device 30 acquires the clothing information of the clothing using the first communication unit 304 that performs proximity communication (S18). ) To recognize the clothing, and the storage position information of the drawer in which the clothing is stored is acquired using the first communication unit 304 (S24). Then, the control unit 310 transmits the storage position information to the information processing apparatus 50 using the second communication unit 306 (S32). Thereby, the control unit 310 can transmit the storage position information of the clothes by the user (grandmother) to the information processing device 50 without the user (grandmother) performing a special operation. Therefore, in the information processing apparatus 50, it is possible to easily collect clothing storage position information.

  In the first embodiment, the control unit 310 of the storage device 30 recognizes clothing by acquiring information on clothing such as a target (for men and women) and size. Thereby, since detailed information on clothes can be obtained, it is possible to support the user (grandmother) who wears the second mounting device 20 to specify the clothes he is looking for.

  In the first embodiment, the control unit 310 of the storage device 30 transmits clothing information, storage position information, and image data to the information processing apparatus 50. Thereby, the detailed information regarding the clothing which the user (the grandmother) is looking for can be provided.

  In the first embodiment, the case has been described in which the control unit 310 of the storage device 30 recognizes clothing using the clothing information acquired via the first communication unit 304 in step S18. However, it is not limited to this. For example, the control unit 310 may recognize clothing based on image data captured by the imaging unit 302 or the imaging unit 102 of the first mounting device 10. When clothing is recognized using the imaging units 302 and 102, clothing in which clothing image data and clothing information (type, target, size, color, design, etc.) are associated as shown in FIG. The DB 46 is stored in the storage unit 308 in advance. The control unit 310 may recognize the garment by comparing the image data captured by the imaging units 302 and 102 with the image data stored in the storage unit 308 when the garment is stored. In addition, the control unit 310 may perform clothing recognition using the first communication unit 114 of the first wearing device 10. When recognition of clothing is performed using the first communication unit 114, the control unit 310 may acquire the clothing information received by the first communication unit 114 in close proximity communication with the article device 40.

  In the first embodiment, the description has been given of the case where the control unit 310 acquires the clothing storage position information via the first communication unit 304, but the present invention is not limited to this. For example, the control unit 310 may acquire the storage position information using the image data captured by the imaging unit 302 or the imaging unit 102. In this case, by analyzing the image photographed by the imaging unit, it is only necessary to identify which drawer of which chiffon contains the clothing.

  In the first embodiment described above, the control unit 310 of the storage device 30 transmits the information in the storage DB 44 to the information processing apparatus 50. However, the present invention is not limited to this. For example, the information in the storage DB 44 may be transmitted to the first mounting device 10 or the second mounting device 20. Control unit 310 may transmit information to a caregiver's mobile terminal or a care robot. The control unit 310 is not limited to transmitting information via the second communication unit 306, and may transmit information via the first communication unit 304.

  In the first embodiment, the control unit 118 of the first mounting device 10 is not limited to the case where the imaging unit 102 starts shooting when the proximity communication with the storage device 30 is established. When the imaging request is received from the equipment 30, the imaging by the imaging unit 102 may be started. In this case, the control unit 310 of the storage device 30 can obtain an image of the clothing to be stored by transmitting a shooting request to the imaging unit 102 at the timing when the clothing information is received from the article device 40.

  In the first embodiment, configurations that are not used for processing may be omitted from the configurations in FIG. For example, the display unit 104 and the microphone 108 may be omitted from the first mounting device 10, or the imaging unit 202 may be omitted from the second mounting device 20. That is, the configurations of the first mounting device 10 and the second mounting device 20 may be different.

<< Second Embodiment >>
Next, an electronic device system according to the second embodiment will be described in detail with reference to FIGS. FIG. 11 shows a configuration of an electronic device system 1100 according to the second embodiment. As shown in FIG. 11, the electronic device system 1100 includes a first mounting device 10, a second mounting device 20, a storage device 30, an article device 40, information processing, as in the first embodiment. Device 50. In the first embodiment, the storage device 30 mainly performs the information collecting process (see FIGS. 5 and 6). However, in the second embodiment, the first mounting device 10 is mainly used. Collect information. Accordingly, in the second embodiment, the second communication unit 116 of the first mounting device 10 performs wireless communication with the communication unit 502 of the information processing device 50. The configuration of each other device and each device is the same as that of the first embodiment.

(Information collection process)
Next, information collection processing executed in cooperation by the first mounting device 10, the storage device 30, and the article device 40 will be described. FIG. 12 is a flowchart illustrating an example of processing executed by the control unit 118 of the first mounting apparatus 10, and FIG. 13 is a flowchart illustrating an example of processing executed by the control unit 310 of the storage device 30. In this process, when the user (grandmother) who wears the first wearing device 10 stores clothes (such as laundry) in the chiffon, the storage location information of the clothes acquired by the storage device 30 This is a process that the first mounting apparatus 10 transmits to the information processing apparatus 50. 10 is stored in the storage unit 112 of the first mounting device 10, and clothing information is not transmitted from the article device 40 to the storage device 30. Shall. Accordingly, it is assumed that the clothing DB 42 as shown in FIGS. 4A and 4B does not have to be stored in the storage unit 404 of the article device 40.

  In the process of FIG. 12, first, in step S <b> 60, the control unit 118 of the first mounting device 10 stands by until close proximity communication with the storage device 30 is established. That is, it waits until the user (grandmother) who wears the 1st wearing device 10 approaches chiffon, and shifts to Step S62 at the stage which approached. It is assumed that wireless communication between the second communication unit 116 of the first mounting device 10 and the second communication unit 306 of the storage device 30 is started with the establishment of the proximity communication as a trigger. Further, at this stage, as in the first embodiment, it is assumed that proximity communication between the storage device 30 and the article device 40 is not established.

  In step S62, the control unit 118 starts photographing by the imaging unit 102. Thereby, when the user (grandmother) who wears the 1st wearing device 10 stores clothes in a drawer of clothes, he can photograph the clothes to store. Next, in step S <b> 64, the control unit 118 requests the storage device 30 to transmit clothing storage position information. Thereafter, in step S66, the control unit 118 stands by until receiving the storage position information.

  Note that the control unit 310 of the storage device 30 repeatedly executes the process of FIG. 13 while the process of FIG. 12 is being performed by the control unit 118 of the first mounting apparatus 10. That is, as shown in FIG. 13, the control unit 310 waits until the proximity communication with the first mounting device 10 is established (S80), and after the proximity communication is established (S80: affirmative), the first mounting device. It waits until it receives the transmission request | requirement of the clothing storage position information from 10 (until step S64 of FIG. 12 is performed) (S82). Thereafter, the control unit 310 waits until the near field communication with the article device 40 is established (S84), and at the stage where the near field communication is established (the stage where the user (grandmother) stores the clothes in the drawer). 310 obtains storage position information indicating in which drawer the clothes are stored (S86). Note that the control unit 310 identifies the first communication unit 304 that has been in close proximity communication with the article device 40 from among the first communication units 304 provided in each of the plurality of drawers 324, thereby identifying which drawer 324 has clothing. Specifies whether the item is stored. Thereafter, the control unit 310 transmits the acquired storage position information to the first mounting device 10 using the second communication unit 306 (S88).

  Returning to FIG. 12, when the control unit 118 receives the storage position information from the storage device 30 by the second communication unit 116 (S66: Yes), the control unit 118 proceeds to step S68. Note that the control unit 118 displays a display unit when the storage position information cannot be received from the storage device 30 by the time a predetermined time (a time indicating a timeout, for example, 15 seconds) elapses from the process of step S64. You may make it alert | report that it cannot receive using 104 or the speaker 110. FIG.

  If transfering it to step S68, the control part 118 will acquire clothing information based on the image data image | photographed with the imaging part 102 in the timing which received storage position information from the apparatus 30 for storage. In this case, the control unit 118 compares the captured image data with the image data stored in the clothing DB 46 (see FIG. 10) to identify the clothing that the user (grandmother) is trying to store, and the clothing DB 46 Get clothing information from

  Next, in step S70, the control unit 118 stores information in which the clothing image data acquired in step S68 and the storage position information received in step S66 are associated with the image data of the storage unit 112 (storage DB 44 (see FIG. 8)). ).

  Next, in step S <b> 72, the control unit 118 determines whether or not the proximity communication with the storage device 30 continues to be established. If the proximity communication with the storage device 30 continues to be established, there is a possibility that another clothing may be stored in the dress, and the process returns to step S64.

  On the other hand, when close proximity communication with the storage device 30 is no longer established (No at Step S72), since the storage of the clothing is completed, the process proceeds to Step S74, and the control unit 118 stores the storage DB 44 stored in the storage unit 112. Information (clothing information, storage position information, image data) is transmitted to the information processing apparatus 50 using the second communication unit 116. The control unit 506 of the information processing apparatus 50 accumulates the storage DB 44 information received from the first mounting apparatus 10 in the storage unit 504. As a result, information on which garment is stored in which drawer of which chase is stored in the storage unit 504. The method for updating information in the storage unit 504 is the same as that in the first embodiment.

  In the second embodiment, the second mounting device 20 and the information processing device 50 cooperate to execute the information use processing, but the processing content is the same as in the first embodiment ( (See FIG. 9).

  As described above in detail, according to the second embodiment, the control unit 118 of the first mounting apparatus 10 acquires clothing information using the image data captured by the imaging unit 102 (S68). Recognizing the clothing, the storage position information of the drawer in which the clothing is stored is acquired using the first communication unit 304 of the storage device 30 (S66, S86). Then, the control unit 118 transmits the storage position information to the information processing apparatus 50 using the second communication unit 116 (S74). Accordingly, the control unit 118 can transmit the storage position information and clothing information of the clothing by the user (grandmother) to the information processing device 50 without the user (grandmother) performing a special operation. Therefore, the information processing apparatus 50 can easily collect information related to the position where the clothes are stored.

  In the second embodiment, the imaging unit 102 that captures image data used to acquire clothing information is provided in the first mounting device 10 that is worn by a user (grandmother) who stores clothing. Yes. Thereby, even if it does not provide an image pick-up part in each storage (chance), since the image of the clothing to store can be acquired, cost reduction can be aimed at.

  Further, in the second embodiment, the imaging unit 102 of the first mounting device 10 starts shooting in response to the start of the proximity communication by the first communication unit 114, so that useless shooting can be suppressed. The consumption of a battery (not shown) of the first mounting device 10 can be suppressed. Although not shown in FIG. 12, the photographing by the imaging unit 102 may be terminated when the determination in step S <b> 72 is denied.

  In the second embodiment, the control unit 118 of the first wearing apparatus 10 acquires information on clothing such as a target (for men and women) and size using the image data and the clothing DB 46. And recognizes clothing. Thereby, since detailed information on clothes can be obtained, it is possible to support the user (grandmother) who wears the second mounting device 20 to specify the clothes he is looking for.

  In the second embodiment, the description has been given of the case where the control unit 118 recognizes clothing by acquiring clothing information using image data captured by the imaging unit 102. However, the present invention is not limited to this. Absent. For example, imaging data captured by the imaging unit 302 of the storage device 30 may be used. In this case, the imaging unit 302 may start imaging in response to the start of proximity communication between the first communication units 114 and 304. When the first communication unit 304 of the storage device 30 acquires clothing information from the product device 40, the acquired clothing information may be received from the storage device 30. Further, when the first communication unit 114 of the first mounting device 10 can communicate with the proximity communication unit 402 of the article device 40, the clothing information can be acquired from the article device 40 via the first communication unit 114. Good.

  Note that, in the second embodiment, the control unit 118 may acquire the storage position information of the clothing from the imaging data of the imaging unit 102 and the imaging unit 302.

  Moreover, in the said 2nd Embodiment, the control part 118 may transmit the information of storage D44 directly to the 2nd mounting apparatus 20, and transmits the storage information of clothing to the caregiver's portable terminal or care robot. You may do it. In addition, the control unit 118 may transmit the information in the storage DB 44 to another device using the first communication unit 114.

  In the first and second embodiments, the case where the first communication unit 304 of the storage device 30 is provided at the bottom of the drawer 324 as illustrated in FIG. It is not limited to this. For example, the first communication unit 304 may be provided in the vicinity of each drawer 324 of the main body unit 322.

  In the first and second embodiments, the first mounting device 10 and the storage device 30 are provided with a human body communication unit, and on which drawer the clothes are stored based on the communication result of the human body communication unit. May be determined by the control unit 118 or 310. For example, a user (grandmother) wearing the first wearing device 10 touches the knob 326 (see FIGS. 3A and 3B) and pulls the drawer 324 when storing clothes. For this reason, if the human body communication part is provided in the knob 326, the control part 118 or 310 can specify drawer | drawing-out 324 in which the user (grandmother) has accommodated clothing based on the human body communication result. When using human body communication, either a current system that transmits a weak current through the human body and modulates the current to transmit information, or an electric field system that modulates the electric field induced on the surface of the human body and transmits information. This method may be used, and other human body communication methods may be used.

  In the first and second embodiments, wearable devices other than the glasses-type terminal worn on the user's face may be employed as the first wearing device 10 and the second wearing device 20.

  In the first and second embodiments, the proximity communication via the proximity communication unit 402 and the first communication unit 304 of the article device 40 provided in the clothes stored in the drawer is periodically performed. Information on clothes stored in the drawer may be periodically acquired. Thereby, even if clothing is taken out from the drawer and worn by the user, the information in the storage unit 504 of the information processing device 50 can be updated.

  In the first and second embodiments, the position information (placement information in the house) of the storage (such as the chest) in which the storage device 30 is provided is the first mounting device 10 and the second mounting device 10. It may be stored in at least one of the mounting device 20 and the information processing device 50. Such layout information may be stored as image data, and the control unit 218 of the second wearing device 20 can easily understand the layout information when displaying the storage position information of the clothes on the display unit 204. You may make it display. The layout information is created by using images taken by the first mounting device 10 and the second mounting device 20, and gyro sensors (not shown) provided in the first mounting device 10 and the second mounting device 20. That's fine.

<< Third Embodiment >>
Next, an electronic device system according to a third embodiment will be described in detail based on FIGS. FIG. 14 shows a configuration of an electronic device system 1200 according to the third embodiment. As shown in FIG. 14, the electronic device system 1200 includes a first mounting device 10 ′, a second mounting device 20 ′, a storage device 30 ′, an article device 40 ′, and an information processing device 50 ′. . The electronic device system 1200 according to the present embodiment provides information on a position where a user (for example, a grandmother) who wears the first mounting device 10 ′ purchases a product to a user (for example, a grandmother) who wears the second mounting device 20 ′. It is a system to do.

(1st mounting apparatus 10 'and 2nd mounting apparatus 20')
The first mounting device 10 ′ and the second mounting device 20 ′ include position detection units 120 and 220 in addition to the same configuration as the first mounting device 10 and the second mounting device 20 of the first and second embodiments. ing. The position detection units 120 and 220 include, for example, GPS (Global Positioning System) sensors, detect position information (for example, latitude and longitude) of the first mounting device 10 ′ and the second mounting device 20 ′, and a control unit 118, 218. Note that the position detectors 120 and 220 may detect the position from the communication state with a plurality of Wi-Fi base stations, for example, or may detect the position by other methods.

(Storage device 30 ')
The storage device 30 ′ may be the same as the storage device 30 of the first and second embodiments, but the imaging unit is omitted as can be seen by comparing FIG. 14 and FIG. In the third embodiment, the storage device 30 ′ is provided in a shopping basket used in a supermarket or the like.

(Apparatus 40 ')
The article device 40 ′ has the same configuration as the article device 40 of the first and second embodiments. In the third embodiment, it is assumed that the article device 40 ′ is provided in a product (for example, canned food, retort food, side dish, etc.) displayed in a store such as a supermarket. Note that the storage unit 404 stores information related to a product in which the article device 40 ′ is provided.

  FIGS. 15A and 15B show an example of the data structure of the information (product DB 48) stored in the storage unit 404. FIG. As shown in FIGS. 15A and 15B, the product DB 48 has fields such as product name, raw material, manufacturer or country of origin, and import source. The product name field stores the name of the product (boiled red salmon, curry, etc.). In the raw material field, the name of the used material (such as salmon and pork) is stored. In the field of the manufacturer or country of origin, the name of the company or country that manufactured the product (XX country, △ company, etc.) is stored. In the field of import source, the name of the importing company (such as XX Co., Ltd.) is stored when the product is imported from a foreign country. The data in the product DB 48 may be input by the product manufacturer or importer before the product is sold.

(Information processing apparatus 50 ')
The information processing apparatus 50 ′ has the same configuration as the information processing apparatus 50 of the first and second embodiments. In the third embodiment, it is assumed that the information processing apparatus 50 ′ is a cash register installed at a cash register (a place to pay a price) of a store such as a supermarket or a server provided in a store office or the like. In the electronic device system 1200 of the third embodiment, the information processing apparatus 50 ′ may be omitted.

(Information collection process)
Next, information collection processing executed in cooperation by the first mounting device 10 ′, the storage device 30 ′, and the article device 40 ′ will be described. 16 and 17 are flowcharts illustrating an example of processing executed by the control unit 118 of the first mounting device 10 ′. In this process, the first wearing device 10 ′ worn by the user (grandmother) acquires the position information of the product at a store such as a supermarket and transmits it to the second wearing device 20 ′ worn by the user (grandmother). It is processing.

  In the process of FIG. 16, first, in step S100, the control unit 118 of the first mounting device 10 ′ waits until the user (grandmother) wearing the first mounting device 10 ′ enters a store such as a supermarket. . In this case, the control unit 118 compares the position information (latitude, longitude) acquired from the position detection unit 120 with the map information (store position information) stored in advance in the storage unit 112, so that the first It is determined whether or not the user wearing the mounting device 10 ′ has entered the store. The control unit 118 proceeds to step S102 when the user (the grandmother) enters the store.

  In step S102, the control unit 118 determines whether or not a predetermined time (for example, several tens of minutes) has elapsed since the user (grandmother) wearing the first wearing device 10 'entered the store. If the determination in step S102 is negative, the process proceeds to step S104, and the control unit 118 determines whether the user (grandmother) wearing the first mounting device 10 ′ has the product displayed in the store in his / her hand. Judge whether or not. When the user (grandmother) picks up the product, the distance between the first mounting device 10 ′ and the article device 40 ′ approaches and close proximity communication is established, so that the control unit 118 in step S104, the article device 40 ′. Whether or not the user (grandmother) has the product in his hand. Note that the communication distance between the first communication unit 114 and the proximity communication unit 402 is preferably set to about 20 cm to 50 cm in order to enable the determination in step S104.

  If the user (grandmother) does not have the product in hand, the determination in step S104 is denied and the process returns to step S102. And step S102, S104 is repeated until predetermined time passes. When the predetermined time has elapsed, the determination in step S102 is affirmed and the process proceeds to step S106. If transfering it to step S106, the control part 118 will judge whether a user (grandmother) is still in a shop based on the positional information acquired from the position detection part 120. FIG. If the user (grandmother) is not in the store, the determination in step S106 is denied, and all the processes in FIGS. 16 and 17 are terminated. On the other hand, when the user (the grandmother) is in the store, the determination in step S106 is affirmed and the process returns to step S104. Note that the determination in steps S102 to S106 can determine the case where the user wearing the first mounting device 10 'has entered the store but has left the store without purchasing anything.

  When step S104 is affirmed, that is, when proximity communication between the first communication unit 114 and the proximity communication unit 402 is established within a predetermined time, the process proceeds to step S108, and the control unit 118 controls the first mounting device 10. The position information (latitude, longitude) of the place where the user wearing “has held the product is acquired from the position detection unit 120.

  Next, in step S110, the control unit 118 captures the product held in the hand of the user wearing the first mounting device 10 'with the imaging unit 102, and acquires product image data. Next, in step S112, the control unit 118 requests the product device 40 '(control unit 406) to transmit information on the product DB 48 stored in the storage unit 404. Thereafter, in step S114, the control unit 118 stands by until information on the product DB 48 is received from the product device 40 '. Note that the control unit 406 of the article device 40 ′ transmits the information of the product DB 48 to the first mounting device 10 ′ using the proximity communication unit 402 when receiving the transmission request.

  In addition, the control unit 118 displays the information when the information of the product DB 48 cannot be received from the product device 40 ′ before a predetermined time (a time indicating a timeout, for example, 3 seconds) elapses from the process of step S112. You may make it alert | report to a user (grandfather) that it cannot receive using the part 104 or the speaker 110. FIG.

  When the product DB 48 information is received from the article device 40 ′ (step S114: affirmative), the process proceeds to step S116 in FIG. 17, and the control unit 118 associates the acquired position information, product DB 48 information, and image data. Store in the storage unit 112. FIG. 18 shows an example of the data structure of information (purchasing DB 49) stored in the storage unit 112. As shown in FIG. 18, the purchase DB 49 has fields such as product information, purchase place information, and image data. The product information field includes fields such as product name, raw material, manufacturer or country of origin, and import source. Information received from the article device 40 ′ is stored in the field of product name, raw material, manufacturer or country of origin, and import source. Further, the fields of purchase place information include fields such as store information and detailed information. In the store information field, store information (for example, store name) where the product is purchased is stored. The detailed information field stores the position information acquired in step S108 of FIG. Product image data is stored in the image data field.

  Next, in step S118, the control unit 118 determines whether or not the user (the grandmother) has put the product held in his hand into the shopping basket. When the user (grandmother) puts a product into the shopping basket, the distance between the storage device 30 'and the product device 40' approaches and close proximity communication is established. Therefore, in step S118, the determination is affirmed when the proximity communication between the first communication unit 304 and the proximity communication unit 402 is established, and the determination is denied when the proximity communication is not established.

  When the determination in step S118 is negative, the process proceeds to step S120, and the control unit 118 determines whether or not a predetermined time has elapsed since the user (the grandmother) held the product. If the predetermined time has not elapsed, the determination in step S120 is denied and the process returns to step S118. On the other hand, when the predetermined time has elapsed, the determination in step S120 is affirmed, and in step S122, the control unit 118 deletes information stored in the storage unit 112 (position information, information on the product DB 48, and image data). To do. As a result, information on products that are not actually purchased can be deleted from the purchase DB 49, and the storage area of the storage unit 112 can be used efficiently. After step S122, the process proceeds to step S124. Note that the control unit 118 may transmit the deleted information to the information processing apparatus 50. In this case, since the information of the product that the user has in hand but did not purchase can be accumulated, the information can be used for future sales strategies and the like.

  On the other hand, when the determination in step S118 is affirmed, the process proceeds to step S124, and the control unit 118 determines whether or not the user (grandmother) has passed the cash register (place to pay the price). Whether the user (the grandmother) has passed the cash register may be determined based on the position information acquired by the position detection unit 120.

  If the user (grandmother) has not passed the cash register (No at step S124), the process proceeds to step S126, and the control unit 118 determines whether the user (grandmother) has another product in hand. . When the user (grandmother) newly obtains a product (step S126: Yes), the process returns to step S108. On the other hand, when the user (the grandmother) does not have a new product (No at Step S126), the process returns to Step S124.

  On the other hand, when the user (grandmother) passes the cash register (step S124: affirmative), the process proceeds to step S128, and the control unit 118 stores information (product information, merchandise information, and the like) stored in the storage unit 112. The purchase place information and the image data) are transmitted to the second mounting device 20 ′ using the second communication unit 116.

  Here, the control unit 218 of the second mounting device 20 ′ accumulates the information of the purchase DB 49 transmitted from the first mounting device 10 ′ and received by the second communication unit 216 in the storage unit 212. Thereby, the position information of the place where the product purchased by the user (the grandmother) was stored in the storage unit 212.

(Information usage processing)
Next, an information use process executed by the second mounting device 20 ′ will be described. FIG. 19 is a flowchart illustrating an example of processing executed by the control unit 218 of the second mounting device 20 ′. In this process, when the user (grandmother) wearing the second mounting device 20 ′ wants to know the location where the product is sold, the location information of the location where the product is sold is notified to the user (grandmother). It is a process to do.

  In the process of FIG. 19, first, in step S140, the control unit 218 of the second mounting device 20 ′ obtains information on a product (for example, retort food or frozen food) that the user (grandmother) wants to know where to sell. Waiting for acquisition. When the user's voice “Where is the curry of OO Co., Ltd. sold?” Is input to the microphone 208 or when the information “Curry of OO Co., Ltd.” is input from the operation unit 206 Then, the process proceeds to step S142. Note that if the user (grandmother) inputs a voice saying “I want an ordinary curry” or “I want to eat the curry that I had eaten the last time” to the microphone 208, the control unit 218 reads the usual curry purchase history. What is necessary is just to discriminate curry, and when there are a plurality of curry candidates, a plurality of curry images may be displayed on the display unit 204 so that the user (grandmother) can select them.

  In step S <b> 142, the control unit 218 acquires location information (purchase location information) of a place where the product is sold from the storage unit 212. Next, in step S144, the control unit 218 notifies the acquired position information using the display unit 204 or the speaker 210. Thereby, the user (the grandmother) can easily know the place where the product is sold.

  Note that the control unit 218 may output all candidates when there are a plurality of purchase place information candidates, or may be based on user information (for example, the place where the user lives or the current place). The candidates may be narrowed down for transmission.

  As described above in detail, according to the third embodiment, the control unit 118 of the first mounting device 10 ′ captures the product in accordance with the proximity communication with the product (product) (S110), The photographed image data and the position information detected by the position detection unit 120 are transmitted to the second mounting apparatus 20 ′ using the second communication unit 116 (S128). Accordingly, the control unit 118 transmits the image data of the product taken by the user wearing the first mounting device 10 ′ and the position information of the place where the product was sold to the second mounting device 20 ′. Can do. For this reason, the user wearing the second mounting device 20 'can easily know the position where the product is sold.

  In the third embodiment, the control unit 118 detects position information according to the establishment of the proximity communication with the product, and thus can obtain accurate position information of the place where the product is placed.

  Further, in the third embodiment, the control unit 118 receives information related to the product through proximity communication with the product, and thus can obtain information related to the acquired product at an appropriate timing.

  In the third embodiment, in addition to product image data and position information, information related to the product is transmitted to the second mounting device 20 ′. Thereby, the user wearing the second mounting device 20 ′ can know the position information of the place where the product is sold by inputting the name of the desired product into the microphone 208.

  In the third embodiment, the control unit 118 of the first mounting device 10 ′ acquires the product information by proximity communication with the article device 40 ′ as an example. Alternatively, human body communication may be used. In addition, the control unit 118 is not limited to acquiring product information from the article device 40 ′, for example, when the user holds the product in his / her hand, acquires the image data by capturing the product, and from the image data You may specify goods. Note that the process of specifying a product from the image data may be performed by the information processing apparatus 50 ′ or the like.

  In the third embodiment, the control unit 118 of the first mounting device 10 ′ creates a database in which purchase frequencies are ranked from past purchase histories for products in the same category (for example, curry). The database may be transmitted to the second mounting device 20 ′. As a result, after the control unit 218 of the second mounting device 20 ′ presents the purchase location of the product to the user who wears the second mounting device 20 ′, it is input by voice that the product is sold out by the user. In this case, it is possible to present the purchase place of the products in the order of ranking. Thereby, the user who wears the second mounting device 20 ′ can obtain the purchase place information about the substitute product when the product is sold out. The ordering of purchase frequency may be performed by the control unit 218 of the second mounting apparatus 20 '.

  In the third embodiment, the control unit 118 of the first mounting device 10 ′ transmits product image data and the like to the second mounting device 20 ′ by wireless communication using the second communication unit 116. Although the case has been described, the present invention is not limited to this. For example, when the first mounting device 10 ′ and the second mounting device 20 ′ are close to each other, image data or the like may be transmitted by proximity communication. Further, the control unit 118 may transmit product image data or the like to, for example, a home server installed in a residence, and transmit image data or the like from the home server or the like to the second mounting device 20 ′.

  In the third embodiment, steps S118 to S122 in FIG. 17 may be omitted. In this case, the position information and the like of the place where all the products obtained by the user (grandmother) were sold are stored in the storage unit 212 of the second mounting device 20 '.

  The processing functions in the first to third embodiments can be realized by a computer. In that case, a program describing the processing contents of the functions that the processing device (CPU) should have is provided. By executing the program on a computer, the above processing functions are realized on the computer. The program describing the processing contents can be recorded on a computer-readable recording medium (except for a carrier wave).

  When the program is distributed, for example, it is sold in the form of a portable recording medium such as a DVD (Digital Versatile Disc) or a CD-ROM (Compact Disc Read Only Memory) on which the program is recorded. It is also possible to store the program in a storage device of a server computer and transfer the program from the server computer to another computer via a network.

  The computer that executes the program stores, for example, the program recorded on the portable recording medium or the program transferred from the server computer in its own storage device. Then, the computer reads the program from its own storage device and executes processing according to the program. The computer can also read the program directly from the portable recording medium and execute processing according to the program. Further, each time the program is transferred from the server computer, the computer can sequentially execute processing according to the received program.

  Each of the above-described embodiments is a preferred embodiment of the present invention, and the first to third embodiments can be appropriately combined. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.

10, 10 'first mounting device 20, 20' second mounting device 30, 30 'storage device 40, 40' product device 42 clothing DB
44 Storage DB
46 Clothing DB
48 Product DB
49 Purchase DB
50, 50 ′ Information processing apparatus 102, 202 Imaging unit 112, 212 Storage unit 114, 214 First communication unit 116, 216 Second communication unit 118, 218 Control unit 120, 220 Position detection unit 302 Imaging unit 304 First communication unit 306 Second communication unit 308 Storage unit 310 Control unit 402 Proximity communication unit 404 Storage unit 406 Control unit 502 Communication unit 504 Storage unit 506 Control unit 1000, 1100, 1200 Electronic device system

Claims (12)

A recognition unit that recognizes an article using at least one of the proximity communication unit and the imaging unit;
An acquisition unit that acquires storage information in a storage unit of the article recognized by the recognition unit using at least one of the proximity communication unit and the imaging unit;
An electronic device comprising: a transmission unit that transmits the stored information to an external device using a communication unit different from the proximity communication unit or the proximity communication unit.   The electronic device according to claim 1, wherein at least one of the proximity communication unit and the imaging unit is held by a storage person who stores the article.   The electronic apparatus according to claim 1, wherein the imaging unit starts imaging in response to the start of proximity communication by the proximity communication unit. A recognition unit that recognizes an article using at least one of the first proximity communication unit and the first imaging unit;
Using at least one of a second proximity communication unit and a second imaging unit, an acquisition unit for acquiring storage information in the storage unit of the article recognized by the recognition unit;
An electronic device comprising: a transmission unit that transmits the storage information to an external device using a communication unit that is different from the first proximity communication unit or the first proximity communication unit and the second proximity communication unit.   The electronic device according to claim 4, wherein at least one of the first proximity communication unit and the first imaging unit is held by a storage person who stores the article.   The first imaging unit starts imaging in response to the start of proximity communication by the first proximity communication unit, and / or the second imaging unit responds to the start of proximity communication by the second proximity communication unit. The electronic device according to claim 4, wherein shooting is started.   The electronic device according to claim 1, wherein the recognition unit recognizes information on an owner of the article.   The electronic device according to claim 1, wherein the transmission unit transmits the storage information of the article recognized by the recognition unit and image data of the article to the external device. A position detector for detecting position information;
A proximity communication unit that performs proximity communication with an article;
An imaging unit that images the article according to establishment of proximity communication between the article and the proximity communication unit;
A transmission unit that transmits image data of the article imaged by the imaging unit and position information detected by the position detection unit to an external device using a communication unit different from the proximity communication unit or the proximity communication unit; Electronic equipment comprising.   The electronic device according to claim 9, wherein the position detection unit detects position information in accordance with establishment of proximity communication between the article and the proximity communication unit.   The electronic device according to claim 9 or 10, wherein the proximity communication unit receives information related to the article.   The electronic device according to claim 11, wherein the transmission unit transmits information related to the article to the external device using the proximity communication unit or a communication unit different from the proximity communication unit.

Images