JP2018135152A - Bottle storage apparatus and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a bottle storage apparatus which can present information related to a brand of a bottle to be cooled to a user with good visibility.SOLUTION: A bottle storage apparatus 100 has a storage part 101 which stores a bottle 1, a cold part (cold equipment) which is provided around the bottle storage part, a rotary part (a rotary motor) which makes the bottle stored in the storage part rotate, an imaging part which images the bottle stored in the storage part, a control part which controls rotation of the bottle on the rotary part and imaging of the imaging part based on a picture of the bottle obtained by the imaging part, an information management part (a storage apparatus management part) which specifies at least a brand of the bottle based on the picture of the bottle obtained by control of the control part, and an output part (a display part 102) which outputs the brand specified by the information management part and at least one of relation information related to the brand.SELECTED DRAWING: Figure 1B

Description

  The present invention relates to a bottle storage device for storing bottles such as wine bottles, and a system using the bottle storage device.

  Wine is drunk all over the world. In addition, sake (SAKE) has begun to spread all over the world, and it is distributed in bottles (quad bottles) that are almost the same size as wine.

  There is a wine cellar that can store wine at a certain temperature. The wine cellar that is widely used cools wine electrically using a compressor or the like. Although the wine cellar is excellent in temperature control, it is large and time-consuming to carry, and the sound of compressors and fans is generated, so it is often not suitable for desktop use.

  Therefore, there is a wine cooler that cools wine with ice water as a bottle storage device for desktop use. However, the wine cooler using ice water has a drawback that the wine is too cold than an appropriate temperature (for example, 5 ° C. to 20 ° C.). In addition, when wine is immersed in ice water, it is difficult to hold the bottle because the bottle gets wet, and there is a possibility that the visibility of the label may deteriorate because the label gets wet.

  As one method for solving such inconvenience, Patent Document 1 proposes a wine cooler in which a cold insulating material can be detachably fixed to an inner wall of a cold insulating container. Patent Document 1 describes that the temperature can be adjusted flexibly by adjusting the quantity and size of the cold insulating material. Moreover, the wine cooler of patent document 1 is made into the shape which has the space which can recognize the label of a wine bottle between a wine bottle and a cold insulating material, and, by this, the state by which the wine bottle was accommodated in the wine cooler But you can see the label on the wine bottle.

Japanese Patent No. 4406683

  However, although the wine cooler of Patent Document 1 has a shape that allows the wine bottle label to be visually recognized between the wine bottle and the cold insulation material, the label may differ depending on the direction of the wine bottle in the wine cooler. There is a possibility that it cannot be visually recognized. Also, since the label is viewed from the gap between the wine bottle and the cold insulation material, the label visibility is not good.

  One aspect of the present disclosure discloses a bottle storage device and system capable of presenting information related to a brand of a bottle to be cooled to a user with high visibility.

A bottle storage device according to an aspect of the present disclosure is provided.
An accommodating part for accommodating the bottle;
A cooling / heating unit provided around the housing unit;
A rotating part for rotating the bottle accommodated in the accommodating part;
An imaging unit for imaging the bottle stored in the storage unit;
A control unit that controls rotation of the bottle of the rotating unit and imaging of the imaging unit based on an image of the bottle obtained by the imaging unit;
An information management unit that identifies at least the brand of the bottle based on the image of the bottle obtained by the control of the control unit;
An output unit that outputs at least one of the brand specified by the information management unit and related information about the brand;
Is provided.

A system according to one aspect of the present disclosure includes:
A system comprising a bottle storage device and an information processing device,
The bottle storage is
An accommodating part for accommodating the bottle;
A cooling / heating unit provided around the housing unit;
A rotating part for rotating the bottle accommodated in the accommodating part;
An imaging unit for imaging the bottle stored in the storage unit;
A communication unit that transmits an image of the bottle obtained by the imaging unit, and receives a recognition result about the image of the bottle and related information about the brand of the bottle;
A control unit that controls rotation of the bottle of the rotating unit and imaging of the imaging unit based on the recognition result;
An output unit for outputting related information on the brand;
With
The information processing apparatus includes:
A communication unit that receives the image of the bottle and transmits related information about the recognition result and the brand;
An information management unit for recognizing an object appearing in the image of the bottle and identifying at least the brand of the bottle based on the image of the bottle;
Is provided.

  According to one aspect of the present disclosure, information regarding the brand of the bottle to be cooled can be presented to the user with high visibility.

The perspective view which shows the external appearance structure of a bottle storage device The perspective view which shows the state which put the bottle Schematic cross-sectional view showing the internal configuration of the bottle storage Exploded perspective view showing the case parts that make up the bottle storage Perspective view of the top lid from the back side Perspective view showing peripheral structure of cooling / heating device Perspective view showing peripheral structure of cooling / heating device Schematic cross-sectional view showing a state in which a cooling / heating medium is put in a cooling / heating device Schematic sectional view showing the case where a Peltier element is used in the cooling / heating device The perspective view which shows the attachment state of the imaging part to a circuit board The figure which shows the dew condensation prevention mechanism of the image pickup section Diagram showing the state when the shutter is closed Diagram showing the state when the shutter is closed The perspective view which shows the external appearance structure of the simple bottle storage device by embodiment Schematic cross-sectional view showing the internal configuration of the bottle storage Exploded perspective view showing the case parts that make up the bottle storage Perspective view of the top lid from the back side Diagram showing how the cooling / heating device is inserted into the tray Block diagram showing functional configuration of bottle storage Flow chart used to explain the operation of the bottle storage Illustration showing examples of bottles and labels Illustration showing examples of bottles and labels Illustration showing examples of bottles and labels The figure which shows the positional relationship of a label and an imaging part Flow chart showing stock analysis and verification process procedure The figure which shows the picked-up image when it picks up at the wide angle from the front of the bottle The figure which shows the picked-up image when it picks up at the narrow angle from the front of the bottle The figure which shows the picked-up image when it images from the direction slightly shifted from the front of the bottle The figure which shows the picked-up image when adjusting the position of the bottle and picking it up from the front of the bottle The figure which shows the picked-up image which imaged the position where there is no label The figure which shows the picked-up image which imaged the label of the bottle back The figure which shows the example of the feature pattern which is imaged The figure which shows the example of the feature pattern which is imaged The figure which shows the example of the feature pattern which is imaged The figure which shows the example of the information table which the brand database stores The figure which shows the example of the bottle insertion log | history log memorize | stored in a log information storage part Block diagram showing functional configuration of bottle storage The figure which shows the example of the external notice by the bottle storage Flow chart used to explain the operation of the bottle storage The figure which shows the example of an image displayed by a display part The figure which shows the example of the collation result image displayed by a display part The figure which shows the example which notifies that it collated by making LED light-emit The figure which shows the example of the table obtained by favorite registration processing The figure which shows the example which light-emits the number of LED according to the number of favorite frequency The figure which shows the example which light-emits the number of LED according to the number of favorite frequency Block diagram showing the functional configuration of a bottle storage device having a communication function with the outside The flowchart which shows the brand analysis and collation processing procedure performed by the bottle storage device which has a communication function The block diagram which shows the system configuration which a bottle storage device can communicate with information devices, such as a smart phone, via a communication part. The figure which shows a mode that the information memorize | stored in the bottle storage device was displayed on the information equipment The figure which shows the content of the favorite table memorize | stored in a log information memory | storage part, when it cooperates with information equipment The block diagram which shows the function structure of the bottle storage device which has the function to rotate and raise / lower a bottle stand. Flow chart used to explain the operation of the bottle storage It is a figure which shows the example which provided the scanner in the bottle storage, and the external appearance perspective view It is a figure which shows the example which provided the scanner in the bottle storage, and the perspective view which shows the mode of the inside External perspective view showing an example in which an annular scanner is provided in the opening of the bottle housing portion Top view showing a typical electrostatic button Plan view showing electrostatic buttons with a capacitive sensor in the shape of a cross on the back of the button Diagram showing insertion history log with rotation information added Block diagram showing the functional configuration of a bottle storage device capable of personal authentication Plan view showing a ring-type fingerprint input unit Plan view showing line-type fingerprint input unit The figure which shows the display in a display part when a sparkling beverage is inserted in the bottle storage device. The figure which shows the example of the table which linked | related with content ID and stored the sound source information Figure showing a bottle to be photographed Schematic showing an example of the arrangement of curved mirrors as seen from the front Schematic showing an example of the arrangement of curved mirrors seen from the side Schematic showing an example of the arrangement of curved mirrors as seen from above Schematic which shows the specific example of the system constructed | assembled using the bottle storage device of embodiment Diagram showing an example where a device manufacturer operates a cloud server A diagram showing an example in which a device manufacturer and another management company jointly or share a cloud server

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

<1> Structure of Bottle Storage Device FIGS. 1A, 1B, and 1C are views showing the appearance of the bottle storage device of the embodiment. 1A is a perspective view showing an external configuration of a bottle storage device 100, FIG. 1B is a perspective view showing a state in which a wine bottle (hereinafter simply referred to as “bottle”) 1 is put, and FIG. 1C is a bottle storage device. It is the schematic sectional drawing which looked at the internal structure of 100 from the upper direction. The bottle storage device 100 of the present embodiment is not limited to the wine bottle 1 and can be widely used as a storage device for bottles containing beverages such as champagne and sake.

  The bottle storage device 100 has a substantially cylindrical shape. Inside the bottle storage device 100 is provided a storage portion 101 having a space for storing the bottle 1. On the side surface of the bottle storage device 100, a display unit 102 made of a liquid crystal display or the like and a notification unit 102a made of an LED (Light Emitting Diode) or the like are provided. On the upper surface of the bottle storage device 100, an operation input unit 103 including an electrostatic button or the like is provided. As can be seen from FIG. 1C, a cooling / heating device 104 is provided around the housing portion 101.

  In addition, an imaging unit 105 including a camera or the like is provided inside the bottle storage device 100. The imaging unit 105 is disposed at a position where the bottle 1 accommodated in the accommodation unit 101 can be imaged. Specifically, the imaging unit 105 is provided at a back position of the display unit 102 at a certain distance from the storage unit 101. In other words, the imaging unit 105 is disposed away from the cooling / heating device 104. Thereby, it is possible to prevent the imaging unit 105 and the display unit 102 (for example, the circuit board of the camera and the display) from being excessively cooled and causing malfunction. In addition, since the brand of the bottle and the like are displayed on the display unit 102 as will be described later, the label is directed to the front by arranging the imaging unit 105 on the back surface of the display unit 102 (that is, the label is the front of the imaging unit 105). The user can be guided to insert the bottle so that it enters the imaging area. Thereby, it is possible to improve the label recognition rate or reduce the mechanism or processing for label recognition.

  FIG. 2 is an exploded perspective view showing case parts constituting the bottle storage device 100. The case 111 is a case serving as a base for the bottle storage device 100, and is attached with the imaging unit 105, a bottle base 117 (FIG. 4) described later, and the like. The case 112 is a case serving as an exterior of the bottle storage device 100. The tray 113 is a water receiver that receives water generated from the cooling / heating device 104 or the like. The cam box (cam box) 114 is a case for housing the mechanical parts. The upper lid 115 is detachably fixed to the upper surfaces of the cases 111 and 112 by the force of a magnet, for example. Incidentally, the operation input unit 103 including an electrostatic button provided on the upper lid 115 is electrically connected to a circuit board (not shown) provided on the case 111 when the upper lid 115 is attached to the cases 111 and 112. Connected.

  The tray 113 has a notch 113a, and the cam box 114 has a notch 114a. Thereby, the bottle 1 accommodated inside the tray 113 and the cam box 114 can be imaged from the imaging unit 105 arranged outside the tray 113 and the cam box 114 through the notches 113a and 114a.

  FIG. 3 is a perspective view of the upper lid 115 from the back side. The upper lid 115 is provided with guides 115a and 115b.

  4 and 5 are perspective views showing the peripheral structure of the cooling / heating device 104. FIG. The cooling / heating device 104 includes a pair of containers disposed around the bottle 1, and a cooling / heating medium 116 is placed in each container. The cold / warm medium 116 is a so-called cold storage agent or cold-retaining agent, and is cooled in advance to, for example, 0 ° or less by another cold / warm device. Incidentally, if the cold medium 116 is preheated, the bottle storage device 100 can be provided with a heat retaining function. The cooling / heating device 104 can cool the bolt 1 efficiently because the surface facing the bottle is formed of a metal having good thermal conductivity.

  A disk-shaped bottle base 117 is provided below the cooling / heating device 104. The bottle base 117 is rotatable by a motor (not shown). Thereby, the bottle 1 placed on the bottle base 117 can be rotated together with the bolt base. Incidentally, the cooling / heating device 104 is independent of the bottle base 117 and does not rotate. Therefore, according to the rotation position of the bottle base 117, the direction of the bottle 1 that can be seen from the gaps between the containers of the cooling / heating device 104 changes. In other words, the imaging unit 105 can image the bottle from various angles through the gaps between the containers of the cooling / heating device 104.

  The bearing base 118 transmits a driving force of a motor (not shown) to each container constituting the cooling / heating device 104, and each container is moved in the direction of approaching and separating from each other by the motor. When each container is moved in the proximity direction, the cooling capacity is increased, and when each container is moved in the direction of separation, the cooling efficiency is decreased.

  Here, when the upper lid 115 is attached to the upper portion of the case 111, the claw portion of the guide 115a enters the inside of each container of the cooling / heating device 104, whereby the upper portion of the cooling / heating device 104 is held by the guide 115a. Further, the circumferential projection of the guide 115b abuts on the inner peripheral surface of the cooling / heating device 104, whereby the upper portion of the cooling / heating device is held by the guide 115b. When the containers 115a and 115b are moved in the directions in which the containers approach and separate from each other, the guides 115a and 115b are moved so as to reduce the diameter and expand the diameter in conjunction with the movement. As a result, the guides 115a and 115b can hold the upper ends of the containers by interlocking with the lower ends of the containers constituting the cooling / cooling device 104, even when the lower ends of the containers are moved toward and away from each other by the motor.

  FIG. 6 is a schematic cross-sectional view showing a state in which the cooling / heating medium 116 is put in the cooling / heating device 104. In the present embodiment, the case where the cooling / heating device 104 is configured by a pair of containers has been described, but it may be configured by one container, or may be configured by three or more containers. However, it is necessary to secure an imaging path for imaging the bottle 1 by the imaging unit 105.

  In this embodiment, the cooling / heating device 104 is constituted by a container, and the cooling temperature is realized by putting the cooling / heating medium 116 in the container. However, the configuration of the cooling / heating device 104 is not limited to this, and for example, FIG. As shown in the schematic cross-sectional view, electrical cooling may be performed by providing a Peltier element 119 or the like on the surface facing the bottle 1. Such electrical cooling may be performed in combination with the above-described cooling medium 116 or may be performed alone.

  FIG. 8 is a perspective view showing a specific attachment state of the display unit 102 made of a liquid crystal display and the imaging unit 105 made of a camera to the circuit board 120 as seen from the front side of the bottle storage device 100. Incidentally, the front side of the bottle storage device 100 is the display unit 102 side. The circuit board 120 is attached to the case 111 (FIG. 2).

  9, 10 </ b> A, and 10 </ b> B are diagrams illustrating a dew condensation prevention mechanism of the imaging unit 105. The bottle storage device 100 has a dew condensation preventing function for preventing dew condensation on the lens of the imaging unit 105. As shown in FIG. 9, a motor 131 is attached to the case 111 via an attachment plate 132. A motor shaft 133 is attached to the rotation shaft of the motor 131. 10A and 10B are views of the imaging unit 105 viewed from the direction of the bottle 1. A motor shaft 133 is inserted into the long hole 134 a of the shutter 134. Thereby, according to the rotational position of the motor 131, the shutter 134 can be in the closed state shown in FIG. 10A and the open state shown in FIG. 10B. When the imaging is not performed, the closed state shown in FIG. 10A is set, and when the imaging is performed, the open state shown in FIG. 10B is set, so that condensation of the imaging unit 105 due to cooling can be suppressed.

  Next, a simple bottle storage device will be described. The simple bottle storage device described below does not have the display unit 102 formed of a liquid crystal display or the like.

  FIG. 11A and FIG. 11B which show the same reference numerals as those corresponding to FIG. 1 are diagrams showing a schematic configuration of a simplified bottle storage device 200 according to the embodiment. FIG. 11A is a perspective view illustrating an external configuration of the bottle storage device 200, and FIG. 11B is a schematic cross-sectional view illustrating an internal configuration of the bottle storage device 200. The bottle storage device 200 does not have the display unit 102 made of a liquid crystal display or the like, but has a notification unit 201 made of an LED or the like. One LED or a plurality of LEDs may be used.

  FIG. 12, in which parts corresponding to those in FIG. 2 are given the same reference numerals, is an exploded perspective view showing case parts constituting the bottle storage device 200. The case 211 is a case serving as a base for the bottle storage device 200. The imaging unit 105 is attached to the case 211 via the camera holder 216. The case 212 is a case that is an exterior of the bottle storage device 200. The tray 213 is a water receiver that receives water generated from the cooling / heating device 104 or the like. The upper lid 215 is detachably fixed to the upper surfaces of the cases 211 and 212 by the force of a magnet, for example.

  FIG. 13 is a perspective view of the upper lid 215 from the back side. Compared with the bottle storage device 100, the bottle storage device 200 has a configuration in which the containers constituting the cooling / cooling device 104 are not moved in the direction of approaching and separating from each other. For this reason, the upper lid 215 serves as a guide 215a. It has a simple configuration in which an annular protrusion that abuts on the inner peripheral surface of the container is formed.

  Since the bottle storage device 200 is configured not to move the containers constituting the cooling / cooling device 104 in the approaching and separating directions, the cam box 114 like the bottle storage device 100 can be omitted, as shown in FIG. In addition, the tray 213 can be easily assembled simply by inserting the containers constituting the cooling / heating device 104.

<2> Functional Configuration of Bottle Storage Unit Next, the functional configuration of the bottle storage units 100 and 200 will be described. Since the functional configuration of the bottle storage device 200 is simpler than that of the bottle storage device 100, the functional configuration of the bottle storage device 200 will be described first, and then the functional configuration of the bottle storage device 100 will be described.

<2-1> Functional Configuration of Bottle Storage Device 200 FIG. 15 is a block diagram showing a functional configuration of the bottle storage device 200. The bottle storage device 200 includes a cooling / heating device 104, an imaging unit 105, a control unit 221, an image analysis unit 222, an information management unit 223, a log information storage unit (log information) 224, a brand database (brand DB) 225, a notification unit 201, and An illumination unit 226 is included.

  The controller 221 controls the overall operation of the bottle storage device 200. The image analysis unit 222 analyzes the image captured by the imaging unit 105. The information management unit 223 uses the image analysis result obtained by the image analysis unit 222 and the brand image stored in the brand database 225 to perform brand analysis and verification. The information management unit 223 updates the log information in the log information storage unit 224 based on the collation result. Further, the control unit 221 controls the notification unit 201 based on the collation result in the information management unit 223. The illumination unit 226 illuminates the bottle 1 so that the imaging unit 105 can clearly image the bottle.

  FIG. 16 is a flowchart for explaining the operation of the bottle storage device 200.

  When the power is turned on, the control unit 221 of the bottle storage device 200 performs activation notification display by causing the LED of the notification unit 201 to emit light in a predetermined color, for example, in step S11. Next, in step S <b> 12, the control unit 221 determines whether the bottle 1 has been inserted based on the image obtained by the imaging unit 105. The determination as to whether or not the bottle 1 has been inserted may be made using the detection result of the weight sensor, for example, when the bottle base 117 is provided with a weight sensor. When determining that the bottle 1 is not inserted, the control unit 221 moves to step S13 and causes the notification unit 201 to perform a standby display indicating that the bottle 1 is waiting to be inserted.

  On the other hand, if the control part 221 judges that the bottle 1 was inserted, it will move to step S14 and will make the illumination part 226 light. In subsequent step S15, the imaging unit 105 performs bottle label photographing processing, and in the subsequent step S16, the information management unit 223 performs brand analysis and collation processing. In step S17, the information management unit 223 determines whether the bottle is different from the previously inserted bottle. If the bottle is different, the process proceeds to step S18 to update the insertion history log in the log information storage unit 224.

  In step S19, it is determined whether or not the control unit 221 is turned off. If the power is not turned off, the process returns to step S12.

  17A to 17D are diagrams showing the positional relationship between the label and the imaging unit 105 when the bottle 1 is inserted into the bottle storage device 200. FIG. 17A, 17B, and 17C are diagrams illustrating examples of the bottle 1 and a label attached thereto, and FIG. 17D is a position of the label and the imaging unit 105 when the bottle 1 is accommodated in the bottle storage devices 100 and 200. It is a figure which shows a relationship. As shown in FIG. 17D, the imaging unit 105 is preferably arranged at a position where the imaging center is near the center of the label.

  FIG. 18 is a flowchart showing the brand analysis and collation processing procedure performed by the information management unit 223 in step S16 of FIG.

  The information management unit 223 determines whether or not a character string has been acquired in step S21. If the information management unit 223 determines that the character string has been acquired, the information management unit 223 moves to step S22 to store the acquired character string in the brand database 225. Match. In step S23, the information management unit 223 determines whether there is matching data. If there is matching data, the information management unit 223 moves to step S24 and holds the collation result.

  On the other hand, if the information management unit 223 determines that the character string has not been acquired (step S21: No), or if there is no data matching the character string (step S23: No), the step The process moves to S25. In step S25, the information management unit 223 determines whether or not a feature pattern has been acquired. If it is determined that the feature pattern has been acquired, the information management unit 223 moves to step S26 to store the acquired feature pattern in the brand database 225. To match.

  In step S27, the information management unit 223 determines whether there is matching data. Incidentally, in step S27, it is determined whether there is matching data for the character string in addition to the feature pattern (that is, whether there is a matching result held in step S24). If there is, the process proceeds to step S28. In step S28, the information management unit 223 checks the collation result for the character string and the feature pattern, and records the collation result in the subsequent step S29. On the other hand, if the information management unit 223 determines that there is no data that matches both the feature pattern and the character string (step S27: No), the information management unit 223 moves to step S30 and cannot perform collation in the brand database 225. In step S31, it is determined that there is no collation result.

  19A to 19F are examples of captured images obtained by imaging the bottle 1 accommodated in the bottle storage device 200 by the imaging unit 105. FIG. 19A is a captured image taken at a wide angle from the front of the bottle 1, FIG. 19B is a captured image taken at a narrow angle from the front of the bottle 1, and FIG. 19C is slightly shifted from the front of the bottle 1. FIG. 19D is a captured image when the image is taken from the direction. FIG. 19D is an image obtained when the position of the bottle 1 is adjusted by rotating the bottle base 117 (FIG. 4) from the state of FIG. 19E is a captured image obtained by imaging a position without a label, and FIG. 19F is a captured image obtained by imaging a label on the back of the bottle.

  20A to 20C are diagrams illustrating examples of feature patterns that have been imaged.

  Incidentally, in the captured image shown in FIG. 19A, all of “SAKE”, “Cherry Blossom”, and “2010” are captured as character strings, and a plurality of feature patterns as shown in FIGS. 20A and 20B are also used as feature patterns. Can be said to be an ideal captured image. In the captured images shown in FIGS. 19B and 19D, “sakura” and “2010” are captured as character strings, and a feature pattern as illustrated in FIG. 20C is captured as a feature pattern.

  FIG. 21 shows an example of an information table stored in the brand database 225. Information such as brand type, CID (content ID), brand name, brewer information, corresponding store, etc. is stored in association with the character string and feature pattern which are the judgment information. As a result, the information management unit 223 uses the brand database 225 to read information such as brand type, CID (content ID), brand name, brewer information, and corresponding store from the collated character string and feature pattern. Can do.

  FIG. 22 shows an example of the bottle insertion history log stored in the log information storage unit 224. The bottle insertion history log may be recorded when a bottle is inserted or when a predetermined time has elapsed (for example, every 10 minutes). The bottle insertion history log includes date, time, CID (content ID), accuracy, drinking record, and the like. The accuracy is the likelihood of collation by the information management unit 223. As a drinking record, “True” is recorded when the accuracy is equal to or higher than a predetermined threshold position, and “False” is recorded when the accuracy is lower than the predetermined threshold. The bottle storage device 200 uses this bottle insertion history log to determine how often the bottle 1 indicated by the content ID has been inserted (that is, how often a certain type of beverage has been drunk), or from the bottle 1 of a certain content ID to another content ID. It is possible to notify the user of this by recording the time when the bottle 1 was replaced, and notifying or displaying it.

<2-2> Functional Configuration of Bottle Storage Device 100 FIG. 23 in which the same reference numerals are assigned to the corresponding parts to FIG. 15 is a block diagram showing the functional configuration of the bottle storage device 100. The bottle storage device 100 includes an operation input unit 103, a display unit 102, and a voice input / output unit 141 in addition to the configuration of the bottle storage device 200. Actually, the bottle storage device 200 also has an operation input unit 103, which is omitted in FIG. Further, the bottle storage device 200 may have the voice input / output unit 141. The critical difference between the bottle storage devices 100 and 200 is that the bottle storage device 100 has a display unit 102 formed of a liquid crystal display or the like.

  FIG. 24 is an example of external notification by the bottle storage device 100. The bottle storage device 100 notifies the operation state externally by light from the LED (notification unit 102a), display by the liquid crystal display (display unit 102), and audio output (audio input / output unit 141). In FIG. 24, each row corresponds to each other. For example, during startup, the LED emits white light, a startup logo is displayed on the liquid crystal display, and startup sound is output from the voice input / output unit 141. Further, when waiting for the insertion of the bottle 1, the LED emits blue light, a standby list is displayed on the liquid crystal display, and a standby sound is output from the voice input / output unit 141.

  FIG. 25, in which parts corresponding to those in FIG. 16 are assigned the same reference numerals, is a flowchart for explaining the operation of the bottle storage device 100. Only the procedure different from FIG. 16 will be described below. In step S41, the bottle storage device 100 displays the collation result as an image on the display unit. In addition, the control unit 221 of the bottle storage device 100 determines whether or not there is an operation input from the operation input unit 103 or a voice input from the voice input / output unit 141 in step S42. Move on to S43. In step S43, favorite registration processing and purchase processing are performed. For example, the higher the number of times the electrostatic button as the operation input unit 103 is pressed, the higher the favorite degree is registered.

  FIG. 26 shows an example of an image displayed by the display unit 102. The image shown in FIG. 26 is stored, for example, in the brand database 225 in advance. Specifically, general-purpose labels, specific labels, matching dishes, positions, brewery information, store menus, etc. corresponding to each content ID (CID) are stored, and information corresponding to the content ID of the collation result Is displayed on the display unit 102. Incidentally, the specific label is, for example, an image of a label with a high advertising effect provided in advance by a purchaser. Matching dishes are images showing dishes that match the content ID. The position is an image representing the taste of the content ID. The brewery information is an image representing the face or area of the brewery. The store menu is an image of a menu that matches the content ID in the store menu when the bottle storage device 100 is used in a specific store.

  As described above, in the bottle storage device 100 according to the present embodiment, various information related to the inserted bottle 1 is displayed by the display unit 102, so that the user can enjoy drinking more. Moreover, since the information of the dish which suits a bottle drink is displayed, the demand for not only the bottle drink but also the dish is stimulated. Therefore, when the bottle storage device 100 of the present embodiment is used in a restaurant or the like, it leads to an improvement in sales of dishes. Note that the same information as the image displayed on the display unit 102 may be output as audio from the audio input / output unit 141.

  FIG. 27A shows an example of a collation result image displayed by the display unit 102 in step S41. In the example of FIG. 27A, the current time “20:06”, the favorite frequency (number of stars in the figure) registered up to the previous time, and the like are displayed together with the label image authenticated by the collation. In addition, when not having the display unit 102 as in the bottle storage device 200 (FIG. 11) but having only the notification unit 201, the LEDs that are the notification unit 201 are collated as illustrated in FIG. 27B. What is necessary is just to make it light-emit in the specific color which shows this.

  FIG. 28 shows an example of a table obtained by favorite registration processing. The table of FIG. 28 is stored in the log information storage unit 224. The table in the figure is created for each user ID (UID). For each content ID (C11, C12,...), The registration time when the favorite registration is performed, the favorite frequency, and the cumulative determination number are recorded. The cumulative determination number is the number of times the content ID has been registered so far.

  If it has the display part 102 which consists of a liquid crystal display etc. like the bottle storage device 100, as shown to FIG. 27A, a favorite frequency can be displayed with an image. On the other hand, as long as the bottle storage device 200 does not have the display unit 102 but has the notification unit 201 composed of a plurality of LEDs, as shown in FIG. 29A and FIG. The user can be notified of the favorite frequency by, for example, emitting a certain number of LEDs.

  In the present embodiment, the case has been described where the favorite frequency is determined by the number of times the user presses the operation input unit 103. However, for example, the favorite frequency may be determined by the number of content IDs inserted into the bottle storage device 100. Good. That is, since favorite beverages (bottles) tend to be inserted into the bottle storage device 100 more frequently, the favorite frequency may be determined based on the number of times. Alternatively, the favorite frequency may be determined by comprehensively determining the number of times the operation input unit 103 is pressed and the number of insertions.

<2-3> Functional configuration of bottle storage device having communication function with outside FIG. 30 is a functional configuration of a bottle storage device 300 having a communication function with the outside, and FIG. FIG. The bottle storage device 300 includes a communication unit 301 in addition to the functions of the bottle storage device 100 of FIG. The communication unit 301 can communicate with the cloud server 400 via the Internet 500.

  The cloud server 400 includes a storage device management unit 401, a log information storage unit 402, and a brand database 403. The cloud server 400 can communicate with a plurality of bottle storage devices, can record log information of a plurality of bottle storage devices in the log information storage unit 402, and stores a large amount of brand data in the brand database 403. it can. That is, the log information storage unit 402 and the brand database 403 of the cloud server 400 can store a larger amount of data than the log information storage unit 224 and the brand database 225 of the bottle storage device 300. The cloud server 400 and the bottle storage device 300 have a master-slave relationship.

  When the collation result is not obtained even if collation is performed using the brand database 225, the bottle storage device 300 requests collation from the cloud server 400 via the notification unit 301. At this time, the bottle storage device 300 sends the captured image to be collated or the image analysis result to the cloud server 400. The storage device management unit 401 of the cloud server 400 compares the image analysis result based on the received captured image or the received image analysis result with the image stored in the brand database 403, and stores the verification result in a bottle. To vessel 300. Thereby, since collation using more label images than the label images stored in the brand database 225 of the bottle storage device 300 can be performed, there is a high possibility of finding a label image that matches the captured label image. Become. Moreover, since more information associated with the content ID obtained by the collation can be stored in the cloud server 400, the amount of information that can be displayed or output by the bottle storage device 300 can be increased.

  Note that the log information storage unit 224 and the brand database 225 of the bottle storage device 300 may be omitted, and the cloud server 400 may perform all of the verification processing and log information storage processing. The search for the label image that matches the captured label image and the search for the information corresponding to the content ID are not limited to the cloud server 400, and may be performed using the Internet space including the cloud server 400.

  FIG. 31, in which parts corresponding to those in FIG. 18 are assigned the same reference numerals, is a flowchart showing brand analysis and verification processing procedures performed by the information management unit 223 of the bottle storage device 300 having a communication function. Only the procedure different from that shown in FIG. 18 will be described below. If the information management unit 223 determines in step S30 that collation in the brand database 225 is impossible, the information management unit 223 proceeds to step S50. In step S50, the information management unit 223 determines whether there is image data that matches the captured character string and feature pattern in the Internet space including the cloud server 400. If there is matching image data, step S51 is performed. In step S52, a search result (that is, matching image data) is recorded in the brand database 403. If there is no matching image data, it is determined in step S52 that there is no matching result.

<2-4> Cooperation with Information Device FIG. 32 in which the same reference numerals are assigned to the corresponding parts to FIG. 30 shows that the bottle storage device 300 can communicate with the information device 600 such as a smartphone via the communication unit 301. 2 is a block diagram showing a system configuration. The information device 600 includes a communication unit 601, a display unit 602, a control unit 603, an operation input unit 604, and the like.

  In the system shown in FIG. 32, the information device 600 can access the bottle storage device 300, read the log information stored in the log information storage unit 224 of the bottle storage device 300, and display it on the display unit 602. Yes. As a result, the user causes the information device 600 to display information he / she wants to see from the information stored in the bottle storage device 300 independently of the information displayed on the display unit 102 of the bottle storage device 300. Can do.

  As shown in FIG. 33, even if the bottle storage device 200 does not have the display unit 102 such as a liquid crystal display, it is stored in the bottle storage device 200 if a communication unit capable of communicating with the information device 600 is provided. The displayed information can be displayed on the display unit 602 of the information device 600.

FIG. 34 shows the contents of the favorite table stored in the log information storage unit 224 when the information device 600 is linked. In addition to the information shown in FIG. 28, access history and purchase log information is recorded. In the example of FIG. 34, a user with user ID = “001” removes a bottle with content ID = C12 from a store of EC (Electronic Commerce) -2.
The purchase is recorded.

<2-5> Functional Configuration of Bottle Storage Unit Having Rotation and Lifting Mechanism Already with reference to FIG. 4, the bottle storage unit 100 can image the bottle 1 from various angles by rotating the bottle base 117. I explained that.

  FIG. 35, in which parts corresponding to those in FIG. 30 are assigned the same reference numerals, is a block diagram showing a functional configuration of a bottle storage 700 having a function of rotating and raising / lowering the bottle base 117. The bottle storage device 700 has a mechanism for raising and lowering the bottle table 117 in addition to a rotating mechanism for rotating the bottle table 117 similar to the bottle storage device 100 as a mechanism. The bottle storage device 700 controls the rotary motor 701 by the control unit 221 and also controls the elevation control unit 702.

  FIG. 36, in which parts corresponding to those in FIG. 16 are assigned the same reference numerals, is a flowchart for explaining the operation of the bottle storage device 700. In the process of FIG. 36, since the process of step S60-S64 is added compared with the process of FIG. 16, the process is demonstrated.

  In step S <b> 60, the control unit 221 determines whether the label is facing the front (that is, whether the label is facing the imaging unit 105) based on the analysis result by the image analysis unit 222. Specifically, the image analysis unit 222 determines the appearance of the label in the image. More specifically, the image analysis unit 222 determines whether or not the label appears to the extent that the brand of the bottle can be specified in the bottle image. This determination can be made based on, for example, whether the element recognition rate is high or the edge of the label. If the control unit 221 determines in step S60 that the label is not facing the front, the process proceeds to step S61 to rotate the bottle motor 117 by rotating the rotation motor 701, and then the imaging unit 105 again in step S15. The label imaging process is performed. Control part 221 repeats processing of Steps S15-S60-S61-S15 until it judges that a label is facing the front.

  Note that the bottle storage device 700 may take an image while rotating the bottle. For example, the bottle storage device 700 may rotate the bottle to a preset angle regardless of whether or not the label is recognized, and take an image every time the bottle rotates by a predetermined angle. Further, the bottle storage device 700 may control the rotation direction according to the recognized label portion. For example, the bottle storage device 700 may rotate the bottle counterclockwise when the right end of the label is recognized.

  When the control unit 221 determines in step S60 that the label is facing the front, the control unit 221 moves to step S62 and determines whether or not the height is appropriate. Specifically, the image analysis unit 222 determines the appearance of the label in the image. More specifically, the image analysis unit 222 determines whether or not the label appears to the extent that the brand of the bottle can be specified in the bottle image. This determination can also be made based on, for example, whether the element recognition rate is high or the edge of the label. If the control unit 221 determines that the height is not appropriate in step S62, the control unit 221 moves to step S63 and adjusts the height of the bottle base 117 by the lifting control unit 702 and the lifting mechanism, and then in step S15, the label by the imaging unit 105 is again used. Perform imaging processing. Control part 221 repeats processing of Steps S15-S60-S62-S63-S15 until it judges that the height of a label is appropriate. Moreover, the bottle storage device 700 displays a collation result image in step S64.

  The bottle storage device 700 may take an image while raising and lowering the bottle. For example, the bottle storage device 700 may raise or lower the bottle to a preset height regardless of whether or not the label is recognized, and take an image every time the bottle rises or falls by a predetermined height. Further, the bottle storage device 700 may control the raising and lowering direction according to the recognized label portion. For example, the bottle storage device 700 may raise the bottle when the upper end of the label is recognized.

  Incidentally, when labels are attached to a plurality of positions of the bottle 1, a plurality of labels can be imaged by rotation and elevation.

  Note that the bottle storage device 700 may output information that prompts the user to rotate the bottle instead of or together with the rotation of the bottle. For example, the bottle storage device 700 may display an image prompting the user to rotate the bottle on the display unit 102. Further, the bottle storage device 700 may display the image on the display unit 102 in accordance with the recognized label portion. For example, when the right end of the label is recognized, the bottle storage device 700 may display an image that prompts the user to rotate the bottle counterclockwise on the display unit 102. Information that prompts the user to rotate the bottle may be notified to the user by the notification unit 201.

<3> Other configuration examples of bottle storage device <3-1>
In the above-described embodiment, the case where a label image is captured by the imaging unit 105 including a camera has been described. However, the imaging unit 105 is not limited to a camera, and a scanner may be used. FIG. 37A and FIG. 37B show an example of the configuration. FIG. 37A is a perspective view showing an example in which the bottle storage device 200 is provided with the scanner 801, and FIG. 37B is a perspective view showing an internal state when the bottle storage device 200 is provided with the scanner 801. In short, if a vertically long scanner 801 along the bottle 1 is provided and the bottle 1 or the scanner 801 is rotated, the label can be read.

  As shown in FIG. 38, an annular scanner 802 may be provided at the opening of the bottle housing portion 101. Thereby, the image of the label can be read when the bottle 1 is inserted into the bottle storage device 200.

<3-2>
In the above-described embodiment, a case has been described in which the operation input unit 103 including an electrostatic button or the like as illustrated in FIG. As shown in FIG. 39B, a capacitive sensor 103b is arranged in a cross shape on the back of the button 103a to detect user operation in the up / down / left / right direction, and select an image to be displayed on the display unit 102 accordingly. You may be able to do it. In this way, the user can select the image he wants to see. Note that when the display unit 102 is a touch panel display, the image may be selected by touching the display unit 102. That is, the display unit 102 may also serve as the operation input unit 103.

<3-3>
In the case of having a rotation mechanism for rotating the bottle 1 such as the bottle base 117 and a motor, information on the rotation of the bottle 1 may be recorded as a log. FIG. 40 shows an example in which rotation information is also added to the insertion history log. By looking at the insertion history log of FIG. 40, it is possible to know that the bottle 1 has been rotated and the back label has been photographed, and the date and time.

<3-4>
FIG. 41, in which parts corresponding to those in FIG. 30 are assigned the same reference numerals, is a block diagram showing a functional configuration of a bottle storage device 900 capable of personal authentication. The bottle storage device 900 includes a fingerprint input unit 901 and a fingerprint authentication unit 902 in addition to the functions of the bottle storage device 300 of FIG. Thereby, since the bottle storage device 900 can identify the user, the control unit 221 can display, for example, recommended information associated with the identified user. In addition, after authentication, the product can be purchased via the Internet 500 or the like.

  42A and 42B show a configuration example of the fingerprint input unit 901. FIG. 42A and 42B, the operation input unit 103 also serves as the fingerprint input unit 901. 42A shows an example in which a ring-type fingerprint input unit 901 is mounted on the operation input unit 103 of the bottle storage device 100, and FIG. 42B shows that a line-type fingerprint input unit 901 is mounted on the operation input unit 103 of the bottle storage device 100. It is an example. Note that the ring-type and line-type fingerprint input units 901 are well-known configurations used for smartphones and the like, and thus description thereof is omitted here.

<3-5>
In the above-described embodiment, an example in which the display unit 102 mainly displays the brand specified by the information management unit 223 and related information related to the specified brand has been described. An image as shown in FIG. 43 may be displayed. FIG. 43 shows a bubble 151 rising while shaking from side to side in addition to the image of the label on the display unit 102 because the beverage of the specified brand inserted into the bottle storage device is a sparkling beverage. In this way, the user can grasp the characteristics of the beverage in the bottle storage device 100 at a glance.

<3-6>
For example, a music output unit is provided in the brand database 225 for storing music information in association with a content ID (CID), and playing back and outputting music corresponding to the inserted bottle (that is, content ID) brand. Also good. In this way, music that matches the bottle brand will flow, so you can enjoy drinking more. Specifically, as shown in FIG. 44, sound source information (sound source) may be stored in a table storing display images to be displayed on the display unit 102 in association with content IDs. This table is stored in the brand database 225, for example. The sound source may be stored in the bottle storage devices 100 and 200, or may be acquired via the Internet.

<3-7>
If a curved mirror is provided between the imaging unit 105 of the bottle storage device 100, 200 and the bottle 1, the entire label can be imaged even in a narrow space, and the bottle storage device 100, 200 can be further downsized. . In order to capture the entire label by the imaging unit 105 including a camera or the like, it is necessary to separate the bottle 1 and the imaging unit 105 by a predetermined distance (for example, 5 cm) or more from the viewpoint of the viewing angle of the camera. If the image pickup unit 105 is simply arranged in a direction perpendicular to the surface of the bottle 1, the outer shape of the bottle storage devices 100 and 200 must be enlarged accordingly. By providing the curved mirror, the entire label can be put in the field of view of the camera even when the distance between the bottle 1 and the camera is reduced, so that the bottle storage devices 100 and 200 can be downsized.

  45A to 45C are diagrams illustrating examples of label photographing using the curved mirror 903. 45A is a diagram illustrating the bottle 1 to be imaged, FIG. 45B is a schematic diagram illustrating an arrangement example of the curved mirror 903 seen from the front direction, and FIG. 45C is an arrangement example of the curved mirror 903 seen from the side surface direction. FIG. 45D is a schematic diagram illustrating an arrangement example of the curved mirror 903 viewed from the upper direction. A curved mirror 903 is disposed along the vertical direction of the bottle 1 inserted into the bottle storage device 100, and an imaging unit (camera) 105 is disposed so as to photograph the mirror surface of the curved mirror 903. In the illustrated example, the imaging unit 105 is disposed below the curved mirror 903. The curved mirror 903 is curved so that, for example, the label is enlarged toward the upper part of the label farther from the image pickup unit (camera) 105. By doing in this way, even if the distance between the imaging unit (camera) 105 and the label is short, the entire label can be put in the field of view of the imaging unit (camera) 105. Incidentally, when the curved mirror 903 is used, a curved captured image is obtained. Therefore, the captured image may be returned to an uncurved image by the image analysis unit 222 (FIG. 15) or the like.

<3-8>
It is also possible to output various information from the voice input / output unit 141 as voice. For example, the brand of the bottle 1 inserted into the bottle storage device 100 and information related to the brand may be output as audio. That is, it is good also as a structure which carries out the audio | voice output which carries out the audio | voice output of the related information regarding the brand specified by the information management part 223 and / or the specified brand.

  Moreover, when the sensor which detects the remaining amount of the drink in the bottle 1 is provided, you may notify a user or a store clerk by voice output that the remaining amount of the drink has decreased. Of course, the fact that the remaining amount is low may be notified by an image or light emission of the LED.

  Further, the bottle storage devices 100 and 200 may have an interactive configuration. For example, in response to a voice request input from the voice input / output unit 141, information read from the log information storage unit 224 or the brand database 225 may be output from the voice input / output unit 141.

<3-9>
The bottle storage device according to the present embodiment may have a configuration in which a power source is obtained via a cord, but may also have a system configuration in which a power source is obtained cordlessly by non-contact power feeding. If the non-contact power supply is used, the bottle storage device 100, 200 can be easily moved to a desired table without the cord being in the way.

<3-10>
The bottle storage device of the present embodiment may adjust the distance between the bottle 1 and the imaging unit 105. Specifically, the bottle storage device further includes a mechanism (hereinafter also referred to as a front-rear movement unit) that moves the bottle in a direction (hereinafter also referred to as a front-rear direction) that connects the stored bottle 1 and the imaging unit 105. The controller 221 controls movement of the bottle in the front-rear direction by the front-rear moving unit. More specifically, when it is determined that label recognition is difficult, the control unit 221 causes the front / rear moving unit to move the bottle in the front / rear direction. For example, the determination as to whether or not it is difficult to recognize the label may be a determination of whether or not the label in the image is blurred or a degree thereof, or a determination of the position (center position) of the bottle in the front-rear direction. The back-and-forth moving unit may be a device using the cooling / heating device 104. For example, the back-and-forth moving unit may push the bottle to the center of the housing unit 101 using each part of the cooling / heating device 104 including two or more parts.

<3-11>
The bottle storage device of the present embodiment may control illumination for imaging. Specifically, the control unit 221 causes the imaging unit 105 to capture images under a plurality of illumination conditions, and selects a label recognition image from the obtained plurality of images. For example, the control unit 221 causes the illumination unit 226 to illuminate under a plurality of illumination conditions, and causes the imaging unit 105 to capture images under each illumination condition. The image analysis unit 222 evaluates the label recognition rate in the image obtained by the imaging unit 105. And the image with the highest evaluation among the obtained images is used for the specific process of the brand.

  Further, a pattern for recognizing the gloss of the label may be provided on the inner surface of the bottle storage device of the present embodiment, and the bottle storage device may use the pattern for label recognition. Here, the label of the bottle may be made of a glossy material such as gold or silver. In that case, there is a possibility that erroneous recognition of the label may occur when the illumination for imaging is reflected by the label and part or all of the label becomes glossy. Therefore, a specific pattern is applied around the imaging unit 105. Then, when the glossy portion is present in the image obtained by the imaging unit 105, the image analysis unit 222 determines whether the specific pattern is reflected in the glossy portion. When it is determined that the specific pattern is reflected in the glossy portion, the image analysis unit 222 performs label recognition processing on the assumption that the glossy portion is also a part of the label.

<3-12>
The bottle storage device of the present embodiment may control the imaging of the bottle according to the position where the bottle is placed. Specifically, the bottle storage device further includes a weight sensor, and the control unit 221 controls the focusing of the imaging unit 105 based on information obtained from the weight sensor. For example, the bottle storage device includes a plurality of weight sensors, and the control unit 221 determines the position of the bottle in the storage unit 101 (or bottle base 117) based on information obtained from the plurality of weight sensors. If it is determined that the bottle position is closer to the imaging unit 105 than the center of the storage unit 101, the control unit 221 causes the imaging unit 105 to set the focus position in the vicinity. If it is determined that the bottle position is farther from the imaging unit 105 than the center of the storage unit 101, the control unit 221 causes the imaging unit 105 to set the focus position far away. Further, the focusing of the imaging unit 105 may be controlled according to the thickness of the bottle (in other words, the width in the front-rear direction).

  Further, the bottle storage device may notify the user of the remaining amount of the bottle using information obtained from the weight sensor. For example, the image analysis unit 222 determines whether the color of the bottle is a predetermined color (for example, brown or black) based on the bottle image obtained from the imaging unit 105. When the color of the bottle is a predetermined color, the information management unit 223 calculates the weight of the bottle based on the information obtained from the weight sensor, and the internal capacity obtained by subtracting the weight of the bottle container from the weight of the bottle, that is, Calculate the remaining amount. Then, the control unit 221 causes the display unit 102 to display an image indicating the calculated remaining amount. For example, the image may be superimposed on a brand that has already been displayed, or may be displayed separately from the brand. The control unit 221 may also notify the notification unit 102a of the calculated remaining amount. For example, the remaining amount may be displayed on the notification unit 102a in a scale.

<3-13>
FIG. 46 is a schematic diagram showing a specific example of a system constructed using the bottle storage device of the above-described embodiment. The bottle storage device may be any bottle storage device in the above-described embodiment as long as a communication unit is provided. In FIG. 46, the bottle storage device 300 is used as an example.

  The group 1000 is, for example, a company, an organization, a household, etc., and its size is not limited. The group 1000 includes a plurality of bottle storage devices 300 and a home gateway 1001. Some of the plurality of bottle storage devices 300 can be connected to the Internet, and others can not be connected to the Internet. There may be one that cannot be connected to the Internet by itself but can be connected to the Internet via the home gateway 1001. The group 1000 includes a user 1002 who uses the bottle storage device 300. The bottle storage device 300 may be able to communicate with an electronic device 1003 such as a smartphone used by the user 1002.

  The data center operating company 1100 has a cloud server 1101. The cloud server 1101 is a virtualization server that cooperates with various devices via the Internet. It mainly manages huge data (big data) that is difficult to handle with ordinary database management tools. The data center operating company 1100 performs data management, management of the cloud server 1101, operation of the data center that performs them, and the like.

  Each bottle storage device 300 may communicate indirectly with the cloud server 1101 via a personal gateway such as a mobile phone or a wireless communication router. Each bottle storage device 300 may communicate directly with the cloud server 1101 without going through a gateway.

  Here, the data center operating company 1100 is not limited to a company that performs only data management, operation of the cloud server 1101, and the like. For example, as shown in FIG. 47A, there may be a case where a device manufacturer that develops and manufactures one of a plurality of bottle storage devices 300 performs data management and operation of the cloud server 1101 together. In this case, the device manufacturer corresponds to the data center operating company 1100. The data center operating company 1100 is not limited to one company. For example, as shown in FIG. 47B, there may be a case where the device manufacturer and another management company jointly or share the data management and operation of the cloud server 1101. In this case, both or either one corresponds to the data center operating company 1100.

  The service provider 1200 has a server 1201. The server 1201 mentioned here includes, for example, a memory in a personal PC regardless of the scale. Further, the service provider 1200 may not have the server 1201.

  In the above service, the home gateway 1001 is not essential. For example, when the cloud server 1101 performs all data management, the home gateway 1001 becomes unnecessary. In addition, there may be no device that cannot be connected to the Internet by itself, as in the case where every device in the home is connected to the Internet.

  Next, the flow of information in the service will be described.

  First, the bottle storage device 300 of the group 1000 transmits each log information to the cloud server 1101 of the data center operating company 1100. The cloud server 1101 accumulates log information of the bottle storage device 300.

  The log information may be provided directly to the cloud server 1101 from the plurality of bottle storage devices 300 themselves via the Internet. Further, log information may be once accumulated from the plurality of bottle storage devices 300 to the home gateway 1001 and provided to the cloud server 1101 from the home gateway 1001.

  Next, the cloud server 1101 of the data center operating company 1100 provides the collected log information to the service provider 1200 in a certain unit. Here, it may be a unit in which the information collected by the data center operating company 1100 can be organized and provided to the service provider 1200, or a unit requested by the service provider 1200. Although described as a fixed unit, it may not be fixed, and the amount of information to be provided may change depending on the situation.

  The log information is stored in the server 1201 held by the service provider 1200 as necessary. Then, the service provider 1200 organizes the log information into information suitable for the service provided to the user, and provides it to the user. The user to be provided may be a user 1002 using any one of the plurality of bottle storage devices 300, or a user 1300 managing and operating the plurality of bottle storage devices 300. The user 1300 is, for example, a restaurant manager. The user to be provided may be an external user.

  The service to the user may be provided to the user directly from the service provider 1200, for example. Further, the service to the user may be provided to the user via the cloud server 1101 of the data center operating company 1100 again, for example. Further, the cloud server 1101 of the data center operating company 1100 may organize the log information into information suitable for the service provided to the user and provide the service provider 1200 with the log information.

  Note that the user 1002 and the user 1300 may be different or the same.

<4> Effects of the Embodiment As described above, according to the present embodiment, the imaging unit 105 that images the bottle 1 accommodated in the accommodation unit 101 and the image of the bottle 1 obtained by the imaging unit 105. And the information management unit 223 that specifies at least the brand of the bottle, thereby improving the visibility of the label and further providing a drinking environment that makes drinking enjoyable. , 200, 300, 700, 900 and a bottle storage device utilization system can be realized.

  The present invention is not limited to the above-described embodiments in terms of the type, arrangement, number, etc. of the members, and departs from the gist of the invention, such as appropriately replacing the constituent elements with those having the same operational effects. It can change suitably in the range which does not.

  The bottle storage device of the present disclosure includes a storage unit that stores a bottle, a cooling / heating unit provided around the storage unit, a rotating unit that rotates the bottle stored in the storage unit, and a storage unit. An imaging unit that images the bottle that has been performed, a control unit that controls rotation of the bottle of the rotation unit and imaging of the imaging unit based on an image of the bottle obtained by the imaging unit, and the control unit An information management unit that identifies at least the brand of the bottle based on the image of the bottle obtained by the control of the output, and an output that outputs at least one of the brand specified by the information management unit and related information related to the brand A section. Thereby, the information regarding the brand of the bottle to be cooled can be presented to the user with good visibility.

  Further, in the bottle storage device of the present disclosure, the control unit controls the rotation of the bottle of the rotating unit based on the appearance of the label of the bottle in the image of the bottle, and according to the rotation of the bottle Control imaging of the imaging unit. Thus, the brand can be efficiently identified by controlling the rotation and imaging while paying attention to the label.

  Further, in the bottle storage device of the present disclosure, the control unit rotates the bottle in the rotating unit when the bottle label is not reflected in the image of the bottle to the extent that the brand of the bottle can be specified, The imaging unit is caused to image the bottle in accordance with the rotation of the bottle. Thereby, rotation operation can be optimized by rotating when the brand cannot be specified.

  Further, in the bottle storage device of the present disclosure, whether or not the label of the bottle is reflected to the extent that the brand of the bottle can be specified is determined according to at least one of the degree of recognition of the element of the label and the aspect of the edge of the label. It is judged based on one. Thereby, it can be rotated to such an extent that a label can be recognized more correctly, and rotation operation can be made more appropriate.

  Further, in the bottle storage device of the present disclosure, the control unit causes the rotation unit to rotate the bottle at a predetermined angle, causes the imaging unit to image the bottle every rotation of the bottle at a predetermined angle, and the bottle In the image of the bottle obtained at every rotation of the predetermined angle, when the bottle label is reflected to the extent that the brand of the bottle can be specified, the rotation unit stops the rotation of the rotation unit. Thereby, since it stops in front of a label, rotation becomes unnecessary for recognition after the next time.

  Moreover, the bottle storage device of the present disclosure further includes an elevating unit that elevates and lowers the bottle accommodated in the accommodating unit, and the control of the control unit includes control of elevating and lowering the elevating unit. Thereby, even if it is a case where the label has deviated from the imaging region in the vertical direction of the bottle, the label can be recognized.

  Further, in the bottle storage device of the present disclosure, the control unit controls the rotation of the bottle of the rotating unit and the raising / lowering of the bottle of the lifting unit based on the appearance of the label of the bottle in the image of the bottle. The imaging of the imaging unit is controlled according to the rotation and elevation of the bottle. Thus, the brand can be efficiently identified by controlling the rotation and imaging while paying attention to the label.

  Further, in the bottle storage device of the present disclosure, the control unit rotates the bottle to the rotating unit and rotates the bottle when the bottle label is not reflected in the bottle image so as to identify the brand of the bottle. The bottle is moved up and down by the lifting unit, and the bottle is imaged by the imaging unit according to the rotation and lifting of the bottle. Thereby, rotation operation can be optimized by rotating when the brand cannot be specified.

  Further, the bottle storage device of the present disclosure includes a brand database that stores a plurality of brand label images, and the information management unit is stored in the bottle label image obtained by the imaging unit and the brand database. The brand of the bottle is specified by collating with the label image.

  In the bottle storage device of the present disclosure, the output unit includes a display unit that displays at least one of the brand specified by the information management unit and related information related to the specified brand.

  The bottle storage device according to the present disclosure further includes a communication unit that transmits to the external device at least one of the brand specified by the information management unit and related information related to the specified brand.

  The bottle storage device according to the present disclosure further includes a log information storage unit that stores log information related to the bottle inserted into the storage unit.

  Further, the bottle storage device of the present disclosure includes a brand database that stores a plurality of brand label images, and the information management unit is stored in the bottle label image obtained by the imaging unit and the brand database. The brand name of the bottle is specified by collating with the label image, and the log information storage unit stores at least the brand specified by the information management unit as the log information.

  The bottle storage device according to the present disclosure further includes an operation input unit capable of inputting a favorite degree of the user by the brand, and the log information storage unit stores the favorite degree in association with the brand.

  Moreover, in the bottle storage device of the present disclosure, the related information regarding the brand displayed by the display unit includes at least one of a matched dish, taste, brewery information, and a favorite degree.

  Moreover, in the bottle storage device according to the present disclosure, the related information related to the brand transmitted by the communication unit includes at least one of a matched dish, taste, brewery information, and favorite degree.

  The bottle storage device according to the present disclosure further includes a curved mirror, and the imaging unit images the bottle through the curved mirror.

  Further, the system of the present disclosure is a system including a bottle storage device and an information processing device, and the bottle storage device includes a storage unit that stores the bottle, a cooling / heating unit provided around the storage unit, A rotation unit that rotates the bottle stored in the storage unit, an imaging unit that images the bottle stored in the storage unit, and an image of the bottle obtained by the imaging unit, A communication unit that receives a recognition result about an image and related information related to the brand of the bottle, a control unit that controls rotation of the bottle of the rotating unit and imaging of the imaging unit based on the recognition result, and the brand An output unit that outputs related information, wherein the information processing device receives an image of the bottle and transmits related information about the recognition result and the brand, and the bottle Recognizing an object appearing in an image, and a data management unit configured to specify at least the bottle stock based on the image of the bottle.

  INDUSTRIAL APPLICABILITY The bottle storage device and system of the present invention can obtain an effect that information relating to the brand of the bottle to be cooled can be presented to the user with good visibility, and includes a bottle storage device such as a wine bottle and a bottle storage device. It is suitable as.

DESCRIPTION OF SYMBOLS 1 Bottle 100, 200, 300, 700, 900 Bottle storage device 101 Accommodating part 102, 602 Display part 102a, 201 Notification part 103, 604 Operation input part 104 Cooling / heating device 105 Imaging part 116 Cooling / heating medium 117 Bottle base 118 Bearing base 141 Audio Input / output unit 151 Bubble 221 and 603 Control unit 222 Image analysis unit 223 Information management unit 224 and 402 Log information storage unit 225 and 403 Brand database 226 Illumination unit 301 and 601 Communication unit 400 Cloud server 401 Storage device management unit 500 Internet 600 Information Device 701 Rotation motor 702 Elevating control unit 801, 802 Scanner 901 Fingerprint input unit 902 Fingerprint authentication unit 903 Curved mirror

Claims (18)

An accommodating part for accommodating the bottle;
A cooling / heating unit provided around the housing unit;
A rotating part for rotating the bottle accommodated in the accommodating part;
An imaging unit for imaging the bottle stored in the storage unit;
A control unit that controls rotation of the bottle of the rotating unit and imaging of the imaging unit based on an image of the bottle obtained by the imaging unit;
An information management unit that identifies at least the brand of the bottle based on the image of the bottle obtained by the control of the control unit;
An output unit that outputs at least one of the brand specified by the information management unit and related information about the brand;
Bottle storage device with. The control unit controls the rotation of the bottle of the rotating unit based on the appearance of the label of the bottle in the image of the bottle, and controls the imaging of the imaging unit according to the rotation of the bottle.
The bottle storage device according to claim 1. The control unit rotates the bottle in the rotating unit when the bottle label does not appear to the extent that the brand of the bottle can be specified in the bottle image, and causes the imaging unit to rotate according to the rotation of the bottle. Image the bottle;
The bottle storage device according to claim 2. Whether the label of the bottle is reflected to the extent that the brand of the bottle can be identified is determined based on the degree of recognition of the element of the label and at least one of the aspects of the edge of the label.
The bottle storage device according to claim 3. The controller is
Rotate the bottle every predetermined angle to the rotating part,
Let the imaging unit image the bottle every rotation of the bottle at a predetermined angle,
When the bottle label obtained in each rotation of the bottle at a predetermined angle reflects the bottle label to the extent that the brand of the bottle can be specified, the rotation unit stops the rotation of the rotation unit,
The bottle storage device according to claim 3 or 4. An elevating part for raising and lowering the bottle accommodated in the accommodating part;
The control of the control unit includes control of lifting and lowering of the lifting unit,
The bottle storage device according to any one of claims 1 to 5. The control unit controls the rotation of the bottle of the rotating unit and the raising and lowering of the bottle of the lifting unit based on the appearance of the label of the bottle in the image of the bottle, and according to the rotation and lifting of the bottle Controlling imaging of the imaging unit;
The bottle storage device according to claim 6. The controller, when the bottle label is not reflected in the image of the bottle to the extent that the brand of the bottle can be specified, the rotating unit rotates the bottle and the lifting unit moves the bottle up and down, Causing the imaging unit to image the bottle according to rotation and elevation of the bottle;
The bottle storage device according to claim 7. It has a brand database that stores label images of multiple brands,
The information management unit specifies the brand of the bottle by comparing the label image of the bottle obtained by the imaging unit with the label image stored in the brand database.
The bottle storage device according to any one of claims 1 to 8. The output unit includes a display unit that displays at least one of the brand specified by the information management unit and related information on the specified brand.
The bottle storage device according to any one of claims 1 to 9. A communication unit that transmits at least one of the brand specified by the information management unit and related information related to the specified brand to an external device;
The bottle storage device according to any one of claims 1 to 10. A log information storage unit for storing log information regarding the bottle inserted into the housing unit;
The bottle storage device according to any one of claims 1 to 11. It has a brand database that stores label images of multiple brands,
The information management unit specifies the brand of the bottle by comparing the label image of the bottle obtained by the imaging unit and the label image stored in the brand database,
The log information storage unit stores at least the brand specified by the information management unit as the log information.
The bottle storage device according to claim 12. An operation input unit that can input a user's favorite degree for the brand is further provided,
The log information storage unit stores the favorite degree in association with the brand.
The bottle storage device according to claim 13. The related information related to the brand displayed by the display unit includes at least one of a matched dish, taste, brewery information, and a favorite degree.
The bottle storage device according to claim 10. The related information related to the brand transmitted by the communication unit includes at least one of a matching dish, taste, brewery information, and a favorite degree,
The bottle storage device according to claim 11. A curved mirror,
The imaging unit images the bottle through the curved mirror;
The bottle storage device according to any one of claims 1 to 16. A system comprising a bottle storage device and an information processing device,
The bottle storage is
An accommodating part for accommodating the bottle;
A cooling / heating unit provided around the housing unit;
A rotating part for rotating the bottle accommodated in the accommodating part;
An imaging unit for imaging the bottle stored in the storage unit;
A communication unit that transmits an image of the bottle obtained by the imaging unit, and receives a recognition result about the image of the bottle and related information about the brand of the bottle;
A control unit that controls rotation of the bottle of the rotating unit and imaging of the imaging unit based on the recognition result;
An output unit for outputting related information on the brand;
With
The information processing apparatus includes:
A communication unit that receives the image of the bottle and transmits related information about the recognition result and the brand;
An information management unit for recognizing an object appearing in the image of the bottle and identifying at least the brand of the bottle based on the image of the bottle;
A system comprising: