JP2019138493A - Refrigerator, commodity order placement method and commodity order placement system - Google Patents

Abstract

To provide a refrigerator capable of properly managing commodities in a storage chamber of the refrigerator.SOLUTION: A refrigerator which can be connected to a display device includes: receiving means for receiving data of purchased commodities; specifying means for specifying arrangement positions of the purchased commodities arranged at arbitrary positions in the storage chamber; measuring means for measuring the residual amount of the commodities included in the storage chamber; display means for displaying the residual amount of the commodities measured by the measuring means in the display device; and order placing means for performing order placement of commodities in the case where the residual amount of the commodities becomes below the minimal proper amount.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a refrigerator and the like.

  In recent years, various techniques for conveniently using a refrigerator have been proposed. For example, there is an application that manages the contents of a refrigerator, and the user can manage the expiration date by inputting purchased products into the application.

  Also, multi-functional refrigerators are being promoted. For example, by attaching a plurality of sensors to the storage unit provided inside the refrigerator, and measuring the storage start date, the number of items stored, the quantity, etc. of each product stored in the storage unit of the refrigerator, A refrigerator that can be confirmed and automatically orders products less than the minimum appropriate amount has been proposed (see, for example, Patent Document 1).

JP 2003-050077 A

  However, the method of managing the refrigerator by the application has a problem that it takes time to register the purchased product and record the remaining amount of the registered product. Moreover, the refrigerator described in patent document 1 had the problem that the goods decided in the location where the sensor was attached had to be arrange | positioned.

  In order to solve the above-described problems, an object of the present invention is to provide a refrigerator or the like that can appropriately manage commodities in a refrigerator storage.

In order to solve the above-described problems, the refrigerator of the present invention is
A refrigerator connectable with a display device,
A receiving means for receiving data of the purchased product;
A specifying means for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
Measuring means for measuring the remaining amount of goods contained in the storage;
Display means for displaying the remaining amount of the product measured by the measuring means on the display device;
When the remaining amount of the product is less than the minimum appropriate amount, ordering means for placing an order for the product;
It is characterized by providing.

The product ordering method of the present invention is:
A product ordering method in a refrigerator connectable with a display device,
A receiving step for receiving data of purchased products;
A specifying step for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
A measuring step of measuring the remaining amount of the product contained in the storage;
An ordering step for placing an order for the product if the remaining amount of the product is less than the minimum appropriate amount;
It is characterized by providing.

The product ordering system of the present invention is
A product ordering system including a mobile terminal device, a display device, and a refrigerator,
The portable terminal device
An acquisition means for acquiring data of purchased products;
A transmission means for transmitting data of the purchased product to the refrigerator when the refrigerator is communicable;
With
The refrigerator is
Receiving means for receiving data of the purchased product from the portable terminal device;
A specifying means for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
Measuring means for measuring the remaining amount of goods contained in the storage;
Display means for displaying the remaining amount of the product measured by the measuring means on the display device;
When the remaining amount of the product is less than the minimum appropriate amount, ordering means for placing an order for the product;
It is characterized by providing.

  According to the present invention, the refrigerator acquires data of purchased products, and orders the products when the remaining amount of the products is less than the minimum appropriate amount for the arbitrarily arranged products. Therefore, the user does not have to take the trouble of registering the purchased product, recording the remaining amount of the registered product, or considering the position where the product is placed, and manage the product placed in the refrigerator. Is possible.

It is a figure for demonstrating the whole structure of the goods ordering system in 1st Embodiment. It is a figure for demonstrating the function structure of the refrigerator in 1st Embodiment. It is the figure which showed an example of the data structure of the merchandise data in 1st Embodiment. It is the figure which showed an example of the data structure of the minimum appropriate amount data in 1st Embodiment. It is the figure which showed an example of the data structure of the residual amount data in 1st Embodiment. It is the figure which showed an example of the data structure of the order data in 1st Embodiment. It is a figure for demonstrating the function structure of the television apparatus in 1st Embodiment. It is a figure for demonstrating the function structure of the smart phone in 1st Embodiment. It is a figure for demonstrating the function structure of the ordering server in 1st Embodiment. It is the figure which showed an example of the data structure of the order data in 1st Embodiment. It is a figure for demonstrating the sequence in 1st Embodiment. It is an operation | movement flow for demonstrating the main process of the refrigerator in 1st Embodiment. It is a figure for demonstrating the main process of the refrigerator in 1st Embodiment. It is an operation | movement flow for demonstrating the main process of the television apparatus in 1st Embodiment. It is an operation | movement flow for demonstrating the main process of the smart phone in 1st Embodiment. It is an operation | movement flow for demonstrating the main process of the order receiving server in 1st Embodiment. It is a figure for demonstrating the operation example in 1st Embodiment. It is a figure for demonstrating the whole structure of the goods ordering system in 2nd Embodiment. It is a figure for demonstrating the function structure of the refrigerator in 2nd Embodiment. It is a figure for demonstrating the function structure of the cloud server in 2nd Embodiment. It is a figure for demonstrating the operation example in 3rd Embodiment. It is an operation | movement flow for demonstrating the main process of the television apparatus in 4th Embodiment. It is a figure for demonstrating the operation example in 4th Embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. In addition, this embodiment demonstrates the goods ordering system containing the refrigerator of this invention as an example.

[1. First Embodiment]
[1.1 Overall configuration]
First, the overall configuration of the product ordering system 1 of the present embodiment will be described with reference to FIG. As shown in FIG. 1, in the product ordering system 1, a refrigerator 10, a television device 20 that is a display device, and a smartphone 30 that is a mobile terminal device are connected to a network NW1. The network NW1 is connected to a network NW2 that is an external network, and the order receiving server 40 is connected via the network NW2.

  Here, the network NW1 is a LAN (Local Area Network), and is configured by Ethernet (registered trademark) or the like, for example. Each device can be connected via a network NW1 provided in the home. The network NW2 is an external network and is configured by the Internet or a mobile phone network.

  In FIG. 1, the smartphone 30 is connected to the network NW1 via the access point AP, but may be connected to the network NW2 via a base station and connected to the network NW1 via the network NW2.

  The order receiving server 40 is a server managed by a store that ships products, and is a server that accepts product orders from users. As shown in FIG. 1, the order receiving server 40 may prepare one order receiving server that accepts all products to be ordered, or may prepare an order receiving server for each store, service, and ordered product.

[1.2 Functional configuration]
Next, functional configurations of the refrigerator 10, the television device 20, the smartphone 30, and the order receiving server 40 will be described.

[1.2.1 Refrigerator]
The functional configuration of the refrigerator 10 will be described with reference to FIG. The refrigerator 10 includes a control unit 100, a refrigeration control unit 110, an image input unit 120, a product identification unit 125, a weight sensor 130, a storage unit 140, and a communication unit 170.

  The control unit 100 is a functional unit for controlling the entire refrigerator 10. The control unit 100 realizes various functions by reading and executing various programs, and is configured by a CPU (Central Processing Unit), for example.

  The refrigeration control unit 110 is a functional unit that refrigerates products placed in the refrigerator 10 and provides functions according to user operations. For example, a door opening / closing detection unit 112 that detects opening / closing of the door of the refrigerator 10, an interior lighting lamp 114 that lights when the door of the refrigerator 10 is open, and a temperature sensor 116 that detects the temperature inside the refrigerator 10, A cooling device 118 for generating cooled air.

  The image input unit 120 is a functional unit that captures 360 degrees and outputs it as image data, such as an upper part, a front door, a back wall, and a side wall in the storage of the refrigerator 10. For example, a camera capable of photographing 360 degrees may be installed in the refrigerator 10, or a plurality of cameras capable of photographing a predetermined range may be installed.

  The product specifying unit 125 is a functional unit for specifying the product placed in the refrigerator 10 and the position where the product is placed. For example, the electronic tag attached to the product is read to identify the product and the position where the product is arranged. Further, the image data in the storage of the refrigerator 10 output from the image input unit 120 is analyzed, the product is recognized, the area containing the recognized product image is associated with the position in the storage, and the product The position where is placed may be specified. As a method for recognizing the product from the image data, a known method such as pattern matching based on the shape of the product or characters printed on the product may be used.

  The weight sensor 130 is a functional unit for measuring the weight of a product arranged in the storage of the refrigerator 10. A plurality of weight sensors 130 may be installed in the refrigerator 10 as necessary.

  For example, the weight sensor 130 is attached to the bottom of the placement location for a product placed at a predetermined location, such as an egg, a beverage, a seasoning, or the like, to thereby determine the remaining amount of the product placed at the predetermined location. , And can be measured by weight and number.

  Moreover, you may arrange | position the several weight sensor 130 on a shelf in a storage in a grid | lattice form. By doing in this way, the weight of goods can be measured for every division which occupies a certain range. Therefore, by measuring the weight of the product specified by the product specifying unit 125 with the weight sensor 130, it is possible to measure the weight even if the product is placed at an arbitrary position by the user.

  The storage unit 140 is a functional unit that stores various programs necessary for the operation of the refrigerator 10 and various data. The storage unit 140 includes, for example, an SSD (Solid State Drive) that is a semiconductor memory, an HDD (Hard Disk Drive) that is a magnetic disk device, and the like.

  The storage unit 140 stores product data 142, in-store image data 144, minimum appropriate amount data 146, remaining amount data 148, order data 150, and user information 152.

  The product data 142 is data related to products purchased by the user. An example of the product data 142 will be described with reference to FIG. As shown in FIG. 3, the product data 142 includes a product (for example, “drinking water”) indicating a purchased product, a unit quantity (for example, “500 g”) indicating the quantity per product, And a purchase quantity (for example, “5”) indicating the purchased quantity.

  In the present embodiment, the product in the product data 142 stores a specific name of the product, but a JAN code or a code that can uniquely identify the product may be stored. The same applies to minimum appropriate amount data 146, remaining amount data 148, and order data 150, which will be described later.

  In the present embodiment, the product data 142 will be described as storing product data 342 transmitted from the smartphone 30. Details will be described later.

  As information stored in the product data 142, information other than the information described above may be stored, and information such as the expiration date, purchase date, and purchase store may be stored.

  The internal image data 144 stores the image data output by the image input unit 120. The image data 144 in a store | warehouse | chamber may be memorize | stored for every fixed period (for example, every 1 minute), and may be memorize | stored when the door of the refrigerator 10 is closed.

  The minimum appropriate amount data 146 is data indicating the minimum appropriate amount, which is the lower limit of the appropriate amount, for each product. Here, the proper amount is an amount that is determined for each product and that should normally be placed in the refrigerator 10. The appropriate amount and the minimum appropriate amount are determined by the user of the refrigerator 10 based on the use frequency of the product, the single use amount, and the like. For example, if it is determined that 3 to 5 drinking water is placed in the refrigerator, the appropriate amount of the product “drinking water” is “3 to 5”, and the minimum appropriate amount is “ 3 ". In the present embodiment, the minimum appropriate amount among the appropriate amounts is stored as the minimum appropriate amount data 146.

  An example of the minimum appropriate amount data will be described with reference to FIG. As shown in FIG. 4, the minimum appropriate amount data includes a product (for example, “drinking water”), a minimum appropriate amount (for example, “3 bottles”), and whether or not to automatically order the product. Automatic ordering (for example, “Yes”), order quantity (for example, “5”) indicating the order quantity of the product when the product is automatically ordered, and when the product is automatically ordered , An ordering party (for example, “ordering party 1”) indicating a transmission destination of information related to ordering is included.

  Here, the product stored in the minimum appropriate amount data 146 is the same as the product stored in the product data 142, thereby connecting the product data 142 and the minimum appropriate amount data 146. In this way, among the products stored in the product data 142, a product for determining whether the minimum appropriate amount is satisfied or not, that is, a product for managing inventory is specified.

  The minimum appropriate amount may be expressed not as a specific value such as the number or weight but as a ratio (for example, “50%”) to the purchased amount.

  The order quantity is set to an amount necessary to make at least the minimum appropriate quantity for a product that is less than the minimum appropriate quantity.

  Here, the order quantity may be stored as the number of products, or may be stored as the unit quantity of products. For example, the number of items to be ordered is stored for commodities on the premise of purchasing a plurality of bottles such as drinking water. Further, when ordering per unit quantity (for example, one piece) like butter, the unit quantity (one piece) is stored. About these, it may memorize | store beforehand for every kind of goods, and information required for goods data may be contained. Further, it may be set and stored by the user.

  The remaining amount data 148 is data indicating the remaining amount of the product for each product for which the minimum appropriate amount is set. An example of the remaining amount data will be described with reference to FIG. As shown in FIG. 5, the remaining amount data includes a product (for example, “drinking water”) for identifying a product for which the minimum appropriate amount is set, a measurement remaining amount (for example, “5 bottles”), The remaining amount state (for example, “sufficient”) is included.

  The measurement remaining amount indicates the amount of the product arranged in the refrigerator 10 and is determined based on the results output from the product specifying unit 125 and the weight sensor 130.

The remaining amount state is determined by comparing the measured remaining amount and the minimum appropriate amount of the minimum appropriate amount data 146 for each product for which the minimum appropriate amount is set. In the present embodiment, description will be made assuming that the remaining amount state is as follows.
Sufficient: When the measurement remaining amount is more than the minimum appropriate amount Insufficient: The product is automatically ordered and the measurement remaining amount is less than the minimum appropriate amount. Is less than the minimum appropriate amount

  The order data 150 is data indicating the state of the order for the product for which the minimum appropriate amount is set. An example of the order data will be described with reference to FIG. As shown in FIG. 6, the ordering data 150 includes a product (for example, “drinking water”) for identifying a product to be ordered, and an ordering state (for example, “in stock” indicating a state related to the ordering of the product. )).

In the present embodiment, the ordering state will be described as the following state.
In stock: When the measured remaining amount of the product is greater than or equal to the minimum appropriate amount Unordered: When the measured residual amount of the product is less than the minimum appropriate amount and no order has been placed Ordered: When the order has been placed

  The user information 152 is information related to the user of the refrigerator 10. For example, information such as the user's name, address, and telephone number is stored. User information 152 may be set and stored by the user in refrigerator 10, or user information stored in smartphone 30 may be received from communication unit 170 and stored. The user information 152 is used when notifying the ordering party as information about the orderer when placing an order for a product.

  The communication unit 170 is a functional unit for the refrigerator 10 to communicate with other devices. For example, a wireless LAN standard such as IEEE802.11a / b / g / n is used to connect to another device via a network. Moreover, in order to implement | achieve near field communication with another apparatus, you may utilize standards, such as Bluetooth (registered trademark), ZigBee (registered trademark), NFC (Near field radio communication).

[1.2.2 Television device]
Next, the functional configuration of the television apparatus 20 will be described with reference to FIG. The television apparatus 20 includes a control unit 200, a video signal receiving unit 210, a display unit 220, an audio output unit 230, a storage unit 240, an operation unit 250, and a communication unit 270. .

  The control unit 200 is a functional unit for controlling the entire television device 20. The control unit 200 realizes various functions by reading and executing various programs, and is configured by, for example, a CPU.

  The video signal receiving unit 210 is a functional unit that receives a broadcast signal and converts it into a video output signal and an audio output signal. The video output signal is output to the display unit 220. The audio output signal is output to the audio output unit 230.

  The display unit 220 is a functional unit that displays video based on the video output signal and various types of information. For example, a liquid crystal display (LCD), an organic EL (Electro Luminescence) display, or the like is used.

  The audio output unit 230 is a functional unit that outputs audio based on the audio output signal. For example, it is configured by a device such as a speaker or headphones.

  The storage unit 240 is a functional unit that stores various programs and various data necessary for the operation of the television apparatus 20. The storage unit 240 includes, for example, an SSD that is a semiconductor memory, an HDD (Hard Disk Drive), or the like.

  The storage unit 240 stores remaining amount data 148 received from the refrigerator 10 as remaining amount data 242.

  The operation unit 250 is a functional unit that inputs an operation from a user and outputs the operation to the control unit 200. For example, an operation button provided on the television device 20 or a remote control device that can be connected wirelessly.

  The communication unit 270 is a functional unit for the television device 20 to connect to a network and communicate with other devices. For example, a wireless LAN standard such as IEEE 802.11a / b / g / n is used.

[1.2.3 Smartphone]
The functional configuration of the smartphone 30 will be described with reference to FIG. The smartphone 30 includes a control unit 300, a display unit 310, an operation unit 320, a storage unit 340, and a communication unit 370.

  The control unit 300 is a functional unit for controlling the entire smartphone 30. The control unit 300 realizes various functions by reading and executing various programs, and is configured by, for example, a CPU.

  The display unit 310 is a functional unit that displays various types of information to the user, and includes a liquid crystal display, an organic EL display, or the like.

  The operation unit 320 is a functional unit for receiving an operation from a user. For example, it is configured by a touch panel configured integrally with the display unit 310. As an operation detection method, any method such as a capacitance method, a pressure-sensitive method such as a resistance film method, an infrared method, or an electromagnetic induction method may be used.

  The storage unit 340 is a functional unit that stores various programs necessary for the operation of the smartphone 30 and various data. The storage unit 340 is configured by, for example, an SSD that is a semiconductor memory, and the remaining amount data 344 that stores the product data 342 that stores information related to the products purchased by the user and the remaining amount data 148 received from the refrigerator 10. Is memorized.

  The product data 342 is information related to products purchased by the user. For example, at the time of purchase, information received from a cash register provided in a store, information printed on a receipt (for example, character recognition of a receipt, or reading a two-dimensional barcode printed on a receipt) Information) is stored as product data 342. In addition, the cash register reads an electronic tag or a barcode attached to the product, and acquires information about the product.

  Here, the product data 342 stores, for example, a purchase quantity, which is the quantity of the purchased product, and a unit quantity per product. Further, the product data 342 may include price, expiration date (expiration date), and product attributes as other information.

  The communication unit 370 is a functional unit for the smartphone 30 to connect to a network and communicate with other devices. For example, a wireless LAN standard such as IEEE802.11a / b / g / n or a short-range wireless communication standard such as Bluetooth or ZigBee is used.

[1.2.4 Order receiving server]
The functional configuration of the order receiving server 40 will be described with reference to FIG. The order receiving server 40 includes a control unit 400, a storage unit 440, and a communication unit 470.

  The control unit 400 is a functional unit for controlling the entire order receiving server 40. The control unit 400 realizes various functions by reading and executing various programs, and is configured by a CPU or the like, for example.

  The storage unit 440 is a functional unit that stores various programs and various data necessary for the operation of the order receiving server 40. Further, the storage unit 440 stores the order request received from the refrigerator 10 as the order data 442.

  Here, the order request is a request including a product ordered by the refrigerator 10 or a user, an order quantity of the product, and an address as a delivery destination. An example of the order data 442 storing the order request will be described with reference to FIG. As shown in FIG. 10, the order data 442 includes a product (for example, “drinking water”) for identifying the ordered product, an order quantity (for example, “5 bottles”) indicating the received order, Orderer information indicating information related to the buyer is stored. The orderer information includes the name of the orderer (for example, “Tanaka”) and the address (for example, “Address 1”).

[1.3 Process flow]
[1.3.1 Overview of processing]
Next, the overall flow of the product ordering system 1 will be described with reference to FIG. First, the smartphone 30 transmits product data to the refrigerator 10 (S1002).

  Subsequently, the refrigerator 10 specifies the arrangement of the products arranged in the storage, and measures the remaining amount of the products from the specified arrangement. The remaining amount measured at this time and the remaining amount state are stored as remaining amount data 148 (S1004).

  Subsequently, the refrigerator 10 transmits an ordering request to the order receiving server 40 for a product whose remaining state is “insufficient” (S1006).

  In addition, when the refrigerator 10 receives the remaining amount data request from the television device 20 (S1008), the refrigerator 10 transmits the remaining amount data 148 to the television device 20 (S1010). The remaining amount data request is a request for the television device 20 to acquire the remaining amount data 148 stored in the refrigerator 10. When the television apparatus 20 receives the remaining amount data 148 from the refrigerator 10, the television device 20 displays the internal state of the refrigerator 10 on the display unit 220 based on the received remaining amount data (S <b> 1012). Note that the refrigerator 10 may transmit the in-compartment image data 144 together with the remaining amount data 148.

  At this time, the television apparatus 20 displays, on the display unit 220, confirmation for placing an order (ordering) for a product whose remaining state is “insufficient / necessary confirmation”. When the user selects to order the product, the television apparatus 20 transmits an order confirmation to the refrigerator 10 (S1014). The order confirmation is information for specifying a product ordered by the user.

  In addition, when it is determined that the user is out, the refrigerator 10 transmits the remaining amount data 148 to the smartphone 30 (S1016). Note that the refrigerator 10 may transmit the in-compartment image data 144 together with the remaining amount data 148. As a case where the user is out, the case where the position of the smartphone 30 is outdoors can be considered. Whether or not the position of the smartphone 30 is outdoors can be determined by, for example, detecting that the GPS information received from the smartphone 30 is away from the installation location of the refrigerator 10. The determination can also be made by detecting that the communication unit 170 and the smartphone 30 cannot be connected by short-range wireless communication or that the smartphone 30 is not directly connected to the network NW1.

  The smartphone 30 that has received the remaining amount data 148 displays, on the display unit 310, a confirmation for placing an order for the product for which the remaining state is “insufficient / necessary confirmation” (S 1018). If the user selects to order the product, the smartphone 30 transmits an order confirmation to the refrigerator 10 (S1020).

  The refrigerator 10 receives the order confirmation transmitted from the television device 20 and the smartphone 30, and transmits an order request to the order receiving server 40 based on the order confirmation (S1022).

  By the processing described above, it is possible to place an order for a product arranged in the storage of the refrigerator 10 and having a measured remaining amount less than the minimum appropriate amount by the processing of the refrigerator 10 or by the user's operation. It becomes possible.

[1.3.2 Flow of refrigerator processing]
It continues and the process of the refrigerator 10 is demonstrated with reference to FIG. 12 and FIG. First, the control unit 100 receives the product data 342 from the smartphone 30 via the communication unit 170 and stores the product data 342 as the product data 142 in the storage unit 140 (step S102).

  After the refrigerator 10 receives the product data from the smartphone 30, the product is placed at a predetermined position or an arbitrary position of the refrigerator 10 by the user. Then, the minimum appropriate amount data 146 is stored (step S104).

  Here, the minimum appropriate amount data 146 may be received from the smartphone 30 and stored in a minimum appropriate amount predetermined by the user, or controlled based on the weight or quantity of the product placed in the refrigerator 10. The unit 100 may determine and store the minimum appropriate amount.

  Subsequently, the product placed in the refrigerator 10 is recognized, and the position where the product is placed is specified (step S106). Here, the product specifying unit 125 specifies the product based on the product data 142. For example, the product name stored in the electronic tag attached to the product may be read and associated with the product stored in the product data 142. Further, the image may be analyzed using the shape considered as the product stored in the product data 142 or the name of the product.

  Subsequently, the control unit 100 measures the remaining amount of the product specified by the product specifying unit 125 (step S108), and determines whether or not the measured remaining amount of the product is less than the minimum appropriate amount ( Step S110).

  Here, the control unit 100 stores the remaining amount data 148 and the order data 150 again. As for the remaining amount data 148, the remaining amount of the product measured in step S108 is stored in the remaining amount data 148 as the remaining amount, and the result determined in step S110 is stored as the remaining amount state.

  The remaining amount state is “sufficient” if the measured remaining amount is not less than the minimum appropriate amount. If the measurement remaining amount is less than the minimum appropriate amount, the control unit 100 further reads the minimum appropriate amount data 146, and if the product is a product for which an automatic order is placed, “insufficient” is assumed. Let's say “insufficient / necessary confirmation”

For the order data 150, the order status of the product is stored as the following status.
(1) If the measured remaining amount of the product for which the order status is “in stock” is less than the minimum appropriate amount, it will be “not ordered” (2) the order status is “not ordered” or “ordered” If the measured remaining amount of the product exceeds the minimum appropriate amount, “In stock”

  If it is determined in step S110 that the measured remaining amount of the product is greater than or equal to the minimum appropriate amount, the process returns to step S108 (step S110; No → step S108). When the measurement remaining amount is less than the minimum appropriate amount, the process proceeds to step S112 (step S110; Yes → step S112).

  Subsequently, the control unit 100 reads the ordering data 150 and determines whether the ordering state of the product is “ordered” (step S112). If this determination is affirmative, it is in a state waiting for the ordered product to arrive at the house, and it is not necessary to place an order for the product, so the process returns to step S108 (step S112; Yes → step S108).

  Subsequently, the control unit 100 reads the remaining amount data 148 and determines whether the remaining amount state of the product is “insufficient / necessary confirmation” (step S114). If a negative result is obtained in step S114, since the product is a product for which automatic ordering is performed, an ordering request is transmitted to the order receiving server 40 (step S114; No → step S128).

  If an affirmative result is obtained in step S114, the product needs to be inquired of the user for ordering the product. In this case, the control unit 100 subsequently determines whether or not the user is out (step S114; Yes → step S116). As described above, the determination method as to whether or not the user is going out may be determined based on whether or not the position of the smartphone 30 is outdoors.

  When the user is out, the control unit 100 determines whether or not a remaining amount data request has been received from the television device 20 (step S116; Yes → step S118). When a positive result is obtained in this determination, the control unit 100 transmits the remaining amount data 148 to the television apparatus 20 (step S118; Yes → step S120). In this way, the remaining amount data 148 can be transmitted to the television device 20 when the television device 20 is in a state where the remaining amount data 148 can be received and displayed.

  In addition, when receiving the order confirmation transmitted from the television device 20, the control unit 100 transmits an order request to the order receiving server 40 based on the received order confirmation (Step S122; Yes → Step S128).

  On the other hand, if a negative result is obtained as the determination result of step S116, the remaining amount data 148 is transmitted to the smartphone 30 (step S116; No → step S124).

  In addition, when the order confirmation transmitted from the smartphone 30 is received, the control unit 100 transmits an order request to the order receiving server 40 based on the received order confirmation (Step S126; Yes → Step S128).

  Subsequently, the control unit 100 sets the order status of the order data 150 to “already ordered” for the product for which the order request has been made (step S130).

[1.3.3 Processing flow of television device]
Next, processing of the television device 20 will be described with reference to FIG. First, when there is a request from the user to confirm the state in the storage, the control unit 200 transmits a remaining amount data request to the refrigerator 10 via the communication unit 270 (step S132).

  Subsequently, when receiving the remaining amount data 148 from the refrigerator 10 as a response to the remaining amount data request, the control unit 200 stores the remaining amount data 242 in the storage unit 240 (step S134). When receiving the in-compartment image data 144 together with the remaining amount data 148, an area for storing the in-compartment image data is provided in the storage unit 240, and the received image is stored in the area for storing the in-compartment image data. . Moreover, the control part 200 displays the screen which can grasp | ascertain the condition in the store | warehouse | chamber of the refrigerator 10 on the display part 220 based on the residual amount data 242 (step S136).

  Subsequently, the control unit 200 causes the display unit 220 to display a product whose remaining state is “insufficient / necessary confirmation” from the remaining amount data 242 (step S138). When an operation for placing an order for a product is performed by the user, the control unit 200 transmits an order confirmation for the product to the refrigerator 10 (step S140; Yes → step S142).

[1.3.4 Smartphone processing flow]
It continues and the process of the smart phone 30 is demonstrated with reference to FIG. First, the control unit 300 determines whether or not product data has been received (step S152). Product data is realized by, for example, receiving data of the purchased product when the user purchases the product from a cash register that can acquire product data such as the name and quantity of the product by reading an electronic tag or barcode. To do. Further, the control unit 300 stores the received product data as product data 342 in the storage unit 340 (step S154).

  As the product data, the smartphone 30 may read from a receipt, for example, or from a product.

  Subsequently, when connected to the refrigerator 10, the control unit 300 transmits the product data 342 to the refrigerator 10 via the communication unit 370 (Step S156; Yes → Step S158).

  Subsequently, when the control unit 300 receives the remaining amount data 148 from the refrigerator 10 via the communication unit 370, the control unit 300 stores the received remaining amount data 148 as the remaining amount data 344 in the storage unit 340. (Step S160). When receiving the in-compartment image data 144 together with the remaining amount data 148, an area for storing the in-compartment image data is provided in the storage unit 340, and the received image is stored in the area for storing the in-compartment image data. .

  Subsequently, a product whose remaining state is “insufficient / necessary confirmation” is displayed on the display unit 310 from the remaining amount data 344 (step S162). When an operation for placing an order for a product is performed by the user, the control unit 300 transmits an order confirmation for the product to the refrigerator 10 (step S164; Yes → step S166).

[1.3.5 Order server processing]
Next, processing of the order receiving server 40 will be described with reference to FIG. First, the control unit 400 determines whether an order request has been received from the refrigerator 10 (step S182). When it is determined that an order request has been received from the refrigerator 10, the control unit 400 stores the order data 442 in the storage unit 440 (step S184).

  The employee of the store that manages the order receiving server 40 delivers the product by the order amount to the orderer stored in the orderer information based on the order data stored in the order data 442.

[1.4 Operation example]
Next, with reference to FIG. 17, a display example of the internal situation displayed on the display unit 220 of the television device 20 will be described. Display screen W100 includes an area E100 for displaying products arranged in refrigerator 10 and the remaining amount in an illustration based on remaining amount data 242, and buttons E102a and E102b for accepting orders for missing items. And region E102. Moreover, the area | region E104 which displays a measurement remaining amount with a table | surface or a graph for every goods may be contained.

  In this screen, when the button E102a for ordering butter is selected by the user, the television apparatus 20 transmits an order confirmation for ordering butter to the refrigerator 10.

  Note that the order of the product does not have to be performed by transmitting an order confirmation from the television device 20 to the refrigerator 10, and the user inputs information such as the product, the ordered quantity, and the ordering destination to the television device 20 and the smartphone. The order request may be transmitted from 30 to the order receiving server 40.

  In addition, when the storage unit 240 stores the image data received from the refrigerator 10, the television device 20 may display the image data in the region E100. Further, the illustration and the in-store image data may be switched and displayed, or the in-store image data and the illustration may be displayed side by side. Moreover, the smart phone 30 also displays the internal condition of the refrigerator 10 by performing display based on the remaining amount data 344 and the internal image data.

  By comprising as mentioned above, the user can confirm the state of the refrigerator 10 visually by displaying the state in the storage of the refrigerator 10, and the residual amount of goods on the television apparatus 20 or the smart phone 30. FIG. Since goods can be managed without opening the door of the refrigerator 10, the state in the storage of the refrigerator 10 leads to power saving.

  In the measurement of the remaining amount, the position of the product is specified by the image data in the warehouse or the electronic tag, and the remaining amount of the product is obtained based on the weight detected by the weight sensor 130. Therefore, it is possible to manage the product that is not arranged at a predetermined position. . In addition, by comparing the minimum appropriate amount with the measured remaining amount of the product, it is possible to automatically order an insufficient product and prevent the product from being lost from the refrigerator 10.

  Even for a product that is not automatically ordered, the user can check the shortage of the remaining amount of the product on the television device 20 and the smartphone 30 and can also order the product. Moreover, it is possible to use as a shopping list by displaying the product with insufficient remaining amount on the television device 20 or the smartphone 30.

  Further, by transmitting the product data from the smartphone 30 to the refrigerator 10, the user can save time and effort to input product information into the refrigerator 10. In addition, since the product data 142 stored in the refrigerator 10 is a list of products purchased by the user, it can be used by linking with other apps (for example, a household account book app).

  Moreover, the refrigerator 10 may manage information related to the date and time such as the expiration date and the storage start date included in the electronic tag. By managing the period after the product is installed, it is possible to notify the user that there is a product that has a long period since the product was installed when displaying the internal situation. In addition, it is possible to maintain the freshness of products and reduce the number of products that have expired and must be discarded.

[2. Second Embodiment]
The second embodiment is an embodiment that performs management of remaining amount data of the refrigerator 10 and ordering of products by a cloud server connected to the Internet. In the second embodiment, FIG. 1 of the first embodiment is replaced with FIG. 18 and FIG. 2 is replaced with FIG. The same functional units as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

[2.1 Configuration]
The overall configuration of the product ordering system 2 of the present embodiment will be described with reference to FIG. As shown in FIG. 18, in the product ordering system 2, a cloud server 50 is newly connected to a network NW2.

  Here, as shown in FIG. 19, the refrigerator 12 is different from the refrigerator 10 of the first embodiment portable device in that the storage unit 140 does not include the order data 150 and the user information 152.

  The cloud server 50 is a server that provides a service via a network. In this embodiment, based on the information in the refrigerator 12, a service for automatically ordering missing products is provided. The functional configuration of the cloud server 50 will be described with reference to FIG. The cloud server 50 includes a control unit 500, a storage unit 540, and a communication unit 570.

  The control unit 500 is a functional unit for controlling the entire cloud server 50. The control unit 500 realizes various functions by reading and executing various programs, and is configured by, for example, a CPU.

  The storage unit 540 is a functional unit in which various programs necessary for the operation of the cloud server 50 and various data are stored. The storage unit 540 includes, for example, an SSD that is a semiconductor memory, an HDD, or the like.

  The storage unit 540 stores minimum appropriate amount data 542, remaining amount data 544, order data 546, and user information 548. The minimum appropriate amount data 542 is the minimum appropriate amount data 146 in the first embodiment, the remaining amount data 544 is the remaining amount data 148 in the first embodiment, the ordering data 546 is the ordering data 150 in the first embodiment, and the user. Information 548 is data similar to the user information 152 in the first embodiment.

  The communication unit 570 is a functional unit for the cloud server 50 to connect to a network and communicate with other devices. This is realized by a NIC (Network Interface Card) used in a wired / wireless LAN or a communication module connectable to a 3G / LTE line.

[2.2 Process flow]
In this embodiment, the refrigerator 12 performs the process shown in FIG.12 and FIG.13 similarly to 1st Embodiment. Here, after the refrigerator 12 stores the remaining amount data 148 in step S <b> 112, the remaining amount data 148 is transmitted to the cloud server 50. Further, since the automatic ordering is performed by the cloud server 50, the refrigerator 12 does not perform the ordering process for the product for which the automatic ordering is performed in the process of step S128 of FIG.

  The cloud server 50 stores the received remaining amount data 148 as the remaining amount data 544, and places an order for a product whose measured remaining amount is less than the minimum appropriate amount and for which automatic ordering is to be performed. At this time, the orderer information as the order quantity, the order place, and the delivery place is determined based on the information stored in the minimum appropriate quantity data 542 and the user information 548.

  Further, the television device 20 and the smartphone 30 may transmit an order confirmation to the cloud server 50. When the cloud server 50 receives the order confirmation, the cloud server 50 transmits the order confirmation to the order receiving server 40 based on the information included in the order request.

  According to the present embodiment, the cloud server 50 manages the remaining amount data of the refrigerator 12 and performs automatic ordering. Therefore, the function realized by the refrigerator 12 can be suppressed, and the manufacturing cost can be suppressed.

[3. Third Embodiment]
Unlike the first embodiment, the third embodiment is an embodiment that uses product classification. Examples of product categories include eggs, dairy products, beverages, seasonings, processed products, meat, seafood, and vegetables.

  The product classification may be determined from the product information recorded in the electronic tag, for example, or when the product and classification correspondence table is stored in the storage unit 140 of the refrigerator 10 and the product is classified, May be determined from the correspondence table.

  FIG. 21 illustrates a display example of the internal situation displayed on the display unit 220 of the television apparatus 20 in the present embodiment. FIG. 21A is a display example of a screen W300 that is displayed first when displaying the display of the internal situation. The display screen W300 includes an area E306 that displays, for each product category, a product illustration, a category name, and the number of products (number of items) included in the category for the products arranged in the refrigerator 10. E300 and an area E302 including buttons E302a and E302b for receiving an order for a missing item. An area E304 for displaying information such as the ratio of the number of items in a graph may be included.

  The area E306 can be selected by the user. When the area E306 is selected, the television apparatus 20 displays on the display unit 220 a display screen W310 that displays the products included in the selected category and the measurement remaining amount for each product.

  The display screen W310 is almost the same as the display screen W100 of the first embodiment, and is short of an area E310 that displays the products arranged in the refrigerator 10 and the remaining amount in an illustration based on the remaining amount data 242. And an area E312 including a button E312a for receiving an order of a certain product. The display screen W310 may include an area E314 for displaying the measurement remaining amount for each product in a table or graph.

  The difference between the display screen W310 and the display screen W100 of the first embodiment includes an area E316 for displaying the classification name displayed on the display screen W310 and a button E318 for displaying the display screen W300. Yes. Also, in the area E312, only buttons for ordering missing products among the products included in the classification displayed on the display screen W310 are displayed.

  According to the present embodiment, the remaining amount data 148 can be displayed for each product category. When there are many products arranged in the refrigerator 10 or when it is desired to grasp the number of products for each product category, the convenience can be improved.

  In addition, when there are few products of a specific classification (for example, when there are few vegetables), it is possible to recommend purchasing a product included in the classification.

[4. Fourth Embodiment]
Unlike the first embodiment, the fourth embodiment is an embodiment in which recipe data is displayed on the television device 20 based on the remaining amount data 148 of the refrigerator 10.

  In this embodiment, about the main process of the television apparatus 20, after the control part 200 displays the internal condition of the refrigerator 10 (step S136), the control part 200 acquires the recipe which can be cooked based on the residual amount data 242. (Step S432). Further, the acquired recipe is displayed on the display unit 220 of the television apparatus 20 (step S434).

  Here, the recipe information may be stored in the refrigerator 10 or the television device 20, may be acquired from a cloud server that provides the recipe information, or obtained by searching for recipe information existing on the Internet. Also good.

  Also, in the main process of the smartphone 30, the recipe may be displayed in the same procedure as the television device 20. Specifically, when the control unit 300 receives the remaining amount data from the refrigerator 10, a recipe that can be cooked is acquired based on the remaining amount data and displayed on the display unit 310 of the smartphone 30.

  FIG. 23 illustrates a display example of a recipe displayed on the display unit 220 of the television apparatus 20 in the present embodiment. FIG. 23A is a display example of a screen W400 that is first displayed on the display unit 220 when displaying the display of the internal situation. On the display screen W400, based on the remaining amount data 242, an area E400 that displays the product arranged in the refrigerator 10 and its remaining amount in an illustration, and an area E402 that includes a button for accepting an order for a missing item A region E404 including buttons E404a and E404b for instructing display of a recipe is included.

  FIG. 23B is a display example of a screen W410 displayed on the display unit 220 when the buttons E404a and E404b for instructing the display of the recipe are selected by the user. The display screen W410 displays the cooking procedure and ingredients for the selected recipe.

  If there is a product whose measurement remaining amount is excessive or the expiration date is approaching compared to the minimum appropriate amount, the recipe may display a recipe that preferentially consumes the product. Moreover, when two or more dishes can be cooked based on the remaining amount data 242, such as a main dish and a side dish, a main dish and a dessert, a plurality of recipes that can be combined may be displayed.

[5. Modified example]
The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and the design and the like within the scope of the present invention are also within the scope of the claims. include.

  For example, the refrigerator 10 stores the remaining amount data 148 and transmits the remaining amount data 148 to the television device 20 and the smartphone 30. However, the refrigerator 10 may not be configured in this way. Instead of storing the remaining amount data 148, the refrigerator 10 obtains the measured remaining amount and the remaining amount state for each product, and each time the information including the product, the measured remaining amount, and the remaining state is displayed on the television device. You may transmit to 20 and the smart phone 30.

  Moreover, it is needless to say that the above-described embodiments can be executed by combining the respective embodiments. For example, by executing the combination of the third embodiment and the fourth embodiment, it is possible to easily grasp the situation in the storage, even when there are many products installed in the refrigerator. It becomes possible to display a recipe based on the product inside.

In addition, the program that operates in each device in the embodiment is a program (a program that causes a computer to function) that controls the CPU and the like so as to realize the functions of the above-described embodiments. Information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) at the time of processing, and then stored in a storage device such as an HDD or an SSD (solid state drive). Reading, correction, and writing are performed by the CPU.

  In addition, when distributing to the market, the program can be stored and distributed in a portable recording medium, or transferred to a server computer connected via a network such as the Internet. In this case, of course, the storage device of the server computer is also included in the present invention.

1, 2 Product ordering system 10, 12 Refrigerator 100 Control unit 110 Refrigeration control unit 112 Door open / close detection unit 114 Interior lighting 116 Temperature sensor 118 Cooling device 120 Image input unit 125 Product identification unit 130 Weight sensor 140 Storage unit 142 Product data 144 Image data in the store 146 Minimum appropriate amount data 148 Remaining amount data 150 Ordering data 152 User information 170 Communication unit 20 Television device 200 Control unit 210 Video signal receiving unit 220 Display unit 230 Audio output unit 240 Storage unit 242 Remaining data 250 Operation Unit 270 Communication Unit 30 Smartphone 300 Control Unit 310 Display Unit 320 Operation Unit 340 Storage Unit 342 Product Data 344 Remaining Data 370 Communication Unit 40 Order Server 400 Control Unit 440 Storage Unit 442 Order Data 470 Part 50 cloud server 500 controller 540 storage unit 542 minimum proper amount data 544 the remaining quantity data 546 order data 548 the user information 570 communication unit

Claims (10)

A refrigerator connectable with a display device,
A receiving means for receiving data of the purchased product;
A specifying means for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
Measuring means for measuring the remaining amount of goods contained in the storage;
Display means for displaying the remaining amount of the product measured by the measuring means on the display device;
When the remaining amount of the product is less than the minimum appropriate amount, ordering means for placing an order for the product;
A refrigerator comprising: The refrigerator is further connectable with a mobile terminal device,
The refrigerator according to claim 1, wherein the receiving unit receives, from the mobile terminal device, product data received by the mobile terminal device at the time of purchase.   The refrigerator according to claim 2, wherein the ordering unit transmits information on a product whose remaining amount of the product is less than a minimum appropriate amount to the mobile terminal device.   The ordering means transmits information of a product whose remaining amount of the product is less than a minimum appropriate amount to the mobile terminal device when the position of the mobile terminal device is outdoors. Refrigerator.   5. The refrigerator according to claim 1, wherein the specifying unit specifies a position where the product is arranged from a type of the product associated with a predetermined position in the storage. . The storage further includes a photographing means for photographing the product,
The refrigerator according to any one of claims 1 to 5, wherein the specifying unit specifies a position where the purchased product is arranged by analyzing the photographed product.   The refrigerator according to claim 6, wherein the display unit displays a shadow image in the storage taken by the photographing unit on the display device.   8. The order according to claim 1, wherein when the ordering request is received from the display device, the ordering unit orders a product whose remaining amount of the product is less than a minimum appropriate amount. Refrigerator. A product ordering method in a refrigerator connectable with a display device,
A receiving step for receiving data of purchased products;
A specifying step for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
A measuring step of measuring the remaining amount of the product contained in the storage;
An ordering step for placing an order for the product if the remaining amount of the product is less than the minimum appropriate amount;
A product ordering method characterized by comprising: A product ordering system including a mobile terminal device, a display device, and a refrigerator,
The portable terminal device
An acquisition means for acquiring data of purchased products;
A transmission means for transmitting data of the purchased product to the refrigerator when the refrigerator is communicable;
With
The refrigerator is
Receiving means for receiving data of the purchased product from the portable terminal device;
A specifying means for specifying an arrangement position of the purchased product arranged at an arbitrary position in the storage;
Measuring means for measuring the remaining amount of goods contained in the storage;
Display means for displaying the remaining amount of the product measured by the measuring means on the display device;
When the remaining amount of the product is less than the minimum appropriate amount, ordering means for placing an order for the product;
A product ordering system characterized by comprising: