KR20140081267A - Refrigerator, and method for including the same - Google Patents

Refrigerator, and method for including the same Download PDF

Info

Publication number
KR20140081267A
KR20140081267A KR1020120150833A KR20120150833A KR20140081267A KR 20140081267 A KR20140081267 A KR 20140081267A KR 1020120150833 A KR1020120150833 A KR 1020120150833A KR 20120150833 A KR20120150833 A KR 20120150833A KR 20140081267 A KR20140081267 A KR 20140081267A
Authority
KR
South Korea
Prior art keywords
food
list
refrigerator
image
unit
Prior art date
Application number
KR1020120150833A
Other languages
Korean (ko)
Other versions
KR102014145B1 (en
Inventor
김성엽
홍사윤
박선주
박미영
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020120150833A priority Critical patent/KR102014145B1/en
Publication of KR20140081267A publication Critical patent/KR20140081267A/en
Application granted granted Critical
Publication of KR102014145B1 publication Critical patent/KR102014145B1/en

Links

Images

Classifications

    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D29/00—Arrangement or mounting of control or safety devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/0007—Image acquisition
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803—Home automation networks
    • F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
    • F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
    • F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
    • F25D2500/00—Problems to be solved
    • F25D2500/06—Stock management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Economics (AREA)
  • Operations Research (AREA)
  • Human Computer Interaction (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Quality & Reliability (AREA)
  • Development Economics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Chemical & Material Sciences (AREA)
  • Combustion & Propulsion (AREA)
  • Mechanical Engineering (AREA)
  • Thermal Sciences (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)

Abstract

The present invention relates to a refrigerator and an operation method thereof. A method of operating a refrigerator according to an embodiment of the present invention includes the steps of photographing an image of a food item in a goods receipt or departure, discriminating an image of a food image taken on the basis of a list of foods in the household, , And updating the high-fat food list. Accordingly, it becomes possible to easily update the high-end food list in the refrigerator.

Description

[0001] The present invention relates to a refrigerator,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a refrigerator and an operation method thereof, and more particularly, to a refrigerator that can easily update a list of foods in a refrigerator and an operation method thereof.

Refrigerators are household appliances that can store refrigerated or frozen foods and other storage materials using refrigerant cycles. For this function, the refrigerator may include a main body having a freezing compartment and a refrigerating compartment, an evaporator disposed in the main body, a compressor compressing the refrigerant, a condenser condensing the refrigerant, and an expansion device decompressing and expanding the refrigerant.

The refrigerator having the above configuration can periodically turn on / off the compressor so that the internal temperature of the refrigerating chamber and the freezing chamber can be maintained within a predetermined temperature range.

In addition to the basic functions of a refrigerator, various user-friendly functions have recently been added.

It is an object of the present invention to provide a refrigerator which can easily update a list of high-tasting foods in a refrigerator, and an operation method thereof.

According to another aspect of the present invention, there is provided a method of operating a refrigerator, comprising the steps of: photographing an image of a foodstuff received or dispatched, determining a food image taken based on the high- And updating the list of high-fat foods based on the food image.

According to another aspect of the present invention, there is provided a refrigerator including: a memory for storing a list of high-tasting foods; a camera for photographing images of goods received or dispatched; And a control unit for determining an image and updating the high-fat food list based on the discriminated food image.

According to the embodiment of the present invention, food images can be easily and quickly discriminated by discriminating the photographed food images by utilizing a list of stored foods in storage at the time of goods receipt or shipment from the refrigerator. Accordingly, it becomes possible to easily update the high-end food list in the refrigerator.

On the other hand, the stored high-temperature food list has a list of foods that were previously stored in addition to the currently stored food list, so that the food image can be quickly identified by using the existing data when the food is received .

On the other hand, by outputting the food name discriminated at the time of wearing or leaving food, audio user convenience can be increased.

On the other hand, it is possible to recognize the food in a simple and prompt manner by recognizing the user's voice at the time of wearing or leaving the food, identifying the food by combining the recognized user voice and the taken food image. Accordingly, it becomes possible to easily update the high-end food list in the refrigerator.

1 is a front view of a refrigerator according to an embodiment of the present invention.
FIG. 2 is a front view showing a state where the door of the refrigerator shown in FIG. 1 is opened.
3 is a view schematically showing the configuration of the refrigerator of FIG.
FIG. 3 is a perspective view illustrating a refrigerator, which is an example of the home appliance of FIG. 1;
4 is a block diagram schematically illustrating the interior of the refrigerator shown in FIG.
5 is an internal block diagram of a mobile terminal.
6 is a flowchart illustrating an operation method of a refrigerator according to an embodiment of the present invention.
Figs. 7A and 9B are views referred to explain the operation method of Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

FIG. 1 is a front view of a refrigerator according to an embodiment of the present invention, and FIG. 2 is a front view showing a door of a refrigerator shown in FIG. 1 opened.

1 and 2, a refrigerator 1 according to an embodiment includes a case 110 forming an internal space defined by a refrigerating chamber 129 and a freezing chamber 139, a refrigerating chamber 129 for opening and closing the refrigerating chamber 129, The outward appearance is formed by the door 140 and the freezing chamber door 120 that opens and closes the freezing chamber 139.

The refrigerator compartment door 140 may be a right door rotatably connected to the right side of the case 110 and the freezer compartment door 122 may be a left door rotatably connected to the left side of the case 110. [

A door handle 121 protruding frontward is further provided on the front surface of the freezing compartment door 120 and the refrigerating compartment door 140 so that the user can easily grip the freezing compartment door 120 and the refrigerator compartment door 140 .

The dispenser 160 may be provided on the front surface of the freezer compartment door 120 as a convenience means for allowing a user to easily remove ice or drinking water without opening the freezer compartment door 120. In addition, A control panel 200 for controlling the driving operation of the refrigerator 1 and showing the state of the refrigerator 1 in operation can be further provided on the upper side.

The control panel 200 may include an input unit 220 including a plurality of buttons, and a display unit 230 for displaying a control screen and an operating state.

The display unit 230 displays information such as a control screen, an operating state, and a room temperature. For example, the display unit 230 can display the service type (each ice, water, sculptured ice) of the dispenser, the set temperature of the freezer, and the set temperature of the freezer.

The display unit 230 may be implemented as a liquid crystal display (LCD), a light emitting diode (LED), an organic light emitting diode (OLED), or the like. Also, the display unit 230 may be implemented as a touch screen capable of performing the function of the input unit 220 as well.

The input unit 220 may include a plurality of operation buttons. For example, the input unit 220 may include a dispenser setting button (not shown) for setting a dispenser service type (ice, water, sculpted ice, etc.), a freezer room temperature setting button (not shown) And a refrigerator compartment temperature setting button (not shown) for setting the freezer compartment temperature. Meanwhile, the input unit 220 may be implemented as a touch screen capable of performing the function of the display unit 230 as well.

On the other hand, the camera 300 can be disposed in one area inside the refrigerating chamber 129. In the figure, one camera 300 is disposed in the upper area of the refrigerating chamber 129, but the present invention is not limited thereto. A plurality of cameras may be disposed in a plurality of areas, or a plurality of cameras may be disposed in the upper area, Or disposed in an area adjacent to the door 140 in the hood. It is also possible to arrange it in the freezing chamber 139.

Meanwhile, the refrigerator according to the present invention is not limited to the double door type shown in the drawing, but may be a one door type, a sliding door type, a curtain door type, Type, and the like, and it is sufficient to provide a compressor and a fan for a refrigerator refrigeration cycle or a refrigeration cycle.

3 is a view schematically showing the configuration of the refrigerator of FIG.

The refrigerator 1 includes a compressor 112, a condenser 116 for condensing the refrigerant compressed by the compressor 112, a condenser 116 for condensing the refrigerant condensed in the condenser 116, A refrigerating compartment evaporator 122 disposed in a refrigerating compartment (not shown), a freezing compartment evaporator 124 disposed in a freezing compartment (not shown), and a refrigerant condenser 123 condensed in the refrigerating compartment evaporator 122 or the freezing compartment evaporator 124 A refrigerating compartment expansion valve 132 for expanding the refrigerant supplied to the refrigerating compartment evaporator 122 and a freezing compartment expansion valve 134 for expanding the refrigerant supplied to the freezing compartment evaporator 124 do.

The refrigerator 1 may further include a gas-liquid separator (not shown) in which refrigerant having passed through the evaporators 122 and 124 is separated into a liquid and a gas.

The refrigerator 1 further includes a refrigerator compartment fan 142 and a freezer compartment fan 142 for sucking the refrigerant that has passed through the refrigerating compartment evaporator 122 and the freezing compartment evaporator 124 and blowing them into a refrigerating compartment (not shown) and a freezing compartment (not shown) 144).

The controller may further include a compressor driving unit 113 for driving the compressor 112 and a refrigerating compartment fan driving unit 143 and a freezing compartment fan driving unit 145 for driving the refrigerating compartment fan 142 and the freezing compartment fan 144.

4 is a block diagram schematically illustrating the inside of the refrigerator shown in FIG.

4 includes a compressor 112, a refrigerating compartment fan 142, a freezing compartment fan 144, a control unit 310, a temperature sensing unit 320, a communication unit 222, a memory 240 An input unit 220, a display unit 230, an audio input unit 252, an audio output unit 254, a first heater 330, a second heater 331, and a camera 300. The refrigerator can further include a compressor driving unit 113, a refrigerating compartment fan driving unit 143, a freezing compartment fan driving unit 145, a first heater driving unit 332 and a second heater driving unit 333.

The input unit 220 includes a plurality of operation buttons and transmits a signal to the control unit 310 about the input freezing room set temperature or the refrigerating room setting temperature.

The display unit 230 can display refrigerator status information according to user input. For example, the current freezer compartment temperature or the refrigerating compartment temperature can be displayed.

The temperature sensing unit 320 senses the temperature in the refrigerator and transmits a signal indicating the sensed temperature to the controller 310. [ Here, the temperature sensing unit 320 senses the refrigerator compartment temperature and the freezer compartment temperature, respectively. It is also possible to detect the temperature of each chamber in the refrigerating chamber or each chamber in the freezing chamber.

The memory 240 may store various data for operation of the entire refrigerator 10. On the other hand, the memory 240 may be provided with a speech recognition algorithm.

In particular, the memory 240 may store a high-fat food list. Here, the high-fat food list may include a list of foods currently stored. Further, the high-fat food list may include a list of previously stored foods, in addition to the currently stored food list.

The audio input unit 252 can receive a user voice. For this purpose, a microphone may be provided. The received voice can be converted into an electric signal and transmitted to the control unit 310.

The audio output unit 254 converts the electric signal from the control unit 310 into an audio signal and outputs the audio signal. For this purpose, a speaker or the like may be provided.

The communication unit 222 operates to exchange data with an external electronic device in a wired or wireless manner, as described above. For example, data may be exchanged with the mobile terminal 500.

As another example, data can be exchanged with the AP apparatus 400 and data can be exchanged with the electronic apparatuses in the internal network 10 via the AP apparatus 400. [ Alternatively, it is possible to exchange data with various external electronic devices other than the internal network 10 through the AP apparatus 400 and the external network 550. [

The first heater 330 may be a defrost heater for removing the property occurring around the evaporator 124. The operation of the first heater 330 can be operated under the control of the first heater driving unit 332. [

The second heater 331 may be a defrost heater for removing the property that occurs around the evaporator 122. The operation of the second heater 331 can be operated under the control of the second heater driving unit 333. [

The camera 300 is disposed in at least one area within the compartment, and photographs the food to be received or the food image to be shipped. Then, the photographed image is transmitted to the control unit 310.

The camera 300 is activated when the door of the refrigerator is opened, is in operation when the door is closed, is inactivated, and may not operate.

The control unit 310 controls the compressor driving unit 113 and the fan driving unit 243 or 245 to directly control the on / off operation of the compressor 112 and the fan 142 or 144, And finally control the compressor 112, and the fan 142 or 144. [0050] Here, the fan driving unit may be a refrigerator compartment fan driving unit 143 or a freezing compartment fan driving unit 145.

For example, the control unit 310 may include a microcomputer and may output a corresponding speed command value signal to the compressor driving unit 113 or the fan driving unit 143 or 145, respectively.

(Not shown), a refrigerator compartment fan motor (not shown), and a freezer compartment fan motor (not shown) are respectively connected to the compressor driving unit 113, the refrigerating compartment fan driving unit 143 and the freezing compartment fan driving unit 145 And each of the electric motors (not shown) is operated at a target rotational speed under the control of the control unit 310.

When such an electric motor is a three-phase electric motor, it can be controlled by a switching operation in an inverter (not shown) or can be controlled at a constant speed by using AC power as it is. Here, each electric motor (not shown) may be any one of an induction motor, a BLDC (blush less DC) electric motor, a synRM (synchronous reluctance motor) electric motor,

On the other hand, the control unit 310 can control the operation of the entire refrigerator 1, in addition to the operation control of the compressor 112 and the fans 142 and 144, as described above. That is, the control unit 310 can control the overall operation of the refrigerant cycle in accordance with the set temperature from the input unit 220. A three-way valve (not shown), a refrigerating compartment expansion valve (not shown), and a freezing compartment expansion valve (not shown), in addition to the compressor driving portion 113, the refrigerating compartment fan driving portion 143 and the freezing compartment fan driving portion 145 You can control more. Also, the operation of the condenser (not shown) can be controlled. In addition, the control unit 310 may control the operation of the display unit 230.

5 is an internal block diagram of a mobile terminal.

5, the mobile terminal 500 includes a wireless communication unit 510, an audio / video (A / V) input unit 520, a user input unit 530, a sensing unit 540, an output unit 550, A memory 560, an interface unit 570, a control unit 580, and a power supply unit 590.

The wireless communication unit 510 may include a broadcast receiving module 511, a mobile communication module 513, a wireless Internet module 515, an NFC module 517, and a GPS module 519.

The broadcast receiving module 511 can receive at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 511 may be stored in the memory 560.

The mobile communication module 513 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 515 is a module for wireless Internet access, and the wireless Internet module 515 can be built in or externally attached to the mobile terminal 500. For example, the wireless Internet module 515 may perform WiFi based wireless communication or WiFi Direct based wireless communication.

NFC module 517 may perform near field communication. The NFC module 517 can receive data from the corresponding home appliance or transmit data to the home appliance when the user approaches or is tagged within a predetermined distance from the home appliance equipped with the NFC tag or the NFC module.

In addition, Bluetooth, RFID (radio frequency identification), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

GPS (Global Position System) module 519 may receive position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 520 is for inputting an audio signal or a video signal, and may include a camera 521 and a microphone 523.

The user input unit 530 generates key input data that the user inputs for controlling the operation of the terminal. To this end, the user input unit 530 may include a key pad, a dome switch, a touch pad (static pressure / static electricity), and the like. Particularly, when the touch pad has a mutual layer structure with the display 551, it can be called a touch screen.

The sensing unit 540 senses the current state of the mobile terminal 500 such as the open / close state of the mobile terminal 500, the position of the mobile terminal 500, A sensing signal can be generated.

The sensing unit 540 may include a sensing sensor 541, a pressure sensor 543, a motion sensor 545, and the like. The motion sensor 545 can detect the movement or the position of the mobile terminal 500 using an acceleration sensor, a gyro sensor, a gravity sensor, or the like. In particular, the gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction (angle) of rotation about the reference direction.

The output unit 550 may include a display 551, an acoustic output module 553, an alarm unit 555, and a haptic module 557, and the like.

The display 551 displays and outputs information processed by the mobile terminal 500. [

Meanwhile, as described above, when the display 551 and the touch pad have a mutual layer structure to constitute a touch screen, the display 551 may be used as an input device capable of inputting information by a user's touch in addition to the output device .

The audio output module 553 outputs audio data received from the wireless communication unit 510 or stored in the memory 560. [ The sound output module 553 may include a speaker, a buzzer, and the like.

The alarm unit 555 outputs a signal for notifying the occurrence of an event of the mobile terminal 500. For example, it is possible to output a signal in a vibration mode. .

The haptic module 557 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 557 is a vibration effect.

The memory 560 may store a program for processing and controlling the control unit 580 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The interface unit 570 serves as an interface with all the external devices connected to the mobile terminal 500. The interface unit 570 receives data from the external device or receives power from the external device and transmits the data to each component in the mobile terminal 500 so that data in the mobile terminal 500 can be transmitted to the external device .

The controller 580 typically controls the operation of the respective units to control the overall operation of the mobile terminal 500. For example, perform related controls and processing for voice calls, data communications, video calls, and the like. In addition, the control unit 580 may include a multimedia playback module 581 for multimedia playback. The multimedia playback module 581 may be configured in hardware in the controller 580 or may be configured in software separately from the controller 580. [

The power supply unit 590 receives external power and internal power under the control of the controller 580 and supplies power necessary for operation of the respective components.

Meanwhile, the block diagram of the mobile terminal 500 shown in FIG. 5 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted depending on the specifications of the actual implemented mobile terminal 500. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

FIG. 6 is a flowchart showing an operation method of a refrigerator according to an embodiment of the present invention, and FIGS. 7A to 9B are views referred to explain the operation method of FIG.

Referring to the drawings, the camera 300 in the refrigerator 1 shoots an image of a foodstuff to be received or dispatched (S610).

The controller 310 in the refrigerator 1 can control the camera 300 to be activated when the refrigerator door 140 or the freezer door 120 is opened. That is, it can be controlled to operate.

Then, the activated camera 300 can start shooting when the refrigerator door 140 or the freezer door 120 is opened. The captured image can be a still image, but a moving image is also possible. It may also be a plurality of still images photographed for a predetermined time. The photographed image is transmitted to the control unit 310.

Particularly, in connection with the embodiment of the present invention, when the user puts in or leaves the predetermined food into the refrigerator, the camera 300 can photograph the food image, including the user's hand, that is being put in or out.

FIG. 7A illustrates opening of the refrigerator door 140 by the user 600, and FIG. 7B illustrates the user wearing the predetermined food 605 in the refrigerator. At this time, the camera 300 can take an image of the food 605 to be received. In the figure, it is illustrated that the food 605 is a 'drop tomato'.

Next, the control unit 310 in the refrigerator 1 discriminates the photographed food image based on the high-fat food list (S620).

The control unit 310 calls up a list of high-fat foods stored in the memory 240 and searches for food images in the list associated with the picked-up food images.

For example, a high end food list may be a high end food list that has previously been stored, in addition to the currently stored high end food list.

On the other hand, the memory 240 may store an image of the food when storing the high-fat food list.

7C illustrates a high-fat food list 620 stored in the memory 240. FIG. The high-fat food list 620 may include a list 622 currently stored and a list 627 previously stored.

In the figure, a food name such as 'apple' or 'boat' item is stored in text format in the currently stored list 622. As described above, in addition to the text, And the like.

In the figure, the 'drop tomato' item 629 is stored in a text format in the previously stored list 627, but it is stored together with the 'drop tomato' image and the like in addition to the text It is possible.

The control unit 310 compares the 'droplet tomato' image and the photographed 'droplet tomato' image corresponding to the droplet tomato item 629 in the intrinsic food list 620, particularly the previously stored list 627 , It can be judged that the food item to be received is 'drop tomato'.

As described above, by performing the image search using the high-fat food list, the food can be identified quickly and simply. Therefore, the usability of the user can be increased.

On the other hand, the control unit 310 of the refrigerator 10 can control the outputting of the food name for the discriminated food through the audio output unit 254. That is, after determining the 'drop tomato' to be received, the audio output unit 254 can output audio called 'drop tomato'. As a result, the user can intuitively know that the food image discrimination is completed.

Next, the control unit 310 in the refrigerator 1 controls to update the high-fat food list based on the discriminated food image (S630). Accordingly, the memory 240 can store the updated, updated food list.

7D illustrates an updated high-fat food list 630 that is stored in the memory 240. FIG. The high end food list 630 may include an updated current stored list 632 and an updated previously stored list 637. [

The illustration shows that a food name such as 'apple', 'boat', 'bell tomato' item with the 'bell tomato' item 639 added in the updated currently stored list 632 is stored in text format One, as described above, besides the text, it is possible to store it together with an image of an 'apple', a 'boat' image, an image of 'Tomato Tomato' and the like.

On the other hand, in the figure, it is exemplified that the 'drop tomato' item is excluded from the updated previously stored list 637, but it is also possible to add it as shown in FIG. 7C.

Next, the communication unit 222 in the refrigerator 1 transmits the updated list of intrinsic foods to the mobile terminal (S640).

The control unit 310 in the refrigerator 1 can control to transmit the high-fat food list upon updating of the high-fat food list, periodically, or upon request for transferring the high-fat food list of the mobile terminal 500.

7E illustrates that a high-pitched food list (Slist) is transmitted from the refrigerator 1 to the mobile terminal 500. Fig.

Meanwhile, the intrinsic food list transmitted to the mobile terminal 500 may include at least one of a food name, a storage facility, a storage quantity, and an expiration date. Accordingly, the mobile terminal 500 can display the high-fat food list on the display.

FIG. 7F illustrates that information (640) about the item 'Drop Tomato' newly received at this time through the mobile terminal 500 is displayed on the display 180. FIG.

On the other hand, Figs. 7A to 7F illustrate that the food to be received is discriminated based on the image taken by the camera 300 of the refrigerator 1, and the high-fat food list is updated, but other examples are possible.

That is, Figs. 7A to 7F are diagrams for explaining, based on the image photographed by the camera 300 of the refrigerator 1 and the user's voice (for example, audio of 'drop tomato'), , It is also possible to comprehensively discriminate the foods to be received and update the list of high-priced foods.

On the other hand, Figs. 8A to 8C illustrate that the food to be shipped is discriminated based on the image taken by the camera 300 of the refrigerator 1, and the high-fat food list is updated.

8A illustrates that the user 600 opens the refrigerator door 140 and leaves the predetermined food 710 from the refrigerator. At this time, the camera 300 can take an image of the food 710 to be shipped. In the figure, it is exemplified that the food 710 is a 'drop tomato'.

8B illustrates a high-fat food list 630 stored in the memory 240. FIG. The high-fat food list 630 may include a list 632 currently stored and a list 637 previously stored.

In the figure, the name of the food such as 'apples', 'boats', and 'tomatoes' items is stored in text format in the currently stored list 632. As described above, , 'Boat' images, 'drop tomato' images, and the like.

The control unit 310 compares the 'droplet tomato' image and the photographed 'droplet tomato' image corresponding to the droplet tomato item 639 in the intrinsic food list 630, in particular, the current storage list 632 , It can be judged that the food item to be shipped is 'drop tomato'.

As described above, by performing the image search using the high-fat food list, the food can be identified quickly and simply. Therefore, the usability of the user can be increased.

On the other hand, the control unit 310 of the refrigerator 10 can control the outputting of the food name for the discriminated food through the audio output unit 254. That is, the audio output unit 254 can output the audio 'drop tomato' after determining the 'drop tomato' to be shipped. As a result, the user can intuitively know that the food image discrimination is completed.

FIG. 8C illustrates an updated, high-end food list 620 that is updated according to the user's food issue. That is, the high-fat food list 620 stored in the memory 240 is illustrated. The high end food list 620 may include an updated current stored list 622 and an updated previously stored list 627. [

In the drawing, it is illustrated that a food name such as an 'apple' or a 'boat' item in which a 'drop tomato' item is deleted, is stored in a text format in the updated currently stored list 622, Besides, it can be stored together with an 'apple' image, a 'boat' image and the like.

On the other hand, in the drawing, it is illustrated that the 'Drop Tomato' item 629 is added and stored in the text format in the updated previously stored list 627. However, as described above, in addition to the text, And the like.

On the other hand, even after shipment, the communication unit 222 in the refrigerator 1 can transmit the updated intrinsic food list to the mobile terminal. The control unit 310 in the refrigerator 1 can control to transmit the high-fat food list upon updating of the high-fat food list, periodically, or upon request for transferring the high-fat food list of the mobile terminal 500.

Figures 9A-B illustrate another example of a food dispenser for a refrigerator.

9A illustrates that the user 600 opens the refrigerator door 140 and the user leaves the predetermined food 910 from the refrigerator. At this time, the camera 300 can take an image of the food 810 that is going in and out. The figure illustrates that the food 810 is an apple.

Accordingly, the control unit 310 of the refrigerator 1 compares the image of the taken food with the image of the items in the old list using the internal list 630 of FIG. 8B described above, It can be confirmed that it is 'apple'.

Then, the control unit 310 of the refrigerator 1 can update the old list 820 as shown in FIG. 9B. That is, the 'apple' item can be deleted from the list 822 currently stored and the 'apple' item 829 can be added to the list 827 that was previously stored. Accordingly, at the time of goods receipt or shipment of the food, it is possible to quickly identify the food to be received or shipped based on the photographed images, and to update the high-priced food list.

The refrigerator according to the present invention is not limited to the configuration and the method of the embodiments described above but the embodiments may be modified such that all or some of the embodiments are selectively combined .

Meanwhile, the method of operating the refrigerator of the present invention can be implemented as a code that can be read by a processor on a processor-readable recording medium provided in a communication apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (14)

Photographing an image of a goods receipt or goods leaving;
Discriminating the photographed food image based on the intimate food list; And
And updating the high-fat food list based on the discriminated food image. The method according to claim 1,
And transmitting the updated list of high-tide foods to the mobile terminal. The method according to claim 1,
The high-
Wherein the list includes a list of high-fat foods currently stored in the refrigerator. The method of claim 3,
The high-
Further comprising a list of high-fat foods previously stored in the refrigerator. The method according to claim 1,
And displaying the food name corresponding to the discriminated image on the display or outputting it as audio. 3. The method of claim 2,
The updated high-fat food list, sent to the mobile terminal,
Wherein the refrigerator includes at least one of a food name, a storage facility, a storage quantity, and an expiration date. The method according to claim 1,
Receiving a user voice; And
Further comprising: recognizing the received user voice,
Wherein,
Wherein the food object to be received or shipped is discriminated on the basis of the picked-up food image and the recognized voice. A memory for storing the high-end food list;
A camera for taking images of the goods in stocking or leaving goods; And
And a control unit for discriminating the photographed food image based on the high quality food list and updating the high quality food list based on the discriminated food image. 9. The method of claim 8,
And a communication unit for transmitting the updated high-priced food list to the mobile terminal. 9. The method of claim 8,
The memory comprising:
Wherein the refrigerator includes a list of the in-house foods currently stored in the refrigerator. 11. The method of claim 10,
The memory comprising:
Wherein the refrigerator further comprises a list of high-fat foods previously stored in the refrigerator. 9. The method of claim 8,
A display section; And
And an audio output unit,
Wherein,
And displays the food name corresponding to the discriminated image on the display unit or outputs it to the audio output unit. 10. The method of claim 9,
Wherein,
Wherein the updated high-fat food list including at least one of a food name, a storage facility, a storage quantity, and an expiration date is transmitted to the mobile terminal. 9. The method of claim 8,
And an audio input unit for receiving user voice,
Wherein,
Recognizes the received user voice, and discriminates the food object to be received or shipped based on the picked-up food image and the recognized voice.
KR1020120150833A 2012-12-21 2012-12-21 Refrigerator, and method for including the same KR102014145B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020120150833A KR102014145B1 (en) 2012-12-21 2012-12-21 Refrigerator, and method for including the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020120150833A KR102014145B1 (en) 2012-12-21 2012-12-21 Refrigerator, and method for including the same

Publications (2)

Publication Number Publication Date
KR20140081267A true KR20140081267A (en) 2014-07-01
KR102014145B1 KR102014145B1 (en) 2019-08-26

Family

ID=51732621

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020120150833A KR102014145B1 (en) 2012-12-21 2012-12-21 Refrigerator, and method for including the same

Country Status (1)

Country Link
KR (1) KR102014145B1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105841434A (en) * 2016-05-25 2016-08-10 海信（山东）冰箱有限公司 Refrigerator and control method thereof
CN106123479A (en) * 2016-07-06 2016-11-16 辽宁科技学院 The food materials method for automatically inputting of refrigerator
WO2017010804A1 (en) * 2015-07-15 2017-01-19 Samsung Electronics Co., Ltd. Object recognition for a storage structure
KR20170028238A (en) * 2015-09-03 2017-03-13 삼성전자주식회사 Refrigerator
CN107816841A (en) * 2016-09-14 2018-03-20 青岛海尔智能技术研发有限公司 The detecting system and its detection method of food species inside refrigerator compartment
KR102338337B1 (en) * 2020-08-10 2021-12-09 엘지전자 주식회사 Method and appratus for managing items stored in refrigerator
WO2023132437A1 (en) * 2022-01-06 2023-07-13 삼성전자주식회사 Electronic device and method of controlling same
WO2024089973A1 (en) * 2022-10-27 2024-05-02 パナソニックＩｐマネジメント株式会社 Loading/unloading management system, and loading/unloading management method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024111710A1 (en) * 2022-11-25 2024-05-30 엘지전자 주식회사 Artificial intelligence apparatus and operation control method therefor

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002243335A (en) * 2001-02-21 2002-08-28 Toshiba Corp Food preservation chamber, home network device, portable information terminal, food information provision server, menu information provision server, and information provision server containing in preservation chamber
KR20040083784A (en) * 2003-03-25 2004-10-06 최철웅 The managing system and its process for the an article in custody of refrigerator
KR20120117464A (en) * 2011-04-15 2012-10-24 엘지전자 주식회사 A refrigerator and a control method the same

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002243335A (en) * 2001-02-21 2002-08-28 Toshiba Corp Food preservation chamber, home network device, portable information terminal, food information provision server, menu information provision server, and information provision server containing in preservation chamber
KR20040083784A (en) * 2003-03-25 2004-10-06 최철웅 The managing system and its process for the an article in custody of refrigerator
KR20120117464A (en) * 2011-04-15 2012-10-24 엘지전자 주식회사 A refrigerator and a control method the same

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017010804A1 (en) * 2015-07-15 2017-01-19 Samsung Electronics Co., Ltd. Object recognition for a storage structure
KR20170028238A (en) * 2015-09-03 2017-03-13 삼성전자주식회사 Refrigerator
CN105841434A (en) * 2016-05-25 2016-08-10 海信（山东）冰箱有限公司 Refrigerator and control method thereof
CN106123479A (en) * 2016-07-06 2016-11-16 辽宁科技学院 The food materials method for automatically inputting of refrigerator
CN107816841A (en) * 2016-09-14 2018-03-20 青岛海尔智能技术研发有限公司 The detecting system and its detection method of food species inside refrigerator compartment
CN107816841B (en) * 2016-09-14 2020-08-07 青岛海尔智能技术研发有限公司 Detection system and detection method for food types in refrigerator compartment
KR102338337B1 (en) * 2020-08-10 2021-12-09 엘지전자 주식회사 Method and appratus for managing items stored in refrigerator
WO2023132437A1 (en) * 2022-01-06 2023-07-13 삼성전자주식회사 Electronic device and method of controlling same
WO2024089973A1 (en) * 2022-10-27 2024-05-02 パナソニックＩｐマネジメント株式会社 Loading/unloading management system, and loading/unloading management method

Also Published As

Publication number Publication date
KR102014145B1 (en) 2019-08-26

Similar Documents

Publication Publication Date Title
KR20140081267A (en) Refrigerator, and method for including the same
US9640174B2 (en) Home appliance and operation method thereof
US11015859B2 (en) Refrigerator
US10015021B2 (en) Home appliance and mobile terminal
AU2010248277B2 (en) Mobile terminal
AU2010248278B2 (en) Mobile terminal, operating method thereof, and refrigerator
JP2019124461A (en) refrigerator
US9773408B2 (en) Mobile terminal and operation method thereof
KR20140125105A (en) Refrigerator and operating method thereof
US20060174641A1 (en) Refrigerator with a display module
US10573302B2 (en) Terminal and home appliance system including the same
US20120109378A1 (en) Robot refrigerator and system having the same
KR20140126429A (en) Refrigerator and operating method thereof
KR20140089795A (en) Home appliance, and method for including the same
US11215392B2 (en) Refrigerator
US9860621B2 (en) Home appliance and operating method thereof
KR20140081270A (en) Mobile terminal, communication device, and method for operaing the same
KR102010384B1 (en) Mobile terminal, home appliance, and method for including the same
KR20210039785A (en) Refrigerator and control method thereof
KR101992178B1 (en) A portable device and a controlling method for the portable device
KR102152730B1 (en) Home appliance, and method for including the same
KR20180052885A (en) Refrigerator and method for shopping goods using the same
KR20140089875A (en) Home appliance, mobile terminal, and method for including the same
KR102152729B1 (en) Home appliance, and method for including the same
KR102010381B1 (en) a portable device, a method for the portable device and the refrigerator system comprising thereof

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant