WO2018205558A1

WO2018205558A1 - Refrigerator and control method therefor

Info

Publication number: WO2018205558A1
Application number: PCT/CN2017/113172
Authority: WO
Inventors: 姚育; 季涛; 戴江; 胡宏亮
Original assignee: 合肥美的智能科技有限公司
Priority date: 2017-05-08
Filing date: 2017-11-27
Publication date: 2018-11-15
Also published as: CN107062796A

Abstract

Disclosed are a refrigerator (100) and a control method therefor, wherein the refrigerator (100) comprises: a drawer (102), a liner, a camera module (104), wherein the camera module (104) is arranged on a side face of the liner and is located at a position where same can photograph the contents of the drawer (102) when the drawer (102) is in a pulled-out state; a sensor (106) for detecting whether the drawer (102) is in the pulled-out state; and a processor (108) for obtaining a detection result from the sensor (106), and when the detection result indicates that the drawer (102) is in the pulled-out state, controlling the camera module (104) such that same carries out photography.

Description

Refrigerator and control method thereof

The present application claims priority to Chinese Patent Application No. JP-A No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No. No.

Technical field

The present invention relates to the field of household appliances, and in particular to a control method of a refrigerator and a refrigerator.

Background technique

At present, a camera module is disposed inside the refrigerator, and an object in the refrigerator is photographed by the camera module to identify an object placed in the refrigerator according to an image captured by the camera module. In the prior art, the camera module is disposed at the top of the cabinet of the refrigerator, and the camera module can only photograph objects on the shelf of the refrigerator, and cannot capture objects in the drawer. Even if the camera module can capture objects in the drawer, since the camera module is placed at the top of the cabinet of the refrigerator, it is far away from the drawer, and the shooting effect cannot be guaranteed.

Therefore, how to enable the camera module to capture objects in the drawer and ensure the shooting effect becomes a technical problem to be solved.

Summary of the invention

The present invention aims to solve at least one of the technical problems existing in the prior art or related art.

To this end, an object of the invention is to propose a refrigerator.

Another object of the present invention is to provide a method of controlling a refrigerator.

In order to achieve at least one of the above objects, according to an embodiment of the first aspect of the present invention, a refrigerator is provided, comprising: a drawer; a liner; a camera module disposed on a side of the liner, and when the drawer is at In the extracted state, the camera module is located at a position capable of capturing an object in the drawer; and a sensor is configured to detect whether the drawer is in an extracted state; And acquiring the detection result of the sensor, and when the detection result is that the drawer is in the extracted state, controlling the camera module to capture.

According to the refrigerator of the embodiment of the present invention, when the drawer is taken out from the refrigerator, since the camera module is disposed on the side of the refrigerator liner, the camera module is relatively close to the drawer, and the camera module can clearly capture the inside of the drawer. The placement of the object ensures the shooting effect of the camera module, which is beneficial for later image recognition and other operations.

The refrigerator according to the above embodiment of the present invention may further have the following technical features:

According to an embodiment of the present invention, the processor is further configured to: when determining that the door of the refrigerator is open, start the camera module, and when the detection result is that the drawer is not in the state of being pulled out Or determining that the camera module is closed when the door is closed.

According to the refrigerator of the embodiment of the present invention, when it is determined that the door of the refrigerator is opened, the camera module is activated to keep the camera module in a state to be photographed at a time, thereby ensuring that the camera module can be in the drawer in a timely manner. When shooting the objects placed in the drawer. Moreover, when the drawer is not in the drawn state, that is, the drawer slides into the refrigerator, or the drawer has not slipped out of the refrigerator after the door is opened, when the door is closed, the camera module is closed, so that the camera module is kept at all times. The working state, which not only prolongs the service life of the camera module, but also reduces the power consumption of the camera module.

According to an embodiment of the present invention, the drawer is disposed in a refrigerating chamber of the refrigerator, and the box door is a refrigerating chamber box door.

According to an embodiment of the present invention, the processor is specifically configured to: when the detection result is that the drawer is in a state of being withdrawn, and a ratio of a volume extracted from the refrigerator to a total volume of the drawer exceeds When the threshold is preset, the camera module is controlled to shoot.

According to the refrigerator of the embodiment of the present invention, when the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold (for example, the preset threshold is two-thirds), the drawer is mostly slipped from the refrigerator. At this time, the camera module can capture the objects in the drawer more comprehensively.

According to an embodiment of the invention, the camera module is rotatable to cause the camera module to capture objects in the drawer from different angles.

According to the refrigerator of the embodiment of the present invention, the camera module can shoot the drawer from different angles The object inside avoids the shooting dead angle, further ensuring that the camera module can fully capture the objects in the drawer.

According to an embodiment of the present invention, the method further includes: a communication module, configured to send the result of the camera module shooting to the server, so that the server identifies the name of the object in the drawer.

According to the refrigerator of the embodiment of the present invention, the result of photographing the camera module is transmitted to the server for the server to recognize the object placed in the drawer, thereby reducing the data processing capability of the refrigerator, improving the data processing speed, and also making the user A more comprehensive understanding of the objects placed in the refrigerator, in order to better manage the ingredients.

According to an embodiment of the invention, the sensor comprises a combination of one or more of the following: a Hall sensor, a distance sensor, a proximity sensor.

According to an embodiment of the invention, the inner casing comprises: a groove, and the camera module is disposed in the groove.

According to the refrigerator of the embodiment of the present invention, by disposing the camera module in the groove, the camera module is prevented from protrudingly disposed on the inner casing, thereby ensuring the appearance of the interior of the refrigerator.

According to an embodiment of the second aspect of the present invention, a control method of a refrigerator is provided, the refrigerator comprising: a drawer, a liner, and a camera module disposed on a side of the inner casing, and the control method of the refrigerator includes : detecting whether the drawer is in an extracted state; and when detecting that the drawer is in an extracted state, controlling the camera module to shoot.

According to the control method of the refrigerator according to the embodiment of the present invention, when the drawer is taken out from the refrigerator, since the camera module is disposed on the side of the refrigerator liner, the camera module is relatively close to the drawer, and the camera module can be clearly photographed. The placement of objects in the drawer ensures the shooting effect of the camera module, which is beneficial for later image recognition and other operations.

According to an embodiment of the present invention, the method further includes: determining whether the door of the refrigerator is opened before detecting whether the drawer is in a state of being withdrawn, and starting the camera module when determining that the door is open And detecting whether the drawer is in the withdrawn state; and after starting the camera module, if the drawer is not in the withdrawn state or determining that the door is closed, the camera module is closed.

According to the control method of the refrigerator according to the embodiment of the present invention, when it is determined that the door of the refrigerator is opened, The camera module is activated to keep the camera module in a state to be photographed at a time, thereby ensuring that the camera module can timely record the placement of objects in the drawer when the drawer is in the drawn state. Moreover, when the drawer slides into the refrigerator, or the drawer has not slipped out of the refrigerator after the door is opened, when the door is closed, the camera module is closed, so that the camera module is kept in working state, so that the camera module is not extended. The service life also reduces the power consumption of the camera module.

According to an embodiment of the present invention, the camera module is controlled to photograph when the drawer is in the withdrawn state and the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold.

According to the control method of the refrigerator according to the embodiment of the present invention, when the ratio of the volume withdrawn from the refrigerator to the total volume of the drawer exceeds a preset threshold (for example, the preset threshold is two-thirds), the drawer is mostly The refrigerator slides out, and the camera module can capture the objects in the drawer more comprehensively.

According to an embodiment of the present invention, the method further includes: transmitting a result of the camera module shooting to a server, wherein the server identifies the name of the object in the drawer.

According to the control method of the refrigerator according to the embodiment of the present invention, the result of photographing the camera module is sent to the server, so that the server can recognize the object placed in the drawer, thereby reducing the data processing capability of the refrigerator and improving the data processing speed. It also enables users to more fully understand the objects placed in the refrigerator, so as to better manage the ingredients.

A third aspect of the present invention provides a refrigerator including a processor, wherein the processor is configured to implement the steps of the control method of the refrigerator according to any one of the above aspects when the computer program stored in the memory is executed .

A fourth aspect of the invention provides a computer readable storage medium having stored thereon a computer program, the computer program being executed by a processor, the step of implementing the control method of the refrigerator according to any one of the above aspects .

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

DRAWINGS

The above and/or additional aspects and advantages of the present invention are described in connection with the embodiments of the accompanying drawings The description will become obvious and easy to understand, where:

FIG. 1 is a schematic structural view of a refrigerator according to an embodiment of the present invention; FIG.

2 is a schematic flow chart showing a control method of a refrigerator according to an embodiment of the present invention;

FIG. 3 is a schematic flow chart showing a control method of a refrigerator according to another embodiment of the present invention; FIG.

Figure 4 shows a schematic block diagram of a refrigerator in accordance with an embodiment of the present invention.

Wherein, the correspondence between the mark of the drawing in FIG. 1 and the part name is:

100 refrigerators, 102 drawers, 104 camera modules, 106 sensors, 108 processors, 110 boxes, 112 shelves.

detailed description

The present invention will be further described in detail below with reference to the drawings and specific embodiments. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict.

In the following description, numerous specific details are set forth in order to provide a full understanding of the invention, but the invention may be practiced otherwise than as described herein. Limitations of the embodiments.

FIG. 1 shows a schematic structural view of a refrigerator in accordance with an embodiment of the present invention.

As shown in FIG. 1, a refrigerator 100 according to an embodiment of the present invention includes: a drawer 102; a liner; a camera module 104 disposed on a side of the inner casing, and the camera module 104 when the drawer 102 is in the withdrawn state. The sensor 106 is configured to detect whether the drawer 102 is in the extracted state; the processor 108 acquires the detection result of the sensor 106, and when the detection result is that the drawer 102 is in the extracted state, the control is performed. The camera module 104 captures.

In this technical solution, when the drawer 102 is taken out from the refrigerator 100, since the camera module 104 is disposed on the side of the inner tank of the refrigerator 100, the camera module 104 is relatively close to the drawer 102, and the camera module 104 can be photographed very clearly. The object placement in the drawer 102 is ensured, thereby ensuring the shooting effect of the camera module 104, which is advantageous for post-image recognition and the like.

Wherein, the drawer 102 is in the withdrawn state, and the drawer 102 is slid out from the refrigerator 100. The rear state and the state in the process in which the drawer 102 slides into the refrigerator 100.

In the above technical solution, preferably, the processor 108 is further configured to: when determining that the box door 110 of the refrigerator 100 is opened, start the camera module 104, and when the detection result is that the drawer 102 is not in the state of being withdrawn or determine the door When the 110 is off, the camera module 104 is turned off.

When it is determined that the door 110 of the refrigerator 100 is opened, the camera module 104 is activated to keep the camera module 104 in a state to be photographed at a time, thereby ensuring that the camera module 104 can slide out of the refrigerator 100 in time. The placement of objects within the drawer 102 is photographed. Moreover, when the drawer 102 slides into the refrigerator 100, or after the door 110 is opened, the drawer 102 has not slipped out of the refrigerator 100, and when the door 110 is closed, the camera module 104 is closed, so that the camera module 104 is kept in operation. The state not only extends the service life of the camera module 104, but also reduces the power consumption of the camera module 104.

In the above technical solution, preferably, the drawer 102 is disposed in the refrigerating compartment of the refrigerator 100, and the bin door 110 is the refrigerating compartment door 110.

In the above technical solution, preferably, the processor 108 is specifically configured to: when the detection result is that the drawer 102 is in the withdrawn state, and the ratio of the volume extracted from the refrigerator 100 to the total volume of the drawer 102 exceeds a preset threshold, The camera module 104 is controlled to shoot.

When the ratio of the volume of the drawer 102 taken out from the refrigerator 100 to the total volume of the drawer 102 exceeds a preset threshold (for example, the preset threshold is two-thirds), it is indicated that the drawer 102 mostly slides out of the refrigerator 100. The camera module 104 is capable of capturing objects in the drawer 102 more comprehensively.

In the above technical solution, preferably, the camera module 104 can be rotated to cause the camera module 104 to photograph objects in the drawer 102 from different angles.

The camera module 104 can capture objects in the drawer 102 from different angles to avoid shooting dead angles, and further ensures that the camera module 104 can comprehensively capture objects in the drawer 102.

In the above technical solution, preferably, the refrigerator 100 further includes: a communication module, configured to send the result of the camera module 104 to the server, so that the server recognizes the name of the object in the drawer 102.

Sending the result of the camera module 104 to the server for identification by the server The objects placed in the drawer 102 reduce the data processing capability of the refrigerator 100, improve the data processing speed, and enable the user to more fully understand the objects placed in the refrigerator 100, thereby better managing the ingredients.

In the above technical solution, preferably, the sensor 106 includes one or a combination of the following: a Hall sensor 106, a distance sensor 106, and a proximity sensor 106.

In the above technical solution, preferably, the inner tank includes: a groove, and the camera module 104 is disposed in the groove.

By arranging the camera module 104 in the recess, the camera module 104 is prevented from protruding on the inner casing, thereby ensuring the appearance of the interior of the refrigerator 100.

In any of the above technical solutions, preferably, the processor 108 is disposed inside the box door 110, and the processor 108 in FIG. 1 is a broken line indicating that the processor 108 is disposed inside the box door 110.

In any of the above aspects, preferably, the camera module 104 is coupled to the processor 108 via a connector and a harness, and the sensor 106 is coupled to the processor 108 via a connector and a harness.

In any of the above technical solutions, preferably, the refrigerator 100 further includes at least one shelf 112. When the refrigerator 100 includes a plurality of shelves 112, the camera module 104 is disposed at two shelves 112 closest to the camera module 104. between.

2 shows a schematic flow chart of a method of controlling a refrigerator in accordance with one embodiment of the present invention.

As shown in FIG. 2, in a control method of a refrigerator according to an embodiment of the present invention, a refrigerator includes: a drawer, a liner, and a camera module disposed on a side of the inner liner, and the control method of the refrigerator includes:

In step 202, it is detected whether the drawer is in the withdrawn state.

Step 204: Control the camera module to shoot when it is detected that the drawer is in the withdrawn state.

Wherein, the drawer is in a state of being withdrawn: a state in which the drawer slides out from the refrigerator and a state in which the drawer slides into the refrigerator.

According to the control method of the refrigerator according to the embodiment of the present invention, when the drawer is taken out from the refrigerator, since the camera module is disposed on the side of the refrigerator liner, the camera module is relatively close to the drawer, and the camera module can be clearly photographed. The placement of objects in the drawer ensures the camera The shooting effect of the module is conducive to the operation of image recognition in the later stage.

In the above technical solution, preferably, the method further includes: determining whether the door of the refrigerator is opened before detecting whether the drawer is in the drawn state, and starting the camera module and detecting the sliding and sliding of the drawer when determining that the door is open The state of the output; and after the camera module is activated, if the drawer is not in the withdrawn state or the door is closed, the camera module is closed.

When it is determined that the box door of the refrigerator is opened, the camera module is activated to keep the camera module in a state to be photographed at a time, thereby ensuring that the camera module can timely capture the object placement in the drawer when the drawer is in the withdrawn state. Moreover, when the drawer slides into the refrigerator, or the drawer has not slipped out of the refrigerator after the door is opened, when the door is closed, the camera module is closed, so that the camera module is kept in working state, so that the camera module is not extended. The service life also reduces the power consumption of the camera module.

In any of the above aspects, preferably, when the drawer is in the withdrawn state, and the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold, the camera module is controlled to shoot.

When the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold (for example, the preset threshold is two-thirds), it means that most of the drawer slides out of the refrigerator, and the camera module can be compared. Fully capture the objects in the drawer.

In any of the above technical solutions, preferably, the method further comprises: transmitting the result of the camera module shooting to the server, so that the server recognizes the name of the object in the drawer.

By sending the results of the camera module to the server, the server can identify the objects placed in the drawer, reduce the data processing capability of the refrigerator, improve the data processing speed, and enable the user to more fully understand the placement in the refrigerator. Objects, and thus better management of ingredients.

FIG. 3 shows a schematic flow chart of a control method of a refrigerator in accordance with another embodiment of the present invention.

As shown in FIG. 3, a method for controlling a refrigerator according to another embodiment of the present invention includes:

In step 302, it is determined whether the door of the refrigerator is open. If the result of the determination is yes, step 304 is performed. If the result of the determination is no, step 302 is performed again.

In step 304, the camera module is powered on to activate the camera module.

Step 306, judging whether the drawer slides out from the refrigerator, or whether the drawer is in the process of sliding into the refrigerator. When the judgment result is yes, indicating that the drawer is in the extracted state, step 308 is performed, and when the judgment result is no, Go to step 310.

Step 308, controlling the camera module to shoot.

In step 310, it is determined whether the door is closed. If the determination result is yes, step 312 is performed. If the determination result is no, step 306 is performed.

In step 312, the camera module is powered off to turn off the camera module.

The technical solution of the present invention is described in detail above with reference to the accompanying drawings. With the technical solution of the present invention, the camera module in the refrigerator can capture objects in the drawer and ensure the shooting effect.

As shown in FIG. 4, a refrigerator 40 according to an embodiment of the present invention includes a processor 404 for implementing control of a refrigerator according to any one of the above technical solutions when executing a computer program stored in the memory 402. The steps of the method.

A computer readable storage medium according to an embodiment of the present invention, wherein a computer program is stored thereon, the computer program being executed by a processor to implement the steps of the control method of the refrigerator according to any one of the above aspects.

In the present invention, the terms "first" and "second" are used for the purpose of description only, and are not to be understood as indicating or implying relative importance; the term "plurality" means two or more; the term "connected" , "connection" and the like should be understood in a broad sense, for example, it may be a fixed connection, a detachable connection, or an integral connection; it may be directly connected or indirectly connected through an intermediate medium. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.

The above description is only the preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes can be made to the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A refrigerator, comprising:

drawer;

Liner

a camera module disposed on a side of the inner casing, and the camera module is located at a position capable of capturing an object in the drawer when the drawer is in an extracted state;

a sensor for detecting whether the drawer is in a state of being withdrawn;

The processor acquires a detection result of the sensor, and controls the camera module to capture when the detection result is that the drawer is in an extracted state.
The refrigerator according to claim 1, wherein said processor is further configured to:

When the door of the refrigerator is determined to be open, the camera module is activated, and

When the detection result is that the drawer is not in the withdrawn state or it is determined that the door is closed, the camera module is closed.
The refrigerator according to claim 1 or 2, characterized in that

The drawer is disposed in a refrigerating chamber of the refrigerator, and the box door is a refrigerating chamber box door.
The refrigerator according to any one of claims 1 to 3, wherein the processor is specifically used for

When the detection result is that the drawer is in the withdrawn state, and the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold, the camera module is controlled to capture.
The refrigerator according to any one of claims 1 to 4, characterized in that

The camera module is rotatable to cause the camera module to capture objects in the drawer from different angles.
The refrigerator according to any one of claims 1 to 5, further comprising:

And a communication module, configured to send the result of the camera module to the server, so that the server identifies the name of the object in the drawer.
The refrigerator according to any one of claims 1 to 6, wherein

The sensor includes one or a combination of the following: a Hall sensor, a distance sensor, a proximity sensor.
The refrigerator according to any one of claims 1 to 7, wherein the inner tank comprises:

a groove, the camera module being disposed in the groove.
A refrigerator control method, comprising: a drawer, a liner, and a camera module disposed on a side of the inner tank, wherein the control method of the refrigerator comprises:

Detecting whether the drawer is in an extracted state;

The camera module is controlled to be photographed when it is detected that the drawer is in the withdrawn state.
The control method of the refrigerator according to claim 9, further comprising:

Determining whether the door of the refrigerator is opened before detecting whether the drawer is in the withdrawn state, and when determining that the door is open, starting the camera module and detecting whether the drawer is in an extracted state ;as well as

After the camera module is activated, if the drawer is not in the withdrawn state or it is determined that the door is closed, the camera module is closed.
A control method of a refrigerator according to claim 9, wherein

The camera module is controlled to photograph when the drawer is in the withdrawn state and the ratio of the volume extracted from the refrigerator to the total volume of the drawer exceeds a preset threshold.
The control method of the refrigerator according to any one of claims 9 to 11, further comprising:

Sending the result of the camera module shooting to the server, for the server to recognize the name of the object in the drawer.