CN113158876A - Method for identifying information of articles in refrigerator, refrigerator and computer storage medium - Google Patents
Method for identifying information of articles in refrigerator, refrigerator and computer storage medium Download PDFInfo
- Publication number
- CN113158876A CN113158876A CN202110413457.5A CN202110413457A CN113158876A CN 113158876 A CN113158876 A CN 113158876A CN 202110413457 A CN202110413457 A CN 202110413457A CN 113158876 A CN113158876 A CN 113158876A
- Authority
- CN
- China
- Prior art keywords
- article
- articles
- refrigerator
- bottle
- bottle seat
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 235000004522 Pentaglottis sempervirens Nutrition 0.000 claims abstract description 22
- 240000004050 Pentaglottis sempervirens Species 0.000 claims abstract description 20
- 241001300198 Caperonia palustris Species 0.000 claims abstract description 3
- 235000000384 Veronica chamaedrys Nutrition 0.000 claims abstract description 3
- 230000005540 biological transmission Effects 0.000 claims description 12
- 238000004590 computer program Methods 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 6
- 238000013135 deep learning Methods 0.000 claims description 3
- 230000006872 improvement Effects 0.000 description 8
- 235000013305 food Nutrition 0.000 description 5
- 239000000463 material Substances 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000003708 edge detection Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 235000013618 yogurt Nutrition 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
- G06V20/36—Indoor scenes
-
- F—MECHANICAL ENGINEERING; LIGHTING; HEATING; WEAPONS; BLASTING
- F25—REFRIGERATION OR COOLING; COMBINED HEATING AND REFRIGERATION SYSTEMS; HEAT PUMP SYSTEMS; MANUFACTURE OR STORAGE OF ICE; LIQUEFACTION SOLIDIFICATION OF GASES
- F25D—REFRIGERATORS; COLD ROOMS; ICE-BOXES; COOLING OR FREEZING APPARATUS NOT OTHERWISE PROVIDED FOR
- F25D29/00—Arrangement or mounting of control or safety devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Chemical & Material Sciences (AREA)
- Combustion & Propulsion (AREA)
- Mechanical Engineering (AREA)
- Thermal Sciences (AREA)
- General Engineering & Computer Science (AREA)
- Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
Abstract
The invention provides a method for identifying information of articles in a refrigerator, the refrigerator and a computer storage medium, wherein the method for identifying the information of the articles in the refrigerator comprises the following steps: acquiring a bird-eye view image including spaces in a plurality of refrigerator bottle seats; detecting and judging whether articles in the bottle seat are shielded by the bottle seat above the articles in the bird's-eye view image, and when shielded articles exist, adjusting the position relation between the bottle seat above the articles and the bottle seat for storing the articles until the articles and the bottle seat above the articles are not shielded; and acquiring a bird's-eye view image comprising a plurality of spaces in the bottle seats of the refrigerator again, and identifying the article information according to the top surface pattern of the article. The condition that the article is sheltered from by the bottle seat in the image shot is judged, and the height of the bottle seat is adjusted to expose the article completely in the image, so that the accuracy of information identification of the article stored in the bottle seat is improved, and the condition that the article cannot be identified due to sheltering is reduced.
Description
Technical Field
The invention relates to the field of refrigerating devices, in particular to a method for identifying information of articles in a refrigerator, the refrigerator and a computer storage medium.
Background
With the development of intellectualization of home appliances, recognizing the internal food materials has been a function necessary only for refrigerators. Generally, in order to identify food materials inside a refrigerator, one or more cameras are installed in an internal storage space of the refrigerator for shooting the food materials, and after a shot picture is processed, an identification result is generated and sent to a user terminal for the user to view. The refrigerator bottle seat is usually used for storing yoghourt and other articles with short shelf life, the requirement for food material information identification is higher, a method for shooting a bird's eye view of the articles stored in the bottle seat is proposed at present, and because the pattern content of the top surface of the articles is relatively fixed, the influence of the article placing angle is small, and the articles are easier to identify.
However, when some articles with a high height are stored in the bottle seat during shooting, the bottle seat above the articles can shield the top surface of the articles, so that the articles are difficult to identify.
Disclosure of Invention
The invention aims to provide an article information identification method in a refrigerator, the refrigerator and a computer storage medium.
The invention provides a method for identifying information of articles in a refrigerator, which comprises the following steps:
acquiring a bird's-eye view image including a plurality of spaces in a bottle seat of a refrigerator,
detecting and judging whether articles in the bottle seat are shielded by the bottle seat above the articles in the bird's-eye view image, and when shielded articles exist, adjusting the position relation between the bottle seat above the articles and the bottle seat for storing the articles until the articles and the bottle seat above the articles are not shielded;
and acquiring a bird's-eye view image comprising a plurality of spaces in the bottle seats of the refrigerator again, and identifying the article information according to the top surface pattern of the article.
As a further improvement of the present invention, "acquiring a bird's-eye view image including a plurality of spaces in a bottle seat of a refrigerator" specifically includes the steps of:
and detecting that the refrigerator door body moves to form a preset angle with the refrigerator body, and controlling a camera arranged at the top of the refrigerator body to shoot to obtain a bird's-eye view image of the space in the bottle holder.
As a further improvement of the present invention, after "acquiring a bird's-eye view image including a plurality of spaces in a bottle seat of a refrigerator", the method further comprises the steps of:
detecting and identifying edge contour lines of a plurality of bottle seats;
defining at least the area between adjacent edge contour lines between adjacent bottle seats as an identification area;
and detecting and identifying the article image in the identification area.
As a further improvement of the present invention, "detecting and determining whether the article in the bottle seat is blocked by the bottle seat above the article in the bird's-eye view image" specifically includes the steps of:
detecting and identifying an edge contour line of an article;
and if the edge contour line of the article is intersected with the edge contour line of the bottle seat above the article, judging that the article is blocked.
As a further improvement of the present invention, "adjusting the positional relationship between the bottle seat above the article and the bottle seat storing the article until there is no shielding between the article and the bottle seat above the article" specifically includes:
and controlling the bottle seat above the article to move upwards along the transmission device or controlling the bottle seat eye transmission device for storing the article to move downwards until no overlapping or intersecting part exists between the edge contour line of the shielded article and the edge contour line of the bottle seat above the shielded article.
As a further improvement of the invention, the method also comprises the following steps:
and when the bottle seat is judged to generate resistance in the movement, stopping the movement of the bottle seat.
As a further improvement of the invention, the method also comprises the following steps:
detecting the nearest distance between the edge contour line of the article and the edge contour line of the bottom of the bottle seat above the article in the detection area;
and when the closest distance is greater than the preset spacing distance, adjusting the position relation between the bottle seat above the article and the bottle seat for storing the article until the edge contour line of the shielded article and the edge contour line of the bottle seat above the shielded article reach the preset distance.
As a further improvement of the present invention, "performing detection and identification on an article image in the identification area" specifically includes:
and identifying the top surface information of the articles through a deep learning identification algorithm to obtain the category information of the articles, recording the storage time and counting the number of the articles of the same category.
The invention also provides a refrigerator, which comprises a plurality of bottle seats arranged on a refrigerator door body, wherein the bottle seats are arranged on the door body in a sliding manner through a transmission device and move up and down along the frame of the door body in a sliding manner;
the top of the refrigerator body is provided with a camera which is arranged towards the outside of the refrigerator body and is used for shooting the space in the bottle seat;
the refrigerator also comprises a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor executes the program to realize the steps of the method for identifying the information of the articles in the refrigerator.
As a further improvement of the invention, the transmission device comprises a slide rail and a driving device, and the bottle seat is arranged on the frame of the refrigerator door body through the slide rail and is controlled by the driving module to move along the slide rail.
The invention also provides a computer storage medium, wherein a computer program is stored in the computer storage medium, and when the computer program runs, the equipment of the computer storage medium executes the steps of the method for identifying the information of the articles in the refrigerator.
The invention has the beneficial effects that: the condition that the article is sheltered from by the bottle seat in the image shot is judged, and the height of the bottle seat is adjusted to expose the article completely in the image, so that the accuracy of information identification of the article stored in the bottle seat is improved, and the condition that the article cannot be identified due to sheltering is reduced.
Drawings
Fig. 1 is a flowchart illustrating a method for identifying information on an object in a refrigerator according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a bottle holder area photographed in one embodiment of the present invention.
Fig. 3 is a schematic flow chart related to defining an identification area according to an embodiment of the present invention.
Fig. 4 is a detailed flowchart illustrating step S2 in the method for identifying information on articles in a refrigerator according to an embodiment of the present invention.
FIG. 5 is a schematic diagram of the bottle holder 1b and the bottle holder 1c after their positions are adjusted according to the embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clear, the technical solutions of the present application will be clearly and completely described below with reference to the detailed description of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art without any inventive work based on the embodiments in the present application are within the scope of protection of the present application.
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
For convenience in explanation, the description herein uses terms indicating relative spatial positions, such as "upper," "lower," "rear," "front," and the like, to describe one element or feature's relationship to another element or feature as illustrated in the figures. The term spatially relative position may encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as "below" or "above" other elements or features would then be oriented "below" or "above" the other elements or features. Thus, the exemplary term "below" can encompass both a spatial orientation of below and above.
As shown in fig. 1, the present invention provides a method for identifying information of articles in a refrigerator, comprising the steps of:
s1: the method comprises the steps of obtaining a bird's-eye view image of the space in a plurality of refrigerator bottle seats.
Specifically, in the present embodiment, the acquiring the bird's-eye view image specifically includes the steps of:
and detecting that the refrigerator door body moves to form a preset angle with the refrigerator body, and controlling a camera arranged at the top of the refrigerator body to shoot to obtain a bird's-eye view image of the space in the bottle holder.
Exemplarily, the camera is arranged at the top of the refrigerator body, a plurality of rows of bottle holders are arranged on a refrigerator door body and used for placing articles such as food materials and medicines which need to be stored at low temperature, an angle sensor is arranged at the refrigerator door body, and when the condition that the refrigerator door body moves to form a preset angle with the refrigerator body is detected, the camera is controlled to shoot to obtain a bird-eye view image. Preferably, the preset angle is 30 degrees, when the camera at the top of the refrigerator body shoots the bottle seat area on the door body, the camera can shoot the conditions in the multiple bottle seat areas completely by a overlooking angle, and the upper end face patterns of the articles stored in the bottle seats can be shot, so that the subsequent identification of the article types is facilitated, and when the camera is shot at the position of 30 degrees, the blocking between the articles is small, the identification is easy, the articles occupy a large area in the image, and the invalid information in the image can be reduced.
As shown in fig. 2, a schematic diagram of the area of the bottle holder obtained by photographing is shown.
Further, as shown in fig. 3, in some embodiments of the present invention, after obtaining the bird's-eye view image, the method further includes:
s11: and detecting and identifying edge contour lines of a plurality of bottle seats.
The contour line of the edge of the bottle base is identified by an edge detection algorithm, and further, in some embodiments, the edge of the bottle base is provided with a marking line for enhancing the identification effect. The edge detection algorithm may adopt currently common algorithms such as Roberts, Sobel, Prewitt, Canny, Log, etc., and specific algorithm contents are not described herein again.
S12: at least the area between adjacent edge contour lines between adjacent bottle holders is defined as an identification area.
Specifically, the contour lines are numbered according to the arrangement sequence, and the area between the adjacent edge contour lines between two adjacent bottle seats is selected as the identification area according to the arrangement sequence of the bottle seats, for example, as shown in the second figure, a first bottle seat 1a, a second bottle seat 1b and a third bottle seat 1c are sequentially arranged on the refrigerator door body from bottom to top, the recognized edge contour lines are numbered as 11, 12, 13, 14, 15 and 16 in sequence from bottom to top, wherein the edge contour line 11 and the edge contour line 12 are contour lines of the first bottle holder 1a, the edge contour line 13 and the edge contour line 14 are contour lines of the second bottle holder 1b, the edge contour line 15 and the edge contour line 16 are contour lines of the third bottle holder 1c, respectively, and at this time, the areas between the edge contour lines 12 and 13, the edge contour lines 14 and 15, and the edge contour line 16 to the image top area are defined as identification areas, respectively.
S13: and detecting and identifying the article image in the identification area.
The identification area is divided by the method, so that the position of the article to be identified in the image can be accurately defined, invalid information in the identification area is reduced, and the speed and the accuracy of subsequent article information detection and identification are improved.
In other embodiments of the present invention, the camera may also be disposed on the refrigerator door and arranged facing the refrigerator body, and after detecting that the refrigerator door and the refrigerator body form a preset angle, the camera is started to photograph the storage conditions of the articles in the refrigerating chamber and the freezing chamber.
S2: and detecting and judging whether the articles in the bottle seat are shielded by the bottle seat above the articles in the bird's-eye view image, and when the shielded articles exist, adjusting the position relation between the bottle seat above the articles and the bottle seat for storing the articles until the articles and the bottle seat above the articles are not shielded.
Specifically, as shown in fig. 4, step S2 includes the steps of:
s21: and detecting and identifying the edge contour line of the article.
S22: and if the edge contour line of the article is intersected with the edge contour line of the bottle seat above the article, judging that the article is blocked.
If the article is shielded by the bottle seat above the article in the image, the edge contour of the article and the bottle seat must be partially intersected, and whether the article is shielded can be accurately judged by judging whether the edge contour lines of the article and the bottle seat are intersected or not.
For example, as shown in fig. 2, the top patterns of the articles 2 and 3 stored in the refrigerator are respectively blocked by the bottle seat 1b and the bottle seat 1c above the articles 2 and 3, at this time, the edge contour line of the article 2 and the edge contour line 13 are partially overlapped, and the edge contour line of the article 3 and the edge contour line 15 are partially overlapped, so that the articles 2 and 3 cannot be accurately detected and identified.
S23: and controlling the bottle seat above the article to move upwards along the transmission device or controlling the bottle seat for storing the article to move downwards along the transmission device until no overlapping or intersecting part exists between the edge contour line of the shielded article and the edge contour line of the bottle seat above the shielded article.
Further, when being equipped with a plurality of bottle seats, adjust the bottle seat position according to from the order up or according to from the order down in proper order.
Specifically, the relationship between the shielded object and the bottle seat can be monitored and calculated in real time through the camera, or the fixed distance of each movement of the bottle seat is set, and the shielded object is photographed and judged again when the bottle seat moves once, until the shielded object does not exist.
Furthermore, when the position of the bottle seat is adjusted, the method also comprises the following steps: and when the bottle seat is judged to generate resistance in the movement, stopping the movement of the bottle seat. Or, an adjusting distance threshold is set for each bottle seat, so that the damage to the refrigerator structure and the stored articles caused by collision between the articles in the bottle seat and the bottle seat above the article in the adjustment process is avoided.
Illustratively, as shown in fig. 5, there is a schematic diagram of the bottle holder 1b and the bottle holder 1c after the positions thereof are adjusted, in which the article 2 and the bottle holder 1b, and the article 3 and the bottle holder 1c are in a state of being separated from each other just on the image.
Further, in some embodiments of the present invention, after performing step S23, the method further includes the steps of:
s24: and detecting the nearest distance between the edge contour line of the article and the edge contour line of the bottom of the bottle seat above the article in the detection area.
S25: when the nearest distance is larger than the preset spacing distance, the position relation between the bottle seat above the article and the bottle seat for storing the article is adjusted until the edge contour line of the article to be shielded and the edge contour line of the bottle seat above the article reach the preset distance.
The two steps are suitable for the condition that the distance between the bottle seat and the article below the bottle seat is too large. When the distance between the edge contour line of the article and the edge contour line of the bottom of the bottle seat above the article exceeds the preset distance, the bottle seat is adjusted to move downwards, so that the size of the identification area is reduced, invalid information in the identification area is reduced, the accuracy of subsequent identification and detection is improved, and the space in the bottle seat of the refrigerator can be effectively utilized.
The bottle seat height is adjusted through adjustment so as to reduce the condition that articles are shielded by the bottle seat in the shot image, thereby improving the subsequent accuracy of information identification of the articles stored in the bottle seat, reducing the condition that the articles cannot be identified due to shielding, and improving the user experience.
S3: and acquiring a bird's-eye view image comprising a plurality of spaces in the bottle seats of the refrigerator again, and identifying the article information according to the top surface pattern of the article.
And identifying the top surface information of the article through a deep learning identification algorithm, detecting and identifying the category information of the article, recording the storage time and counting the number of the similar articles.
According to the top surface image information, the type information of the identified article is detected, and compared with the side pattern of the identified article, the top pattern is more convenient to set and the identification accuracy is higher.
The invention also provides a refrigerator, which comprises a plurality of bottle seats arranged on a refrigerator door body, wherein the bottle seats are arranged on the door body in a sliding manner through a transmission device and move up and down along the frame of the door body in a sliding manner.
The top of the refrigerator body is provided with a camera which is arranged towards the outside of the refrigerator body and is used for shooting the space in the bottle seat;
the refrigerator further comprises a memory and a processor, wherein the memory stores a computer program capable of running on the processor, and the processor executes the computer program to realize the steps of the method for identifying the information of the articles in the refrigerator.
Furthermore, the transmission device comprises a slide rail and a driving device, and the bottle seat is arranged on the frame of the refrigerator door body through the slide rail and is controlled by the driving module to move along the slide rail.
Furthermore, the refrigerator is also provided with an angle sensing device for detecting the included angle between the refrigerator door and the refrigerator body.
The present invention also provides a computer storage medium in which a computer program is stored, and the computer program when executed causes an apparatus of the computer storage medium to perform the steps of the method for identifying information on articles in a refrigerator according to any one of claims 1 to 7.
In summary, the bottle holder height is adjusted and adjusted by judging the condition that the article in the shot image is shielded by the bottle holder to completely expose the article in the image, so that the accuracy of identifying the article information stored in the bottle holder is improved, the condition that the article cannot be identified due to being shielded is reduced, and the user experience is improved.
It should be understood that although the present description refers to embodiments, not every embodiment contains only a single technical solution, and such description is for clarity only, and those skilled in the art should make the description as a whole, and the technical solutions in the embodiments can also be combined appropriately to form other embodiments understood by those skilled in the art.
The above-listed detailed description is only a specific description of a possible embodiment of the present invention and is not intended to limit the scope of the present invention, and equivalent embodiments or modifications made without departing from the technical spirit of the present invention are included in the scope of the present invention.
Claims (11)
1. A method for identifying information of articles in a refrigerator is characterized by comprising the following steps:
acquiring a bird-eye view image including spaces in a plurality of refrigerator bottle seats;
detecting and judging whether articles in the bottle seat are shielded by the bottle seat above the articles in the bird's-eye view image, and when shielded articles exist, adjusting the position relation between the bottle seat above the articles and the bottle seat for storing the articles until the articles and the bottle seat above the articles are not shielded;
and acquiring a bird's-eye view image comprising a plurality of spaces in the bottle seats of the refrigerator again, and identifying the article information according to the top surface pattern of the article.
2. The method for identifying information on articles in a refrigerator according to claim 1, wherein the step of "acquiring a bird's-eye view image including a plurality of spaces in a bottle seat of the refrigerator" specifically comprises the steps of:
and detecting that the refrigerator door body moves to form a preset angle with the refrigerator body, and controlling a camera arranged at the top of the refrigerator body to shoot to obtain a bird's-eye view image of the space in the bottle holder.
3. The method for identifying information on articles in a refrigerator according to claim 1, further comprising the step of, after "acquiring a bird's-eye view image including a plurality of spaces in a bottle holder of the refrigerator":
detecting and identifying edge contour lines of a plurality of bottle seats;
defining at least the area between adjacent edge contour lines between adjacent bottle seats as an identification area;
and detecting and identifying the article image in the identification area.
4. The method for identifying information on articles in a refrigerator according to claim 3, wherein the step of detecting and determining whether the articles in the bottle holder are covered by the bottle holder above the bird's eye view image specifically comprises the steps of:
detecting and identifying an edge contour line of an article;
and if the edge contour line of the article is intersected with the edge contour line of the bottle seat above the article, judging that the article is blocked.
5. The method for identifying information on articles in a refrigerator according to claim 4, wherein the step of adjusting the positional relationship between the bottle seat above the article and the bottle seat for storing the article until there is no obstruction between the article and the bottle seat above the article comprises:
and controlling the bottle seat above the article to move upwards along the transmission device or controlling the bottle seat eye transmission device for storing the article to move downwards until no overlapping or intersecting part exists between the edge contour line of the shielded article and the edge contour line of the bottle seat above the shielded article.
6. The method for identifying information on articles in a refrigerator according to claim 4, further comprising the steps of:
and when the bottle seat is judged to generate resistance in the movement, stopping the movement of the bottle seat.
7. The method for identifying information on articles in a refrigerator according to claim 5, further comprising the steps of:
detecting the nearest distance between the edge contour line of the article and the edge contour line of the bottom of the bottle seat above the article in the detection area;
and when the closest distance is greater than the preset spacing distance, adjusting the position relation between the bottle seat above the article and the bottle seat for storing the article until the edge contour line of the shielded article and the edge contour line of the bottle seat above the shielded article reach the preset distance.
8. The method as claimed in claim 3, wherein the step of detecting and identifying the article image in the identification area comprises:
and identifying the top surface information of the articles through a deep learning identification algorithm to obtain the category information of the articles, recording the storage time and counting the number of the articles of the same category.
9. A refrigerator comprises a plurality of bottle seats arranged on a refrigerator door body and is characterized in that,
the bottle seat is arranged on the door body in a sliding manner through a transmission device and moves up and down along the frame of the door body in a sliding manner;
the top of the refrigerator body is provided with a camera which is arranged towards the outside of the refrigerator body and is used for shooting the space in the bottle seat;
the refrigerator further includes a memory storing a computer program executable on the processor, and a processor implementing the steps of the method for identifying information on articles in the refrigerator according to any one of claims 1 to 8 when the processor executes the program.
10. The refrigerator according to claim 9, wherein the transmission device comprises a slide rail and a driving device, and the bottle holder is arranged on a frame of the refrigerator door body through the slide rail and is controlled by the driving module to move along the slide rail.
11. A computer storage medium in which a computer program is stored, and which when executed causes an apparatus of the computer storage medium to perform the steps of the method for identifying information on articles in a refrigerator according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110413457.5A CN113158876A (en) | 2021-04-16 | 2021-04-16 | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium |
| PCT/CN2021/132850 WO2022217928A1 (en) | 2021-04-16 | 2021-11-24 | Method for identifying information of article in refrigerator, refrigerator, and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110413457.5A CN113158876A (en) | 2021-04-16 | 2021-04-16 | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113158876A true CN113158876A (en) | 2021-07-23 |
Family
ID=76868520
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110413457.5A Pending CN113158876A (en) | 2021-04-16 | 2021-04-16 | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113158876A (en) |
| WO (1) | WO2022217928A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114882349A (en) * | 2022-03-29 | 2022-08-09 | 青岛海尔电冰箱有限公司 | Method for judging target identity of articles in refrigerator, refrigerator and computer storage medium |
| WO2022217928A1 (en) * | 2021-04-16 | 2022-10-20 | 青岛海尔电冰箱有限公司 | Method for identifying information of article in refrigerator, refrigerator, and computer storage medium |
| WO2023109151A1 (en) * | 2021-12-14 | 2023-06-22 | 青岛海尔电冰箱有限公司 | Method for identifying information of item in refrigerator, and refrigerator |
| WO2023124088A1 (en) * | 2021-12-27 | 2023-07-06 | 青岛海尔电冰箱有限公司 | Method for identifying information of articles in refrigerator, and refrigerator |
| WO2023185280A1 (en) * | 2022-03-31 | 2023-10-05 | 青岛海尔电冰箱有限公司 | Method for identifying article information in refrigerator bottle holder, and refrigerator |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205980518U (en) * | 2016-08-12 | 2017-02-22 | 合肥华凌股份有限公司 | Thing box, Refrigerator door and refrigerator are put to portable convenience |
| CN109330284A (en) * | 2018-09-21 | 2019-02-15 | 京东方科技集团股份有限公司 | A kind of commodity shelf system |
| JP2019070467A (en) * | 2017-10-06 | 2019-05-09 | 東芝ライフスタイル株式会社 | refrigerator |
| CN109951636A (en) * | 2019-03-18 | 2019-06-28 | Oppo广东移动通信有限公司 | It takes pictures processing method, device, mobile terminal and storage medium |
| CN110455027A (en) * | 2019-07-16 | 2019-11-15 | 海信集团有限公司 | A kind of image collecting device and its refrigerator, control method |
| CN111444880A (en) * | 2020-04-10 | 2020-07-24 | 海信集团有限公司 | Food material identification method and refrigerator |
| CN112487962A (en) * | 2020-11-27 | 2021-03-12 | 青岛海尔科技有限公司 | Article information determination method and device, storage medium and electronic device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109696020B (en) * | 2018-03-28 | 2023-01-20 | 海尔智家股份有限公司 | Refrigerator with a door |
| CN110765815B (en) * | 2018-07-26 | 2024-05-24 | 北京京东尚科信息技术有限公司 | Display rack shielding detection method and device |
| KR102245911B1 (en) * | 2019-08-09 | 2021-04-30 | 엘지전자 주식회사 | Refrigerator for providing information of item using artificial intelligence and operating method thereof |
| CN211650920U (en) * | 2020-03-10 | 2020-10-09 | 合肥市天马塑胶有限公司 | Refrigerator bottle seat with adjustable position |
| CN112432414A (en) * | 2020-12-11 | 2021-03-02 | 恩亿科(北京)数据科技有限公司 | Refrigerator freshness management method and system based on image recognition |
| CN113158876A (en) * | 2021-04-16 | 2021-07-23 | 青岛海尔电冰箱有限公司 | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium |
-
2021
- 2021-04-16 CN CN202110413457.5A patent/CN113158876A/en active Pending
- 2021-11-24 WO PCT/CN2021/132850 patent/WO2022217928A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN205980518U (en) * | 2016-08-12 | 2017-02-22 | 合肥华凌股份有限公司 | Thing box, Refrigerator door and refrigerator are put to portable convenience |
| JP2019070467A (en) * | 2017-10-06 | 2019-05-09 | 東芝ライフスタイル株式会社 | refrigerator |
| CN109330284A (en) * | 2018-09-21 | 2019-02-15 | 京东方科技集团股份有限公司 | A kind of commodity shelf system |
| CN109951636A (en) * | 2019-03-18 | 2019-06-28 | Oppo广东移动通信有限公司 | It takes pictures processing method, device, mobile terminal and storage medium |
| CN110455027A (en) * | 2019-07-16 | 2019-11-15 | 海信集团有限公司 | A kind of image collecting device and its refrigerator, control method |
| CN111444880A (en) * | 2020-04-10 | 2020-07-24 | 海信集团有限公司 | Food material identification method and refrigerator |
| CN112487962A (en) * | 2020-11-27 | 2021-03-12 | 青岛海尔科技有限公司 | Article information determination method and device, storage medium and electronic device |
Non-Patent Citations (1)
| Title |
|---|
| 白雅贤: ""货架商品图像分割与识别方法研究"", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022217928A1 (en) * | 2021-04-16 | 2022-10-20 | 青岛海尔电冰箱有限公司 | Method for identifying information of article in refrigerator, refrigerator, and computer storage medium |
| WO2023109151A1 (en) * | 2021-12-14 | 2023-06-22 | 青岛海尔电冰箱有限公司 | Method for identifying information of item in refrigerator, and refrigerator |
| WO2023124088A1 (en) * | 2021-12-27 | 2023-07-06 | 青岛海尔电冰箱有限公司 | Method for identifying information of articles in refrigerator, and refrigerator |
| CN114882349A (en) * | 2022-03-29 | 2022-08-09 | 青岛海尔电冰箱有限公司 | Method for judging target identity of articles in refrigerator, refrigerator and computer storage medium |
| CN114882349B (en) * | 2022-03-29 | 2024-05-24 | 青岛海尔制冷电器有限公司 | Method for judging object identity of articles in refrigerator, refrigerator and computer storage medium |
| WO2023185280A1 (en) * | 2022-03-31 | 2023-10-05 | 青岛海尔电冰箱有限公司 | Method for identifying article information in refrigerator bottle holder, and refrigerator |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022217928A1 (en) | 2022-10-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113158876A (en) | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium | |
| US11102417B2 (en) | Target object capturing method and device, and video monitoring device | |
| CN109922250B (en) | Target object snapshot method and device and video monitoring equipment | |
| CN113095240B (en) | Method for identifying article information in refrigerator, refrigerator and computer storage medium | |
| CN110689560B (en) | Food material management method and equipment | |
| CN113076907B (en) | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium | |
| EP1418025A2 (en) | Article pickup device comprising a robot and a visual sensor | |
| GB2586424A (en) | System and method of determining a location for placement of a package | |
| US9001219B2 (en) | Image processing apparatus configured to detect object included in image and method therefor | |
| US10692225B2 (en) | System and method for detecting moving object in an image | |
| KR101972356B1 (en) | An apparatus and a method for detecting upper body | |
| CN107036687A (en) | The grain storage Monitoring of Quantity method and device of view-based access control model | |
| CN105740792B (en) | Object detection method and device | |
| CN108363977B (en) | Human body prone position state identification method and device | |
| CN114913410A (en) | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium | |
| CN105654531B (en) | Method and device for drawing image contour | |
| JP7482410B2 (en) | Storage/Receipt Management Device, Storage/Receipt Management System, and Storage/Receipt Management Method | |
| CN108596012A (en) | A kind of barrier frame merging method, device and terminal | |
| CN110770739A (en) | Control method, device and control equipment based on image recognition | |
| WO2023185779A1 (en) | Method for identifying article information in refrigerator | |
| CN109559450B (en) | Intelligent container management system | |
| CN114708503A (en) | Method for identifying information of articles in bottle seat of refrigerator, refrigerator and computer storage medium | |
| CN114818796A (en) | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium | |
| CN113264313A (en) | Shooting method for picking up/putting down goods, shooting module and transfer robot | |
| EP3138044B1 (en) | Method and device for detecting moving objects such as fingerprints and corresponding computer program product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210723 |
|
| RJ01 | Rejection of invention patent application after publication |