CN117560568A - Method, apparatus and computer storage medium for acquiring image of article in apparatus - Google Patents
Method, apparatus and computer storage medium for acquiring image of article in apparatus Download PDFInfo
- Publication number
- CN117560568A CN117560568A CN202210918191.4A CN202210918191A CN117560568A CN 117560568 A CN117560568 A CN 117560568A CN 202210918191 A CN202210918191 A CN 202210918191A CN 117560568 A CN117560568 A CN 117560568A
- Authority
- CN
- China
- Prior art keywords
- image
- marker
- space
- information
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 239000003550 marker Substances 0.000 claims abstract description 38
- 238000001514 detection method Methods 0.000 claims abstract description 14
- 238000004590 computer program Methods 0.000 claims description 9
- 230000006872 improvement Effects 0.000 description 7
- 238000002372 labelling Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 4
- 235000013361 beverage Nutrition 0.000 description 3
- 238000005057 refrigeration Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 230000005389 magnetism Effects 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000008267 milk Substances 0.000 description 1
- 210000004080 milk Anatomy 0.000 description 1
- 235000013336 milk Nutrition 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
- G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computational Linguistics (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a method, equipment and a computer storage medium for acquiring an image of an article in equipment, wherein at least one marker is arranged in a space in the equipment, and the method comprises the following steps: acquiring images of a plurality of spaces in the equipment; acquiring a pre-stored reference image of the space in the device containing all the markers, wherein the reference image contains a complete area of the space in the device; identifying whether the image contains the same marker information as the reference image; and when the image contains the same label information as the reference image, judging the image as the image to be detected. Through setting up a plurality of markers in the storage room, thereby carry out the detection discernment of marker to the image that takes a picture and acquire the image that can contain whole storage space, solved among the prior art because the angle deviation causes the incomplete problem of image photograph of acquisition.
Description
Technical Field
The present invention relates to the field of refrigeration apparatuses, and in particular, to a method and an apparatus for acquiring an image of an article in an apparatus, and a computer storage medium.
Background
Refrigerator (vertical, horizontal) is often all given supermarket convenience store by beverage brand side purchase, only can sell from the product in the brand side requirement refrigerator, but this just needs the brand side to each district to get the convenience store inspection, all is artifical inspection before, now shoots through installing the camera additional, then discerns the product in the refrigerator through image recognition technology, judges whether the product of placing in the refrigerator accords with the brand side requirement. The technical means that is commonly used at present is that install a camera additional on the door frame, door magnetism that is inhaled with the cabinet body is installed to the door frame bottom, and when the customer purchased the beverage and opens the cabinet door, the freezer main control board detected that door magnetism is separated, through calculating the angle that the door was opened, when the door was opened to preset angle, the main control board controlled the camera to shoot, gathers the internal space photo of cabinet to carry out image recognition to the photo of gathering.
In the prior art, the angle of the door opening is judged by a gyroscope sensor, the principle of the gyroscope is that the acceleration and the angular velocity are utilized to deduce an angle value, but if the door is opened at a constant speed, the acceleration is equal to 0, so that the finally calculated angle value is influenced, and the actual angle is inconsistent with the door opening angle to be photographed; if the door opening speed is too high, the hardware CPU or the operating system is not timely corresponding in real time, so that the actual photographing angle is larger than the calculated angle, and the standard photo is difficult to collect.
Disclosure of Invention
The invention aims to provide a method, equipment and a computer storage medium for acquiring an image of an article in equipment.
In order to achieve one of the above objects, an embodiment of the present invention provides a method for acquiring an image of an object in a device, where at least one marker is disposed in a space in the device, including the steps of:
acquiring images of a plurality of spaces in the equipment;
acquiring a pre-stored reference image of the space in the device containing all the markers, wherein the reference image contains a complete area of the space in the device;
identifying whether the image contains the same marker information as the reference image;
and when the image contains the same label information as the reference image, judging the image as the image to be detected.
As a further improvement of an embodiment of the present invention, the acquiring an image of the space in the apparatus specifically includes:
controlling a camera arranged at the outer side of the equipment door body to be in a continuous recording state;
a plurality of continuously photographed images of the space within the apparatus are acquired.
As a further improvement of an embodiment of the present invention, the identifying whether the image contains the same marker information as the reference image specifically includes:
and identifying whether the acquired image contains the same label information as the reference image or not in real time.
As a further improvement of an embodiment of the present invention, the identifying whether the image contains the same marker information as the reference image specifically includes:
and storing the acquired images of the space in the equipment, and uniformly identifying whether the images contain the same label information as the reference image or not.
As a further improvement of an embodiment of the present invention, the marker information includes marker number information, marker position information, marker shape information, and/or marker size information.
As a further improvement of an embodiment of the present invention, the method further comprises the steps of:
and identifying the article information in the image to be detected by utilizing an article information detection algorithm.
The invention provides a device with a method for acquiring an image of an article in the device, which comprises the following steps: the box body, the door body, the camera, at least one marker, a memory and a processor, wherein,
the box body defines a storage compartment, and the door body can rotate around the box body through a hinge to enable an opening of the storage compartment to be exposed or closed;
the camera is arranged at the outer side edge of the door body and is configured to shoot a space image in the equipment;
the marker is arranged in the storage room;
the memory stores a computer program executable on the processor which when executed implements the steps of the method for acquiring an image of an item within a device as described in any one of the embodiments above.
As a further improvement of an embodiment of the present invention, the case includes a plurality of racks, the racks divide the storage compartments, and the markers are disposed on a side of the racks near the door.
As a further improvement of an embodiment of the present invention, the marker is also disposed at a diagonal of the storage compartment opening.
The present invention provides a computer storage medium in which a computer program is stored which, when run, causes an apparatus in which the computer storage medium is located to perform the steps of the method for acquiring an image of an item within an apparatus according to any one of the embodiments described above.
Compared with the prior art, the method has the advantages that the plurality of labels are arranged in each direction in the storage space of the equipment, the reference images containing all the labels are prestored in the system, the camera loaded on the door body is controlled to be in a continuous image state or a video state all the time, the quantity, the shape and other characteristics of the labels contained in the plurality of images obtained by continuous shooting of the camera are changed in the process of slowly opening the door body of the equipment, the system identifies and analyzes the acquired plurality of images, whether the acquired plurality of images contain label information identical to that in the prestored reference images or not, if yes, the corresponding images are judged to be images to be detected, and the object information in the images is detected and identified. Through setting up a plurality of markers in the storage room, thereby carry out the detection discernment of marker to the image that takes a picture and acquire the image that can contain whole storage space, solved among the prior art because the angle deviation causes the incomplete problem of image photograph of acquisition.
Drawings
Fig. 1 is a schematic view of an apparatus structure with a method for acquiring an image of an object in the apparatus according to an embodiment of the present invention.
Fig. 2 is a schematic flow chart of a method for acquiring an image of an object in a device according to an embodiment of the invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be clearly and completely described below with reference to the specific embodiments of the present application and the corresponding drawings. It will be apparent that the described embodiments are only some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
Embodiments of the present invention are described in detail below, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements or elements having like or similar functions throughout. The embodiments described below by referring to the drawings are exemplary only for explaining the present invention and are not to be construed as limiting the present invention.
For purposes of illustration, terms such as "upper," "lower," "rear," "front," and the like, are used herein to describe one element or feature's relationship to another element or feature as illustrated in the figures. The term spatially relative position may include different orientations of the device in use or operation than that illustrated in the figures. For example, if the device in the figures is turned over, elements described as "below" or "over" other elements or features would then be oriented "below" or "over" the other elements or features. Thus, the exemplary term "below" can encompass both a spatial orientation of below and above.
As shown in fig. 1, an embodiment of the present invention provides an apparatus 100 having a method for acquiring an image of an object in the apparatus, where the apparatus 100 includes a case 110 and a door 120, a camera 130, at least one marker 140, and a memory and a processor.
The apparatus 100 may be a non-refrigeration apparatus, such as a wine cabinet, or may be a refrigeration apparatus, such as a vertical refrigerator, a horizontal refrigerator, or the like, and the present invention is not limited to the specific type of apparatus 100, and the vertical refrigerator shown in fig. 1 is described as an example.
The case 110 defines a storage compartment 111, and the door 120 may be pivoted about the case 110 by a hinge to expose or close an opening of the storage compartment 111.
The camera 130 is disposed on the outer side of the door 120, and is configured to capture an image of the space in the device 100, and specifically, the camera 130 is disposed at a middle position of a side edge of the door 120, which is far away from the hinge in the vertical direction, so as to capture a space region in the device 100 in a larger range, thereby preventing the shielding of objects in the captured image.
In other embodiments of the present invention, the camera 130 may be controlled to capture video, and then each frame of image in the video captured by the camera 130 may be acquired for detection and identification. Of course, two or more cameras 130 may be disposed at other positions of the door 120 for capturing two or more images of the space in the apparatus 100 at different angles.
The markers 140 are disposed in the storage compartment 111, and one or more markers 140 may be disposed in the storage compartment 111, and the location, shape and size of each marker 140 are not limited herein, and may be set according to practical application requirements.
In the embodiment of the present invention, the case 110 includes a plurality of racks 112, and the racks 112 divide the storage compartments 111 for placing articles. The rack 112 specifically includes an upper surface and a lower surface that are horizontally disposed, and four sides that connect the upper surface and the lower surface, the markers 140 are disposed on a side of the rack 112 that is close to the door 120, and the specific number and specific positions of the markers 140 disposed on the side of the rack 112 that is close to the door 120 are not limited by the present invention, and the more the number of the markers 140 is disposed, the more the sides of the rack 112 that is close to the door 120 are disposed toward two ends, and the more comprehensive the information of the articles in the image to be detected is identified for the subsequent detection.
Furthermore, the labeling object 140 is further disposed at the opposite corner of the opening of the storage compartment 111, so as to cover the whole space region of the space in the apparatus 100 more comprehensively, thereby further improving the accuracy in the subsequent detection method.
Of course, the installation position of the marker 140 is not limited to this, and a position in the storage compartment 111 which is not easily blocked by the article may be selected as much as possible.
The memory stores a computer program executable on the processor, and the memory is further configured to store images or videos acquired by capturing by the camera 130, where the processor executes the program to implement the steps of the method for capturing images of articles in the device according to any one of the embodiments described below.
As shown in fig. 2, the method for acquiring an image of an article in a device according to an embodiment of the present invention includes the steps of:
s1: images of a plurality of intra-device spaces are acquired.
S2: and acquiring a pre-stored reference image of the space in the device containing all the labels, wherein the reference image contains the complete area of the space in the device.
S3: and identifying whether the image contains the same label information as the reference image.
S4: and when the image contains the same label information as the reference image, judging the image as the image to be detected.
In step S1, an image of a space in the apparatus is acquired, specifically including:
in an embodiment of the present invention, a camera disposed outside the door body of the device may be controlled to be in a continuous recording state, and then each frame of image in the video recorded by the camera is obtained.
In another embodiment of the present invention, a camera disposed outside the door body of the apparatus may be controlled to be in a photographing state, so as to obtain a plurality of continuously photographed images of the space in the apparatus. Specifically, a photographing frequency can be set, the camera is controlled to continuously photograph images of the space in the equipment, the photographing frequency can be specifically adjusted according to practical products applied, and the sufficient number of images can be collected for image recognition in a subsequent algorithm under the condition of the door opening speed of a general door body.
In step S2, a pre-stored reference image of the space in the device containing all the markers is obtained, where the reference image contains a complete area of the space in the device, and specifically includes:
specifically, an image of the space in the device containing all the markers is captured in advance and stored as a reference image in the processor terminal, for example, the specific positions of the markers refer to fig. 1, and because the distribution range of the markers is wider, when the captured reference image can contain all the markers in fig. 1, the image can cover the complete area of the space in the box.
In the preferred embodiment of the present invention, an image taken when the camera moves to an intermediate position with respect to the case as the door body is opened is acquired as a reference image. When the camera moves to the middle position relative to the box body along with the opening of the door body, the space area in the box body in the image shot by the camera is the most comprehensive, and all the labels can be contained, so that the shielding of some objects is avoided.
In step S3, identifying whether the image contains the same label information as the reference image specifically includes:
in an embodiment of the present invention, whether the obtained image contains the same label information as the reference image is identified in real time, specifically, each time the camera shoots an image, the image is uploaded to the processor for image identification.
More specifically, an algorithm model may be established according to the shape, size, color, and other features of the preset labeling object, the acquired image is identified, whether the labeling object is included in the image is detected, if the feature of the labeling object is detected in the image, the image is compared with the labeling object information included in the reference image, if the acquired image includes the labeling object information identical to the reference image, step S4 is executed, and the image is used as the image to be detected. Of course, if the obtained image has no label information or the label information is different from the label information in the reference image, the processor can select to automatically delete the image, so as to avoid occupying storage space.
The acquired image and the marker message contained in the reference image are compared, and the marker message mainly comprises comparison marker quantity information, marker position information, marker shape information and/or marker size information.
In the process of slowly opening the door body, the label information in the image obtained by photographing by the camera is continuously changed, and for example, the structure in fig. 1 can be seen, when the door body is slowly opened to the process that one side edge of the door body, which is far away from the hinge in the vertical direction, is relatively positioned at the middle position of the box body, the label information contained in a plurality of continuous images obtained by photographing by the camera is controlled to be continuously increased, and when one side edge of the door body, which is far away from the hinge in the vertical direction, is relatively positioned at the middle position of the box body, the label information in the image obtained by the camera is the most and the most comprehensive, and by comparing with the label information in the reference image, the label information is the same as the label information in the reference image. Of course, when the door body is opened to a larger angle, the quantity information of the labels in the image acquired by the camera is smaller and is missing.
In another embodiment of the present invention, the acquired images of the space in the device that are continuously photographed are stored, and the images are collectively identified as to whether the images contain the same marker information as the reference image. Specifically, an acquired image quantity threshold value can be set, a camera is controlled to continuously shoot and store a plurality of images, when the quantity of the images shot by the camera reaches the quantity threshold value, the processor can uniformly detect and identify all the uploaded images, judge whether the images have the same label information as the reference image or not, and if yes, select the images as images to be detected, and delete the rest images; if not, all the acquired images can be deleted directly.
Further, the method provided in an embodiment of the present invention further includes the steps of:
s5: and identifying the article information in the image to be detected by utilizing an article information detection algorithm.
And after the acquired image is detected and identified as an image to be detected, identifying all article information contained in the image to be detected by utilizing an article information detection algorithm, and transmitting a detection result of the article information in the image to be detected to a terminal. Here, the article information detection algorithm is in the prior art, deep learning can be performed according to the feature information of beverage bottles or milk bottles of certain brands, and a relevant detection model is constructed for algorithm detection and identification.
The present invention also provides a computer storage medium, in which a computer program is stored, and when the computer program runs, the computer program causes a device where the computer storage medium is located to execute the steps of the method for acquiring an image of an article in the device according to any one of the above embodiments.
In summary, a plurality of markers are arranged in each direction in a storage space of the device, reference images containing all the markers are prestored in the system, a camera loaded on a door body is controlled to be in a continuous image state or a video state all the time, in the process that the door body of the device is slowly opened, the number, the shape and other characteristics of the markers contained in a plurality of images obtained by continuous shooting of the camera are changed, the system identifies and analyzes the acquired images to determine whether the acquired images contain the same marker information as the prestored reference images, if yes, the corresponding images are judged to be images to be detected, and the object information in the images is detected and identified. Through setting up a plurality of markers in the storage room, thereby carry out the detection discernment of marker to the image that takes a picture and acquire the image that can contain whole storage space, solved among the prior art because the angle deviation causes the incomplete problem of image photograph of acquisition.
It should be understood that although the present disclosure describes embodiments, not every embodiment is provided with a separate embodiment, and that this description is for clarity only, and that the skilled artisan should recognize that the embodiments may be combined as appropriate to form other embodiments that will be understood by those skilled in the art.
The above list of detailed descriptions is only specific to practical embodiments of the present invention, and they are not intended to limit the scope of the present invention, and all equivalent embodiments or modifications that do not depart from the spirit of the present invention should be included in the scope of the present invention.
Claims (10)
1. An image acquisition method for an article in a device, wherein at least one marker is arranged in a space in the device, and the method is characterized by comprising the following steps:
acquiring images of a plurality of spaces in the equipment;
acquiring a pre-stored reference image of the space in the device containing all the markers, wherein the reference image contains a complete area of the space in the device;
identifying whether the image contains the same marker information as the reference image;
and when the image contains the same label information as the reference image, judging the image as the image to be detected.
2. The method for acquiring the image of the object in the device according to claim 1, wherein the acquiring the image of the space in the device specifically comprises:
controlling a camera arranged at the outer side of the equipment door body to be in a continuous recording state;
a plurality of continuously photographed images of the space within the apparatus are acquired.
3. The method for acquiring an image of an object in a device according to claim 2, wherein the identifying whether the image contains the same label information as the reference image specifically comprises:
and identifying whether the acquired image contains the same label information as the reference image or not in real time.
4. The method for acquiring an image of an object in a device according to claim 2, wherein the identifying whether the image contains the same label information as the reference image specifically comprises:
and storing the acquired images of the space in the equipment, and uniformly identifying whether the images contain the same label information as the reference image or not.
5. The method of claim 3 or 4, wherein the marker information includes marker quantity information, marker position information, marker shape information, and/or marker size information.
6. The method of in-device item image acquisition according to claim 5, further comprising the steps of:
and identifying the article information in the image to be detected by utilizing an article information detection algorithm.
7. An apparatus having a method of image acquisition of an item within the apparatus, comprising: the box body, the door body, the camera, at least one marker, a memory and a processor are characterized in that,
the box body defines a storage compartment, and the door body can rotate around the box body through a hinge to enable an opening of the storage compartment to be exposed or closed;
the camera is arranged at the outer side edge of the door body and is configured to shoot a space image in the equipment;
the marker is arranged in the storage room;
the memory stores a computer program executable on the processor, which when executed implements the steps of the method for acquiring an image of an item within a device as claimed in any one of claims 1 to 6.
8. The apparatus of claim 7, wherein the housing comprises a plurality of racks, the racks dividing the storage compartment, the labels being disposed on a side of the racks adjacent to the door.
9. The apparatus having a method of in-apparatus item image acquisition as in claim 8, wherein the marker is further disposed at a diagonal of the storage compartment opening.
10. A computer storage medium in which a computer program is stored, characterized in that the computer program, when run, causes a device in which the computer storage medium is located to perform the steps of the method for acquiring images of items in a device according to any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210918191.4A CN117560568A (en) | 2022-08-01 | 2022-08-01 | Method, apparatus and computer storage medium for acquiring image of article in apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210918191.4A CN117560568A (en) | 2022-08-01 | 2022-08-01 | Method, apparatus and computer storage medium for acquiring image of article in apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117560568A true CN117560568A (en) | 2024-02-13 |
Family
ID=89815222
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210918191.4A Pending CN117560568A (en) | 2022-08-01 | 2022-08-01 | Method, apparatus and computer storage medium for acquiring image of article in apparatus |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117560568A (en) |
-
2022
- 2022-08-01 CN CN202210918191.4A patent/CN117560568A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7229580B2 (en) | Unmanned sales system | |
| CN108885813B (en) | Intelligent sales counter, article identification method, apparatus, server and storage medium | |
| TR201808190T4 (en) | Refrigerator and its control method. | |
| US12016487B2 (en) | Method and system for foodstuff identification | |
| CN105164481A (en) | Method for managing storage product in refrigerator using image recognition, and refrigerator for same | |
| WO2022217928A1 (en) | Method for identifying information of article in refrigerator, refrigerator, and computer storage medium | |
| TWI694352B (en) | Interactive behavior detection method, device, system and equipment | |
| US11335010B2 (en) | Methods for viewing and tracking stored items | |
| JP6655908B2 (en) | Refrigerators and programs | |
| US10785456B1 (en) | Methods for viewing and tracking stored items | |
| WO2023193752A1 (en) | Method for identifying article information in refrigerator, and refrigerator | |
| JP7482410B2 (en) | Storage/Receipt Management Device, Storage/Receipt Management System, and Storage/Receipt Management Method | |
| CN217090154U (en) | Article display device, container and inventory management system | |
| CN113468914A (en) | Method, device and equipment for determining purity of commodities | |
| CN113470250B (en) | Vending cabinet, monitoring method, server, system and computer-readable storage medium | |
| CN117560568A (en) | Method, apparatus and computer storage medium for acquiring image of article in apparatus | |
| CN110910567A (en) | Deduction method, device, electronic equipment, computer readable storage medium and container | |
| WO2023185779A1 (en) | Method for identifying article information in refrigerator | |
| WO2021091481A1 (en) | System for object identification and content quantity estimation through use of thermal and visible spectrum images | |
| CN110443946B (en) | Vending machine, and method and device for identifying types of articles | |
| CN114708503A (en) | Method for identifying information of articles in bottle seat of refrigerator, refrigerator and computer storage medium | |
| WO2022181575A1 (en) | Storage/retrieval management device, storage/retrieval management system, and storage/retrieval management method | |
| CN114818796A (en) | Method for identifying information of articles in refrigerator, refrigerator and computer storage medium | |
| CN207473729U (en) | Automatic vending machine | |
| CN116416556A (en) | Article information identification method, refrigeration equipment and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication |