CN114007003A - Intelligent storage camera and storage management method - Google Patents
Intelligent storage camera and storage management method Download PDFInfo
- Publication number
- CN114007003A CN114007003A CN202111282250.5A CN202111282250A CN114007003A CN 114007003 A CN114007003 A CN 114007003A CN 202111282250 A CN202111282250 A CN 202111282250A CN 114007003 A CN114007003 A CN 114007003A
- Authority
- CN
- China
- Prior art keywords
- camera
- articles
- intelligent storage
- shell
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 title claims abstract description 60
- 238000007726 management method Methods 0.000 title claims abstract description 22
- 238000000605 extraction Methods 0.000 claims description 5
- 230000006855 networking Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 abstract description 7
- 238000005516 engineering process Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 238000013500 data storage Methods 0.000 description 3
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 229940079593 drug Drugs 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 235000013305 food Nutrition 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/51—Housings
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B65—CONVEYING; PACKING; STORING; HANDLING THIN OR FILAMENTARY MATERIAL
- B65D—CONTAINERS FOR STORAGE OR TRANSPORT OF ARTICLES OR MATERIALS, e.g. BAGS, BARRELS, BOTTLES, BOXES, CANS, CARTONS, CRATES, DRUMS, JARS, TANKS, HOPPERS, FORWARDING CONTAINERS; ACCESSORIES, CLOSURES, OR FITTINGS THEREFOR; PACKAGING ELEMENTS; PACKAGES
- B65D25/00—Details of other kinds or types of rigid or semi-rigid containers
- B65D25/20—External fittings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Mechanical Engineering (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The invention discloses an intelligent storage camera and a storage management method, wherein the intelligent storage camera comprises a shell, a main control module is arranged in the shell, and a camera and a voice system which are connected with the main control module are arranged at the front part of the shell; the side wall of the shell is provided with a charging interface, the bottom of the shell is rotatably provided with a rotary rod, and two ends of the rotary rod are provided with clamps for clamping a storage box; the main control module is electrically connected with the server; the server is used for identifying and recording the accommodated articles shot by the camera, and simultaneously providing storage positions of the articles for the user when the user searches for the articles. The invention monitors the article flow through the camera, provides the functions of article searching and managing, can quickly position the object to be searched, optimizes the searching process of the user, reduces the time consumption and promotes the convenience of family life.
Description
Technical Field
The invention belongs to the field of storage management, and particularly relates to an intelligent storage camera and a storage management method.
Background
The existing image recognition technology is mature and cheap, and although the technology is successfully applied to aspects of industrial production, the technology is difficult to be utilized in family life. The existing article management system has many requirements on the operation process of a user, such as manually inputting complicated article information, arranging many sensors and the like, and still needs to consume a great deal of energy in storage.
In the aspect of family life, people can use a plurality of objects such as tools, medicines, foods and the like, and can store the objects in a proper position when not used.
However, as the number of stored articles increases, people often forget specific storage positions of the articles in the course of time, and have to spend a lot of time searching in each storage box, even missing multiple times of searching in the searching process.
Chinese patent publication No. CN109426842A discloses an article management system based on an electronic tag, which includes an electronic tag, an electronic tag reader/writer, a processor, an image acquisition device, a data storage device, a network communication device, and a display device; the processor is respectively connected with the electronic tag reader-writer, the image acquisition device, the data storage device, the network communication device and the display device; the processor acquires an image signal acquired by the image acquisition device, processes the image signal and stores the processed image signal to the data storage device; the processor controls the electronic tag reader-writer to write in the electronic tag, the processor controls the electronic tag to read article related information of the electronic tag, the electronic tag has a unique identification code, and the article related information at least comprises storage position information of the article; the network communication device is connected with the remote server and used for acquiring the article related information and transmitting the article related information to the display device through the processor for displaying.
The article management system can realize storage, classification and search of the image and the character information of the article, but has the problems of complex structure and inconvenient use.
Disclosure of Invention
The invention provides an intelligent storage camera and a storage management method, which have the advantages that the camera is used for monitoring the flowing of articles, the functions of article searching and management are provided, the articles to be searched can be quickly positioned, the searching process of a user is optimized, the time consumption is reduced, and the convenience of family life is promoted.
An intelligent storage camera comprises a shell, wherein a main control module is arranged inside the shell, and a camera and a voice system which are connected with the main control module are arranged at the front part of the shell;
the side wall of the shell is provided with a charging interface, the bottom of the shell is rotatably provided with a rotary rod, and two ends of the rotary rod are provided with clamps for clamping a storage box; the main control module is electrically connected with the server;
the server is used for identifying and recording the accommodated articles shot by the camera, and simultaneously providing storage positions of the articles for the user when the user searches for the articles.
Further, the shell on be equipped with the button switch who is connected with main control module, press button switch back equipment circular telegram, the camera is shot and is uploaded the image to the server through main control module, cuts off the power supply after accomplishing.
The invention also provides an intelligent storage management method, which adopts the intelligent storage camera and comprises the following steps:
(1) when the intelligent storage camera is used for the first time, the intelligent storage camera is clamped on the storage box, and networking information and information of the storage box where the intelligent storage camera is located are configured;
(2) when articles are stored or taken out, the articles are placed in front of the camera, the button switch is pressed, then the articles can be stored or taken out, meanwhile, the camera records the articles for 3-4 seconds, and videos and time are uploaded to the server;
(3) the server firstly judges whether each piece of access data is stored or taken out; meanwhile, the video is sent to a feature extraction network to obtain the first K features with the highest score, and then the K features are sent to an object recognition network to infer the category of the object and obtain a classification score; taking out all data belonging to the large class in the database, and calculating the similarity of the characteristics;
if the data with the characteristics which are strongly matched exists, the data is judged to be the information corresponding to the currently stored or taken article, and the data is set to be in a stored or taken state; if the characteristics are compared and matched, processing according to strong matching, but storing a piece of reminding information into a background; if no matching object exists, but the classification score is high, the object is judged to be newly stored, a piece of data corresponding to the object is newly established, and the large class-number is used as the name of the object; if no matching object exists and the classification score is low, judging that the identification is unsuccessful, and putting a piece of warning information into the background;
(4) after the user finishes all the access states, the user can check and edit the access results in the background; when searching for articles, only search information needs to be input or images need to be uploaded for searching.
The camera can only be stored, and when the camera is not used, the rotating rod is rotated until the camera faces the inner wall of the storage box, so that the privacy of the living environment of people is protected.
And (3) judging whether the article is stored or taken out by tracking the moving direction of the target.
In the step (4), when editing the access result, the user can select to edit the name, video and content description attributes, manually mark the article with unsuccessful identification as a corresponding article, and the image can be used as the basis for the next matching of the corresponding article.
In the step (4), when the images are uploaded for searching, feature extraction is carried out through the same feature network, all data in the library are matched, and the top 8 most similar articles are recommended to the user for selection.
Compared with the prior art, the invention has the following beneficial effects:
1. the invention adopts the image recognition technology, so that a user can quickly input the information of the article and can quickly locate the position of the article through software.
2. The invention adopts the power-off mode when the button is pressed to be powered on to complete the task when in use, thereby greatly reducing the energy consumption, being suitable for the characteristic of long storage period and reducing the requirement on the storage capacity of the battery.
3. The invention has simple materials and working procedures and good economical efficiency.
4. The invention adopts the mobile camera, and can flexibly use the camera to concentrate on managing one or more storage boxes.
5. The management system of the invention can store and edit the object information stored once, and the object which fails to be identified for the first time or needs to contain specific information can be quickly accessed after being set by the management system, thereby solving the defect that the object can not be correctly identified sometimes by the image identification technology.
6. The invention does not restrict the process of storing and taking articles, and is suitable for household scenes of emergency taking and emergency use.
Drawings
Fig. 1 is a structural diagram of an intelligent storage camera according to the present invention;
FIG. 2 is a flow chart of an accessing process in the intelligent storage management method according to the present invention;
fig. 3 is a flow chart of identification in the intelligent storage management method according to the present invention.
Detailed Description
The invention will be described in further detail below with reference to the drawings and examples, which are intended to facilitate the understanding of the invention without limiting it in any way.
As shown in figure 1, the intelligent storage camera comprises a shell 1, a main control module is arranged inside the shell 1, and a camera 2 and a voice system 3 which are connected with the main control module are arranged on the front portion of the shell. The side wall of the shell 1 is provided with a charging interface 4, the bottom of the shell 1 is rotatably provided with a rotating rod 5, and two ends of the rotating rod 5 are provided with clamps 6 for clamping a storage box; the camera can be clamped on the edge of any storage box by the clamp 6, and the machine body can be adjusted to a proper position by the rotating rod 5.
The main control module is electrically connected with the server 7, and the server 7 is used for identifying and recording the accommodated articles shot by the camera and providing storage positions of the articles for a user when the user searches for the articles.
Still be equipped with the button switch 8 of being connected with main control module on the shell 1, press button switch 8 rear equipment circular telegram, camera 2 shoots and uploads the image to server 7 through main control module, the outage after the completion.
As shown in fig. 2 and 3, an intelligent storage management method using the intelligent storage camera includes the following steps:
s01, when the first use, with intelligent camera clip on the receiver to configuration networking information and the receiver and other essential information that the camera was located.
S02, when the articles are stored (taken), the articles are placed in front of the camera, the button is pressed, then the articles can be placed (taken) in or out, meanwhile, the camera records 3-4 seconds, the videos and the time are uploaded to the server, and the step S02 is repeated until all the articles are stored and taken out.
S03, the server firstly tracks the moving direction of the article and judges whether the article is stored or taken out according to each piece of access data.
And S04, extracting the video sender characteristics from the network, acquiring the first K characteristics with the highest score, hereinafter referred to as K characteristics, and then sending the K characteristics to the object recognition network to infer the category to which the article belongs and acquire classification scores. And taking out all data belonging to the large class in the database, and calculating the similarity of the features.
S05, if the data with the strong matching characteristics exists, the data is judged to be the information corresponding to the currently stored article, and the data is set to be in a storing (taking out) state; if the features are matched, processing according to strong matching, but storing a piece of reminding information into the background.
If there is no matching object but the classification score is high, S06 judges that there is a new object to be stored, newly creates a piece of data for the object, and sets the major class number as the name of the object. If no matching object exists and the classification score is low, the recognition is judged to be unsuccessful, and a piece of warning information is put in the background.
S07, after the user completes all the access states, the user can view the access results in the background. For all data, the user may choose to edit all attributes of their name, video, content description, etc., such as re-identifying the item for which identification was unsuccessful, or manually tagging the corresponding item. In particular, for the case of manual labeling of the corresponding item, the image will be used as a basis for the next matching of the corresponding item.
S08, when not in use, the rotary rod can be rotated forwards until the lens faces the inner wall of the storage box, so that the privacy of the living environment of people is protected.
And S09, when finding the article, only inputting search information or uploading the image for searching. In particular, for images, feature extraction is performed through the same feature network, all data in the library are matched, and the top 8 most similar articles are recommended to the user.
The embodiments described above are intended to illustrate the technical solutions and advantages of the present invention, and it should be understood that the above-mentioned embodiments are only specific embodiments of the present invention, and are not intended to limit the present invention, and any modifications, additions and equivalents made within the scope of the principles of the present invention should be included in the scope of the present invention.
Claims (7)
1. The intelligent storage camera is characterized by comprising a shell, wherein a main control module is arranged in the shell, and a camera and a voice system which are connected with the main control module are arranged at the front part of the shell;
the side wall of the shell is provided with a charging interface, the bottom of the shell is rotatably provided with a rotary rod, and two ends of the rotary rod are provided with clamps for clamping a storage box; the main control module is electrically connected with the server;
the server is used for identifying and recording the accommodated articles shot by the camera, and simultaneously providing storage positions of the articles for the user when the user searches for the articles.
2. The intelligent storage camera according to claim 1, wherein a button switch connected with the main control module is arranged on the housing, when the button switch is pressed, the equipment is powered on, the camera takes a picture and uploads the picture to the server through the main control module, and then the power is cut off after the picture taking is completed.
3. An intelligent storage management method, which is characterized in that the intelligent storage camera of claim 1 or 2 is adopted, and comprises the following steps:
(1) when the intelligent storage camera is used for the first time, the intelligent storage camera is clamped on the storage box, and networking information and information of the storage box where the intelligent storage camera is located are configured;
(2) when articles are stored or taken out, the articles are placed in front of the camera, the button switch is pressed, then the articles can be stored or taken out, meanwhile, the camera records the articles for 3-4 seconds, and videos and time are uploaded to the server;
(3) the server firstly judges whether each piece of access data is stored or taken out; meanwhile, the video is sent to a feature extraction network to obtain the first K features with the highest score, and then the K features are sent to an object recognition network to infer the category of the object and obtain a classification score; taking out all data belonging to the large class in the database, and calculating the similarity of the characteristics;
if the data with the characteristics which are strongly matched exists, the data is judged to be the information corresponding to the currently stored or taken article, and the data is set to be in a stored or taken state; if the characteristics are compared and matched, processing according to strong matching, but storing a piece of reminding information into a background; if no matching object exists, but the classification score is high, the object is judged to be newly stored, a piece of data corresponding to the object is newly established, and the large class-number is used as the name of the object; if no matching object exists and the classification score is low, judging that the identification is unsuccessful, and putting a piece of warning information into the background;
(4) after the user finishes all the access states, the user can check and edit the access results in the background; when searching for articles, only search information needs to be input or images need to be uploaded for searching.
4. The intelligent storage management method according to claim 3, wherein when the intelligent storage management device is not in use, the rotating rod is rotated until the camera faces the inner wall of the storage box, so that privacy of living environment of people is protected.
5. The intelligent storage management method according to claim 3, wherein in the step (3), whether the article is stored or removed is determined by tracking a target movement direction.
6. The intelligent storage management method according to claim 3, wherein in the step (4), when editing the access result, the user can select to edit the name, video and content description attributes, and manually mark the article with unsuccessful identification as the corresponding article, and the image is used as the basis for the next matching of the corresponding article.
7. The intelligent storage management method according to claim 3, wherein in the step (4), when the image is uploaded for searching, feature extraction is performed through the same feature network, all data in the library are matched, and the top 8 most similar items are recommended to the user for selection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111282250.5A CN114007003A (en) | 2021-11-01 | 2021-11-01 | Intelligent storage camera and storage management method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111282250.5A CN114007003A (en) | 2021-11-01 | 2021-11-01 | Intelligent storage camera and storage management method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114007003A true CN114007003A (en) | 2022-02-01 |
Family
ID=79926064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111282250.5A Pending CN114007003A (en) | 2021-11-01 | 2021-11-01 | Intelligent storage camera and storage management method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114007003A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018092464A (en) * | 2016-12-06 | 2018-06-14 | 凸版印刷株式会社 | Article location management system and tag information reading terminal device |
| CN108968270A (en) * | 2018-08-15 | 2018-12-11 | 河北棣烨信息技术有限公司 | A kind of intelligently storage clip and application method |
| CN109840504A (en) * | 2019-02-01 | 2019-06-04 | 腾讯科技（深圳）有限公司 | Article picks and places Activity recognition method, apparatus, storage medium and equipment |
| CN111050114A (en) * | 2018-10-15 | 2020-04-21 | 珠海格力电器股份有限公司 | Low-power-consumption camera, monitoring management control system and control method thereof |
| CN112242940A (en) * | 2020-07-31 | 2021-01-19 | 广州微林软件有限公司 | Intelligent cabinet food management system and management method |
-
2021
- 2021-11-01 CN CN202111282250.5A patent/CN114007003A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2018092464A (en) * | 2016-12-06 | 2018-06-14 | 凸版印刷株式会社 | Article location management system and tag information reading terminal device |
| CN108968270A (en) * | 2018-08-15 | 2018-12-11 | 河北棣烨信息技术有限公司 | A kind of intelligently storage clip and application method |
| CN111050114A (en) * | 2018-10-15 | 2020-04-21 | 珠海格力电器股份有限公司 | Low-power-consumption camera, monitoring management control system and control method thereof |
| CN109840504A (en) * | 2019-02-01 | 2019-06-04 | 腾讯科技（深圳）有限公司 | Article picks and places Activity recognition method, apparatus, storage medium and equipment |
| CN112242940A (en) * | 2020-07-31 | 2021-01-19 | 广州微林软件有限公司 | Intelligent cabinet food management system and management method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100641791B1 (en) | Tagging Method and System for Digital Data | |
| US20140293069A1 (en) | Real-time image classification and automated image content curation | |
| CN105164481A (en) | Method for managing storage product in refrigerator using image recognition, and refrigerator for same | |
| CN103530652A (en) | Face clustering based video categorization method and retrieval method as well as systems thereof | |
| TW201734896A (en) | Smart bookrack and system and method for managing books using the smart bookrack | |
| CN101300588A (en) | Determining a particular person from a collection | |
| US20200402076A1 (en) | Data processing method and apparatus, and storage medium | |
| US20080002864A1 (en) | Using background for searching image collections | |
| CN204440563U (en) | Search the storage cabinet system of article | |
| CN110290346B (en) | Bidding video acquisition method based on intelligent video analysis | |
| CN103761500A (en) | Intelligent book locating device based on two-dimension code technology | |
| CN108256604A (en) | A kind of intelligence is made an inventory device | |
| Chen et al. | Probabilistic semantic retrieval for surveillance videos with activity graphs | |
| CN110909832A (en) | Data classification management method and device for intelligent household equipment | |
| CN114926757A (en) | Method and system for retrieving lost article, electronic equipment and computer storage medium | |
| US20060082664A1 (en) | Moving image processing unit, moving image processing method, and moving image processing program | |
| CN114007003A (en) | Intelligent storage camera and storage management method | |
| CN106778946B (en) | Intelligent box capable of remotely and quickly searching articles | |
| CN201628997U (en) | Camera attendance machine with backstage comparison | |
| CN111401325A (en) | System and method for quickly searching for articles | |
| CN109635688B (en) | Method and system for managing books on bookshelf based on image recognition | |
| CN111444360A (en) | Warehousing system and method for article management, positioning, sharing and real-time display | |
| CN109145761A (en) | A kind of books in libraries sequence mistake proofing and management system based on image recognition | |
| CN109427017A (en) | A kind of reminding method and device | |
| CN103927399A (en) | Information push method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220201 |