CN109636268B - Goods monitoring system, method and device, electronic equipment and storage equipment - Google Patents

Goods monitoring system, method and device, electronic equipment and storage equipment Download PDF

Info

Publication number
CN109636268B
CN109636268B CN201811351445.9A CN201811351445A CN109636268B CN 109636268 B CN109636268 B CN 109636268B CN 201811351445 A CN201811351445 A CN 201811351445A CN 109636268 B CN109636268 B CN 109636268B
Authority
CN
China
Prior art keywords
goods
freshness
information
data
freshness data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811351445.9A
Other languages
Chinese (zh)
Other versions
CN109636268A (en
Inventor
张飞
郭华洋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koubei Shanghai Information Technology Co Ltd
Original Assignee
Koubei Shanghai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koubei Shanghai Information Technology Co Ltd filed Critical Koubei Shanghai Information Technology Co Ltd
Priority to CN201811351445.9A priority Critical patent/CN109636268B/en
Publication of CN109636268A publication Critical patent/CN109636268A/en
Application granted granted Critical
Publication of CN109636268B publication Critical patent/CN109636268B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087—Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Quality & Reliability (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Operations Research (AREA)
  • Development Economics (AREA)
  • Accounting & Taxation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Cold Air Circulating Systems And Constructional Details In Refrigerators (AREA)
  • Image Analysis (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The application discloses a goods monitoring system, and a goods monitoring method and device. The goods monitoring system comprises: the system comprises an information acquisition subsystem and an image recognition subsystem, wherein the information acquisition subsystem is used for acquiring and displaying image information of a goods state, the image recognition subsystem is used for carrying out feature extraction on the image information to obtain feature information used for expressing the freshness of goods, and first freshness data of the goods are obtained according to the feature information used for expressing the freshness of the goods. Adopt the goods monitored control system that this application provided, can be through the characteristic information of contrast inventory goods freshness degree different angle image information around changing, the fresh degree change condition of goods is discerned to the accuracy to the effective control to the goods freshness degree has been realized.

Description

Goods monitoring system, method and device, electronic equipment and storage equipment
Technical Field
The application relates to the field of goods inventory management, in particular to a goods monitoring system. In addition, the invention also relates to a goods monitoring method, a goods monitoring device, electronic equipment and storage equipment.
Background
Along with the improvement of living standard and the change of living style of people, the frequency of going out to have a dinner is gradually increased, and the catering industry is rapidly developed along with the frequency. In order to meet the requirement of rapid development of the catering industry, a more scientific and effective inventory management system is needed, because the freshness of inventory goods is crucial to the catering industry, but along with more and more types of goods, the people always have a headache on how to rapidly obtain the freshness information of various types of goods and timely and rapidly and accurately transmit the freshness information of various types of goods to a monitoring terminal.
At present, the monitoring of the catering industry for the freshness information of inventory goods is carried out in a manual mode, but when the types of goods are more or the work is busy, the food is manually checked and notified, the time and the labor are wasted, and missing report, misinformation and the like can be caused frequently. Therefore, it is difficult to clearly grasp the freshness conditions of all kinds of the goods.
In order to solve the problems, a traditional catering management software system is introduced into a plurality of restaurants, and a computer is used for helping to monitor the freshness condition of goods, so that the inventory goods management efficiency is improved. But the information of the freshness of the goods is recorded into a computer in the lobby, compared with the original management mode, the information is only recorded into a computer from manual counting, the freshness of the goods is relatively visually displayed, the problems are not fundamentally solved, the operation is relatively complex, and the management efficiency and the monitoring accuracy of the catering industry for the freshness of the goods in stock are reduced.
Disclosure of Invention
The application provides a goods monitored control system to solve the problem that the above-mentioned goods stock monitored control system that prior art exists can't real time monitoring stock goods's new freshness change condition, and the lower problem of the accuracy of the managerial efficiency and the control to the new freshness condition of stock goods. The application further provides a goods monitoring method and device, electronic equipment and storage equipment.
The goods monitoring system comprises an information acquisition subsystem and an image recognition subsystem;
the information acquisition subsystem is used for acquiring image information for displaying the goods state;
the image identification subsystem is used for extracting the characteristics of the image information to obtain characteristic information for indicating the freshness of the goods, and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
Optionally, the information acquisition subsystem is specifically configured to acquire current image information showing a current state of the goods and previous image information showing a previous state of the goods;
the image identification subsystem is specifically configured to perform feature extraction on the current image information to obtain feature information indicating current freshness of a product, perform feature extraction on the previous image information to obtain feature information indicating previous freshness of the product, and obtain the first freshness data according to the feature information indicating the current freshness of the product and the feature information indicating the previous freshness of the product.
Optionally, the image identification subsystem is specifically configured to calculate a difference between the feature information indicating the current freshness of the goods and the feature information indicating the previous freshness of the goods, determine a difference range to which the difference belongs, and obtain the first freshness data according to a correspondence between the difference range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information for indicating the freshness of the goods is a characteristic value for indicating the freshness of the goods;
the image identification subsystem is specifically configured to determine a feature value range to which the feature value for indicating the freshness of the goods belongs, and obtain the first freshness data according to a correspondence between a feature value range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information indicating the freshness of the goods includes at least one of color information of the goods, shape information of the goods, and activity frequency of the goods themselves.
Optionally, the information acquisition subsystem is specifically configured to acquire a plurality of continuous image information showing changes in the state of the goods;
the image identification subsystem is specifically configured to perform feature extraction on the continuous image information to obtain motion vector information and residual data information of the goods in the continuous image information, obtain the activity frequency of the goods according to the motion vector information and the residual data information, and obtain the first freshness data according to a correspondence between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
Optionally, the goods monitoring system further comprises: an odor information processing subsystem and a freshness data processing subsystem;
the odor information processing subsystem is used for acquiring odor information of goods and acquiring second freshness data of the goods according to the odor information of the goods;
the freshness data processing subsystem is configured to determine third freshness data of the goods according to the first freshness data and the second freshness data.
Optionally, the freshness data processing subsystem is specifically configured to perform average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determine the average freshness data of the goods as the third freshness data.
Optionally, the freshness data processing subsystem is specifically configured to determine, as the third freshness data, freshness data with a low value in the first freshness data and the second freshness data.
Optionally, the freshness data processing subsystem is specifically configured to:
calculating a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting the first freshness data or the second freshness data as the third freshness data, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
Optionally, the goods monitoring system further comprises: and the goods clearing subsystem is used for judging whether the stock state of the goods is valid according to the first freshness data, determining the goods as stock goods if the stock state of the goods is valid, and determining the goods as non-stock goods if the stock state of the goods is not valid.
Optionally, the goods inventory cleaning subsystem is specifically configured to determine whether the stock state of the goods is valid according to the first freshness data and a correspondence between the freshness data of the goods and the stock state of the goods, which is obtained in advance.
Optionally, the goods monitoring system further comprises: and the goods state management subsystem is used for acquiring the first freshness data, comparing and analyzing the first freshness data and the standard freshness data of the goods to acquire difference information, and sending the information of the goods to the monitoring terminal if the difference information reaches or exceeds a preset difference information threshold value.
Optionally, the information collection subsystem is specifically configured to collect, from multiple angles, image information showing a state of the goods, for a position where the goods are stored.
Optionally, the plurality of angles includes at least two of a top, front, rear, left side, right side, bottom of a location where the items are stored.
Optionally, the items are stored in a shelf, the shelf has a plurality of storage areas, and the different kinds of items are stored in different storage areas, respectively.
Correspondingly, the application also provides a goods monitoring method, which comprises the following steps:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining the first freshness data according to the characteristic information for indicating the freshness of the goods.
Optionally, the acquiring and displaying of the image information of the goods state specifically includes: acquiring current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods;
the extracting the features of the image information to obtain the feature information indicating the freshness of the goods specifically includes: performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
Optionally, the obtaining the first freshness data of the goods according to the feature information indicating the current freshness of the goods and the feature information indicating the previous freshness of the goods specifically includes: calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information for indicating the freshness of the goods is a characteristic value for indicating the freshness of the goods;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes:
determining a characteristic value range to which the characteristic value for indicating the freshness of the goods belongs;
and obtaining the first freshness data according to the corresponding relation between the characteristic value range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information indicating the freshness of the goods includes at least one of color information of the goods, shape information of the goods, and activity frequency of the goods themselves.
Optionally, the acquiring and displaying of the image information of the goods state specifically includes: collecting a plurality of continuous image information for displaying the goods state change;
the characteristic extraction is carried out on the image information to obtain characteristic information used for expressing the freshness of goods; the method specifically comprises the following steps: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
Optionally, the method for monitoring goods further includes:
collecting smell information of goods, and acquiring second freshness data according to the smell information of the goods;
and determining the third freshness data according to the obtained first freshness data and the second freshness data.
Optionally, the determining the third freshness data according to the obtained first freshness data of the goods and the obtained second freshness data of the goods specifically includes: and averaging the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data.
Optionally, the determining the third freshness data according to the obtained first freshness data and the obtained second freshness data specifically includes: determining freshness data having a low value of the obtained first freshness data and the obtained second freshness data as the third freshness data.
Optionally, determining the third freshness data according to the obtained first freshness data and the obtained second freshness data specifically includes:
calculating a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as actual freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
Optionally, the method for monitoring goods further includes:
and judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
Optionally, the determining, according to the first freshness data of the goods, whether the stock state of the goods is valid specifically includes: and judging whether the stock state of the goods is effective or not according to the correspondence between the freshness data of the goods and the stock state of the goods, which is obtained in advance.
Optionally, the method for monitoring goods further includes:
and comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, sending the information of the goods to a monitoring terminal.
Optionally, the acquiring and displaying of the image information of the goods state specifically includes: image information showing the state of the goods is collected from a plurality of angles with respect to the position where the goods are stored.
Optionally, the plurality of angles includes at least two of a top, front, rear, left side, right side, bottom of a location where the items are stored.
Optionally, the items are stored in a shelf, the shelf has a plurality of storage areas, and the different kinds of items are stored in different storage areas, respectively.
Correspondingly, this application still provides a goods monitoring device, includes:
the image acquisition unit is used for acquiring image information for displaying the goods state;
a first obtaining unit configured to perform feature extraction on the image information to obtain feature information indicating freshness of a product;
a second obtaining unit configured to obtain the first freshness data based on the characteristic information indicating the freshness of the article.
Optionally, the image capturing unit is specifically configured to: acquiring current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods;
the first obtaining unit is specifically configured to: performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods;
the second obtaining unit is specifically configured to: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
Optionally, the second obtaining unit is specifically configured to:
calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information for indicating the freshness of the goods is a characteristic value for indicating the freshness of the goods;
the second obtaining unit is specifically configured to: determining the range of the characteristic value to which the characteristic value for indicating the freshness of the goods belongs, and obtaining the first freshness data according to the correspondence between the range of the characteristic value obtained in advance and the freshness data of the goods.
Optionally, the characteristic information indicating the freshness of the goods includes at least one of color information of the goods, shape information of the goods, and activity frequency of the goods themselves.
Optionally, the image capturing unit is specifically configured to: collecting a plurality of continuous image information for displaying the goods state change;
the first obtaining unit is specifically configured to: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the second obtaining unit is specifically configured to: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
Optionally, the goods monitoring device further comprises:
the odor collecting unit is used for collecting odor information of goods and obtaining the second freshness data according to the odor information of the goods;
a determining unit, configured to determine the third freshness data according to the obtained first freshness data and the obtained second freshness data.
Optionally, the determining unit is specifically configured to perform average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determine the average freshness data of the goods as the third freshness data.
Optionally, the determining unit is specifically configured to determine, as the third freshness data, freshness data with a low value in the obtained first freshness data and the obtained second freshness data.
Optionally, the determining unit is specifically configured to calculate a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as actual freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
Optionally, the goods monitoring device further comprises:
and the listing unit is used for judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
Optionally, the inventory element is specifically configured to determine whether the inventory status of the goods is valid according to a correspondence between the freshness data of the goods and the inventory status of the goods, which is obtained in advance.
Optionally, the goods monitoring device further comprises:
and the analysis unit is used for comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, the information of the goods is sent to a monitoring terminal.
Optionally, the image collecting unit is specifically configured to collect image information showing a state change condition of the goods from multiple angles according to a position where the goods are stored.
Optionally, the plurality of angles includes at least two of a top, front, rear, left side, right side, bottom of a location where the items are stored.
Optionally, the items are stored in a shelf, the shelf has a plurality of storage areas, and the different kinds of items are stored in different storage areas, respectively.
Correspondingly, the present application also provides an electronic device, comprising:
a processor; and
the storage is used for storing a program of the goods monitoring method, and after the equipment is powered on and runs the program of the goods monitoring method through the processor, the following steps are executed:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
Correspondingly, the application also provides a storage device, which stores a program of the goods monitoring method, the program is run by a processor and executes the following steps:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
Compared with the prior art, the method has the following advantages:
adopt the goods monitored control system that this application provided, can be through the characteristic information before and after the contrast stock goods freshness change, the fresh degree change condition of goods in stock of accurate discernment out of stock has improved the managerial efficiency and the accuracy of control to the fresh degree change condition of stock goods.
Drawings
FIG. 1 is a schematic diagram of an item monitoring system provided in an embodiment of the present application;
fig. 2 is a flowchart of a goods monitoring method according to an embodiment of the present application;
FIG. 3 is a schematic view of an article monitoring apparatus provided in accordance with an embodiment of the present application;
fig. 4 is a schematic view of an electronic device for monitoring goods according to an embodiment of the present application;
fig. 5 is a flowchart illustrating the overall operation of a goods monitoring system according to a preferred embodiment of the present application.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.
Embodiments of the goods monitoring system according to the present application will be described in detail below. In addition, in the following description, detailed description will be made separately for the information acquisition subsystem and the image recognition subsystem of the present system. Please refer to fig. 1, which are schematic diagrams of an article monitoring system according to embodiments of the present disclosure.
The embodiment of the application provides a goods state monitoring system, utilizes this kind of monitored control system, can help kitchen personnel's quick convenient fresh degree condition of obtaining stock goods to have good technical characteristics such as easy management, high reliability.
The goods state monitoring system provided by the embodiment of the application specifically comprises the following parts:
and the information acquisition subsystem 101 is used for acquiring image information for displaying the goods state.
In the embodiment of the application, the collected image information for displaying the goods state comprises a plurality of continuous image information for displaying the current state of the goods and a plurality of continuous image information for displaying the previous state of the goods, and the specific freshness data of the stock goods can be obtained by comparing and analyzing the image information before and after the freshness change of the goods is acquired. It should be noted that the image information includes picture image information and video image information, and the freshness change condition of the goods includes a color change condition, an appearance or volume change condition, or a change condition of activity frequency. For example, by analyzing a plurality of image information before and after the acquisition, a decrease in color, a decrease in appearance or volume, or a decrease in the frequency of activities is obtained, it indicates that the freshness of the stock item is decreasing.
Specifically, this information acquisition subsystem can carry out image information acquisition through the camera of the multiple angle that sets up in standard goods shelves, two at least angles in the top, front portion, rear portion, left side, right side, the bottom of the position that a plurality of angles were deposited including inventory goods can obtain more accurate new freshness supervisory data through the collection image information of multi-angle. Therefore, in this embodiment of the application, if the inventory condition of various types of goods is to be accurately monitored, a shelf for storing the goods needs to be established, the shelf is a standard shelf, various types of goods to be monitored are stored in the standard shelf respectively, the standard shelf can be divided into a plurality of storage spaces according to different types, and the goods of corresponding types are stored in the corresponding storage spaces respectively. The information acquisition subsystem shoots goods stored in the storage space through the camera and acquires and displays image information of the freshness change condition of the goods from multiple angles. It should be noted that, the standard shelf described in this embodiment is made of transparent material, the whole standard shelf can be divided into a plurality of storage spaces, the storage spaces can be large or small, and each storage space has a uniform vertical scale mark for storing different kinds of goods. For example, various aquatic products such as live fish, live shrimp, crabs and the like, the freshness information of which is monitored by taking the activity frequency as a main weight, are stored in the first storage space; fresh vegetables and the like taking the color change condition as a main weight to monitor the freshness condition are placed in the storage space II.
And the image identification subsystem 102 is used for performing feature extraction on the image information to obtain feature information used for indicating the freshness of the goods, and obtaining first freshness data of the goods according to the feature information used for indicating the freshness of the goods.
In the embodiment of the application, the image recognition subsystem is specifically configured to perform feature extraction on current image information acquired by the information acquisition subsystem to obtain feature information used for indicating the current freshness of a product, perform feature extraction on previous image information to obtain feature information used for indicating the previous freshness of the product, and obtain first freshness data by analyzing freshness difference information between the feature information used for indicating the current freshness of the product and the feature information used for indicating the previous freshness of the product. The characteristic information mainly includes color change, appearance or volume change, or frequent activity change. The first freshness data is freshness data of the stock goods obtained based on the characteristic information such as the color change condition, the appearance or volume change condition, or the change condition of the activity frequency.
It should be noted that the characteristic information indicating the freshness of the goods may be represented by a characteristic value indicating the freshness of the goods. Determining a difference degree range to which the difference degree belongs by analyzing a difference degree between characteristic information indicating the current freshness of the goods and characteristic information indicating the previous freshness of the goods, and obtaining first freshness data from a correspondence between the difference degree range obtained in advance and the freshness data of the goods according to the determined difference degree range to which the difference degree belongs. That is, a difference value between a characteristic value indicating the current freshness of the goods and a characteristic value indicating the previous freshness of the goods is calculated by an algorithm, a characteristic value range to which the characteristic value indicating the freshness of the goods belongs is determined, and first freshness data is obtained from a correspondence between the characteristic value range obtained in advance and the freshness data of the goods according to the characteristic value range to which the characteristic value indicating the freshness of the goods belongs. Taking the characteristic information of the inventory goods as the color change situation as an example, the color characteristic value for representing the current freshness of the goods is H, the color characteristic value for representing the previous freshness of the goods is F, the image recognition technology + algorithm is utilized to compare and analyze the H and the F, the difference value is H-F, the freshness data of the goods is 'urgent need to be processed' according to the corresponding relation between the characteristic value range obtained in advance and the freshness data of the goods (for example, the freshness data represents 'very fresh', 'comparatively fresh' or 'urgent need to be processed'), the first freshness data is 'urgent need to be processed', a kitchen manager is informed that the goods reach the freshness critical value, and the goods are cooked as soon as possible.
When the freshness of various aquatic products such as live fish, live shrimp and crab is monitored by taking the activity frequency as a main weight, firstly, feature extraction is carried out on a plurality of continuous image information by utilizing an image recognition technology and an algorithm to obtain motion vector information and residual data information of the aquatic products in the plurality of continuous image information, the activity frequency of a product is obtained according to the motion vector information and the residual data information, and the freshness data of the product is obtained to be 'very fresh' according to the correspondence between the activity frequency of the product and the freshness data of the product (for example, the freshness data represents 'very fresh', 'comparatively fresh' or 'treatment urgently needed'), and the first freshness data is 'very fresh'. It should be noted that the motion vector information described in the embodiment of the present application is information of relative motion displacement in the storage space, which is obtained according to a certain criterion when the aquatic product moves in the storage space. The residual data information is the difference information between actually measured freshness information and preset freshness information.
In addition, the goods state monitoring system of the embodiment of the application can further comprise an odor information processing subsystem and a freshness data processing subsystem. The odor information processing subsystem is used for acquiring odor characteristic information of the goods and acquiring second freshness data according to the odor characteristic information of the goods, wherein the second freshness data is freshness data obtained based on the odor characteristic information; the freshness data processing subsystem is configured to determine third freshness data for the item based on the first freshness data and the second freshness data. The third freshness degree data is freshness degree data of the stock goods obtained based on the characteristic information of the odor characteristic information, the color change condition, the appearance or volume change condition or the change condition of the activity frequency. Specifically, the first freshness data and the second freshness data are averaged by using an averaging algorithm to obtain average freshness data of the goods, and the obtained average freshness data of the goods is determined as third freshness data. Or, determining freshness data having a low value of the first freshness data and the second freshness data as third freshness data. Or calculating the similarity between the first freshness data and the second freshness data by using a similarity algorithm, and randomly selecting the first freshness data or the second freshness data as the third freshness data if the similarity reaches or exceeds a similarity threshold.
The goods state monitoring system according to the embodiment of the present application further includes a goods state management subsystem, please refer to fig. 5, which is a complete operation flow chart of the goods monitoring system according to the preferred embodiment of the present application. Firstly, image information shot by the image recognition subsystem at 6 angles of the top, the front, the rear, the left side, the right side and the bottom before and after the inventory change is collected by the information collection subsystem is compared and analyzed, characteristic information of the image information is extracted, and freshness data of inventory goods is obtained according to the freshness information. The goods state management subsystem is specifically used for comparing and analyzing freshness data obtained by the image recognition subsystem with standard freshness data of preset goods to obtain freshness difference information, and if the difference information reaches or exceeds a preset difference information threshold value, the freshness information of the goods is sent to the monitoring terminal to inform kitchen staff to process the freshness information in time. The embodiment of the application is preferentially suitable for the kitchen management system in the catering industry, and the freshness change condition of the goods stored in the kitchen in the restaurant is monitored: for example, the goods to be monitored are live fish, a group of image information shot at least two angles of 6 angles of the top, the front, the rear, the left side, the right side and the bottom is collected from a storage area for storing the live fish at intervals (such as 1 hour or 2 hours), the activity frequency of the live fish at different time points in the storage area is obtained by comparing and analyzing the image information obtained at different time points, and the freshness information of the live fish is obtained according to the activity frequency of the different time points. For example, one set of image information is captured at 1 point as a set, one set of image information is captured at 2 points as a set, and one set of image information is captured at 3 points as a set. Analyzing and obtaining the activity frequency A at the 1 point by utilizing an image recognition technology and an algorithm according to the group a of image information; analyzing and obtaining the activity frequency B at the point 2 by utilizing an image recognition technology and an algorithm according to the group B of image information; and analyzing the activity frequency C at 3 points according to the C groups of image information by using an image recognition technology and an algorithm to obtain the freshness change data of the live fish between 1 point and 2 points B-A, the freshness change data of the live fish between 3 points and 2 points C-B and the freshness change data of the live fish between 1 point and 3 points C-A.
The application discloses goods monitored control system includes: the system comprises an information acquisition subsystem, an image recognition subsystem, an odor information processing subsystem and a freshness data processing subsystem. Adopt the goods monitored control system that this application provided, can be through the characteristic information of contrast inventory goods freshness degree different angle image information around changing, the fresh degree change condition of goods is discerned to the accuracy to the effective control to the goods freshness degree has been realized.
Corresponding to the goods monitoring system, the application also provides a goods monitoring method. Since the embodiment of the method is similar to the embodiment of the system, the description is simple, and please refer to the description of the embodiment of the system for relevant points. Please refer to fig. 2, which is a flowchart illustrating an article monitoring method according to an embodiment of the present application.
The goods monitoring method comprises the following steps:
step S201: image information showing the state of the goods is collected.
The acquiring and displaying of the image information of the goods state specifically includes: the method comprises the steps of collecting current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods.
Step S202: and performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods.
The extracting the features of the image information to obtain the feature information indicating the freshness of the goods specifically includes: and performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods.
Step S203: and obtaining the first freshness data according to the characteristic information for indicating the freshness of the goods.
The obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
Optionally, the obtaining the first freshness data of the goods according to the feature information indicating the current freshness of the goods and the feature information indicating the previous freshness of the goods specifically includes: calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information for indicating the freshness of the goods is a characteristic value for indicating the freshness of the goods;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes:
determining a characteristic value range to which the characteristic value for indicating the freshness of the goods belongs;
and obtaining the first freshness data according to the corresponding relation between the characteristic value range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information indicating the freshness of the goods includes at least one of color information of the goods, shape information of the goods, and activity frequency of the goods themselves.
Optionally, the acquiring and displaying of the image information of the goods state specifically includes: collecting a plurality of continuous image information for displaying the goods state change;
the characteristic extraction is carried out on the image information to obtain characteristic information used for expressing the freshness of goods; the method specifically comprises the following steps: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
Optionally, the method for monitoring goods further includes:
collecting smell information of goods, and acquiring second freshness data according to the smell information of the goods;
and determining the third freshness data according to the obtained first freshness data and the second freshness data.
Optionally, the determining the third freshness data according to the obtained first freshness data of the goods and the obtained second freshness data of the goods specifically includes: and averaging the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data.
Optionally, the determining the third freshness data according to the obtained first freshness data and the obtained second freshness data specifically includes: determining freshness data having a low value of the obtained first freshness data and the obtained second freshness data as the third freshness data.
Optionally, determining the third freshness data according to the obtained first freshness data and the obtained second freshness data specifically includes:
calculating a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as actual freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
Optionally, the method for monitoring goods further includes:
and judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
Optionally, the determining, according to the first freshness data of the goods, whether the stock state of the goods is valid specifically includes: and judging whether the stock state of the goods is effective or not according to the correspondence between the freshness data of the goods and the stock state of the goods, which is obtained in advance.
Optionally, the method for monitoring goods further includes:
and comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, sending the information of the goods to a monitoring terminal.
Optionally, the acquiring and displaying of the image information of the goods state specifically includes: image information showing the state of the goods is collected from a plurality of angles with respect to the position where the goods are stored.
Optionally, the plurality of angles includes at least two of a top, front, rear, left side, right side, bottom of a location where the items are stored.
Optionally, the items are stored in a shelf, the shelf has a plurality of storage areas, and the different kinds of items are stored in different storage areas, respectively.
Corresponding to the goods monitoring method, the application also provides a goods monitoring device, and the goods monitoring method can be applied to the device. Because the embodiment of the device is similar to the embodiment of the method and the system, the description is simple, and the related points can be referred to the partial description of the embodiment of the method and the system, and the following description of the embodiment of the device is only illustrative. Please refer to fig. 3, which is a schematic diagram of an article monitoring device according to an embodiment of the present application.
The goods monitoring device of the embodiment of the application comprises the following parts:
and the image collecting unit 301 is used for collecting image information for displaying the goods state.
The image acquisition unit is specifically configured to: the method comprises the steps of collecting current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods.
A first obtaining unit 302, configured to perform feature extraction on the image information to obtain feature information indicating freshness of the goods.
The first obtaining unit is specifically configured to: and performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods.
A second obtaining unit 303, configured to obtain the first freshness data according to the feature information indicating the freshness of the item.
The second obtaining unit is specifically configured to: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
Optionally, the second obtaining unit is specifically configured to:
calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
Optionally, the characteristic information for indicating the freshness of the goods is a characteristic value for indicating the freshness of the goods;
the second obtaining unit is specifically configured to: determining the range of the characteristic value to which the characteristic value for indicating the freshness of the goods belongs, and obtaining the first freshness data according to the correspondence between the range of the characteristic value obtained in advance and the freshness data of the goods.
Optionally, the characteristic information indicating the freshness of the goods includes at least one of color information of the goods, shape information of the goods, and activity frequency of the goods themselves.
Optionally, the image capturing unit is specifically configured to: collecting a plurality of continuous image information for displaying the goods state change;
the first obtaining unit is specifically configured to: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the second obtaining unit is specifically configured to: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
Optionally, the goods monitoring device further comprises:
the odor collecting unit is used for collecting odor information of goods and obtaining the second freshness data according to the odor information of the goods;
a determining unit, configured to determine the third freshness data according to the obtained first freshness data and the obtained second freshness data.
Optionally, the determining unit is specifically configured to perform average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determine the average freshness data of the goods as the third freshness data.
Optionally, the determining unit is specifically configured to determine, as the third freshness data, freshness data with a low value in the obtained first freshness data and the obtained second freshness data.
Optionally, the determining unit is specifically configured to calculate a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as actual freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
Optionally, the goods monitoring device further comprises:
and the listing unit is used for judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
Optionally, the inventory element is specifically configured to determine whether the inventory status of the goods is valid according to a correspondence between the freshness data of the goods and the inventory status of the goods, which is obtained in advance.
Optionally, the goods monitoring device further comprises:
and the analysis unit is used for comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, the information of the goods is sent to a monitoring terminal.
Optionally, the image collecting unit is specifically configured to collect image information showing a state change condition of the goods from multiple angles according to a position where the goods are stored.
Optionally, the plurality of angles includes at least two of a top, front, rear, left side, right side, bottom of a location where the items are stored.
Optionally, the items are stored in a shelf, the shelf has a plurality of storage areas, and the different kinds of items are stored in different storage areas, respectively.
Correspondingly, the present application also provides an electronic device, comprising:
a processor; and
the storage is used for storing a program of the goods monitoring method, and after the equipment is powered on and runs the program of the goods monitoring method through the processor, the following steps are executed:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
Correspondingly, the application also provides a storage device, which stores a program of the goods monitoring method, the program is run by a processor and executes the following steps:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
Corresponding to the above-mentioned goods monitoring method, an embodiment of the present application further provides an electronic device for goods monitoring, please refer to fig. 4, which is a schematic diagram of the electronic device for goods monitoring provided by the embodiment of the present application.
The electronic equipment for monitoring goods comprises the following parts:
a processor 401; and
a memory 402 for storing a program of the goods monitoring method, wherein after the device is powered on and the program of the goods monitoring method is run by the processor, the following steps are executed:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
It should be noted that, for the detailed description of the electronic device for monitoring goods provided in the embodiment of the present application, reference may be made to the related description of a status monitoring method provided in the embodiment of the present application, and details are not repeated here.
Corresponding to the goods monitoring method, the embodiment of the application further provides a storage device. The storage equipment for monitoring goods comprises the following parts: a program storing a method of monitoring goods, the program being executed by a processor to perform the steps of:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
It should be noted that, for the detailed description of the storage device for monitoring the goods provided in the embodiment of the present application, reference may be made to the related description of the method for monitoring the goods provided in the embodiment of the present application, and details are not described here again.
Although the present application has been described with reference to the preferred embodiments, it is not intended to limit the present application, and those skilled in the art can make variations and modifications without departing from the spirit and scope of the present application, therefore, the scope of the present application should be determined by the claims that follow.

Claims (50)

1. A goods monitoring system is characterized by comprising an information acquisition subsystem and an image recognition subsystem;
the information acquisition subsystem is used for acquiring image information for displaying the goods state;
the image identification subsystem is used for extracting the characteristics of the image information to obtain characteristic information for indicating the freshness of the goods, and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods, wherein the characteristic information for indicating the freshness of the goods comprises the activity frequency of the goods.
2. The goods monitoring system of claim 1, wherein the information acquisition subsystem is specifically configured to acquire current image information showing a current state of the goods and previous image information showing a previous state of the goods;
the image identification subsystem is specifically configured to perform feature extraction on the current image information to obtain feature information indicating current freshness of a product, perform feature extraction on the previous image information to obtain feature information indicating previous freshness of the product, and obtain the first freshness data according to the feature information indicating the current freshness of the product and the feature information indicating the previous freshness of the product.
3. The system for monitoring items according to claim 2, wherein the image recognition subsystem is specifically configured to calculate a degree of difference between the characteristic information indicating the current freshness of the items and the characteristic information indicating the previous freshness of the items, determine a range of the degree of difference to which the degree of difference belongs, and obtain the first freshness data according to a correspondence between the range of the degree of difference obtained in advance and the freshness data of the items.
4. The item monitoring system according to claim 1, wherein the characteristic information indicating the freshness of the item is a characteristic value indicating the freshness of the item;
the image identification subsystem is specifically configured to determine a feature value range to which the feature value for indicating the freshness of the goods belongs, and obtain the first freshness data according to a correspondence between a feature value range obtained in advance and the freshness data of the goods.
5. The item monitoring system according to claim 1 or 4, wherein the characteristic information indicating the freshness of the item further includes at least one of information on a color of the item and information on a shape of the item.
6. The goods monitoring system of claim 5, wherein the information acquisition subsystem is specifically configured to acquire a plurality of consecutive image information showing changes in the state of the goods;
the image identification subsystem is specifically configured to perform feature extraction on the continuous image information to obtain motion vector information and residual data information of the goods in the continuous image information, obtain the activity frequency of the goods according to the motion vector information and the residual data information, and obtain the first freshness data according to a correspondence between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
7. The item monitoring system of claim 1, further comprising: an odor information processing subsystem and a freshness data processing subsystem;
the odor information processing subsystem is used for acquiring odor information of goods and acquiring second freshness data of the goods according to the odor information of the goods;
the freshness data processing subsystem is configured to determine third freshness data of the goods according to the first freshness data and the second freshness data.
8. The item monitoring system of claim 7, wherein the freshness data processing subsystem is configured to average the first freshness data and the second freshness data to obtain an average freshness data of the item, and determine the average freshness data of the item as the third freshness data.
9. The item monitoring system of claim 7, wherein the freshness data processing subsystem is configured to determine a low value freshness data of the first freshness data and the second freshness data as the third freshness data.
10. The item monitoring system of claim 7, wherein the freshness data processing subsystem is specifically configured to:
calculating a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting the first freshness data or the second freshness data as the third freshness data, or performing average calculation on the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
11. The item monitoring system of claim 1, further comprising: and the goods estimating and clearing subsystem is used for judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, and otherwise, determining the goods as non-stock goods.
12. The item monitoring system according to claim 11, wherein the item assessment subsystem is specifically configured to determine whether the stock state of the item is valid according to the first freshness data and a correspondence between the freshness data of the item and the stock state of the item, which is obtained in advance.
13. The item monitoring system of claim 1, further comprising: and the goods state management subsystem is used for acquiring the first freshness data, comparing and analyzing the first freshness data and the standard freshness data of the goods to acquire difference information, and sending the information of the goods to the monitoring terminal if the difference information reaches or exceeds a preset difference information threshold value.
14. The item monitoring system of claim 1, wherein the information collection subsystem is specifically configured to collect image information showing the status of the item from multiple angles with respect to the location where the item is stored.
15. The item monitoring system of claim 14 wherein the plurality of angles includes at least two of a top, front, back, left side, right side, bottom of a location where items are stored.
16. The item monitoring system of claim 1 wherein the items are stored in a rack, the rack having a plurality of storage areas, different types of items being stored in different storage areas, respectively.
17. A method of monitoring goods, comprising:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods, wherein the feature information for indicating the freshness of the goods comprises the activity frequency of the goods;
and obtaining first freshness data according to the characteristic information for indicating the freshness of the goods.
18. The goods monitoring method according to claim 17, wherein the collecting of the image information showing the goods status specifically comprises: acquiring current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods;
the extracting the features of the image information to obtain the feature information indicating the freshness of the goods specifically includes: performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
19. The method for monitoring goods according to claim 18, wherein the obtaining of the first freshness data of the goods according to the characteristic information indicating the current freshness of the goods and the characteristic information indicating the previous freshness of the goods specifically comprises: calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
20. The item monitoring method according to claim 17, wherein the characteristic information indicating the freshness of the item is a characteristic value indicating the freshness of the item;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes:
determining a characteristic value range to which the characteristic value for indicating the freshness of the goods belongs;
and obtaining the first freshness data according to the corresponding relation between the characteristic value range obtained in advance and the freshness data of the goods.
21. The article monitoring method according to claim 17 or 20, wherein the characteristic information indicating the freshness of the article further includes at least one of information on a color of the article and information on a shape of the article.
22. The goods monitoring method according to claim 17, wherein the collecting of the image information showing the goods status specifically comprises: collecting a plurality of continuous image information for displaying the goods state change;
the characteristic extraction is carried out on the image information to obtain characteristic information used for expressing the freshness of goods; the method specifically comprises the following steps: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the obtaining of the first freshness data of the goods according to the feature information indicating the freshness of the goods specifically includes: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
23. The item monitoring method of claim 17, further comprising:
collecting smell information of goods, and acquiring second freshness data according to the smell information of the goods;
and determining third freshness data according to the obtained first freshness data and the obtained second freshness data.
24. The item monitoring method according to claim 23, wherein the determining the third freshness data according to the obtained first freshness data of the item and the obtained second freshness data of the item specifically comprises: and averaging the first freshness data and the second freshness data to obtain average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data.
25. The method for monitoring goods according to claim 23, wherein the determining the third freshness data according to the obtained first freshness data and the second freshness data comprises: determining freshness data having a low value of the obtained first freshness data and the obtained second freshness data as the third freshness data.
26. The method for monitoring goods according to claim 23, wherein determining the third freshness data based on the obtained first freshness data and the obtained second freshness data comprises:
calculating a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as a third freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain an average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
27. The item monitoring method of claim 17, further comprising:
and judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
28. The method for monitoring the goods according to claim 17, wherein the step of judging whether the stock state of the goods is valid according to the first freshness data of the goods comprises the following steps: and judging whether the stock state of the goods is effective or not according to the correspondence between the freshness data of the goods and the stock state of the goods, which is obtained in advance.
29. The item monitoring method of claim 17, further comprising:
and comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, sending the information of the goods to a monitoring terminal.
30. The goods monitoring method according to claim 17, wherein the collecting of the image information showing the goods status specifically comprises: image information showing the state of the goods is collected from a plurality of angles with respect to the position where the goods are stored.
31. The item monitoring method of claim 30, wherein the plurality of angles includes at least two of a top, front, back, left, right, bottom of a location where items are stored.
32. The item monitoring method according to claim 17, wherein the items are stored in a rack, the rack having a plurality of storage areas, different kinds of items being stored in different storage areas, respectively.
33. An article monitoring device, comprising:
the image acquisition unit is used for acquiring image information for displaying the goods state;
a first obtaining unit, configured to perform feature extraction on the image information, and obtain feature information used for indicating freshness of a good, where the feature information used for indicating the freshness of the good includes activity frequency of the good itself;
a second obtaining unit configured to obtain the first freshness data based on the characteristic information indicating the freshness of the article.
34. The item monitoring device of claim 33, wherein the image capturing unit is specifically configured to: acquiring current image information for displaying the current state of the goods and previous image information for displaying the previous state of the goods;
the first obtaining unit is specifically configured to: performing feature extraction on the current image information to obtain feature information used for representing the current freshness of the goods, and performing feature extraction on the previous image information to obtain feature information used for representing the previous freshness of the goods;
the second obtaining unit is specifically configured to: and obtaining the first freshness data according to the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods.
35. The item monitoring device of claim 34, wherein the second obtaining unit is specifically configured to:
calculating the difference degree between the characteristic information for representing the current freshness of the goods and the characteristic information for representing the previous freshness of the goods, determining the difference degree range to which the difference degree belongs, and obtaining the first freshness data according to the corresponding relation between the difference degree range obtained in advance and the freshness data of the goods.
36. The item monitoring device according to claim 33, wherein the characteristic information indicating the freshness of the item is a characteristic value indicating the freshness of the item;
the second obtaining unit is specifically configured to: determining the range of the characteristic value to which the characteristic value for indicating the freshness of the goods belongs, and obtaining the first freshness data according to the correspondence between the range of the characteristic value obtained in advance and the freshness data of the goods.
37. The article monitoring device according to claim 33 or 36, wherein the characteristic information indicating the freshness of the article further includes at least one of information of a color of the article and information of a shape of the article.
38. The item monitoring device of claim 37, wherein the image capturing unit is specifically configured to: collecting a plurality of continuous image information for displaying the goods state change;
the first obtaining unit is specifically configured to: performing feature extraction on the continuous image information to obtain motion vector information and residual data information of goods in the continuous image information;
the second obtaining unit is specifically configured to: and obtaining the activity frequency of the goods according to the motion vector information and the residual data information, and obtaining the first freshness data according to the corresponding relation between the activity frequency of the goods and the freshness data of the goods, which is obtained in advance.
39. The item monitoring device of claim 33, further comprising:
the odor collecting unit is used for collecting odor information of goods and obtaining second freshness data according to the odor information of the goods;
a determining unit, configured to determine third freshness data according to the obtained first freshness data and the obtained second freshness data.
40. The item monitoring device according to claim 39, wherein the determining unit is specifically configured to average the first freshness data and the second freshness data to obtain an average freshness data of the item, and determine the average freshness data of the item as the third freshness data.
41. The item monitoring device according to claim 39, wherein said determining unit is specifically configured to determine, as the third freshness data, freshness data having a low value of the obtained first freshness data and the obtained second freshness data.
42. The item monitoring device according to claim 39, wherein the determining unit is specifically configured to calculate a similarity between the first freshness data and the second freshness data;
if the similarity reaches or exceeds a similarity threshold, randomly selecting one freshness data of the first freshness data and the second freshness data as a third freshness data of the goods, or performing average calculation on the first freshness data and the second freshness data to obtain an average freshness data of the goods, and determining the average freshness data of the goods as the third freshness data;
determining freshness data having a low value of the first freshness data and the second freshness data as the third freshness data if the similarity is lower than the similarity threshold.
43. The item monitoring device of claim 33, further comprising:
and the listing unit is used for judging whether the stock state of the goods is valid according to the first freshness data, if so, determining the goods as stock goods, otherwise, determining the goods as non-stock goods.
44. The item monitoring device according to claim 43, wherein the listing element is specifically configured to determine whether the stock state of the item is valid according to a correspondence between freshness data of the item obtained in advance and the stock state of the item.
45. The item monitoring device of claim 33, further comprising:
and the analysis unit is used for comparing and analyzing the first freshness data and the standard freshness data of the goods to obtain difference information, and if the difference information reaches or exceeds a preset difference information threshold value, the information of the goods is sent to a monitoring terminal.
46. The item monitoring device according to claim 33, wherein the image capturing unit is specifically configured to capture image information showing a change in the state of the item from a plurality of angles with respect to a location where the item is stored.
47. The item monitoring device of claim 46, wherein the plurality of angles comprises at least two of a top, front, back, left side, right side, bottom of a location where items are stored.
48. The item monitoring device of claim 33, wherein the items are stored in a rack, the rack having a plurality of storage areas, different types of items being stored in different storage areas, respectively.
49. An electronic device, comprising:
a processor; and
the storage is used for storing a program of the goods monitoring method, and after the equipment is powered on and runs the program of the goods monitoring method through the processor, the following steps are executed:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods, wherein the feature information for indicating the freshness of the goods comprises the activity frequency of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
50. A storage device, in which a program of a goods monitoring method is stored, the program being executed by a processor to perform the steps of:
collecting image information for displaying the goods state;
performing feature extraction on the image information to obtain feature information for indicating the freshness of the goods, wherein the feature information for indicating the freshness of the goods comprises the activity frequency of the goods;
and obtaining first freshness data of the goods according to the characteristic information for indicating the freshness of the goods.
CN201811351445.9A 2018-11-14 2018-11-14 Goods monitoring system, method and device, electronic equipment and storage equipment Active CN109636268B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811351445.9A CN109636268B (en) 2018-11-14 2018-11-14 Goods monitoring system, method and device, electronic equipment and storage equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811351445.9A CN109636268B (en) 2018-11-14 2018-11-14 Goods monitoring system, method and device, electronic equipment and storage equipment

Publications (2)

Publication Number Publication Date
CN109636268A CN109636268A (en) 2019-04-16
CN109636268B true CN109636268B (en) 2021-04-02

Family

ID=66067961

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811351445.9A Active CN109636268B (en) 2018-11-14 2018-11-14 Goods monitoring system, method and device, electronic equipment and storage equipment

Country Status (1)

Country Link
CN (1) CN109636268B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111582735B (en) * 2020-05-12 2021-01-08 深圳同徽网络技术有限公司 Intelligent warehouse logistics commercial commodity quality monitoring and management system based on big data
CN111738744B (en) * 2020-06-23 2021-08-31 广东好来客集团有限公司 Food safety intelligent detection early warning and management system based on big data

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202281453U (en) * 2011-09-16 2012-06-20 海尔集团公司 Refrigerator with freshness detection device
JP6019414B2 (en) * 2014-11-26 2016-11-02 パナソニックＩｐマネジメント株式会社 MONITORING DEVICE, MONITORING SYSTEM, AND MONITORING METHOD
CN204287031U (en) * 2014-12-31 2015-04-22 华东交通大学 A kind of online the cannot-harm-detection device of fish freshness based on high light spectrum image-forming technology
CN105513052B (en) * 2015-11-26 2018-01-12 四川长虹电器股份有限公司 Food storage and rotten information find out system and method in a kind of refrigerator
CN205365373U (en) * 2016-03-02 2016-07-06 龙岩市海德馨汽车有限公司 Kitchen truck food monitoring devices
CN108399514B (en) * 2017-02-08 2022-04-12 北京京东振世信息技术有限公司 Fresh food delivery prompting method and device capable of monitoring freshness
KR20180112136A (en) * 2017-03-30 2018-10-12 주식회사 원더풀플랫폼 Method for analyzing freshness of food and system using the same
CN108520593B (en) * 2018-03-23 2021-03-16 合肥美的智能科技有限公司 Unmanned vending machine

Also Published As

Publication number Publication date
CN109636268A (en) 2019-04-16

Similar Documents

Publication Publication Date Title
CN109886130B (en) Target object determination method and device, storage medium and processor
US20190012531A1 (en) Movement monitoring system
JP5422018B2 (en) Image processing method and image processing apparatus
CN109886999B (en) Position determination method, device, storage medium and processor
US20190012794A1 (en) Movement monitoring system
CN109636268B (en) Goods monitoring system, method and device, electronic equipment and storage equipment
CN108537166B (en) Method and device for determining shelf browsing amount and analyzing browsing amount
Moonrinta et al. Fruit detection, tracking, and 3D reconstruction for crop mapping and yield estimation
Nguyen et al. Apple detection algorithm for robotic harvesting using a RGB-D camera
Kejriwal et al. Product counting using images with application to robot-based retail stock assessment
CN109886555A (en) The monitoring method and device of food safety
US11450148B2 (en) Movement monitoring system
EP2790140A1 (en) Queue analysis
CN109086696B (en) Abnormal behavior detection method and device, electronic equipment and storage medium
CN110969047A (en) Method and device for identifying food materials and refrigerator
JP6191248B2 (en) Information processing apparatus and information processing program
CN116720899B (en) Super-intelligent business monitoring management method, device, electronic equipment and medium
CN112184751A (en) Object identification method and system and electronic equipment
CN112419432A (en) Method and device for controlling food in refrigerator, electronic equipment and storage medium
CN112380971A (en) Behavior detection method, device and equipment
Chaivivatrakul et al. Towards Automated Crop Yield Estimation-Detection and 3D Reconstruction of Pineapples in Video Sequences.
US11682215B1 (en) Real-time consumer goods monitoring
CN110762943B (en) Article display method and device and household appliance
JP7428609B2 (en) Cooking area estimation device
CN111860326B (en) Building site article movement detection method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant