CN111476061B - Counting processing method, device and system in commodity production and electronic equipment - Google Patents

Counting processing method, device and system in commodity production and electronic equipment Download PDF

Info

Publication number
CN111476061B
CN111476061B CN201910064624.2A CN201910064624A CN111476061B CN 111476061 B CN111476061 B CN 111476061B CN 201910064624 A CN201910064624 A CN 201910064624A CN 111476061 B CN111476061 B CN 111476061B
Authority
CN
China
Prior art keywords
commodity
production
counting
key frame
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910064624.2A
Other languages
Chinese (zh)
Other versions
CN111476061A (en
Inventor
姚高林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201910064624.2A priority Critical patent/CN111476061B/en
Publication of CN111476061A publication Critical patent/CN111476061A/en
Application granted granted Critical
Publication of CN111476061B publication Critical patent/CN111476061B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/41Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04Manufacturing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/40Scenes; Scene-specific elements in video content
    • G06V20/46Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30242Counting objects in image
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Economics (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Human Resources & Organizations (AREA)
  • General Health & Medical Sciences (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Manufacturing & Machinery (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the invention provides a counting processing method, a counting processing device, a counting processing system and electronic equipment in commodity production, wherein the method comprises the following steps: acquiring a video of the commodity in the post-production treatment process, wherein the post-production treatment process comprises a procedure corresponding to the commodity entering a post-production stage; detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed; and counting the commodities based on the detected characteristic image information. According to the scheme provided by the embodiment of the invention, the production count of a subsequent link of the production in a factory can be optimized in a non-invasive mode, and the production count efficiency is improved.

Description

Counting processing method, device and system in commodity production and electronic equipment
Technical Field
The present disclosure relates to the field of manufacturing technologies, and in particular, to a method, an apparatus, a system, and an electronic device for counting in commodity production.
Background
The development of production counts has evolved with technological advances, and traditional garment production counts have undergone mainly the following stages: a manual calculation stage, a paper phenanthrene stage, a bar code phenanthrene counting stage and an electronic phenanthrene counting stage.
The electronic phenanthrene counting is the most popular production counting mode, the information of each phenanthrene ticket is stored in the RFID electronic tag by means of radio frequency identification (Radio Frequency Identification, RFID) technology, and workers directly send the information of the number of products, the processing content (working procedure) and the like to a computer through an acquisition terminal according to the working procedure of the workers, so that the phenanthrene counting work is completed. The production counting mode is high in instantaneity, safe and stable, and the data acquisition problem of software is solved. However, the scheme needs to train workers correspondingly and change the operation habit of the workers, so that certain invasiveness exists in the process of counting production in the subsequent links of production.
Disclosure of Invention
The invention provides a counting processing method, a counting processing device, a counting processing system and electronic equipment in commodity production, which optimize the production counting of a factory in a production later link in a non-invasive mode and improve the production counting efficiency.
In order to achieve the above purpose, the embodiment of the present invention adopts the following technical scheme:
in a first aspect, a method for counting in commodity production is provided, including:
acquiring a video of the commodity in the post-production treatment process, wherein the post-production treatment process comprises a procedure corresponding to the commodity entering a post-production stage;
detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed;
and counting the commodities based on the detected characteristic image information.
In a second aspect, there is provided another counting method in commodity production, comprising:
acquiring video in the commodity production process;
analyzing the video to determine a target image corresponding to the completion of the production of the commodity;
based on the processing of the target image, the number of produced commodities is determined to realize counting in commodity production.
In a third aspect, there is provided a count processing apparatus in commodity production, comprising:
the video acquisition module is used for acquiring videos of the commodities in the post-production treatment process, wherein the post-production treatment process comprises a working procedure corresponding to the commodity entering a post-production stage;
the characteristic image detection module is used for detecting characteristic image information from the video, and the characteristic image information is used for marking that a single commodity is processed;
and the commodity counting processing module is used for counting commodities based on the detected characteristic image information.
In a fourth aspect, there is provided another count processing apparatus in commodity production, comprising:
the video data acquisition module is used for acquiring videos in the commodity production process;
the video data analysis module is used for analyzing the video and determining a target image corresponding to the completion of the production of the commodity;
and the commodity number determining module is used for determining the number of the produced commodities based on the processing of the target image so as to realize counting in commodity production.
In a fifth aspect, there is provided a count processing system in commodity production, comprising: the video acquisition device is arranged in the commodity production factory, and the server is in communication connection with the video acquisition device;
the server is used for acquiring videos in the commodity production process through the video acquisition device; and analyzing the video, determining an image corresponding to the completion of commodity production, and determining the number of the produced commodities based on the processing of the image so as to realize counting in commodity production.
In a sixth aspect, there is provided an electronic device comprising:
a memory for storing a program;
and the processor is coupled to the memory and is used for executing the program, and the program executes the counting processing method in commodity production.
The invention provides a counting processing method, a counting processing device and electronic equipment in commodity production, wherein video of a commodity in the post-production lane processing process is acquired; detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed; and counting the commodities based on the detected characteristic image information, so that automatic production counting of the commodities is realized. In the scheme, no staff is required to carry out additional production counting operation, the post-processing link of production is not required to be improved, the production counting of the post-processing link of production is optimized in a non-invasive mode, and the production counting efficiency is improved.
The foregoing description is only an overview of the technical solutions of the present application, and may be implemented according to the content of the specification in order to make the technical means of the present application more clearly understood, and in order to make the above-mentioned and other objects, features and advantages of the present application more clearly understood, the following detailed description of the present application will be given.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to designate like parts throughout the figures. In the drawings:
FIG. 1 is a schematic diagram of a counting processing system in commodity production according to an embodiment of the present invention;
FIG. 2 is a flowchart showing a counting process in commodity production according to an embodiment of the present invention;
FIG. 3 is a flow chart of a counting process in commodity production according to the second embodiment of the present invention;
FIG. 4 is a flowchart of a counting process in commodity production according to an embodiment of the present invention;
FIG. 5 is a diagram showing a first configuration of a counting and processing device in commodity production according to an embodiment of the present invention;
FIG. 6 is a diagram showing a structure of a counting and processing device in commodity production according to the embodiment of the present invention;
FIG. 7 is a flowchart of a counting process in commodity production according to an embodiment of the present invention;
FIG. 8 is a flowchart of a counting process in commodity production according to an embodiment of the present invention;
FIG. 9 is a flowchart of a counting process in commodity production according to an embodiment of the present invention;
FIG. 10 is a diagram showing a third configuration of a counting and processing device in commodity production according to the present invention;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The embodiment of the invention improves the defects that the prior production counting in the commodity production process, particularly in the post-processing (packaging and quality inspection) link of commodity production, staff are required to be additionally trained in advance and the operation habit of the staff is adjusted, so that the invasion to the production link is caused.
As shown in fig. 1, a schematic diagram of a counting processing system in commodity production according to the present embodiment is shown, where the processing system includes:
a video capture device 110 disposed in the commodity production facility, and a server 120 communicatively connected to the video capture device 110; a server 120 for acquiring video in the commodity production process through the video acquisition device 110; and analyzing the video, determining an image corresponding to the completion of commodity production, and determining the number of the produced commodities based on the processing of the image so as to realize counting in commodity production.
The video capturing device 110 may be multiple, and is respectively disposed directly above each operation station for processing the commodity, so as to record the video of the employee in the process of performing the production process (such as the commodity packaging and the quality inspection) on the commodity. The video capturing device 110 transmits the captured video to the server 120 through the internet of things. The server 120 performs detection and analysis on the video, and determines image information corresponding to the completion of the production of the commodity.
Wherein, the image information for marking the completion of the single commodity can be a specific action of staff. For example, in the quality inspection process of clothes, after staff confirms that the clothes have no quality problem, the clothes are intensively placed in the storage basket, and at the moment, the action of placing the clothes in the basket by the staff can be used as image information for marking that the quality inspection of single clothes is finished. Because staff put into the in-process of basket with the clothes, the health can be transferred to near the basket by a wide margin from operating the station, the regional image of staff's limbs that can appear in the video image this moment near the basket, and this kind of image of staff's limb action can be as the image information that marks that single clothes is inspected.
Based on the detected image information of the processed single commodity, the number of completed commodities can be counted.
Further, in order to facilitate the automatic production counting of the commodities, the completion period of the single commodity can be determined according to the detected image information for marking the processed completion of the single commodity; and then acquiring key frame images containing the commodities from videos corresponding to the finishing period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images. For example, one key frame image including the commodity may be acquired in the video corresponding to each completion period, and then the number of key frame images acquired last is taken as the count value of the commodity.
Further, when the production count is performed on the commodities, the commodities can be classified, and the commodities corresponding to different orders are respectively counted. For example, the key frame images of the same order commodity are piled based on the similarity between the key frame images, so that the key frame image corresponding to the order commodity is obtained; and then counting the corresponding order commodities according to the number of the key frame images correspondingly contained in each order commodity.
When the key frame images are piled according to different orders of commodities, the colors contained in the key frame images can be acquired first, and a color histogram is constructed according to the duty ratio of the colors in the key frame images; and then, stacking the key frame images according to the similarity of the color histograms corresponding to the key frame images to obtain the key frame images of the commodity belonging to the same order.
The technical solution of the present application is further described below by a plurality of embodiments.
Example 1
Fig. 2 is a flowchart of a counting processing method in commodity production according to an embodiment of the present invention, and the method can be applied to the counting processing system in commodity production shown in fig. 1. As shown in fig. 2, the counting processing method in commodity production comprises the following steps:
s210, acquiring videos of commodities in a post-production lane treatment process, wherein the post-production lane treatment process comprises a process corresponding to the commodity entering a post-production stage.
For example, in a commodity production factory, particularly in a post-processing link, a video acquisition device may be disposed directly above an operation station for each commodity production, so as to record video of a process of performing post-processing (such as commodity packaging and quality inspection) on the commodity by an employee through the video acquisition device. The video acquisition device can transmit the acquired video to a background server through the Internet of things for subsequent processing.
S220, detecting characteristic image information from the video, wherein the characteristic image information is used for marking that the single commodity is processed.
The server performs detection and analysis on the video, and detects characteristic image information for marking the processed single commodity.
Wherein, the image information for marking the completion of the single commodity can be a specific action of staff. For example, in the quality inspection process of clothes, after staff confirms that the clothes have no quality problem, the clothes are intensively placed in the storage basket, and at the moment, the action of placing the clothes in the basket by the staff can be used as image information for marking that the quality inspection of single clothes is finished. Because staff put into the in-process of basket with the clothes, the health can be transferred to near the basket by a wide margin from operating the station, the regional image of staff's limbs that can appear in the video image this moment near the basket, and this kind of image of staff's limb action can be as the image information that marks that single clothes is inspected.
And S230, counting the commodities based on the detected characteristic image information.
The server can count the number of finished products according to the detected image information of the finished products. For example, when a plurality of continuous pieces of image information which can be used as mark for finishing quality inspection of single clothes are detected, the count value is increased by 1; after a plurality of image frames are separated, detecting a plurality of continuous image information which can be used for marking the finished quality of the single clothes from the video again, and adding 1 to the count value; and so on, thereby realizing the production counting of the commodity.
According to the counting processing method in commodity production, videos of commodities in the post-production lane processing process are acquired; detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed; and counting the commodities based on the detected characteristic image information, so that automatic production counting of the commodities is realized. In the scheme, no staff is required to carry out additional production counting operation, the post-processing link of production is not required to be improved, the production counting of the post-processing link of production is optimized in a non-invasive mode, and the production counting efficiency is improved.
Example two
As shown in fig. 3, a flow chart of a counting processing method in commodity production according to an embodiment of the present invention is shown, and the embodiment of the present invention is based on the method shown in the first embodiment, and the scheme is refined. As shown in fig. 3, the counting processing method in commodity production comprises the following steps:
s310, acquiring videos of commodities in the production post-treatment process.
S320, detecting characteristic image information from the video, wherein the characteristic image information is used for marking that the single commodity is processed.
S330, determining the completion period of the single commodity according to the detected characteristic image information.
For example, by detecting a plurality of continuous pieces of image information which can be used as marks for finishing quality inspection of a single piece of clothes each time and corresponding to the data stream position in the video, the finishing cycle of the single piece of commodity can be judged, namely, the video stream corresponding to the time from the last time when finishing the finishing of the single piece of commodity is detected to the current time when finishing the finishing of the single piece of commodity is detected corresponds to the finishing cycle of the single piece of commodity.
S340, acquiring key frame images containing the commodities from videos corresponding to the finishing period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images.
The target detection algorithm adopted in the scheme can include, but is not limited to, YOLO (You Only Look Once) and SSD (Single Shot MultiBox Detector) algorithms.
After determining the video stream corresponding to the finishing period of the single commodity, a target detection algorithm can be adopted to acquire the key frame image containing the commodity from the part of video stream. For example, at least one key frame image containing image information of the garment may be acquired from the video stream using a target detection algorithm based on image features of the garment, and then the completion amount of the garment is counted based on the number of key frame images acquired.
Steps S330 to S340 may be used as refinements of step S230.
The embodiment is based on the embodiment shown in fig. 2, and further, the completion period of the single-piece commodity is determined according to the detected characteristic image information; and acquiring key frame images containing the commodities from videos corresponding to the finishing period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images, so that automatic production counting of the commodities is realized, and the production counting efficiency is improved.
Example III
As shown in fig. 4, a flowchart of a counting processing method in commodity production according to an embodiment of the present invention is three, and the scheme of the present invention is refined based on the method shown in the second embodiment. As shown in fig. 4, the counting processing method in the commodity production comprises the following steps:
s410, acquiring videos of commodities in the production post-treatment process.
S420, detecting characteristic image information from the video, wherein the characteristic image information is used for marking that the single commodity is processed.
S430, determining the completion period of the single commodity according to the detected characteristic image information.
S440, acquiring key frame images containing commodities from videos corresponding to the completion period of a single commodity by adopting a target detection algorithm, and gathering the key frame images of the commodity belonging to the same order based on the similarity between the key frame images to obtain the key frame image corresponding to the commodity of the order.
When the production count is performed on the produced commodities, the corresponding commodities may be multiple commodities belonging to different orders or different commodity categories, which requires further production count of the commodities according to the orders.
Therefore, after acquiring the key frame images containing the commodities in the video corresponding to the completion period of the single commodity, the key frame images can be clustered based on the similarity among the key frame images to obtain the key frame images corresponding to the commodities with different orders.
For example, the colors contained in the key frame image may be acquired first, and a color histogram may be constructed according to the duty ratio of the colors in the key frame image. And then, carrying out clustering on the key frame images according to the similarity of the color histograms corresponding to the key frame images to obtain the key frame images of the commodity belonging to the same order.
During the clustering process, a maximum Expectation algorithm (EM) may be used to perform the clustering process on the key frame images.
S450, counting the corresponding order commodities according to the number of the key frame images correspondingly contained in each order commodity.
After obtaining the key frame images of the commodities belonging to different orders, the production count of the commodities of the corresponding orders can be carried out based on the number of the key frame images correspondingly contained in each commodity of the orders.
Steps S440 to S450 may be used as refinements of step S340.
Further, in step S440, the key frame image containing the commodity may be acquired from the video corresponding to the completion period of each single commodity by using the target detection algorithm;
accordingly, in executing step S450, when counting the corresponding order commodities according to the number of the key frame images included in each order commodity, the number of the key frame images may be used as the count value of the corresponding order commodity, so as to facilitate counting the order commodities.
Further, after obtaining the production count value of the commodity based on the method shown in fig. 2 to 4, the following steps may be further performed:
and acquiring an actual count value of the commodity in the process of carrying out post-production lane processing, and correcting the process of counting the commodity based on the detected characteristic image information according to the actual count value.
There may be an error between the product count value result of the commodity obtained based on the above method and the actual commodity count value, so the execution process of step S230 may be modified by using the actual commodity count value, and the algorithm edge of the modification process is used in the subsequent commodity count process, thereby improving the accuracy of the present solution in commodity count.
The embodiment is further based on the embodiment shown in fig. 3, and the key frame images corresponding to the commodity of the order are obtained by gathering the key frame images of the commodity of the same order based on the similarity between the key frame images; and counting the commodities of the corresponding order according to the quantity of the key frame images correspondingly contained in the commodities of each order, thereby realizing production counting of the commodities according to different orders.
Further, the accuracy of the commodity counting in the scheme is improved by acquiring the actual counting value of the commodity in the process of carrying out post-production lane processing and correcting the process of counting the commodity based on the detected characteristic image information according to the actual counting value.
Example IV
As shown in fig. 5, a first structure diagram of a counting and processing device in commodity production according to an embodiment of the present invention is shown, where the counting and processing device in commodity production can control to perform the method steps shown in fig. 2, and includes:
the video acquisition module 510 is configured to acquire a video of a commodity in a post-production lane processing process, where the post-production lane processing process includes a process corresponding to a stage of the commodity entering a post-production stage;
a feature image detection module 520 for detecting feature image information from the video, the feature image information being used to mark that the piece of merchandise is processed;
the commodity count processing module 530 is configured to count commodities based on the detected feature image information.
Further, as shown in fig. 6, in the count processing apparatus in commodity production shown in fig. 5, the commodity count processing module 530 may include:
a completion cycle determining unit 610 for determining a completion cycle of the single article based on the detected feature image information;
the commodity counting processing unit 620 is configured to acquire key frame images including the commodity from the video corresponding to the completion period of the single commodity by using the target detection algorithm, and count the commodity according to the number of the key frame images.
Further, the commodity counting processing unit 620 may be configured to aggregate the keyframe images of the same order commodity based on the similarity between the keyframe images, so as to obtain a keyframe image corresponding to the order commodity; and counting the corresponding order commodities according to the number of the key frame images correspondingly contained in each order commodity.
Further, the commodity count processing unit 620 may be configured to obtain a color included in the key frame image, and construct a color histogram according to a duty ratio of the color in the key frame image; and stacking the key frame images according to the similarity of the color histograms corresponding to the key frame images to obtain the key frame images of the commodity belonging to the same order.
Further, the target detection algorithm is adopted to acquire a key frame image containing the commodity from the video corresponding to the completion period of each single commodity;
accordingly, the commodity count processing unit 620 may be configured to use the number of key frame images as the count value of the commodity of the corresponding order.
Further, the counting and processing device in commodity production may further include:
the commodity counting correction module is used for acquiring an actual counting value of the commodity in the process of carrying out post-production lane processing, and correcting the process of counting the commodity based on the detected characteristic image information according to the actual counting value.
The counting processing device in the production of goods shown in fig. 6 can be used to perform the method steps as shown in fig. 3, 4.
The counting processing device in commodity production provided by the invention obtains the video of the commodity in the post-production lane processing process; detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed; and counting the commodities based on the detected characteristic image information, so that automatic production counting of the commodities is realized. In the scheme, no staff is required to carry out additional production counting operation, the post-processing link of production is not required to be improved, the production counting of the post-processing link of production is optimized in a non-invasive mode, and the production counting efficiency is improved.
Further, determining the completion period of the single commodity according to the detected characteristic image information; and acquiring key frame images containing the commodities from videos corresponding to the finishing period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images, so that automatic production counting of the commodities is realized, and the production counting efficiency is improved.
Further, the key frame images of the same order commodity are piled based on the similarity between the key frame images, so that the key frame image corresponding to the order commodity is obtained; and counting the commodities of the corresponding order according to the quantity of the key frame images correspondingly contained in the commodities of each order, thereby realizing production counting of the commodities according to different orders.
Further, the accuracy of the commodity counting in the scheme is improved by acquiring the actual counting value of the commodity in the process of carrying out post-production lane processing and correcting the process of counting the commodity based on the detected characteristic image information according to the actual counting value.
Example five
Based on the counting processing method in commodity production shown in any one of fig. 2 to 4, as shown in fig. 7, a flowchart of a counting processing method in commodity production according to an embodiment of the present invention is shown, and includes the following steps:
s710, acquiring video in the commodity production process.
The acquired video is not limited to a post-processing link in the commodity production process, but can be expanded to the whole commodity production process. Accordingly, the video capturing device for recording video may be located at any location in the commercial production facility.
S720, analyzing the video to determine a target image corresponding to the completion of the production of the commodity;
the content of the target image may be any relevant image corresponding to the completion of the production of the commodity, for example, may be an image of a specific action of an employee when the commodity is processed (such as packaging and quality inspection of the commodity), or may be an image containing the commodity which is processed correspondingly. From these target images, the information on the number of completed products can be extracted.
S730, determining the number of produced commodities based on the processing of the target image to realize counting in commodity production.
For example, based on counting the number of images including completed goods in the target image, the number of corresponding goods produced can be obtained.
The target image may specifically be a picture determined based on the obtained commodity key frame by analyzing a video. For example, a video may be key frame extracted and a commodity key frame containing a commodity may be obtained therefrom as a target image. To reduce the complexity of the processing, only one commodity key frame corresponding to a single commodity can be extracted for each finished single commodity.
Further, in implementing the determination of the number of produced goods based on the processing of the target image, the method steps as shown in fig. 8 may be performed:
s810, determining target images belonging to the same commodity through similarity processing between the target images.
For example, a color contained in the target image may be acquired, and a color histogram may be constructed according to the duty ratio of the color in the target image; and (3) stacking the target images according to the similarity of the color histograms corresponding to the target images to obtain the target images of the same commodity.
S820, analyzing the target images belonging to the same commodity to obtain the production quantity of the corresponding commodity.
For example, based on counting the number of images including completed products in the target images belonging to the same product, the number of products corresponding to the products can be obtained.
In addition, in realizing the determination of the number of produced goods based on the processing of the target image, the method steps as shown in fig. 9 may also be performed:
s910, determining target commodities with production quantities to be determined.
Before determining the quantity of goods, it is possible to specify which goods need to be determined in terms of production quantity and to record these as target goods.
S920, analyzing each target image to determine each target image belonging to the target commodity.
For example, the object commodity and the commodity image in the object images may be subjected to similarity comparison, so that each object image belonging to the object commodity is determined from all the object images.
S930, obtaining the production quantity of the target commodity based on the determined target images belonging to the target commodity.
After each target image belonging to the target commodity is determined, the number of the produced corresponding target commodity can be obtained by counting the number of the images containing the finished commodity in the target image.
Further, on the basis of the method shown in fig. 8 or fig. 9, an order to which the commodity belongs may be determined, so as to obtain the production quantity of the commodity belonging to the same order. The order is obtained by analyzing commodity images in the video. For example, a commodity image sample contained in a certain order is obtained in advance, and then the sample image is compared with a commodity image in a video, so that the order to which the commodity in the video belongs is determined; or, stacking the commodity images in the video, wherein each category after stacking corresponds to one order.
The counting processing method in commodity production provided by the invention is characterized by acquiring video in the commodity production process; analyzing the video to determine a target image corresponding to the completion of the production of the commodity; based on the processing of the target image, the number of produced goods is determined to realize counting in the production of goods.
Example six
As shown in fig. 10, a third structure diagram of a counting and processing device in commodity production according to an embodiment of the present invention is shown, where the counting and processing device in commodity production can controllably execute the method steps shown in fig. 7, and includes:
a video data acquisition module 101, configured to acquire video in a commodity production process;
the video data analysis module 102 is used for analyzing the video and determining a target image corresponding to the completion of the production of the commodity;
the commodity number determining module 103 is used for determining the number of the produced commodities based on the processing of the target image so as to realize counting in commodity production.
Further, the commodity number determining module 103 may be configured to determine target images belonging to the same commodity by performing similarity processing on each target image; and analyzing the target images belonging to the same commodity to obtain the production quantity of the corresponding commodity.
Alternatively, the commodity quantity determination module 103 may be configured to determine a target commodity of which production quantity is to be determined; analyzing each target image to determine each target image belonging to the target commodity; and obtaining the production quantity of the target commodity based on the determined target images belonging to the target commodity.
Further, the counting processing device in commodity production shown in fig. 10 may further include:
and the commodity order determining module is used for determining an order to which the commodity belongs, wherein the order is obtained by analyzing the commodity image in the video.
The counting processing device in commodity production provided by the invention obtains videos in the commodity production process; analyzing the video to determine a target image corresponding to the completion of the production of the commodity; based on the processing of the target image, the number of produced goods is determined to realize counting in the production of goods.
Example seven
An embodiment of the present invention provides a counting processing system in commodity production, where the counting processing system can control to execute the method steps shown in fig. 2 to 4 and fig. 7 to 9, and the counting processing system includes: video acquisition device in commodity production mill, and with video acquisition device communication connection's server, wherein:
the server is used for acquiring videos in the commodity production process through the video acquisition device; and analyzing the video, determining an image corresponding to the completion of commodity production, and determining the number of the produced commodities based on the processing of the image so as to realize counting in commodity production.
Further, the server may be incorporated with a counting device in commodity production as shown in any one of fig. 5 to 6 and 10.
Example eight
The foregoing embodiment describes the overall architecture of a counting processing device in commodity production, and the functions of the device may be implemented by means of an electronic device, as shown in fig. 11, which is a schematic structural diagram of the electronic device according to the embodiment of the present invention, and specifically includes: a memory 111 and a processor 112.
A memory 111 for storing a program.
In addition to the programs described above, the memory 111 may also be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phonebook data, messages, pictures, videos, and the like.
The memory 111 may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
A processor 112 coupled to the memory 111 for executing a program in the memory 111 that, when run, performs a counting process in the production of goods as shown in any one of fig. 2-4, 7-9.
The specific processing operations described above have been described in detail in the previous embodiments, and are not repeated here.
Further, as shown in fig. 11, the electronic device may further include: communication component 113, power component 114, audio component 115, display 116, and other components. Only some of the components are schematically shown in fig. 11, which does not mean that the electronic device only comprises the components shown in fig. 11.
The communication component 113 is configured to facilitate communication between the electronic device and other devices, either wired or wireless. The electronic device may access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication component 113 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 113 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
A power supply assembly 114 provides power to the various components of the electronic device. The power components 114 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for electronic devices.
The audio component 115 is configured to output and/or input audio signals. For example, the audio component 115 includes a Microphone (MIC) configured to receive external audio signals when the electronic device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 111 or transmitted via the communication component 113. In some embodiments, audio component 115 further comprises a speaker for outputting audio signals.
The display 116 includes a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the method embodiments described above may be performed by hardware associated with program instructions. The foregoing program may be stored in a computer readable storage medium. The program, when executed, performs steps including the method embodiments described above; and the aforementioned storage medium includes: various media that can store program code, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims (18)

1. A count processing method in commodity production, comprising:
acquiring a video of the commodity in the post-production treatment process, wherein the post-production treatment process comprises a procedure corresponding to the commodity entering a post-production stage;
detecting characteristic image information from the video, wherein the characteristic image information is used for marking that a single commodity is processed;
counting the commodities based on the detected characteristic image information;
wherein the counting of the goods based on the detected characteristic image information includes:
determining the completion period of the single commodity according to the detected characteristic image information;
and acquiring key frame images containing the commodities from the video corresponding to the finishing period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images.
2. The method of claim 1, wherein the counting items of merchandise according to the number of key frame images comprises:
stacking the key frame images of the same order commodity based on the similarity between the key frame images to obtain a key frame image corresponding to the order commodity;
and counting the corresponding order commodities according to the quantity of the key frame images correspondingly contained in each order commodity.
3. The method of claim 2, wherein the aggregating the keyframe images of the same order commodity based on the similarity between the keyframe images, to obtain a keyframe image corresponding to the order commodity comprises:
acquiring the colors contained in the key frame image, and constructing a color histogram according to the duty ratio of the colors in the key frame image;
and stacking the key frame images according to the similarity of the color histograms corresponding to the key frame images to obtain the key frame images of the commodity belonging to the same order.
4. A method according to claim 2 or 3, wherein the acquiring a key frame image containing the commodity from the video corresponding to the completion period of each single commodity by using a target detection algorithm is one;
the counting of the corresponding order commodities according to the number of the key frame images correspondingly contained in each order commodity comprises the following steps:
and taking the number of the key frame images as the count value of the commodity of the corresponding order.
5. The method of claim 1, wherein the method further comprises:
and acquiring an actual count value of the commodity in the process of carrying out post-production lane processing, and carrying out correction processing on the process of counting the commodity based on the detected characteristic image information according to the actual count value.
6. A count processing method in commodity production, comprising:
acquiring video in the commodity production process;
analyzing the video to determine a target image corresponding to the completion of the production of the commodity;
determining the number of the produced commodities based on the processing of the target image so as to realize counting in commodity production;
wherein the method further comprises:
determining an order to which the commodity belongs, wherein the order is obtained by analyzing a commodity image in a video.
7. The method of claim 6, wherein determining the quantity of the commodity produced based on the processing of the target image comprises:
determining target images belonging to the same commodity through similarity processing between the target images;
and analyzing the target images belonging to the same commodity to obtain the production quantity of the corresponding commodity.
8. The method of claim 6, wherein determining the quantity of the commodity produced based on the processing of the target image comprises:
determining a target commodity of which the production quantity is to be determined;
analyzing each target image to determine each target image belonging to the target commodity;
and obtaining the production quantity of the target commodity based on the determined target images belonging to the target commodity.
9. A count processing apparatus in commodity production, comprising:
the video acquisition module is used for acquiring videos of the commodities in the post-production treatment process, wherein the post-production treatment process comprises a working procedure corresponding to the commodity entering a post-production stage;
the characteristic image detection module is used for detecting characteristic image information from the video, and the characteristic image information is used for marking that a single commodity is processed;
the commodity counting processing module is used for counting commodities based on the detected characteristic image information;
wherein, commodity count processing module includes:
a completion cycle determining unit configured to determine a completion cycle of the single-piece commodity according to the detected feature image information;
and the commodity counting processing unit is used for acquiring key frame images containing commodities from the video corresponding to the completion period of the single commodity by adopting a target detection algorithm, and counting the commodities according to the number of the key frame images.
10. The apparatus of claim 9, wherein the commodity count processing unit is configured to,
stacking the key frame images of the same order commodity based on the similarity between the key frame images to obtain a key frame image corresponding to the order commodity;
and counting the corresponding order commodities according to the quantity of the key frame images correspondingly contained in each order commodity.
11. The apparatus of claim 10, wherein the commodity count processing unit is configured to,
acquiring the colors contained in the key frame image, and constructing a color histogram according to the duty ratio of the colors in the key frame image;
and stacking the key frame images according to the similarity of the color histograms corresponding to the key frame images to obtain the key frame images of the commodity belonging to the same order.
12. The apparatus according to claim 10 or 11, wherein the acquiring, by using a target detection algorithm, a key frame image containing a commodity from the video corresponding to a completion period of each single commodity is one;
and the commodity counting processing unit is used for taking the number of the key frame images as the counting value of the commodity with the corresponding order.
13. The apparatus of claim 9, wherein the apparatus further comprises:
and the commodity counting correction module is used for acquiring an actual counting value of the commodity in the process of carrying out post-production lane processing, and correcting the process of counting the commodity based on the detected characteristic image information according to the actual counting value.
14. A count processing apparatus in commodity production, comprising:
the video data acquisition module is used for acquiring videos in the commodity production process;
the video data analysis module is used for analyzing the video and determining a target image corresponding to the completion of the production of the commodity;
the commodity number determining module is used for determining the number of the produced commodities based on the processing of the target image so as to realize counting in commodity production;
wherein the apparatus further comprises:
and the commodity order determining module is used for determining an order to which the commodity belongs, wherein the order is obtained by analyzing the commodity image in the video.
15. The apparatus of claim 14, wherein,
the commodity quantity determining module is used for determining target images belonging to the same commodity through similarity processing between the target images; and analyzing the target images belonging to the same commodity to obtain the production quantity of the corresponding commodity.
16. The apparatus of claim 14, wherein,
the commodity quantity determining module is used for determining target commodities with the production quantity to be determined; analyzing each target image to determine each target image belonging to the target commodity; and obtaining the production quantity of the target commodity based on the determined target images belonging to the target commodity.
17. A count processing system in commodity production, comprising: the video acquisition device is arranged in the commodity production factory, and the server is in communication connection with the video acquisition device;
the server is used for acquiring videos in the commodity production process through the video acquisition device; analyzing the video, determining an image corresponding to the completion of commodity production, and determining the number of the produced commodities based on the processing of the image so as to realize counting in commodity production;
the server is further used for determining an order to which the commodity belongs, wherein the order is obtained by analyzing the commodity image in the video.
18. An electronic device, comprising:
a memory for storing a program;
a processor coupled to the memory for executing the program, which program when run performs the count processing method in the production of goods as claimed in any one of claims 1-8.
CN201910064624.2A 2019-01-23 2019-01-23 Counting processing method, device and system in commodity production and electronic equipment Active CN111476061B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910064624.2A CN111476061B (en) 2019-01-23 2019-01-23 Counting processing method, device and system in commodity production and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910064624.2A CN111476061B (en) 2019-01-23 2019-01-23 Counting processing method, device and system in commodity production and electronic equipment

Publications (2)

Publication Number Publication Date
CN111476061A CN111476061A (en) 2020-07-31
CN111476061B true CN111476061B (en) 2023-05-02

Family

ID=71743384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910064624.2A Active CN111476061B (en) 2019-01-23 2019-01-23 Counting processing method, device and system in commodity production and electronic equipment

Country Status (1)

Country Link
CN (1) CN111476061B (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101912899A (en) * 2010-06-21 2010-12-15 中冶京诚工程技术有限公司 Bar counting method and device
CN102016931A (en) * 2008-03-25 2011-04-13 锡克拜控股有限公司 Method and system for controlling production of items
CN102132139A (en) * 2008-08-22 2011-07-20 先锋国际良种公司 Methods for counting corn silks or other plural elongated strands and use of the count for characterizing the strands or their origin
CN102930279A (en) * 2012-09-29 2013-02-13 广西工学院 Image identification method for detecting product quantity
CN103577812A (en) * 2013-11-22 2014-02-12 昆山视杰维光电科技有限公司 Target recognition system and method
CN104156983A (en) * 2014-08-05 2014-11-19 天津大学 Public transport passenger flow statistical method based on video image processing
CN104463898A (en) * 2014-12-31 2015-03-25 南通皋液液压机有限公司 Image identification counting system for logistics platform
CN106919619A (en) * 2015-12-28 2017-07-04 阿里巴巴集团控股有限公司 A kind of commercial articles clustering method, device and electronic equipment
CN107665361A (en) * 2017-09-30 2018-02-06 珠海芯桥科技有限公司 A kind of passenger flow counting method based on recognition of face
CN108428347A (en) * 2018-05-14 2018-08-21 三峡大学 A kind of vehicle count method and system based on more detection zones
CN108596546A (en) * 2018-04-27 2018-09-28 重庆亨厚电子商务有限公司 Commodity management system for e-commerce
CN108780595A (en) * 2016-03-14 2018-11-09 凸版印刷株式会社 Identification device, recognition methods, recognizer and the computer-readable medium comprising recognizer
CN108787486A (en) * 2018-06-05 2018-11-13 四川九哈科技股份有限公司 Cigarette identification method for sorting and its cigarette based on deep learning identify sorting equipment
CN108846449A (en) * 2018-04-25 2018-11-20 阿里巴巴集团控股有限公司 A kind of smart machine, business suspended method, apparatus and equipment

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102016931A (en) * 2008-03-25 2011-04-13 锡克拜控股有限公司 Method and system for controlling production of items
CN102132139A (en) * 2008-08-22 2011-07-20 先锋国际良种公司 Methods for counting corn silks or other plural elongated strands and use of the count for characterizing the strands or their origin
CN101912899A (en) * 2010-06-21 2010-12-15 中冶京诚工程技术有限公司 Bar counting method and device
CN102930279A (en) * 2012-09-29 2013-02-13 广西工学院 Image identification method for detecting product quantity
CN103577812A (en) * 2013-11-22 2014-02-12 昆山视杰维光电科技有限公司 Target recognition system and method
CN104156983A (en) * 2014-08-05 2014-11-19 天津大学 Public transport passenger flow statistical method based on video image processing
CN104463898A (en) * 2014-12-31 2015-03-25 南通皋液液压机有限公司 Image identification counting system for logistics platform
CN106919619A (en) * 2015-12-28 2017-07-04 阿里巴巴集团控股有限公司 A kind of commercial articles clustering method, device and electronic equipment
CN108780595A (en) * 2016-03-14 2018-11-09 凸版印刷株式会社 Identification device, recognition methods, recognizer and the computer-readable medium comprising recognizer
CN107665361A (en) * 2017-09-30 2018-02-06 珠海芯桥科技有限公司 A kind of passenger flow counting method based on recognition of face
CN108846449A (en) * 2018-04-25 2018-11-20 阿里巴巴集团控股有限公司 A kind of smart machine, business suspended method, apparatus and equipment
CN108596546A (en) * 2018-04-27 2018-09-28 重庆亨厚电子商务有限公司 Commodity management system for e-commerce
CN108428347A (en) * 2018-05-14 2018-08-21 三峡大学 A kind of vehicle count method and system based on more detection zones
CN108787486A (en) * 2018-06-05 2018-11-13 四川九哈科技股份有限公司 Cigarette identification method for sorting and its cigarette based on deep learning identify sorting equipment

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
罗三定等.《棒材生产在线视觉计数系统研究》.《小型微型计算机系统》.2004,第第25卷卷(第第4期期),第671-675页. *

Also Published As

Publication number Publication date
CN111476061A (en) 2020-07-31

Similar Documents

Publication Publication Date Title
CN108921645B (en) Commodity purchase judgment method and device and user terminal
US9230190B2 (en) Image recognition to support shelf auditing for consumer research
US20160088262A1 (en) Method For Managing Storage Product In Refrigerator Using Image Recognition, And Refrigerator For Same
US11477415B2 (en) Mechanism for video review at a self-checkout terminal
CN108769731A (en) The method, apparatus and electronic equipment of target video segment in a kind of detection video
CN105448001A (en) Merchandise item registration apparatus
US9947105B2 (en) Information processing apparatus, recording medium, and information processing method
CN112445321A (en) Article processing method and device and electronic equipment
CN115631122A (en) Image optimization method and device for edge image algorithm
US10402777B2 (en) Method and a system for object recognition
CN112115950A (en) Wine label identification method, wine information management method, device, equipment and storage medium
CN111476061B (en) Counting processing method, device and system in commodity production and electronic equipment
CN109785049A (en) A kind of Products Show method, apparatus and terminal device based on data analysis
CN112161984B (en) Wine positioning method, wine information management method, device, equipment and storage medium
CN105403507A (en) Mobile-terminal-based Longjing tea identification and judgment system and method
WO2021057879A1 (en) Data processing system and method, electronic device, and computer readable storage medium
CN108012164B (en) Video playing method and device and electronic equipment
CN111008842B (en) Tea detection method, system, electronic equipment and machine-readable medium
CN111435276A (en) Image processing method and device and electronic equipment
CN112770080B (en) Meter reading method, meter reading device and electronic equipment
CN210605753U (en) System for recognizing cigarette brand display condition of retail merchant
CN112218155A (en) Automatic detection method and device for switching time consumption and electronic equipment
CN113141433A (en) Method and device for testing screen sensitivity and processor
WO2020164401A1 (en) Method for counting items of clothing, counting method and apparatus, and electronic device
CN110956422A (en) Commodity warehousing management method, device and system and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40034081

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant