CN113297887A - Weighing method, device and system - Google Patents

Weighing method, device and system Download PDF

Info

Publication number
CN113297887A
CN113297887A CN202010969888.5A CN202010969888A CN113297887A CN 113297887 A CN113297887 A CN 113297887A CN 202010969888 A CN202010969888 A CN 202010969888A CN 113297887 A CN113297887 A CN 113297887A
Authority
CN
China
Prior art keywords
information
article
weighing
item
identification result
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010969888.5A
Other languages
Chinese (zh)
Inventor
佘静
李嘉
张远
沈健
王树春
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hema China Co Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN202010969888.5A priority Critical patent/CN113297887A/en
Publication of CN113297887A publication Critical patent/CN113297887A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/40Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight
    • G01G19/413Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means
    • G01G19/414Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only
    • G01G19/4144Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01GWEIGHING
    • G01G19/00Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups
    • G01G19/40Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight
    • G01G19/413Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means
    • G01G19/414Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only
    • G01G19/415Weighing apparatus or methods adapted for special purposes not provided for in the preceding groups with provisions for indicating, recording, or computing price or other quantities dependent on the weight using electromechanical or electronic computing means using electronic computing means only combined with recording means
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24147Distances to closest patterns, e.g. nearest neighbour classification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/044Recurrent networks, e.g. Hopfield networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/049Temporal neural networks, e.g. delay elements, oscillating neurons or pulsed inputs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/68Food, e.g. fruit or vegetables

Abstract

The embodiment of the application provides a weighing method, and relates to the technical field of computers. The method comprises the following steps: acquiring article image information of an article; the article is placed on a weighing platform; and according to the item image information, displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface. The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation.

Description

Weighing method, device and system
Technical Field
The present application relates to the field of computer technologies, and in particular, to a weighing method and apparatus.
Background
With the increasingly diversified life forms, the shopping forms of people are greatly changed, for users, more and more occasions such as supermarkets, convenience stores and the like which are convenient to shop online are provided, and more kinds of commodities are provided by the supermarkets, the convenience stores and the like. In the market, goods such as supermarkets and convenience stores are increasingly used for weighing and then paying out goods such as fruits, meat and vegetables.
At present, for the above-mentioned articles needing weighing and payment, a buyer loads the corresponding articles in an article stall in the purchase process, then selects the articles manually to weigh and pay at a weighing platform, for example, manually uses a bar code scale, after the articles are placed on the bar code scale, manually selects a key corresponding to the article to be weighed on the bar code scale, then manually clicks the key to weigh and pay, and then the buyer receives the payment from the bank platform.
However, in the current scheme, since manual intervention is required to select the articles for weighing, the labor cost is high, and in addition, since the articles to be weighed need to be manually selected from a large number of commodity objects, the user needs to be familiar with the keys corresponding to the articles to be weighed, the memory cost is high, the manual selection operation efficiency is low, and the waiting time of buyers is long.
Disclosure of Invention
The embodiment of the application provides a weighing method, so that the labor cost during weighing is reduced, the weighing efficiency is improved, and the waiting time of buyers is reduced.
Correspondingly, the embodiment of the application also provides a weighing device, a weighing system, electronic equipment and a storage medium, which are used for ensuring the realization and application of the method.
In order to solve the above problem, an embodiment of the present application discloses a weighing method, including:
acquiring article image information of an article; the article is placed on a weighing platform;
and according to the item image information, displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
The embodiment of the application also discloses a weighing method, which comprises the following steps:
the weighing equipment terminal acquires article image information of an article and sends the article image information to a server terminal; the article is placed on a weighing platform corresponding to the weighing equipment end;
the server side determines identification result information of the article according to the article image information, determines recommendation information of the article according to the identification result information, and sends the identification result information and the recommendation information to the weighing equipment side;
and the weighing equipment end displays the identification result information of the article in a first area of a display interface, and displays the recommendation information of the article in a second area of the display interface.
The embodiment of the application also discloses a weighing method, which is applied to a weighing equipment end, and the method comprises the following steps:
acquiring article image information of an article and sending the article image information to a server; the article is placed on a weighing platform corresponding to the weighing equipment end;
receiving identification result information and the recommendation information sent by a server; the identification result information and the recommendation information are determined according to the article image information;
displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
The embodiment of the application also discloses a weighing method, which is applied to a server side and comprises the following steps:
receiving article image information sent by a weighing device end;
according to the article image information, determining identification result information of the article and recommendation information of the article according to the identification result information, and sending the identification result information and the recommendation information to the weighing equipment end, so that the weighing equipment end can display the identification result information of the article in a first area of a display interface and display the recommendation information of the article in a second area of the display interface.
The embodiment of the application also discloses a weighing method, which comprises the following steps:
acquiring article image information of an article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
and according to the article image information, displaying the identification result information of the article in a first area of a display interface, and displaying the article image information in a third area of the display interface.
The embodiment of the application also discloses a weighing device, the device includes:
the image information acquisition module is used for acquiring article image information of an article; the article is placed on a weighing platform;
the first display module is used for displaying the identification result information of the article in a first area of a display interface according to the article image information and displaying the recommendation information of the article in a second area of the display interface.
The embodiment of the application also discloses a weighing system, which comprises a weighing equipment end and a server end; the weighing equipment end is correspondingly provided with at least one weighing platform;
the weighing apparatus end includes:
the image information acquisition module is used for acquiring article image information of an article and sending the article image information to the server; the article is placed on a weighing platform corresponding to the weighing equipment end;
the first display module is used for displaying the identification result information of the article in a first area of a display interface and displaying the recommendation information of the article in a second area of the display interface;
the server side comprises:
and the information determining module is used for determining the identification result information of the article according to the article image information, determining the recommendation information of the article according to the identification result information, and sending the identification result information and the recommendation information to the weighing equipment terminal.
The embodiment of the application also discloses a weighing device is applied to the weighing-appliance end, the device includes:
the image information acquisition module is used for acquiring article image information of an article and sending the article image information to the server; the article is placed on a weighing platform corresponding to the weighing equipment end;
the information receiving module is used for receiving the identification result information and the recommendation information sent by the server; the identification result information and the recommendation information are determined according to the article image information;
the first display module is used for displaying the identification result information of the article in a first area of a display interface and displaying the recommendation information of the article in a second area of the display interface.
The embodiment of the application also discloses a weighing device, is applied to the server side, the device includes:
the image receiving module is used for receiving the article image information sent by the weighing equipment end;
the information determining module is used for determining identification result information of the article according to the article image information, determining recommendation information of the article according to the identification result information, sending the identification result information and the recommendation information to the weighing equipment end, enabling the weighing equipment end to display the identification result information of the article in a first area of a display interface, and displaying the recommendation information of the article in a second area of the display interface.
The embodiment of the application also discloses a weighing device, the device includes:
the preview image acquisition module is used for acquiring article image information of an article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
and the third display module is used for displaying the identification result information of the article in a first area of a display interface according to the article image information and displaying the article image information in a third area of the display interface.
The embodiment of the application also discloses an electronic device, which comprises: a processor; and a memory having executable code stored thereon that, when executed, causes the processor to perform a method as described in one or more of the embodiments of the application.
Embodiments of the present application also disclose one or more machine-readable media having executable code stored thereon that, when executed, cause a processor to perform a method as described in one or more of the embodiments of the present application.
Compared with the prior art, the embodiment of the application has the following advantages:
the weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched. For another example, a real-time preview picture of the camera can be displayed in a third area of the display interface, so that a user can conveniently and accurately place articles on the weighing platform.
Drawings
FIG. 1 is an architectural view of a weighing system according to an embodiment of the present application;
FIG. 2 is a schematic view of a weighing apparatus end of an embodiment of the present application;
FIG. 3 is an example of a display interface according to an embodiment of the present application;
FIG. 4 is an example of another display interface according to an embodiment of the present application;
FIG. 5 is an example of another display interface according to an embodiment of the present application;
FIG. 6 is a flow chart of the steps of a weighing method of the present application;
FIG. 7 is an illustration of another example management interface according to an embodiment of the present application;
FIG. 8 is an example of a material capture task interface according to an embodiment of the present application;
fig. 9 is an example of a material shooting interface according to an embodiment of the present application;
fig. 10 is another example of a material shooting interface according to the embodiment of the present application;
fig. 11 is another example of a material shooting interface according to the embodiment of the present application;
FIG. 12 is a schematic view of an alternative weighing apparatus end configuration of an embodiment of the present application;
fig. 13 is another example of a material shooting interface according to the embodiment of the present application;
FIG. 14 is a flowchart illustrating the steps of a weighing method described in the embodiments of the present application from a system level;
FIG. 15 is a flow chart illustrating the steps of a weighing method described in embodiments of the present application from the end of the weighing apparatus;
FIG. 16 is a flowchart illustrating the steps of a weighing method described in embodiments of the present application from the server side;
FIG. 17 is a block diagram of a weighing apparatus according to an embodiment of the present application;
FIG. 18 is a block diagram of a weighing system embodiment of the present application;
FIG. 19 is a block diagram of an embodiment of a weighing apparatus at an end of a weighing device in accordance with an embodiment of the present application;
FIG. 20 is a block diagram of an embodiment of a weighing apparatus on the server side of an embodiment of the present application;
FIG. 21 is a block diagram of another weighing apparatus embodiment of the present application;
fig. 22 is a schematic structural diagram of an apparatus according to an embodiment of the present application.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, the present application is described in further detail with reference to the accompanying drawings and the detailed description.
Referring to fig. 1 and 2, there are shown diagrams of the construction of a weighing system according to an embodiment of the present application.
Therein, a multiple-site weighing apparatus side 100, and a service side 120 are shown in FIG. 1. Such as the weighing apparatus end 100 of supermarket a, the weighing apparatus end 100 of convenience store B. The weighing apparatus side 100 may be connected with the service side 120 in a wired or wireless manner.
As fig. 2 shows an example of a weighing apparatus terminal 100, the weighing apparatus terminal 100 includes: a display screen 101, a weighing platform 102, an image pickup device 103, and a label printing device 104.
It should be noted that, in practical applications, the display screen 101, the weighing platform 102, and the image capturing apparatus 103 may be integrated apparatuses, and then the integrated apparatuses are connected to the label printing apparatus 104 by wire or wirelessly. In addition, the display screen 101, the weighing platform 102, the image pickup device 103 and the label printing device 104 may be integrated devices, and one device integrates multiple functions of displaying, weighing, image pickup, label printing and the like. The photographing direction of the image pickup apparatus 103 faces the top surface of the weighing table. In practical application, the shooting direction of the camera device can be perpendicular to the table top of the weighing table, wherein the perpendicular can be understood as the included angle between the shooting direction and the table top is in a degree range of [90-x, 90+ x ], and x is a preset degree error.
Of course, the weighing device end may further include a processor, a memory, and other components, and the data connection mode between the processor, the memory, the display screen, the weighing platform, and the image capturing device is not limited in this embodiment of the application.
It should be noted that the wired connection may be connected by a USB (Universal Serial Bus) interface, or may be connected by other data interfaces. The wireless connection can be connected in a manner of bluetooth, WiFi (wireless local area network) and the like. The embodiments of the present application are not limited thereto.
It should be noted that, in practical applications, there may be several weighing scales, such as a barcode scale, an intelligent scale with relatively small computing power, and an intelligent scale with relatively large computing power, where a smaller computing power may be understood as a hardware performance smaller than or equal to a preset performance threshold, and a larger computing power may be understood as a hardware performance larger than a preset performance threshold. In practical application, the bar code scale is provided with a smaller screen, an input panel and a weighing platform; the intelligent scale is provided with a touch screen and a weighing platform, and shooting equipment does not exist in the scales.
Of course, the weighing device end may further include an indicator light and/or a speaker, and corresponding indicator light prompt or voice prompt is performed for different operations.
Then, to the bar code scale, this application embodiment can additionally set up an independent weighing-appliance end and independent camera equipment, and this independent weighing-appliance end includes the terminal equipment of taking the display screen, for example intelligent terminal such as panel computer, cell-phone, and this independent camera equipment is placed in this bar code scale, shoots the platform of weighing of bar code scale. The data interface of the bar code scale is connected with the weighing equipment end to transmit weighing information to the weighing equipment end, and the camera equipment is connected with the weighing equipment end. Of course, for this
And to this intelligent balance, this intelligent balance that computing power is great can directly regard as weighing-appliance end, and this application embodiment only needs additionally to set up an independent camera equipment, and this camera equipment shoots the platform of weighing of calculating intelligent balance, and this camera equipment and this weighing-appliance are wired or wireless connection. The weighing equipment end is connected with the server end. In an embodiment of the present application, a preset plug-in may be installed in the smart scale, and the plug-in is used for executing the steps of the method of the embodiment of the present application.
In the embodiment of the present application, a user who purchases an item may place the item on the weighing platform 102, and the processor of the weighing apparatus 100 may obtain the weighing information weighed by the weighing platform 102. The image pickup device 103 may capture the article image information of the article, and the processor of the weighing device end 100 may acquire the article image information captured by the image pickup device 103. Then, the weighing apparatus terminal 100 may send the article image information to the server terminal 120, the server terminal 120 identifies the article image information, and the server terminal 120 returns the identification result information to the weighing apparatus terminal 100. It should be noted that the identification result information may include article information after successful identification or an identification failure notification message after failed identification.
The server 120 may also generate recommendation information according to the identification result information, and then return to the weighing device, for example, the user purchases tomatoes, and recommends eggs for the user according to the habit of the user purchasing or according to the recipe collocation probability.
After receiving the identification result information and the recommendation information, the weighing device 100 displays the identification result information and the recommendation information in the display screen 101 in a partitioned manner.
Referring to fig. 3, fig. 3 shows an example of a display interface a10 displayed on a display screen. Fig. 3 includes three regions, a first region a12 being a recognition result display region, a second region a13 being a recommendation information display region, and a third region a11 being a display region of a live preview screen captured by the image capturing apparatus. As in fig. 3, a live view taken by the image pickup apparatus is displayed in the third area a11, the live view taken by the image pickup apparatus 103 includes the weighing table 102, and the apples are placed on the weighing table 103. Then, the processor at the weighing device end acquires the image information of the article according to the real-time image, and then sends the image information of the article to the server end 120, and the server end 120 identifies the image information of the article to identify 3 pieces of identification result information, where the 3 pieces of identification result information are respectively the red fuji apple, the snake fruit, and the gala fruit, as can be seen from fig. 3, the identified specific article information may include an article icon, an article name, and a unit price. As shown in FIG. 3, the unit price of red Fuji apple is 10 yuan/500 g, the unit price of snake fruit is 20 yuan/500 g, and the unit price of Gala fruit is 5 yuan/500 g. After obtaining the recognition result, the server may further analyze the relevant recommendation information, for example, the recommendation information banana is given in fig. 3, and the unit price is 5 yuan/500 g.
As shown in fig. 3, after the server 120 sends the identification result information and the recommendation information to the weighing apparatus terminal 100, the weighing apparatus terminal displays the 3 pieces of identification result information in the first area a11 and displays the recommendation information in the second area a 13.
It should be noted that, since the weighing device can obtain the weight information of the articles on the weighing platform 102, when displaying the identification result information, the total price can be calculated for each identification result, and then the weight information and the total price are displayed at the corresponding position of the identification result. For example, in fig. 3, if the weight of the article is 1000 g, the weight information "weight: 1000 grams "and total information" total: 20 yuan, weight information' weight: 1000 grams "and total information" total: 40 yuan, and weight information' weight: 1000 grams "and total information" total: 10 yuan.
As shown in fig. 3, the weighing device terminal 100 may also display recommendation information "banana: 5/500 g ".
It should be noted that, in the embodiment of the present application, the display interface 100 may simultaneously display the first area a12, the second area a13, and the third area a11, as shown in fig. 3.
This kind of mode of figure 3 can show real-time commodity state and recognition result in the linkage of same page, and convenience of customers observes the state of placing commodity and does the contrast with recognition result information to, can also recommend relevant article or other information for the user according to this recognition result information, can realize the accurate recommendation of article, can do accurate recommendation scheme at weighing-appliance end, improve user's purchase rate, can increase the sales volume of product on the whole.
The display interface 100 may also display a first area a12 and a second area a13 of the three areas, for example, fig. 4, which may display only the recognition result display area a12 and the recommendation result display area a 13.
The scheme in fig. 4 can recommend related articles or other information to the user according to the identification result information, so that accurate recommendation of the articles can be realized, an accurate recommendation scheme can be made at the weighing equipment end, the purchase rate of the user is improved, and the sales volume of the product can be increased as a whole.
The display interface 100 may also display the first area a12 and the third area a11 of the three areas, as shown in fig. 5, and may have only the display area a11 of the live view of the image pickup apparatus and the recognition result display area a 12.
The scheme of fig. 5 can display the real-time commodity state and the identification result on the same page in a linkage manner, so that a user can conveniently observe the state of the placed commodity and compare the state with the identification result information
In the embodiment of the present application, an article identification model may be provided in advance at the server, and the article identification model may be a machine learning model. The machine learning model may include a language model, a domain vector space model, a classification model based on a K-means clustering algorithm (K-means) or a K-nearest neighbor algorithm (K-nn), and the like.
The machine learning model can be understood as a mathematical model, the mathematical model is a scientific or engineering model constructed by using a mathematical logic method and a mathematical language, the mathematical model is a mathematical structure which is generally or approximately expressed by adopting the mathematical language aiming at the characteristic or quantity dependency relationship of a certain object system, and the mathematical structure is a pure relation structure of a certain system which is described by means of mathematical symbols. The mathematical model may be one or a set of algebraic, differential, integral or statistical equations, and combinations thereof, by which the interrelationships or causal relationships between the variables of the system are described quantitatively or qualitatively. In addition to mathematical models described by equations, there are also models described by other mathematical tools, such as algebra, geometry, topology, mathematical logic, etc. Where the mathematical model describes the behavior and characteristics of the system rather than the actual structure of the system. The simulator comprises a simulator, a decision tree, a random forest, an eXtreme Gradient boost (xgboost), a Light Gradient boost Machine (Light Gradient boost Machine), a k-means classification or a k-nn classification, and the like, wherein the simulator adopts a Machine learning method, a deep learning method and the like to train a model, the Machine learning method can comprise linear regression, a decision tree, the random forest, the eXtreme Gradient boost (xgboost), the Light Gradient boost Machine (Light Gradient boost Machine), the k-means classification or the k-nn classification, and the deep learning method can comprise a Convolutional Neural Network (CNN), a Long Short-Term Memory network (Long Short-Term Memory, LSTM), a Gated cycle Unit (Gated Current Unit, GRU) and the like.
In the embodiment of the application, sample article image information of various articles can be obtained in advance, the article identification model is trained by using the sample article image information, and after the training is finished, the article image information sent by the weighing client side can be identified. It should be noted that, the embodiment of the present application is not limited to this specific model training method.
Of course, in the subsequent use process, the article identification model may be continuously corrected based on the newly acquired sample article image information of the article, and the specific correction process is not limited in the embodiment of the present application.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched. For another example, a real-time preview picture of the camera can be displayed in a third area of the display interface, so that a user can conveniently and accurately place articles on the weighing platform.
Referring to fig. 6, which shows a flowchart of a weighing method provided in an embodiment of the present application, the method may specifically include:
step 201, acquiring article image information of an article; the article is placed on a weighing platform;
in the embodiment of the application, after the buyer places the article on the weighing platform, the image pickup device facing the weighing platform can capture the article image information with the article image, and the target device of the application can acquire the article image information.
It is to be understood that the target device may be the aforementioned weighing device terminal 100.
It should be noted that, in the embodiment of the present application, only a weighing stage for weighing and an image pickup apparatus for photographing the weighing stage may also be provided. Then wireless modules are arranged in the weighing platform and the shooting equipment, and bar codes are arranged on the surfaces of the weighing platform and the shooting equipment, which are not cameras. Then, the mobile terminal of the user is used as a weighing equipment end, after the weighing application is installed in the mobile terminal, the weighing application is opened to scan the bar code, and the mobile terminal calls a wireless module of the mobile terminal to establish communication connection with the wireless module of the weighing platform and the wireless module of the shooting equipment according to the bar code. Then, the mobile terminal can acquire the image information of the article shot by the shooting device and the weight information weighed by the weighing device.
Step 202, according to the item image information, displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
In the embodiment of the application, an SDK (Software Development Kit) can be provided at the cloud server, and the weighing device can call the SDK to obtain corresponding recognition result information and corresponding recommendation information according to the article image information.
After obtaining the identification result information, the weighing apparatus may display the identification result information of the item in a first area a12 of the display interface and display the recommendation information of the item in a second area a13 of the display interface as shown in fig. 3 and 4.
Optionally, in an implementation manner, after step 201, the method further includes:
step 203, displaying the article image information in a third area of the display interface; the article image information is a preview picture shot by the camera equipment.
As shown in fig. 3, the preview screen shot by the camera device can be displayed in real time in the third area a11 of fig. 3, so that the real-time status of the article and the recognition result can be displayed in a linkage manner, and the comparison by the user is facilitated.
Optionally, in an implementation manner, after step 203, the method further includes:
step 204, displaying an article placement area mark in the third area; the article placement area mark is used for prompting the position of placing an article on the weighing platform.
In the embodiment of the application, after the camera equipment is installed on the table top of the weighing platform, the placing area of the article can be specified, and after the article is placed in the placing area, the position of the article in the image is within the preset range in the obtained image information of the article, so that only the image within the range can be identified in the subsequent identification process, the data amount of image processing is reduced, and the identification efficiency and accuracy are improved. Of course, when the article image information needs to be transmitted to the server, only the images within the range can be transmitted, so that the data volume of the transmitted images is reduced, the data transmission time is saved, and the identification efficiency can be indirectly improved.
Referring to fig. 3, in the embodiment of the present application, an area label a14 may be provided, and the area label is used to prompt the user to place an item in the area, so as to facilitate item identification. It is understood that the shape of the area mark may be set according to the requirement, such as a rectangle, a circle, an ellipse, and the like, and the embodiment of the present application is not limited thereto.
Optionally, in an implementation manner, after step 202, the method further includes:
step 205, providing an article list display control in the display interface;
and step 206, displaying an item list selection page after receiving a first trigger operation on the item list display control.
In practical application, there may be a case of an identification error, so that the displayed identification result information does not have article information that the article on the weighing platform should actually have, so that the embodiment of the application may provide an article list display control in the display interface, a user triggers the article list display control to quickly return to an article list selection page, and the user may select the article information that the article should actually have on the article list selection page. It is to be understood that the item list selection page may be a selection page of the full amount of item information.
As shown in fig. 3, the item list presentation control is, for example, a "return to full list" control, and when the user triggers the control, the user can return to the full item list selection page. It should be noted that the item list display control may be located at any position of the display interface, and the embodiment of the application is not limited thereto.
It should be noted that the triggering operation of the present application may be in various forms, for example, when the screen is a touch screen, clicking on the touch screen is performed. For example, when the input device is a keyboard or a mouse, the triggering operation may be an input of the keyboard or the mouse. Specific trigger operation form the embodiments of the present application do not limit it.
Optionally, in an implementation manner, after step 201, the method further includes:
step 207, acquiring the weight information of the article weighed by the weighing platform;
in this application embodiment, after placing the article on the mesa of weighing platform, weighing platform can weigh the weight of this article, and then the weight information that obtains of this weighing platform can be sent to the weighing equipment end can obtain the weight information of this article.
In the step 202, displaying the identification result information of the article in the first area of the display interface includes:
substep 2021 of displaying the weight information and the total price of the article at a position corresponding to the identification result information.
In this embodiment of the application, after the weighing platform scale obtains the weight information of the article, the weight information may be sent to the weighing device side, and the weighing device side may calculate the total price of the article based on the unit price information in each piece of identification result information. The weight information and the total price may then be displayed at a position corresponding to the recognition result information. For example, in fig. 3, the weight information is 1000 g, the total price of red fuji apples is 20 yuan, the total price of snake fruits is 40 yuan, and the total price of gala fruits is 10 yuan. And then displaying the weight and the total price thereof at each recognition result information position respectively. Therefore, the user can conveniently and quickly know the total price of the article.
Optionally, in an implementation manner, after step 202, the method further includes:
step 208, in the case that a plurality of pieces of the identification result information are displayed in the second area, receiving a first selection operation on the identification result information;
step 209 of selecting target recognition result information from the plurality of recognition result selection information in accordance with the first selection operation;
and 210, taking the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
In the embodiment of the present application, three cases may exist when the article image information is identified:
the first method comprises the following steps: the case where the accuracy is completely recognized may be such that only one item information is given as the recognition result information.
For this case, the identification result information may be directly used as target identification result information to be paid later.
And the second method comprises the following steps: the exact case, which can give at least 2 possible article information as the identification result information, cannot be completely identified. For example, in fig. 3, 3 items of information are shown for display.
Then, for this case, the user needs to select one from the plurality of pieces of recognition result information as the target recognition result information to be paid subsequently.
Third, no case is identified. This case gives an unrecognized prompt.
Of course, in the third case, or when there is a result of the recognition but the user does not select the article after the preset time, the user may be prompted to put the article again, perform the recognition process again, and after the recognition error reaches the preset number of times, the user is prompted to return to the article list selection page for selection. Certainly, can carry out corresponding operation through speaker voice prompt user when suggestion at every turn, in addition, can also carry out corresponding suggestion operation through the warning light that weighing-appliance served and set up. Where a false or false voice is recognized such as "did not find a matching item? Please reposition ", of course, the text corresponding to the above speech may also be displayed in the first area. And for the condition that matched commodities are not found for many times, the red light can be continuously flashed.
Of course, there is also a case where the user selects one item information as the target recognition result information in the entire item list selection page, and after the user selects a certain item information in the item list selection page, the selected item information may be displayed in the second area.
Optionally, in an implementation manner, after step 202, the method further includes:
step 211, displaying a print label control in the second area;
step 212, after receiving a second trigger operation on the print label control, generating a print notification according to the target identification result information and the weight information;
step 213, a print notification for printing the label of the item is sent to the label printing device.
In this embodiment of the application, after the user determines the item information of the item to be purchased, the user may first print out an item label by operating the device, and then take the item label and the item to the checkout counter to perform checkout. In this case, the embodiment of the present application may provide a print label control in the second area, such as "print label" in fig. 3, after the user triggers the "print label", the weighing device generates a print notification according to the target identification result information and the weight information, and then sends the print notification to the label printing device 104, and the label printing device prints the article label according to the print notification. The print notification may include information such as the name of the item, the unit price of the item, the weight of the item, and the total price of the item. The information on the item label may include information such as item name, item unit price, item weight, item total price, etc. Of course, the information on the article label may also be a graphic code including the above-mentioned article name, article unit price, article weight, and article total price information.
It should be noted that, a cashier at the cash desk may scan the article label by using a label scanning device at the cash desk, and then the cash desk generates a payment order, and the user may pay the payment order in a plurality of manners, for example, pay by swiping a card, pay by image coding, and the like.
Optionally, in an implementation manner, after step 202, the method further includes:
step 214, continuing to scan the control and the checkout control in the second area;
step 215, after receiving the trigger operation of the continuous scanning control, recording the target identification result information, and continuing to execute the step of obtaining the article image information of the article;
step 216, entering a checkout interface after receiving the triggering operation of the checkout control; the checkout interface displays recorded target identification result information and a payment control; the payment control is used for triggering payment operation.
In the embodiment of the present application, the payment may be performed directly by using the weighing device without using the aforementioned method of performing payment by printing a label. In this way, a continuous scanning control and a checkout control can be provided in the second area, the continuous scanning control is used for the user to select to continuously carry out weighing and charging on other articles, and the result of each weighing and charging can be recorded, for example, the identification result information is added into the virtual shopping cart. And then after the user wants to finish the purchase, triggering a checkout control to enter a checkout interface, wherein the user can check the purchased articles and decide whether to pay or not in the checkout interface, and if the user decides to pay, triggering the payment control in the checkout interface and then entering a payment page to perform payment operation. Specific payment operation process the embodiments of the present application do not impose limitations thereon.
Optionally, in an implementation manner, after step 211, the method further includes:
step 217, obtaining the similarity between the target recognition result information and the article image information;
step 218, adding check information in the print notification when the similarity meets a first preset condition; the check information is used for executing check prompting operation under the condition that the label scanning equipment scans the check information.
In practical application, a situation that a user intentionally selects item information inconsistent with an actual item may occur, for example, the user actually weighs durian, but the item information selected by the user at a weighing device end is not durian but is red fuji apple, which may cause damage to the assets of a merchant. Then the print notification may be added with the inspection information which the printing device then prints into the article label when printing the article label. It should be noted that the check information may be a special symbol. When the tag scanning device at the downstream checkout counter scans the check information, it can check whether the special symbol exists according to the preset check rule, if so, it needs to execute the check prompt operation.
It should be noted that the check prompt operation may include the cashier device sending an alarm prompt and/or sending a prompt message to the terminal device of the staff, where the prompt message may include which cashier needs to be checked, and may also include what the checked article information is. And after receiving the prompt information, the terminal equipment of the staff carries out alarm prompt to prompt the staff to which cash desk to carry out checking operation.
Note that the label scanning device may be a point of sale (POS) device, and the POS device may be provided with a warning light, and when the check prompting operation is performed, the checkout counter device may control the warning light on the POS device to give an alarm.
Optionally, in an implementation manner, after step 211, the method further includes:
step 219, acquiring user identity information corresponding to the target identification result information;
step 220, recording the times of the condition that the similarity meets a first preset condition aiming at the user identity information;
step 221, adding the user identity information into a blacklist under the condition that the times reach a preset number threshold.
In the embodiment of the application, some users may often have a situation that the object identification result information of the object taken by the user is not matched with the object identification result information of the printed label, and in a mode of payment by directly using the weighing device terminal, some users may often have a situation that the object taken by the user is not matched with the object identification result of payment, so that the credit of the user may have a problem, the user needs to be added into a blacklist, and when the user subsequently purchases the object by adopting the mode of the embodiment of the application again, manual intervention is needed, for example, whether the object identification result information of the object and the object identification result information of payment are matched is checked every time of payment, and if the object identification result information of payment is not matched, the user performs correction.
It should be noted that, in the embodiment of the present application, the similarity between the target identification result information and the article image information may be obtained in the foregoing manner, and in addition, the user identity information of the user may be obtained according to payment information provided by the user during payment, and then the user identity information is associated with the target result information. When the similarity is lower than the similarity threshold, recording the identity information of the user for one-time dishonest shopping, and directly adding the identity information of the user into a blacklist after the number of times reaches the number threshold.
In an embodiment of the present application, the blacklist may also be synchronized to checkout counter devices of respective item providers.
It should be noted that the number threshold may be set according to actual requirements, and the embodiment of the present application does not limit this.
Optionally, in an implementation manner, before step 201, the method further includes:
step 222, under the condition that a third trigger operation for opening a material shooting task interface is received, displaying the material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
in the embodiment of the application, the server side can continuously modify the article identification model by using new materials. When a new article appears or the server judges that the identification error rate of a certain article exceeds the error rate threshold value, the server can generate a material shooting task and send the material shooting task to each weighing equipment.
And at the weighing equipment end, the weighing application can be installed, a worker of an article provider can open the weighing application, then a control for opening a material shooting task interface is provided in a page of the weighing application, and after a user triggers the control, the material shooting task interface can be displayed in a display screen.
For example, in fig. 7, the user may open a management interface a20 in the weighing application, a control "material shooting task" a24 for opening a material shooting task interface is displayed in the management interface, and the user enters the material shooting task interface, such as the material shooting task interface a30 in fig. 8, after triggering the control.
In the embodiment of the application, after the weighing application is started each time, the material shooting task can be obtained from the server and cached in the storage space.
It should be noted that, in the embodiment of the present application, the task of the new item may be submitted by the service provider through the weighing device, or may be created by the service provider after being collected by the technician at the service provider. In this embodiment of the application, the operation of the user on the recognition result by the weighing device end may indicate whether the recognition is accurate, for example, when the recognition result is displayed, the recognition result information with the highest recognition probability of the article recognition model is selected as the target recognition result information by default, if the user does not reselect the target recognition result information, the information that is not reselected by the user may be sent to the server, and the server may confirm that the recognition of the article is correct according to the operation that is reselected at this time. If the user reselects the target recognition result information from the plurality of target recognition result information or returns to the item list selection page to reselect the item information as the target recognition result information, the reselected information can be sent to the server, and the server confirms the next recognition error of the item according to the reselection operation. Thus, the identification accuracy of the article can be counted by the method.
In practical applications, for example, after the user triggers printing of the article label, whether the target identification result information is selected again may be determined as described above. For example, in the direct checkout mode, after the user triggers entering into the checkout interface, it may be determined whether the target identification result information is reselected in the above-described mode.
It should be noted that, optionally, in the management interface of fig. 7, a control "enter a trial scanning mode" may also be provided, after the staff triggers the control "enter the trial scanning mode", the weighing device performs a trial scanning mode, then a trial scanning mark is marked on the scanned item, and for the label of the trial scanned item, the checkout counter does not really settle accounts, and a simulated payment process may be entered.
Optionally, in the management interface of fig. 7, an "offline weighing mode" control may be further provided, where the offline weighing mode control corresponds to the opening/closing control, the user may open or close the off-line weighing mode at present, and after the user triggers the opening of the offline weighing mode, the user may perform operations such as identifying and settling accounts on the article offline.
Optionally, in the management interface of fig. 7, an "offline order upload" control may be further provided, and after the user triggers the control, the offline order obtained in the offline weighing mode may be uploaded to the server.
Optionally, in the management interface of fig. 7, a "start self-service weighing" control may be further provided, and after the user triggers the control, the weighing device enters a formal weighing and account settling operation and other flows.
Step 223, selecting the target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
as shown in fig. 8, 6 material shooting tasks "red fuji apple", "banana", "pear", "snake fruit", "gala fruit", "pomegranate" are displayed in the material shooting task interface a30,
the user may select one at a time from the above tasks to perform the process of capturing the image of the sample object. The user may proceed to step 224 after selecting a target item to be photographed, such as "red fuji apple".
Step 224, displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
as in fig. 8, the material shooting task interface a30 also displays a "shooting temporarily" control a31 and a shooting control "start shooting" a 32.
In the material shooting task interface a30, if a worker at the weighing device end is not in time to shoot or there is no actual article corresponding to the material shooting task in the place, the temporary shooting control a31 may be triggered to end the material shooting process. If the staff can shoot and the actual articles corresponding to the articles to be shot in the place, the staff can trigger the 'start shooting' control a32 to enter the material shooting interface a40 of fig. 9 and start entering the shooting process.
And step 225, obtaining sample article image information of the target article to be shot in the material shooting interface and sending the sample article image information to a server.
The user can shoot sample article image information of the target article to be shot in the material shooting interface, and then the sample article image information is uploaded to the server in combination with the article name of the target article to be shot so that the server can train the article recognition model according to the sample article image information.
Optionally, in an implementation manner, step 225 includes:
substep 2251, displaying a preview screen of the image capturing apparatus in a fourth area of the material capturing interface;
and a substep 2252 of displaying the sample item image information obtained from the preview screen in a fifth area of the material capturing interface and transmitting the sample item image information to a server.
As shown in fig. 9, in the present embodiment, the material capturing interface may include two regions, a fourth region a41 in which a preview screen of the image capturing apparatus is displayed, and a fifth region a42, which is similar to the preview screen of the third region of fig. 3 and 5 since the image capturing apparatus is disposed facing the weighing stand, and will not be described in detail herein.
The sample item image information acquired from the preview screen is displayed in the fifth area a42 and transmitted to the server.
Optionally, in an implementation, the sub-step 2252 includes:
sub-step B11, when receiving a fifth trigger operation on the shooting control in the fifth area, acquiring sample item image information from the preview screen;
sub-step B12, in case of receiving a sixth trigger operation on the upload control in the fifth area, sending the sample item image information to a server.
In the embodiment of the present application, a sample of a target object to be photographed may specify a maximum number of shots, as shown in fig. 9, when the maximum number of shots is not reached, a "next" control may be clicked to continue photographing, and image information of the sample object is obtained. Of course, if the user is not satisfied with the quality of the currently captured image, the user may click on the "single-shot" control, delete the image, and then take a picture again.
As shown in fig. 10, after the number of captured images reaches the maximum number, all of the rephotographs a46 and the upload control a45 may be displayed. If the user is not satisfied with the quality of the whole image, all the rephotograph controls can be triggered, all sample article image information of the target article to be shot is deleted, and shooting is restarted. If the user is satisfied with the overall image quality, the uploading control can be triggered to upload the image information of the sample articles to the server. After receiving the sample article image information, the server may train an article recognition model for the article name of the target article to be photographed and the sample article image information.
It should be noted that an upload control may also be added in fig. 9, and the user may optionally capture image information of several sample articles, and then click the upload control to upload the image information of the sample articles.
It should be noted that after the user clicks the upload, the embodiment of the present application may pop up a floating window, and provide a control for quickly entering the shooting of the next commodity and a control for exiting the shooting in the floating window. And when the user triggers the control for quitting shooting, quitting the material shooting process. When the user triggers the control for continuing shooting, the next article to be shot is selected in sequence from the material shooting task to be shot, and shooting is carried out as shown in the shooting process of fig. 9 and fig. 10.
Optionally, in an implementation manner, before step 201, the method further includes:
step 226, displaying the item name association interface under the condition that a seventh trigger operation for opening the item name association interface is received;
step 227, in the item name association interface, receiving a corresponding relationship between an item provider name of an item and a platform common name of the item, and sending an association relationship between the item provider name, the platform common name, and an item provider identifier of the item to a server.
In practical applications, different areas may refer to the same item, such as potato, and some areas prefer to name potatoes, and some areas prefer to name potatoes. For an item, supermarkets and convenience stores in different areas may use a naming mode familiar to people in the corresponding areas.
Therefore, in this embodiment of the present application, as shown in fig. 7, an item name association control a25 may be provided in the management interface, and after the user triggers the item name association control, the user may enter the item name association interface, and then in the item name association interface, the platform public name of the item and the item provider name of the item are corresponded, and then the correspondence is sent to the server together with the item provider identifier. The server may then record the platform public name and the item provider name corresponding to the item provider identity. Of course, the item provider identifier may be set in the weighing apparatus, such as merchant a, merchant B, or the like.
When the subsequent server returns the identification result information to the article, the identification result information of the name of the article provider can be returned.
The article provider may be understood as one selling articles such as a convenience store and a supermarket. The item provider name of the item is understood as the name of the item given to the item provider according to the local place. The common name of the platform can be understood as the name of an article when the article identification model is used for training in the service end, or the original name of the article output by the article identification model.
Of course, in the embodiment of the present application, if the item provider name and the platform common name are identical, the above association may not be established.
It should be noted that, in the embodiment of the present application, possibly because the merchant originally has a commodity library, in the embodiment of the present application, a plug-in may be installed in the weighing client, and then the commodity library of the merchant is associated with the aforementioned "return full-amount list" control, and after the user triggers the "return full-amount list" control, the item list in the original commodity library of the merchant may be obtained, and then the item list is displayed in the item list selection page.
When the server identifies an item, and then the identification probability exceeds a threshold value, such as 99%, and then the user also clicks item information on an item list selection page, the service provider item name in the clicked item information may be associated with the platform common name in the server. For example, when the platform uses the name of 'potato' for the potato article when an article identification model is built, and uses the name of 'potato' for the article provider X in the area a, the 'potato' and the 'potato' can be associated, and after the image of the potato provided for the article provider X identifies the result of the potato, the potato is replaced by the potato and sent to the weighing device of the article provider, so that the weighing device of the article provider can conveniently perform subsequent operations.
In practical application, an interface screenshot of item information clicked by a user can be obtained, then an item name originally set by a merchant is identified from the interface screenshot by using an Optical Character Recognition (OCR), and then the item name corresponds to a platform public name in identification result information sent by a server and is sent to the server to establish the association relationship.
It should be noted that, in the foregoing manner of printing an article label, the weighing device end may send a print notification to the label printing device, where the print notification includes an article ID and an article name, and in this embodiment of the application, the print notification may be intercepted, the article ID and the article name are obtained from the print notification, and then an association relationship is established with the platform public name.
By the mode, the identification library of any merchant can be quickly built for the merchants with the existing commodity libraries, and labor is saved.
Optionally, in an implementation manner, after step 201, the method further includes:
step 228, sending the article image information to a target mobile terminal, so that the mobile terminal can share the article image information.
Referring to fig. 12, another system architecture diagram of the embodiment of the present application is shown, in which the weighing device side is the weighing device side of the merchant, and the weighing device side can be connected with the mobile terminal 107 of the buyer. Then, after the weighing equipment terminal acquires the article image information, the article image information is sent to the mobile terminal, and then a user can share the article image information by using the mobile terminal. For example, the image information is shared in an account of a social platform of the user, such as a microblog account sent to a certain microblog application of the user, a circle of friends of certain social software, and the like, so that the user can share the buyer show in the social platform. Certainly, the user may also send the item image information to other accounts of the social platform, and the sharing operation is not limited in the embodiment of the present application.
In practical applications, a graphic code may be disposed on a surface of the weighing device, and the buyer scans the graphic code using the mobile terminal, which may establish a communication connection with the weighing device. For example, under the condition that the wireless module of the weighing device end can be a bluetooth module, the mobile terminal can obtain the name and the password of the bluetooth module of the weighing device end by scanning the graphic code, then call the bluetooth module of the mobile terminal, and establish communication connection with the bluetooth module of the weighing device end by using the name and the password. Of course, the embodiment of the present application may also establish the communication connection in other manners, and the specific manner of establishing the communication connection is not limited in the embodiment of the present application.
It should be noted that the mobile terminal may be an intelligent device such as a mobile phone, a tablet computer, and an intelligent watch.
It should be noted that, if a merchant only provides the weighing platform and the camera device, and then purchases a home-use mobile terminal to connect the weighing platform and the camera device for self-service weighing, the mobile terminal may store the image information of the article, and then perform the sharing operation.
Optionally, in an implementation manner, after step 203, the method further includes:
step 229, extracting item price information from the identification result information;
step 230, displaying the item price information on the item image information.
Referring to fig. 13, in the embodiment of the present application, after acquiring the identification result information, the weighing device may further extract item price information from the identification result information, and then display the item price information on the item image information. The item price information may include an item name and an item price. When displayed, the item price information may be displayed in a floating manner over the item image information. Thereby being capable of more obviously prompting the price of the shot object.
It is understood that, as shown in fig. 13, a real-time preview screen shot by the camera device is displayed in the third area a11, and in the embodiment of the present application, the item price information may be displayed in a floating manner on the preview screen.
In practical applications, item price information in the form of text may be extracted and then displayed over the item image information.
For example, in fig. 13, item price information "red fuji apple: 10 yuan/500 g ", and then the" red fuji apple: 10 yuan/500 g.
Optionally, in order to avoid the obstruction of the item price information to the item, in the embodiment of the present application, the item price information may be displayed outside the area where the item is located, for example, the item price information may be displayed outside the area outlined by a 14.
The item price information may be displayed in a still state or a dynamic state at a certain position on the preview screen. The dynamic display moves the display, for example, outside the area outlined by a 14.
In the embodiment of the present application, when the number of pieces of identification result information is 1, for example, only one piece of identification result information of red fuji apple is given in fig. 13, and the item price information of the red fuji apple may be displayed on the item image information.
And if there are a plurality of identification results, the item price information can be extracted from the one with the highest probability in the identification result information, and then the item price information is displayed on the item image information. Of course, some or all of the identification result information may be selected from the plurality of identification result information, the item price information of some or all of the identification result information may be extracted, and the item price information may be displayed on the item image information. When a plurality of item price information items are displayed, the item price information items do not overlap.
Of course, in the above-described case where there are a plurality of pieces of recognition result information, if the user selects one piece of target recognition result information from the plurality of pieces of recognition result information, the above-described item price information may be extracted from the target recognition result information and then displayed on the item image information. In addition, if the user selects one item information from the item list selection page, the item price information may be extracted from the selected item information and then displayed on the item image information.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched.
Referring to fig. 14, a flowchart of a weighing method described in the system architecture level provided in the embodiment of the present application is shown, where the method specifically may include:
301, the weighing equipment side acquires article image information of an article and sends the article image information to a server side; the article is placed on a weighing platform corresponding to the weighing equipment end;
the above step 301 refers to the description of the foregoing step 201, and is not described in detail here.
Step 302, the server determines recommendation information of the article according to the identification result information, and sends the identification result information and the recommendation information to the weighing equipment end;
in this embodiment of the application, the article identification model may be trained on the server side in the foregoing manner, so that the weighing device side calls the article identification model to perform article identification. The specific identification process is as described in the foregoing embodiments and will not be described in detail here.
Step 303, the weighing device end displays the identification result information of the article in a first area of a display interface, and displays the recommendation information of the article in a second area of the display interface.
The above step 303 refers to the description of the above step 202, and is not detailed here.
The processing procedure of the weighing device end in the embodiment of the present application may refer to the description of the foregoing embodiment, and is not described in detail here.
Optionally, in an implementation manner, after step 302, the method further includes:
step 304, the weighing equipment end displays the item image information in a third area of the display interface; and the article image information is a preview picture shot by the camera equipment corresponding to the weighing equipment terminal.
The principle of step 304 is similar to that of step 203 of the previous embodiment, and will not be described in detail here.
Optionally, in this embodiment of the present application, the weighing apparatus end may also perform the processes of steps 204, 205 to 206 as in the foregoing embodiments, which are not limited in this embodiment of the present application.
Optionally, in an implementation manner, after step 302, the method further includes:
305, the weighing equipment end acquires the weight information of the article weighed by the weighing platform;
the principle of step 305 is described with reference to step 207 of the previous embodiment and will not be described in detail here.
And step 306, displaying the weight information and the total price of the article at the position corresponding to the identification result information by the weighing equipment terminal.
The principle of this step 306 is described with reference to the sub-step 2021 of the previous embodiment and will not be described in detail here.
Optionally, in an implementation manner, after step 303, the method further includes:
step 307, the weighing equipment receives a first selection operation on the identification result information under the condition that a plurality of pieces of identification result information are displayed in the second area;
308, the weighing equipment terminal selects target identification result information from the identification result selection information according to the first selection operation;
step 309, the weighing apparatus terminal takes the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
The principles of steps 307-309 described above are described with reference to steps 208-210 of the previous embodiments and will not be described in detail herein.
Optionally, in an implementation manner, after step 303, the method further includes:
step 310, the weighing equipment end displays a printing label control in the second area;
311, after receiving a second trigger operation on the print label control, the weighing device generates a print notification according to the target identification result information and the weight information;
step 312, the weighing apparatus sends a printing notification for printing the label of the article to the label printing apparatus;
the principles of steps 310-312 described above, with reference to the descriptions of steps 211-213 previously described, are not described in detail herein.
Step 313, the label printing device prints an article label according to the print notification.
In this embodiment, the print notification may include information such as an item ID, an item name, item weight information, an item unit price, an item total price, and whether there is inspection information, and the label printing device prints the information in the print notification on a paper label of the item after receiving the print notification.
Optionally, in this embodiment of the present application, the weighing apparatus may also perform the foregoing processes of steps 214 to 216, and will not be described in detail herein.
Optionally, in an implementation manner, after step 310, the method further includes:
step 314, the weighing equipment end acquires the similarity between the target identification result information and the article image information;
step 315, adding check information in the print notification by the weighing equipment terminal under the condition that the similarity meets a first preset condition;
the principles of steps 314-315 are described with reference to steps 217-218 of the previous embodiments and will not be described in detail herein.
Step 316, the label scanning device executes an inspection prompt operation when the article label is scanned with the inspection information.
In this embodiment of the application, when the tag scanning device scans the check information, it may check whether there is the special symbol according to a preset check rule, and if there is the special symbol, it needs to perform a check prompt operation.
Optionally, in step 316, the tag scanning device executes an inspection prompting operation when the inspection information is scanned, including:
and a substep 3161, in which the label scanning device controls an alarm lamp of the label scanning device to light up and/or sends a check prompt message to a preset terminal when the inspection information is scanned in the article label.
It should be noted that the aforementioned operation of prompting inspection may include the cashier device sending an alarm and/or sending a prompt message to the terminal device of the staff, where the prompt message may include which cashier needs to be inspected, and may also include what the information of the inspected article is. And after receiving the prompt information, the terminal equipment of the staff carries out alarm prompt to prompt the staff to which cash desk to carry out checking operation.
Note that the label scanning device may be a point of sale (POS) device, and the POS device may be provided with a warning light, and when the check prompting operation is performed, the checkout counter device may control the warning light on the POS device to give an alarm.
Optionally, in an implementation manner, after step 310, the method further includes:
step 317, the server side obtains user identity information corresponding to the target identification result information;
in this embodiment, after receiving the payment information of the target identification result, the checkout counter device may obtain the user identity information according to the payment information, and then associate the identity information with the target identification result information.
Of course, the user identity information may be obtained in other manners.
Step 318, the server side records the times of the condition that the similarity meets a first preset condition aiming at the user identity information;
step 319, the server adds the user identity information to a blacklist when the number of times reaches a preset number threshold.
In practical application, if a user has a dishonest purchase that the taken article is inconsistent with the paid identification result information, in order to further prevent the asset loss of the article provider, the number of times of the dishonest purchase performed by the user may be recorded, and after the number of times reaches a preset number threshold, the user identity information is added to a blacklist.
It should be noted that the principle of steps 317 to 319 can refer to the process of steps 219 to 221, which is not described in detail herein. Steps 317-319 are executed at the server side, and the above-mentioned dishonest operations performed by the same user identity information in different merchants can be collected, so that the data is more comprehensive. While steps 219-221 are not limited to being performed at the server side, they collect dishonest operations by the user at the item provider side, assuming they are performed at the weighing device side.
It should be noted that, in the embodiment of the present application, the blacklist may be distributed to the cash register devices of the cash registers of the merchants.
Optionally, in an implementation manner, after step 319, the method further includes:
step 320, the label scanning device obtains user identity information according to the payment information when receiving the payment information of the user;
step 321, the label scanning device sends an intervention notification to a preset terminal when the user identity information is in the blacklist.
In an embodiment of the present application, the label scanning device may be a cash register device of a cash register station. After the user weighs by oneself, can arrive the cashier's desk and settle accounts, for example the user triggers the controlling part of printing the label at the weighing device end, and after the weighing device end controlled printing device to print out article label, the user can hold article label and article and arrive the cashier's desk and settle accounts.
The staff of the cashier desk can scan the article label by using the label scanning equipment of the cashier desk, then enter the payment process, obtain the user identity information from the payment information after the user provides the payment information, then match the user identity information with the blacklist, and if the user identity information is matched with the blacklist, the staff is required to send an intervention notification to the terminal of the staff, so that the staff is reminded to check the articles purchased by the user.
Certainly, the identity information of the user may also be obtained in other manners, for example, if the cashier lets the user input the member number of the merchant, the above-mentioned creating of the blacklist may be performed by counting the number of dishonest purchases of the user with the member number, so as to purchase the blacklist in the above-mentioned manner. Then, when the user purchases again, the blacklist can be matched based on the membership number, and if the membership number is matched with the blacklist, a worker is informed to intervene to check the purchased articles of the user.
Optionally, in an implementation manner, before step 301, the method further includes:
322, displaying a material shooting task interface according to a third trigger operation when the weighing equipment end receives the third trigger operation for opening the material shooting task interface; the material shooting task interface displays the object to be shot and a shooting control;
323, the weighing equipment terminal selects a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
324, displaying a material shooting interface by the weighing equipment end under the condition of receiving a fourth trigger operation on the shooting control;
step 325, the weighing device side obtains sample article image information of the target article to be shot in the material shooting interface and sends the sample article image information to the server side.
The principles of steps 322-325 are similar to those of steps 222-225 and will not be described in detail herein.
Optionally, in an implementation manner, before step 301, the method further includes:
step 326, the weighing equipment end receives a seventh trigger operation for opening the item name association interface;
step 327, the weighing equipment displays an item name association interface according to the seventh trigger operation;
step 328, the weighing device receives the association relationship between the item provider name of the item and the platform common item name of the item in the item name association interface, and sends the association relationship between the item provider name, the platform common name, and the item provider identifier of the item to the server.
The principles of steps 326-328 are similar to steps 226-227 of the previous embodiment and will not be described in detail herein.
Optionally, in an implementation manner, after step 303, the method further includes:
step 329, the weighing equipment side sends the identity of the target object provider to the server side;
in the embodiments of the present application, since different regions may refer to the same item, such as potato, some regions prefer potato, and some regions prefer potato. For an item, supermarkets and convenience stores in different areas may use a naming mode familiar to people in the corresponding areas. Under the condition that the incidence relation including the identity of the article provider is established, in the process of identifying the article, when the weighing equipment end sends the image information of the article to the server end, the identity of the target article provider of the merchant where the weighing equipment end is located can be sent to the server end.
In step 302, the determining, by the server, the identification result information of the article according to the article image information and the recommendation information of the article according to the identification result information by the server includes:
substep 3021, the server determines identification result information marked by a platform public name according to the item image information;
in substep 3022, the server determines, according to the association, a name of the target item provider corresponding to the target item provider identity information;
and a substep 3023, replacing the mark of the identification result information by the server with the name of the target item provider, and sending the replaced identification result information to the weighing equipment.
For example, the server inputs the item image information into an item identification model, the item identification model outputs "potato", and if it is found that the target item provider identification information corresponds to the potato having its own target item provider name "potato", the "potato" is replaced with "potato", and identification result information such as [ potato icon, potato: unit price 2 yuan/500 g ], the target item provider can display the identification result information with the name of its own original commodity library.
Optionally, in an implementation manner, after step 301, the method further includes:
and 330, sending the article image information to a target mobile terminal by the weighing equipment terminal so that the mobile terminal can share the article image information.
The principle of step 330 is described with reference to step 228, and will not be described in detail here.
Optionally, in an implementation manner, after step 304, the method further includes:
step 331, the weighing equipment terminal extracts item price information from the identification result information;
step 332, the weighing device displays the price information of the article on the image information of the article.
The principles of steps 331-332 are described with reference to steps 229-230 previously described and will not be described in detail herein.
Referring to fig. 15, which shows a flowchart of a weighing method described from an end side of a weighing apparatus provided in the embodiment of the present application, the method may specifically include:
step 401, acquiring article image information of an article and sending the article image information to a server; the article is placed on a weighing platform corresponding to the weighing equipment end;
step 402, receiving identification result information and the recommendation information sent by a server; the identification result information and the recommendation information are determined according to the article image information;
step 403, displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
It should be noted that the implementation of the end side of the weighing device is described with reference to the previous embodiments and will not be described in detail here.
Referring to fig. 16, it shows a flowchart of a weighing method described from the service end side according to an embodiment of the present application, and the method may specifically include:
step 501, receiving article image information sent by a weighing device end;
step 502, according to the image information of the article, determining identification result information of the article and recommendation information of the article according to the identification result information, and sending the identification result information and the recommendation information to the weighing equipment terminal, so that the weighing equipment terminal displays the identification result information of the article in a first area of a display interface and displays the recommendation information of the article in a second area of the display interface.
It should be noted that, the implementation process of the server side refers to the description of the foregoing embodiments, and is not described in detail here.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched.
Referring to fig. 16, which shows a flowchart of a weighing method provided in an embodiment of the present application, the method may specifically include:
step 511, acquiring article image information of the article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
step 512, according to the item image information, displaying the identification result information of the item in a first area of a display interface, and displaying the item image information in a third area of the display interface.
The implementation of the embodiment of the present application refers to the foregoing description of fig. 6, and is not described in detail herein.
In the embodiment of the present application, the weighing device side may also perform the related steps described above, and the server side may also perform the related steps described above, which is not described in detail herein.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, a real-time preview picture of the camera can be displayed in a third area of the display interface, so that a user can conveniently and accurately place articles on the weighing platform.
On the basis of the above embodiments, the present embodiment also provides a weighing apparatus, a weighing system, and the like.
Referring to fig. 17, a block diagram of a weighing apparatus according to an embodiment of the present application is shown, and specifically, the weighing apparatus may include the following modules:
an image information obtaining module 601, configured to obtain article image information of an article; the article is placed on a weighing platform;
the first display module 602 is configured to display, according to the item image information, the identification result information of the item in a first area of a display interface, and display recommendation information of the item in a second area of the display interface.
Optionally, the method further includes:
the second display module is used for displaying the article image information in a third area of the display interface; the article image information is a preview picture shot by the camera equipment.
Optionally, the method further includes: the area prompting module is used for displaying an article placement area mark in the third area; the article placing area mark is used for prompting the position of placing an article on the weighing platform
Optionally, the method further includes: the list control display module is used for providing an article list display control in the display interface; and displaying an item list selection page after receiving a first trigger operation on the item list display control.
Optionally, the method further includes: the weight obtaining module is used for obtaining the weight information of the articles weighed by the weighing platform;
the first display module is further used for displaying the weight information and the total price of the article at the position corresponding to the identification result information.
Optionally, the method further includes: a result selection operation receiving module, configured to receive a first selection operation on the identification result information when a plurality of pieces of identification result information are displayed in the second area;
a first result determination module configured to select target recognition result information from the plurality of recognition result selection information according to the first selection operation;
and the second result determining module is used for taking the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
Optionally, the method further includes: a label control display module for displaying a print label control in the second region;
the printing notification generation module is used for generating a printing notification according to the target identification result information and the weight information after receiving a second trigger operation on the printing label control;
and the printing notification sending module is used for sending a printing notification for printing the label of the article to the label printing device.
Optionally, the method further includes: the similarity obtaining module is used for obtaining the similarity between the target recognition result information and the article image information;
the inspection prompt information adding module is used for adding inspection information into the printing notification under the condition that the similarity meets a first preset condition; the check information is used for executing check prompting operation under the condition that the label scanning equipment scans the check information.
Optionally, the method further includes: the identity information acquisition module is used for acquiring user identity information corresponding to the target identification result information;
the frequency determining module is used for recording the frequency of the condition that the similarity meets a first preset condition aiming at the user identity information;
and the blacklist setting module is used for adding the user identity information into a blacklist under the condition that the times reach a preset number threshold.
Optionally, the method further includes: the material task interface triggering module is used for receiving a third triggering operation for opening a material shooting task interface;
the material interface display module is used for displaying a material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
the material selection module is used for selecting a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
the material shooting interface display module is used for displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
and the material uploading module is used for acquiring sample article image information of the target article to be shot in the material shooting interface and sending the sample article image information to the server.
Optionally, the method further includes: the material uploading module comprises:
the material preview submodule displays a preview picture of the camera equipment in a fourth area of the material shooting interface;
and the uploading sub-module displays the sample article image information acquired from the preview picture in a fifth area of the material shooting interface and sends the sample article image information to a server.
Optionally, the method further includes: the upload sub-module includes:
the acquisition sub-module is used for acquiring sample article image information from the preview picture under the condition that a fifth trigger operation on the shooting control in the fifth area is received;
the image adding submodule is used for adding the article image information into the result display area in the fifth area to be displayed;
and the sending sub-module is used for sending the image information of the sample article to a server under the condition that a sixth trigger operation on the uploading control in the fifth area is received.
Optionally, the method further includes: the name association triggering module is used for receiving a seventh triggering operation for opening the item name association interface;
the name association interface display module is used for displaying the item name association interface according to the seventh trigger operation on the item name association interface;
and the association name sending module is used for receiving the corresponding relation between the item provider name of the item and the platform public name of the item in the item name association interface and sending the association relation between the item provider name, the platform public name and the item provider identity of the item to a server.
Optionally, the method further includes:
and the image sending module is used for sending the article image information to a target mobile terminal by the weighing equipment terminal so that the mobile terminal can share the article image information.
Optionally, the method further includes:
the article price extraction module is used for extracting article price information from the identification result information by the weighing equipment terminal;
and the item price combination display module is used for displaying the item price information on the item image information.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched.
Referring to fig. 18, a block diagram of a weighing system according to an embodiment of the present application is shown, which may specifically include the following modules:
the system comprises a weighing equipment terminal 610 and a server terminal 620; the weighing device end 610 is correspondingly provided with at least one weighing platform 611,
the weighing device terminal 610 includes:
an image information obtaining module 612, configured to obtain article image information of an article and send the article image information to a server; the article is placed on a weighing platform corresponding to the weighing equipment end;
a first display module 613, configured to display identification result information of the item in a first area of a display interface, and display recommendation information of the item in a second area of the display interface;
the server 620 includes:
the information determining module 621 is configured to determine, according to the article image information, identification result information of the article and recommendation information of the article according to the identification result information, and send the identification result information and the recommendation information to the weighing device side;
optionally, the weighing platform corresponds to a camera device, and the weighing device further includes:
the second display module is used for displaying the article image information in a third area of the display interface; and the article image information is a preview picture shot by the camera equipment corresponding to the weighing equipment terminal.
Optionally, the weighing apparatus further includes:
the weight obtaining module is used for obtaining the weight information of the articles weighed by the weighing platform;
the first display module is further used for displaying the weight information and the total price of the article at the position corresponding to the identification result information.
Optionally, the weighing apparatus further includes:
a result selection operation receiving module, configured to receive a first selection operation on the identification result information when a plurality of pieces of identification result information are displayed in the second area;
a first result determination module configured to select target recognition result information from the plurality of recognition result selection information according to the first selection operation;
and the second result determining module is used for taking the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
Optionally, the weighing apparatus further includes:
a label control display module for displaying a print label control in the second region;
the printing notification generation module is used for generating a printing notification according to the target identification result information and the weight information after receiving a second trigger operation on the printing label control;
a print notification sending module for sending a print notification for printing a label of an article to a label printing device;
the label printing apparatus includes:
and the printing module is used for printing the label of the article according to the printing notice.
Optionally, a label scanning device is further arranged corresponding to the weighing device end;
the weighing equipment end further comprises:
the similarity obtaining module is used for obtaining the similarity between the target recognition result information and the article image information;
the inspection prompt information adding module is used for adding inspection information into the printing notification under the condition that the similarity meets a first preset condition;
the label scanning device is used for executing the inspection prompt operation under the condition that the article label is scanned to have the inspection information.
Optionally, the label scanning device includes:
and the prompt submodule is used for controlling an alarm lamp of the label scanning equipment to light up and/or sending a check prompt message to a preset terminal under the condition that the label scanning equipment scans the check information in the article label.
Optionally, the server further includes:
the identification result identity information acquisition module is used for acquiring user identity information corresponding to the target identification result information;
the frequency recording module is used for recording the frequency of the condition that the similarity meets a first preset condition aiming at the user identity information;
and the blacklist adding module is used for adding the user identity information into a blacklist under the condition that the times reach a preset number threshold value by the server.
Optionally, the label scanning device further includes:
the payment identity information acquisition module is used for acquiring user identity information according to the payment information under the condition that the label scanning equipment receives the payment information of a user;
and the intervention notification module is used for sending an intervention notification to a preset terminal under the condition that the user identity information is in the blacklist.
Optionally, the weighing apparatus further includes:
the material task interface triggering module is used for receiving a third triggering operation for opening a material shooting task interface;
the material interface display module is used for displaying a material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
the material selection module is used for selecting a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
the material shooting interface display module is used for displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
the material uploading module is used for acquiring sample article image information of a target article to be shot in the material shooting interface and sending the sample article image information to the server;
the server is also used for training an article recognition model according to the sample article image information; the article identification model is used for identifying identification result information corresponding to the article image information.
Optionally, the weighing apparatus further includes:
the name association triggering module is used for receiving a seventh triggering operation for opening the item name association interface;
the name association interface display module is used for displaying the item name association interface according to the seventh trigger operation on the item name association interface;
an association name sending module, configured to receive, in the item name association interface, a correspondence between an item provider name of an item and a platform common name of the item, and send, to a server, an association relationship between the item provider name, the platform common name, and an item provider identifier of the item;
the server is further used for recording the association relation among the item provider name, the platform public name and the item provider identity of the item.
Optionally, the weighing apparatus further includes:
the article provider identity information sending module is used for sending the target article provider identity identifier to the server side by the weighing equipment side;
the server side further comprises:
the public name result identification module is used for determining identification result information marked by a platform public name according to the article image information;
the article provider name determining module is used for determining the name of the target article provider corresponding to the identity information of the target article provider according to the association relation;
and the article provider identification result sending module is used for replacing the mark of the identification result information by the name of the target article provider and sending the replaced identification result information to the weighing equipment terminal.
Optionally, the weighing apparatus further includes:
and the image sending module is used for sending the article image information to a target mobile terminal by the weighing equipment terminal so that the mobile terminal can share the article image information.
Optionally, the weighing apparatus further includes:
the article price extraction module is used for extracting article price information from the identification result information by the weighing equipment terminal;
and the item price combination display module is used for displaying the item price information on the item image information.
Referring to fig. 19, a block diagram of a weighing apparatus at an end side of a weighing device according to an embodiment of the present application is shown, and specifically, the weighing apparatus may include the following modules:
the image information acquiring module 631 is configured to acquire article image information of an article and send the article image information to a server; the article is placed on a weighing platform corresponding to the weighing equipment end;
an information receiving module 632, configured to receive the identification result information and the recommendation information sent by the server; the identification result information and the recommendation information are determined according to the article image information;
the first display module 633 is configured to display the identification result information of the item in a first area of a display interface, and display the recommendation information of the item in a second area of the display interface.
Referring to fig. 20, a block diagram of a weighing apparatus at a service end side according to an embodiment of the present application is shown, and specifically, the weighing apparatus may include the following modules:
the image receiving module 641 is configured to receive image information of an article sent by the weighing device;
the information determining module 642 is configured to determine, according to the article image information, identification result information of the article and recommendation information of the article according to the identification result information, and send the identification result information and the recommendation information to the weighing device end, so that the weighing device end displays the identification result information of the article in a first area of a display interface and displays the recommendation information of the article in a second area of the display interface.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, recommendation information of the weighed object can be displayed in the second area of the display interface, so that a user can conveniently perform further operations according to the recommendation information, for example, recommending a certain commodity associated with the identification result, and prompting the user to purchase the associated commodity, so that the commodity purchased by the user is more accurately matched.
Referring to fig. 20, a block diagram of a weighing apparatus according to an embodiment of the present application is shown, and specifically, the weighing apparatus may include the following modules:
a preview image acquiring module 651 for acquiring article image information of an article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
the third display module 652 is configured to display the identification result information of the article in the first area of the display interface and display the article image information in the third area of the display interface according to the article image information.
Other modules of the embodiments of the present application refer to the foregoing embodiments and are not described in detail herein.
The weighing equipment end of this application embodiment can directly acquire the article image information of placing on weighing the platform, then based on this article image information discerns the identification result information of article fast, the human cost has been saved, the efficiency of discernment is improved, the latency is saved, in addition, this application embodiment has still been divided a plurality of regions to the display interface, in the display interface, except the identification result information that shows article, can also show other information, the information of demonstration is abundanter, convenience of customers observes more information when weighing and enters the field operation. For example, a real-time preview picture of the camera can be displayed in a third area of the display interface, so that a user can conveniently and accurately place articles on the weighing platform.
The present application further provides a non-transitory, readable storage medium, where one or more modules (programs) are stored, and when the one or more modules are applied to a device, the device may execute instructions (instructions) of method steps in this application.
Embodiments of the present application provide one or more machine-readable media having instructions stored thereon, which when executed by one or more processors, cause an electronic device to perform the methods as described in one or more of the above embodiments. In the embodiment of the present application, the electronic device includes various types of devices such as a terminal device and a server (cluster).
Embodiments of the present disclosure may be implemented as an apparatus, which may include electronic devices such as a terminal device, a server (cluster), etc., using any suitable hardware, firmware, software, or any combination thereof, to perform a desired configuration. Fig. 22 schematically illustrates an example apparatus 700 that may be used to implement various ones of the embodiments described in the present application.
For one embodiment, fig. 22 illustrates an exemplary apparatus 700 having one or more processors 702, a control module (chipset) 704 coupled to at least one of the processor(s) 702, a memory 706 coupled to the control module 704, a non-volatile memory (NVM)/storage 708 coupled to the control module 704, one or more input/output devices 710 coupled to the control module 704, and a network interface 712 coupled to the control module 704.
The processor 702 may include one or more single-core or multi-core processors, and the processor 702 may include any combination of general-purpose or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the apparatus 700 can be used as a terminal device, a server (cluster), or the like in the embodiments of the present application.
In some embodiments, the apparatus 700 may include one or more computer-readable media (e.g., the memory 706 or the NVM/storage 708) having instructions 714 and one or more processors 702 in combination with the one or more computer-readable media configured to execute the instructions 714 to implement modules to perform the actions described in this disclosure.
For one embodiment, control module 704 may include any suitable interface controllers to provide any suitable interface to at least one of processor(s) 702 and/or any suitable device or component in communication with control module 704.
The control module 704 may include a memory controller module to provide an interface to the memory 706. The memory controller module may be a hardware module, a software module, and/or a firmware module.
The memory 706 may be used, for example, to load and store data and/or instructions 714 for the apparatus 700. For one embodiment, memory 706 may comprise any suitable volatile memory, such as suitable DRAM. In some embodiments, the memory 706 may comprise a double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).
For one embodiment, control module 704 may include one or more input/output controllers to provide an interface to NVM/storage 708 and input/output device(s) 710.
For example, NVM/storage 708 may be used to store data and/or instructions 714. NVM/storage 708 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more hard disk drive(s) (HDD (s)), one or more Compact Disc (CD) drive(s), and/or one or more Digital Versatile Disc (DVD) drive (s)).
NVM/storage 708 may include storage resources that are physically part of the device on which apparatus 700 is installed, or it may be accessible by the device and need not be part of the device. For example, NVM/storage 708 may be accessible over a network via input/output device(s) 710.
Input/output device(s) 710 may provide an interface for apparatus 700 to communicate with any other suitable device, input/output device(s) 710 may include communication components, audio components, sensor components, and so forth. Network interface 712 may provide an interface for device 700 to communicate over one or more networks, and device 700 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols, such as access to a communication standard-based wireless network, such as WiFi, 2G, 3G, 4G, 5G, etc., or a combination thereof.
For one embodiment, at least one of the processor(s) 702 may be packaged together with logic for one or more controller(s) (e.g., memory controller module) of control module 704. For one embodiment, at least one of the processor(s) 702 may be packaged together with logic for one or more controllers of control module 704 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 702 may be integrated on the same die with logic for one or more controller(s) of control module 704. For one embodiment, at least one of the processor(s) 702 may be integrated on the same die with logic for one or more controllers of control module 704 to form a system on a chip (SoC).
In various embodiments, the apparatus 700 may be, but is not limited to being: a server, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.), among other terminal devices. In various embodiments, apparatus 700 may have more or fewer components and/or different architectures. For example, in some embodiments, device 700 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.
The detection device can adopt a main control chip as a processor or a control module, sensor data, position information and the like are stored in a memory or an NVM/storage device, a sensor group can be used as an input/output device, and a communication interface can comprise a network interface.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present application have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the true scope of the embodiments of the application.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The above detailed description is provided for a weighing method, a weighing apparatus, an electronic device and a storage medium, and the principles and embodiments of the present application are explained in detail by applying specific examples, and the descriptions of the above examples are only used to help understand the method and the core ideas of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (66)

1. A method of weighing, the method comprising:
acquiring article image information of an article; the article is placed on a weighing platform;
and according to the item image information, displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
2. The method of claim 1, further comprising:
displaying the item image information in a third area of the display interface; the article image information is a preview picture shot by the camera equipment.
3. The method of claim 2, further comprising:
displaying an item placement area indicia in the third area; the article placement area mark is used for prompting the position of placing an article on the weighing platform.
4. The method of claim 1, further comprising:
providing an item list display control in the display interface;
and displaying an item list selection page after receiving a first trigger operation on the item list display control.
5. The method according to any one of claims 1-4, further comprising:
acquiring weight information of the article weighed by the weighing platform;
the displaying the identification result information of the article in a first area of a display interface comprises:
and displaying the weight information and the total price of the article at the position corresponding to the identification result information.
6. The method of claim 5, further comprising:
receiving a first selection operation for the recognition result information in a case where a plurality of pieces of the recognition result information are displayed in the second area;
selecting target recognition result information from the plurality of recognition result selection information according to the first selection operation;
and in the case where one piece of the recognition result information is displayed in the second area, the recognition result information is taken as target recognition result information.
7. The method of claim 6, further comprising:
displaying a print label control in the second region;
after receiving a second trigger operation on the printing label control, generating a printing notification according to the target identification result information and the weight information;
a print notification for printing a label of the item is sent to the label printing device.
8. The method of claim 7, further comprising:
acquiring the similarity between the target identification result information and the article image information;
adding check information in the printing notification when the similarity meets a first preset condition; the check information is used for executing check prompting operation under the condition that the label scanning equipment scans the check information.
9. The method of claim 8, further comprising:
acquiring user identity information corresponding to the target identification result information;
recording the times of the condition that the similarity accords with a first preset condition aiming at the user identity information;
and adding the user identity information into a blacklist under the condition that the times reach a preset number threshold.
10. The method of claim 1, further comprising:
under the condition that a third trigger operation for opening a material shooting task interface is received, displaying the material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
under the condition that a second selection operation is received in the material shooting task interface, selecting a target object to be shot;
displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
and acquiring sample article image information of the target article to be shot in the material shooting interface and sending the sample article image information to a server.
11. The method according to claim 10, wherein the obtaining of the sample article image information of the target article to be photographed in the material photographing interface and the uploading of the article image information comprises:
displaying a preview picture of the camera equipment in a fourth area of the material shooting interface;
and displaying the sample article image information acquired from the preview picture in a fifth area of the material shooting interface and sending the sample article image information to a server.
12. The method according to claim 11, wherein the displaying the sample item image information obtained from the preview screen in a fifth area of the material capture interface and sending the sample item image information to a server comprises:
under the condition that a fifth trigger operation on the shooting control in the fifth area is received, acquiring sample article image information from the preview picture;
adding the article image information to a result display area in the fifth area for displaying;
and under the condition that a sixth trigger operation on the uploading control in the fifth area is received, sending the sample article image information to a server.
13. The method of claim 1, further comprising:
displaying the item name association interface under the condition that a seventh trigger operation for opening the item name association interface is received;
in the item name association interface, receiving a corresponding relation between an item provider name of an item and a platform common name of the item, and sending the association relation of the item provider name, the platform common name and an item provider identity of the item to a server.
14. The method of claim 1, further comprising:
and sending the article image information to a target mobile terminal so that the mobile terminal can share the article image information.
15. The method of claim 2, further comprising:
extracting item price information from the identification result information;
displaying the item price information on top of the item image information.
16. A method of weighing, the method comprising:
the method comprises the steps that a weighing equipment side obtains article image information of an article and sends the article image information to a server side; the article is placed on a weighing platform corresponding to the weighing equipment end;
the server side determines identification result information of the article according to the article image information, determines recommendation information of the article according to the identification result information, and sends the identification result information and the recommendation information to the weighing equipment side;
and the weighing equipment end displays the identification result information of the article in a first area of a display interface, and displays the recommendation information of the article in a second area of the display interface.
17. The method of claim 16, further comprising:
the weighing equipment end displays the article image information in a third area of the display interface; and the article image information is a preview picture shot by the camera equipment corresponding to the weighing equipment terminal.
18. The method of claim 16, further comprising:
the weighing equipment end acquires the weight information of the article weighed by the weighing platform;
and the weighing equipment end displays the weight information and the total price of the article at the position corresponding to the identification result information.
19. The method of claim 18, further comprising:
the weighing equipment end receives first selection operation on the identification result information under the condition that a plurality of pieces of identification result information are displayed in the second area;
the weighing equipment terminal selects target identification result information from the identification result selection information according to the first selection operation;
and the weighing equipment terminal takes the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
20. The method of claim 19, further comprising:
the weighing equipment end displays a printing label control in the second area;
after receiving a second trigger operation on the printing label control, the weighing equipment end generates a printing notice according to the target identification result information and the weight information;
the weighing equipment terminal sends a printing notice for printing the label of the article to the label printing equipment;
the label printing device prints an article label according to the print notification.
21. The method of claim 20, further comprising:
the weighing equipment end acquires the similarity between the target identification result information and the article image information;
the weighing equipment terminal adds check information to the printing notification under the condition that the similarity meets a first preset condition;
and the label scanning equipment executes the inspection prompting operation under the condition that the article label is scanned to have the inspection information.
22. The method of claim 21, wherein the tag scanning device performs a check prompt operation if the check information is scanned, comprising:
and the label scanning equipment controls an alarm lamp of the label scanning equipment to light up and/or sends a checking prompt message to a preset terminal under the condition that the checking information is scanned in the article label.
23. The method of claim 19, further comprising:
the server side acquires user identity information corresponding to the target identification result information;
the server side records the times of the condition that the similarity meets a first preset condition aiming at the user identity information;
and the server adds the user identity information into a blacklist under the condition that the times reach a preset number threshold.
24. The method of claim 23, further comprising:
the label scanning equipment acquires user identity information according to payment information under the condition that the payment information of a user is received;
and the label scanning equipment sends an intervention notification to a preset terminal under the condition that the user identity information is in the blacklist.
25. The method of claim 16, further comprising:
the weighing equipment end displays a material shooting task interface according to a third trigger operation under the condition that the third trigger operation for opening the material shooting task interface is received; the material shooting task interface displays the object to be shot and a shooting control;
the weighing equipment terminal selects a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
the weighing equipment end displays a material shooting interface under the condition of receiving a fourth trigger operation on the shooting control;
and the weighing equipment end acquires sample article image information of the target article to be shot in the material shooting interface and sends the sample article image information to the server end.
26. The method of claim 16, further comprising:
the weighing equipment end receives a seventh trigger operation for opening the item name association interface;
the weighing equipment end displays an article name association interface according to the seventh trigger operation;
and the weighing equipment end receives the association relationship between the item provider name of the item and the platform public item name of the item in the item name association interface, and sends the association relationship between the item provider name, the platform public name and the item provider identity of the item to a server end.
27. The method of claim 26, further comprising:
the weighing equipment terminal sends the identity of the target object provider to the server terminal;
the server determines identification result information of the article according to the article image information and determines recommendation information of the article according to the identification result information, and the method comprises the following steps:
the server side determines identification result information marked by a platform common name according to the article image information;
the server side determines a target article provider name corresponding to the target article provider identity information according to the incidence relation;
and the server replaces the mark of the identification result information by the name of the target object provider and sends the replaced identification result information to the weighing equipment.
28. The method of claim 16, further comprising:
and the weighing equipment terminal sends the article image information to a target mobile terminal so that the mobile terminal can share the article image information.
29. The method of claim 17, further comprising:
the weighing equipment end extracts item price information from the identification result information;
and the weighing equipment end displays the item price information on the item image information.
30. A weighing method is characterized by being applied to a weighing equipment end, and comprises the following steps:
acquiring article image information of an article and sending the article image information to a server; the article is placed on a weighing platform corresponding to the weighing equipment end;
receiving identification result information and the recommendation information sent by a server; the identification result information and the recommendation information are determined according to the article image information;
displaying the identification result information of the item in a first area of a display interface, and displaying the recommendation information of the item in a second area of the display interface.
31. A weighing method is applied to a server side, and comprises the following steps:
receiving article image information sent by a weighing device end;
according to the article image information, determining identification result information of the article and recommendation information of the article according to the identification result information, and sending the identification result information and the recommendation information to the weighing equipment end, so that the weighing equipment end can display the identification result information of the article in a first area of a display interface and display the recommendation information of the article in a second area of the display interface.
32. A method of weighing, the method comprising:
acquiring article image information of an article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
and according to the article image information, displaying the identification result information of the article in a first area of a display interface, and displaying the article image information in a third area of the display interface.
33. A weighing apparatus, characterized in that the apparatus comprises:
the image information acquisition module is used for acquiring article image information of an article; the article is placed on a weighing platform;
the first display module is used for displaying the identification result information of the article in a first area of a display interface according to the article image information and displaying the recommendation information of the article in a second area of the display interface.
34. The apparatus of claim 33, further comprising:
the second display module is used for displaying the article image information in a third area of the display interface; the article image information is a preview picture shot by the camera equipment.
35. The apparatus of claim 34, further comprising:
the area prompting module is used for displaying an article placement area mark in the third area; the article placement area mark is used for prompting the position of placing an article on the weighing platform.
36. The apparatus of claim 33, further comprising:
the list control display module is used for providing an article list display control in the display interface; and displaying an item list selection page after receiving a first trigger operation on the item list display control.
37. The apparatus of any one of claims 33-36, further comprising:
the weight obtaining module is used for obtaining the weight information of the articles weighed by the weighing platform;
the first display module is further used for displaying the weight information and the total price of the article at the position corresponding to the identification result information.
38. The apparatus of claim 37, further comprising:
a result selection operation receiving module, configured to receive a first selection operation on the identification result information when a plurality of pieces of identification result information are displayed in the second area;
a first result determination module configured to select target recognition result information from the plurality of recognition result selection information according to the first selection operation;
and the second result determining module is used for taking the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
39. The apparatus of claim 38, further comprising:
a label control display module for displaying a print label control in the second region;
the printing notification generation module is used for generating a printing notification according to the target identification result information and the weight information after receiving a second trigger operation on the printing label control;
and the printing notification sending module is used for sending a printing notification for printing the label of the article to the label printing device.
40. The apparatus of claim 39, further comprising:
the similarity obtaining module is used for obtaining the similarity between the target recognition result information and the article image information;
the inspection prompt information adding module is used for adding inspection information into the printing notification under the condition that the similarity meets a first preset condition; the check information is used for executing check prompting operation under the condition that the label scanning equipment scans the check information.
41. The apparatus of claim 40, further comprising:
the identity information acquisition module is used for acquiring user identity information corresponding to the target identification result information;
the frequency determining module is used for recording the frequency of the condition that the similarity meets a first preset condition aiming at the user identity information;
and the blacklist setting module is used for adding the user identity information into a blacklist under the condition that the times reach a preset number threshold.
42. The apparatus of claim 33, further comprising:
the material task interface triggering module is used for receiving a third triggering operation for opening a material shooting task interface;
the material interface display module is used for displaying a material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
the material selection module is used for selecting a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
the material shooting interface display module is used for displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
and the material uploading module is used for acquiring sample article image information of the target article to be shot in the material shooting interface and sending the sample article image information to the server.
43. The apparatus of claim 42, wherein the material uploading module comprises:
the material preview submodule displays a preview picture of the camera equipment in a fourth area of the material shooting interface;
and the uploading sub-module displays the sample article image information acquired from the preview picture in a fifth area of the material shooting interface and sends the sample article image information to a server.
44. The apparatus of claim 43, wherein the upload sub-module comprises:
the acquisition sub-module is used for acquiring sample article image information from the preview picture under the condition that a fifth trigger operation on the shooting control in the fifth area is received;
the image adding submodule is used for adding the article image information into the result display area in the fifth area to be displayed;
and the sending sub-module is used for sending the image information of the sample article to a server under the condition that a sixth trigger operation on the uploading control in the fifth area is received.
45. The apparatus of claim 43, further comprising:
the name association triggering module is used for receiving a seventh triggering operation for opening the item name association interface;
the name association interface display module is used for displaying the item name association interface according to the seventh trigger operation on the item name association interface;
and the association name sending module is used for receiving the corresponding relation between the item provider name of the item and the platform public name of the item in the item name association interface and sending the association relation between the item provider name, the platform public name and the item provider identity of the item to a server.
46. The apparatus of claim 33, further comprising:
and the image sending module is used for sending the article image information to a target mobile terminal by the weighing equipment terminal so that the mobile terminal can share the article image information.
47. The apparatus of claim 34, further comprising:
the article price extraction module is used for extracting article price information from the identification result information by the weighing equipment terminal;
and the item price combination display module is used for displaying the item price information on the item image information.
48. The weighing system is characterized by comprising a weighing equipment end and a server end; the weighing equipment end is correspondingly provided with at least one weighing platform;
the weighing apparatus end includes:
the image information acquisition module is used for acquiring article image information of an article and sending the article image information to the server; the article is placed on a weighing platform corresponding to the weighing equipment end;
the first display module is used for displaying the identification result information of the article in a first area of a display interface and displaying the recommendation information of the article in a second area of the display interface;
the server side comprises:
and the information determining module is used for determining the identification result information of the article according to the article image information, determining the recommendation information of the article according to the identification result information, and sending the identification result information and the recommendation information to the weighing equipment terminal.
49. The system of claim 48, wherein the weighing station corresponds to a camera, the weighing apparatus further comprising:
the second display module is used for displaying the article image information in a third area of the display interface; and the article image information is a preview picture shot by the camera equipment corresponding to the weighing equipment terminal.
50. The system of claim 48, wherein the weighing apparatus side further comprises:
the weight obtaining module is used for obtaining the weight information of the articles weighed by the weighing platform;
the first display module is further used for displaying the weight information and the total price of the article at the position corresponding to the identification result information.
51. The system of claim 50, wherein the weighing apparatus side further comprises:
a result selection operation receiving module, configured to receive a first selection operation on the identification result information when a plurality of pieces of identification result information are displayed in the second area;
a first result determination module configured to select target recognition result information from the plurality of recognition result selection information according to the first selection operation;
and the second result determining module is used for taking the identification result information as target identification result information under the condition that one piece of identification result information is displayed in the second area.
52. The system of claim 51,
the weighing equipment end further comprises:
a label control display module for displaying a print label control in the second region;
the printing notification generation module is used for generating a printing notification according to the target identification result information and the weight information after receiving a second trigger operation on the printing label control;
a print notification sending module for sending a print notification for printing a label of an article to a label printing device;
the label printing apparatus includes:
and the printing module is used for printing the label of the article according to the printing notice.
53. The system of claim 52, wherein a label scanning device is further arranged corresponding to the weighing device end;
the weighing equipment end further comprises:
the similarity obtaining module is used for obtaining the similarity between the target recognition result information and the article image information;
the inspection prompt information adding module is used for adding inspection information into the printing notification under the condition that the similarity meets a first preset condition;
the label scanning device is used for executing the inspection prompt operation under the condition that the article label is scanned to have the inspection information.
54. The system of claim 53, wherein the label scanning device comprises:
and the prompt submodule is used for controlling an alarm lamp of the label scanning equipment to light up and/or sending a check prompt message to a preset terminal under the condition that the label scanning equipment scans the check information in the article label.
55. The system of claim 48, wherein the server-side further comprises:
the identification result identity information acquisition module is used for acquiring user identity information corresponding to the target identification result information;
the frequency recording module is used for recording the frequency of the condition that the similarity meets a first preset condition aiming at the user identity information;
and the blacklist adding module is used for adding the user identity information into a blacklist under the condition that the times reach a preset number threshold value by the server.
56. The system of claim 55, wherein the tag scanning device further comprises:
the payment identity information acquisition module is used for acquiring user identity information according to the payment information under the condition that the label scanning equipment receives the payment information of a user;
and the intervention notification module is used for sending an intervention notification to a preset terminal under the condition that the user identity information is in the blacklist.
57. The system of claim 48, wherein the weighing apparatus side further comprises:
the material task interface triggering module is used for receiving a third triggering operation for opening a material shooting task interface;
the material interface display module is used for displaying a material shooting task interface according to the third trigger operation; the material shooting task interface displays the object to be shot and a shooting control;
the material selection module is used for selecting a target object to be shot under the condition that a second selection operation is received in the material shooting task interface;
the material shooting interface display module is used for displaying a material shooting interface under the condition that a fourth trigger operation on the shooting control is received;
the material uploading module is used for acquiring sample article image information of a target article to be shot in the material shooting interface and sending the sample article image information to the server;
the server is also used for training an article recognition model according to the sample article image information; the article identification model is used for identifying identification result information corresponding to the article image information.
58. The system of claim 48, wherein the weighing apparatus side further comprises:
the name association triggering module is used for receiving a seventh triggering operation for opening the item name association interface;
the name association interface display module is used for displaying the item name association interface according to the seventh trigger operation on the item name association interface;
an association name sending module, configured to receive, in the item name association interface, a correspondence between an item provider name of an item and a platform common name of the item, and send, to a server, an association relationship between the item provider name, the platform common name, and an item provider identifier of the item;
the server is further used for recording the association relation among the item provider name, the platform public name and the item provider identity of the item.
59. The system of claim 58, wherein the weighing apparatus side further comprises:
the article provider identity information sending module is used for sending the target article provider identity identifier to the server side by the weighing equipment side;
the server side further comprises:
the public name result identification module is used for determining identification result information marked by a platform public name according to the article image information;
the article provider name determining module is used for determining the name of the target article provider corresponding to the identity information of the target article provider according to the association relation;
and the article provider identification result sending module is used for replacing the mark of the identification result information by the name of the target article provider and sending the replaced identification result information to the weighing equipment terminal.
60. The system of claim 48, wherein the weighing apparatus side further comprises:
and the image sending module is used for sending the article image information to a target mobile terminal by the weighing equipment terminal so that the mobile terminal can share the article image information.
61. The system of claim 49, wherein the weighing apparatus side further comprises:
the article price extraction module is used for extracting article price information from the identification result information by the weighing equipment terminal;
and the item price combination display module is used for displaying the item price information on the item image information.
62. A weighing apparatus, for use at a weighing device, the apparatus comprising:
the image information acquisition module is used for acquiring article image information of an article and sending the article image information to the server; the article is placed on a weighing platform corresponding to the weighing equipment end;
the information receiving module is used for receiving the identification result information and the recommendation information sent by the server; the identification result information and the recommendation information are determined according to the article image information;
the first display module is used for displaying the identification result information of the article in a first area of a display interface and displaying the recommendation information of the article in a second area of the display interface.
63. A weighing device, characterized in that, be applied to the server side, the device includes:
the image receiving module is used for receiving the article image information sent by the weighing equipment end;
the information determining module is used for determining identification result information of the article according to the article image information, determining recommendation information of the article according to the identification result information, sending the identification result information and the recommendation information to the weighing equipment end, enabling the weighing equipment end to display the identification result information of the article in a first area of a display interface, and displaying the recommendation information of the article in a second area of the display interface.
64. A weighing apparatus, characterized in that the apparatus comprises:
the preview image acquisition module is used for acquiring article image information of an article; the article is placed on a weighing platform; the article image information is a preview picture shot by the camera equipment;
and the third display module is used for displaying the identification result information of the article in a first area of a display interface according to the article image information and displaying the article image information in a third area of the display interface.
65. An electronic device, comprising: a processor; and
a memory having executable code stored thereon that, when executed, causes the processor to perform the method of any of claims 1-32.
66. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of any of claims 1-32.
CN202010969888.5A 2020-09-15 2020-09-15 Weighing method, device and system Pending CN113297887A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010969888.5A CN113297887A (en) 2020-09-15 2020-09-15 Weighing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010969888.5A CN113297887A (en) 2020-09-15 2020-09-15 Weighing method, device and system

Publications (1)

Publication Number Publication Date
CN113297887A true CN113297887A (en) 2021-08-24

Family

ID=77318285

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010969888.5A Pending CN113297887A (en) 2020-09-15 2020-09-15 Weighing method, device and system

Country Status (1)

Country Link
CN (1) CN113297887A (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010218373A (en) * 2009-03-18 2010-09-30 Olympus Corp Server system, terminal apparatus, program, information storage medium, and image retrieving method
CN107767590A (en) * 2016-08-16 2018-03-06 深圳仪普生科技有限公司 Automatic identification commercialization bar code electronic scale and Automatic identification method
CN207510869U (en) * 2017-12-06 2018-06-19 北京创跃网络科技有限公司 A kind of bulk commodity self-identifying weighing device with packing frame
CN108303170A (en) * 2018-02-01 2018-07-20 京东方科技集团股份有限公司 The weighing method and smart electronics that smart electronics claim claim
CN108877109A (en) * 2018-05-25 2018-11-23 合肥民众亿兴软件开发有限公司 A kind of supermarket's guard against theft in market automatic identification weighing settlement method and system
CN109559195A (en) * 2018-11-07 2019-04-02 腾讯科技(深圳)有限公司 Shopping management method, system and relevant device for unmanned supermarket
CN109935300A (en) * 2017-12-19 2019-06-25 苏州恒鼎科技咨询有限公司 Intelligence Internet-based claims
CN110793607A (en) * 2019-09-24 2020-02-14 浙江大华技术股份有限公司 Self-service weighing method, system and computer readable storage medium
CN110942293A (en) * 2018-09-21 2020-03-31 阿里巴巴集团控股有限公司 Article information processing method, device, storage medium and system

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010218373A (en) * 2009-03-18 2010-09-30 Olympus Corp Server system, terminal apparatus, program, information storage medium, and image retrieving method
CN107767590A (en) * 2016-08-16 2018-03-06 深圳仪普生科技有限公司 Automatic identification commercialization bar code electronic scale and Automatic identification method
CN207510869U (en) * 2017-12-06 2018-06-19 北京创跃网络科技有限公司 A kind of bulk commodity self-identifying weighing device with packing frame
CN109935300A (en) * 2017-12-19 2019-06-25 苏州恒鼎科技咨询有限公司 Intelligence Internet-based claims
CN108303170A (en) * 2018-02-01 2018-07-20 京东方科技集团股份有限公司 The weighing method and smart electronics that smart electronics claim claim
CN108877109A (en) * 2018-05-25 2018-11-23 合肥民众亿兴软件开发有限公司 A kind of supermarket's guard against theft in market automatic identification weighing settlement method and system
CN110942293A (en) * 2018-09-21 2020-03-31 阿里巴巴集团控股有限公司 Article information processing method, device, storage medium and system
CN109559195A (en) * 2018-11-07 2019-04-02 腾讯科技(深圳)有限公司 Shopping management method, system and relevant device for unmanned supermarket
CN110793607A (en) * 2019-09-24 2020-02-14 浙江大华技术股份有限公司 Self-service weighing method, system and computer readable storage medium

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
GUANNAN CHEN等: "Study of image processing for MR Diffusion Weighed Image", 《2010 3RD INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING》 *
杨京;焦亭;杨雅婷;樊冰芬;平家乐;廉宇凯;: "具有自动识别功能的超市蔬果称重装置", 科技创新与生产力, no. 07 *
胡宏梅;姜子祥;: "基于无线射频识别技术的超市快速结算系统的设计与实现", 计算机测量与控制, no. 05 *

Similar Documents

Publication Publication Date Title
CN108320404B (en) Commodity identification method and device based on neural network and self-service cash register
CN110866429B (en) Missing scanning identification method, device, self-service cashing terminal and system
US8927882B2 (en) Commodity search device that identifies a commodity based on the average unit weight of a number of commodities resting on a scale falling within a predetermined weight deviation of a referece unit weight stored in a database
WO2019165892A1 (en) Automatic vending method and apparatus, and computer-readable storage medium
US8851375B2 (en) Systems and methods for facilitating in-aisle scanning
US10366379B2 (en) Remote weigh station with delayed fraud intervention
JP6549558B2 (en) Sales registration device, program and sales registration method
US8812376B2 (en) Techniques for generating an electronic shopping list
CN108960132B (en) Method and device for purchasing commodities in open type vending machine
US10839452B1 (en) Compressed network for product recognition
CN111311316B (en) Method and device for depicting merchant portrait, electronic equipment, verification method and system
CN110942293B (en) Method, device, storage medium and system for processing article information
CN112200631B (en) Industry classification model training method and device
CN117115571B (en) Fine-grained intelligent commodity identification method, device, equipment and medium
US10719673B2 (en) System and method for collecting and/or retrieving information relating to objects
RU2724797C1 (en) Cash register system and method for identification of courses on tray
CN110895781A (en) Dish type recommendation method and device, electronic equipment and storage medium
CN112396647A (en) Weighing method, payment method, information acquisition method and information acquisition device
CN113297887A (en) Weighing method, device and system
US20190355039A1 (en) Methods of managing and querying product inventory data and inventory management server
CN115761457A (en) Commodity identification method and device, electronic equipment and computer readable medium
US11928662B2 (en) End user training for computer vision system
US11380090B2 (en) Fast multi-modal object recognition system
CN109858446A (en) Article register method and device under a kind of new public safety
US11727470B2 (en) Optical scanning for weights and measures

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 40057556

Country of ref document: HK

TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20230705

Address after: Room 210, 2nd Floor, Juyang Building, No. 1200 Pudong Avenue, Pudong New Area (Shanghai) Pilot Free Trade Zone, Shanghai

Applicant after: HEMA (China) Co.,Ltd.

Address before: Box 847, four, Grand Cayman capital, Cayman Islands, UK

Applicant before: ALIBABA GROUP HOLDING Ltd.