CN111476624A - Information pushing method, device and equipment - Google Patents

Information pushing method, device and equipment Download PDF

Info

Publication number
CN111476624A
CN111476624A CN202010136162.3A CN202010136162A CN111476624A CN 111476624 A CN111476624 A CN 111476624A CN 202010136162 A CN202010136162 A CN 202010136162A CN 111476624 A CN111476624 A CN 111476624A
Authority
CN
China
Prior art keywords
seal
information
state
characteristic color
mark
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010136162.3A
Other languages
Chinese (zh)
Other versions
CN111476624B (en
Inventor
洪晶
张鹏
何田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Rajax Network Technology Co Ltd
Original Assignee
Rajax Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Rajax Network Technology Co Ltd filed Critical Rajax Network Technology Co Ltd
Priority to CN202010136162.3A priority Critical patent/CN111476624B/en
Publication of CN111476624A publication Critical patent/CN111476624A/en
Application granted granted Critical
Publication of CN111476624B publication Critical patent/CN111476624B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0633Lists, e.g. purchase orders, compilation or processing
    • G06Q30/0635Processing of requisition or of purchase orders
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083Shipping
    • G06Q10/0833Tracking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Data Mining & Analysis (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Image Analysis (AREA)

Abstract

The application discloses an information pushing method, device and equipment, relates to the technical field of information processing, and can automatically identify and transmit meal information upwards after a merchant finishes making meal products, so that a take-out platform can accurately obtain the meal information, and the distribution efficiency is improved. The method comprises the following steps: receiving a seal image of an uploaded object and an order identification of the uploaded object, wherein the seal image of the object is obtained based on the object packaged by a buckle with an identification, and a characteristic color block for marking a locking position is arranged on the buckle with the identification; detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance; judging whether the characteristic color block for marking the locking position in the facing slip image meets the facing slip condition or not; if so, indicating that the seal state of the object is a locking state; and updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object, and pushing the updated order information of the object.

Description

Information pushing method, device and equipment
Technical Field
The present application relates to the field of information processing technologies, and in particular, to an information pushing method, an information pushing device, and an information pushing apparatus.
Background
With the advent of the digital age, the take-out market has developed rapidly in recent years. For a sales logistics system, the pushing of meal delivery information is crucial to the delivery process. The actual distribution process is finally completed by distribution personnel, and how to accurately push the meal delivery information to the distribution end is beneficial to the distribution personnel to reasonably arrange the meal taking route and reduce the meal waiting time.
In the related technology, after a merchant finishes making a meal, the meal information such as a meal order, meal delivery time, a delivery address and the like can be manually uploaded and confirmed by using a scheduling system provided by a take-out platform, the scheduling system selects a proper delivery end by analyzing the meal delivery information pushed by the merchant, and plans a delivery path for delivery personnel, so that take-out delivery time is greatly shortened, and delivery efficiency is improved.
In the process of implementing the invention, the inventor finds that the related art has at least the following problems:
in the process of sending out meal information by a merchant, the flow of front-end users is limited or the delivery range is narrowed by the take-out platform due to the fact that the time of taking out meal is slow, the meal information can be uploaded and identified without making the meal, or if the merchant takes too many orders, the take-out information is uploaded in a perfect way, the accuracy rate of the take-out information obtained by the take-out platform is low, the accurate take-out information can not be provided for the delivery end, the equal meal time of delivery personnel and users is consumed, and the delivery efficiency is influenced.
Disclosure of Invention
In view of this, the application provides an information pushing method, an information pushing device and information pushing equipment, and mainly aims to solve the problems that in the prior art, the accuracy of meal delivery information acquired by a takeout platform is low, and the delivery efficiency is affected.
According to a first aspect of the present application, there is provided an information pushing method, including:
receiving a seal image of an uploaded object and an order identification of the uploaded object, wherein the seal image of the object is obtained based on the object packaged by a buckle with an identification, and a characteristic color block for marking a locking position is arranged on the buckle with the identification;
detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance;
judging whether the characteristic color block for marking the locking position in the facing slip image meets the facing slip condition or not;
if so, indicating that the seal state of the object is a locking state;
and updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object, and pushing the updated order information of the object.
Further, before the detecting the feature color block indicating the locking position in the seal image based on the pre-trained classification model, the method further comprises:
inputting a seal sample image carrying a characteristic color block information label into a neural network for training, and extracting parameter information of the characteristic color block in the seal sample image on different dimensions;
and constructing a classification model for identifying the characteristic color blocks according to the parameter information of the characteristic color blocks in the seal sample image on different dimensions.
Further, after the determining whether the characteristic color patch indicating the locking position in the seal image meets the seal condition, the method further includes:
if not, indicating that the seal state of the object is an unlocked state;
and processing the unlocked state into output prompt information of the object to be pushed.
Further, the determining whether the characteristic color block indicating the locking position in the seal image meets the seal condition specifically includes:
calculating relative position information between the related color blocks in the same plane according to the position information of the characteristic color block which marks the locking position in the seal image;
judging whether the relative position information between the associated color blocks in the same plane is within a preset distance range or not;
and if so, indicating that the seal state of the object is a locking state, otherwise, indicating that the seal state of the object is an unlocking state.
Further, the calculating, according to the position information of the characteristic color block indicating the locking position in the seal image, the relative position information between the associated color blocks in the same plane specifically includes:
extracting a characteristic color block in the same plane from a characteristic color block which marks a locking position in the seal image;
classifying the characteristic color blocks in the same plane, and screening out associated color blocks containing preset characteristics;
and calculating the relative position information between the associated color blocks in the same plane according to the position information of the associated color blocks containing the preset characteristics.
Further, after the classifying the feature color blocks in the same plane and screening out associated color blocks containing preset features, the method further includes:
and if the characteristic color blocks in the same plane do not have associated color blocks containing preset characteristics, indicating that the seal state of the object is an unlocked state.
Further, the updating the real-time timestamp of the locking state as the output time information of the object to the order information of the object according to the order identifier of the object and pushing the updated order information of the object specifically includes:
inquiring the order information of the object from a pre-stored order database according to the order identifier of the object, wherein the mapping relation between the order identifier of the object and the order information of the object is recorded in the pre-stored order database;
and binding the real-time timestamp of the locking state as output time information of the object into order information of the object, and pushing the updated order information of the object.
According to a second aspect of the present application, there is provided an information pushing method, including:
acquiring and transmitting a seal image of an object and an order mark of the object after the object is packaged on the basis of a buckle with a mark, wherein a characteristic color block for marking a locking position is arranged on the buckle with the mark;
identifying the seal state of the object according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object;
and if the seal state of the object indicates a locking state, binding the real-time timestamp of the locking state to the order identification of the object, and updating the order information of the object.
Further, the identifying the seal state of the object according to the relative position between the feature color blocks indicating the locking positions in the seal image of the object specifically includes:
judging whether the relative position between the characteristic color blocks which mark the locking position in the seal image of the object is within a preset distance range or not;
if so, determining that the seal state of the object is a locking state; otherwise, determining that the seal state of the object is an unlocked state.
Further, the acquiring a seal image of the object and an order identifier of the object based on the buckle packaged object with the identifier specifically includes:
when the object scanning request is detected, scanning a seal part of the object packaged on the basis of a buckle with an identifier to obtain a seal image of the object;
and scanning the graphic identification code of the object to acquire the order identification of the object.
Further, after the querying the seal status of the object according to the order identifier, the method further includes:
and if the facing slip state of the object is the unlocked state, re-acquiring and transmitting the facing slip image of the object according to the received output prompt information of the object.
Further, the method further comprises:
receiving order information of the updated object;
and if the output time information recorded in the order information of the updated object is inconsistent with the real-time timestamp bound to the object identifier, adopting the output time information recorded in the order information of the updated object to cover the real-time timestamp in the order information.
According to a third aspect of the present application, there is provided an information push apparatus, including:
the receiving unit is used for receiving a seal image of an uploaded object and an order mark of the uploaded object, the seal image of the object is obtained based on the object packaged by a buckle with a mark, and a characteristic color block for marking a locking position is arranged on the buckle with the mark;
the detection unit is used for detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance;
the judging unit is used for judging whether the characteristic color block which marks the locking position in the seal image meets the seal condition or not;
the first indicating unit is used for indicating that the seal state of the object is a locking state if the characteristic color block for marking the locking position in the seal image meets the seal condition;
and the first pushing unit is used for updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object and pushing the updated order information of the object.
Further, the apparatus further comprises:
the training unit is used for inputting the seal sample image carrying the characteristic color block information label into a neural network for training before the characteristic color block marking the locking position in the seal image is detected based on the pre-trained classification model, and extracting parameter information of the characteristic color block in the seal sample image on different dimensions;
and the construction unit is used for constructing a classification model for identifying the characteristic color blocks according to the parameter information of the characteristic color blocks in the seal sample image on different dimensions.
Further, the apparatus further comprises:
a second indicating unit, configured to, after the determining whether the characteristic color block indicating the locking position in the stamp image meets the stamp condition, indicate that the state of the stamp of the object is an unlocked state if the characteristic color block indicating the locking position in the stamp image does not meet the stamp condition;
and the second pushing unit is used for pushing the output prompt information which is processed into the target from the unlocked state.
Further, the judging unit includes:
the computing module is used for computing the relative position information between the related color blocks in the same plane according to the position information of the characteristic color block which marks the locking position in the seal image;
the first judgment module is used for judging whether the relative position information between the associated color blocks in the same plane is within a preset distance range or not;
the first indicating unit is further used for indicating that the seal state of the object is a locking state if the first indicating unit is within the preset distance range;
the second indicating unit is further used for indicating that the seal state of the object is an unlocked state if the seal state is not within the preset distance range.
Further, the calculation module includes:
the extraction submodule is used for extracting a characteristic color block in the same plane from a characteristic color block which marks a locking position in the seal image;
the screening submodule is used for classifying the characteristic color blocks in the same plane and screening out associated color blocks containing preset characteristics;
and the calculating submodule is used for calculating the relative position information between the associated color blocks in the same plane according to the position information of the associated color blocks containing the preset characteristics.
Further, the second indicating unit is further configured to, after the feature color blocks in the same plane are classified and associated color blocks including preset features are screened out, indicate that the seal status of the object is an unlocked status if the associated color blocks including the preset features do not exist in the feature color blocks in the same plane.
Further, the first pushing unit includes:
the query module is used for querying the order information of the object from a pre-stored order database according to the order identifier of the object, and the mapping relation between the order identifier of the object and the order information of the object is recorded in the pre-stored order database;
and the pushing module is used for binding the real-time timestamp of the locking state as the output time information of the object into the order information of the object and pushing the updated order information of the object.
According to a fourth aspect of the present application, there is provided an information pushing apparatus, including:
the system comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring and transmitting a seal image of an object and an order mark of the object after being packaged by a buckle with a mark, and a characteristic color block for marking a locking position is arranged on the buckle with the mark;
the identification unit is used for identifying the seal state of the object according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object;
and the updating unit is used for binding the real-time timestamp of the locking state to the order identification of the object and updating the order information of the object if the seal state of the object indicates the locking state.
Further, the identification unit includes:
the second judgment module is used for judging whether the relative position between the characteristic color blocks which mark the locking position in the seal image of the object is within a preset distance range or not;
the determining module is used for determining that the seal state of the object is a locking state if the relative position between the feature color blocks which mark the locking position in the seal image of the object is within a preset distance range;
the determining module is further configured to determine that the seal state of the object is an unlocked state if a relative position between feature color blocks indicating locking positions in the seal image of the object is not within a preset distance range.
Further, the first acquisition unit includes:
the first scanning module is used for scanning a seal part of the object packaged based on the buckle with the identification to acquire a seal image of the object when the object scanning request is detected;
and the second scanning module is used for scanning the graphic identification code of the object and acquiring the order identification of the object.
Further, the apparatus further comprises:
and the second obtaining unit is used for obtaining and transmitting the seal image of the object again according to the received output prompt information of the object if the seal state of the object is in an unlocked state after the seal state of the object is inquired according to the order mark.
Further, the apparatus further comprises:
the receiving unit is used for receiving the order information of the updated object;
and the covering unit is used for covering the real-time timestamp in the order information by adopting the output time information recorded in the order information of the updated object if the output time information recorded in the order information of the updated object is inconsistent with the real-time timestamp bound to the object identifier.
According to a fifth aspect of the present application, there is provided a buckle with an identifier, comprising:
the buckle head is provided with a first mark and is provided with a through hole;
the buckle body is connected with the buckle head, a second mark is arranged on the buckle body, the buckle body can penetrate through the through hole and is locked at a certain position, and the first mark and the second mark can be positioned on the same side;
and when the first mark and the second mark are positioned at the same side and the distance between the first mark and the second mark is within a preset distance range, the seal state is a locking state.
Further, when the first identifier and the second identifier are not located on the same side, or when the first identifier and the second identifier are located on the same side and the distance between the first identifier and the second identifier is not within a preset distance range, the seal state is an unlocked state.
Further, the buckle with the identification is used for packaging an object, and a photographing device acquires a seal image and an order identification of the object;
the first identification and the second identification are used for enabling the identification equipment to identify in the seal image to obtain the seal state of the object, so that when the seal state of the object is in a locking state, the updating equipment binds the real-time timestamp of the locking state to the order identification of the object and updates the order information of the object.
According to a sixth aspect of the present application, there is provided an information push system, comprising a receiving end and a sending end,
the sending end obtains and transmits a facing slip image of an object and an order identification of the object, wherein the facing slip image is based on a buckle with an identification, and a characteristic color block for marking a locking position is arranged on the buckle with the identification;
according to the relative position between the characteristic color blocks which mark locking positions in the seal image of the object, the sending end identifies the seal state of the object;
the receiving terminal receives the seal image of the uploaded object and the order identification of the object;
detecting a characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, and judging whether the characteristic color block which marks the locking position in the seal image meets the seal condition or not by the receiving end;
if the characteristic color block for marking the locking position in the seal image meets the seal condition, indicating that the seal state of the object is a locking state, updating a real-time timestamp of the locking state to the order information of the object by the receiving terminal according to the order identifier of the object by using the real-time timestamp as the output time information of the object, and pushing the updated order information of the object;
and if the seal state of the object indicates a locking state, the sending end binds the real-time timestamp of the locking state to the order identification of the object and updates the order information of the object.
According to a seventh aspect of the present application, there is provided a computer device comprising a memory storing a computer program and a processor implementing the steps of the method of the first and second aspects when the computer program is executed.
According to an eighth aspect of the present application, there is provided a readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of the first and second aspects described above.
By the technical scheme, compared with the information pushing mode which needs a take-out platform to manually upload and confirm meal information by a merchant in the existing mode, the information pushing method, the information pushing device and the information pushing equipment provided by the application receive the seal image of an uploaded object and the order mark of the object, recognize the characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, further judge whether the characteristic color block of the locking position in the seal image meets the seal condition, indicate that the seal state of the object is a locking state if the characteristic color block meets the seal condition, update the real-time timestamp of the locking state as the output time information of the object to the order information of the object according to the order mark of the object, push the updated order information of the object, can automatically recognize and transmit the meal information after the merchant finishes making the meal, and enable the take-out platform to accurately obtain the meal information, accurate meal delivery information is provided for a merchant end and a takeout platform end, the delivery efficiency of delivery personnel is improved, an effective informatization means is provided for offline, and the informatization and intelligentization process of catering service is promoted.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 shows a flow chart of an information push method provided by an embodiment of the present application;
fig. 2 is a schematic flowchart illustrating another information pushing method provided in an embodiment of the present application;
3a-3d show schematic structural diagrams of a clip with a logo provided by an embodiment of the present application during flipping;
fig. 4 is a schematic flowchart illustrating another information pushing method provided in an embodiment of the present application;
fig. 5 is a schematic flowchart illustrating another information pushing method provided in an embodiment of the present application;
fig. 6 is a schematic structural diagram illustrating an information pushing apparatus according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of another information pushing apparatus provided in the embodiment of the present application;
fig. 8 is a schematic structural diagram of another information pushing apparatus provided in the embodiment of the present application;
fig. 9 shows a schematic structural diagram of another information pushing apparatus provided in the embodiment of the present application.
Detailed Description
The present application will be described in detail below with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
At present, by means of the existing information pushing mode, after a merchant finishes making a meal, the meal information is manually uploaded to a take-out platform and confirmed, and along with the continuous excess of orders of the meal, the merchant has no time to consider the uploading of the meal information, so that the accuracy rate of the meal information acquired by the take-out platform is low, the accurate meal information cannot be provided for a delivery end, the equal meal time of delivery personnel and a user is consumed, and the delivery efficiency is influenced.
The information pushing system comprises a sending end and a receiving end, wherein the receiving end is a server end and is used for receiving a seal image of an uploaded object and an order identification of the uploaded object, the seal image of the uploaded object is obtained based on the object packaged by a buckle with an identification, a characteristic color block for marking a locking position is arranged on the buckle with the identification, the characteristic color block for marking the locking position in the seal image is identified based on a pre-trained classification model, whether the characteristic color block for marking the locking position in the seal image meets a seal condition or not is judged, if yes, the seal state of the uploaded object is indicated to be a locking state, a real-time timestamp of the locking state is used as output time information of the uploaded object to update the order information of the uploaded object according to the order identification of the uploaded object, and the order information of the uploaded object is pushed. The sending end is a merchant end and is used for obtaining and transmitting a seal image of an object and an order mark of the object after the object is packaged by a buckle with a mark, identifying the seal state of the object according to the relative position between characteristic color blocks for marking a locking position in the seal image of the object, binding a real-time timestamp of the locking state to the order mark of the object and updating the order information of the object if the seal state of the object indicates a locking state. Specifically, in the practical application process, a merchant end can acquire and upload a seal image of an object packaged based on a buckle with an identifier by using scanning equipment, the seal image is identified by using a pre-configured AI module, and a server can detect a characteristic color block which marks a locking position in the seal image by using a pre-trained classification model, so that the seal state of the object is output, and order information of the object is accurately acquired.
In order to solve the problem, this embodiment provides an information pushing method, as shown in fig. 1, where the method is applied to a server, and specifically includes:
101. and receiving the seal image of the uploaded object and the order identification of the object.
It can be understood that, in order to improve the safety of the food, the merchant uses the food security seal to package the prepared food, so that the food can be protected from being opened by outsiders in the distribution process to a certain extent, and the food can be taken by the user with ease. The food safety seal can be in the form of a disposable buckle and a disposable seal.
Under the general condition, disposable buckle can be used for once only sealing taking out meal article packing, ties up partial shape difference according to the buckle main part and divide into banding and column, prevents that meal article packing from being torn open in the distribution process, has received liking of numerous trade companies, especially disposable banding buckle, and disposable banding buckle here can select the buckle that has the sign. The buckle that has the sign is being utilized to carry out meal article encapsulation in-process by specific trade company, for the convenience of judging the facing slip state to the buckle that has the sign, can set up the characteristic color lump of sign locking position on the buckle that has the sign as the sign, for example, be provided with a black circular color lump on the buckle discount, buckle is overhead to have a plurality of red triangle-shaped color lumps, and arrange on the coplanar, make the lock body that the buckle head was worn into to the buckle body through upset buckle afterbody, after locking the buckle body, unable reverse movement buckle body, in order to encapsulate meal article.
The seal image of the object is obtained based on the object packaged by the buckle with the identification, and the buckle with the identification is provided with a characteristic color block for marking a locking position. The specific merchant can shoot the packaged meal through the intelligent equipment with the shooting function and upload the seal image of the object.
It should be noted that the photographed facing slip image needs to include at least a feature color block of a locking position on the buckle with a mark after packaging, such as a red triangle color block, a black circle color block, a blue square color block, and the like. Of course, the color block may have other shapes or colors, and the embodiment of the present invention is not limited.
In the embodiment of the invention, the seal image of the object is generally an image shot by a merchant at a packaging position after the food packaging is finished, and as the merchant packages the food as the final step before the food is delivered, errors such as poor sealing, packaging missing and the like occur in the packaging process along with the increasing number of the food.
102. And detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance.
Because the buckle with the identification is turned over to finish the packaging process of the dinnerware, the specific graphic color blocks arranged on the positions of the buckle with the identification can change the relative position relationship along with the turning over, for example, at the beginning of packaging the dinnerware, the black circular color block at the head part of the buckle is positioned at the front side, the red triangular color blocks at the body part of the buckle are positioned at the back side, and along with turning over the buckle tail, the triangular color blocks are gradually turned over to the front side and pass through the lock body, so that the packaging process of the dinnerware is finished.
The pre-trained classification model can identify the characteristic color blocks which mark the locking positions in the seal image, for example, the colors, shapes, position information and the like of the characteristic color blocks can be specifically input into a network model with learning capability in the process of training the classification model, parameter information of the characteristic color blocks marked with label information such as colors, shapes, positions and the like is extracted by using the network model, and the parameter information of the characteristic color blocks in different dimensions is mapped into weight parameters of the identification characteristic color blocks in different dimension information, so that the classification model for identifying the characteristic color blocks is constructed.
It should be noted that, there are a plurality of characteristic color blocks arranged on the buckle with the mark, and not all the characteristic color blocks are displayed in the seal image, and here, only the characteristic color blocks appearing in the seal image that mark the locking position are identified, so as to extract the relevant information such as the color, shape, position, and the like of the characteristic color blocks.
103. And judging whether the characteristic color block for marking the locking position in the seal image meets the seal condition.
It can be understood that the food packaging state relates to whether the food can be delivered, and for the packaged food, the seal state should be locked, and the buckle with the identification has the characteristics of being anti-disassembling and irreversible, so that whether the food is damaged in the food delivery process can be detected to a certain extent, and for the unpackaged food, the packaging state should be unlocked, and the food cannot be delivered. In order to obtain accurate meal delivery time of a merchant, the meal packaging process is used as the last link of meal delivery, and corresponding time when the seal state is locked can be used as meal delivery time and uploaded to order information of an outside platform.
The sealing label image is provided with a locking position, the locking position is marked on the locking position, the sealing state of the object is different, for the black circular color block, if the sealing label state of the disposable clamping tape state is locked, the relative distance between the black circular color block and the red triangular color block in the same plane is short, and if the sealing label state of the disposable clamping tape state is unlocked, the black circular color block and the red triangular color block are not in the same plane or are far away from each other.
In the embodiment of the present invention, specifically, in the process of determining whether the characteristic color block indicating the locking position in the seal image meets the seal condition, since a plurality of characteristic color blocks may appear in the seal image, and the characteristic color blocks have different position information, and the position information of not all the characteristic color blocks has the determined referential property, the related color blocks identifying the locking position in the seal image can be screened out from the plurality of characteristic color blocks, and whether the related color blocks identifying the locking position in the seal image are located on the same plane and the relative distance between the characteristic color blocks is further determined, so as to determine the seal state of the object.
104. And if so, indicating that the seal state of the object is a locking state.
And if the characteristic color block at the locking position in the seal image meets the seal condition, the fact that the buckle with the identification completely encapsulates the meal is indicated, the meal can be delivered, and the seal state of the object is indicated to be the locking state.
105. And updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object, and pushing the updated order information of the object.
The order identification of the object can be an order barcode image, a two-dimensional code image and other identifications used for describing order information of food, and particularly in the practical application process, a merchant can scan the order barcode image or the two-dimensional code image by using PDA equipment to extract the order information.
In the embodiment of the invention, the seal states of different objects can determine whether the meal can be delivered or not, and a merchant can be reminded of whether to package again or not. For the last operation step that the seal state is the locking state and is output as a judgment object, the real-time timestamp of the locking state can be directly updated into the order information of the object as the output time information of the object, and the updated order information is pushed to the takeout platform, so that the condition that a dealer manually confirms the food information is not needed.
In the embodiment of the invention, a merchant does not need to confirm whether the packaging is finished, but a classification model in a server is used for identifying the characteristic color block in the seal image, judging whether the characteristic color block meets the seal condition to determine the packaging state, digitalizing the packaging state into different state information and then automatically transmitting the different state information, and the merchant does not need to manually upload the output time information of the object, so that the accuracy of the output time information is improved.
Compared with the information pushing method which needs a take-out platform to manually upload and confirm meal information in the existing method, the information pushing method provided by the embodiment of the invention receives a seal image of an uploaded object and an order mark of the object, identifies a characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, further judges whether the characteristic color block of the locking position in the seal image meets a seal condition, indicates that the seal state of the object is a locking state if the characteristic color block meets the seal condition, updates the output time information of the object by taking a real-time timestamp of the locking state as the output time information of the object according to the order mark of the object, pushes the order information of the updated object, can automatically identify and send out the meal information after the merchant finishes making the meal, enables the take-out platform to accurately obtain the meal information, and provides accurate meal information to the merchant terminal and the take-out platform terminal, the distribution efficiency of distribution personnel is improved, an effective informatization means is provided for the offline, and the informatization and intelligentization process of the catering service is promoted.
Further, as a refinement and an extension of the specific implementation of the foregoing embodiment, in order to fully describe the specific implementation process of the present embodiment, the present embodiment provides another information pushing method, as shown in fig. 2, where the method includes:
201. and receiving the seal image of the uploaded object and the order identification of the object.
202. Inputting the seal sample image carrying the characteristic color block information label into a neural network for training, and extracting parameter information of the characteristic color block in the seal sample image on different dimensions.
In the embodiment of the invention, as the tail part of the buckle with the mark in the packaging process is turned over to form the seal images in different packaging states, the seal sample images in different packaging states can be collected in a test scene and an offline scene, the seal sample images in different sealing states are marked, the color, the shape and the position information of the characteristic color block in the seal sample image in different packaging states are confirmed, and the seal sample image with the characteristic color block information label is input into a neural network for training.
It can be understood that the parameter information of the characteristic color blocks in the seal sample image in different dimensions can reflect the information of the color, shape, position, etc. of the characteristic color blocks in the seal sample image, and the information of the color, shape, position, etc. of the characteristic color blocks in the seal sample image in different seal states has relativity, for example, the relative positions of the characteristic color blocks in the seal sample image are far away or not in the same plane in the unlocked state, and the relative positions of the characteristic color blocks in the seal sample image are close in the locked state.
203. And constructing a classification model for identifying the characteristic color blocks according to the parameter information of the characteristic color blocks in the seal sample image on different dimensions.
The parameter information of the characteristic color blocks in the seal sample image on different dimensions can embody the seal state of a buckle with a mark in the seal image, so that the mapping relation between the parameter information of the characteristic color blocks on different dimensions and the packaging state is formed, and the classification model for identifying the characteristic color blocks can be constructed by utilizing the mapping relation between the parameter information of the characteristic color blocks on different dimensions and the packaging state.
Specifically, in the process of training and constructing the classification model by the neural network, the forward propagation and backward propagation parameters can be continuously obtained by using the labels of the color, shape and position information of the characteristic color blocks in the seal sample image in different packaging states, and the parameter information of the characteristic color blocks in the seal sample image on different dimensions can be extracted. Generally, a neural network is composed of a multilayer structure, such as a convolution layer, a pooling layer and a full connection layer, parameter information of characteristic color blocks in a seal sample image on different dimensions can be extracted through the convolution layer, dimension reduction processing can be performed on the parameter information of the characteristic color blocks in the seal sample image on the different dimensions through the pooling layer, the parameter information of the characteristic color blocks in the seal sample image on the different dimensions after dimension reduction can be summarized through the full connection layer, weight values representing the different dimensions in the seal sample image are formed, identification results of the characteristic color blocks in the seal sample image can be generated according to the weight values representing the different dimensions in the seal sample image through a classification layer, and a classification identification model is constructed.
204. And detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance.
Specifically, in the application process, the feature color blocks of the locking positions in the seal image can be identified by using the pre-trained classification model, and the feature color blocks comprise feature information such as the colors, shapes and positions of the feature color blocks, for example, red triangle color block m1(a1, b1), red triangle color block m (a2, b2), red triangle color block m3(a3, b3), black circle color block n (a4, b4) and the like.
It can be understood that the pre-trained classification model can only identify the characteristic color blocks in the seal image, the characteristic color blocks at the lock body position of the buckle are used as the key color blocks for judging the seal state, and no matter whether the seal image is in any seal state, the characteristic color blocks for representing the lock body position of the buckle inevitably exist in the characteristic color blocks at the lock position in the identification seal image. And the characteristic color blocks at the tail of the buckle may not necessarily appear in the seal image for different seal states, and for the seal image in an unlocked state, if the characteristic color blocks are not yet turned to the forward direction, the characteristic color blocks may not appear in the seal image, so that the characteristic color blocks identified in the seal image may be only partial characteristic color blocks or a small number of characteristic color blocks.
205. And calculating the relative position information between the related color blocks in the same plane according to the position information of the characteristic color block which marks the locking position in the seal image.
In the embodiment of the invention, in the process of turning over the tail part of the buckle, more characteristic color blocks may appear, and the characteristic color blocks in the same plane can be used for judging the seal state of the object, wherein the key color blocks and other color blocks can be bound into related color blocks, if only the key color blocks exist in the same plane, namely if the related color blocks containing preset characteristics do not exist in the characteristic color blocks in the same plane, the buckle tail of the disposable buckle is not turned over, the meal cannot be locked, and the seal state of the object is indicated to be in an unlocked state.
If the associated color blocks with the preset features in the same plane appear, certainly, the associated color blocks may not be the key color block and one other color block, and may also be the key color block and a plurality of other color blocks, it is indicated that the tail of the buckle is turned over, the meal can be gradually locked, specifically, the feature color blocks in the same plane can be extracted from the feature color blocks marking the locking positions in the seal image, the feature color blocks in the same plane are classified, the associated color blocks containing the preset features are screened out, and the relative position information between the associated color blocks in the same plane is calculated according to the position information of the associated color blocks containing the preset features.
206. And judging whether the relative position information between the associated color blocks in the same plane is within a preset distance range.
In the turning process of the buckle with the mark, the position information of the characteristic color block on the buckle can be changed continuously, the specific turning process can be shown in figures 3a-3d, figures 3a and 3b show the position information of the characteristic color block in the buckle with the mark when the tail part of the buckle is not turned, the black circular color block is the key color block at the shooting front, the red triangular color block is at the back, the packaging action is not started at the moment, the tail part of the buckle can pass through the lock body along with the action of turning the tail part of the buckle, the red triangular color block is gradually turned over to the front, as shown in figure 3c, the tail part of the buckle penetrates through the lock body part, three red triangular color blocks are leaked, the relative positions of the red triangular color block and the black circular color block are far away, the packaging action is carried out at the moment, but the locking state is not presented, and finally the tail part of, as shown in fig. 3d, one of the triangular color blocks is exposed and shielded by the lock body, and the red triangular color block is closer to the black circular color block, so that the packaging action is completed and the locking state is presented.
It can be understood that, when the disposable snap is designed, a black circular color block and a plurality of red triangular color blocks exist, and a distance between each red triangular color block does not exceed a preset distance range, for example, the distance between the red triangular color blocks is 1cm, then the preset distance range is at least 1cm, and preferably 2 times the distance between the red triangular color blocks, which may be set according to actual situations, and the embodiment of the present invention is not limited.
207a, indicating that the seal state of the object is a locking state.
In the embodiment of the invention, the specific red triangular color blocks can pass through the lock body where the black circular color block is located in the process of packaging the meal, the relative position information among the associated color blocks can indicate whether the red triangular color block passes through the lock body, the relative position information among the associated color blocks which do not pass through the lock body is positive, the relative position information among the associated color blocks which pass through the lock body is negative, if the relative position information of the lock body where the red triangular color block and the black circular color block are located is within the preset distance range, the seal state of the object is indicated to be in the locking state, and the seal state of the object can be in the locking state with higher strength as the number of the red triangular color blocks which pass through the lock body is more.
208a, inquiring the order information of the object from a pre-stored order database according to the order identifier of the object.
The order information is transmitted to the server at the first time when the merchant receives the order, the server stores a large amount of order information for ordering by customers, in order to avoid confusion of corresponding relations among data caused by overlarge data quantity, the merchant can store the order information by using the order database, and generate order information for each order identifier, so that the mapping relation between the order identifiers and the order information is formed.
209a, binding the real-time timestamp of the locking state as output time information of the object to order information of the object, and pushing the updated order information of the object.
In the embodiment of the invention, the object in the locking state can directly output complete order information, namely the order information containing the output time information, so that distribution personnel can arrange the distribution task according to the output time information in the order information.
It can be understood that the takeaway platform is generally an information platform with a data scheduling function, and specifically, after the updated order information of the object is pushed to the takeaway platform, the second device may match the corresponding delivery client according to the updated order information of the object, so as to screen out the optimal delivery client to perform corresponding food delivery.
Corresponding to step 207a, step 207b indicates that the state of the seal of the object is unlocked.
In the embodiment of the invention, if the relative position information between the associated color blocks in the same plane is not in the preset distance range, the result shows that the red triangular color block is not close to the black circular color block after being turned over, the meal cannot be locked, and the sealing state of the object is in an unlocked state.
208b, processing the unlocked state into output prompt information of the target to be pushed.
In the embodiment of the invention, if the seal state of the object is the unlocked state, it indicates that the meal does not finish the meal and the meal time cannot be uploaded, the object identifier of the timestamp can be processed into digital information by combining with the seal state of the unlocked state, and then output prompt information is generated and sent to the client of the merchant so as to remind the merchant of re-packaging the meal and re-uploading the packaged image of the object and the order information of the object.
The embodiment provides another information pushing method, as shown in fig. 4, the method is applied to a merchant terminal, and specifically includes:
301. and acquiring and transmitting a seal image of the object and an order identification of the object after the object is packaged by the buckle with the identification.
It can be understood that, in order to align the buckle position of shooting the meal package, the merchant can shoot the packaged meal with the buckle with the identification after aligning the shot equipment, and certainly, a plurality of shooting equipment can be arranged at different shooting angles to acquire the seal images of more objects, so that the seal image of the buckle position with the identification can be accurately acquired.
In the embodiment of the invention, because the object cannot accurately determine whether the object is completely packaged after being packaged and cannot accurately record the output time, when the object scanning request is detected, the seal part of the object is scanned, the seal image of the object is acquired and transmitted, the graphic identification code of the object is scanned, and the order identification of the object is acquired and transmitted.
302. And identifying the seal state of the object according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object.
In the embodiment of the invention, the accurate meal delivery time sent by the merchant terminal can provide convenience for the rider, save the waiting time of the rider, and also can be used as the responsibility basis of the merchant and the rider when the meal delivery delay occurs. In order to accurately obtain the meal delivery time of a merchant, the meal is required to be packaged before the meal is manufactured and delivered, and the packaged meal is not easy to be tampered after the buckle with the mark is locked, so that whether the meal packaging is finished or not can be accurately indicated unless the buckle is cut off or the packaging bag is damaged. According to the embodiment of the invention, whether the meal is packaged completely or not, namely the seal state of the object, can be used as the basis for the meal delivery time of the merchant.
It can be understood that, in order to facilitate merchant query, the merchant end may bind and store the seal state of the object and the order identifier of the corresponding object, and may further query the seal state of the object according to the order identifier.
In the embodiment of the invention, whether the relative position between the characteristic color blocks for marking the locking position in the seal image of the object is within the preset distance range can be judged; if so, determining that the seal state of the object is a locking state; otherwise, determining the seal state of the object as an unlocked state.
303. And if the seal state of the object indicates a locking state, binding the real-time timestamp of the locking state to the order identification of the object, and updating the order information of the object.
It can be understood that the service end outputs the seal state of the object to the merchant end after identifying the seal image, and if the seal state of the object indicates a locking state, the updated order information of the object is acquired and displayed; and if the facing slip state of the object indicates an unlocked state, re-acquiring and transmitting the facing slip image of the object according to the received output prompt information of the object.
In order to ensure the accuracy of the output order information, the content in the order information may be verified after receiving the order information of the updated object sent by the server, and if the output time information recorded in the order information of the updated object is not consistent with the real-time timestamp bound to the object identifier, the output time information recorded in the order information of the updated object is adopted to cover the real-time timestamp in the order information, and if the output time information is consistent, the order information does not need to be modified.
It can be understood that, in the embodiment of the present invention, the buckle with the mark is provided as a tool for packaging an object, the feature color blocks described above correspond to different marks arranged on the buckle with the mark, the black circular feature color block corresponds to a first mark arranged on a buckle head of the buckle with the mark, and the red triangular feature color block corresponds to a second mark arranged on a buckle body of the buckle with the mark, where the first mark and the second mark are not limited.
After the object is packaged and finished based on the buckle with the identification, in order to better determine whether the object is packaged well, when the first identification and the second identification in a seal image formed based on the buckle with the identification accord with seal conditions, the seal state of the object is a locking state; otherwise, the seal state of the object is an unlocked state.
Further, in order to describe the structure of the buckle with the identifier more in detail, the buckle with the identifier provided in the embodiment of the present invention is used for identifying the state of the seal, and can be used as a food security seal in a form, which is shown in fig. 3a and 3b, and specifically includes a buckle head, wherein the buckle head is provided with a first identifier, such as a circular color block, and the buckle head is provided with a through hole; the buckle body is connected with the buckle head, a second mark such as a triangular color block is arranged on the buckle body, the buckle body can penetrate through the through hole and is locked at a certain position by combining the graph shown in the figure 3c and the figure 3d, the first mark and the second mark can be positioned on the same side, and when the first mark and the second mark are positioned on the same side and the distance between the first mark and the second mark is within a preset distance range, the seal state is a locking state; otherwise, the seal state is an unlocked state. Specifically, when the first mark and the second mark are not located on the same side, or even if the first mark and the second mark are located on the same side, the distance between the first mark and the second mark is not within the preset distance range, the seal state is an unlocked state.
Further, when the first identifier and the second identifier are not located on the same side, or when the first identifier and the second identifier are located on the same side and the distance between the first identifier and the second identifier is not within the preset distance range, the seal state is an unlocked state. See in particular the implementation of steps 302-303.
Further, the buckle with the identification is used for packaging the object, and the photographing equipment acquires a seal image and an order identification of the object; the first identification and the second identification are used for the identification equipment to identify in the seal image so as to obtain the seal state of the object, so that when the seal state of the object is in a locking state, the updating equipment binds the real-time timestamp of the locking state to the order identification of the object and updates the order information of the object. See in particular the implementation process of updating the order information of the object in step 303.
An embodiment of the present invention provides another information pushing method, as shown in fig. 5, the method relates to interaction between a merchant terminal and a server, and includes:
401. and the merchant terminal acquires and transmits a seal image of the object and an order mark of the object, wherein the seal image is based on the buckle packaged object with the mark.
The inventor realizes that how to accurately acquire the time information of the output meals of the merchants is a long-standing difficulty for the service industry such as catering, supermarkets and the like which can be distributed at present. The time when the merchant accurately outputs the goods has decisive significance for responsibility distribution in the distribution fulfillment process, for example, when the goods distribution is over time, the merchant output may be slow or the distribution of the distribution personnel may be slow, but if the merchant output is considered to be slow once, besides the responsibility of the merchant, the merchant is further caused to execute a flow management policy for ordering the merchant, so that the initiative of the merchant in providing the output time is not high, the willingness is low, and the output time acquired by the takeout platform is likely to be false or inaccurate.
The invention is described in the catering industry. In the catering industry, the buckle with the identification is gradually popular on the package of the food to be delivered, and the buckle with the identification protects the food from being manually opened in the delivery process to a certain extent, so that the safety image of the delivered food is improved, and customers and merchants are relieved. Guiding documents are provided for service monitoring parties in many urban areas, and the use of the buckle with the identification is widely popularized, so that the packaging of the food by the buckle with the identification becomes a necessary packaging action in the outward delivery process of the catering industry. Considering that the packaging of the disposable fastener to the meal is the last link of the packaging of the meal, the time point of the packaging completion of the fastener with the identification can be used as a perfect time point of the meal output, and the fastener has the characteristics of disassembly prevention and irreversible performance after the packaging is completed, and can prevent the cheating of a merchant to a certain extent.
402. And identifying the seal state of the object by the merchant terminal according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object.
In the embodiment of the present invention, the merchant end may also set a local identification module, and identify the tag state of the object according to the relative position between the feature color blocks indicating the locking position in the tag image of the object, where the specific identification process of the identification module may be the same as the process of determining whether the feature color block indicating the locking position in the tag image meets the tag condition in the following server.
403. And the server receives the seal image of the uploaded object and the order identification of the object.
404. The server detects a characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, judges whether the characteristic color block which marks the locking position in the seal image meets the seal condition, if so, executes the following step 405, otherwise, executes the following step 406.
405. And updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identification server of the object, and pushing the updated order information of the object to a take-out platform and a merchant terminal.
The takeout platform can create order information at the first time when a customer order is received and send the order information to the merchant terminal, so that the merchant terminal can make a corresponding meal, the server can identify the seal image after the merchant terminal completes the making and packaging of the meal to confirm whether the meal is packaged completely, and after the package is confirmed to be complete, the order information carrying output time information can be transmitted to the takeout platform and the merchant terminal, so that the takeout platform and the merchant can continuously update the order information to ensure the accuracy of displaying the order information.
406. And processing the unlocked state into output prompt information of the object, and pushing the output prompt information to a merchant terminal.
It can be understood that, when the server identifies the seal image, it is confirmed that the meal is not packaged completely, and no information is sent to the takeaway platform, but output prompt information of the object is generated and sent to the merchant terminal to prompt the merchant terminal to re-package the meal and re-upload the packaged image of the object.
407. And if the seal state of the object indicates a locking state, the sending end binds the real-time timestamp of the locking state to the order identification of the object and updates the order information of the object.
408. And if the output time information recorded in the order information of the updated object is inconsistent with the real-time timestamp bound to the object identifier, adopting the output time information recorded in the order information of the updated object to cover the real-time timestamp in the order information.
Further, as a specific implementation of the method in fig. 1 and fig. 2, an embodiment of the present application provides an information pushing apparatus, as shown in fig. 6, the apparatus includes: a receiving unit 51, a recognition unit 52, a judgment unit 53, a first instruction unit 54, and a first pushing unit 55.
The receiving unit is used for receiving a seal image of an uploaded object and an order mark of the uploaded object, the seal image of the object is obtained based on the object packaged by a buckle with a mark, and a characteristic color block for marking a locking position is arranged on the buckle with the mark;
the detection unit 52 may be configured to detect a feature color patch indicating a locking position in the seal image based on a classification model trained in advance;
the judging unit 53 may be configured to judge whether a feature color block indicating a locking position in the seal image conforms to a seal label;
the first indicating unit 54 may be configured to indicate that the tag state of the object is a locked state if the feature color block indicating the locking position in the tag image meets the tag condition;
the first pushing unit 55 may be configured to update the real-time timestamp of the locking state to the order information of the object as the output time information of the object according to the order identifier of the object, and push the updated order information of the object.
Compared with the information pushing mode which needs a take-out platform to manually upload and confirm meal information in the existing mode, the information pushing device provided by the embodiment of the invention receives a seal image of an uploaded object and an order mark of the object, identifies a characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, further judges whether the characteristic color block of the locking position in the seal image meets a seal condition, indicates that the seal state of the object is a locking state if the characteristic color block meets the seal condition, updates the output time information of the object by taking a real-time timestamp of the locking state as the output time information of the object according to the order mark of the object, pushes the order information of the updated object, can automatically identify and send out the meal information after the merchant finishes making the meal, enables the take-out platform to accurately obtain the meal information, and provides accurate meal information to the merchant terminal and the take-out platform terminal, the distribution efficiency of distribution personnel is improved, an effective informatization means is provided for the offline, and the informatization and intelligentization process of the catering service is promoted.
In a specific application scenario, as shown in fig. 7, the apparatus further includes:
the training unit 56 may be configured to, before the pre-trained classification model is used to detect the feature color block indicating the locking position in the seal image, input the seal sample image carrying the feature color block information tag into a neural network for training, and extract parameter information of the feature color block in the seal sample image in different dimensions;
the constructing unit 57 may be configured to construct a classification model for identifying the characteristic color blocks according to parameter information of the characteristic color blocks in the seal sample image in different dimensions.
In a specific application scenario, as shown in fig. 7, the apparatus further includes:
the second indicating unit 58 may be configured to, after determining whether the feature color block indicating the locking position in the stamp image meets the stamp condition, indicate that the state of the stamp of the object is an unlocked state if the feature color block indicating the locking position in the stamp image does not meet the stamp condition;
the second pushing unit 59 may be configured to push the output prompt information that is processed as the target in the unlocked state.
In a specific application scenario, as shown in fig. 7, the determining unit 53 includes:
the calculating module 531 may be configured to calculate, according to the position information of the characteristic color block indicating the locking position in the seal image, relative position information between the associated color blocks in the same plane;
the first determining module 532 may be configured to determine whether the relative position information between the associated color blocks in the same plane is within a preset distance range;
the first indicating unit 54 may be further configured to indicate that the seal state of the object is a locked state if the first indicating unit is within the preset distance range;
the second indicating unit 58 may be further configured to indicate that the seal status of the object is an unlocked status if the object is not within the preset distance range.
In a specific application scenario, as shown in fig. 7, the calculating module 531 includes:
the extraction sub-module 5311 may be configured to extract a feature color block in the same plane from a feature color block indicating a locking position in the seal image;
the screening submodule 5312 may be configured to classify the feature color patches in the same plane, and screen out associated color patches that include preset features;
the calculating sub-module 5313 may be configured to calculate, according to the position information of the associated color blocks with the preset features, relative position information between the associated color blocks in the same plane.
In a specific application scenario, as shown in figure 7,
the second indicating unit 58 may be further configured to determine that the seal status of the object is an unlocked status if there is no related color block containing a preset feature in the feature color blocks in the same plane after the feature color blocks in the same plane are classified and related color blocks containing a preset feature are screened out.
In a specific application scenario, as shown in fig. 7, the first pushing unit 55 includes:
the query module 551 may be configured to query the order information of the object from a pre-stored order database according to the order identifier of the object, where a mapping relationship between the order identifier of the object and the order information of the object is recorded in the pre-stored order database;
the pushing module 552 may be configured to bind the real-time timestamp of the locking state as output time information of the object to order information of the object, and push updated order information of the object.
Further, as a specific implementation of the method in fig. 4, an embodiment of the present application provides an information pushing apparatus, as shown in fig. 8, the apparatus includes: a first acquisition unit 61, a recognition unit 62, and an update unit 63.
The first obtaining unit 61 may be configured to obtain and transmit a seal image of an object and an order identifier of the object, where the seal image is based on a buckle with an identifier, and a characteristic color block indicating a locking position is disposed on the buckle with the identifier;
the identification unit 62 may be configured to identify a tag state of the object according to a relative position between feature color blocks indicating a locking position in a tag image of the object;
the updating unit 63 may be configured to, if the tag status of the object indicates a locking status, bind the real-time timestamp of the locking status to the order identifier of the object, and update the order information of the object.
Compared with the information pushing mode which needs a take-out platform to manually upload and confirm meal information in the existing mode, the information pushing device provided by the embodiment of the invention receives a seal image of an uploaded object and an order mark of the object, identifies a characteristic color block which marks a locking position in the seal image based on a pre-trained classification model, further judges whether the characteristic color block of the locking position in the seal image meets a seal condition, indicates that the seal state of the object is a locking state if the characteristic color block meets the seal condition, updates the output time information of the object by taking a real-time timestamp of the locking state as the output time information of the object according to the order mark of the object, pushes the order information of the updated object, can automatically identify and send out the meal information after the merchant finishes making the meal, enables the take-out platform to accurately obtain the meal information, and provides accurate meal information to the merchant terminal and the take-out platform terminal, the distribution efficiency of distribution personnel is improved, an effective informatization means is provided for the offline, and the informatization and intelligentization process of the catering service is promoted.
In a specific application scenario, as shown in fig. 9, the identifying unit 62 includes:
the second determining module 621 may be configured to determine whether a relative position between feature color blocks indicating a locking position in the seal image of the object is within a preset distance range
The determining module 622 is configured to determine that the seal state of the object is the locked state if the relative position between the feature color blocks indicating the locking positions in the seal image of the object is within a preset distance range;
the determining module 622 can also be maliciously used to determine that the seal state of the object is an unlocked state if the relative position between the feature color blocks indicating the locking positions in the seal image of the object is not within the preset distance range.
In a specific application scenario, as shown in fig. 9, the first obtaining unit 61 includes:
the first scanning module 611 may be configured to, when it is detected that an object is requested to be scanned, scan a seal portion of the object after being encapsulated based on a buckle with an identifier, and obtain a seal image of the object;
the second scanning module 612 may be configured to scan the graphical identifier of the object and obtain an order identifier of the object.
In a specific application scenario, as shown in fig. 9, the apparatus further comprises,
the second obtaining unit 64 may be configured to, after querying the tag status of the object according to the order identifier, if the tag status of the object is an unlocked status, re-obtain and transmit the tag image of the object according to the received output prompt information of the object.
In a specific application scenario, as shown in fig. 9, the apparatus further includes:
a receiving unit 65, which may be configured to receive order information of the updated object;
the covering unit 66 may be configured to, if the output time information recorded in the updated order information of the object is inconsistent with the real-time timestamp bound to the object identifier, cover the real-time timestamp in the order information by using the output time information recorded in the updated order information of the object.
It should be noted that other corresponding descriptions of the functional units related to the information pushing apparatus provided in this embodiment may refer to the corresponding descriptions in fig. 1 to fig. 5, and are not repeated herein.
Based on the above-mentioned methods as shown in fig. 1 to fig. 5, correspondingly, the present application further provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the information push method as shown in fig. 1 to fig. 5 is implemented.
Based on such understanding, the technical solution of the present application may be embodied in the form of a software product, which may be stored in a non-volatile storage medium (which may be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method according to the implementation scenarios of the present application.
Based on the method shown in fig. 1 to fig. 5 and the virtual device embodiment shown in fig. 6 to fig. 9, to achieve the above object, an embodiment of the present application further provides an entity device for pushing information, which may specifically be a computer, a smart phone, a tablet computer, a smart watch, a server, or a network device, and the entity device includes a storage medium and a processor; a storage medium for storing a computer program; a processor for executing a computer program to implement the information pushing method as shown in fig. 1 and fig. 2.
Optionally, the entity device may further include a user interface, a network interface, a camera, a Radio Frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, and the like. The user interface may include a Display screen (Display), an input unit such as a keypad (Keyboard), etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface), etc.
Those skilled in the art will appreciate that the structure of the entity device for pushing information provided by the present embodiment does not constitute a limitation to the entity device, and may include more or less components, or combine some components, or arrange different components.
The storage medium may further include an operating system and a network communication module. The operating system is a program for managing hardware and software resources of the actual device for store search information processing, and supports the operation of the information processing program and other software and/or programs. The network communication module is used for realizing communication among components in the storage medium and communication with other hardware and software in the information processing entity device.
Through the above description of the embodiments, those skilled in the art will clearly understand that the present application can be implemented by software plus a necessary general hardware platform, and can also be implemented by hardware. Through the technical scheme, compared with the existing mode, the food information can be automatically identified and transmitted upwards after the food is made by a merchant, so that the take-out platform can accurately acquire the food information, the accurate food information is provided for the merchant and the take-out platform, the delivery efficiency of delivery personnel is improved, effective information means is provided for online downlink, and the informatization and intelligentization process of food and beverage services is promoted.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present application. Those skilled in the art will appreciate that the modules in the devices in the implementation scenario may be distributed in the devices in the implementation scenario according to the description of the implementation scenario, or may be located in one or more devices different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
The above application serial numbers are for description purposes only and do not represent the superiority or inferiority of the implementation scenarios. The above disclosure is only a few specific implementation scenarios of the present application, but the present application is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present application.

Claims (10)

1. An information pushing method, comprising:
receiving a seal image of an uploaded object and an order identification of the uploaded object, wherein the seal image of the object is obtained based on the object packaged by a buckle with an identification, and a characteristic color block for marking a locking position is arranged on the buckle with the identification;
detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance;
judging whether the characteristic color block for marking the locking position in the facing slip image meets the facing slip condition or not;
if so, indicating that the seal state of the object is a locking state;
and updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object, and pushing the updated order information of the object.
2. The method of claim 1, wherein prior to the detecting the feature patch in the seal image that indicates the lock-out position based on the pre-trained classification model, the method further comprises:
inputting a seal sample image carrying a characteristic color block information label into a neural network for training, and extracting parameter information of the characteristic color block in the seal sample image on different dimensions;
and constructing a classification model for identifying the characteristic color blocks according to the parameter information of the characteristic color blocks in the seal sample image on different dimensions.
3. The method of claim 1, wherein after the determining whether the characteristic patch in the stamp image indicating the detent position meets a stamp condition, the method further comprises:
if not, indicating that the seal state of the object is an unlocked state;
and processing the unlocked state into output prompt information of the object to be pushed.
4. The method according to claim 1, wherein the determining whether the characteristic color patch indicating the locking position in the stamp image meets the stamp condition specifically comprises:
calculating relative position information between the related color blocks in the same plane according to the position information of the characteristic color block which marks the locking position in the seal image;
judging whether the relative position information between the associated color blocks in the same plane is within a preset distance range or not;
and if so, indicating that the seal state of the object is a locking state, otherwise, indicating that the seal state of the object is an unlocking state.
5. The method according to claim 4, wherein the calculating of the relative position information between the associated color patches in the same plane according to the position information of the characteristic color patch indicating the locking position in the seal image specifically comprises:
extracting a characteristic color block in the same plane from a characteristic color block which marks a locking position in the seal image;
classifying the characteristic color blocks in the same plane, and screening out associated color blocks containing preset characteristics;
and calculating the relative position information between the associated color blocks in the same plane according to the position information of the associated color blocks containing the preset characteristics.
6. The method according to claim 5, wherein after the classifying the feature patches in the same plane and screening out the associated patches containing the preset features, the method further comprises:
and if the characteristic color blocks in the same plane do not have associated color blocks containing preset characteristics, indicating that the seal state of the object is an unlocked state.
7. An information pushing method, comprising:
acquiring and transmitting a seal image of an object and an order mark of the object after the object is packaged on the basis of a buckle with a mark, wherein a characteristic color block for marking a locking position is arranged on the buckle with the mark;
identifying the seal state of the object according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object;
and if the seal state of the object indicates a locking state, binding the real-time timestamp of the locking state to the order identification of the object, and updating the order information of the object.
8. An information pushing apparatus, comprising:
the receiving unit is used for receiving a seal image of an uploaded object and an order mark of the uploaded object, the seal image of the object is obtained based on the object packaged by a buckle with a mark, and a characteristic color block for marking a locking position is arranged on the buckle with the mark;
the detection unit is used for detecting a characteristic color block which marks a locking position in the seal image based on a classification model trained in advance;
the judging unit is used for judging whether the characteristic color block which marks the locking position in the seal image meets the seal condition or not;
the first indicating unit is used for indicating that the seal state of the object is a locking state if the characteristic color block for marking the locking position in the seal image meets the seal condition;
and the first pushing unit is used for updating the real-time timestamp of the locking state as output time information of the object to order information of the object according to the order identifier of the object and pushing the updated order information of the object.
9. An information pushing apparatus, comprising:
the system comprises a first acquisition unit, a second acquisition unit and a third acquisition unit, wherein the first acquisition unit is used for acquiring and transmitting a seal image of an object and an order mark of the object after being packaged by a buckle with a mark, and a characteristic color block for marking a locking position is arranged on the buckle with the mark;
the identification unit is used for identifying the seal state of the object according to the relative position between the characteristic color blocks which mark the locking position in the seal image of the object;
and the updating unit is used for binding the real-time timestamp of the locking state to the order identification of the object and updating the order information of the object if the seal state of the object indicates the locking state.
10. The utility model provides a buckle with sign which characterized in that includes:
the buckle head is provided with a first mark and is provided with a through hole;
the buckle body is connected with the buckle head, a second mark is arranged on the buckle body, the buckle body can penetrate through the through hole and is locked at a certain position, and the first mark and the second mark can be positioned on the same side;
and when the first mark and the second mark are positioned at the same side and the distance between the first mark and the second mark is within a preset distance range, the seal state is a locking state.
CN202010136162.3A 2020-03-02 2020-03-02 Information pushing method, device and equipment and buckle with identification Active CN111476624B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010136162.3A CN111476624B (en) 2020-03-02 2020-03-02 Information pushing method, device and equipment and buckle with identification

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010136162.3A CN111476624B (en) 2020-03-02 2020-03-02 Information pushing method, device and equipment and buckle with identification

Publications (2)

Publication Number Publication Date
CN111476624A true CN111476624A (en) 2020-07-31
CN111476624B CN111476624B (en) 2021-04-13

Family

ID=71747103

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010136162.3A Active CN111476624B (en) 2020-03-02 2020-03-02 Information pushing method, device and equipment and buckle with identification

Country Status (1)

Country Link
CN (1) CN111476624B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140119817A1 (en) * 2012-11-01 2014-05-01 Kindwin Opto Electronics (Shenzhen) Ltd. Coaxial tensionable automatic lock
CN103955933A (en) * 2014-04-30 2014-07-30 杭州师范大学 Automobile pull ring lock catch riveting detecting method based on machine vision
CN107238957A (en) * 2017-08-02 2017-10-10 业成科技(成都)有限公司 Abutted equipment and its applying method
CN107657400A (en) * 2016-07-26 2018-02-02 北京京东尚科信息技术有限公司 Commodity ex-warehouse control system and method
CN109931892A (en) * 2019-03-30 2019-06-25 廊坊华安汽车装备有限公司 A kind of canister buckle structure detection method and system
CN110288441A (en) * 2019-06-26 2019-09-27 浪潮金融信息技术有限公司 A kind of design scheme in novel unmanned shop
CN209506275U (en) * 2018-10-31 2019-10-18 天津天和顺物流有限责任公司 A kind of logistics wrapping and encapsulating detection device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140119817A1 (en) * 2012-11-01 2014-05-01 Kindwin Opto Electronics (Shenzhen) Ltd. Coaxial tensionable automatic lock
CN103955933A (en) * 2014-04-30 2014-07-30 杭州师范大学 Automobile pull ring lock catch riveting detecting method based on machine vision
CN107657400A (en) * 2016-07-26 2018-02-02 北京京东尚科信息技术有限公司 Commodity ex-warehouse control system and method
CN107238957A (en) * 2017-08-02 2017-10-10 业成科技(成都)有限公司 Abutted equipment and its applying method
CN209506275U (en) * 2018-10-31 2019-10-18 天津天和顺物流有限责任公司 A kind of logistics wrapping and encapsulating detection device
CN109931892A (en) * 2019-03-30 2019-06-25 廊坊华安汽车装备有限公司 A kind of canister buckle structure detection method and system
CN110288441A (en) * 2019-06-26 2019-09-27 浪潮金融信息技术有限公司 A kind of design scheme in novel unmanned shop

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
任子真: ""塑料铆接缝隙图像检测系统的研究"", 《微机与应用》 *

Also Published As

Publication number Publication date
CN111476624B (en) 2021-04-13

Similar Documents

Publication Publication Date Title
CN108922026B (en) Replenishment management method and device for vending machine and user terminal
US20220122026A1 (en) Supply chain management method, computer program product for displaying trading record, supply chain management system, and computer program product for managing trading record
US10062257B2 (en) Intelligent display system and method
CN107045641B (en) Goods shelf identification method based on image identification technology
US20180253674A1 (en) System and method for identifying retail products and determining retail product arrangements
US10853705B2 (en) Collation/retrieval system, collation/retrieval server, image feature extraction apparatus, collation/retrieval method, and program
CN107481414A (en) A kind of real-time shopping guide method and system of open unmanned sale apparatus
JP6136257B2 (en) Vending machine management apparatus, data processing method thereof, and program
CN102982332A (en) Retail terminal goods shelf image intelligent analyzing system based on cloud processing method
US11727599B2 (en) Color correspondence information generating system, program, and method of generating color correspondence information
US10157362B1 (en) Systems and methods for delivering items
CN106301866A (en) The statistical method of destination object and device
CN111476624B (en) Information pushing method, device and equipment and buckle with identification
JP6688520B2 (en) Trading system and trading method
CN110543839A (en) commodity goods laying rate acquisition method based on computer vision
CN104318448A (en) Recording method and device based on two-dimension code scanning
CN111444360A (en) Warehousing system and method for article management, positioning, sharing and real-time display
CN109816429A (en) Information popularization method and apparatus
CN111476625B (en) Output time acquisition method and device, computer equipment and readable storage medium
CN110533380A (en) A kind of fresh check system and its checking method
WO2011116334A2 (en) Object ocr and location tagging systems
CN112418881A (en) Two-dimensional code authentication coding method and traceability system
CN114125134A (en) Contactless operation method and device, server and electronic equipment
CN212606359U (en) Fastener with mark
KR102488953B1 (en) System for providing pre-owned luxury checking service using colorbook

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant