CN112445321A - Article processing method and device and electronic equipment - Google Patents

Article processing method and device and electronic equipment Download PDF

Info

Publication number
CN112445321A
CN112445321A CN201910802887.9A CN201910802887A CN112445321A CN 112445321 A CN112445321 A CN 112445321A CN 201910802887 A CN201910802887 A CN 201910802887A CN 112445321 A CN112445321 A CN 112445321A
Authority
CN
China
Prior art keywords
article
information
glasses
package
prompt information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910802887.9A
Other languages
Chinese (zh)
Inventor
许俊
张振宇
陈波
朱午辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cainiao Smart Logistics Holding Ltd
Original Assignee
Cainiao Smart Logistics Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cainiao Smart Logistics Holding Ltd filed Critical Cainiao Smart Logistics Holding Ltd
Priority to CN201910802887.9A priority Critical patent/CN112445321A/en
Publication of CN112445321A publication Critical patent/CN112445321A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/083Shipping
    • G06Q10/0832Special goods or special handling procedures, e.g. handling of hazardous or fragile goods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Economics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Development Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention provides an article processing method, an article processing device and electronic equipment, wherein the method comprises the following steps: acquiring an image of an article in a scanning field of view of AR glasses, and identifying attribute information of the article from the image; analyzing the attribute information of the article to generate prompt information corresponding to the article; and identifying prompt information of the article on an imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator performs operation on the article based on the prompt information. According to the scheme of the embodiment of the invention, the article to be operated can be quickly identified and information prompt is carried out, so that an operator is assisted to conveniently perform corresponding operation on the article, and the processing efficiency is improved.

Description

Article processing method and device and electronic equipment
Technical Field
The present application relates to the field of computers, and in particular, to an article processing method and apparatus, and an electronic device.
Background
With the rapid development of electronic commerce, express delivery services also grow at a high speed, and the number of packages to be processed by a transfer center also increases rapidly. Although some automatic sorting equipment is applied in the industry at present, the manual sorting mode is still an indispensable mainstream sorting mode due to many reasons such as technology, cost, business characteristics and the like. At present, the following problems are generally faced in manual sorting:
1. the problems of wrong division and missing division are as follows: the manual long-time code reading and sorting according to the memory information are easy to cause wrong sorting and missing sorting, bring the complexity and cost of abnormal piece processing, and influence the experience of consumers.
2. The visual fatigue problem of the sorters: in the manual sorting mode, a sorter stares at a large amount of mobile packages on the production line for a long time, needs to read package information quickly and perform sorting decision, and visual fatigue occurs quickly, so that the error probability is increased, the work experience is poor, and the visual health is even affected.
3. And (3) training sorters on duty: in the manual sorting mode, a sorter needs to learn various surface single formats and the relation between the memory surface single information and the sorting flow direction, and the working threshold is high.
4. Sorting efficiency problem: in the manual sorting mode, the rotating speed of the conveyor belt is usually set to be very low in consideration of code reading and decision timeliness of sorters.
Disclosure of Invention
The invention provides an article processing method, an article processing device and electronic equipment, which can be used for quickly identifying an article to be operated and prompting information, so that an operator is assisted to conveniently perform corresponding operation on the article, and the processing efficiency is improved.
In order to achieve the above purpose, the embodiment of the invention adopts the following technical scheme:
in a first aspect, there is provided an article processing method, comprising:
acquiring an image of an article in a scanning field of view of AR glasses, and identifying attribute information of the article from the image;
analyzing the attribute information of the article to generate prompt information corresponding to the article;
and identifying prompt information of the article on an imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator performs operation on the article based on the prompt information.
In a second aspect, there is provided another article processing method, comprising:
acquiring an image of a parcel in a scanning view field of AR glasses, and identifying express bill information on the parcel from the image;
determining prompt information corresponding to the package according to the express bill information;
and identifying the prompt information of the package on an imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator performs operation on the package based on the prompt information of the package.
In a third aspect, there is provided an article processing apparatus comprising:
the system comprises an article information acquisition module, an AR glasses and a storage module, wherein the article information acquisition module is used for acquiring an image of an article in a scanning view field of the AR glasses and identifying attribute information of the article from the image;
the prompt information generation module is used for analyzing the attribute information of the article and generating prompt information corresponding to the article;
and the prompt information identification module is used for identifying the prompt information of the article on the imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator can perform operation on the article based on the prompt information.
In a fourth aspect, there is provided another article processing apparatus comprising:
the package information acquisition module is used for acquiring an image of a package in a scanning view field of the AR glasses and identifying express bill information on the package from the image;
the package prompt information generation module is used for determining prompt information corresponding to the package according to the express bill information;
and the package prompt information identification module is used for identifying the prompt information of the package on the imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator can execute operation on the package based on the prompt information of the package.
In a fifth aspect, an electronic device is provided, comprising:
a memory for storing a program;
a processor, coupled to the memory, for executing the program, which when executed performs the article processing method provided by the present invention.
The invention provides an article processing method, an article processing device and electronic equipment, wherein an image of an article in a scanning view field of AR glasses is obtained, and attribute information of the article is identified from the image; analyzing the attribute information of the article to generate prompt information corresponding to the article; and identifying prompt information of the article on an imaging screen of the AR glasses by using an augmented reality technology so that an operator performs operation on the article based on the prompt information.
In a parcel sorting scene, an image of a parcel in a scanning view field of AR glasses is obtained, and express bill information on the parcel is identified from the image; determining prompt information corresponding to the package according to the express bill information; and identifying prompt information of the package on an imaging screen of the AR glasses by using an augmented reality technology so that an operator performs operation on the package based on the prompt information of the package.
In the scheme, the observation field of view of human eyes is simulated by utilizing the scanning field of view of the AR glasses, attribute information of articles in the scanning field of view, such as express bill information of packages, is identified, prompt information of the articles is generated based on the attribute information, and the prompt information of the articles is identified on an imaging screen of the AR glasses, so that an operator is assisted to execute operation on the articles based on the prompt information. For example, in a parcel sorting scene, prompt information of parcels is marked on an imaging screen of AR glasses, express bill information does not need to be read manually, and corresponding operation contents of the parcels are distinguished according to memory information, so that the problem of mistaken distribution and missed distribution of the parcels in the sorting process is effectively solved; the sorting staff can quickly sort the packages only according to the prompt information, so that the problem of visual fatigue caused by the fact that the sorting staff needs to quickly read package information and give sorting decisions in a short time because the sorting staff tightly stares a large amount of packages on the production line for a long time is effectively solved. In addition, because the express waybill information is automatically identified and prompt information is generated in the scheme, various express waybill format learning is not needed for sorters, and the on-duty training cost and the working threshold height are reduced.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
FIG. 1 is a schematic diagram of a prior art parcel sorting process;
FIG. 2 is a first flowchart of an article processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of a second method of article handling according to an embodiment of the present invention;
FIG. 4 is a first block diagram of an article processing apparatus according to an embodiment of the present invention;
FIG. 5 is a second block diagram of the article processing apparatus according to the embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
The scheme provides a semi-automatic sorting method capable of quickly and accurately realizing manual parcel sorting in the process of researching manual parcel sorting. In this method, a sorter is required to use Augmented Reality (AR) glasses during sorting of packages. Firstly, by acquiring an image of a parcel in a scanning view field (a view field observed by a sorter) of AR glasses, identifying express waybill information on the parcel from the image; then, identifying express bill information, and determining prompt information corresponding to the package, for example, a target delivery place (also called as a flow direction) where the package can be delivered is used as the prompt information; and finally, identifying prompt information of the packages on an imaging screen of the AR glasses by using an augmented reality technology, so that an operator can perform sorting operation on the packages according to the prompt information of the packages. Under the condition that the prompt message of the package is not identified, the image of the scanning view field of the AR glasses is the image displayed on the imaging screen of the AR glasses.
As shown in fig. 1, a parcel sorting processing logic diagram provided in the embodiment of the present invention is used for explaining an actual application scenario of the article processing method proposed in the present scheme, and the specific processing logic is as follows:
1. the sorting person is located conveyer belt one side to wear the parcel that removes on the AR glasses scanning conveyer belt, the image information of parcel on the scanning in-process AR glasses gathers the conveyer belt, and discerns the express delivery bill information on the parcel.
And 2, the AR glasses transmit the express bill information to the intelligent sorting system to request the sorting flow direction of the corresponding package, wherein the sorting flow direction can refer to the destination of the package or the area of the destination.
3. The intelligent sorting system feeds back sorting flow direction results to the AR glasses.
And 4, carrying out distinctive identification on the packages belonging to different flow directions in AR imaging by the AR glasses according to the sorting flow direction. For example, when targeting a parcel as a flow direction, each flow direction may be pre-set associated with AR glasses worn by a sorter for the respective flow direction. And the AR glasses identify the flow direction of the corresponding parcel according to the relevance between the flow direction of the current parcel and the preset flow direction of the AR glasses.
Such as: for the packages which do not belong to the current flow direction, when AR imaging is carried out on the AR glasses in the current flow direction, no special identification is carried out on the packages, and the sorters in the current flow direction can not sort the packages; for the parcels belonging to the current flow direction, when AR imaging is carried out on the parcels of the current flow direction by AR glasses, special flow direction identification (such as color, text, sound and the like) is carried out on the parcels, and the sorters in the current flow direction sort the parcels according to the identification.
Compared with the prior art, the scheme has the following advantages:
the accuracy and efficiency advantage of AR intelligence letter sorting to and augmented reality's direct-view sign, can greatly reduce the wrong branch and miss the branch condition.
AR intelligent sorting completely replaces manual processes of code reading, memory and decision making, visual fatigue of sorting personnel is greatly relieved, and work experience is improved.
And 3, the AR intelligent sorting is realized by fully automatically identifying the express bill, so that the on-duty threshold and the training cost of a sorter are reduced.
The efficiency advantage of AR intelligence letter sorting can suitably improve the conveyer belt rotational speed, and then promotes letter sorting efficiency.
The technical solution of the present application is further illustrated by the following examples.
Example one
Fig. 2 is a flowchart of an article processing method according to an embodiment of the present invention, in which an execution subject in the method may be a package sorting processing system formed by the AR glasses and the intelligent sorting system shown in fig. 1, and the method includes the following steps:
s210, obtaining an image of the package in the scanning view field of the AR glasses, and identifying express bill information on the package from the image.
At the sorting site, a sorter may be located to one side of the conveyor belt and scan packages moving on the conveyor belt using AR glasses. In the scanning process, the view field observed by a sorter when sorting packages can be simulated by acquiring the images of the packages in the scanning view field of the AR glasses. For example, an image of the parcel in the scanned field of view of the AR glasses may be captured by an image capture device (e.g., a camera) disposed on the AR glasses during the review of the parcel by the sorter. Then, the express waybill information on the parcel is identified from the image containing the parcel, and the specific content of the waybill information is obtained.
And S220, determining prompt information corresponding to the package according to the express bill information.
After the AR glasses acquire express waybill information of a package, the waybill information can be sent to the intelligent sorting system shown in fig. 1, and the intelligent sorting system analyzes specific contents in the waybill information to determine the flow direction of the corresponding package. The flow direction of the package may include the destination of the package or the area in which the destination is located. For example, if the destination province of a certain parcel is a Jilin, the corresponding flow direction can be the Jilin or the three northeast provinces (regions), and the specific flow direction division can refer to the specific division of the transfer center on the express delivery distribution area. According to the express bill information, prompt information corresponding to the package can be determined, and the prompt information is used for guiding an operator to operate the package. For example, the target delivery location information corresponding to the package may be determined according to the delivery bill information, and the target delivery location information may be used as the prompt information corresponding to the package. The target delivery location may be a specific flow direction corresponding to the package.
And S230, identifying prompt information of the package on an imaging screen of the AR glasses by using an augmented reality technology, so that an operator performs operation on the package based on the prompt information of the package.
The intelligent sorting system determines the flow direction of the package, if the target distribution place of the package is located, the target distribution place can be used as prompt information to be fed back to corresponding AR glasses, the AR glasses can process AR images through a built-in augmented reality processing module, namely the prompt information of the package is identified on an imaging screen of the AR glasses, and therefore an operator can perform operation on the package based on the prompt information of the package.
For example, when the intelligent sorting system uses the target delivery location as the prompt information, the augmented reality technology may be used to identify the target delivery location information corresponding to the package on the imaging screen of the AR glasses, so that the operator determines the logistics channel corresponding to the package based on the target delivery location information corresponding to the package, and sorts the package to the logistics channel. The logistics channel can refer to a channel through which the parcels are subjected to logistics processing according to the corresponding flow direction of the parcels in the parcel sorting process. The following method can be used for identifying the prompt message of the package, but is not limited to the following method:
in the first mode, flow direction identification can be respectively carried out on all packages in the scanning view field of the AR glasses, so that a sorting operator can sort out the packages which accord with the flow direction of the sorting task from the packages flowing in all the identifications.
For example, the AR glasses may perform a special identification on the flow direction of each parcel, to characterize the flow direction of the parcel; the sorter can then determine the flow direction of each package, identify packages therefrom that match the flow direction of its sorting job, and sort them. For example, a sorter responsible for the sorting of the flow of Jilin may only sort packages that identify the flow of Jilin.
In a second mode, the flow direction identification can be carried out on the packages in the scanning view field of the AR glasses, which are the same as the preset sorting flow direction of the AR glasses, so that the sorter sorts the packages marked with the flow direction.
For example, each flow direction is associated with the AR glasses of the corresponding flow direction of the sorter in advance, after the AR glasses receive the flow direction of the packages fed back by the intelligent sorting system, the AR glasses can only perform special identification on the packages with the same flow direction as the flow direction preset by the AR glasses, the flow direction of the packages is represented, and no identification is performed on the packages in other flow directions; then, the sorter can determine whether to sort the packages by judging whether the packages are identified to flow, so that the logic of the sorter for judging the flow direction mentally is saved. Such as a sorter responsible for a current flow-to-sort job, may determine whether to perform a sort operation simply by seeing whether a package is identified as flowing without determining the specific flow-to content of the package.
Further, the above-mentioned ways of flow direction identification of the parcel in the scan field of view of the AR glasses may include, but are not limited to: any of characters, images, and sounds. For example, in fig. 1, packages that are consistent with the current flow direction may be identified by color.
According to the article processing method, the image of the package in the scanning view field of the AR glasses is obtained, and the express bill information on the package is identified from the image; determining prompt information corresponding to the package according to the express bill information; and identifying prompt information of the package on an imaging screen of the AR glasses by using an augmented reality technology so that an operator performs operation on the package based on the prompt information of the package.
According to the scheme, the observation field of the human eyes is simulated by utilizing the scanning field of view of the AR glasses, the express delivery surface single information of the parcel in the scanning field of view is identified, the prompt information of the parcel, such as the flow direction of the parcel, is determined, manual code reading is not needed, the flow direction identification of the parcel is carried out according to the memory information, and the problem that the parcel is wrongly distributed and missed is sent is effectively solved; after the flow direction of the packages is recognized, the flow direction of the packages can be used as prompt information to identify on an imaging screen of AR glasses, and sorting personnel can quickly sort the packages only by the prompt information of the identification, so that the problem that the sorting personnel needs to quickly read the package information and give out visual fatigue caused by sorting decisions in a short time because the sorting personnel stares a large amount of packages on a production line for a long time in a tight manner is effectively avoided. In addition, because the express waybill information is automatically identified and the prompt message is generated, the operation of the package can be guided to the operator, the sorting operator does not need to learn various express waybill formats, and the on-duty training cost and the working threshold height are reduced.
Example two
Fig. 3 is a flow chart of a second article processing method according to an embodiment of the present invention, which aggregates the core processing concept of the method shown in fig. 1 and provides an article processing method suitable for different fields, the method including the following steps:
s310, acquiring an image of the article in the scanning view field of the AR glasses, and identifying the attribute information of the article from the image.
Specifically, in a processing scene for an article, particularly a large number of articles, an image of the article in a scanning field of view of the AR glasses may be acquired by using the AR glasses, and attribute information of the article may be identified from the image. The attribute information of the article may be information describing features of the article, including but not limited to: the shape, color, size, attached text, image description, etc. of the article.
The method comprises the steps that in the process of obtaining the image of the object in the scanning view field of the AR glasses, the image of the object in the scanning view field of the AR glasses can be collected through the image collecting device arranged on the AR glasses.
And S320, analyzing the attribute information of the article to generate prompt information corresponding to the article.
By analyzing the article attribute information, prompt information having a guiding effect on the processing operation of the article can be generated.
For example, the category of the article in the field to which the article belongs may be determined according to the attribute information of the article, and the determined category may be used as the prompt information corresponding to the article. The category of the field to which the article belongs includes, but is not limited to, the specific category of the field of garbage classification and the field of kitchen classification.
For another example, the operation state information of the article may be determined according to the attribute information of the article, and the determined operation state information may be used as the presentation information corresponding to the article. The operation state of the article may be a current operation state, or an operation state corresponding to the article entering the next processing link. For example, in a parcel sorting scene, a current placing position of a parcel is wrong and can be used as an operation state where an article is currently located, or a next handling link of the parcel is a logistics channel entering a target delivery place, and then the parcel enters a specified logistics channel and can be used as an operation state where the article is located in the next handling link.
For another example, when the article is an article to be sorted to a target processing node, the target processing node information of the article may be determined according to the attribute information of the article, and the determined target processing node information may be used as the prompt information corresponding to the article. For example, in a package sorting scenario, packages may be sorted hierarchically by a plurality of processing nodes according to different corresponding flow directions, each hierarchy may include a plurality of processing nodes, and the target processing node may be a processing node for a next package to be sorted.
And S330, identifying prompt information of the article on an imaging screen of the AR glasses by using an augmented reality technology, so that an operator performs operation on the article based on the prompt information.
After the prompt message that the article correspond is generated, the prompt message can be fed back to the corresponding AR glasses, the AR glasses can process the AR image through the built-in augmented reality processing module, namely the prompt message of the article is identified on the imaging screen of the AR glasses, and therefore the operator can perform operation on the package based on the prompt message of the article.
For example, after the operator knows the category of the domain to which the article belongs through the prompt information, the article can be classified according to the domain category of the article; for another example, after the operator obtains the operation state information of the article through the prompt information, the position of the parcel with a misplaced placement position can be adjusted according to the operation state information, or the parcel entering the logistics channel as required is moved into the corresponding logistics channel; for another example, after the operator knows the target processing node to which the article is to be sorted through the prompt message, the operator may hand over the article to the target processing node for subsequent processing.
Further, the following manner can be adopted but not limited to when the prompt message of the article is identified:
in the first mode, prompt information can be respectively identified for all articles in the scanning view field of the AR glasses, so that an operator can perform operation on the articles meeting the operation task of the operator based on the prompt information of each article.
In a second mode, prompt information can be identified for an article in the scanning field of view of the AR glasses, the article being associated with the preset operation task of the AR glasses, so that an operator can perform an operation on the article identified with the prompt information.
For an example of the two manners, reference may be made to the first embodiment, and details are not described herein for the process of identifying the prompt information of the package.
Further, the manner of identifying the reminder information of the item on the imaging screen of the AR glasses may include: at least one of text, image and sound.
The article processing method provided by the invention comprises the steps of acquiring an image of an article in a scanning view field of AR glasses, and identifying attribute information of the article from the image; analyzing the attribute information of the article to generate prompt information corresponding to the article; the augmented reality technology is utilized, the prompt information of the article is marked on the imaging screen of the AR glasses, so that an operator can operate the article based on the prompt information, and the article identification and the article processing efficiency of the operator are improved.
EXAMPLE III
FIG. 4 is a block diagram of an article processing apparatus according to an embodiment of the present invention, which may be used to perform the method steps shown in FIG. 2, including:
the package information acquisition module 410 is used for acquiring an image of a package in a scanning view field of the AR glasses and identifying express bill information on the package from the image;
the package prompt information generation module 420 is configured to determine prompt information corresponding to the package according to the express bill information;
and the package prompt information identification module 430 is configured to identify the prompt information of the package on the imaging screen of the AR glasses by using an augmented reality technology, so that an operator performs an operation on the package based on the prompt information of the package.
Further, the package prompt information generating module 420 may be configured to determine target delivery location information corresponding to the package according to the express bill information, and use the target delivery location information as the prompt information corresponding to the package.
Further, the package prompting information identification module 430 may be configured to identify, by using an augmented reality technology, target delivery location information corresponding to the package on an imaging screen of the AR glasses, so that an operator determines a logistics channel corresponding to the package based on the target delivery location information corresponding to the package, and sorts the package to the logistics channel.
The article processing device provided by the invention has the advantages that the image of the parcel in the scanning view field of the AR glasses is obtained, and the express bill information on the parcel is identified from the image; determining prompt information corresponding to the package according to the express bill information; and identifying prompt information of the package on an imaging screen of the AR glasses by using an augmented reality technology so that an operator performs operation on the package based on the prompt information of the package.
According to the scheme, the observation field of the human eyes is simulated by utilizing the scanning field of view of the AR glasses, the express delivery surface single information of the parcel in the scanning field of view is identified, the prompt information of the parcel, such as the flow direction of the parcel, is determined, manual code reading is not needed, the flow direction identification of the parcel is carried out according to the memory information, and the problem that the parcel is wrongly distributed and missed is sent is effectively solved; after the flow direction of the packages is recognized, the flow direction of the packages can be used as prompt information to identify on an imaging screen of AR glasses, and sorting personnel can quickly sort the packages only by the prompt information of the identification, so that the problem that the sorting personnel needs to quickly read the package information and give out visual fatigue caused by sorting decisions in a short time because the sorting personnel stares a large amount of packages on a production line for a long time in a tight manner is effectively avoided. In addition, because the express waybill information is automatically identified and the prompt message is generated, the operation of the package can be guided to the operator, the sorting operator does not need to learn various express waybill formats, and the on-duty training cost and the working threshold height are reduced.
Example four
Fig. 5 is a block diagram of an article processing apparatus according to an embodiment of the present invention, which can be used to execute the method steps shown in fig. 3, and includes:
an item information obtaining module 510, configured to obtain an image of an item in a scanning field of view of the AR glasses, and identify attribute information of the item from the image;
a prompt message generating module 520, configured to analyze attribute information of an article and generate a prompt message corresponding to the article;
and a prompt message identification module 530, configured to identify a prompt message of the article on an imaging screen of the AR glasses by using an augmented reality technology, so that an operator performs an operation on the article based on the prompt message.
Further, the prompt information generating module 520 may be configured to determine a category of the article in the field to which the article belongs according to the attribute information of the article, and use the determined category as the prompt information corresponding to the article.
Further or alternatively, the prompt information generating module 520 may be configured to determine the operation state information of the article according to the attribute information of the article, and use the determined operation state information as the prompt information corresponding to the article.
Further or alternatively, the prompt information generating module 520 may be configured to determine target processing node information of the article according to the attribute information of the article, and use the determined target processing node information as the prompt information corresponding to the article.
Further, the prompt information identification module 530 may be configured to identify prompt information for all articles in the scanning field of the AR glasses, so that an operator performs an operation on the article meeting an operation task of the operator based on the prompt information of each article.
Further or alternatively, the prompt information identification module 530 may be configured to identify prompt information for an article in the scanning field of view of the AR glasses, where the article is associated with the preset operation task of the AR glasses, so that an operator performs an operation on the article identified with the prompt information.
Further, the article information acquiring module 510 is configured to acquire an image of an article in a scanning field of view of the AR glasses through an image acquisition device disposed on the AR glasses.
Further, the manner of identifying the reminder information of the item on the imaging screen of the AR glasses may include: at least one of text, image and sound.
The object processing device provided by the invention acquires the image of the object in the scanning view field of the AR glasses and identifies the attribute information of the object from the image; analyzing the attribute information of the article to generate prompt information corresponding to the article; the augmented reality technology is utilized, the prompt information of the article is marked on the imaging screen of the AR glasses, so that an operator can operate the article based on the prompt information, and the article identification and the article processing efficiency of the operator are improved.
EXAMPLE five
The foregoing embodiment describes an overall architecture of an article processing apparatus, and functions of the apparatus can be implemented by an electronic device, as shown in fig. 6, which is a schematic structural diagram of the electronic device according to the embodiment of the present invention, and specifically includes: a memory 610 and a processor 620.
And a memory 610 for storing programs.
In addition to the programs described above, the memory 610 may also be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phonebook data, messages, pictures, videos, and so forth.
The memory 610 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
A processor 620, coupled to the memory 610, for executing the program in the memory 610, which when executed performs the operational steps of the article handling method described in the previous embodiments.
Further, the processor 620 may also include various modules described in the foregoing embodiments to perform article processing operations, and the memory 610 may be used, for example, to store data required by and/or output data from the modules to perform the operations.
The above specific processing operations have been described in detail in the foregoing embodiments, and are not described again here.
Further, as shown in fig. 6, the electronic device may further include: communication component 630, power component 640, audio component 650, display 660, and other components. Only some of the components are schematically shown in fig. 6, and the electronic device is not meant to include only the components shown in fig. 6.
The communication component 630 is configured to facilitate wired or wireless communication between the electronic device and other devices. The electronic device may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G, 5G, or a combination thereof. In an exemplary embodiment, the communication component 630 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 630 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
A power supply component 640 provides power to the various components of the electronic device. The power components 640 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for an electronic device.
The audio component 650 is configured to output and/or input audio signals. For example, the audio component 650 includes a Microphone (MIC) configured to receive external audio signals when the electronic device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 610 or transmitted via the communication component 630. In some embodiments, audio component 650 further includes a speaker for outputting audio signals.
Display 660 comprises a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims (14)

1. An article handling method comprising:
acquiring an image of an article in a scanning field of view of AR glasses, and identifying attribute information of the article from the image;
analyzing the attribute information of the article to generate prompt information corresponding to the article;
and identifying prompt information of the article on an imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator performs operation on the article based on the prompt information.
2. The method of claim 1, wherein analyzing the attribute information of the item and generating the prompt information corresponding to the item comprises:
and determining the category of the article in the field to which the article belongs according to the attribute information of the article, and taking the determined category as the prompt information corresponding to the article.
3. The method of claim 1, wherein analyzing the attribute information of the item and generating the prompt information corresponding to the item comprises:
and determining the operation state information of the article according to the attribute information of the article, and taking the determined operation state information as the prompt information corresponding to the article.
4. The method of claim 1, wherein the item is an item to be sorted to a target processing node,
analyzing the attribute information of the article, and generating prompt information corresponding to the article comprises:
and determining target processing node information of the article according to the attribute information of the article, and taking the determined target processing node information as prompt information corresponding to the article.
5. The method of claim 1, wherein identifying a reminder for the item on an imaging screen of the AR glasses such that an operator performs an operation on the item based on the reminder comprises:
and respectively identifying prompt information for all articles in the scanning view field of the AR glasses so that the operator can operate the articles according with the operation task based on the prompt information of each article.
6. The method of claim 1, wherein identifying a reminder for the item on an imaging screen of the AR glasses such that an operator performs an operation on the item based on the reminder comprises:
and identifying prompt information for the article in the scanning view field of the AR glasses, which is associated with the preset operation task of the AR glasses, so that the operator can operate the article identified with the prompt information.
7. The method of claim 1, wherein the acquiring an image of an item in a scan field of view of the AR glasses comprises:
and acquiring the image of the object in the scanning view field of the AR glasses through an image acquisition device arranged on the AR glasses.
8. The method of claim 1, wherein identifying the reminder information for the item on the imaging screen of the AR glasses comprises: at least one of text, image and sound.
9. An article handling method comprising:
acquiring an image of a parcel in a scanning view field of AR glasses, and identifying express bill information on the parcel from the image;
determining prompt information corresponding to the package according to the express bill information;
and identifying the prompt information of the package on an imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator performs operation on the package based on the prompt information of the package.
10. The method of claim 9, wherein the determining, according to the courier bill information, prompt information corresponding to the package comprises:
and determining target delivery place information corresponding to the package according to the express bill information, and taking the target delivery place information as prompt information corresponding to the package.
11. The method of claim 10, wherein the identifying, using augmented reality technology, the reminder information for the package on the imaging screen of the AR glasses to cause the operator to perform an operation on the package based on the reminder information for the package comprises:
and identifying target distribution place information corresponding to the packages on an imaging screen of the AR glasses by using an augmented reality technology, so that an operator determines a logistics channel corresponding to the packages based on the target distribution place information corresponding to the packages, and sorts the packages to the logistics channel.
12. An article processing apparatus comprising:
the system comprises an article information acquisition module, an AR glasses and a storage module, wherein the article information acquisition module is used for acquiring an image of an article in a scanning view field of the AR glasses and identifying attribute information of the article from the image;
the prompt information generation module is used for analyzing the attribute information of the article and generating prompt information corresponding to the article;
and the prompt information identification module is used for identifying the prompt information of the article on the imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator can perform operation on the article based on the prompt information.
13. An article processing apparatus comprising:
the package information acquisition module is used for acquiring an image of a package in a scanning view field of the AR glasses and identifying express bill information on the package from the image;
the package prompt information generation module is used for determining prompt information corresponding to the package according to the express bill information;
and the package prompt information identification module is used for identifying the prompt information of the package on the imaging screen of the AR glasses by utilizing an augmented reality technology so that an operator can execute operation on the package based on the prompt information of the package.
14. An electronic device, comprising:
a memory for storing a program;
a processor coupled to the memory for executing the program, the program when executed performing the article processing method of any of claims 1-11.
CN201910802887.9A 2019-08-28 2019-08-28 Article processing method and device and electronic equipment Pending CN112445321A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910802887.9A CN112445321A (en) 2019-08-28 2019-08-28 Article processing method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910802887.9A CN112445321A (en) 2019-08-28 2019-08-28 Article processing method and device and electronic equipment

Publications (1)

Publication Number Publication Date
CN112445321A true CN112445321A (en) 2021-03-05

Family

ID=74741677

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910802887.9A Pending CN112445321A (en) 2019-08-28 2019-08-28 Article processing method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN112445321A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113240376A (en) * 2021-05-31 2021-08-10 中邮信息科技(北京)有限公司 Article information determination method, article information determination device, electronic device, and medium
CN113441411A (en) * 2021-07-31 2021-09-28 北京五指术健康科技有限公司 Rubbish letter sorting equipment based on augmented reality
CN113592515A (en) * 2021-08-03 2021-11-02 北京沃东天骏信息技术有限公司 Method, system and device for identifying authenticity of article
CN115953635A (en) * 2023-03-10 2023-04-11 中国邮电器材集团有限公司 Multi-category target object sorting method, AR glasses and system

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014043353A (en) * 2013-12-10 2014-03-13 Okura Yusoki Co Ltd Picking system
CN103927350A (en) * 2014-04-04 2014-07-16 百度在线网络技术(北京)有限公司 Smart glasses based prompting method and device
CN105416439A (en) * 2015-11-24 2016-03-23 大连楼兰科技股份有限公司 Vehicle disassembling and assembling method based on intelligent glasses
WO2016058449A1 (en) * 2014-10-15 2016-04-21 成都理想境界科技有限公司 Smart glasses and control method for smart glasses
CN106156967A (en) * 2015-04-08 2016-11-23 阿里巴巴集团控股有限公司 Express delivery information association, the method and device of offer logistics content information
CN106779541A (en) * 2016-11-30 2017-05-31 长威信息科技发展股份有限公司 A kind of warehouse management method and system based on AR technologies
CN108023298A (en) * 2017-11-21 2018-05-11 北京恒华伟业科技股份有限公司 A kind of tunnel cable attribute display method and system
CN207650852U (en) * 2017-12-27 2018-07-24 北京枭龙防务科技有限公司 Intelligent sorting system based on augmented reality intelligent glasses
CN109255314A (en) * 2018-08-30 2019-01-22 Oppo广东移动通信有限公司 Information cuing method, device, intelligent glasses and storage medium
CN109344719A (en) * 2018-09-03 2019-02-15 国网天津市电力公司 Substation equipment information query method based on augmented reality and intelligent glasses
CN109917918A (en) * 2019-03-07 2019-06-21 联想(北京)有限公司 A kind of information processing method and electronic equipment based on augmented reality

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014043353A (en) * 2013-12-10 2014-03-13 Okura Yusoki Co Ltd Picking system
CN103927350A (en) * 2014-04-04 2014-07-16 百度在线网络技术(北京)有限公司 Smart glasses based prompting method and device
WO2016058449A1 (en) * 2014-10-15 2016-04-21 成都理想境界科技有限公司 Smart glasses and control method for smart glasses
CN106156967A (en) * 2015-04-08 2016-11-23 阿里巴巴集团控股有限公司 Express delivery information association, the method and device of offer logistics content information
CN105416439A (en) * 2015-11-24 2016-03-23 大连楼兰科技股份有限公司 Vehicle disassembling and assembling method based on intelligent glasses
CN106779541A (en) * 2016-11-30 2017-05-31 长威信息科技发展股份有限公司 A kind of warehouse management method and system based on AR technologies
CN108023298A (en) * 2017-11-21 2018-05-11 北京恒华伟业科技股份有限公司 A kind of tunnel cable attribute display method and system
CN207650852U (en) * 2017-12-27 2018-07-24 北京枭龙防务科技有限公司 Intelligent sorting system based on augmented reality intelligent glasses
CN109255314A (en) * 2018-08-30 2019-01-22 Oppo广东移动通信有限公司 Information cuing method, device, intelligent glasses and storage medium
CN109344719A (en) * 2018-09-03 2019-02-15 国网天津市电力公司 Substation equipment information query method based on augmented reality and intelligent glasses
CN109917918A (en) * 2019-03-07 2019-06-21 联想(北京)有限公司 A kind of information processing method and electronic equipment based on augmented reality

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113240376A (en) * 2021-05-31 2021-08-10 中邮信息科技(北京)有限公司 Article information determination method, article information determination device, electronic device, and medium
CN113441411A (en) * 2021-07-31 2021-09-28 北京五指术健康科技有限公司 Rubbish letter sorting equipment based on augmented reality
CN113592515A (en) * 2021-08-03 2021-11-02 北京沃东天骏信息技术有限公司 Method, system and device for identifying authenticity of article
CN115953635A (en) * 2023-03-10 2023-04-11 中国邮电器材集团有限公司 Multi-category target object sorting method, AR glasses and system

Similar Documents

Publication Publication Date Title
CN112445321A (en) Article processing method and device and electronic equipment
US9971154B1 (en) Pointer tracking for eye-level scanners and displays
CN107016387B (en) Method and device for identifying label
US20140195374A1 (en) Managing inventory in a shopping store
US9378545B2 (en) Culture medium information registration system, colony detection device, program and sanitary management system
CN104881770A (en) Express bill information identification system and express bill information identification method
CN107449483A (en) A kind of system for prompting and method of material surplus
CN104507165A (en) Intelligent prompting method, system and device
CN114266514A (en) Informationized intelligent warehousing management method and system
US20210279784A1 (en) Analysis method and system for the item on the supermarket shelf
US20150169762A1 (en) Culture medium information registration system, communication terminal device, program, sanitary management system and film-type culture medium
CN111062252B (en) Real-time dangerous goods semantic segmentation method, device and storage device
CN109614834A (en) A kind of method, equipment and the system of automatic identification express delivery information
CN108965762A (en) A kind of monitor video storage method
CN114596243A (en) Defect detection method, device, equipment and computer readable storage medium
CN116911328A (en) Intelligent material identification and positioning system and application method thereof
CN115546824B (en) Taboo picture identification method, apparatus and storage medium
CN111435276A (en) Image processing method and device and electronic equipment
JP6500358B2 (en) Colony detection system, colony detection method, and program
CN112131894B (en) Method, system, glasses, apparatus and computer readable medium for sorting articles
CN111435511B (en) Order processing method, device, equipment, system and readable storage medium
CN109684948B (en) Method, device and system for detecting mesh abnormality of object
CN112950103A (en) Logistics object storage device, management method thereof, electronic device and computer-readable storage medium
US20240104495A1 (en) System and method for tracking inventory inside warehouse with put-away accuracy using machine learning models
CN214048108U (en) Storage cabinet

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination