CN114266327A - Information display method, information processing method, terminal equipment, server and storage medium - Google Patents
Information display method, information processing method, terminal equipment, server and storage medium Download PDFInfo
- Publication number
- CN114266327A CN114266327A CN202010962523.XA CN202010962523A CN114266327A CN 114266327 A CN114266327 A CN 114266327A CN 202010962523 A CN202010962523 A CN 202010962523A CN 114266327 A CN114266327 A CN 114266327A
- Authority
- CN
- China
- Prior art keywords
- article
- image
- code
- code scanning
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000003672 processing method Methods 0.000 title claims abstract description 10
- 230000010365 information processing Effects 0.000 title claims abstract description 9
- 238000004806 packaging method and process Methods 0.000 claims abstract description 57
- 238000012856 packing Methods 0.000 claims description 32
- 238000004891 communication Methods 0.000 claims description 30
- 238000010586 diagram Methods 0.000 claims description 29
- 238000013136 deep learning model Methods 0.000 claims description 25
- 210000000746 body region Anatomy 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 19
- 238000007667 floating Methods 0.000 claims description 15
- 238000012545 processing Methods 0.000 claims description 14
- 239000008194 pharmaceutical composition Substances 0.000 claims description 6
- 239000003814 drug Substances 0.000 description 226
- 229940079593 drug Drugs 0.000 description 47
- 230000015654 memory Effects 0.000 description 30
- 230000011218 segmentation Effects 0.000 description 17
- 238000005516 engineering process Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000012549 training Methods 0.000 description 8
- 230000005291 magnetic effect Effects 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000013135 deep learning Methods 0.000 description 3
- 238000000605 extraction Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 239000002775 capsule Substances 0.000 description 2
- 238000013527 convolutional neural network Methods 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- QVFWZNCVPCJQOP-UHFFFAOYSA-N chloralodol Chemical compound CC(O)(C)CC(C)OC(O)C(Cl)(Cl)Cl QVFWZNCVPCJQOP-UHFFFAOYSA-N 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 239000002537 cosmetic Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 239000002920 hazardous waste Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000009512 pharmaceutical packaging Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Landscapes
- Medical Treatment And Welfare Office Work (AREA)
Abstract
The embodiment of the application provides an information display method, an information processing method, terminal equipment, a server and a storage medium. In the information display method, at least one part of the image of the article packaging body is displayed in the image display interface, and the display code scanning guide information is superposed on the image display interface, so that a user can scan the article tracing code on the article packaging body through the image display interface while watching the code scanning guide information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
Description
Technical Field
The present application relates to the field of internet technologies, and in particular, to an information displaying and processing method, a terminal device, a server, and a storage medium.
Background
The medicine tracing refers to a process of carrying out whole-course supervision on production and circulation links of medicines through an electronic supervision system. In order to facilitate tracing, a manufacturer of the medicine can print a tracing code on a packaging box of the medicine, and a user can scan the tracing code of the medicine to obtain tracing information of the medicine.
Generally, the tracing code of the medicine is printed in a small local area on the outer package of the medicine, and the style of the tracing code is similar to that of the commodity code, so that a user cannot easily and accurately find the tracing code. The existing method for guiding a user to scan the tracing code is single. Therefore, a new solution is yet to be proposed.
Disclosure of Invention
Aspects of the present application provide an information display method, an information processing method, a terminal device, a server, and a storage medium, so as to flexibly guide a user to perform drug tracing.
The embodiment of the application provides an information display method, which comprises the following steps: displaying an image of at least a portion of the item package in an image display interface; and displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
An embodiment of the present application provides an information processing method, including: acquiring an image of at least a part of an article package sent by a terminal device; identifying the image to determine an article corresponding to the article package; acquiring code scanning guide information of an article from code scanning guide information corresponding to a plurality of different articles; and sending the code scanning guide information of the article to the terminal equipment for displaying so as to guide a user to scan the article tracing code on the article packaging body.
An embodiment of the present application further provides a terminal device, including: a display component; the display assembly is configured to: displaying an image of at least a portion of the item package on an image display interface; and displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
An embodiment of the present application further provides a server, including: a processing component and a communication component; the communication component to: acquiring an image of at least a part of an article package sent by a terminal device; the processing component is configured to: identifying the image to determine an article corresponding to the article package; acquiring code scanning guide information of an article from code scanning guide information corresponding to a plurality of different articles; and sending the code scanning guide information of the article to the terminal equipment for displaying through the communication assembly so as to guide a user to scan the article tracing code on the article packaging body.
The embodiment of the present application also provides a computer-readable storage medium storing a computer program, and the computer program can implement the information presentation method executed by the terminal device or the information processing method executed by the server provided by the embodiment of the present application when being executed.
In the information display method provided by the embodiment of the application, at least one part of the image of the article packaging body is displayed in the image display interface, and the display code scanning guidance information is superposed on the image display interface, so that a user can scan the article tracing code on the article packaging body through the image display interface while watching the code scanning guidance information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic structural diagram of an information presentation system according to an exemplary embodiment of the present application;
FIG. 2 is a schematic diagram of a medicine tracing code obtained in an image display interface;
fig. 3a and 3b are schematic diagrams of images acquired from at least a part of a medicine package in an image display interface;
FIG. 4 is a schematic diagram of a same screen display image display interface and code scanning guidance information;
FIG. 5 is a schematic diagram illustrating a medicine tracing code scanned according to the code scanning guidance information;
fig. 6 is a schematic diagram of a drug traceability information display page;
fig. 7 is a schematic flowchart of an information presentation method according to an exemplary embodiment of the present application;
FIG. 8 is a flowchart illustrating an information processing method according to an exemplary embodiment of the present application;
fig. 9 is a schematic structural diagram of a terminal device according to an exemplary embodiment of the present application;
fig. 10 is a schematic structural diagram of a server according to another exemplary embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In order to facilitate the supervision of the production and circulation links of the medicines through an electronic supervision system, generally, a medicine manufacturer can print a tracing code of the medicines on a packaging box of the medicines when producing the medicines. The user can obtain the tracing information of the medicine through the tracing code. The tracing code of the medicine can be realized as an information code such as a two-dimensional code, a bar code or a three-dimensional code, or can also be realized as an electronic certificate in other forms.
The code of traceing back of medicine is printed on certain side of medicine box usually, and the area of code is traceed back to the medicine is less, and is comparatively similar with the pattern of commodity code. Therefore, most users are difficult to find the position of the medicine tracing code on the medicine box under the condition of no guidance, great difficulty is brought to the operation of scanning the code by the users for medicine tracing, and certain obstacle is also caused to the popularization of the code scanning tracing function.
At present, the code scanning guidance for users is usually as follows: and providing a page for guiding code scanning for the user on line for the user to learn. However, on one hand, the page is not easy to be noticed by the user, and on the other hand, the guidance content provided by the page usually needs the user to learn and memorize in advance, which is not favorable for the user to quickly adjust the scanning position of the medicine box according to the guidance information.
In view of the above technical problem, in some embodiments of the present application, a solution is provided, and the technical solutions provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Fig. 1 is a schematic structural diagram of an information presentation system according to an exemplary embodiment of the present application, and as shown in fig. 1, the information presentation system 100: including terminal equipment 101 and server 102.
Among them, the terminal device 101 refers to a device capable of interacting with a user and having a communication function. The implementation form of the terminal device 101 may be different in different application scenarios. For example, in some scenarios, the terminal device 101 may be implemented as a mobile phone, a tablet computer, a computer device, a Personal Digital Assistant (PDA), and so on.
Based on the interaction between the terminal device 101 and the server 102, the information presentation system 100 may provide a drug traceability function. When a user holds the terminal device 101 to scan the medicine tracing code on the medicine package, the information display system 100 can display the medicine tracing information to the user; when the user holds the terminal device 101 and does not accurately scan the medicine tracing code, the information presentation system 100 may instruct the user to correctly scan the code, and respond to the user to present the medicine tracing information when the user accurately scans the medicine tracing code.
Wherein, terminal device 101 is mainly used for: and displaying an image of at least one part of the medicine package on an image display interface. Wherein, the medicine packaging body can comprise at least one of an outer packaging box, an outer packaging bag, an outer packaging box, a close-fitting inner packaging bottle, an inner packaging bag and an inner packaging box of the medicine. When the medicine is a capsule medicine, the medicine package may further include a capsule plate of the medicine. Generally, a medicine tracing code is printed on a medicine package.
Wherein an image of at least a portion of the pharmaceutical package is captured by the terminal device 101. Terminal device 101 may interact with a user to detect a code scan operation initiated by the user. In response to the code scanning operation, the terminal device 101 may start the camera to perform shooting, and display an image display interface on a shooting page of the camera. The image display interface is used for displaying images shot by the camera. When the camera photographs the medicine package, the terminal device 101 may display the photographed image of at least a portion of the medicine package on the image display interface.
The image display interface may be implemented as a part of the display area on the shooting page, or may be implemented as the whole display area on the shooting page, which is not limited in this embodiment. When the image display interface is implemented as a portion of the display area on the shooting page, the image display interface may be framed by a viewing frame for guiding a user to aim at the object being shot so that the object being shot is located within the viewing frame. In some embodiments, the framed image display interface may be described as a scan window on a photographic page, such as scan window 103 shown in FIG. 2.
The user initiating the code scanning operation may be a user with a medicine tracing requirement, such as a medicine purchasing user, a transportation user in a medicine transportation link, a medicine supervision user, and the like.
In some cases, the terminal device 101 may display a page, and display a code scanning operation control on the page, and a user may trigger the code scanning operation control to initiate a code scanning operation. In other cases, the terminal device 101 may monitor a voice instruction of the user, and the user may initiate a code scanning operation by issuing the code scanning voice instruction, which is not limited in this embodiment.
In some cases, when the user needs to trace back the medicine and align the camera of the terminal device 101 with the medicine tracing code, the terminal device 101 may shoot the medicine tracing code and display the medicine tracing code in the image display interface, as shown in fig. 2. At this time, the terminal apparatus 101 may decode the medicine tracing code, transmit the medicine information obtained by decoding to the server 102, and receive the tracing information of the medicine returned by the server 102.
In other cases, when the user needs to trace back the medicine, but the camera of the terminal device 101 is not aligned with the medicine tracing code, the terminal device 101 may capture an image of at least a portion of the medicine package and display the image of at least a portion of the medicine package in the image display interface.
For example, when the camera of the terminal device 101 is aligned with a side of the external medicine packing box that does not contain the medicine tracing code, an image of the side of the external medicine packing box can be displayed in the image display interface, as shown in fig. 3 a. When the camera of the terminal device 101 is not aligned with a side surface of the external medicine packing box or the camera is close to the external medicine packing box, the terminal device 101 may capture a local area of the side surface of the external medicine packing box, and a local image of the side surface may be displayed in the image display interface, as shown in fig. 3 b.
In this case, the terminal apparatus 101 may superimpose the display code scanning guidance information on the image display interface to guide the user to scan the article tracing code on the article package through the image display interface.
And the superposition display refers to the display of the code scanning guidance information and the image display interface on the same screen, so that the code scanning guidance information is displayed while the image display interface is displayed.
The code scanning guidance information refers to information for guiding a user to scan a medicine tracing code.
In some embodiments, the scan guidance information is provided by the server 102. In such an embodiment, the terminal device 101 may acquire an image of at least a portion of the pharmaceutical package within the image display interface and send the image to the server 102.
After receiving the image of at least a part of the medicine package sent by the terminal device 101, the server 102 may identify the image to determine the medicine corresponding to the medicine package. The operation of identifying the corresponding medicine based on the image of at least a part of the medicine package by the server 102 may be implemented based on a deep learning manner, which will be described in detail in the following embodiments and will not be described herein.
The server 102 stores code scanning guidance information corresponding to a plurality of different medicines. Based on this, after determining the medicine corresponding to the medicine package, the server 102 may obtain the code scanning guidance information of the medicine from the code scanning guidance information corresponding to a plurality of different medicines, and send the code scanning guidance information of the medicine to the terminal device 101.
After receiving the code scanning guidance information of the medicine tracing code returned by the server 102, the terminal device 101 may display the code scanning guidance information in an overlapping manner on the image display interface. Further, the terminal device 101 may instruct the user to scan the medicine tracing code on the medicine package through the image display interface by scanning the code guidance information.
In the above process, the terminal device 101 acquires the image of at least a part of the medicine package, and the process of identifying the corresponding medicine based on the image can be realized silently without the participation of the user, so that the medicine identification operation can be completed without the perception of the user. In addition, medicine identification can be realized based on at least a part of image of the medicine packaging body, and then, the user need not aim at the medicine packaging body completely with the camera, has reduced the requirement to user's operation.
Based on the above, the code scanning guidance information and the image display interface for scanning the medicine tracing code can be displayed on the same screen, and the user can adjust the placing angle of the medicine package or the scanning angle of the terminal device 101 according to the content scanned by the image display interface while watching the code scanning guidance information, so that the terminal device 101 can scan the medicine tracing code.
In the information presentation system 100, the above-mentioned data interaction process between the terminal device 101 and the server 102 may be implemented based on a communication connection relationship established between the terminal device 101 and the server 102. The specific communication connection mode may depend on the actual application scenario.
In some exemplary embodiments, the terminal device 101 and the server 102 may communicate with each other in a wired communication manner and a wireless communication manner. The WIreless communication mode includes short-distance communication modes such as bluetooth, ZigBee, infrared, WiFi (WIreless-Fidelity), long-distance WIreless communication modes such as LORA, and WIreless communication mode based on a mobile network. When the mobile network is connected through communication, the network format of the mobile network may be any one of 3d (gsm), 2.5G (gprs), 3G (WCDMA, TD-SCDMA, CDMA2000, UTMS), 4G (LTE), 4G + (LTE +), 5G, WiMax, and the like.
In the present embodiment, based on the interaction between the terminal device 101 and the server 102, when the user initiates a code scanning operation, an image of at least a portion of a medicine package in the image display interface is acquired, and a scanned medicine is identified based on the acquired image. After the medicine is identified, code scanning guidance information of the medicine is displayed in an overlapping mode on an image display interface, and then a user can watch the code scanning guidance information and execute code scanning operation. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the position of the medicine tracing code can be rapidly and accurately determined from the medicine packaging body by the user, and the code scanning tracing operation can be accurately completed.
The above embodiments describe embodiments in which the server 102 can identify an image of at least a portion of a drug package to identify a drug corresponding to the drug package. Specific alternative embodiments of server 102 for identifying drugs based on drug packages are illustrated below
In some exemplary embodiments, the server 102 may implement drug identification based on a deep learning approach.
Optionally, the depth model may include: the device comprises a main body region segmentation module and a main body identification module. The main body segmentation refers to identifying a region which may contain an article in the image as a main body region, and segmenting the main body region and a background region in the image to extract the main body region. The image subject identification means that the classification to which the subject belongs is identified based on the image features of the subject region and based on the image features.
Alternatively, in order to make the deep learning model learn to perform subject region segmentation and subject recognition on the input image, the deep learning model may be trained in advance based on a large amount of training data.
Wherein the training data may include: and image samples corresponding to a plurality of different medicine packages. Before training, the training data may be labeled, that is, each image sample is labeled with the type of the medicine corresponding to the image sample, a background area, and a main body area corresponding to the medicine package.
And then inputting the marked training data into a main body region segmentation module of the deep learning model. After the training data is input into the main body region segmentation module, the main body region segmentation module can extract image features in each image sample, and predict the main body region and the background region of each image sample based on the current model parameters of the main body region segmentation module. After the prediction result of the main region segmentation module for the image sample is obtained, the main region and the background region labeled on the image sample can be used as supervision signals to calculate the prediction loss of the main region segmentation module. Based on the prediction loss, model parameters of the subject region segmentation module may be adjusted. And repeatedly executing the process to iteratively train the main body region segmentation module until the prediction loss of the main body region segmentation module is less than the set threshold value.
After the training of the body region segmentation module is completed, next, the body recognition module may be trained based on the output result of the body region segmentation module.
Alternatively, the subject region and the background region of the image sample predicted by the subject region segmentation module may be acquired, and the predicted subject region may be input to the subject recognition module. In the main body recognition module, a set feature extraction algorithm can be adopted to extract the image features of the main body region, so as to obtain the image features corresponding to each main body region. Because the image samples are labeled with the classifications to which the corresponding medicines belong, the subject identification module can establish the corresponding relationship between the classifications to which the medicines belong and the image features after acquiring the image features corresponding to the subject areas in each image sample, and store the corresponding relationship in the server 102.
The operation of extracting the image features involved in the deep learning model can be realized based on the operation of extracting the depth features, or can be realized based on the operation of extracting the local features, or is realized based on the combined operation of the depth features and the local features. The depth feature extraction operation may be implemented based on a Convolutional Neural Network (CNN), and is not described in detail.
Based on the above, after the training is completed for the subject region segmentation module and the subject recognition module, the server 102 may store the deep learning model locally for subsequent use. When the server 102 receives the image of at least a part of the medicine package transmitted from the terminal apparatus 101, the image may be input to a deep learning model trained in advance. The deep learning model can extract the characteristics of the input image, predict the medicine corresponding to the image based on the pre-trained model parameters and output the prediction result.
Based on the above, when the server 102 receives the image of at least a part of the medicine package transmitted by the terminal apparatus 101, the image may be input to a deep learning model trained in advance. In the deep learning model, a main body region in the image is identified based on a main body region segmentation module, and feature extraction is carried out on the extracted main body region based on a main body identification module, so as to obtain the image features to be matched. Next, the server 102 may perform feature matching on the extracted image features to be matched and pre-stored image features of different drugs, and determine a drug corresponding to the image features to be matched according to a result obtained by the feature matching.
For example, the server 102 may compare the image features to be matched with the image features corresponding to each of the pre-stored medicines to obtain the similarity between the image features to be matched and the image features corresponding to each of the pre-stored medicines. And then selecting the medicine with the similarity meeting the set requirement as the medicine corresponding to the image characteristics to be matched.
Based on the above embodiment, the server 102 can accurately identify the medicine corresponding to the medicine package based on a deep learning manner, which is beneficial to accurately providing a code scanning guidance service of the medicine tracing code for the user.
In the above and following embodiments of the present application, the server 102 may pre-store code scanning guidance information corresponding to a plurality of medicines, and the code scanning guidance information may be stored in correspondence with the identification of the medicine. Wherein the identification of the drug may include: the name of the medicine, the number of the medicine, and SPU (Standard Product Unit) information of the medicine, which is not limited in this embodiment.
After identifying the corresponding drug based on the image of the at least a portion of the drug package, the server 102 may determine code scanning guidance information corresponding to the identified drug based on a correspondence of the identification of the drug and the code scanning guidance information.
Alternatively, the code scanning guidance information may be at least one of a code scanning guidance video, a code scanning prompt guidance audio, a code scanning guidance step map, and a code scanning guidance dynamic image. The code scanning instruction step diagram can comprise a plurality of images.
In the preprocessing stage, a code scanning guidance video corresponding to each medicine can be shot, and the code scanning guidance video and the identification of the medicine are correspondingly stored in the server 102; each code scanning guide video can be converted into a code scanning guide dynamic image, and the code scanning guide dynamic image and the identification of the medicine are correspondingly stored in the server 102; the package of each medicine can be shot to obtain a plurality of images, the images are respectively subjected to character marking to obtain a step diagram of code scanning tracing, and the step diagram of code scanning tracing and the identification of the medicine are correspondingly stored in the server 102.
The code scanning guidance video and the code scanning guidance dynamic image can dynamically display at least one of a relative position relation between a target surface containing a medicine tracing code on the medicine packaging body and a non-target surface (such as a front surface printed with a medicine name) not containing the medicine tracing code on the medicine packaging body, a position of the medicine tracing code on the target surface and a position of the non-medicine tracing code (such as a commodity code) on the medicine packaging body by adopting continuous image frames. Besides, the adjustment modes of the placing angle and the placing direction of the medicine package bodies can be dynamically displayed. For the code scanning guidance video, the audio guidance information can be added in the code scanning guidance video to guide the code scanning operation of the user, and the description is omitted.
The code scanning prompt guidance audio can be obtained by manual prerecording, and can also be obtained by voice conversion according to a preset code scanning guidance scheme. The code scanning prompt guidance audio can describe at least one of the main characteristics of a target surface containing the medicine tracing code on the medicine packaging body, the relative position relation between the target surface and a non-target surface not containing the medicine tracing code on the medicine packaging body and the position of the medicine tracing code on the target surface in a voice mode. The code scanning guidance step diagram information can adopt a discrete image sequence to display at least one of a target surface containing the medicine tracing code on the medicine packaging body, a relative position relation between the target surface and a non-target surface not containing the medicine tracing code on the medicine packaging body, a position of the medicine tracing code on the target surface and a position of the non-medicine tracing code (such as a commodity code) on the medicine packaging body. In each step diagram, the position of the correct tracing code and/or the position of the wrong tracing code can be marked by characters, which are not described again.
In this embodiment, the code scanning guidance information corresponding to each medicine is prepared in advance, and a code scanning guidance operation with high pertinence can be realized.
After receiving the code scanning guidance information of the medicine returned by the server 102, the terminal device 101 may display the code scanning guidance information in an overlapping manner on the image display interface.
Optionally, the terminal device 101 may display a floating window on the page where the image display interface is located, and display the code scanning guidance information in the floating window.
Optionally, when the terminal device 101 displays the floating window, the floating window may be displayed in another area outside the image display interface to avoid blocking the view area. As shown in fig. 4 and 5, the floating window may be displayed below the image display interface. Optionally, if the transparency of the floating window is high, the floating window and the image display interface may be properly superimposed, which is not limited in this embodiment.
Optionally, when displaying the code scanning guidance information, the terminal device 101 may display one or a combination of multiple types of positions of a target surface of the medicine package containing the medicine tracing back code, a relative position relationship between the display target surface and a non-target surface of the medicine package not containing the medicine tracing back code, a position of the displayable medicine tracing back code on the target surface, and a position of the displayable medicine tracing back code on the medicine package. The code scanning guidance information may be displayed through at least one of a code scanning guidance video, a code scanning guidance step diagram, and a code scanning guidance dynamic image, which is not limited in this embodiment.
A typical way to display the scan guiding message can be shown in fig. 4 and 5. In the illustration of fig. 4 and 5, a floating window is displayed below the scanning window, a scanning code guidance video is displayed in the floating window, the scanning code guidance video can be continuously played to display the medicine packing boxes from multiple angles, and the side faces printed with the medicine tracing codes on the medicine packing boxes are displayed and the positions of the medicine tracing codes are marked. Meanwhile, a code scanning guidance step diagram can be displayed below the code scanning guidance video. In the code scanning guidance step diagram, the front face of the medicine box, the relative position relation between the front face of the medicine box and the side face printed with the medicine tracing code, the close-up of the side face printed with the medicine tracing code, the character marking and the side face printed with the wrong code are respectively displayed by adopting a plurality of images.
In the illustration of fig. 4, the user has not found the drug tracing code accurately, and by viewing the code scanning guidance information below the scanning window, the user can find the position of the drug tracing code accurately and can adjust the angle of the drug packaging box. Further, the terminal apparatus 101 may photograph the medicine tracing code with a camera, as shown in fig. 5.
In this embodiment, based on the code scanning guidance video, the code scanning guidance step chart and the code scanning guidance dynamic image, the operation mode of determining the medicine tracing code from the medicine packaging body can be displayed to the user in a visual visualization mode, so that the user can more conveniently and flexibly master the code scanning operation skill.
In addition, based on the mode of displaying the scanning window and the code scanning guide information on the same screen, on one hand, the terminal equipment does not need to display the style of the medicine tracing code and the position of the medicine tracing code on the medicine packaging body in other modes (such as setting a special code scanning learning page); on the other hand, the user does not need to learn in advance and memorize the style of the medicine tracing code and the position of the medicine tracing code on the medicine packaging body, and the code scanning tracing operation can be completed only by directly scanning the medicine packaging body, so that the medicine tracing method is very convenient and fast.
In addition, the code scanning guidance information provided by the embodiment has strong pertinence, and the code scanning guidance information displayed by the terminal device 101 corresponds to the currently scanned medicine of the user, so that the user can acquire the code scanning guidance information more clearly, directly and accurately, and the code scanning tracing efficiency is improved.
Optionally, when the user adjusts the position of the medicine package so that the terminal device 101 can scan the medicine tracing code, the terminal device 101 may acquire the medicine tracing code in the image display interface, acquire the tracing information of the corresponding medicine according to the medicine tracing code, and display the tracing information of the medicine.
In some embodiments, the terminal device 101 has a plurality of drug tracing information pre-stored locally, and the tracing information of each drug is stored corresponding to the identity of the drug. After the terminal device 101 obtains the identifier of the drug through the drug tracing code analysis, the tracing information corresponding to the drug tracing code can be obtained locally and displayed.
In other embodiments, after obtaining the identifier of the drug through the drug tracing code analysis, the terminal device 101 may send a tracing information obtaining request to the server 102 according to the identifier of the drug. After receiving the trace back information acquisition request including the identifier of the medicine, the server 102 may issue the trace back information corresponding to the identifier of the medicine to the terminal device 101.
A typical way to display drug traceability information is shown in fig. 6. The medicine tracing information can comprise basic information such as the name, the production merchant, the specification and the details of the medicine, and also can comprise medicine verification information such as the number of scanning people and the number of scanning records of the medicine tracing code. Based on the medicine tracing information, the user can know the information of multiple dimensions of the medicine, and the medication safety is improved.
It should be noted that the embodiment of identifying the medicine based on the image of at least a part of the medicine package and acquiring the code scanning guide information corresponding to the medicine can be implemented as the "remote calculation" mode based on the server 102 as described in the above embodiment. When the server is implemented as a cloud server, the above-described computing manner may be described as a "cloud computing" manner.
In other alternative embodiments, the above-mentioned implementation of identifying the medicine based on the image of at least a portion of the medicine package and acquiring the code scanning guidance information corresponding to the medicine may be implemented in an "edge calculation" manner based on the terminal device 101. In this way, near-end services may be provided to the user.
In such an implementation of "edge calculation", the deep learning model described in the foregoing embodiment may be run on the terminal device 101. After the terminal device 101 acquires the image of at least a part of the medicine package, the image may be input to a locally-operated deep learning model to obtain a recognition result of the image. Alternatively, when the terminal device 101 has a large storage space, the code scanning guidance information corresponding to the plurality of medicines described in the foregoing embodiment may be stored locally in the terminal device 101.
After the terminal device 101 acquires the medicines corresponding to the images, the code scanning guidance information of the medicines corresponding to the images can be determined from the code scanning guidance information corresponding to the various medicines, and the code scanning guidance information is displayed on the page where the image display interface is located in an overlapping manner. In this manner, the terminal device 101 may break through network limitations and provide a faster, safer, and more reliable code scanning guidance service to the user.
Alternatively, in this embodiment, the server 102 may provide an update service of the deep learning model, and when the deep learning model is optimized, the server 102 may push the optimized deep learning model to the terminal device 101. Optionally. The server 102 may also provide a service for updating code scanning guidance information corresponding to the drug. For example, when scanning guide information of a newly added part of a medicine, the server 102 may send the newly added medicine and the corresponding scanning guide information to the terminal device 101 for use by the terminal device 101.
The information display system 100 provided by the foregoing embodiments may provide a code scanning guidance service for tracing other articles besides a code scanning guidance service for tracing back medicines, for example: the code scanning guidance service for tracing food, the code scanning guidance service for tracing chemical materials, the code scanning guidance service for tracing hazardous waste garbage, the code scanning guidance service for tracing cosmetics and the like.
In code scanning guidance for different articles, a deep learning model capable of identifying different articles based on an image of at least a portion of an article package may be trained, and code scanning guidance information for different articles may be prepared in advance. In one embodiment, the deep learning model and the correspondence between the code scanning guidance information and the identification of the article may be stored on the side of the terminal device 101; in another embodiment, the deep learning model and the correspondence between the code scanning guidance information and the identification of the item may be stored on the server 102 side.
Based on this, in one embodiment, when the user scans and traces the article based on the terminal device 101, if the article tracing code on the article package is not scanned, the terminal device 101 may identify the article corresponding to the image based on the image of at least a part of the article package within the image display interface and the deep learning model stored locally, and acquire the scan guidance information corresponding to the article from the scan guidance information of the plurality of different articles stored locally.
In another embodiment, terminal device 101 may capture an image of at least a portion of the item package within the image display interface and send the image to server 102. The server 102 identifies the article corresponding to the image based on the pre-trained deep learning model, acquires code scanning guide information corresponding to the article from code scanning guide information of a plurality of different articles, and returns code scanning guide information of the article tracing code to the terminal device 101.
After the terminal device 101 acquires the code scanning guide information corresponding to the article, the code scanning guide information can be displayed in an overlapping manner on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
Based on the implementation mode, a user can obtain the code scanning guide information corresponding to the article only by scanning the article, and can quickly and accurately scan the article tracing code according to the code scanning guide information, so that article tracing is realized, and repeated description is omitted.
In addition to the information presentation system described in the foregoing embodiment, an embodiment of the present application provides an information presentation method, as shown in fig. 7, when the information presentation method is executed on a terminal device side, the information presentation method may include the following steps:
And 701, displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
In some exemplary embodiments, before displaying the code scanning guidance information in the overlay mode, the method further includes: and sending the image to a server so that the server returns code scanning guidance information of the corresponding article tracing code according to the image.
In some exemplary embodiments, a manner of displaying the code scanning guidance information in an overlaid manner on the image display interface includes: displaying a floating window on the page where the image display interface is located; and displaying the code scanning guidance information in the floating window.
In some exemplary embodiments, the scanning guidance information is presented, including at least one of: displaying a target surface containing the article tracing code on the article packaging body; displaying the relative position relation between the target surface and a non-target surface which does not contain the article tracing code on the article packaging body; displaying the position of the article tracing code on the target surface; and displaying the position of the non-article tracing code on the article packaging body.
In some exemplary embodiments, the scan guidance information includes: at least one of a code scanning guidance video, a code scanning prompt guidance audio, a code scanning guidance step chart and a code scanning guidance dynamic image.
In some exemplary embodiments, after presenting the code scanning guidance information, the method further includes: acquiring the article tracing code in the image display interface; and acquiring the tracing information of the corresponding article according to the article tracing code, and displaying the tracing information of the article.
In some exemplary embodiments, the article package includes: at least one of an outer packing box, an outer packing bag, an inner packing bottle, an inner packing bag and an inner packing box of the article.
In some exemplary embodiments, the article comprises: a pharmaceutical composition.
In this embodiment, an image of at least a part of the article package is displayed on the image display interface, and the display code scanning guidance information is superimposed on the page where the image display interface is located, so that the user can scan the article tracing code on the article package through the image display interface while viewing the code scanning guidance information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
In addition to the information presentation system described in the foregoing embodiment, an embodiment of the present invention provides an information presentation method, as shown in fig. 8, when the information presentation method is executed on the server side, the method may include the following steps:
And step 802, identifying the image to determine the article corresponding to the article package.
And 803, acquiring code scanning guide information of the article from code scanning guide information corresponding to a plurality of different articles.
And step 804, sending the code scanning guidance information of the article to the terminal equipment for displaying so as to guide a user to scan the article tracing code on the article packaging body.
In some exemplary embodiments, a manner of identifying the image to determine the article corresponding to the article package includes: inputting the image into a deep learning model; identifying, in the deep learning model, a subject region in the image; extracting the features of the main body region to obtain the image features to be matched; and performing feature matching on the image features to be matched and pre-stored image features of different articles, and determining the article corresponding to the image features to be matched according to the result obtained by the feature matching.
In some exemplary embodiments, the code scanning guidance information of the article includes: at least one of a code scanning guide video, a code scanning guide step diagram and a code scanning guide dynamic image.
In some exemplary embodiments, the article package includes: at least one of an outer packing box, an outer packing bag, an inner packing bottle, an inner packing bag and an inner packing box of the article.
In some exemplary embodiments, the article comprises: a pharmaceutical composition.
In this embodiment, the scanned article may be identified based on an image of at least a portion of the article package. After the article is identified, code scanning guidance information of the article can be sent to the terminal equipment. Furthermore, the user can execute the code scanning operation while watching the code scanning guidance information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
It should be noted that the execution subjects of the steps of the methods provided in the above embodiments may be the same device, or different devices may be used as the execution subjects of the methods. For example, the execution subjects of steps 801 to 803 may be device a; for another example, the execution subject of steps 801 and 802 may be device a, and the execution subject of step 803 may be device B; and so on.
In addition, in some of the flows described in the above embodiments and the drawings, a plurality of operations are included in a specific order, but it should be clearly understood that the operations may be executed out of the order presented herein or in parallel, and the sequence numbers of the operations, such as 801, 802, etc., are merely used for distinguishing different operations, and the sequence numbers themselves do not represent any execution order. Additionally, the flows may include more or fewer operations, and the operations may be performed sequentially or in parallel.
It should be noted that, the descriptions of "first", "second", etc. in this document are used for distinguishing different messages, devices, modules, etc., and do not represent a sequential order, nor limit the types of "first" and "second" to be different.
Fig. 9 is a schematic structural diagram of a terminal device provided in an exemplary embodiment of the present application, where the terminal device is suitable for the information presentation system provided in the foregoing embodiment. As shown in fig. 9, the terminal device includes:
a display component 901, a communication component 902, an image acquisition component 903, a memory 904, and a processing component 905.
Wherein, the display component 901 is configured to: displaying an image of at least a portion of the item package in an image display interface; and displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
The image capturing component 903 is configured to capture an image of at least a part of the package of the article, so as to be displayed by the display component 901.
The memory 904 is used for storing computer programs and can be configured to store other various data to support operations on the terminal device. Examples of such data include instructions for any application or method operating on the terminal device, contact data, phonebook data, messages, pictures, videos, etc.
The processing component 905 is coupled to the memory 904, and is configured to execute the computer program in the memory 904 and call other components to implement the functions described in this embodiment.
Further optionally, the communication component 902 is configured to: before the display component 901 displays the code scanning guidance information in an overlapping manner, the image is sent to a server, so that the server returns the code scanning guidance information of the corresponding article tracing code according to the image.
Further optionally, the display component 901 is specifically configured to, when displaying the code scanning guidance information on the image display interface: displaying a floating window on the page where the image display interface is located; and displaying the code scanning guidance information in the floating window.
Further optionally, the display component 901 is specifically configured to perform at least one of the following operations when displaying the code scanning guidance information: displaying a target surface containing the article tracing code on the article packaging body; displaying the relative position relation between the target surface and a non-target surface which does not contain the article tracing code on the article packaging body; displaying the position of the article tracing code on the target surface; and displaying the position of the non-article tracing code on the article packaging body.
Further optionally, the code scanning guidance information includes: at least one of a code scanning guidance video, a code scanning prompt guidance audio, a code scanning guidance step chart and a code scanning guidance dynamic image.
Further optionally, after the display component 901 displays the code scanning guidance information, the image capturing component 903 is further configured to: acquiring the article tracing code in the image display interface; the processing component 905 is configured to: according to the article tracing code, tracing information of the corresponding article is acquired, and the tracing information of the article is displayed through the display component 901.
Further optionally, the article package comprises: at least one of an outer packing box, an outer packing bag, an inner packing bottle, an inner packing bag and an inner packing box of the article.
Further optionally, the article comprises: a pharmaceutical composition.
Further, as shown in fig. 9, the terminal device further includes: power component 906, audio component 907, and other components. Only some of the components are schematically shown in fig. 9, and it is not meant that the terminal device includes only the components shown in fig. 9.
The display assembly 901 includes a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP), among others. If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.
The image capturing component 903 may include a lens and an image sensor, and the image sensor may be implemented as a CCD (Charge-coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor.
In this embodiment, when the user initiates the code scanning operation, the code scanning guidance information of the article is displayed on the page where the image display interface is located, and then the user can perform the code scanning operation while viewing the code scanning guidance information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
Accordingly, the present application further provides a computer-readable storage medium storing a computer program, where the computer program can implement the steps that can be executed by the terminal device in the foregoing method embodiments when executed.
Fig. 10 is a schematic structural diagram of a server provided in an exemplary embodiment of the present application, where the server is suitable for the information presentation system provided in the foregoing embodiment. As shown in fig. 10, the server includes: memory 1001, processing component 1002, and communications component 1003.
A memory 1001 for storing a computer program and may be configured to store other various data to support operations on the server. Examples of such data include instructions for any application or method operating on the server, contact data, phonebook data, messages, pictures, videos, and so forth.
A communication component 1003 for: an image of at least a portion of the package of the article transmitted by the terminal device is acquired.
A processing component 1002, coupled to the memory 1001, for executing the computer program in the memory 1001 to: identifying the image to determine an article corresponding to the article package; the code scanning guidance information of the article is acquired from the code scanning guidance information corresponding to a plurality of different articles, and the code scanning guidance information of the article is sent to the terminal equipment for displaying through the communication component 1003 so as to guide a user to scan the article tracing code on the article packaging body.
Further optionally, the processing component 1002, when identifying the image to determine the article corresponding to the article package, is specifically configured to: inputting the image into a deep learning model; identifying, in the deep learning model, a subject region in the image; extracting the features of the main body region to obtain the image features to be matched; and performing feature matching on the image features to be matched and pre-stored image features of different articles, and determining the article corresponding to the image features to be matched according to the result obtained by the feature matching.
Further optionally, the code scanning guidance information of the article includes: at least one of a code scanning guidance video, a code scanning prompt guidance audio, a code scanning guidance step chart and a code scanning guidance dynamic image.
Further optionally, the article package comprises: at least one of an outer packing box, an outer packing bag, an inner packing bottle, an inner packing bag and an inner packing box of the article.
Further optionally, the article comprises: a pharmaceutical composition.
Further, as shown in fig. 10, the server further includes: power components 1004, and other components. Only some of the components are schematically shown in fig. 10, and it is not meant that the server includes only the components shown in fig. 10.
In this embodiment, the scanned article may be identified based on an image of at least a portion of the article package. After the article is identified, code scanning guidance information of the article can be sent to the terminal equipment. Furthermore, the user can execute the code scanning operation while watching the code scanning guidance information. Based on the implementation mode, when the user executes the code scanning operation, the code scanning guidance information is pushed to the user in real time, the timeliness of the code scanning guidance mode is improved, the user can quickly and accurately determine the position of the article tracing code from the article packaging body, and the code scanning tracing operation is accurately completed.
Accordingly, the present application further provides a computer-readable storage medium storing a computer program, where the computer program can implement the steps that can be executed by the server in the foregoing method embodiments when executed.
The memories of fig. 9 and 10 may be implemented by any type of volatile or non-volatile memory device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The communication components of fig. 9 and 10 described above are configured to facilitate wired or wireless communication between the device in which the communication component is located and other devices. The device in which the communication component is located may access a wireless network based on a communication standard, such as WiFi, 3d, 3G, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component may be implemented based on Near Field Communication (NFC) technology, Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
The power supply components of fig. 9 and 10 described above provide power to the various components of the device in which the power supply components are located. The power components may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device in which the power component is located.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (15)
1. An information display method, comprising:
displaying an image of at least a portion of the item package in an image display interface;
and displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
2. The method of claim 1, wherein before displaying the scanning guidance information in the overlay manner, further comprising:
and sending the image to a server so that the server returns code scanning guidance information of the corresponding article tracing code according to the image.
3. The method of claim 1, wherein displaying code scanning guidance information in an overlaid manner on the image display interface comprises:
displaying a floating window on the page where the image display interface is located;
and displaying the code scanning guidance information in the floating window.
4. The method of claim 1, wherein presenting the scanning guidance information comprises at least one of:
displaying a target surface containing the article tracing code on the article packaging body;
displaying the relative position relation between the target surface and a non-target surface which does not contain the article tracing code on the article packaging body;
displaying the position of the article tracing code on the target surface;
and displaying the position of the non-article tracing code on the article packaging body.
5. The method of claim 1, wherein the scanning direction information comprises: at least one of a code scanning guidance video, a code scanning prompt guidance audio, a code scanning guidance step chart and a code scanning guidance dynamic image.
6. The method of claim 1, wherein after presenting the scanning guidance information, further comprising:
acquiring the article tracing code in the image display interface;
and acquiring the tracing information of the corresponding article according to the article tracing code, and displaying the tracing information of the article.
7. The method of any of claims 1-6, wherein the article package comprises: at least one of an outer packing box, an outer packing bag, an inner packing bottle, an inner packing bag and an inner packing box of the article.
8. The method according to any one of claims 1-6, wherein the article comprises: a pharmaceutical composition.
9. An information processing method characterized by comprising:
acquiring an image of at least a part of an article package sent by a terminal device;
identifying the image to determine an article corresponding to the article package;
acquiring code scanning guide information of an article from code scanning guide information corresponding to a plurality of different articles;
and sending the code scanning guide information of the article to the terminal equipment for displaying so as to guide a user to scan the article tracing code on the article packaging body.
10. The method of claim 9, wherein identifying the image to determine the item to which the package of items corresponds comprises:
inputting the image into a deep learning model;
identifying, in the deep learning model, a subject region in the image;
extracting the features of the main body region to obtain the image features to be matched;
and performing feature matching on the image features to be matched and pre-stored image features of different articles, and determining the article corresponding to the image features to be matched according to the result obtained by the feature matching.
11. The method of claim 9, wherein the scanning guidance information of the item comprises: at least one of a code scanning guide video, a code scanning guide step diagram and a code scanning guide dynamic image.
12. The method according to any one of claims 9-11, wherein the article comprises: a pharmaceutical composition.
13. A terminal device, comprising: a display component;
the display assembly is configured to: displaying an image of at least a portion of the item package on an image display interface; and displaying code scanning guidance information in an overlapping mode on the image display interface so as to guide a user to scan the article tracing code on the article packaging body through the image display interface.
14. A server, comprising: a processing component and a communication component;
the communication component to: acquiring an image of at least a part of an article package sent by a terminal device;
the processing component is configured to: identifying the image to determine an article corresponding to the article package; acquiring code scanning guide information of an article from code scanning guide information corresponding to a plurality of different articles; and sending the code scanning guide information of the article to the terminal equipment for displaying through the communication assembly so as to guide a user to scan the article tracing code on the article packaging body.
15. A computer-readable storage medium storing a computer program, wherein the computer program is capable of implementing the information presentation method according to any one of claims 1 to 8 or the information processing method according to any one of claims 9 to 12 when executed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010962523.XA CN114266327A (en) | 2020-09-14 | 2020-09-14 | Information display method, information processing method, terminal equipment, server and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010962523.XA CN114266327A (en) | 2020-09-14 | 2020-09-14 | Information display method, information processing method, terminal equipment, server and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114266327A true CN114266327A (en) | 2022-04-01 |
Family
ID=80824082
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010962523.XA Pending CN114266327A (en) | 2020-09-14 | 2020-09-14 | Information display method, information processing method, terminal equipment, server and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114266327A (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101859407A (en) * | 2010-05-17 | 2010-10-13 | 王玉春 | Commodity tracing method based on site identification |
| TWM467132U (en) * | 2013-05-24 | 2013-12-01 | Imar Technology Co Ltd | Image recognition mobile-commerce system for mobile phone |
| CN107944885A (en) * | 2017-12-08 | 2018-04-20 | 快创科技（大连）有限公司 | A kind of commodity tracing management system based on AR technologies |
| CN108833703A (en) * | 2018-06-20 | 2018-11-16 | 深圳正品创想科技有限公司 | A kind of commodity association message rendering method and its device, mobile terminal |
| CN109242473A (en) * | 2018-08-31 | 2019-01-18 | 阿里巴巴集团控股有限公司 | A kind of method of payment, device and electronic equipment |
| CN208737535U (en) * | 2018-09-12 | 2019-04-12 | 苏州优化智能科技有限公司 | A kind of smart electronics retrospect scale system |
| CN305141684S (en) * | 2019-05-03 | |||
| CN110599512A (en) * | 2019-08-25 | 2019-12-20 | 南京理工大学 | Medicine name identification method and system based on image identification |
| CN110940407A (en) * | 2019-12-11 | 2020-03-31 | 北京星际华通科技有限公司 | Intelligent electronic scale for Internet of things and transaction method, device and system thereof |
| WO2020148658A2 (en) * | 2019-01-18 | 2020-07-23 | Rathod Yogesh | Methods and systems for displaying on map current or nearest and nearby or searched and selected location(s), geo-fence(s), place(s) and user(s) and identifying associated payments and account information for enabling to make and receive payments |
| CN111652678A (en) * | 2020-05-27 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Article information display method, device, terminal, server and readable storage medium |
-
2020
- 2020-09-14 CN CN202010962523.XA patent/CN114266327A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN305141684S (en) * | 2019-05-03 | |||
| CN101859407A (en) * | 2010-05-17 | 2010-10-13 | 王玉春 | Commodity tracing method based on site identification |
| TWM467132U (en) * | 2013-05-24 | 2013-12-01 | Imar Technology Co Ltd | Image recognition mobile-commerce system for mobile phone |
| CN107944885A (en) * | 2017-12-08 | 2018-04-20 | 快创科技（大连）有限公司 | A kind of commodity tracing management system based on AR technologies |
| CN108833703A (en) * | 2018-06-20 | 2018-11-16 | 深圳正品创想科技有限公司 | A kind of commodity association message rendering method and its device, mobile terminal |
| CN109242473A (en) * | 2018-08-31 | 2019-01-18 | 阿里巴巴集团控股有限公司 | A kind of method of payment, device and electronic equipment |
| CN208737535U (en) * | 2018-09-12 | 2019-04-12 | 苏州优化智能科技有限公司 | A kind of smart electronics retrospect scale system |
| WO2020148658A2 (en) * | 2019-01-18 | 2020-07-23 | Rathod Yogesh | Methods and systems for displaying on map current or nearest and nearby or searched and selected location(s), geo-fence(s), place(s) and user(s) and identifying associated payments and account information for enabling to make and receive payments |
| CN110599512A (en) * | 2019-08-25 | 2019-12-20 | 南京理工大学 | Medicine name identification method and system based on image identification |
| CN110940407A (en) * | 2019-12-11 | 2020-03-31 | 北京星际华通科技有限公司 | Intelligent electronic scale for Internet of things and transaction method, device and system thereof |
| CN111652678A (en) * | 2020-05-27 | 2020-09-11 | 腾讯科技（深圳）有限公司 | Article information display method, device, terminal, server and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6396605B2 (en) | Region extraction method and apparatus | |
| JP2018500706A (en) | Region recognition method and apparatus | |
| TWI582710B (en) | The method of recognizing the object of moving image and the interactive film establishment method of automatically intercepting target image | |
| CN111897507B (en) | Screen projection method and device, second terminal and storage medium | |
| US9412017B1 (en) | Methods systems and computer program products for motion initiated document capture | |
| CN107526987B (en) | Apparatus, system, and method for using an imaging component on a mobile terminal | |
| US20180107876A1 (en) | Method and system for providing augmented reality contents by using user editing image | |
| CN106055707A (en) | Bullet screen display method and device | |
| US20210374476A1 (en) | Method and system for identifying authenticity of an object | |
| CN107092904B (en) | Method and device for acquiring resources | |
| CN106056117A (en) | Image processing method and device for rectangular object | |
| US10402777B2 (en) | Method and a system for object recognition | |
| US10600060B1 (en) | Predictive analytics from visual data | |
| CN108718423B (en) | Working method of two-dimensional code information sharing system between television terminal and mobile terminal | |
| CN114266327A (en) | Information display method, information processing method, terminal equipment, server and storage medium | |
| US9269159B2 (en) | Systems and methods for tracking object association over time | |
| EP4047568A1 (en) | Method and device for generating emoticon, and storage medium | |
| US20140115711A1 (en) | Method and apparatus for delivering private media content to smart phones | |
| CN110662103B (en) | Multimedia object reconstruction method and device, electronic equipment and readable storage medium | |
| CN115878844A (en) | Video-based information display method and device, electronic equipment and storage medium | |
| US10051232B2 (en) | Adjusting times of capture of digital images | |
| CN113362424A (en) | Image synthesis method, commodity advertisement image synthesis device and storage medium | |
| CN113382153B (en) | Method and apparatus for displaying image, electronic device, and storage medium | |
| Farhath et al. | Development of shopping assistant using extraction of text images for visually impaired | |
| US20210248755A1 (en) | Product release method and image processing method, apparatus, device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |