CN116168376A - Voice broadcast medicine box recognition device and medicine box recognition method - Google Patents

Voice broadcast medicine box recognition device and medicine box recognition method Download PDF

Info

Publication number
CN116168376A
CN116168376A CN202310411759.8A CN202310411759A CN116168376A CN 116168376 A CN116168376 A CN 116168376A CN 202310411759 A CN202310411759 A CN 202310411759A CN 116168376 A CN116168376 A CN 116168376A
Authority
CN
China
Prior art keywords
medicine
medicine box
rectangular frame
screw rod
box
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202310411759.8A
Other languages
Chinese (zh)
Other versions
CN116168376B (en
Inventor
张晓俊
周嘉成
姜余杰
邱志昕
黄嘉敏
陶智
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou University
Original Assignee
Suzhou University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou University filed Critical Suzhou University
Priority to CN202310411759.8A priority Critical patent/CN116168376B/en
Publication of CN116168376A publication Critical patent/CN116168376A/en
Application granted granted Critical
Publication of CN116168376B publication Critical patent/CN116168376B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J7/00—Devices for administering medicines orally, e.g. spoons; Pill counting devices; Arrangements for time indication or reminder for taking medicine
    • A61J7/04—Arrangements for time indication or reminder for taking medicine, e.g. programmed dispensers
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/50—General identification or selection means using icons or symbolic figures, e.g. by a graphical representation symbolising the type of pathology or the organ by an image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61J—CONTAINERS SPECIALLY ADAPTED FOR MEDICAL OR PHARMACEUTICAL PURPOSES; DEVICES OR METHODS SPECIALLY ADAPTED FOR BRINGING PHARMACEUTICAL PRODUCTS INTO PARTICULAR PHYSICAL OR ADMINISTERING FORMS; DEVICES FOR ADMINISTERING FOOD OR MEDICINES ORALLY; BABY COMFORTERS; DEVICES FOR RECEIVING SPITTLE
    • A61J2205/00—General identification or selection means
    • A61J2205/70—Audible labels, e.g. for pre-recorded info or messages
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D30/00—Reducing energy consumption in communication networks
    • Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Medical Preparation Storing Or Oral Administration Devices (AREA)

Abstract

The invention relates to a voice broadcasting medicine box recognition device and a medicine box recognition method, comprising a base; the sliding assembly comprises a screw rod, a sliding table and a moving platform, wherein the screw rod is rotatably arranged on the base, one end of the screw rod is connected with a driving source, the sliding table is in threaded connection with the screw rod, and the moving platform is arranged on the sliding table; the control assembly comprises a controller, a camera and a loudspeaker, wherein the controller is arranged on the base and is respectively connected with the driving source, the camera and the loudspeaker, and the camera is arranged opposite to the mobile platform; the device also comprises an acquisition module, a judging module and an identification module for processing the medicine box image; the medicine box identification method disclosed by the invention is matched with the voice broadcasting medicine box identification device, so that medicine information on the medicine box can be accurately found and identified, and medicine taking of visually defective groups such as blind persons can be assisted by voice broadcasting of medicine names and medicine taking precautions; the voice broadcasting medicine box recognition device is simple in structure, convenient to operate, high in fault tolerance and suitable for practicality.

Description

Voice broadcast medicine box recognition device and medicine box recognition method
Technical Field
The invention relates to the technical field of medical auxiliary equipment, in particular to a voice broadcasting medicine box identification device and a medicine box identification method.
Background
In recent years, due to the dramatic increase in the aging of the world population, there are endless cases of auxiliary devices aimed at helping the elderly take medicines. The traditional common devices capable of assisting the old in taking medicines are mostly medicine boxes, and comprise common medicine boxes, wherein the common medicine boxes are formed by dividing a plastic box into areas, and then labeling information such as corresponding medicine names and dosage on each area to assist the old in taking medicines correctly; the intelligent medicine box is characterized in that the user is prompted to take medicine by voice, the medicine taking times are reminded, and the like, and medicine taking information can be transmitted to a mobile phone of a guardian for reminding at a higher level.
The auxiliary medicine taking device can remind the old to take medicine, but does not have the function of automatically identifying the medicine, and the medicine is classified by human intervention or manually identified to take, so that the auxiliary medicine taking device cannot be suitable for people with vision defects such as blind people.
Disclosure of Invention
Therefore, the invention aims to solve the technical problems that the medicine taking auxiliary device in the prior art can remind the old to take medicine, but does not have the function of automatically identifying the medicine, the medicine is required to be classified by human intervention or the medicine is required to be taken by human identification, and the medicine taking auxiliary device cannot be suitable for people with vision defects such as blind people.
In order to solve the technical problems, the invention provides a voice broadcasting medicine box identification device, which comprises,
the acquisition module is used for acquiring the image information of the medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text row on the medicine box according to the image information of the medicine box;
the judging module is used for selecting a text line in any rectangular frame to perform text recognition and judging whether the text is inverted, if so, putting the medicine box again until the medicine box is put correctly, if so, dividing the medicine box into areas according to the medicine box frame and the central position of the medicine box, and determining the confidence coefficient of each rectangular frame according to the position of each rectangular frame relative to the dividing area, the length-width ratio of each rectangular frame and the area of each rectangular frame;
the identification module is used for taking the text line in the rectangular frame with the highest confidence as the name of the medicine, carrying out character identification on the medicine name, comparing the identified medicine name with the medicine names in the database, judging whether the matching rate is in a set range, broadcasting the medicine name and the notice of medicine taking by voice if the matching rate is in the set range, and adjusting the position of the medicine box if the matching rate is not in the set range.
In one embodiment of the present invention, further comprising,
the base is used for bearing;
the sliding assembly comprises a screw rod, sliding rods, a sliding table and a moving platform, wherein the screw rod is rotatably arranged on the base, one end of the screw rod is connected with a driving source for driving the screw rod to rotate, the two sliding rods are parallel to the screw rod and arranged on the base, the two sliding rods are respectively positioned on two sides of the screw rod, the sliding table is in threaded connection with the screw rod and is in sliding connection with the sliding rods, and the moving platform is arranged on the sliding table;
the control assembly comprises a controller, a camera and a loudspeaker, wherein the controller is arranged on the base and is respectively connected with the driving source, the camera and the loudspeaker, and the camera is opposite to the mobile platform and is positioned on the motion path of the mobile platform.
In one embodiment of the invention, the base comprises an internal accommodating space, the screw rod and the sliding table are both positioned in the accommodating space, two through grooves which are communicated with the accommodating space are symmetrically formed in two sides of the base, the through grooves are parallel to the screw rod, and two ends of the moving platform respectively extend into the accommodating space from the two through grooves and are connected with the sliding table.
In one embodiment of the invention, a drive source protection cover is arranged on the base, and the drive source is arranged in the drive source protection cover.
In one embodiment of the invention, the driving source protection cover is connected with a main box, the controller is arranged in the main box, a mounting hole is arranged on one side of the main box facing the moving platform, the camera is coaxially arranged in the mounting hole, and the main box is also provided with a sound outlet hole group corresponding to the position of the loudspeaker.
In one embodiment of the present invention, a control button is further disposed on the main case, and the control button is connected to the controller.
A medicine box identification method, which uses the voice broadcasting medicine box identification device as set forth in any one of the above to identify and broadcast the medicine name on the medicine box, comprising the following steps,
step S1: acquiring image information of a medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text line according to the image information of the medicine box;
step S2: selecting a text line in any rectangular frame for text recognition and judging whether the text is inverted, if so, rearranging the medicine box until the medicine box is correctly positioned, if so, dividing the medicine box into areas according to the center positions of the medicine box frame and the medicine box, and determining the confidence coefficient of each rectangular frame according to the positions of each rectangular frame relative to the dividing areas, the length-width ratio of each rectangular frame and the area of each rectangular frame;
step S3: and (3) taking a text line in a rectangular frame with highest confidence as a medicine name, performing character recognition on the medicine name, comparing the recognized medicine name with the medicine names in a database, judging whether the matching rate is in a set range, if so, broadcasting the medicine name and the notice of medicine taking by voice, and if not, adjusting the position of the medicine box, and returning to the step (S1) until the matching rate is in the set range.
In one embodiment of the present invention, the method for determining the confidence level of each rectangular frame is as follows: dividing the medicine box into an area A, an area B and an area C, and determining the confidence coefficient of each rectangular frame according to the following formula:
Figure SMS_1
Figure SMS_2
Figure SMS_3
Figure SMS_4
wherein xi represents the confidence of the text in each rectangular frame; xi represents the area within each rectangular border;
Figure SMS_5
representing the area within the rectangular border; />
Figure SMS_6
For each rectangular aspect ratio; />
Figure SMS_7
Is the total number of rectangles of text on the box outlined by the EAST algorithm.
In one embodiment of the invention, the edges of the medicine box are highlighted by using a canny operator, the frame of the medicine box is determined by using hough linear detection, the center position of the medicine box is determined, and the rectangular frames of all texts on the medicine box are determined by using an EAST algorithm.
In one embodiment of the invention, the medicine name obtained in the step S3 is identified through hundred-degree OCR, and fuzzyWuzzy is introduced to blur the character string of the medicine name.
Compared with the prior art, the technical scheme of the invention has the following advantages:
the invention relates to a voice broadcasting medicine box identification device and a medicine box identification method, wherein the voice broadcasting medicine box identification device comprises a base, a sliding component, a control component, an acquisition module, a judging module and an identification module, wherein the sliding component comprises a moving platform driven by a driving source and a screw rod, the control component comprises a controller, a camera and a loudspeaker, the camera is opposite to the moving platform and is used for acquiring image information of a medicine box placed on the moving platform, after the image information is processed by the acquisition module, the judging module and the identification module, the controller broadcasts names and related using instructions of medicines to a user through the loudspeaker according to the processed and identified information; the medicine box identification method disclosed by the invention is matched with the voice broadcasting medicine box identification device, so that medicine information on the medicine box can be accurately found and identified, and medicine taking of visually defective groups such as blind persons can be assisted by voice broadcasting of medicine names and medicine taking precautions; the voice broadcasting medicine box recognition device is simple in structure, convenient to operate, high in fault tolerance and suitable for practicality.
Drawings
In order that the invention may be more readily understood, a more particular description of the invention will be rendered by reference to specific embodiments thereof that are illustrated in the appended drawings, in which
Fig. 1 is a perspective view of a voice broadcast kit identification apparatus according to a preferred embodiment of the present invention;
fig. 2 is a schematic diagram showing an internal structure of a voice broadcast kit identification apparatus according to a preferred embodiment of the present invention;
FIG. 3 is an exploded view of a voice broadcast kit identification device according to a preferred embodiment of the present invention;
fig. 4 is a schematic diagram of a sliding table of the voice broadcast medicine box recognition device according to the preferred embodiment of the invention;
FIG. 5 is a schematic diagram of a main case of a voice broadcast medicine case identification apparatus according to a preferred embodiment of the present invention;
fig. 6 is a schematic view showing a part of the structure of a voice broadcast kit identification apparatus according to a preferred embodiment of the present invention;
FIG. 7 is a schematic representation of a rectangular framing of all text lines on a cartridge image;
fig. 8 is a schematic illustration of partitioning a cartridge image.
Description of the specification reference numerals: 1. an acquisition module; 2. a judging module; 3. an identification module; 4. a base; 5. a sliding assembly; 51. a screw rod; 52. a slide bar; 53. a sliding table; 531. a threaded through hole; 532. a guide hole; 54. a mobile platform; 55. a driving source; 6. a control assembly; 61. a controller; 62. a camera; 63. a speaker; 64. a control button; 7. a drive source protection cover; 8. a main body case; 81. a mounting hole; 82. and a sound outlet hole group.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and specific examples, which are not intended to be limiting, so that those skilled in the art will better understand the invention and practice it.
Example 1
Referring to fig. 1-6, a voice broadcast kit identification apparatus of the present invention includes,
the acquisition module 1 is used for acquiring the image information of the medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text row on the medicine box according to the image information of the medicine box;
the judging module 2 is used for selecting a text line in any rectangular frame to perform text recognition and judging whether the text is inverted, if so, putting the medicine box again until the medicine box is put correctly, if so, dividing the medicine box into areas according to the medicine box frame and the central position of the medicine box, and determining the confidence coefficient of each rectangular frame according to the position of each rectangular frame relative to the dividing area, the length-width ratio of each rectangular frame and the area of each rectangular frame;
and the recognition module 3 is used for taking the text line in the rectangular frame with the highest confidence as the name of the medicine, carrying out character recognition on the medicine name, comparing the recognized medicine name with the medicine names in the database, judging whether the matching rate is in a set range, broadcasting the medicine name and the notice of medicine taking by voice if the matching rate is in the set range, and adjusting the position of the medicine box if the matching rate is not in the set range.
As shown with reference to fig. 1-5, further comprising,
a base 4, the base 4 being for carrying;
the sliding assembly 5 comprises a screw rod 51, sliding rods 52, a sliding table 53 and a moving platform 54, wherein the screw rod 51 is rotatably arranged on the base 4, one end of the screw rod 51 is connected with a driving source 55 for driving the screw rod to rotate, two sliding rods 52 are arranged on the base 4 in parallel with the screw rod 51, the two sliding rods 52 are respectively positioned on two sides of the screw rod 51, the sliding table 53 is in threaded connection with the screw rod 51 and is in sliding connection with the sliding rods 52, and the moving platform 54 is arranged on the sliding table 53;
the control assembly 6, the control assembly 6 includes a controller 61, a camera 62 and a speaker 63, the controller 61 is disposed on the base 4, the controller 61 is respectively connected to the driving source 55, the camera 62 and the speaker 63, and the camera 62 is disposed opposite to the moving platform 54 and located on a motion path of the moving platform 54.
Specifically, the screw rod 51 extends along the length direction of the base 4, two ends of the screw rod 51 are respectively connected with the base 4 in a rotating way, the driving source 55 is arranged on the base 4, the output end of the driving source 55 is coaxially connected with one end of the screw rod 51, the screw rod 51 is connected with a sliding table 53 in a threaded way, and a moving platform 54 for placing a medicine box is arranged on the sliding table 53; the driving source 55 drives the screw rod 51 to rotate, so that the sliding table 53 in threaded connection with the screw rod 51 and the moving platform 54 connected with the sliding table can be driven to move along the screw rod 51, and the moving direction of the moving platform 54 can be controlled by controlling the rotating direction of the output shaft of the driving source 55.
Specifically, the controller 61 is connected to the base 4, the controller 61 is connected to the camera 62, the speaker 63 and the control button 64, and the controller 61 is connected to the driving source 55, and the camera 62 is disposed opposite to the moving platform 54 to photograph the medicine box on the moving platform 54. The acquisition module 1, the judgment module 2 and the identification module 3 are connected with a controller.
The using process comprises the following steps: the user places the medicine box on the mobile platform 54, presses the control button 64 for a long time to start the device, the device automatically identifies the medicine box on the mobile platform 54, and after the identification is successful, the device performs voice broadcast to broadcast the name and the taking mode of the medicine, if the identification fails, the device can broadcast voice of the identification failure, the user controls the distance between the mobile platform 54 and the camera 62 through the control button 64 (the distance between the medicine box and the camera 62 is generally required to be increased for the medicine box with larger volume, and the distance between the medicine box and the camera 62 is generally required to be reduced for the medicine box with smaller volume), and after a period of time, the device can re-identify until the identification is successful.
More preferably, the control buttons 64 can be divided into a power switch, a first moving button for controlling the moving platform 54 to be far away from the camera 62 and a second moving button for controlling the moving platform 54 to be close to the camera 62, and protrusions with different patterns can be respectively arranged on the three buttons, so that the blind can distinguish the different buttons through touching, and the operation and the use of the blind are convenient. Meanwhile, a fixing structure capable of fixing the medicine box can be arranged on the mobile platform 54, so that the medicine box is prevented from toppling over in the process of moving along with the mobile platform 54, and the smooth proceeding of the identification process is prevented.
Specifically, the base 4 includes the bottom plate, the bottom plate is the rectangular plate, the both ends of bottom plate are provided with a baffle perpendicularly respectively, and two other sides of bottom plate are provided with a first flange perpendicularly respectively, a structure of enclosing the bottom plate in the centre formation slot form is constituteed to first flange and baffle, and the base 4 still includes the safety cover, the safety cover is the concave shape, including the intermediate lamella and be located its both sides and rather than vertically second flange, the both ends of safety cover are connected rather than at the top of two baffles respectively, and two second flanges downwardly extending of safety cover, the safety cover like this, the bottom plate, baffle and first flange just form a semi-closed structure, can play certain guard action to lead screw 51 of setting in its inside, slide bar 52 and slip table 53. Meanwhile, it should be noted that a certain gap is formed between the first flange and the second flange, so that two ends of the moving platform 54 can extend into the base 4 through the gap to be connected with the sliding table 53.
Referring to fig. 4, a threaded through hole 531 is provided on the sliding table 53, the sliding table 53 is in threaded connection with the screw rod 51 through the threaded through hole 531, two guide holes 532 parallel to the threaded through hole 531 and respectively located at two sides of the sliding table 53 are symmetrically provided on the sliding table 53, and the sliding table 53 is respectively in sliding connection with the two sliding rods 52 through the two guide holes 532. It is conceivable that the sliding table 53 is guided and limited by symmetrically arranging the sliding rods 52 parallel to the screw rod 51 at both sides of the screw rod, so that the sliding table 53 has better stability in the moving process, and smooth adjustment and identification processes are ensured.
Referring to fig. 1,2,3 and 5, further, the base 4 includes an internal accommodating space, the screw rod 51 and the sliding table 53 are both located in the accommodating space, two through slots which are communicated with the accommodating space are symmetrically arranged on two sides of the base 4, the through slots are parallel to the screw rod 51, and two ends of the moving platform 54 respectively extend into the accommodating space from the two through slots and are connected with the sliding table 53.
Further, the base 4 is provided with a driving source protection cover 7, and the driving source 55 is provided in the driving source protection cover 7; it is conceivable that the driving source 55 can be protected by providing the driving source protection cover 7, and that the driving source 55 is prevented from being knocked and damaged during the process of taking and transferring the device.
Further, the driving source protection cover 7 is connected with a main case 8, the controller 61 is arranged in the main case 8, one side of the main case 8 facing the moving platform 54 is provided with a mounting hole 81, the camera 62 is coaxially arranged in the mounting hole 81, and the main case 8 is also provided with a sound outlet hole group 82 corresponding to the position of the loudspeaker 63; specifically, the main case 8 is detachably connected with the driving source protection cover 7, a space for accommodating the controller 61 is provided in the main case 8, and meanwhile, a mounting hole 81 for placing the camera 62 is provided in the main case 8, so that each component is convenient to mount and fix. And the sound hole group 82 is arranged on the main box 8, so that the sound emitted by the loudspeaker 63 positioned inside the main box 8 can be conveniently released and heard by an operator.
Further, a control button 64 is further provided on the main case 8, and the control button 64 is connected to the controller 61.
Example two
Referring to fig. 7 and 8, a medicine box identification method, which uses the voice broadcast medicine box identification device according to any one of the above to identify and broadcast the medicine name on the medicine box, includes the following steps,
step S1: acquiring image information of a medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text line according to the image information of the medicine box;
step S2: selecting a text line in any rectangular frame for text recognition and judging whether the text is inverted, if so, rearranging the medicine box until the medicine box is correctly positioned, if so, dividing the medicine box into areas according to the center positions of the medicine box frame and the medicine box, and determining the confidence coefficient of each rectangular frame according to the positions of each rectangular frame relative to the dividing areas, the length-width ratio of each rectangular frame and the area of each rectangular frame;
step S3: and (3) taking a text line in a rectangular frame with highest confidence as a medicine name, performing character recognition on the medicine name, comparing the recognized medicine name with the medicine names in a database, judging whether the matching rate is in a set range, if so, broadcasting the medicine name and the notice of medicine taking by voice, and if not, adjusting the position of the medicine box, and returning to the step (S1) until the matching rate is in the set range.
Further, the method for determining the confidence coefficient of each rectangular frame comprises the following steps: dividing the medicine box into an area A, an area B and an area C, and determining the confidence coefficient of each rectangular frame according to the following formula:
Figure SMS_8
Figure SMS_9
Figure SMS_10
Figure SMS_11
wherein xi represents the context of each rectangular frameConfidence of the cost; xi represents the area within each rectangular border;
Figure SMS_12
representing the area within the rectangular border; />
Figure SMS_13
For each rectangular aspect ratio; />
Figure SMS_14
Is the total number of rectangles of text on the box outlined by the EAST algorithm.
Specifically, the characters of each text line on the medicine box are connected together to form a shape similar to a rectangle, the rectangular frames of all the text lines on the medicine box image are determined by using an EAST algorithm (namely, the text lines are rectangular frames), the characters in one rectangular frame are arbitrarily selected for text recognition, and whether the medicine box is inverted or not can be judged by the recognized characters; meanwhile, the medicine box can be divided into an area A, an area B and an area C by the frame of the medicine box and the central position of the medicine box, which are obtained in the step S1, wherein the area A is the upper half part (namely half rectangle) of the medicine box image; the rectangle formed in the lower half of the cartridge image is equally divided into two rectangles from the middle to the left and right, forming the B region and the C region, respectively.
After a large number of medicine boxes are checked, the medicine names on the medicine boxes are most likely to appear in the dotted line box position of the area A, the medicine names on the medicine boxes are most likely to appear in the dotted line box positions of the area A and the area B, and the medicine names on the medicine boxes are almost not likely to appear in the area C alone; according to the relevant regulations of the national drug administration, the number of words of the names of the drugs cannot exceed 8, meanwhile, after the drug names are searched, the minimum number of words of the drug names is found to be 3, according to the characteristics, a threshold value is set, and the rectangle with the length-width ratio of 3-8 is reserved; in addition, the rectangular area occupied by the medicine name is generally the largest; and weight distribution is carried out according to the three characteristics, so that the single characteristic is prevented from breaking judgment of the name and the position of the medicine, and the highest recognition accuracy is ensured.
Further, the edges of the medicine boxes are highlighted by using a canny operator, the frames of the medicine boxes are determined by using hough linear detection, the center positions of the medicine boxes are determined, and the rectangular frames of all texts on the medicine boxes are determined by using an EAST algorithm.
Further, the medicine name obtained in the step S3 is identified through hundred-degree OCR, and fuzzyWuzzy is introduced to blur the character string of the medicine name. Specifically, character recognition can be performed by OCR of hundred degrees, but the data compared during character recognition is not necessarily completely corresponding, so FuzzyWuzzy (a tool capable of performing fuzzy matching on character strings) is introduced to perform fuzzy processing.
The medicine box identification method disclosed by the invention is matched with the voice broadcasting medicine box identification device, so that medicine information on the medicine box can be accurately found and identified, and medicine taking of visually defective groups such as blind persons can be assisted by voice broadcasting of medicine names and taking precautions; the voice broadcasting medicine box recognition device is simple in structure, convenient to operate, high in fault tolerance and suitable for practicality.
It is apparent that the above examples are given by way of illustration only and are not limiting of the embodiments. Other variations and modifications of the present invention will be apparent to those of ordinary skill in the art in light of the foregoing description. It is not necessary here nor is it exhaustive of all embodiments. While still being apparent from variations or modifications that may be made by those skilled in the art are within the scope of the invention.

Claims (10)

1. A voice broadcasting medicine box identification device is characterized by comprising,
the acquisition module is used for acquiring the image information of the medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text row on the medicine box according to the image information of the medicine box;
the judging module is used for selecting a text line in any rectangular frame to perform text recognition and judging whether the text is inverted, if so, putting the medicine box again until the medicine box is put correctly, if so, dividing the medicine box into areas according to the medicine box frame and the central position of the medicine box, and determining the confidence coefficient of each rectangular frame according to the position of each rectangular frame relative to the dividing area, the length-width ratio of each rectangular frame and the area of each rectangular frame;
the identification module is used for taking the text line in the rectangular frame with the highest confidence as the name of the medicine, carrying out character identification on the medicine name, comparing the identified medicine name with the medicine names in the database, judging whether the matching rate is in a set range, broadcasting the medicine name and the notice of medicine taking by voice if the matching rate is in the set range, and adjusting the position of the medicine box if the matching rate is not in the set range.
2. The voice broadcast kit identification device of claim 1, wherein: also included is a method of manufacturing a semiconductor device,
the base is used for bearing;
the sliding assembly comprises a screw rod, sliding rods, a sliding table and a moving platform, wherein the screw rod is rotatably arranged on the base, one end of the screw rod is connected with a driving source for driving the screw rod to rotate, the two sliding rods are parallel to the screw rod and arranged on the base, the two sliding rods are respectively positioned on two sides of the screw rod, the sliding table is in threaded connection with the screw rod and is in sliding connection with the sliding rods, and the moving platform is arranged on the sliding table;
the control assembly comprises a controller, a camera and a loudspeaker, wherein the controller is arranged on the base and is respectively connected with the driving source, the camera and the loudspeaker, and the camera is opposite to the mobile platform and is positioned on the motion path of the mobile platform.
3. The voice broadcast kit identification device of claim 2, wherein: the base comprises an internal accommodating space, the screw rod and the sliding table are both positioned in the accommodating space, two through grooves which are communicated with the accommodating space are symmetrically formed in two sides of the base, the through grooves are parallel to the screw rod, and two ends of the mobile platform extend into the accommodating space from the two through grooves respectively and are connected with the sliding table.
4. The voice broadcast kit identification device of claim 2, wherein: the base is provided with a driving source protection cover, and the driving source is arranged in the driving source protection cover.
5. The voice broadcast kit identification device of claim 4, wherein: the driving source protection cover is connected with a host box, the controller is arranged in the host box, one side of the host box facing the mobile platform is provided with a mounting hole, the camera is coaxially arranged in the mounting hole, and the host box is also provided with a sound outlet hole group corresponding to the position of the loudspeaker.
6. The voice broadcast kit identification device of claim 5, wherein: and a control button is further arranged on the host box and is connected with the controller.
7. A medicine box identification method, which uses the voice broadcasting medicine box identification device as set forth in any one of claims 1-6 to identify and broadcast medicine names on medicine boxes, and is characterized in that: comprises the steps of,
step S1: acquiring image information of a medicine box, and determining the frame and the center position of the medicine box and the rectangular frame of each text line according to the image information of the medicine box;
step S2: selecting a text line in any rectangular frame for text recognition and judging whether the text is inverted, if so, rearranging the medicine box until the medicine box is correctly positioned, if so, dividing the medicine box into areas according to the center positions of the medicine box frame and the medicine box, and determining the confidence coefficient of each rectangular frame according to the positions of each rectangular frame relative to the dividing areas, the length-width ratio of each rectangular frame and the area of each rectangular frame;
step S3: and (3) taking a text line in a rectangular frame with highest confidence as a medicine name, performing character recognition on the medicine name, comparing the recognized medicine name with the medicine names in a database, judging whether the matching rate is in a set range, if so, broadcasting the medicine name and the notice of medicine taking by voice, and if not, adjusting the position of the medicine box, and returning to the step (S1) until the matching rate is in the set range.
8. The kit identification method of claim 7, wherein: the method for determining the confidence coefficient of each rectangular frame comprises the following steps: dividing the medicine box into an area A, an area B and an area C, and determining the confidence coefficient of each rectangular frame according to the following formula:
Figure QLYQS_1
Figure QLYQS_2
Figure QLYQS_3
Figure QLYQS_4
wherein xi represents the confidence of the text in each rectangular frame; xi represents the area within each rectangular border; />
Figure QLYQS_5
Representing the area within the rectangular border; />
Figure QLYQS_6
For each rectangular aspect ratio; the total number of i=1, 2,3, …, i is the total number of rectangles of text on the kit outlined by the EAST algorithm.
9. The kit identification method of claim 7, wherein: and (3) identifying the medicine name obtained in the step (S3) through hundred-degree OCR, and introducing fuzzyWuzzy to blur the character string of the medicine name.
10. The kit identification method of claim 7, wherein: the edges of the medicine box are highlighted by using a canny operator, the frame of the medicine box is determined by using hough linear detection, the center position of the medicine box is determined, and the rectangular frames of all texts on the medicine box are determined by using an EAST algorithm.
CN202310411759.8A 2023-04-18 2023-04-18 Voice broadcast medicine box recognition device and medicine box recognition method Active CN116168376B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310411759.8A CN116168376B (en) 2023-04-18 2023-04-18 Voice broadcast medicine box recognition device and medicine box recognition method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310411759.8A CN116168376B (en) 2023-04-18 2023-04-18 Voice broadcast medicine box recognition device and medicine box recognition method

Publications (2)

Publication Number Publication Date
CN116168376A true CN116168376A (en) 2023-05-26
CN116168376B CN116168376B (en) 2023-07-18

Family

ID=86420329

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310411759.8A Active CN116168376B (en) 2023-04-18 2023-04-18 Voice broadcast medicine box recognition device and medicine box recognition method

Country Status (1)

Country Link
CN (1) CN116168376B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106652673A (en) * 2017-01-16 2017-05-10 华南理工大学 Method for automatically identifying and reading medicine specification
CN109920509A (en) * 2019-01-17 2019-06-21 平安科技（深圳）有限公司 Medicine information recognition methods, device, computer equipment and storage medium
CN110721045A (en) * 2019-10-22 2020-01-24 权哲峰 Intelligent medicine identification and broadcast device for medicine vehicle and installation method thereof
WO2020118311A1 (en) * 2018-12-07 2020-06-11 Resmed Inc. Intelligent setup and recommendation system for sleep apnea device
CN111860496A (en) * 2020-06-22 2020-10-30 中国平安财产保险股份有限公司 License plate recognition method, device, equipment and computer readable storage medium
CN112069890A (en) * 2020-07-31 2020-12-11 飞诺门阵(北京)科技有限公司 Method and device for identifying medicament label and storage medium
CN218384009U (en) * 2022-03-02 2023-01-24 曲阜师范大学 Chinese language and literature early Chinese character recognition auxiliary device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106652673A (en) * 2017-01-16 2017-05-10 华南理工大学 Method for automatically identifying and reading medicine specification
WO2020118311A1 (en) * 2018-12-07 2020-06-11 Resmed Inc. Intelligent setup and recommendation system for sleep apnea device
CN109920509A (en) * 2019-01-17 2019-06-21 平安科技（深圳）有限公司 Medicine information recognition methods, device, computer equipment and storage medium
CN110721045A (en) * 2019-10-22 2020-01-24 权哲峰 Intelligent medicine identification and broadcast device for medicine vehicle and installation method thereof
CN111860496A (en) * 2020-06-22 2020-10-30 中国平安财产保险股份有限公司 License plate recognition method, device, equipment and computer readable storage medium
CN112069890A (en) * 2020-07-31 2020-12-11 飞诺门阵(北京)科技有限公司 Method and device for identifying medicament label and storage medium
CN218384009U (en) * 2022-03-02 2023-01-24 曲阜师范大学 Chinese language and literature early Chinese character recognition auxiliary device

Also Published As

Publication number Publication date
CN116168376B (en) 2023-07-18

Similar Documents

Publication Publication Date Title
US8937650B2 (en) Systems and methods for performing a triggered action
CN116168376B (en) Voice broadcast medicine box recognition device and medicine box recognition method
FR2864290B1 (en) METHOD AND DEVICE FOR RECOGNIZING IRIS
EP1158386A3 (en) Method and apparatus for controlling access to storage device
CN104886927A (en) Multi-functional intelligent platform
FR2820872B1 (en) VOICE RECOGNITION METHOD, MODULE, DEVICE AND SERVER
WO2002025568A3 (en) Pill identification and prescription management device, system and method
AU2003225079A1 (en) Hospital bed obstacle detection device and method
KR100430543B1 (en) Automatic picture taking machine and method
CN106151955A (en) A kind of intelligent desk lamp
CN107320743A (en) One kind realizes ultraviolet-sterilization method and system using mobile terminal
CN108416341A (en) A kind of new bio identifying system
MX9204733A (en) DEVICE AND METHOD FOR PROCESSING SCRAP FILM.
US4427292A (en) Computer controlled microfilm camera system
Kumar et al. Smart assistance library system for the disabled: An iot based user-friendly wheelchair
CN214024277U (en) Prepreg cutting and positioning device
KR20190007357A (en) Method and apparatus for recognizing concave indication, calssification apparatus of used medicine using the same
KR101632169B1 (en) Voice road guide system for a person who is visually handicapped
Leiber Interhemispheric effects in short-term recognition memory for single words
US11872512B2 (en) Robot air filter
DE69525928D1 (en) DEVICE AND PRODUCTION METHOD FOR SWITCHING FILMS
US4365892A (en) Apparatus for making a copy in one of three sizes of X-ray film
CN220582071U (en) Face recognition equipment
CH716065A1 (en) Device for acting on at least parts of a body.
JP2004062257A (en) Book-read support device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant