CN101474020B - Shopping guide method and apparatus for blind in supermarket based on bar code identification - Google Patents
Shopping guide method and apparatus for blind in supermarket based on bar code identification Download PDFInfo
- Publication number
- CN101474020B CN101474020B CN2009100450638A CN200910045063A CN101474020B CN 101474020 B CN101474020 B CN 101474020B CN 2009100450638 A CN2009100450638 A CN 2009100450638A CN 200910045063 A CN200910045063 A CN 200910045063A CN 101474020 B CN101474020 B CN 101474020B
- Authority
- CN
- China
- Prior art keywords
- bar code
- supermarket
- information
- unit
- code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Cash Registers Or Receiving Machines (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention relates to a blindman supermarket shopping guide method based on a bar code identification and a device thereof which belong to the technical field of ancillary equipment of for the disabled. The device comprises the bar code identification, a supermarket information read-in unit, a bar code identification unit and a voice synthesis output unit. The specific proposal is characterized by arranging three types of bar codes which are respectively big size, medium size and small size in a supermarket, acquiring images in the vision range of a user by the supermarket information read-in unit, detecting and decoding the bar codes in the vision range of the user, using code information and position information corresponding to the bar codes to encode stereo, and outputting the stereo to the blindman by an earphone, thus helping the blindman know commodity regions, goods arrangement, and the name, trademark and price of a single item in the supermarket. The method and the deviceare mainly used for assisting the blind in shopping in the supermarket independently.
Description
Technical field
What the present invention relates to is the blind-guiding method and the device in a kind of detection technique field, and specifically, what relate to is a kind of blind in supermarket shopping guide method and device based on bar code identification.
Background technology
The external information that the mankind obtain nearly has and 80% depends on vision, and other 20% derive from the sense of hearing and sense of touch, but for the blind person, obtain channel owing to lost this important information of vision, and their live and work has been subjected to very big restriction.In order to improve blind person's quality of life, reduce the blind inconvenience that causes, the method that the scientists consideration substitutes with sensation, the information that some are important passes to the blind person by the sense of hearing or sense of touch channel.
Blind man's stick and seeing-eye dog have been improved blind person's quality of life to a certain extent, but they all can only provide basic walking guiding for the blind person, be difficult to help the blind person to seek required article, and can not be that the blind person provides environmental information with hommizations such as voice, quick concrete mode.So, at supermarket shopping for activity in the cards hardly of blind person Lai Shuoshi.If can design system,, in the supermarket,, will make the autonomous supermarket shopping of blind person become possibility for the blind person provides merchandise news in the certain distance on every side in real time by the method for voice suggestion.
At present domestic research for sense of hearing replacement vision also is in the starting stage, find by prior art documents, Chinese patent title: based on the vision alternative method of cognitive and target identification, number of patent application 200710039631.4, this technology can classification and the positional information of inspected object in environment, and these information can be converted into voice signal, thereby realize the replacement of vision to the sense of hearing.But this technology does not have specific aim for the detection of object, and the algorithm complexity does not have real-time, and has no idea can help the blind person to find the information of article fast for the blind person provides commodity subregion and cargo type etc.Most critical be, circumstance complication, the article of supermarket shelves are various, kind is different, the algorithm accuracy of object identification and reliability do not guarantee.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, a kind of blind in supermarket shopping guide method and device based on bar code identification is provided, can identification be arranged in bar code in the supermarket with stipulated form, and the information of bar code changed into corresponding audible signal, thereby the details of article are finished supermarket shopping guide's purpose on the primary partition of assisting blind understanding supermarket goods and the shelf.
The present invention is achieved by the following technical solutions:
Blind in supermarket shopping guide method based on bar code identification involved in the present invention comprises the steps:
Step 1: large-scale, medium-sized, small-sized three kinds of bar codes are set in the supermarket, and primary partition information such as the corresponding daily necessities of large-scale bar code, food are affixed on and are placed on zone corresponding in the supermarket on the label; The information of the corresponding type of goods of medium-sized bar code is attached on the shelf of placing corresponding article; The details of corresponding each commodity of compact bar code are attached on the sample of each commodity, and sample is placed in the desired location of shelf by appointment;
Step 2: the blind person obtains purchase guiding system at the entrance place;
Step 3: the supermarket environmental information is read in: the camera in the purchase guiding system reads in the certain scene information within the vision in blind person the place ahead, image is through analog to digital conversion, form with digital signal represents, each two field picture corresponding expression the matrix of each pixel gray-scale information;
Step 4: bar code information identification: adopt image processing algorithm, identify the bar code in the present image through filtering denoising, texture detection, the civilian recognition sequence several steps of sign indicating number, if a plurality of bar codes, then according to from left to right or order from top to bottom discern one by one, be stored in the Installed System Memory;
Step 5: the bar code barycenter obtains: after reading bar code, simultaneously can obtain the ranks position of bar code in image array, on this both direction, add the coordinate computation average respectively earlier, obtain the barycenter of bar code, simultaneously the size of record strip font code in image with the back;
Step 6: the voice messaging of detected bar code correspondence obtains: according to the bar code information that step 4 obtains, search corresponding voice sequence in system database; According to the bar code barycenter that obtains in the step 5, obtain corresponding three-dimension stereo coded signal;
Step 7: vision signal converts sound signal to: the voice sequence that obtains in the step 6 and three-dimension stereo data in conjunction with being encoded into the three dimensional sound signal that the blind person can identification, are exported by earphone.
Described step 4, five, six is all finished by embedded system, and the sound conversion in the step 7 is also finished in embedded system, and the earphone output sound signal is given the blind person then.
Blind in supermarket shopping guide device based on bar code identification involved in the present invention comprises bar code identification, and the supermarket environmental information is read in the unit, and bar code recognition unit and sound synthesize output unit.
Described bar code identification comprises three types, and primary partition information such as the corresponding daily necessities of its medium-and-large-sized bar code, food are affixed on and are placed on zone corresponding in the supermarket on the label; The information of the corresponding type of goods of medium-sized bar code is attached on the shelf of placing corresponding article; The details of corresponding each commodity of compact bar code are attached on the sample of each commodity, and sample is placed in the desired location of shelf by appointment;
Described supermarket environmental information is read in the unit and is read in blind person's image information within the vision, and image becomes digital video signal through analog to digital conversion, and each two field picture corresponding tables is shown the matrix of a gray-scale information.
Described bar code recognition unit is accepted from the next consecutive image of video information collecting unit transmission, and searches the bar code that exists in the image by image processing algorithm, the information of identification barcode encoding.Simultaneously, the position of record strip font code and size obtain the barycenter of bar code by the computing of averaging.
Described sound converting unit is accepted the information of the moving object transmitted from the barcode detection unit, is converted into the virtual three-dimensional voice signal by convolution algorithm, by earphone output, points out supermarket within the vision environmental information to the blind person.
Among the present invention, described bar code identification is provided with initial code literary composition and stop code literary composition, to make things convenient for Flame Image Process when encoding.
Among the present invention, described supermarket environmental information is read in the unit and is finished reading in of supermarket environmental information by the black and white camera.
Among the present invention, described bar code recognition unit is accepted to read in after the information that transmits the unit, at first carrying out filtering and noise reduction sound and thresholding handles, carrying out texture again detects, for each row image array data, when the gray-scale value saltus step occurring, record saltus step slope, when the saltus step slope reaches certain threshold value,, in the candidate region, search the initial code literary composition and the stop code literary composition that meet coding rule as the bar code candidate region, the zone that has initial code literary composition and stop code Wen Tezheng simultaneously is marked as the barcode size or text field, for the bar code that finds, according to order recognition code literary composition sequence from left to right, the center-of-mass coordinate and the size of record strip font code simultaneously.
Compared with prior art, the present invention has following beneficial effect:
At first, general system for guiding blind is subjected to the restriction of object identification algorithm, the reliable and stable recognition object in complex environment of having no idea, it is very big to occur false positive differentiation and false dismissal probability in complex environments such as supermarket, here the bar code label method of Ti Chuing can guarantee not occur any false positive judgement, simultaneously, false dismissal probability also reduces greatly;
Secondly, the object identification algorithm need take very big calculation resources, embedded hardware equipment had high requirement, this causes hardware cost too high, realize easily and bar-code recognising algorithm is simple, can compress the cost of supermarket blindmen guidance system greatly, making large tracts of land promote becomes possibility;
Once more, the supermarket environment has certain singularity, and different brands, packing, price may appear in certain type commodity.Have no idea to differentiate above-mentioned information based on the general-purpose system of object identification, the voice content of bar code correspondence then can provide the details of particular commodity for the blind person, has more practicality; Convenient saving time used in the guiding of system for the blind person that the bar code plan of establishment of third gear model is perfect.
Description of drawings
Fig. 1 is the structured flowchart of the embodiment of the invention
Fig. 2 is the user mode figure of the embodiment of the invention
Embodiment
Below in conjunction with accompanying drawing embodiments of the invention are elaborated: present embodiment is being to implement under the prerequisite with the technical solution of the present invention, provided detailed embodiment and concrete operating process, but protection scope of the present invention is not limited to following embodiment.
As shown in Figure 1, in the present embodiment, described device is by bar code identification, the black and white camera that the blind person carries (promptly reading in the unit as the supermarket environmental information), bar code recognition unit, sound conversion output unit are formed, and wherein: the function of bar code recognition unit, sound converting unit is by the DSP Platform Implementation.In addition, also has the peripherals earphone.
The present embodiment bar code identification is included in large-scale, medium-sized, the small-sized three kinds of bar codes that are provided with in the supermarket.Primary partition information such as the corresponding daily necessities of large-scale bar code, food are affixed on and are placed on zone corresponding in the supermarket on the label; The information of the corresponding type of goods of medium-sized bar code is attached on the shelf of placing corresponding article; The details of corresponding each commodity of compact bar code are attached on the sample of each commodity, and sample is placed in the desired location of shelf by appointment; Bar code identification is provided with initial code literary composition and stop code literary composition when encoding, to make things convenient for Flame Image Process.
The supermarket environmental information is read in the unit and is read in blind person's environmental information on every side, utilizes the black and white camera to pick up the interior video image of field of front vision scope, and image information is offered the bar code recognition unit.
The bar code recognition unit is accepted to read in after the information that transmits the unit, at first carrying out filtering and noise reduction sound and thresholding handles, carrying out texture again detects, for each row image array data, when the gray-scale value saltus step occurring, record saltus step slope, when the saltus step slope reaches certain threshold value, as the bar code candidate region, search the initial code literary composition and the stop code literary composition that meet coding rule in the candidate region, the zone that has initial code literary composition and stop code Wen Tezheng simultaneously is marked as the barcode size or text field, for the bar code that finds, according to order recognition code literary composition sequence from left to right, the center-of-mass coordinate and the size of record strip font code simultaneously.
Sound conversion output unit is accepted the bar code sign indicating number literary composition information and the positional information that transmit the bar code recognition unit, and utilizes this algorithm of HRTF (Function related transfer function of Head-Related Transform) to realize stereo coding.The time domain sequences corresponding with HRTF is called a relevant impulse response HRIR (Head-RelatedImpulse Response), and it is azimuth angle theta, elevation angle φ, apart from the function of d and time t.
In the sound transfer algorithm that present embodiment adopted, HRIR is to 25 position angles, 50 elevations angle and 200 discrete samplings that time point carries out.HRIR is as the impulse response of surrounding environment for sound, and the sound sequence of sound source output is as long as carry out the sound sequence that convolution just can obtain having positional information with corresponding HRIR data.
The result that bi-telephone will obtain, the i.e. different sound sequence S of left and right sides ear
l(n) and S
r(n), export to the blind person, just can make them hear that the virtual three-dimensional that has the moving object movable information is stereo.But the weak point of the method is the blind person and is difficult to discern the distance of moving object, because HRIR does not relate to the information of distance when sampling.
For remedying this deficiency, present embodiment adopts the method for sound intensity level to replace range information, and the sound of the moving object correspondence of distance is more weak, and the near stronger sound of object correspondence of distance.Judge that according to the civilian information of sign indicating number of bar code which kind of in the large, medium and small type bar code bar code be, then size and the standard size of bar code in image compared, according to the near big and far smaller former distance of determining bar code and user that causes.
In the present embodiment, the ICETEK-DM642-C evaluation board that has adopted the production of Beijing Rui Tai Creative Company is as development platform.This evaluation board is a low-power consumption stand-alone development platform.Equipment mainly comprises the TMS320DM642 dsp chip of TIX (TI), independent HPI interface, 2 road video ports, 4M synchronous dynamic random access memory, the stereo digital signal codec of 32MFlash, AIC23, JTAG emulation interface and 4 user lamps on the plate.
As shown in Figure 2, when present embodiment uses, the supermarket environmental information is read in the unit can adopt the black and white camera, further, can adopt camera 1 as shown in Figure 2, bar code recognition unit, sound conversion output unit can adopt existing DSP 3 to realize, in addition, sound conversion output unit connects earphone 2.
The foregoing description is mainly used in the supermarket blindmen shopping guide, by the identification bar code, system can extract in the surrounding environment and purchase Useful Information and convert specific sound to for the blind person, the blind person is by these sound, can judge supermarket goods subregion and particular commodity details, thereby finish procurement of commodities voluntarily.The foregoing description method is simple, and embedded device carries the aspect, and travelling speed is fast, for blind person's life provides another facility.
Claims (7)
1. the supermarket blindmen shopping guide method based on bar code recognition is characterized in that comprising the steps:
Step 1: large-scale, medium-sized, small-sized three kinds of bar codes are set in the supermarket, and the corresponding daily necessities of large-scale bar code, food primary partition information are affixed on and are placed on zone corresponding in the supermarket on the label; The information of the corresponding type of goods of medium-sized bar code is attached on the shelf of placing corresponding article; The details of corresponding each commodity of compact bar code are attached on the sample of each commodity, and sample is placed in the desired location of shelf by appointment;
Step 2: the blind person obtains purchase guiding system at the entrance place;
Step 3: the supermarket environmental information is read in: the camera in the purchase guiding system reads in the scene information of blind person's field of front vision, and image represents with the form of digital signal through analog to digital conversion, each two field picture corresponding expression the matrix of each pixel gray-scale information;
Step 4: bar code information identification: adopt image processing algorithm, identify the bar code in the present image through filtering denoising, texture detection, the civilian recognition sequence several steps of sign indicating number, if a plurality of bar codes, then according to from left to right or order from top to bottom discern one by one, be stored in the Installed System Memory;
Step 5: the bar code barycenter obtains: after reading bar code, obtain the ranks position of bar code in image array simultaneously, on this both direction, add the coordinate computation average respectively earlier, obtain the barycenter of bar code, simultaneously the size of record strip font code in image with the back;
Step 6: the voice messaging of detected bar code correspondence obtains: according to the bar code information that step 4 obtains, search corresponding voice sequence in system database; According to the bar code barycenter that obtains in the step 5, obtain corresponding three-dimension stereo coded signal;
Step 7: vision signal converts sound signal to: the voice sequence that obtains in the step 6 and three-dimension stereo data in conjunction with being encoded into the three dimensional sound signal that the blind person can identification, are exported by earphone.
2. the supermarket blindmen shopping guide method based on bar code recognition according to claim 1 is characterized in that, described vision signal is converted to sound signal and realizes by a related transfer function.
3. the supermarket blindmen shopping guide method based on bar code recognition according to claim 2, it is characterized in that, in described the related transfer function, adopt the method for sound intensity level to replace range information, a little less than the sound of the moving object correspondence of distance, and the near stronger sound of object correspondence of distance.
4. the supermarket blindmen shopping guide device based on bar code recognition is characterized in that comprising bar code identification, and the supermarket environmental information is read in the unit, and bar code recognition unit and sound synthesize output unit, wherein:
Described bar code identification comprises three types, and the corresponding daily necessities of its medium-and-large-sized bar code, food primary partition information are affixed on and are placed on zone corresponding in the supermarket on the label; The information of the corresponding type of goods of medium-sized bar code is attached on the shelf of placing corresponding article; The details of corresponding each commodity of compact bar code are attached on the sample of each commodity, and sample is placed in the desired location of shelf by appointment;
Described supermarket environmental information is read in the unit and is read in blind person's image information within the vision, and image becomes digital video signal through analog to digital conversion, and each two field picture corresponding tables is shown the matrix of a gray-scale information;
Described bar code recognition unit is accepted to read in the consecutive image that the unit transmission comes from the supermarket environmental information, and search the bar code that exists in the image by image processing algorithm, the information of identification barcode encoding, simultaneously, the position of record strip font code and size obtain the barycenter of bar code by the computing of averaging;
The synthetic output unit of described sound is accepted the information of the moving object transmitted from the bar code recognition unit, is converted into the virtual three-dimensional voice signal by convolution algorithm, by earphone output, points out supermarket within the vision environmental information to the blind person.
5. the supermarket blindmen shopping guide device based on bar code recognition as claimed in claim 4 is characterized in that, described bar code identification is provided with initial code literary composition and stop code literary composition.
6. the supermarket blindmen shopping guide device based on bar code recognition as claimed in claim 4 is characterized in that, described supermarket environmental information is read in the unit and finished reading in of environmental information by the black and white camera.
7. the supermarket blindmen shopping guide device based on bar code recognition as claimed in claim 4, it is characterized in that, described bar code recognition unit is accepted to read in after the information that transmits the unit, at first carrying out filtering and noise reduction sound and thresholding handles, carrying out texture again detects, for each row image array data, when the gray-scale value saltus step occurring, record saltus step slope, when the saltus step slope reaches certain threshold value, as the bar code candidate region, search the initial code literary composition and the stop code literary composition that meet coding rule in the candidate region, the zone that has initial code literary composition and stop code Wen Tezheng simultaneously is marked as the barcode size or text field, for the bar code that finds, according to order recognition code literary composition sequence from left to right, the center-of-mass coordinate and the size of record strip font code simultaneously.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100450638A CN101474020B (en) | 2009-01-08 | 2009-01-08 | Shopping guide method and apparatus for blind in supermarket based on bar code identification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2009100450638A CN101474020B (en) | 2009-01-08 | 2009-01-08 | Shopping guide method and apparatus for blind in supermarket based on bar code identification |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101474020A CN101474020A (en) | 2009-07-08 |
| CN101474020B true CN101474020B (en) | 2010-07-21 |
Family
ID=40834881
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2009100450638A Expired - Fee Related CN101474020B (en) | 2009-01-08 | 2009-01-08 | Shopping guide method and apparatus for blind in supermarket based on bar code identification |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101474020B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI563996B (en) * | 2015-04-13 | 2017-01-01 | 亞東技術學院 | Meal system for blind user |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2012099A1 (en) * | 2007-07-06 | 2009-01-07 | Mettler-Toledo AG | Control weight, method and system for tracking such weights |
| CN102631106A (en) * | 2011-02-11 | 2012-08-15 | 张思妍 | Braille prompting storage rack for blind people |
| CN102254160B (en) * | 2011-07-12 | 2013-06-12 | 央视国际网络有限公司 | Video score detecting and recognizing method and device |
| CN102798388A (en) * | 2012-06-20 | 2012-11-28 | 上海交通大学 | Blind person supermarket shopping auxiliary device based on DSP (Digital Signal Processor) |
| US9363635B2 (en) * | 2012-11-08 | 2016-06-07 | Qualcomm Incorporated | Obtaining a geo-fence without a network download |
| CN104268497A (en) * | 2014-09-18 | 2015-01-07 | 国家电网公司 | Information prompt device allowing the blind to do shopping conveniently in supermarket |
| CN104535059A (en) * | 2014-12-04 | 2015-04-22 | 上海交通大学 | Indoor positioning system specific to totally blind population |
| US9830489B2 (en) * | 2016-03-29 | 2017-11-28 | Analog Devices, Inc. | Simple code reader |
| WO2018112930A1 (en) * | 2016-12-23 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Method and device for identifying commodities |
| US9864890B1 (en) * | 2017-01-25 | 2018-01-09 | General Electric Company | Systems and methods for contextualizing data obtained from barcode images |
| CN107479559B (en) * | 2017-09-22 | 2023-08-29 | 中国地质大学（武汉） | Intelligent shopping guide system and method for blind people in mall |
| CN108646742A (en) * | 2018-05-31 | 2018-10-12 | 杭州纳戒科技有限公司 | Self-help shopping travel unit and self-help shopping system |
| ES1295251Y (en) * | 2022-04-08 | 2023-01-16 | Nuevos Sist Tecnologicos S L | CONSUMER PRODUCT PACKAGING WITH VISIBLE CODE AND SYSTEM INCLUDING THE PACKAGING |
-
2009
- 2009-01-08 CN CN2009100450638A patent/CN101474020B/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI563996B (en) * | 2015-04-13 | 2017-01-01 | 亞東技術學院 | Meal system for blind user |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101474020A (en) | 2009-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101474020B (en) | Shopping guide method and apparatus for blind in supermarket based on bar code identification | |
| Ichnowski et al. | Dex-nerf: Using a neural radiance field to grasp transparent objects | |
| CN102999152B (en) | A kind of gesture motion recognition methods and system | |
| Cui et al. | 3D semantic map construction using improved ORB-SLAM2 for mobile robot in edge computing environment | |
| CN106557173B (en) | Dynamic gesture identification method and device | |
| TW200506753A (en) | Apparatus, method, and system for positively identifying an item | |
| CN101930532A (en) | Mobile phone-based camera quick response matrix code recognizing and reading method | |
| CN103714554A (en) | Video tracking method based on spread fusion | |
| Zhu et al. | A Dual Self-Attention mechanism for vehicle re-Identification | |
| Yang et al. | Surface defect detection of heat sink based on lightweight fully convolutional network | |
| Pan et al. | Understanding the challenges when 3d semantic segmentation faces class imbalanced and ood data | |
| Dong et al. | Combination of modified U‐Net and domain adaptation for road detection | |
| Huo et al. | Improved covariant local feature detector | |
| Cao et al. | An Improved YOLOv4 Lightweight Traffic Sign Detection Algorithm | |
| CN115984968A (en) | Student time-space action recognition method and device, terminal equipment and medium | |
| Xie et al. | Event voxel set transformer for spatiotemporal representation learning on event streams | |
| CN115331112A (en) | Infrared and visible light image fusion method and system based on multi-granularity word elements | |
| Tao et al. | Objformer: Boosting 3D object detection via instance-wise interaction | |
| CN108304817A (en) | The method and apparatus for realizing gesture operation | |
| CN115116427A (en) | Labeling method, voice synthesis method, training method and device | |
| Yang et al. | A hierarchical deep neural network with iterative features for semantic labeling of airborne LiDAR point clouds | |
| Ma et al. | Depth-guided progressive network for object detection | |
| Sharma et al. | Automated indian sign language recognition system using lstm models | |
| Amiri et al. | A similarity measure for analyzing human activities using human-object interaction context | |
| Kainz et al. | Measurement of Water Consumption based on Image Processing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100721 Termination date: 20130108 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |