CN109002819A - Blind person's vibration and contacts matrix perceive photo apparatus - Google Patents
Blind person's vibration and contacts matrix perceive photo apparatus Download PDFInfo
- Publication number
- CN109002819A CN109002819A CN201810789588.1A CN201810789588A CN109002819A CN 109002819 A CN109002819 A CN 109002819A CN 201810789588 A CN201810789588 A CN 201810789588A CN 109002819 A CN109002819 A CN 109002819A
- Authority
- CN
- China
- Prior art keywords
- haptic elements
- card computer
- blind person
- photo
- outer housing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 239000011159 matrix material Substances 0.000 title claims abstract description 26
- 230000008447 perception Effects 0.000 claims abstract description 8
- 230000005540 biological transmission Effects 0.000 claims abstract description 6
- 238000000034 method Methods 0.000 claims description 10
- VYPSYNLAJGMNEJ-UHFFFAOYSA-N Silicium dioxide Chemical compound O=[Si]=O VYPSYNLAJGMNEJ-UHFFFAOYSA-N 0.000 claims description 4
- 239000000741 silica gel Substances 0.000 claims description 4
- 229910002027 silica gel Inorganic materials 0.000 claims description 4
- 241000270295 Serpentes Species 0.000 claims description 3
- 239000010409 thin film Substances 0.000 claims description 3
- 210000004556 brain Anatomy 0.000 claims 1
- 230000005611 electricity Effects 0.000 claims 1
- 238000010586 diagram Methods 0.000 abstract description 6
- 238000003384 imaging method Methods 0.000 abstract description 4
- 230000009286 beneficial effect Effects 0.000 abstract 1
- 241000023320 Luma <angiosperm> Species 0.000 description 1
- 240000007651 Rubus glaucus Species 0.000 description 1
- 235000011034 Rubus glaucus Nutrition 0.000 description 1
- 235000009122 Rubus idaeus Nutrition 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009429 electrical wiring Methods 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000010408 film Substances 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 1
- 238000010428 oil painting Methods 0.000 description 1
- 238000010421 pencil drawing Methods 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Vascular Medicine (AREA)
- Multimedia (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention provides a kind of blind person vibration and contacts matrix perception photo apparatus, including camera, card computer assembly and touch tablet;The camera is carried out data transmission with card computer assembly by cable connection;The touch tablet includes haptic elements and rectangle outer housing, and the haptic elements are that can shake or go up and down or the hollow-cup motor of spin friction, the outer housing upper surface are equipped with haptic elements, and haptic elements close matrix in outer housing arranges;The card computer assembly and haptic elements control the on-off of haptic elements operation by cable connection.Simple, operation that the beneficial effects of the invention are as follows structures and easy to carry, after turning sketch profile diagram by photo, by sketch profile by vibrator on touch tablet or the technology of contacts matrix imaging, the profile details information for the perception photo that blind person can be made apparent.
Description
Technical field
Field of the present invention is related to a kind of blind person's product more particularly to a kind of blind person vibration and contacts matrix perception photo is set
It is standby.
Background technique
Blind person has braille when carrying out reading text, but in terms of knowing figure, because scheming without relevant art knowing
When, because general photograph does not have profile information outstanding, thus when blind person is known with feel again, is inconvenient, cannot know feel
Information is communicated to blind person well.
Summary of the invention
The object of the present invention is to provide one kind by converting sketch profile diagram for photo, then passes through the shake on touch tablet
It moves device or contacts matrix and photo profile information is communicated to blind person.
The technical scheme is that a kind of blind person's vibration and contacts matrix perceive photo apparatus, including camera, card
Computer assembly and touch tablet.
By cable connection between the camera and card computer assembly, the image data that camera is shot is transferred to
Card computer assembly.
The touch tablet includes haptic elements and rectangle outer housing, and the outer housing can also be set according to aesthetic feeling needs
Count into the other shapes such as square, ellipse, the haptic elements be can shake or the hollow-cup motor of lifting, the shell
Body upper surface is equipped with haptic elements, and haptic elements close matrix in outer housing upper surface arranges, and haptic elements are bonded in
Outer housing upper surface.
By cable connection, card computer assembly issues an instruction to control sense of touch for the card computer assembly and haptic elements
The on-off of element operation.
The haptic elements in outer housing at least 9 and matrix arrangement.
The card computer assembly includes card computer, connecting terminal block, display screen and power supply unit, the card computer
It is preferred that raspberry pie card computer (Raspberry Pi), by PIL in card computer (Python Imaging Library) come
The processing in terms of filter, the realization including sketch, pencil drawing, oil painting etc. filtering effects are carried out, PIL is mainly used to processing figure
Piece, it supports plurality of picture format.
The processing key of sketch filter is the lookup to edge.Pass through the lines of the available object of lookup to edge
Sense.After carrying out gray processing processing to image, we define a threshold value (threshold) first.Sketch it is main it is emphasised that
The variation of shading value, when drafting are oblique directions, and by experience, we are by the ash of the gray value of each pixel and its lower right corner
Angle value is compared, and when being greater than this threshold value, being judged as it is profile and draws.
Gray level image pretreatment is carried out with PIL, as long as we are L mode with convert function unsteady state operation.
Image gray processing is the R for making three kinds of color components of color, and the component value of G, B are equal, due to R, the value of G, B
Range is [0,255], so gray level image can indicate 256 kinds of gray scale face, color color image turns gray level method, and there are mainly three types of calculate
Method:
1. maximum value process (Maximum): so that the value of R, G, B is equal to the maximum one-component value in three color components, it may be assumed that R
=G=B=Max(R,G,B)。
2. mean value method (Average): the value of R, G, B being made to be equal to being averaged for three color components of three color components
Value, it may be assumed that R=G=B=(R+G+B)/3.
3. weighted average method (Weight Average): I encloses different power to R, G, B three-component respectively herein
Value indicates are as follows: R=G=B=WR*R+WG*G+WB*B, wherein WR, WG, WB are the weight of R, G, B respectively.Consider herein due to
Human eye to the susceptibility highest of green, take second place by red, minimum to the susceptibility of blue, therefore, as weight WG > WR > WB
When, generated gray level image more meets the visual experience of human eye.The library PIL uses ITU-R 601-2 luma transform:
L = R * 299/1000 + G * 587/1000 + B * 114/1000
That is WR=29.9%, WG=58.7%, WB=11.4%.
The card computer and camera and display screen pass through cable connection respectively, and the image of camera acquisition is in display screen
Interior imaging display, the card computer are connected with the shooting switch of control shooting, shoot the switch of switch for controlling photo
Selection.
The card computer and power supply unit connect with connecting terminal block, one terminals of the card computer and haptic elements
It is attached by connecting terminal block, another terminals of haptic elements and power supply unit are attached by connecting terminal block.
It is preferred that said supply unit supply another terminals operating voltage of haptic elements, the operating voltage direct current 3V or
5V, card computer issues control instruction to haptic elements, and low level issues.
It is preferred that another terminals of haptic elements are connect with power supply unit middle line, card computer issues haptic elements and controls
System instruction, and high level issues, and the voltage that sets out is direct current 3V or 5V.
According to the needs of controller, control instruction is issued to the corresponding haptic elements of needs movement, keeps its haptic elements dynamic
Make.
The outer housing and haptic elements upper surface are equipped with the silica gel thin film to match with outer housing and haptic elements, silica gel
The sense of touch of film opponent influences small, and dust can be effectively prevented or water is unrestrained on a touchpad.
The method of blind person's vibration and contacts matrix perception photo:
A) camera transfers data to card computer assembly by cable;
B) image of data transmission realizes gray level image pretreatment with PIL;
C) whole image is divided into several pockets;
D) touch tablet, which is equipped in region corresponding with each pocket and each region, is equipped with haptic elements;
E) image carries out surface by from left to right snake scan sequence;
F) in unit time, haptic elements shake in corresponding region on the black or white decision touch tablet of fritter respective pixel
Or whether life drop;
G) corresponding ports are arranged by code and switch set out vibration or lifting.
The whole image is divided into the pixel fritter that pixel is 3*3.
The advantages and positive effects of the present invention are: the present invention has structure simple, operation and easy to carry, pass through photograph
After piece turns sketch profile diagram, by sketch profile by vibrator on touch tablet or the technology of contacts matrix imaging, blind person can be made
The profile details information of apparent perception photo.
Detailed description of the invention
Fig. 1 is electric control system block diagram of the invention
Fig. 2 is electrical wiring schematic diagram of the present invention
Fig. 3 is the electric hookup of connecting terminal block part of the present invention
Fig. 4 is that the distribution for the pixel pocket that image of the present invention is divided into 3*3 and every pocket corresponding motor quantity are divided
The schematic diagram of cloth.
In figure:
Specific embodiment
As shown in Figure 1-3, a kind of blind person's vibration of the present invention and contacts matrix perceive photo apparatus, including camera 1, card
Computer assembly 2 and touch tablet 3;
The camera 1 is carried out data transmission with card computer assembly 2 by cable connection;
The touch tablet 3 includes haptic elements 31 and rectangle outer housing 32, and the haptic elements 31 are that can shake drag cup
Motor, 32 upper surface of outer housing is equipped with haptic elements 31, so there is 225 close matrix in outer housing of haptic elements 31
Arrangement, haptic elements 31 are pasted onto rectangle outer housing upper surface, and the outer housing 32 and 31 upper surface of haptic elements are equipped with
One silica gel thin film that can freely take and match with outer housing 32 and haptic elements 31.
With haptic elements 31 by cable connection, card computer assembly 2 issues an instruction to distinguish the card computer assembly 2
Control the on-off that haptic elements 31 are run.
The card computer assembly 2 includes card computer 21,22 power supply unit 23 of connecting terminal block and display screen 24, described
Card computer 21 is connected with the shooting switch 4 of control shooting by cable, 23 wiring of the card computer 21 and power supply unit
End is connect by cable with one end of connecting terminal block 22,31 1 terminals of haptic elements pass through cable connection to card computer
In 21 corresponding terminal blocks 22, another terminals of haptic elements 31 are straight by supply voltage on cable connection to terminal block 22
It flows at 3V.
Camera 1 is connect by cable with card computer with display screen 24.
Said supply unit 23 supplies the operating voltage of another terminals direct current 3V of haptic elements 31,21 pairs of card computer touchings
Sensing unit 31, which issues control instruction, acts haptic elements 31, and low level issues.
As shown in figure 4, the method for blind person's vibration and contacts matrix perception photo are as follows:
The camera 1 transfers data to card computer assembly 2 by cable;
A) image of data transmission realizes gray level image pretreatment with PIL;
B) the pixel pocket for being 3*3 by 25 pixels that whole image is divided into matrix arrangement, topmost starts, successively
It is from left to right 1 to 25 pockets;
C) touch tablet 3 is equipped with the touching that 9 matrix arrangements are equipped in region corresponding with each pocket and each region
Sensing unit 31;
D) image carries out surface by from left to right snake scan sequence, and image presses 1 to 5, from 10 to 6, from 11 to 15, from 20 to
16, the scanning sequency from 21 to 25 is showed;
E) in unit time, sense of touch in corresponding region on the black or white decision touch tablet 3 of driving 3*3 fritter respective pixel
Whether element 31 acts;
F) corresponding ports are arranged by code and switch vibration of setting out.
One embodiment of the present invention has been described in detail above, but the content is only preferable implementation of the invention
Example, should not be considered as limiting the scope of the invention.It is all according to all the changes and improvements made by the present patent application range
Deng should still be within the scope of the patent of the present invention.
Claims (8)
1. a kind of blind person's vibration and contacts matrix perceive photo apparatus, it is characterised in that: including camera (1), card computer group
Part (2) and touch tablet (3);
The camera (1) is carried out data transmission with card computer assembly (2) by cable connection;
The touch tablet (3) includes haptic elements (31) and rectangle outer housing (32), and the haptic elements (31) are that can shake
Or the hollow-cup motor of lifting, outer housing (32) upper surface are equipped with haptic elements (31), haptic elements (31) are in outer housing
Interior close matrix arrangement;
The card computer assembly (2) and haptic elements (31) control the logical of haptic elements (31) operation by cable connection
It is disconnected.
2. blind person's vibration according to claim 1 and contacts matrix perceive photo apparatus, it is characterised in that: described in shell
Haptic elements (31) in body (32) at least 9.
3. blind person's vibration according to claim 1 and contacts matrix perceive photo apparatus, it is characterised in that: the card electricity
Brain component (2) includes card computer (21), connecting terminal block (22) and power supply unit (23), the card computer (21) and control
The shooting switch (4) of shooting is connected, and the card computer (21) and power supply unit (23) connect with connecting terminal block (22), institute
It states card computer (21) and is attached with (31) one terminals of haptic elements by connecting terminal block (22), haptic elements (31) are another
One terminals are attached with power supply unit (23) by connecting terminal block (22).
4. blind person's vibration according to claim 3 and contacts matrix perceive photo apparatus, it is characterised in that: the power supply is single
First (23) supply haptic elements (31) another terminals operating voltage, and card computer (21) issues control to haptic elements (31) and refers to
It enables, and low level issues.
5. blind person's vibration according to claim 3 and contacts matrix perceive photo apparatus, it is characterised in that: the sense of touch member
Part (31) another terminals are connect with power supply unit (23) middle line, and card computer (21) issues control to haptic elements (31) and refers to
It enables, and high level issues.
6. blind person's vibration according to claim 1 and contacts matrix perceive photo apparatus, it is characterised in that: the outer housing
(32) and haptic elements (31) upper surface is equipped with the silica gel thin film to match with outer housing (32) and haptic elements (31).
7. the method for blind person's vibration according to claim 1 and contacts matrix perception photo, it is characterised in that: the camera shooting
Head (1) transfers data to card computer assembly (2) by cable;
The image of data transmission realizes gray level image pretreatment with PIL;
Whole image is divided into several pockets;
Touch tablet (3) is equipped in region corresponding with each pocket and each region and is equipped with haptic elements (31);
Image carries out surface by from left to right snake scan sequence;
In unit time, haptic elements (31) in corresponding region on the black or white decision touch tablet (3) of fritter respective pixel
Whether vibration or raw drop or rotation;
Corresponding ports are set by code and switch set out vibration or lifting or rotation.
8. the method for blind person's vibration according to claim 7 and contacts matrix perception photo, it is characterised in that: described entire
Image is divided into the pixel fritter that pixel is 3*3.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810789588.1A CN109002819A (en) | 2018-07-18 | 2018-07-18 | Blind person's vibration and contacts matrix perceive photo apparatus |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810789588.1A CN109002819A (en) | 2018-07-18 | 2018-07-18 | Blind person's vibration and contacts matrix perceive photo apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
CN109002819A true CN109002819A (en) | 2018-12-14 |
Family
ID=64598757
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201810789588.1A Pending CN109002819A (en) | 2018-07-18 | 2018-07-18 | Blind person's vibration and contacts matrix perceive photo apparatus |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN109002819A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109903300A (en) * | 2019-01-15 | 2019-06-18 | 浙江工业大学 | A kind of intelligent contact display methods and device for learning to know figure suitable for congenital blind person |
WO2020139091A1 (en) * | 2018-12-28 | 2020-07-02 | Bustamante Solis Cesar Jose | Haptic device in a matrix arrangement |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104882090A (en) * | 2015-05-26 | 2015-09-02 | 浙江大学 | Blind-person tactile image realization apparatus and method |
CN204791898U (en) * | 2015-05-26 | 2015-11-18 | 浙江大学 | Device that blind person's sense of touch image was realized |
CN205193378U (en) * | 2015-11-11 | 2016-04-27 | 深圳职业技术学院 | Touch blind person's glasses system |
CN106709486A (en) * | 2016-11-11 | 2017-05-24 | 南京理工大学 | Automatic license plate identification method based on deep convolutional neural network |
-
2018
- 2018-07-18 CN CN201810789588.1A patent/CN109002819A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104882090A (en) * | 2015-05-26 | 2015-09-02 | 浙江大学 | Blind-person tactile image realization apparatus and method |
CN204791898U (en) * | 2015-05-26 | 2015-11-18 | 浙江大学 | Device that blind person's sense of touch image was realized |
CN205193378U (en) * | 2015-11-11 | 2016-04-27 | 深圳职业技术学院 | Touch blind person's glasses system |
CN106709486A (en) * | 2016-11-11 | 2017-05-24 | 南京理工大学 | Automatic license plate identification method based on deep convolutional neural network |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2020139091A1 (en) * | 2018-12-28 | 2020-07-02 | Bustamante Solis Cesar Jose | Haptic device in a matrix arrangement |
CN109903300A (en) * | 2019-01-15 | 2019-06-18 | 浙江工业大学 | A kind of intelligent contact display methods and device for learning to know figure suitable for congenital blind person |
CN109903300B (en) * | 2019-01-15 | 2021-05-18 | 浙江工业大学 | Intelligent contact display method and device suitable for congenital blind people to learn and recognize pictures |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110609722B (en) | Dark mode display interface processing method, electronic equipment and storage medium | |
EP3399288B1 (en) | Camera assembly and mobile electronic device | |
WO2014030888A1 (en) | System and method for perceiving images with multimodal feedback | |
CN109002819A (en) | Blind person's vibration and contacts matrix perceive photo apparatus | |
CN112598594A (en) | Color consistency correction method and related device | |
CN104079904A (en) | Color image generating method and device | |
WO2018117754A1 (en) | Display device for adjusting color temperature of image and display method for the same | |
CN107145871B (en) | It is a kind of can gesture operation intelligent home control system | |
CN104951117B (en) | Image processing system and related method for generating corresponding information by utilizing image identification | |
CN114040249A (en) | Atmosphere lamp adjusting method and device based on picture, intelligent terminal and storage medium | |
CN102972020A (en) | Camera module and method for driving the same | |
CN101647050A (en) | A visual interface control based on viewing display area configuration | |
WO2014171675A1 (en) | Method of processing image and electronic device and system supporting the same | |
CN109413399A (en) | Use the devices and methods therefor of depth map synthetic object | |
CN104820537A (en) | Method and device for adjusting terminal display effect | |
EP4199496A1 (en) | Image stabilization method and electronic device therefor | |
KR20200034290A (en) | Electronic device for improving visual recognition of partial area of display | |
CN109147585A (en) | Micro LED display panel, control method, control device and electronic equipment | |
CN109088983A (en) | Screen backlight adjusting method, device, readable storage medium storing program for executing and mobile terminal | |
WO2020258494A1 (en) | Display driving method, display panel and display device | |
CN113781959B (en) | Interface processing method and device | |
CN109753155B (en) | Head-mounted display device, driving method thereof and virtual reality display device | |
CN103391406B (en) | A kind of video switch circuit and changing method thereof | |
WO2019216688A1 (en) | Method for estimating light for augmented reality and electronic device thereof | |
CN205946040U (en) | Device is shot to VR image and VR image imaging system based on mobile terminal thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181214 |