RO129857A0 - Method and device for acoustic and tactile perception of space - Google Patents
Method and device for acoustic and tactile perception of space Download PDFInfo
- Publication number
- RO129857A0 RO129857A0 ROA201400323A RO201400323A RO129857A0 RO 129857 A0 RO129857 A0 RO 129857A0 RO A201400323 A ROA201400323 A RO A201400323A RO 201400323 A RO201400323 A RO 201400323A RO 129857 A0 RO129857 A0 RO 129857A0
- Authority
- RO
- Romania
- Prior art keywords
- acoustic
- tactile
- module
- signal
- space
- Prior art date
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
Description
Metodă și dispozitiv de percepție acustica si tactila a spațiuluiMethod and device for acoustic and tactile perception of space
Invenția se referă la o metodă și dispozitiv de percepție acustica si tactila a spațiului 3D destinata deplasării si navigării in mediu a nevazatorilor, persoanelor cu probleme de vedere si in general a utilizatorilor dispozitivului.The invention relates to a method and device for acoustic and tactile perception of 3D space intended for moving and navigating in the environment of blind people, visually impaired persons and in general users of the device.
Conceperea si realizarea unor metode si dispozitive care sa permită percepția spațiului 3D destinate deplasării si navigării in mediu a nevazatorilor, persoanelor cu probleme de vedere si in general a utilizatorilor dispozitivului preocupa atat unitati de cercetare de renume din lume, cu proiecte lansate la nivel mondial, cum ar fi proiectul “Project Tango” sau finanțate de EU prin programe de cercetare FP7 cunoscut cu numele I Cane, dar si marile companii in vederea implementării si dezvoltării pe piața a unor noi produse. Importanta soluției tehnice propuse se datoreaza celor peste 3 milioane nevazatori in Europa, aceasta metoda permițând un prim pas pentru nevazatori de a percepe mediul in care trăiesc.The design and realization of methods and devices that allow the perception of 3D space intended for the displacement and navigation in the environment of the blind, the visually impaired and the users of the device in general concern so many renowned research units in the world, with projects launched worldwide, such as the "Project Tango" project or financed by the EU through FP7 research programs known as I Cane, but also the big companies in order to implement and develop new products on the market. The importance of the proposed technical solution is due to the over 3 million blind people in Europe, this method allowing a first step for the blind to perceive the environment in which they live.
Dezavantajele soluțiilor cunoscute constau în faptul ca utilizarea unui baston cu senzori care sa detecteze obiecte din mediu (proiectul FP7 EU si produsele “ I Cane”) oferă informații parțiale ale mediului in care se deplasează utilizatorul dispozitivului. Foarte cunoscut in aceasta privința este proiectul European de dezvoltare si cercetare științifica “IMAGO” care are ca scop realizarea unui dispozitiv “embeded”, introdus in bastonul persoanelor nevazatoare, care sa permită acestora navigarea in spațiu, dar restricționat la detectarea unor obstacole, cu facilitați similare oferite de utilizarea bastonului.The disadvantages of the known solutions consist in the fact that the use of a stick with sensors to detect objects from the environment (the FP7 EU project and the "I Cane" products) provides partial information of the environment in which the user of the device moves. Very well known in this regard is the European project for scientific development and research "IMAGO" which aims to create an "embeded" device, inserted into the cane of blind persons, which will allow them to navigate in space, but restricted to detecting obstacles, with ease. similar offered by the use of the cane.
La nivel european sunt peste 3.000.000 nevazatori sau parțial nevazatori si la nivel național numărul acestora înregistrați la Asociația Nevazatorilor din Romania este de aproximativ 80.000. Pentru imbunatatirea vieții acestei categorii sociale s-au efectuat o serie de cercetări științifice concretizate prin apariția pe piața a unor produse ce utilizează comunicarea vocala si răspund direct nevoilor legate de informare - ceas vorbitor, cantar vorbitor etc. Problemele apar in cadrul echipamentelor prin care se incearca sa se descrie unui nevazator lumea înconjurătoare, datorita posibilităților limitate de informare. In acest caz canalele de informare disponibile sunt cele auditive si cele tactile recepționate direct, fara procesarea informației pentru generarea unei harți a spațiului. Daca in cadrul văzului aria de percepție este foarte mare, cu posibilitatea focalizării si respectiv a ignorării anumitor zone din câmpul vizual - lucrul ce permite afișarea anumitor informații in zonele periferice ale vederii - in cadrul simțului auditiv aria de percepție directa fara procesarea informației prezintă o selectivitate mica. In aceste condiții tratarea evenimentelor se face cu aceiași prioritate chiar daca sunt sunete secundare sau prioritare, importante in navigarea unei peroane nevazatoare, ceea ce limitează posibilitatea utilizării comunicării sonore doar pentru echipamentele de semnalizare punctiforma sau la cerere (GPS vorbitor, alarme etc).At the European level, there are over 3,000,000 blind or partially blind and at national level, their number registered at the Romanian Watchers Association is about 80,000. In order to improve the life of this social category, a series of scientific researches have been carried out through the appearance on the market of products that use voice communication and respond directly to information needs - speaker clock, speaker scale, etc. Problems arise in the equipment that tries to describe to a blind person the surrounding world, due to the limited possibilities of information. In this case, the information channels available are the auditory and tactile ones received directly, without processing the information for generating a space map. If within the visual area the perception area is very large, with the possibility of focusing and ignoring certain areas of the visual field - the thing that allows the display of certain information in the peripheral areas of the vision - within the auditory sense the direct perception area without processing the information presents a selectivity small. In these conditions, the treatment of events is made with the same priority, even if they are secondary or priority sounds, important in navigating a blind spot, which limits the possibility of using sound communication only for point-to-point or on-demand signaling equipment (GPS speaker, alarms, etc.).
Alte soluții tehnice de percepție a unei harți 3D prin utiizarea a doua camere de luat vederi montate pe un telefon mobil (Proiect Tango), se afla intr-o faza incipienta in generarea cu rezoluție ridicata a mediului de navigare si se cauta soluții pentru transformarea spațiului pozițiilor 3D intr-un spațiu 3D perceptibil acustic sau tactil de nevazatori.Other technical solutions for the perception of a 3D map by using two cameras mounted on a mobile phone (Tango Project), is in an incipient phase in generating a high resolution of the navigation environment and looking for solutions for transforming the space. 3D positions in a perceptible acoustic or tactile 3D space of the blind.
h·..·> S7AT î.r-,?:) invemj» șt mărc») ; ,.v _ . ,...... , ;..... fh · .. ·> S7AT î.r-,? :) invemj »know mark»); ,. v _. , ......,; ..... f
L. Qu '3ς3ι IL. Qu '3ς3ι I
..... ’ JlrOC..... 'JlrOC
-2014-00323-ϊ 5 * an*-2014-00323-ϊ 5 * year *
Problema pe care o rezolvă invenția este percepția acustica si tactila a spațiului 3D destinata deplasării si navigării in mediu al nevazatorilor, persoanelor cu probleme de vedere si in general al utilizatorilor dispozitivului.The problem solved by the invention is the acoustic and tactile perception of the 3D space intended for moving and navigating in the environment of the blind, the visually impaired and in general the users of the device.
Metoda conform invenției, înlătură dezavantajele de mai sus prin aceea că se asigura orientarea si navigarea in spațiu a nevazatorilor, persoanelor in varsta cu probleme de vedere si a utilizatorilor prin generarea, de către un modul scanner 3D cu laser sau un modul scanner cu ultrasunete sau un modul procesare imagini, a unui mediu virtual 3D sub forma unei interfețe virtual grafice stabile in raport cu mișcarea modulului, urmata de generarea acustica si tactila a spațiului mediului 3D printr-o funcție de transformare Fvl de la spațiul 3D exprimat in poziție, la spațiul 3D exprimat in domeniul frecvente, prin care se asociaza fiecărui punct de poziție din spațiul P(x, y, z), cartografiat 3D, un vector tridimensional vL (fi>, fm, fx) asociat cartografierii de poziție 3D, cu valori fi,, fm, fA, in care funcțiile de transformare Fvl sunt de forma FvLb = v(fbx, fby, fbz) sau FVLm = v(fmx, fmy, fmz) sau FVla = ν(ίΔχ, fAy, fv) sau combinații ale variabilelor funcțiilor v, cu efectuarea unei baleeri a variabilei frecventei de baza fb, sau variabilei frecventei de modulare a frecventei de baza notata fm, sau a variabiliei de defazaj intre frecventa de baza fr si frecventei de modulare fm notata f\, cu limitele gamei de baleaj date de limitele gamei asociate spațiului punctelor de poziție P(x,y,z), dar cu rezoluție variabila a gamei de baleaj asemanator câmpului visual uman, se obține astfel transformarea spațiului 3D exprimat in poziție intr-un câmp de percepție acustic, prin aplicarea semnalului rezultat la un modul acustic (ex. difuzor, casca, etc.), sau intr-un câmp de percepție tactila prin aplicarea la un modul piezoceramic sau modul magnetoreologic. Sun definite notațiile:The method according to the invention removes the above disadvantages by ensuring that the orientation and navigation in space of the blind, the elderly with visual problems and the users is generated by a 3D laser scanner module or an ultrasound scanner module or an image processing module, of a 3D virtual environment in the form of a stable graphical virtual interface in relation to the movement of the module, followed by the acoustic and tactile generation of the 3D environment space through an Fvl transformation function from the 3D space expressed in position, to the space 3D expressed in the common domain, which associates each position point in space P (x, y, z), mapped 3D, a three-dimensional vector v L (fi>, f m , fx) associated with 3D position mapping, with values fi ,, f m , f A , wherein the transform functions Fvl are of the form FvLb = v (fbx, fby, fbz) or F V Lm = v (f mx , f my , fmz) or F V at = ν ( ί Δχ , f Ay , fv) or combinations of va of the functions v, by performing a sweep of the basic frequency variable fb, or the modulation frequency variable of the noted basic frequency f m , or of the phase difference between the basic frequency fr and the modulation frequency f m noted f \, with the limits the range of the sweep given by the limits of the range associated with the position of the position points P (x, y, z), but with the variable resolution of the sweep range similar to the human visual field, the transformation of the 3D space expressed in position into an acoustic perception field is thus obtained , by applying the resulting signal to an acoustic module (e.g. speaker, headset, etc.), or in a tactile field of perception by applying it to a piezoceramic module or magnetoreological module. The notations are defined:
P(x, y, z) - punct in spațiul poziției din mediu, in care: x,y,z - coordonatele carteziene, vL (fb, fm, G) un vector asociat punctului P(x, y, z) prin care se asociaza coordonatei x frecventa fb, coordonatei y frecventa fm, cordonatei z frecventa;P (x, y, z) - point in the space of the position in the environment, where: x, y, z - the Cartesian coordinates, v L (fb, fm, G) a vector associated with the point P (x, y, z) through which is associated with the coordinate x frequency f b , the coordinate y frequency f m , the coordinate z frequency;
fb - frecventa de baza care reprezintă o frecventa asociata unui punct in spațiul, fata de care se vor define frecventele modulate fm sau frecventele defazate f\, definite printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor de baza, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman;fb - the basic frequency that represents a frequency associated with a point in space, against which the modulated frequencies f m or the offset frequencies f \ will be defined, defined by a bi-univocal linear relationship between the position space range and the base frequency range, with variable resolution of the sweep range similar to the human visual field;
fm - frecventa de modulare care reprezintă o frecventa asociata unui punct in spațiul, prin care se modulează frecventa de baza fb , cu relație de asociere definita printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor de modulare, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman;f m - the modulation frequency which represents a frequency associated with a point in space, by which the basic frequency f b is modulated, with association relation defined by a bi-univocal linear relationship between the position space range and the modulation frequency range, with resolution variable sweep range similar to human visual field;
f\- frecventa defazata care reprezintă un defazaj intre fecventa de baza fi, si frecventa modulata fm asociat unui punct in spațiul, cu relație de asociere definita printr-o relație liniara biunivoca intre gama spațiului de poziție si gama defazajului, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman;f \ - the offset frequency which represents a phase difference between the base frequency fi, and the modulated frequency f m associated with a point in space, with an association relation defined by a bi-univocal linear relationship between the range of the position space and the range of the phase shift, with variable resolution of the range of sweeping resembling the human field of vision;
v - reprezintă funcția de transformare din spațiul pozițiilor defini de mulțimea punctelor P (x,y,z) in spațiul frecventelor defint de mulțimea punctelor Fvl, avand drept variabile fbX, fby, fbz corespunzătoare frecventelor de baza raportate la coordonatele carteziene x,y,z, respectiv fmx, fmy, fmz corespunzătoare frecventelor de baza raportate la coordonatele carteziene x,y,z, ‘2014- 0 0 3 2 3 -2 5 -04- 2014v - represents the transformation function from the space of the positions defined by the set of points P (x, y, z) in the space of the frequencies defined by the set of points Fvl, having as variables fb X , fby, fbz corresponding to the basic frequencies related to the Cartesian coordinates x, y , z, respectively fmx, fmy, fmz corresponding to the basic frequencies related to the Cartesian coordinates x, y, z, '2014- 0 0 3 2 3 - 2 5 -04- 2014
fAx, f&y, fâz respectiv corespunzătoare frecventelor de baza raportate la coordonatele carteziene x,y,z.f Ax , f & y, respectively phase corresponding to the basic frequencies related to the Cartesian coordinates x, y, z.
Fvl - reprezintă puncte in spațiul frecventelor obținute prin transformarea punctelor P(x,y,z) din spațiul pozițiilor printr-o funcție de transformare v, in care s-au notat:Fvl - represents points in the frequency space obtained by transforming the points P (x, y, z) from the position space through a transformation function v, in which we have noted:
Fvl cu FvLb, daca avem asociat punctului x din spațiul pozițiilor o frecventa fbx, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor de baza, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului y din spațiul pozițiilor o frecventa fby, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor de baza, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului z din spațiul pozițiilor o frecventa fbz, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor de baza, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual urna,Fvl with FvLb, if we have associated the point x in the position space with a frequency f bx , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the base frequencies, with variable resolution of the sweep range similar to the visual field human, respectively if we have associated with the point y in the position space a frequency f by , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the basic frequencies, with variable resolution of the range of the sweep resembling the human visual field , respectively if we have associated with the point z in the position space a frequency f bz , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the base frequencies, with variable resolution of the sweep range similar to the field of view,
Fvl cu FvLm, daca avem asociat punctului x din spațiul pozițiilor o frecventa fmx, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor modulate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului y din spațiul pozițiilor o frecventa fmy, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor modulate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului z din spațiul pozițiilor o frecventa fmz, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor modulate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman,Fvl with FvLm, if we have associated with the point x in the position space a frequency f mx , associated with a point in the space defined by a bi-univocal linear relation between the range of the position space and the range of the modulated frequencies, with variable resolution of the sweep range similar to the human field of view respectively if we associate point y in the space positions of a frequency f my, associated with a point in space defined by the linear bi-univocal between wide area position and frequency range modulated with a resolution variable range Scanning similar visual field of human or if we have associated with the point z in the position space a frequency f mz , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the modulated frequencies, with variable resolution of the sweep range similar to the human visual field,
Fvl cu FVla, daca avem asociat punctului x din spațiul pozițiilor o frecventa f\x, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor defazate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului y din spațiul pozițiilor o frecventa fây, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor defazate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman, respectiv daca avem asociat punctului z din spațiul pozițiilor o frecventa fv, asociata unui punct in spațiul definit printr-o relație liniara biunivoca intre gama spațiului de poziție si gama frecventelor defazate, cu rezoluție variabila a gamei de baleaj asemanator câmpului vizual uman.Fvl with F V at, if we have associated with the point x in the position space a frequency f \ x , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the phase frequencies, with variable resolution of the similar sweep range. of the human visual field, respectively if we have associated the point y in the position space with a frequency f ây , associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the offset frequencies, with variable resolution of the sweep range similar to the visual field human, respectively if we have associated with the point z in the position space a frequency fv, associated with a point in the space defined by a bi-univocal linear relationship between the range of the position space and the range of the offset frequencies, with variable resolution of the range of scanning similar to the human visual field.
VL (fb, fm, Îa) este un vector tridimensional asociat cartografierii de poziție 3D, cu valori fb, fm, fâV L (fb, fm, Îa) is a three-dimensional vector associated with 3D position mapping, with values f b , f m , fâ
Secvențele metodei de percepție acustica si tactila a spațiului se realizează in succesiunea prezentata mai jos, respectiv: (i) captarea si prelucrarea imaginii spațiului printrun modul de scanare laser 3D sau un modul de scanare ultrasonica 3D sau prin utilizarea unui modul de preocesare imagini si transformarea intr-o harta virtuala a mediului; (ii) prin procesarea semnalelor de la niște traductoare gravitaționale 3G si/sau traductoare tip busol, imaginea instabila obtinuta de la modulul de scanare laser 3D sau modulul de scanare ultrasonica 3D sau prin utilizarea unui modul de procesare imagini este transformata intr-o ‘ 2 Ο 1 A - Ο Ο 3 2 3 -2 5 -04- 2014The sequences of the acoustic and tactile perception method of the space are realized in the sequence presented below, respectively: (i) capturing and processing the image of the space through a 3D laser scanning module or a 3D ultrasonic scanning module or by using an image preprocessing module and the transformation in a virtual environment map; (ii) by processing signals from 3G gravity transducers and / or compass transducers, the unstable image obtained from the 3D laser scanning module or the 3D ultrasonic scanning module or by using an image processing module is transformed into a '2 Ο 1 A - Ο Ο 3 2 3 -2 5 -04- 2014
harta virtuala a mediului cu imagine stabila a mediului indiferent in ce direcții se mișca respectivele module de captare a imaginii menționate anterior, (iii) transformarea printr-o funcție de transformare Fvl a spațiului 3D exprimat in poziție, la spațiul 3D exprimat in domeniul frecvente, prin care se asociaza fiecărui punct de poziție din spațiul P(x, y, z), cartografiat 3D, un vector tridimensional vL (fb, fm, fi) asociat cartografierii de poziție 3D, cu valori fi, fm, fi, in care funcțiile de transformare FVl sunt de forma Fvtb = v(fix, fiy, fiz) sau FvLm = v(fmx, fmy, fmz) sau FVla = v(fix, fAy, fĂ7) sau combinații ale variabilelor funcțiilor v. (iv) baleerea variabilei frecventei de baza fi, sau vriabilei frecventei de modulare a frecventei de baza notata fm, sau a variabiliei de defazaj intre frecventa de baza fi si frecventei de modulare fm notata Ϊδ cu limitele gamei de baleaj date de limitele gamei associate spațiului punctelor de poziție P(x,y,z), dar cu rezoluție variabila a gamei de baleaj asemanator câmpului visual uman, (v) transformarea in acest mod a spațiul 3D exprimat in poziție intrun câmp de percepție acustic, prin aplicarea semnalului rezultat la un actuator acustic; (vi) sau transformarea in acest mod a spațiul 3D exprimat in poziție intr-un câmp de percepție tactila prin aplicarea la un actuator piezoceramic; (vii) sau transformarea in acest mod a spațiul 3D exprimat in poziție intr-un câmp de percepție tactila prin aplicarea la un actuator magnetoreologic.virtual map of the environment with a stable image of the environment, in which directions the respective image capture modules move, (iii) transforming by a Fvl transform function the 3D space expressed in position, to the 3D space expressed in the common domain, by associating each position point in space P (x, y, z), mapped 3D, a three-dimensional vector v L (fb, f m , fi) associated with 3D position mapping, with values fi, f m , fi, wherein the transform functions F V l are of the form Fvtb = v (fi x , fi y , fi z ) or FvLm = v (f mx , f my , f mz ) or F V la = v (fi x , f Ay , f Ă7 ) or combinations of the variables of the functions v. (iv) the sweep of the variable of the basic frequency fi, or the variable of the modulation frequency of the noted basic frequency f m , or of the phase shift between the basic frequency fi and the modulation frequency f m noted Ϊδ with the limits of the sweep range given by the limits of the range associated with the punctual space r of position P (x, y, z), but with variable resolution of the sweep range similar to the human visual field, (v) transforming in this way the 3D space expressed in position into an acoustic perception field, by applying the resulting signal to a acoustic actuator; (vi) or transforming in this way the 3D space expressed in position into a tactile field of perception by applying it to a piezo-ceramic actuator; (vii) or transforming in this way the 3D space expressed in position into a tactile field of perception by applying it to a magnetorheological actuator.
Dispozitivul conform invenției înlătură dezavantajele menționate prin aceea că este alcătuit dintr-un modul scalare si filtrare care recepționează din mediu 3D un semnal al pozițiilor din spațiu P(x,y,z) pe care le scaleaza si filtrează de zgomot si semnale parazite in domeniul de funcționare a unui modul de scanare laser 3D sau a unui modul de scanare ultrasonică 3D sau a unui modul de procesare imagini si filtrează semnalele de zgomot, un modul de scanare laser 3D sau un modul de scanare ultrasonică 3D sau un modul de preocesare imagini, care primesc semnalele scalate si filtrate si generează harta virtuala cartografîata a mediului 3D stabila daca dispozitivul de recepție acustica si tactila este fix, dar instabila in raport cu mișcarea mâinii utilizatorului asupra dispozitivului de recepție acustica si tactila, un modul harta virtuala a mediului scanat ultrasonic care primește semnalul de la un modul de scanare ultrasonic 3D cu imagine instabila in raport cu mișcarea mâinii utilizatorului a dispozitivului de recepție acustica si tactila, pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D si/sau de la o busola magnetica cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila si le transmite la un modul de generare harta acustica sau tactila, sau un modul harta virtuala a mediului scanat laser care primește semnalul de la un modul de scanare laser 3D (SL3D) cu imagine instabila in raport cu mișcarea mâinii utilizatorului a dispozitivului de recepție acustica si tactila, pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D si/sau de la o busola magnetica cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila si le transmite la un modul de generare harta acustica sau tactila, sau un modul harta virtuala a mediului prin procesare de imagini care primește semnalul de la un modul procesare imagine 3D cu imagine instabila in raport cu mișcarea mâiniiThe device according to the invention removes the disadvantages mentioned by the fact that it is made up of a scalar and filtering module that receives from the 3D environment a signal of the positions in space P (x, y, z) that it scales and filters out noise and parasitic signals in the field. operating a 3D laser scanning module or a 3D ultrasonic scanning module or image processing module and filtering out noise signals, a 3D laser scanning module or a 3D ultrasound scanning module or image processing module, that receive the scaled and filtered signals and generate the mapped virtual map of the 3D environment stable if the acoustic and tactile reception device is fixed, but unstable in relation to the user's hand movement on the acoustic and tactile reception device, a virtual ultrasonic scanned environment map module receives the signal from a 3D ultrasonic scan module with unstable image relative to m shaking the user's hand of the acoustic and tactile reception device, which it processes together with the signals received from a 3D gravitational transducer and / or from a magnetic compass, transforming it into a virtual map of the environment with stable image no matter in which directions move the acoustic and tactile reception device and transmit them to an acoustic or tactile map generation module, or a virtual map of the laser scanned environment that receives the signal from a 3D laser scanning module (SL3D) with unstable image in relation to movement the user's hand of the acoustic and tactile reception device, which it processes together with the signals received from a 3D gravitational transducer and / or from a magnetic compass, transforming it into a virtual map of the environment with stable image no matter in which directions it moves. the acoustic and tactile reception device and transmits them to an acoustic or tactile map generation module ila, or a virtual environment map module by image processing that receives the signal from a 3D image processing module with unstable image in relation to the movement of the hand
-2014-00323-2 5 -04- 2014-2014-00323-2 5 -04- 2014
utilizatorului a dispozitivului de recepție acustica si tactila, pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D si/sau de la o busola magnetica, cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila si le transmite la un modul de generare harta acustica sau tactila, un modul de generare harta acustica sau tactila care primește de la un modul harta virtuala a mediului scanat ultrasonic sau un modul harta virtuala a mediului scanat laser sau un modul harta virtuala a mediului prin procesare de imagini, semnale cu harta virtuala a mediului stabila in raport cu mișcările dispozitivului de recepție acustica si tactila, de la un modul baleere frecventa cu rezoluție variabila semnalul de baleere in frecventa intr-o gama data cu rezoluție variabila a gamei de baleaj asemanator câmpului visual uman si de la un modul limitare gama baleere semnalele care generează limita superioara si limita de jos a gamei de baleere si realizează transformarea conform metodei invenției, printr-o funcție de transformare FVl a spațiului 3D exprimat in poziție, la spațiul 3D exprimat in domeniul frecvente, prin care se asociaza fiecărui punct de poziție din spațiul P(x, y, z), cartografiat 3D, un vector tridimensional vl (fb, fm, f\) asociat cartografierii de poziție 3D, cu baleere in frecventa intr-o gama data, cu rezoluție variabila a gamei de baleaj asemanator câmpului visual uman si cu limitare superioara si limitare de jos a gamei de baleere, intr-un câmp de percepție acustica si/sau intr-un câmp de percepție tactila, un modul actuator acustic care primește un semnal al câmpului de percepție acustic de la modulul de generare harta acustica sau tactila pe care il transforma in semnal acustic prin utilizarea unui actuator acustic, cum ar fi un difuzor sau o casca auditiva, si care va acționa asupra simțului de percepție acustic uman- timpan, sau un modul actuator tactil care primește un semnal al câmpului de percepție tactil de la modulul de generare harta acustica sau tactila pe care il transforma in semnal tactil prin utilizarea unui actuator piezoceramic, cum ar fi un set de pastile piezoceramice, si care va acționa asupra simțului de percepție tactil uman cum ar fi degetele sau alte parii ale corpului in contactat cu actuatorul piezoelectric, sau prin utilizarea unui actuator magnetoreologic, cum ar fi un amortizor semi-activ cu fluide magnetoreologice, si care va acționa asupra simțului de percepție tactil uman cum ar fi degetele in contactat cu actuatorul magnetoreologic.the user of the acoustic and tactile reception device, which processes it together with the signals received from a 3D gravitational transducer and / or from a magnetic compass, transforming it into a virtual map of the environment with stable image no matter in which directions it moves. the acoustic and tactile reception device and transmits them to an acoustic or tactile map generation module, an acoustic or tactile map generation module that receives from a ultrasonic scanned environment virtual map module or a laser scanned environment virtual map module or a module virtual map of the environment through image processing, signals with the virtual map of the environment stable in relation to the movements of the acoustic and tactile reception device, from a frequency module with variable resolution frequency signal of frequency in a given range with variable resolution of the sweep range similar to the human visual field and from a module limit the range of the signals signals which generates the upper limit and the lower limit of the sweep range and performs the transformation according to the method of the invention, through a transform function F V to the 3D space expressed in position, to the 3D space expressed in the common domain, by which it is associated with each position point from space P (x, y, z), mapped 3D, a three-dimensional vector vl (fb, f m , f \) associated with 3D position mapping, with frequency sweeps in a given range, with variable resolution of the sweep range similar to the human visual field and with upper limitation and lower limitation of the range of sweep, in an acoustic perception field and / or in a tactile perception field, an acoustic actuator module that receives a signal of the acoustic perception field from the module for generating the acoustic or tactile map that it transforms into an acoustic signal by using an acoustic actuator, such as a speaker or a hearing aid, and which will act on the sense of perception human-eardrum acoustics, or a tactile actuator module that receives a signal from the tactile perception field from the acoustic or tactile map generation module that transforms it into a tactile signal by using a piezoceramic actuator, such as a set of piezoceramic tablets, and which will act on the sense of human tactile perception such as the fingers or other bets of the body in contact with the piezoelectric actuator, or by using a magnetorheological actuator, such as a semi-active shock absorber with magnetorheological fluids, and which will act on the sense of human tactile perception such as the fingers in contact with the magnetorheological actuator.
Invenția prezintă avantajele determinării percepției acustice si tactile a spațiului 3D destinata deplasării si navigării in mediu al nevazatorilor, persoanelor cu probleme de vedere si in general al utilizatorilor dispozitivului cu informații complete ale mediului in care se deplasează acesta.The invention presents the advantages of determining the acoustic and tactile perception of the 3D space intended for moving and navigating in the environment of the blind, the visually impaired and in general the users of the device with complete information of the environment in which it is moving.
Se dă în continuare un exemplu de realizare a invenției în legătura cu fig.l care prezintă o schemă de principiu a dispozitivului. Dispozitiv de percepție acustica si tactila a spațiului este alcătuit din modulele prezentate mai jos.Following is an example of embodiment of the invention in connection with FIG. 1 which shows a schematic diagram of the device. The acoustic and tactile perception device of the space is made up of the modules presented below.
Modul scalare si filtrare (MSF) care recepționează din mediu 3D un semnal al pozițiilor din spațiu P(x,y,z), pe care le scaleaza si filtrează de zgomot si semnale parazite in domeniul de funcționare a unui modul de scanare laser 3D (SL3D) sau a unui modul de scanare ultrasonica 3D (SU3D) sau a unui modul de preocesare imagini (PI3D) si filtrează semnalele de zgomot.Scaling and filtering mode (MSF) that receives from the 3D environment a signal of the positions in space P (x, y, z), which it scales and filters out noise and parasitic signals in the operating range of a 3D laser scanning module ( SL3D) or a 3D ultrasound scanning module (SU3D) or an image processing module (PI3D) and filters out noise signals.
‘20Η- 0 0 3 2 3 -2 5 -W- 20M'20 Η- 0 0 3 2 3 - 2 5 -W- 20M
Modul de scanare laser 3D (SL3D) sau un modul de scanare ultrasonica 3D (SU3D) sau un modul de procesare imagini (PI3D), care primesc semnalele scalate si filtrate (SSF) si generează harta virtuala cartografiata a mediului 3D stabila daca dispozitivul de recepție acustica si tactila (DPAT) este fix, dar instabila in raport cu misarea datorata mâinii utilizatorului MUT asupra dispozitivului de recepție acustica si tactila (DPAT).3D laser scanning module (SL3D) or 3D ultrasound scanning module (SU3D) or image processing module (PI3D), which receives scaled and filtered signals (SSF) and generates the mapped virtual map of the stable 3D environment if the receiving device acoustic and tactile (DPAT) is fixed, but unstable in relation to the MUT user's hand movement on the acoustic and tactile reception device (DPAT).
Modul harta virtuala a mediului scanat ultrasonic (HVU) care primește semnalul de la un modul de scanare ultrasonic 3D (SU3D) cu imagine instabila in raport cu misarea datorata mâinii utilizatorului MUT a dispozitivului de recepție acustica si tactila (DPAT), pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D (TGR) si/sau de la o busola magnetica (TBM), cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila (DPAT) si le transmite la un modul de generare harta acustica sau tactila (GAT).The ultrasonic scanned environment (HVU) virtual map module that receives the signal from a 3D ultrasonic scanning module (SU3D) with unstable image in relation to the MUT user's hand motion of the acoustic and tactile reception device (DPAT), which it processes together with the signals received from a 3D gravitational transducer (TGR) and / or from a magnetic compass (TBM), with the transformation into a virtual map of the stable image environment no matter in which directions the acoustic and tactile reception device moves ( DPAT) and sends them to an acoustic or tactile map (GAT) generation module.
Modul harta virtuala a mediului scanat laser (HVL) care primește semnalul de la un modul de scanare laser 3D (SL3D) cu imagine instabila in raport cu misarea datorata mâinii utilizatorului MUT a dispozitivului de recepție acustica si tactila (DPAT), pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D (TGR) si/sau de la o busola magnetica (TBM), cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila (DPAT) si le transmite la un modul de generare harta acustica sau tactila (GAT).The virtual map mode of the laser scanned environment (HVL) that receives the signal from a 3D laser scanning module (SL3D) with unstable image in relation to the MUT user's hand movement of the acoustic and tactile reception device (DPAT), which it processes together with the signals received from a 3D gravitational transducer (TGR) and / or from a magnetic compass (TBM), with the transformation into a virtual map of the stable image environment no matter in which directions the acoustic and tactile reception device moves ( DPAT) and sends them to an acoustic or tactile map (GAT) generation module.
Modul harta virtuala a mediului prin procesare de imagini (HVI) care primește semnalul de la un modul procesare imagine 3D (PI3D) cu imagine instabila in raport cu misarea datorata mâinii utilizatorului MUT a dispozitivului de recepție acustica si tactila, pe care le procesează împreuna cu semnalele primite de la un traductor gravitațional 3D (TGR) si/sau de la o busola magnetica (TBM), cu transformarea intr-o harta virtuala a mediului cu imagine stabila indiferent in ce direcții se mișca dispozitivul de recepție acustica si tactila (DPAT) si le transmite la un modul de generare harta acustica sau tactila (GAT).The virtual map environment of the image processing (HVI) module that receives the signal from a 3D image processing module (PI3D) with unstable image in relation to the MUT user's hand movement of the acoustic and tactile reception device, which it processes together with the signals received from a 3D gravity transducer (TGR) and / or a magnetic compass (TBM), with the transformation into a virtual map of the stable image environment regardless of which directions the acoustic and tactile reception device (DPAT) move and sends them to an acoustic or tactile map (GAT) generation module.
Exemplul cel mai cunoscut in realizarea imaginii stabile in condițiile mișcării mâinii utilizatorului MUT, ceea ce conduce la mișcarea dispozitivului de recepție acustica si tactila (DPAT), il reprezintă telefonul android, smart phone si echipamentul dezvoltat cu traductoare accelerometrice 3D gravitaționale si traductoare busola magnetica, in cadrul proiectului „Project Tango”. Prin aceasta metoda se combina informațiile primite la la traductoare cu tehnicile de procesare imagini prin utilizarea a doua camere de luat vederi pentru a genera harta cartografiata a spațiului de navigare a utilizatorului telefonului mobil. Referința fixa in spațiu se obține prin procesarea semnalului de la busola magnetica si compensarea mișcării dispozitivului de recepție acustica si tactila (DPAT) se obține prin dubla integrare a accelerației primite de la traductoarele accelerometrice 3D gravitaționale.The best-known example in achieving stable image in the conditions of the MUT user's hand movement, which leads to the movement of the acoustic and tactile reception device (DPAT), is the android phone, smart phone and the equipment developed with accelerometric 3D gravity transducers and magnetic compass transducers, within the project "Project Tango". This method combines the information received at the translators with the image processing techniques by using two cameras to generate the mapped map of the navigation space of the mobile phone user. The fixed reference in space is obtained by processing the signal from the magnetic compass and compensating for the movement of the acoustic and tactile reception device (DPAT) is obtained by double integrating the acceleration received from the gravitational 3D accelerometric transducers.
Modul de generare harta acustica sau tactila (GAT) care primește de la un modul harta virtuala a mediului scanat ultrasonic (HVU) sau un modul harta virtuala a mediului scanat laser (HVL) sau un modul harta virtuala a mediului prin procesare de imagini (HVI), semnale cu harta virtuala a mediului stabila in raport cu mișcările dispozitivului de recepție acustica si tactila (DPAT), de asemenea de la un modul baleere frecventa cu rezoluție variabila (MBF) semnalul de baleere in frecventa (SBF) intr-o gama data cu rezoluție variabila a gamei de “201 4-003 23 -2 5 θ*- 2014 baleaj asemanator câmpului visual uman si de la un modul limitare gama baleere semnalele (LGB) care generează limita superioara (SGBs) si limita de jos (SGBsj) a gamei de baleere si realizează transformarea conform metodei invenției, printr-o funcție de transformare Fvl a spațiului 3D exprimat in poziție, la spațiul 3D exprimat in domeniul frecvente, prin care se asociaza fiecărui punct de poziție din spațiul P(x, y, z), cartografiat 3D, un vector tridimensional vl (fb, fm, D asociat cartografierii de poziție 3D, cu baleere in frecventa intr-o gama data cu rezoluție variabila a gamei de baleaj asemanator câmpului visual uman si cu limitare superioara si limitare de jos a gamei de baleere, intr-un câmp de percepție acustica si/sau intr-un câmp de percepție tactila,The acoustic or tactile map generation (GAT) module that receives from a virtual ultrasonic scanned environment (HVU) module or a virtual laser scanned environment (HVL) module or a virtual image processing module (HVI) ), signals with the stable virtual map of the environment in relation to the movements of the acoustic and tactile reception device (DPAT), also from a variable frequency module with variable resolution (MBF), the frequency sweep signal (SBF) in a given range with variable resolution of the range of “201 4-003 23 -2 5 θ * - 2014 sweep similar to the human visual field and from a module limit the range of empty signals (LGB) that generate the upper limit (SGBs) and the lower limit (SGBsj) of the sweep range and performs the transformation according to the method of the invention, through a function of Fvl transformation of the 3D space expressed in position, to the 3D space expressed in the common domain, by which it is associated with each position point in s step P (x, y, z), 3D mapped, a three-dimensional vector vl (fb, f m , D associated with 3D position mapping, with frequency sweeps in a given range with variable resolution of the sweep range similar to the human visual field and with upper limitation and lower limitation of the sweep range, in an acoustic perception field and / or in a tactile perception field,
Modul actuator acustic (MAA) care primește un semnal al câmpului de percepție acustic (SPA) de la modulul de generare harta acustica sau tactila (GAT) pe care il transforma in semnal acustic (SAA) prin utilizarea unui actuator acustic, cum ar fi un difuzor sau o casca auditiva, si care va acționa asupra simțului de percepție acustic uman SUA- timpan.Acoustic Actuator Module (MAA) that receives an acoustic perception field (SPA) signal from the acoustic or tactile map generation (GAT) module that it transforms into an acoustic signal (SAA) by using an acoustic actuator, such as a speaker or a headset, and that will act on the sense of human acoustic perception US-eardrum.
Modul actuator tactil (MAT) care primește un semnal al câmpului de percepție tactil (SPT) de la modulul de generare harta acustica sau tactila (GAT) pe care il transforma in semnal tactil (SPT) prin utilizarea unui actuator piezoceramic, cum ar fi un set de pastile piezoceramice, si care va acționa asupra simțului de percepție tactil uman SUT cum ar fi degetele sau alte parti ale corpului in contactat cu actuatorul piezoelectric, sau prin utilizarea unui actuator magnetoreologic, cum ar fi un amortizor semi-activ cu fluide magnetoreologice, si care va genera un semnal de acționare tactil (SAT) asupra simțului de percepție tactil uman SUT cum ar fi degetele in contactat cu actuatorul magnetoreologic.The tactile actuator module (MAT) that receives a signal from the tactile perception field (SPT) from the acoustic or tactile map generation module (GAT) that it transforms into a tactile signal (SPT) by using a piezoceramic actuator, such as a set of piezoceramic pills, and which will act on the human SUT tactile sense of perception such as the fingers or other parts of the body in contact with the piezoelectric actuator, or by using a magnetorheological actuator, such as a semi-active magnetorheological fluid buffer, and which will generate a tactile actuation signal (SAT) on the human SUT tactile sense of perception such as the fingers in contact with the magnetorheological actuator.
BibliografieBibliography
1. K.-H. Thiel, “Performance Capabilities of Laser-Scanners - An Overview and Measurement Principie Analysis” in Proceedings of Internațional Society for Photogrammetry and Remote Sensing, voi. 36, 2004.,1. K.-H. Thiel, “Performance Capabilities of Laser-Scanners - An Overview and Measurement Principle Analysis” in Proceedings of the International Society for Photogrammetry and Remote Sensing, vol. 36, 2004.,
2. L. Ping, A. Liscidini en P. Andeani, „A 3.6 mW, 90 nm CMOS Gated-Vemier Time-toDigital Converter With an Equivalent Resolution of 3.2 ps,” IEEE Joumal of Solid-State Circuits, voi. 47, nr. 7, pp. 1626-1635, 2012.2. L. Ping, A. Liscidini in P. Andeani, "A 3.6 mW, 90 nm CMOS Gated-Vemier Time-toDigital Converter With an Equivalent Resolution of 3.2 ps," IEEE Joumal of Solid-State Circuits, vol. 47, no. 7, pp. 1626-1635, 2012.
3. Cao, Y.; De Cock, W.; Steyaert, M.; Leroux, P., 1-1-1 MASH Time-to-Digital Converters With 6 ps Resolution and Third-Order Noise-Shaping, Solid-State Circuits, IEEE Joumal of , vol.47, no.9, pp.2093,2106, Sept. 2012.3. Cao, Y.; Of Cock, W.; Steyaert, M.; Leroux, P., 1-1-1 MASH Time-to-Digital Converters With 6 ps Resolution and Third-Order Noise-Shaping, Solid-State Circuits, IEEE Joumal of, vol.47, no.9, pp.2093, 2106, Sept. 2012.
4. Kurtti, S.; Kostamovaara, J., An Integrated Laser Radar Receiver Channel Utilizing a TimeDomain Walk Error Compensation Scheme, Instrumentation and Measurement, IEEE Transactions on , voi.60, no.l, pp.146,157, Jan. 2011.4. Kurtti, S.; Kostamovaara, J., An Integrated Laser Radar Receiver Channel Utilizing a TimeDomain Walk Error Compensation Scheme, Instrumentation and Measurement, IEEE Transactions on, voi.60, no.l, pp.146,157, Jan. 2011.
5. MacLachlan, R.A.; Riviere, C.N., High-Speed Microscale Optical Tracking Using Digital Frequency-Domain Multiplexing, Instrumentation and Measurement, IEEE Transactions on , voi.58, no.6, pp. 1991,2001, June 2009.5. MacLachlan, R.A.; Riviere, C.N., High-Speed Microscale Optical Tracking Using Digital Frequency-Domain Multiplexing, Instrumentation and Measurement, IEEE Transactions on, Vol.58, no.6, pp. 1991,2001, June 2009.
6. Vladareanu L., Capitanu L., „Hybrid Force-Position Systems with Vibration Control for Improvment of Hip Implant Stability”, the 18th Congress of the European Society of Biomechanics, Lisbon, Portugal, July Ist - July 4th, 2012.6. Vladareanu L., Captain L., "Hybrid Force-Position Systems with Vibration Control for Improvement of Hip Implant Stability", 18th Congress of the European Society of Biomechanics, Lisbon, Portugal, July Ist - July 4th, 2012.
7. Vladareanu L., Vladareanu V., Schiopu P., „Hybrid Force-Position Dynamic Control of the Robots Using Fuzzy Applications, 3-th Edition of the IEEE/IACSIT Internațional7. Vladareanu L., Vladareanu V., Schiopu P., "Hybrid Force-Position Dynamic Control of the Robots Using Fuzzy Applications, 3-th Edition of the IEEE / IACSIT International
20Π- 0 0 3 2 3 -2 5 ‘Ο*' 2014 conference on Biomechanics, Neurorehabilitation, Mechanical Engineering, Manufacturing Systems, Robotics and Aerospace, ICMERA2012, Bucharest, 26-28 October 2012, pp.8, Invited Paper20Π- 0 0 3 2 3 - 2 5 'Ο *' 2014 conference on Biomechanics, Neurorehabilitation, Mechanical Engineering, Manufacturing Systems, Robotics and Aerospace, ICMERA2012, Bucharest, 26-28 October 2012, pp.8, Invited Paper
8. Vladareanu Luige., Lucian. M. Velea, Radu Aadrian Munteanu, Mihai Stelian Munteanu, Victor Vladareanu, Velea Alida Lia Mariana, Moga Daniel, Real-Time Control Method and Control Divice for an Actuator, Publication no.: EP2077476, App no.: 08464013.5/EPO 08464013,20088. Vladareanu Luige., Lucian. M. Velea, Radu Aadrian Munteanu, Mihai Stelian Munteanu, Victor Vladareanu, Velea Alida Lia Mariana, Moga Daniel, Real-Time Control Method and Control Divice for an Actuator, Publication no .: EP2077476, App no .: 08464013.5 / EPO 08464013, 2008
9. Balakrishnan, G.; Sainarayanan, G.; Nagarajan, R.; Yaacob, Sazali, Stereo image to stereo sound methods for Vision based ETA, Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering, 2005. CCSP 2005. Ist Internațional Conference on, voi., no., pp.193,196, 14-16 Nov. 2005 doi: 10.1109/CCSP.2005.49771889. Balakrishnan, G.; Sainarayanan, G.; Nagarajan, R.; Yaacob, Sazali, Stereo image to stereo sound methods for Vision based ETA, Computers, Communications, & Signal Processing with Special Track on Biomedical Engineering, 2005. CCSP 2005. Ist International Conference on, vol., No., Pp.193,196, 14 -16 Nov 2005 doi: 10.1109 / CCSP.2005.4977188
10. Chalamandaris, A.; Karabetsos, S.; Tsiakoulis, P.; Raptis, S., A unit selection text-to-speech synthesis system optimized for use with screen readers, Consumer Electronics, IEEE Transactions on , voi.56, no.3, pp.1890,1897, Aug. 201010. Chalamandaris, A.; Karabetsos, S.; Tsiakoulis, P.; Raptis, S., A unit selection text-to-speech synthesis system optimized for use with screen readers, Consumer Electronics, IEEE Transactions on, you.56, no.3, pp.1890,1897, Aug. 2010
11. McDaniel, T.; Krishna, S.; Balasubramanian, V.; Colbry, D.; Panchanathan, S., Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind, Haptic Audio visual Environments and Games, 2008. HAVE 2008. IEEE Internațional Workshop on, voi., no., pp.13,18, 18-19 Oct. 2008 doi: 10.1109/HAVE.2008.468529111. McDaniel, T.; Krishna, S.; Balasubramanian, V.; Colbry, D.; Panchanathan, S., Using a haptic belt to convey non-verbal communication cues during social interactions to individuals who are blind, Haptic Audio visual Environments and Games, 2008. HAVE 2008. IEEE International Workshop on, vol., No., Pp. 13.18, 18-19 Oct. 2008 doi: 10.1109 / HAVE.2008.4685291
12. S. Chu, S. Narayanan, and C.-C. Jay Kuo, “Environmental sound recognition with timefrequency audio features,” IEEE Trans Audio, Speech and Language Processing, voi. 17, no. 6, pp. 1142-1158, 2009.12. S. Chu, S. Narayanan, and C.-C. Jay Kuo, “Environmental sound recognition with timefrequency audio features,” IEEE Trans Audio, Speech and Language Processing, vol. 17, no. 6, pp. 1142-1158, 2009.
13. W. Huang, T. Chiew, H. Li, T. Kok, J. Biswas, “Scream detection for home applications,“ Industrial Electronics and Applications (ICIEA), pp.2115-2120, 201013. W. Huang, T. Chiew, H. Li, T. Kok, J. Biswas, "Scream detection for home applications," Industrial Electronics and Applications (ICIEA), pp.2115-2120, 2010
14. D. L. Wang and G. J. Brown, Computațional Auditory Scene Analysis: Principles, Algorithms, and Applications, IEEE Press, 2006.A, 1990.14. D. L. Wang and G. J. Brown, Computational Auditory Scene Analysis: Principles, Algorithms, and Applications, IEEE Press, 2006.A, 1990.
15. J.-J. Aucouturier, B. Defreville, and F. Pachet, “The bag-of-frames approach to audio pattem recognition: A sufficient model for urban soundscapes but not for polyphonic music,” Joumal of the Acoustical Society of America , voi. 122, pp. 881,2007.15. J.-J. Aucouturier, B. Defreville, and F. Pachet, "The bag-of-frames approach to audio pattem recognition: A sufficient model for urban soundscapes but not for polyphonic music," Joumal of the Acoustical Society of America, vol. 122, pp. 881,2007.
16. Vuegen, L., Van Den Broeck, B., Karsmakers, P., Van hamme, H., Vanrumste, B., Automatic monitoring of activities of daily living based on real-life acoustic sensor data: A preliminary study, in Fourth workshop on speech and language processing for assistive technologies (SLPAT): Proceedings (21-22 August 2013, Grenoble, France), Alexandersson, J., Ljunglof, P., McCoy, K., Portei, F. Eds., 2013, pp. 113-118.16. Vuegen, L., Van Den Broeck, B., Karsmakers, P., Van hamme, H., Vanrumste, B., Automatic monitoring of daily living activities based on real-life acoustic sensor data: A preliminary study, in Fourth workshop on speech and language processing for assistive technologies (SLPAT): Proceedings (August 21-22, 2013, Grenoble, France), Alexandersson, J., Ljunglof, P., McCoy, K., Portei, F. Eds., 2013, pp. 113-118.
17. E. Benetos, M. Lagrange, and S. Dixon, “Characterization of acoustic scenes using a temporally-constrained shift-invariant model,” in Proc DAFX, York, UK ,2012.17. E. Benetos, M. Lagrange, and S. Dixon, “Characterization of acoustic scenes using a temporally-constrained shift-invariant model,” in Proc DAFX, York, UK, 2012.
18. I Cane, Intelligence in a cane, http://www.i-cane.org/en/home18. The Dogs, Intelligence in the Dog, http://www.i-cane.org/en/home
19. ntelligent white cane improves mobility and independence of blind and visually impaired people, http://www.i-cane.org/en/86519. Intelligent white cane improves mobility and independence of blind and visually impaired people, http://www.i-cane.org/en/865
20. Project Tango, https://www.google.com/atap/projecttango/20. Project Tango, https://www.google.com/atap/projecttango/
21. Launches Project Tango Smartphone To Experiment With Computer Vision And 3D Sensors, http://techcrunch.com/2014/02/20/google-launches-project-tango/21. Launches Project Tango Smartphone To Experiment With Computer Vision And 3D Sensors, http://techcrunch.com/2014/02/20/google-launches-project-tango/
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ROA201400323A RO129857A0 (en) | 2014-04-25 | 2014-04-25 | Method and device for acoustic and tactile perception of space |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
ROA201400323A RO129857A0 (en) | 2014-04-25 | 2014-04-25 | Method and device for acoustic and tactile perception of space |
Publications (1)
Publication Number | Publication Date |
---|---|
RO129857A0 true RO129857A0 (en) | 2014-11-28 |
Family
ID=51945582
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
ROA201400323A RO129857A0 (en) | 2014-04-25 | 2014-04-25 | Method and device for acoustic and tactile perception of space |
Country Status (1)
Country | Link |
---|---|
RO (1) | RO129857A0 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108354533A (en) * | 2018-01-12 | 2018-08-03 | 浙江国自机器人技术有限公司 | A kind of intelligence floor-cleaning machine device people |
US11234574B2 (en) | 2018-01-12 | 2022-02-01 | Zhejiang Guozi Robot Technology Co., Ltd. | Intelligent floor cleaning robot |
-
2014
- 2014-04-25 RO ROA201400323A patent/RO129857A0/en unknown
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108354533A (en) * | 2018-01-12 | 2018-08-03 | 浙江国自机器人技术有限公司 | A kind of intelligence floor-cleaning machine device people |
US11234574B2 (en) | 2018-01-12 | 2022-02-01 | Zhejiang Guozi Robot Technology Co., Ltd. | Intelligent floor cleaning robot |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10857036B2 (en) | Active confocal imaging systems and methods for visual prostheses | |
Hoang et al. | Obstacle detection and warning system for visually impaired people based on electrode matrix and mobile Kinect | |
Bousbia-Salah et al. | A navigation aid for blind people | |
Hasegawa et al. | Aerial display of vibrotactile sensation with high spatial-temporal resolution using large-aperture airborne ultrasound phased array | |
US9805619B2 (en) | Intelligent glasses for the visually impaired | |
Balakrishnan et al. | Wearable real-time stereo vision for the visually impaired. | |
Dunai et al. | Obstacle detectors for visually impaired people | |
Aymaz et al. | Ultrasonic Assistive Headset for visually impaired people | |
Liu et al. | Electronic travel aids for the blind based on sensory substitution | |
Sharma et al. | Design of micro controller Based Virtual Eye for the Blind | |
Sharma et al. | International journal of engineering sciences & research technology a review on obstacle detection and vision | |
Nakadai et al. | Active audition system and humanoid exterior design | |
JP2011250928A (en) | Device, method and program for space recognition for visually handicapped person | |
RO129857A0 (en) | Method and device for acoustic and tactile perception of space | |
JP2016077712A (en) | Photoacoustic imaging device and photoacoustic imaging method | |
Patel et al. | Smartphone-based obstacle detection for visually impaired people | |
Caspo et al. | A survey on hardware and software solutions for multimodal wearable assistive devices targeting the visually impaired | |
Durgadevi et al. | Iot based assistive system for visually impaired and aged people | |
Hossain et al. | State of the art review on walking support system for visually impaired people | |
KR102092212B1 (en) | Wearable aids for the visually impaired | |
KR20140086087A (en) | Ultrasound system and control method for the same | |
KR20160035517A (en) | Smart Sign Language Glove | |
Nguyen et al. | A vision aid for the visually impaired using commodity dual-rear-camera smartphones | |
KR20190073045A (en) | Apparatus for recommending music, method thereof and computer recordable medium storing program to perform the method | |
JP3362496B2 (en) | Conductor baton tactile appreciation device for blind people |