FR3076709B1 - DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER - Google Patents

DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER Download PDF

Info

Publication number
FR3076709B1
FR3076709B1 FR1850271A FR1850271A FR3076709B1 FR 3076709 B1 FR3076709 B1 FR 3076709B1 FR 1850271 A FR1850271 A FR 1850271A FR 1850271 A FR1850271 A FR 1850271A FR 3076709 B1 FR3076709 B1 FR 3076709B1
Authority
FR
France
Prior art keywords
generating
head
user
orientation data
augmented reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
FR1850271A
Other languages
French (fr)
Other versions
FR3076709A1 (en
Inventor
Arnaud LENGLET
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Esthesix
Original Assignee
Esthesix
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Esthesix filed Critical Esthesix
Priority to FR1850271 priority Critical
Priority to FR1850271A priority patent/FR3076709B1/en
Priority claimed from PCT/FR2019/050042 external-priority patent/WO2019138186A1/en
Publication of FR3076709A1 publication Critical patent/FR3076709A1/en
Application granted granted Critical
Publication of FR3076709B1 publication Critical patent/FR3076709B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61FFILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
    • A61F9/00Methods or devices for treatment of the eyes; Devices for putting-in contact lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
    • A61F9/08Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B21/00Teaching, or communicating with, the blind, deaf or mute
    • G09B21/001Teaching or communicating with blind persons
    • G09B21/006Teaching or communicating with blind persons using audible presentation of the information
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Dispositif (1) porté par un utilisateur pour indiquer des informations sonores en réalité augmentée, comportant : une centrale inertielle (2) de tête, pour être portée par la tête de l'utilisateur et générer des données d'orientation (8) relatives à la direction de la tête; un dispositif de capture d'image (201) pour générer une image capturée (202) ; une unité centrale de traitement (4) pour : recevoir l'image capturée, l'analyser au moyen d'un réseau de neurones (204) pour reconnaître un ou plusieurs objets (10) y apparaissant, générer un espace virtuel et y placer plusieurs sources sonores virtuelles pour chacun des objets reconnus, recevoir les données d'orientation, et déterminer un signal binaural (11) reçu au niveau des oreilles de l'utilisateur résultant d'une émission sonore par les sources virtuelles placées dans l'espace virtuel orienté à partir des données d'orientation reçues, générer un signal audio (12), comportant le signal binaural déterminé; une unité d'écoute (5) pour restituer le signal audio généré et être portée au moins en partie par ladite tête.Device (1) worn by a user for indicating sound information in augmented reality, comprising: a head inertial unit (2), to be worn by the head of the user and generating orientation data (8) relating to the direction of the head; an image capturing device (201) for generating a captured image (202); a central processing unit (4) for: receiving the captured image, analyzing it by means of a neural network (204) to recognize one or more objects (10) appearing there, generating a virtual space and placing therein several virtual sound sources for each of the recognized objects, receiving the orientation data, and determining a binaural signal (11) received at the level of the user's ears resulting from a sound emission by the virtual sources placed in the oriented virtual space from the orientation data received, generating an audio signal (12), comprising the determined binaural signal; a listening unit (5) for reproducing the audio signal generated and being carried at least in part by said head.
FR1850271A 2018-01-12 2018-01-12 DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER Active FR3076709B1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
FR1850271 2018-01-12
FR1850271A FR3076709B1 (en) 2018-01-12 2018-01-12 DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
FR1850271A FR3076709B1 (en) 2018-01-12 2018-01-12 DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER
FR1872680A FR3076927B1 (en) 2018-01-12 2018-12-11 Improved device and method for communicating audio information to a user in augmented reality
PCT/FR2019/050042 WO2019138186A1 (en) 2018-01-12 2019-01-10 Improved device and method for communicating sound information to a user in augmented reality

Publications (2)

Publication Number Publication Date
FR3076709A1 FR3076709A1 (en) 2019-07-19
FR3076709B1 true FR3076709B1 (en) 2019-12-20

Family

ID=62017474

Family Applications (2)

Application Number Title Priority Date Filing Date
FR1850271A Active FR3076709B1 (en) 2018-01-12 2018-01-12 DEVICE AND METHOD FOR COMMUNICATING SOUND INFORMATION TO AN AUGMENTED REALITY USER
FR1872680A Active FR3076927B1 (en) 2018-01-12 2018-12-11 Improved device and method for communicating audio information to a user in augmented reality

Family Applications After (1)

Application Number Title Priority Date Filing Date
FR1872680A Active FR3076927B1 (en) 2018-01-12 2018-12-11 Improved device and method for communicating audio information to a user in augmented reality

Country Status (1)

Country Link
FR (2) FR3076709B1 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2831428B1 (en) * 2001-10-26 2004-09-03 Univ Compiegne Tech METHOD FOR ALLOWING AT LEAST ONE USER, PARTICULARLY A BLIND USER, TO PERCEIVE A SHAPE AND DEVICE FOR CARRYING OUT THE METHOD
KR20150008840A (en) * 2010-02-24 2015-01-23 아이피플렉 홀딩스 코포레이션 Augmented reality panorama supporting visually imparired individuals
US10339406B2 (en) * 2013-03-15 2019-07-02 Orcam Technologies Ltd. Apparatus and method for using background change to determine context
US20170286383A1 (en) * 2016-03-30 2017-10-05 Microsoft Technology Licensing, Llc Augmented imaging assistance for visual impairment

Also Published As

Publication number Publication date
FR3076709A1 (en) 2019-07-19
FR3076927A1 (en) 2019-07-19
FR3076927B1 (en) 2020-11-27

Similar Documents

Publication Publication Date Title
US10341545B2 (en) Wearable apparatus with wide viewing angle image sensor
US10084961B2 (en) Automatic generation of video from spherical content using audio/visual analysis
US10613823B2 (en) System and method for differentially locating and modifying audio sources
US10019774B2 (en) Authentication and validation of smartphone imagery
US9883396B2 (en) Context-related arrangements
US9942711B2 (en) Apparatus and method for determining co-location of services using a device that generates an audio signal
JP6239715B2 (en) System and method for transmitting information using image code
US20190325915A1 (en) Automatic generation of video and directional audio from spherical content
US9514370B1 (en) Systems and methods for automated 3-dimensional (3D) cloud-based analytics for security surveillance in operation areas
JP2020504360A (en) Face activity detection method and apparatus, and electronic device
US9516281B1 (en) Systems and methods for automated cloud-based analytics for security surveillance systems with mobile input capture devices
JP6030240B2 (en) Method and apparatus for face recognition
EP2887697B1 (en) Method of audio signal processing and hearing aid system for implementing the same
WO2015188620A1 (en) Method, device, and system for obtaining information based on audio input
US9560323B2 (en) Method and system for metadata extraction from master-slave cameras tracking system
US9246543B2 (en) Smart audio and video capture systems for data processing systems
US9426428B2 (en) Systems and methods for automated cloud-based analytics and 3-dimensional (3D) display for surveillance systems in retail stores
KR102189205B1 (en) System and method for generating an activity summary of a person
US8314854B2 (en) Apparatus and method for image recognition of facial areas in photographic images from a digital camera
US10659908B2 (en) System and method to capture image of pinna and characterize human auditory anatomy using image of pinna
AU2016200905A1 (en) A system and method for identifying and analyzing personal context of a user
JP2015512589A (en) Method and apparatus for authenticating video content
US20150070506A1 (en) Event triggered location based participatory surveillance
EP2867849B1 (en) Performance analysis for combining remote audience responses
US8682934B2 (en) Metadata generating apparatus, information processing apparatus, imaging apparatus, video conference system, security system, method of generating metadata, and program

Legal Events

Date Code Title Description
PLFP Fee payment

Year of fee payment: 2

PLSC Search report ready

Effective date: 20190719

PLFP Fee payment

Year of fee payment: 3

PLFP Fee payment

Year of fee payment: 4