WO2022149825A1 - Dispositif électronique et procédé de rendu sonore de dispositif électronique - Google Patents

Dispositif électronique et procédé de rendu sonore de dispositif électronique Download PDF

Info

Publication number
WO2022149825A1
WO2022149825A1 PCT/KR2022/000068 KR2022000068W WO2022149825A1 WO 2022149825 A1 WO2022149825 A1 WO 2022149825A1 KR 2022000068 W KR2022000068 W KR 2022000068W WO 2022149825 A1 WO2022149825 A1 WO 2022149825A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
sensor
information
sound
moving means
Prior art date
Application number
PCT/KR2022/000068
Other languages
English (en)
Korean (ko)
Inventor
김진익
박남준
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Publication of WO2022149825A1 publication Critical patent/WO2022149825A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • H04S7/303—Tracking of listener position or orientation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091—Details not provided for in groups H04R1/1008 - H04R1/1083
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00—Details of connection covered by H04R, not provided for in its groups
    • H04R2420/07—Applications of wireless loudspeakers or wireless microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/11—Application of ambisonics in stereophonic audio systems

Definitions

  • the processor 220 loads a command or data received from another component (eg, the sensor module 260 or the communication circuit 290 ) into volatile memory and , may process commands or data stored in the volatile memory, and store the resulting data in the non-volatile memory.
  • the second electronic device 201 may include a volatile memory and/or a non-volatile memory coupled to the processor 220 .
  • the gyro sensor 265 may include a circuit (eg, an integrated circuit, IC) that controls the operation of the gyro sensor 265 .
  • a circuit eg, an integrated circuit, IC
  • the battery 282 may supply power to at least one component of the second electronic device 201 .
  • battery 282 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, and/or a fuel cell.
  • the external power source may be connected to the second electronic device 201 by wire through, for example, a connector pin, or may be connected wirelessly through an antenna included in the communication circuit 290 .
  • the communication circuit 290 may include an antenna module.
  • the antenna module of the communication circuit 290 may transmit or receive a signal and/or power to the outside (eg, an external electronic device).
  • the antenna module of the communication circuit 290 may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the networks 198a , 198b , and 198c may be selected from the plurality of antennas by the communication circuit 290 .
  • the first electronic device 101 may detect a boarding state of a vehicle.
  • the first electronic device 101 may detect the gait of the user of the first electronic device 101 using sensors included in the sensor module 176 included in the first electronic device 101 . . If the first electronic device 101 detects the user's gait using the sensor module 176 and the user's gait is not detected while riding on the moving means, it is determined that the first electronic device 101 has boarded the moving means. can do. The first electronic device 101 detects the user's gait by using the sensor module 176, and when it is detected that the user rides on the moving means and moves at a speed higher than a certain speed, the first electronic device 101 detects the user's walking on the moving means. can be judged as
  • the first electronic device 101 receives a wireless communication connection request with the second electronic device 201 according to a user input in operation 403 under the control of the processor 120 , the second electronic device 201 . ) and a wireless communication connection, and control to drive the sensor module 260 of the second electronic device 201 based on the communication connection.
  • the first electronic device 101 is the first electronic device 101 based on sensor information collected from the sensor module 176 of the first electronic device 101 and the sensor module 260 of the second electronic device 201 . ) and/or motion information of the second electronic device 201 and posture information of the moving means may be determined.
  • the first electronic device 101 under the control of the processor 120 , in operation 407 , based on the sensor information of the first electronic device 101 and the sensor information of the second electronic device 201 , Motion information of the first electronic device 101 and the second electronic device 201 ) and posture information of the moving means may be acquired.
  • the acceleration of the first electronic device 101 and/or the second electronic device 201 using the acceleration sensor of the first electronic device 101 and/or the acceleration sensor of the second electronic device 201 is It may be the same as Equation (1).
  • Equations 3 and 4 the pitch attitude angle ⁇ and/or the roll attitude angle ⁇ of the first electronic device 101 and/or the second electronic device 201 are obtained by Equations 3 and 4 can be the same as
  • the first electronic device 101 renders a sound based on the motion information and the posture information and transmits the sound to the second electronic device 201 through the communication module 190 . can be transmitted
  • the first electronic device 101 may calculate a quaternion of the first electronic device 101 based on sensor data obtained from the acceleration sensor and the gyro sensor of the first electronic device 101 . have.
  • the quaternion of the first electronic device 101 may be equal to Equation 6 as Q1.
  • the quaternion of the second electronic device 201 is Q2, and may be expressed in Equation (7).
  • the first electronic device 101 When the first electronic device 101 detects rotation of the moving means under the control of the processor 120 , the first electronic device 101 may branch from operation 505 to operation 507 .
  • the first electronic device 101 may check the orbital similarity between the first electronic device 101 and the second electronic device 201 in operation 507 under the control of the processor 120 .
  • the first electronic device 101 may determine whether it is in a state of orbiting with the second electronic device 201 .
  • the first electronic device 101 and/or the second electronic device 201 are in an idle state. It can be judged that there is
  • the first electronic device 101 may branch from operation 509 to operation 507 .
  • the first electronic device 101 may check motion information of the electronic devices in operation 511 under the control of the processor 120 .
  • the first electronic device 101 may check motion information of the first electronic device 101 and/or the second electronic device 201 in operation 511 under the control of the processor 120 . .
  • the roll, pitch, and yaw attitude values of the first electronic device 101 and/or the second electronic device 201 are determined by the first electronic device 101 and/or the second electronic device 201 ( 201) may be motion information.
  • the first electronic device 101 may branch from operation 513 to operation 511 .
  • the first electronic device 101 detects the rotation of the moving means based on the posture information in operation 515 under the control of the processor 120 , and renders a sound based on the motion information to the second electronic device 201 , in operation 515 .
  • the first electronic device 101 under the control of the processor 120 , in operation 515 , detects rotation of the moving means and the first electronic device 101 and/or the second electronic device 201 .
  • the sound may be rendered and transmitted to the second electronic device 201 to correspond to the relative position and/or direction of the .
  • the first electronic device 101 renders a sound having a three-dimensional effect based on the motion information and the posture information in operation 515 under the control of the processor 120 to provide the sound to the second electronic device 201 .
  • the second electronic device 201 may include a stereo speaker or a multi-channel speaker.
  • the first electronic device 101 under the control of the processor 120 , in operation 515 , based on the motion information and the posture information, a second electronic device including a stereo speaker or a multi-channel speaker A sound giving a three-dimensional effect may be rendered by outputting a different sound for each speaker of the device 201 , and the rendered sound may be transmitted to the second electronic device 201 through the communication module 190 .
  • the sound channel may be divided into two channels, namely, the first earbud 2011/the second earbud 2012 .
  • the electronic device 101 may render a sound to output different sounds to the first earbud 2011 and the second earbud 2012 .
  • a sound rendered by the first electronic device 101 is listened to by the second electronic device 201 is assumed as follows.
  • the sound output from the earbuds 2011 and 2012 corresponding to the direction in which the specific object moves away from the sound direction may be reduced.
  • a sound output from the earbuds 2011 and 2012 corresponding to a direction in which a specific object approaches a sound direction may be increased.
  • the moving means 601 may rotate during path movement.
  • the first electronic device 101 and the second electronic device 201 positioned in the moving means 601 use respective acceleration sensors and/or gyro sensors to yaw, pitch, and roll. ) axis sensor data can be detected.
  • the first electronic device 101 and the second electronic device 201 calculate similar rotation angles as posture information.
  • the first electronic device 101 determines that the first electronic device 101 and/or the second electronic device 201 are in an idle state. can do.
  • FIG. 8 is a diagram illustrating a case in which the first electronic device 101 and a plurality of external electronic devices 201 and 301 are located in the moving means 601 according to various embodiments of the present disclosure.
  • the electronic device (eg, the first electronic device 101 ) includes a sensor module 176 ; display module 160; communication module 190; and a processor 120 , wherein the processor 120 detects a boarding condition of the moving means, and a sensor of the sensor module 176 and a hearable device (eg, the second electronic device 201 ).
  • the processor 120 when the processor 120 detects a proximity recognition signal set by the mobile means as a geo-fence through the communication module 190 , it may determine that the mobile device has been boarded.
  • the processor 120 may determine that the user has boarded the moving means.
  • the processor 120 is configured to configure the electronic device (eg, the first electronic device 101) and/or the hearable device (eg, the hearable device) based on the first sensor information and the second sensor information.
  • the motion information may be acquired by using the measurement value of the amount of change in the angular velocity of the roll, yaw, and pitch axes of the second electronic device 201).
  • the processor 120 generates a sound to correspond to the relative position and/or relative direction of the hearable device (eg, the second electronic device 201 ) based on the motion information and/or the posture information. can be rendered.
  • a sound rendering method of an electronic device includes: detecting a riding situation in a moving means; Controlling the sensor module 176 of the electronic device (eg, the first electronic device 101) and the sensor module 260 of the hearable device (eg, the second electronic device 201) to be driven ; receiving first sensor information of the hearable device (eg, the second electronic device 201) from the hearable device (eg, the second electronic device 201); The electronic device (eg, the first electronic device 101) and the hearable device (eg, the hearable device) based on the first sensor information and the second sensor information of the electronic device (eg, the first electronic device 101) acquiring motion information of the second electronic device (201) and posture information of the moving means; and rendering a sound based on the posture information and the motion information, and transmitting the sound to the hearable device (eg, the second electronic device 201) through the communication module 190.
  • the electronic device eg, the first electronic device 101 and the hearable device (eg, the hearable device) based on the first sensor
  • the sensing of the riding condition of the moving means includes detecting whether the user is walking by using the sensor module 176 of the electronic device (eg, the first electronic device 101), and When stopping and moving at a specific speed or more is sensed or a vibration pattern according to boarding conditions is sensed, it may include an operation of determining that the person has boarded the moving means.
  • the acquiring operation is based on the first sensor information and the second sensor information, and the electronic device (eg, the first electronic device 101) and/or the hearable device (eg, the second sensor information)
  • the method may further include an operation of acquiring the motion information by using the measurement value of the amount of change in angular velocity of the roll, yaw, and pitch axes of the second electronic device 201).
  • the acquiring operation is to acquire a quaternion angle based on the first sensor information and the second sensor information, and if the quaternion angle or a change in the angle is within a certain range, the hearable device (eg , determining that the second electronic device 201) and the electronic device (eg, the first electronic device 101) revolve.
  • the operation of transmitting the sound to the hearable device further includes an operation of rendering the sound so that a sound having a three-dimensional effect can be output based on the motion information.
  • the operation of transmitting the sound to the hearable device is performed by the hearable device (eg, the second electronic device 201) based on the motion information and/or the posture information. rendering the sound to correspond to the relative position and/or relative orientation of the device 201).
  • first, second, or first or second may simply be used to distinguish an element from other elements in question, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101).
  • a storage medium eg, internal memory 136 or external memory 138
  • a machine eg, electronic device 101
  • the processor eg, the processor 120
  • the device eg, the electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • the method according to various embodiments disclosed in this document may be provided as included in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones).
  • a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. , or one or more other operations may be added.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Telephone Function (AREA)

Abstract

Un dispositif électronique peut comprendre : un module de capteur ; un module d'affichage ; un module de communication ; et un processeur, le processeur détectant une situation d'embarquement d'un moyen de transport, commandant le module de capteur et un module de capteur d'un dispositif d'écoute de telle sorte que celui-ci est actionné, reçoit des premières informations de capteur du dispositif d'écoute en provenance du dispositif d'écoute par l'intermédiaire du module de communication, obtient des informations de mouvement sur le dispositif électronique et le dispositif d'écoute et des informations de posture sur le moyen de transport sur la base des premières informations de capteur et des secondes informations de capteur du module de capteur, restitue un son sur la base des informations de posture et des informations de mouvement, et transmet le son au dispositif d'écoute par l'intermédiaire du module de communication.
PCT/KR2022/000068 2021-01-06 2022-01-04 Dispositif électronique et procédé de rendu sonore de dispositif électronique WO2022149825A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2021-0001508 2021-01-06
KR1020210001508A KR20220099362A (ko) 2021-01-06 2021-01-06 전자 장치 및 전자 장치의 사운드 렌더링 방법

Publications (1)

Publication Number Publication Date
WO2022149825A1 true WO2022149825A1 (fr) 2022-07-14

Family

ID=82358018

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/000068 WO2022149825A1 (fr) 2021-01-06 2022-01-04 Dispositif électronique et procédé de rendu sonore de dispositif électronique

Country Status (2)

Country Link
KR (1) KR20220099362A (fr)
WO (1) WO2022149825A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006287730A (ja) * 2005-04-01 2006-10-19 Alpine Electronics Inc オーディオ装置
KR20110128857A (ko) * 2009-02-13 2011-11-30 코닌클리케 필립스 일렉트로닉스 엔.브이. 이동 애플리케이션을 위한 헤드 트래킹
KR20170053058A (ko) * 2015-11-05 2017-05-15 엘지전자 주식회사 이어셋 장치 및 그 장치의 제어 방법
JP2018110366A (ja) * 2017-01-04 2018-07-12 伊藤　和幸 ３ｄサウンド映像音響機器
WO2019015954A1 (fr) * 2017-07-19 2019-01-24 Sony Corporation Procédé, dispositif et système de génération de champs sonores spatiaux

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006287730A (ja) * 2005-04-01 2006-10-19 Alpine Electronics Inc オーディオ装置
KR20110128857A (ko) * 2009-02-13 2011-11-30 코닌클리케 필립스 일렉트로닉스 엔.브이. 이동 애플리케이션을 위한 헤드 트래킹
KR20170053058A (ko) * 2015-11-05 2017-05-15 엘지전자 주식회사 이어셋 장치 및 그 장치의 제어 방법
JP2018110366A (ja) * 2017-01-04 2018-07-12 伊藤　和幸 ３ｄサウンド映像音響機器
WO2019015954A1 (fr) * 2017-07-19 2019-01-24 Sony Corporation Procédé, dispositif et système de génération de champs sonores spatiaux

Also Published As

Publication number Publication date
KR20220099362A (ko) 2022-07-13

Similar Documents

Publication Publication Date Title
WO2022097862A1 (fr) Procédé de commande d'affichage et dispositif électronique prenant en charge ledit procédé
WO2022154373A1 (fr) Procédé pour déterminer la posture d'un utilisateur en utilisant un capteur d'accélération d'un dispositif électronique habitronique, et dispositif électronique associé
WO2021118120A1 (fr) Dispositif électronique comprenant une structure de collecte d'énergie
WO2022045490A1 (fr) Procédé de fourniture d'entrée tridimensionnelle et dispositif électronique de prise en charge associé
WO2023022567A1 (fr) Dispositif électronique pliable et procédé de commande d'un dispositif électronique pliable à l'aide d'un capteur hall numérique
WO2022154440A1 (fr) Dispositif électronique de traitement de données audio, et procédé d'exploitation associé
WO2022149825A1 (fr) Dispositif électronique et procédé de rendu sonore de dispositif électronique
WO2022145914A1 (fr) Procédé pour trouver un dispositif de sortie audio à l'aide d'un dispositif d'alimentation de puissance et son dispositif d'alimentation de puissance
WO2022055319A1 (fr) Dispositif électronique permettant de délivrer un son et son procédé de fonctionnement
WO2022154349A1 (fr) Procédé de commande de dispositif électronique sur la base de la capacité de batterie restante, et dispositif électronique associé
WO2024072003A1 (fr) Dispositif électronique comprenant une pluralité de batteries et son procédé de fonctionnement
WO2023013950A1 (fr) Procédé de charge sans fil et appareil le prenant en charge
WO2023043035A1 (fr) Dispositif électronique et procédé de commande d'au moins un dispositif pouvant être porté, et support de stockage lisible par ordinateur non transitoire
WO2023146104A1 (fr) Procédé de fourniture de guide de recharge sans fil et dispositif électronique effectuant celui-ci
WO2023085848A1 (fr) Procédé de commande de signal et dispositif portatif le prenant en charge
WO2023121215A1 (fr) Dispositif électronique pour commander l'état de charge de la batterie d'un dispositif électronique externe, et son procédé de fonctionnement
WO2023128208A1 (fr) Dispositif électronique pouvant être monté sur la tête d'un utilisateur, et procédé pour fournir une fonction à l'aide d'informations biométriques dans le même dispositif électronique
WO2024106749A1 (fr) Dispositif électronique, procédé d'identification d'une priorité de connexion et support de stockage non transitoire lisible par ordinateur
WO2024053869A1 (fr) Dispositif électronique et son procédé de chargement
WO2023106640A1 (fr) Dispositif électronique, et procédé pour empêcher une reconnaissance erronée d'un geste dans un dispositif électronique
WO2023096363A1 (fr) Dispositif électronique comprenant un dispositif d'authentification biométrique
WO2023277364A1 (fr) Dispositif électronique utilisant une communication bluetooth et procédé associé de fonctionnement
WO2023068582A1 (fr) Bobine de charge sans fil et dispositif électronique la comprenant
WO2023063593A1 (fr) Dispositif électronique et système de positionnement déterminant un canal pour réaliser un système de positionnement en intérieur (ips)
WO2024106907A1 (fr) Dispositif électronique et procédé de détection d'exercice d'un utilisateur

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22736802

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22736802

Country of ref document: EP

Kind code of ref document: A1