CN111698638A - 3D sense of hearing dimension data controller - Google Patents

3D sense of hearing dimension data controller Download PDF

Info

Publication number
CN111698638A
CN111698638A CN202010705175.8A CN202010705175A CN111698638A CN 111698638 A CN111698638 A CN 111698638A CN 202010705175 A CN202010705175 A CN 202010705175A CN 111698638 A CN111698638 A CN 111698638A
Authority
CN
China
Prior art keywords
axis
data controller
auditory
bluetooth module
dimensional data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010705175.8A
Other languages
Chinese (zh)
Inventor
李马科
陶陌
郑伯洪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202010705175.8A priority Critical patent/CN111698638A/en
Publication of CN111698638A publication Critical patent/CN111698638A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/302—Electronic adaptation of stereophonic sound system to listener position or orientation
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/20—Pc systems
    • G05B2219/25—Pc structure of the system
    • G05B2219/25033—Pc structure of the system structure, control, syncronization, data, alarm, connect I-O line to interface

Abstract

The invention discloses a 3D auditory dimension data controller which comprises a main control chip, wherein the main control chip is provided with a nine-axis sensor, a Bluetooth module and a MIDI protocol communication module, the nine-axis sensor is connected with the Bluetooth module, the displacement change between axes is collected through the nine-axis sensor, and meanwhile, data transmission is carried out through Bluetooth. In the data transmission process, data are required to be converted into MIDI protocols, then the data are transmitted to an audio platform of an upper computer through BLE protocols of Bluetooth, and therefore the 3D dimensionality of the whole audio is adjusted in real time, so that the sound quality experience of people in a sound field can not be changed no matter how the people move or slightly rotate in the sound field.

Description

3D sense of hearing dimension data controller
Technical Field
The invention relates to the field of 3D audio related products, in particular to a 3D auditory dimension data controller.
Background
3D audio is mentioned, everybody can think that it has the characteristics of immersive sensation and telepresence at first, because 3D audio technology has expanded listening area and dimension, not only make the binaural change into plane surround sound, but also increased the sound image localization of vertical direction, make immersive sensation and telepresence effect greatly strengthen. With the emergence of virtual reality technologies such as AR and VR, the 3D audio technology is growing up rapidly, and great innovation is brought to the fields such as movies, games and live broadcasting.
3D audio has two important objective factors, localization and interaction. The positioning enables people to accurately judge the position of sound, and the positioning can be completed by recording the sound and then decoding the sound. The real-time subdivision is interaction, and the position of the sound is determined according to the auditory sense of people. Modern people have tried various efforts to build up realistic appeal and realistic sound reality. At the beginning, people paid great attention to how the direction of the sound stage is better reflected, so the term "vocal tract" is used. Originally, only a single sound channel (Mono) is generated, namely, sound is generated by only one sound box, and listeners can obviously feel that the sound is generated from the position where the sound box is arranged, so that the performance capability of the system is limited. After people listen to mono, Stereo (Stereo) has been produced, which uses two separate channel recordings and requires a pair of speakers to accomplish the playback task. By adjusting the volume of the sound boxes, people can mistakenly think that the sound source originates from between the two sound boxes, and subdivision is accurate. Unfortunately, their drawbacks are all significant, that is, they require the sound boxes to be placed reasonably, otherwise they directly affect the lyric of the sound. At this point, extended stereo (extendedstreeo) has been reduced, which is well handled by certain algorithms for sound expansion in a two-enclosure system, which has a larger side lining for two enclosures placed closer together. Later, four-channel (Quadraphonics), Surround-Sound (Surround-Sound), and Interactive 3D Audio (Interactive 3D Sound effect) have appeared.
In recent years, 3D audio and laboratories are in the beginning stage. And both mainly surround both the input system and the playback system. But through the understanding of the international form, for example, an AIVR movie unit is added for the first time in the gold bear prize of Berlin in 2019; AI mixing and other research directions are developed in birmingham university, joke university and london university. The international form exactly reflects the necessity of realizing the trend direction of science and technology, talents and the country in the current development strategy of China.
Disclosure of Invention
The invention aims to provide a 3D auditory dimension data controller, which aims to solve the problem that if a person generates displacement in a sound field, namely the position changes, the position of a sound source changes relatively, so that the quality of sound heard by people changes. In fact, not only people can change under the condition of displacement, but also when the head of people rotates or slightly shifts, the whole sound effect can generate a slight change problem.
In order to achieve the purpose, the invention provides the following technical scheme: the utility model provides a 3D sense of hearing dimension data controller, includes main control chip, be equipped with nine sensors, bluetooth module and MIDI agreement communication module on the main control chip, nine sensors are connected with bluetooth module.
Preferably, the nine-axis sensor is combined by a three-axis accelerometer, a three-axis gyroscope and a three-axis magnetometer.
Preferably, the nine-axis sensor model is MPU 9250.
Preferably, the bluetooth module is in a version of 4.0 or more.
Preferably, the bluetooth module is of model NRF 52832.
Preferably, the bluetooth module needs to convert the detected data into a MIDI protocol and send the MIDI protocol to the MIDI protocol communication module, then the BLE protocol passing through the bluetooth module is transmitted to the upper computer, and the host of the upper computer learns the data and controls the change of the 3D dimension of the audio platform through the MIDI protocol communication module.
Preferably, the main control chip is NRF 52832.
Preferably, the 3-axis gyroscope, the 3-axis accelerometer and the 3-axis magnetometer output digital quantities of 16 bits.
Preferably, the MIDI protocol of the bluetooth module BLE is designed by apple inc in 2014, and the BLE MIDI protocol is set as a technical standard by MMA team members in 2015 at 6 months.
Preferably, the three-axis magnetometer adopts a high-flexibility Hall type sensor to acquire data.
Compared with the prior art, the invention has the beneficial effects that:
this 3D sense of hearing dimension data controller proposes to gather the displacement change between the axle through nine sensors, carries out data transmission through the bluetooth simultaneously. In the data transmission process, data are required to be converted into MIDI protocols, then the data are transmitted to an audio platform of an upper computer through BLE protocols of Bluetooth, and therefore the 3D dimensionality of the whole audio is adjusted in real time, so that the sound quality experience of people in a sound field can not be changed no matter how the people move or slightly rotate in the sound field.
Drawings
FIG. 1 is a schematic flow chart of the present invention;
FIG. 2 is a circuit diagram of the Bluetooth signal connection of the present invention;
FIG. 3 is a flow chart of the nine-axis sensor of the present invention for detecting angular changes;
FIG. 4 is a control flow diagram of the Bluetooth module of the present invention;
FIG. 5 is a circuit diagram of the peripheral circuit of the main control chip according to the present invention;
FIG. 6 is a block peripheral circuit diagram of the present invention;
FIG. 7 is a schematic view of the nine-axis sensor detection axis and its orientation according to the present invention;
FIG. 8 is a nine axis sensor circuit diagram of the present invention;
FIG. 9 is a system power supply circuit diagram of the present invention;
FIG. 10 is a wireless circuit diagram of the remote controller of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Referring to fig. 1-10, an embodiment of the present invention is shown: the utility model provides a 3D sense of hearing dimension data controller, includes main control chip, last nine sensors, bluetooth module and the MIDI agreement communication module of being equipped with of main control chip, nine sensors are connected with bluetooth module, and LED5 is as bluetooth signal connection pilot lamp as shown in FIG. 5, and the LED pilot lamp is often bright after the bluetooth is shaken hands and is connected. LED4 indicates current angle when having the angle change as nine-axis gyroscope, and when having the angle change, LED4 scintillation, this design board carries a button on board, returns to zero the signal as the gyroscope when the button is pressed.
Furthermore, the nine-axis sensor is combined by a three-axis accelerometer, a three-axis gyroscope and a three-axis magnetometer, data interaction can be carried out between the nine-axis sensor and the single chip microcomputer through an integrated circuit bus (IIC) interface, and the transmission rate can reach 400 kHz/s. The angular velocity measuring range of the gyroscope can reach +/-2000 (DEG/s) at most, and the gyroscope has good dynamic response characteristics. The maximum measurement range of the accelerometer is +/-16 g (g is gravity acceleration), and the static measurement precision is high.
Furthermore, the model of the nine-axis sensor is MPU9250, and a hardware acceleration engine of a Digital Motion Processor (DMP) of the MPU9250 can integrate the nine-axis sensor data and output complete 9-axis fusion operation data to an application terminal. With the DMP, we can use the Motion Processing Library (MPL) provided by InvenSense company to realize the attitude solution very conveniently, as shown in FIG. 6; the I2C operation mode is used to read the DMP data of the MPU 9250. The MPU9250 circuit is shown in FIG. 7; the MPU9250 has high requirements on power supply filtering and is easily influenced by voltage fluctuation, so three ceramic chip capacitors are adopted to weld the MPU9250, the overall performance reaches the initial ideal state at present, the lithium battery is adopted for supplying power to the system, the voltage range of the lithium battery is 3.0-4.2V, but the voltage range of the MPU9250 and the power supply voltage range of the Bluetooth module are relatively smaller, 1 LDO is adopted as voltage reduction to provide stable power supply for the whole system, and a power supply circuit is shown in fig. 9.
Furthermore, the bluetooth module is a version of more than 4.0, and because the system needs to support the MIDI protocol, the bluetooth chip must be more than 4.0 according to the MIDI protocol requirement.
Further, the bluetooth module adopts model NRF 52832.
Further, the bluetooth module needs to convert the detected data into the MIDI protocol and send the MIDI protocol to the communication module, then the BLE protocol through the bluetooth module is transmitted to the upper computer, and the host computer learns the data, controls the change of the 3D dimension of the audio platform through the MIDI protocol communication module.
Further, the main control chip is NRF52832 and supports BLE4.2 and BLE5.0 maximum transmitting power of 2.5mW, the software multistage adjustable built-in 32.768Khz clock crystal oscillator supports resources rich in a high-performance low-power-consumption Cortex-M4F core processor built in a global unlicensed ISM 2.4Ghz frequency band, 512Kb FLASH and 64Kb RAM support 2.0-3.6V power supply, the best-performance industrial standard design can be guaranteed when the power supply is larger than 3.3V power supply, the communication distance can reach 100M under the ideal condition of long-time use at the temperature of minus 40 to plus 85 ℃, and the design of peripheral circuits is shown in figure 4.
Further, the output of the 3-axis gyroscope, the output of the 3-axis accelerometer and the output of the 3-axis magnetometer are all 16-bit digital quantities.
Further, the MIDI protocol of the bluetooth module BLE is designed by apple inc in 2014, and the MMA team member sets the technical standard BLE MIDI protocol in 2015 at 6 months.
Furthermore, the three-axis magnetometer adopts a high-flexibility Hall type sensor to acquire data.
Firstly, Bluetooth detects whether data of a nine-axis sensor MPU9250 changes, when the position between axes of the sensor data changes, for example, the displacement in the X-axis direction occurs, the displacement data is sensed by a triaxial accelerometer of the sensor, and the triaxial accelerometer has integral accumulated errors, so the data is corrected by a magnetometer; and accurately confirming the displacement condition in the three-axis direction. When the displacement condition is detected, the displacement data is sent through the Bluetooth and fed back to the upper computer. Simultaneously carrying out next detection, and if the displacement does not change, carrying out cyclic detection, wherein the specific flow is shown in fig. 1;
secondly, a detection process of detecting angle change by a nine-axis sensor and a data conversion process are carried out, the sensor needs to be initialized before detection is started, an initial axis is determined, then the axis is fixed, the 3D audio dimension takes the angle as initial data, then the change condition of the detected angle is started, when the angle changes, the sensor obtains the change data through a DMP module, then filtering of a numerical mean value is carried out, the Euler angle which is wanted by people is finally obtained, the angle is limited, and the brief process is shown in figure 2;
finally, the Bluetooth module is controlled, firstly, the Bluetooth is initialized, then MIDI service is created, namely a conversion protocol is created, and data is converted into the MIDI protocol; then starting the broadcast of the Bluetooth, so that the Bluetooth is started and is allowed to be connected; then, starting to judge whether the Bluetooth is correctly connected with the host or not, namely 'handshaking' in the program; when the connection is detected to be successful, judging whether the MIDI service is correct, if so, starting to learn data, and finally controlling the action of the platform through the MIDI protocol, otherwise, returning to continue judging; the circulation is carried out, and the flow is shown in FIG. 3;
the system needs a remote controller as the distance and volume adjustment of the sound field, and the design is a head-wearing device, so that the control switch is not convenient to integrate in the device, and a wireless communication mode is also adopted, wherein the 433M wireless communication mode is adopted, a signal is received by a receiving chip, a key code is decrypted by a decoding chip and then a key instruction is sent to a singlechip, and a 433 wireless circuit is shown in figure 10;
several angles for a nine-axis sensor. First, euler's angle, which is a set of three independent angular parameters used to uniquely define the position of a fixed-point rotational rigid body, should be composed of nutation angle θ, precession angle ψ, and rotation angle Φ, which is given first for l. With the euler angle, the following, roll angle can be determined. For the pitch angle and the heading angle, a right-handed system is generally defined by the right direction, the rear direction and the upper direction of the carrier, the translation of a main shaft staring forward is a roll angle, the rotation of the main shaft staring to the right side is the pitch angle, and the rotation of the main shaft staring upward is the heading angle. Pitch angle: and the included angle between the X main shaft of the machine body coordinate system and the horizontal plane. When the positive semi-axis of the X main shaft is arranged on a horizontal plane passing through the origin of coordinates, the pitch angle is positive, and according to behavior habits, the range of the pitch angle theta is as follows: phi/2 is more than or equal to theta and less than or equal to phi/2.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (10)

1. The utility model provides a 3D sense of hearing dimension data controller, includes main control chip, its characterized in that: the master control chip is provided with a nine-axis sensor, a Bluetooth module and a MIDI protocol communication module, and the nine-axis sensor is connected with the Bluetooth module.
2. A 3D auditory dimensional data controller according to claim 1, characterized by: the nine-axis sensor is combined by a three-axis accelerometer, a three-axis gyroscope and a three-axis magnetometer.
3. A 3D auditory dimensional data controller according to claim 1, characterized by: the model of the nine-axis sensor is MPU 9250.
4. A 3D auditory dimensional data controller according to claim 1, characterized by: the Bluetooth module is more than 4.0.
5. A 3D auditory dimensional data controller according to claim 1, characterized by: the Bluetooth module adopts a model NRF 52832.
6. A 3D auditory dimensional data controller according to claim 1, characterized by: the Bluetooth module needs to convert detected data into a MIDI protocol to be sent to the MIDI protocol communication module, then a BLE protocol of the Bluetooth module is transmitted to the upper computer, and the host of the upper computer learns the data and controls the 3D dimensionality change of the audio platform through the MIDI protocol communication module.
7. A 3D auditory dimensional data controller according to claim 1, characterized by: the main control chip is NRF 52832.
8. A 3D auditory dimensional data controller according to claim 2, characterized by: the outputs of the 3-axis gyroscope, the 3-axis accelerometer and the 3-axis magnetometer are all 16-bit digital quantities.
9. The 3D auditory dimensional data controller of claim 6, wherein: the MIDI protocol of the bluetooth module BLE is designed by apple company in 2014, and the MMA team member enters the technical standard BLEMIDI protocol in 2015 at 6 months.
10. A 3D auditory dimensional data controller according to claim 2, characterized by: the three-axis magnetometer adopts a high-flexibility Hall sensor to acquire data.
CN202010705175.8A 2020-07-21 2020-07-21 3D sense of hearing dimension data controller Pending CN111698638A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010705175.8A CN111698638A (en) 2020-07-21 2020-07-21 3D sense of hearing dimension data controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010705175.8A CN111698638A (en) 2020-07-21 2020-07-21 3D sense of hearing dimension data controller

Publications (1)

Publication Number Publication Date
CN111698638A true CN111698638A (en) 2020-09-22

Family

ID=72486653

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010705175.8A Pending CN111698638A (en) 2020-07-21 2020-07-21 3D sense of hearing dimension data controller

Country Status (1)

Country Link
CN (1) CN111698638A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070079692A1 (en) * 2005-10-12 2007-04-12 Phonak Ag MIDI-compatible hearing device
CN205566613U (en) * 2016-04-19 2016-09-07 杨涛 Active intelligent thing networking audio amplifier
US20180188850A1 (en) * 2016-12-30 2018-07-05 Jason Francesco Heath Sensorized Spherical Input and Output Device, Systems, and Methods
CN110610692A (en) * 2018-06-14 2019-12-24 古怪工作室有限公司 Interactive percussion device for acoustic applications

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070079692A1 (en) * 2005-10-12 2007-04-12 Phonak Ag MIDI-compatible hearing device
CN205566613U (en) * 2016-04-19 2016-09-07 杨涛 Active intelligent thing networking audio amplifier
US20180188850A1 (en) * 2016-12-30 2018-07-05 Jason Francesco Heath Sensorized Spherical Input and Output Device, Systems, and Methods
CN110610692A (en) * 2018-06-14 2019-12-24 古怪工作室有限公司 Interactive percussion device for acoustic applications

Similar Documents

Publication Publication Date Title
EP4246217A1 (en) Connecting assembly for a wearable device, wearable device, and wearable apparatus
US10397728B2 (en) Differential headtracking apparatus
CN102316394B (en) Bluetooth equipment and audio playing method using same
CN205563457U (en) Virtual reality's portable host computer, virtual reality helmet and system
EP3884651B1 (en) Different head detection in headphones
JP5325946B2 (en) Method of communication using portable electronic device and accessory device
EP2200349B1 (en) Information processing system and information processing method
WO2021077923A1 (en) Method of controlling display device, and portable device
CN108432272A (en) How device distributed media capture for playback controls
CN107182011B (en) Audio playing method and system, mobile terminal and WiFi earphone
US11720317B2 (en) Electronic device and method for controlling buffer
US11894917B2 (en) Method and apparatus for time synchronization between head-mounted device and peripheral device
US20140062842A1 (en) Display device
CN105872928B (en) A kind of method and system that the virtual surround sound based on mobile terminal generates
WO2022100258A1 (en) Wearing assembly for wearable device, and wearable device
CN111698638A (en) 3D sense of hearing dimension data controller
CN211904161U (en) Portable gesture detection device
CN204347758U (en) Body sense bracelet tutoring system
CN113472943B (en) Audio processing method, device, equipment and storage medium
CN113099373B (en) Sound field width expansion method, device, terminal and storage medium
CN113063417A (en) Control method based on foot posture interaction
CN108260115A (en) Bluetooth equipment position information processing method, device, terminal device and storage medium
US10659905B1 (en) Method, system, and processing device for correcting energy distributions of audio signal
CN105307086A (en) Method and system for simulating surround sound for two-channel headset
CN219876045U (en) Audio control circuit and earphone

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200922

WD01 Invention patent application deemed withdrawn after publication