CN212749771U

CN212749771U - Information processing system based on audio wearable equipment

Info

Publication number: CN212749771U
Application number: CN202021848400.5U
Authority: CN
Inventors: 柳江; 彭轩
Original assignee: Shenzhen Miaoyan Technology Co ltd
Current assignee: Shenzhen Miaoyan Technology Co ltd
Priority date: 2020-08-27
Filing date: 2020-08-27
Publication date: 2021-03-19
Anticipated expiration: 2030-08-27

Abstract

The utility model relates to the technical field of audio equipment control, in particular to an information processing system based on audio wearable equipment, which comprises the audio wearable equipment and an audio processing device in communication connection with the audio wearable equipment, wherein the audio wearable equipment comprises a sensor module for detecting the motion state of a user, a voice module for converting sound wave signals and electric signals, a communication module for performing data information interaction with an external terminal, a storage module for storing data information and an operation module; the audio processing device comprises a motion characteristic acquisition module, a characteristic information matching module for identifying and matching current motion state information and matching the current motion state information, a timing module for recording time information of certain new motion characteristic information, a working mode switching module for judging and switching working modes of the audio wearable device and a voice presentation module for adjusting audio volume output of a receiver.

Description

Information processing system based on audio wearable equipment

Technical Field

The utility model relates to an audio equipment control technical field especially relates to an information processing system based on audio frequency wearing equipment.

Background

With the development and improvement of intelligent devices and wearable devices, audio wearable devices are continuously developing towards the trends of Wireless, miniaturization and concealment, and users tend to wear audio wearable devices for a long time based on the requirement of audio acquisition, such as tws (true Wireless stereo) bluetooth headsets and the like. At present, under the requirement of miniaturized audio wearable equipment, the battery capacity of the audio wearable equipment is generally less than 200mAh, and the power consumption of the traditional intelligent wearable equipment is higher, so that the interval period of battery replacement and/or charging is shorter; in addition, in order to wear comfortable, a wearer needs to adjust the output audio volume of the audio wearable device in different motion states, for example, when the wearer moves, the audio output volume is increased to hear audio content clearly, and when the wearer has a rest, the audio output volume is reduced to reduce the interference of audio on the rest of the user.

SUMMERY OF THE UTILITY MODEL

Therefore, it is necessary to provide an information processing system based on an audio wearable device, which has low power consumption of the device, a long battery replacement and/or charging interval period, and an adaptive audio volume to a user motion state, in order to solve the technical problems of high power consumption of the device and high operation difficulty caused by frequent adjustment of the volume of the device.

The utility model provides an information processing system based on audio frequency wearing equipment, including audio frequency wearing equipment and with audio frequency wearing equipment communication connection's audio processing device, audio frequency wearing equipment includes:

the sensor module is used for detecting the motion state of a user;

the voice module comprises a microphone for acquiring an environment sound signal, a signal filtering processing circuit for filtering the sound signal received by the microphone and a receiver for outputting the sound signal with preset volume;

the communication module comprises a transceiver which is used for being in communication connection with an external terminal and being accessed by the external terminal or transmitting data information flow to the external terminal;

the storage module is used for storing information such as program codes, state information, data results, audio data and the like of the audio wearable device;

the operation module is used for operating the algorithm and logic of the audio processing device and calculating and processing audio data, sensor data and external response;

the audio processing apparatus includes:

the motion characteristic acquisition module is used for receiving, filtering, analyzing and processing the motion state data detected by the sensor module to acquire the current motion state information of the user;

the characteristic information matching module is used for identifying and matching the current motion state information detected by the motion characteristic acquisition module and judging whether the current motion state information is matched with other non-current preset working modes; if the current motion state is matched with the current motion state, starting a timing window to record the duration of the current motion state;

the timing module is used for recording the duration of a certain new motion characteristic information, the starting time of a motion characteristic state and the switching time of the working mode of the audio wearable device;

the working mode switching module is used for judging whether the duration of a certain new motion characteristic information recorded in the timing window exceeds a time threshold value for switching to a successfully matched working mode, and if so, switching the working mode of the audio wearable device to a new working mode which is successfully matched correspondingly;

and the voice presentation module is used for adjusting the audio volume output of the receiver according to the current working mode and the functional scene of the audio wearable device.

In one embodiment, the voice module further comprises an audio input interface for accessing an audio signal by an external expansion device and/or an audio output interface for transmitting the audio signal to the external expansion device, and the audio input interface accesses the audio signal to the signal filtering processing circuit for filtering processing.

In one embodiment, the speech sound presenting module adjusts the output volume of the digital audio in the operation module, or adjusts the amplification factor of a power amplifier of the receiver, or adjusts the amplitudes of the transmitter and the audio input interface to adjust the audio volume output of the receiver.

In one embodiment, the audio-wearable device further comprises a time module.

In one embodiment, the microphone comprises a microphone and an analog/digital converter for converting an analog signal into a digital signal that can be processed by the operation module.

In one embodiment, the audio wearable device further comprises a rear-hanging U-shaped housing, a human-computer interaction module accommodated in the housing and electrically connected to the operation module, and a power switch, a scene switch, a volume increasing switch, a volume decreasing switch and a function switch which are installed outside the housing and respectively send instructions to the human-computer interaction module.

In one embodiment, the scene switcher is used for controlling the audio wearable device to respectively enter a hearing assistance mode of a plurality of different functional scenes and an auxiliary hearing mode of a plurality of different functional scenes.

Implement the utility model discloses an information processing system based on audio wearing equipment, detect user's motion state through the sensor module, when user's motion state changes, the current motion state information that motion characteristic acquisition module detected changes, under the successful condition of matching via characteristic information matching module, and when the duration of new motion characteristic information exceeded the time threshold of switching to the successful working mode of matching, working mode switching module switched audio wearing equipment to new working mode, and then by the voice presentation module control receiver with predetermined volume output audio frequency, in the process, the volume control of audio wearing equipment output sound is by audio processing apparatus automatic control, the operational difficulty that the user frequently adjusted the volume manually has been avoided, experience sense scheduling problem inadequately; in addition, the information processing system adjusts the volume output through the change of the motion state, so that the volume is adaptive to the motion state of a user, the problem of high power consumption caused by continuous high-power output of the information processing system is solved, the service life of the battery in single charging is prolonged, and the electric energy is saved.

Drawings

Fig. 1 is a schematic block diagram of an information processing system according to an embodiment of the present invention;

FIG. 2 is a schematic circuit diagram of an information handling system according to an embodiment of the present invention;

fig. 3 is a schematic structural diagram of an audio wearable device according to an embodiment of the present invention;

FIG. 4 is a diagram illustrating a mode transition of an information handling system according to an embodiment of the present invention;

fig. 5 is a flowchart of an information processing method according to an embodiment of the present invention;

fig. 6 is a logic diagram of an information processing method according to another embodiment of the present invention.

Detailed Description

In order to make the above objects, features and advantages of the present invention more comprehensible, embodiments of the present invention are described in detail below with reference to the accompanying drawings. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein, as those skilled in the art will be able to make similar modifications without departing from the spirit and scope of the present invention.

Referring to fig. 1, the present invention provides an information processing system based on an audio wearable device, which has low power consumption, long battery replacement and/or charging interval period, and adaptive audio volume and user motion state, and comprises an audio wearable device 100 and an audio processing apparatus 200 communicatively connected to the audio wearable device 100, wherein, the audio wearable device 100 is used for being worn on the clothes or body part of the user to provide audio playing and hearing aid services for the user, the audio processing device 200 is used for receiving the user motion state signal accessed by the audio wearable device 100 and the data signal accessed by the external terminal 300, and performing operation processing on the motion state signal according to a preset program, so as to judge and switch the audio wearable device 100 to enter a corresponding working mode, thereby adjusting the volume of the audio output by the audio wearable device 100.

The audio wearable device 100 comprises a sensor module 110 for detecting the motion state of the user, a voice module 120 for converting sound wave signals and electric signals into each other, a communication module 130 for communicating with an external terminal 300 and accessing the external terminal 300 or transmitting data information streams to the external terminal 300, a processor module 140 for receiving and processing information sent by the modules, and an audio decoding and power amplifier 150 for receiving information from the processor module 140 and decoding and power amplifying corresponding information. Wherein the sensor module 110 includes one or more of an acceleration sensor, a gyroscope sensor, a magnetic field sensor, a touch sensor, or a pressure sensor. Preferably, the sensor module 110 is an acceleration sensor. The acceleration sensor is a sensor capable of measuring acceleration, and generally comprises a mass block, a damper, an elastic element, a sensitive element, an adaptive circuit and the like, and obtains an acceleration value by measuring the inertial force borne by the mass block in the acceleration process according to the Newton's second law, and transmits the acceleration value to the processor module 140 for operation processing so as to judge the motion state of a user. Similarly, the gyroscope sensor, the magnetic field sensor, the touch sensor, the pressure sensor, or the like is used for outputting a changed level value when the user movement state changes, so as to facilitate the processor module 140 to perform operation processing.

The voice module 120 includes a microphone 121 for acquiring an ambient sound signal, a signal filter processing circuit 122 for performing filter processing on a sound signal received by the microphone 121, and a receiver 123 for outputting a sound signal at a predetermined volume. It should be noted that the original sound output by the receiver 123 may originate from the microphone 121, or may originate from the audio information transmitted to the receiver 123 by the external terminal 300 through the communication module 130. In this case, the voice module 120 is mainly used to collect the sound signals in the environment and amplify the signals in the environment, so that the hearing-impaired user can hear the sound in the environment clearly or the general user can enlarge the environmental sound effect, and the hearing-aid or auxiliary hearing function of the audio wearable device 100 is realized. In an embodiment, the microphone 121 is configured in a built-in manner, an external manner, or a remote wireless connection manner, that is, the microphone 121 may be installed inside the audio wearable device 100, may also be installed outside the audio wearable device 100 to receive a sound signal of an environment around the audio wearable device 100, and may also receive a sound signal of a remote location from the audio wearable device 100 in a wireless connection manner, so as to implement remote monitoring of the sound signal. The microphone 121 includes a microphone 121a and an analog/digital converter 121b, and the analog/digital converter 121b is responsible for converting an analog signal into a digital signal that can be processed by the processor module 140, and it should be noted that, if the output end of the microphone 121a is already a digital signal, the digital signal can be directly transmitted to the processor module 140 without being processed by the analog/digital converter 121 b.

In an embodiment, the voice module 120 further includes an audio input interface (not shown) for accessing an audio signal by an external expansion device and/or an audio output interface (not shown) for transmitting an audio signal to an external expansion device, where the audio input interface accesses the audio signal to the signal filtering processing circuit 122 for filtering, that is, the audio input interface and the audio output interface are used to expand the volume of the audio wearable device 100, so as to expand the applicable scene of the audio wearable device 100.

The communication module 130 includes a transceiver 131 having a wired transmission module interface or/and a wireless transmission module interface to realize data information interaction with the external terminal 300, but may also include other interfaces or interface combinations capable of realizing communication connection. In an embodiment, the external terminal 300 is further connected to the server 400 through a communication connection manner, so as to further transmit the data information transmitted by the audio wearable device 100 to the server 400 for processing, the audio wearable device 100 and the external terminal 300 may be connected through a wired connection or a wireless signal, and accordingly, the external terminal 300 is required to be provided with a transceiver unit 310 for performing data interaction with the transceiver 131 and a communication unit 320 connected to the server 400. The external terminal 300 is configured to receive and transmit sensor data such as acceleration and motion frequency, calculation results, a working state, volume, and corresponding time axis and other data information sent by the audio wearable device 100 to the server 400, perform offline data mining and autonomous learning on the data information by the server 400, and update the learning results and optimized parameters to the audio wearable device 100 through the external terminal 300; external terminal 300 still is used for broadcasting audio information transmission to audio frequency wearing equipment 100, that is to say, the utility model discloses an audio frequency wearing equipment 100 both can regard as the hearing aid equipment that help hearing disorder patient listened sound and provide the supplementary equipment of listening that sound is enlargied for the user, can also be used for receiving the audio signal that external terminal 300 sent, uses as external terminal 300's audio playback end. Preferably, the external terminal 300 includes, but is not limited to, a mobile phone, a watch, a computer, a player, a radio, a television, a hearing aid/hearing aid or other devices with voice output function; the server 400 includes, but is not limited to, a local server, a private server, a public cloud server, or a cluster of servers.

The processor module 140 further includes a storage module 141 for storing information such as program codes, status information, data results, and audio data of the audio wearable device 100, and an operation module 142 for operating algorithms and logic of the audio processing apparatus 200, calculating and processing audio data, sensor data, and external responses, the operation module 142 processing digital signals converted by the analog/digital converter 121 b. Referring to FIG. 2, in one embodiment, the processor module 140 is a wireless Bluetooth processor model NRF52832, i.e., U3 in the circuit diagram, the processor module 140 being used for logic control and response, arithmetic operations, wireless communication, and the like. It should be noted that the wireless bluetooth processor is provided with a wireless transceiving function, so that when the wireless bluetooth processor is used as the processor module 140, the transceiver 131 does not need to be additionally added. In addition, the wireless bluetooth processor of this embodiment needs to be used in conjunction with an external audio codec device, such as an audio codec device with a circuit diagram labeled U9 and a model number CS4345, to convert the encoded digital audio signal into a voice signal capable of directly driving the receiver 123. Further, audio wearable device 100 also includes a time module 160 that provides a clock for processor module 140, time module 160 including a crystal X1 that provides a 32MHz master clock for wireless bluetooth processor U3, i.e., processor module 140, and a crystal X2 that provides a 32.768KHz clock for processor module 140. In the circuit schematic, the audio decoding and power amplifier 150, i.e., U9 in the circuit schematic is CS4345, and is electrically connected to the processor module 140 through the I2S interface; the receiver 123, i.e. U7 and U8 in the circuit diagram, are electrically connected to the left and right channel output interfaces of the audio decoding and power amplifier 150, respectively; the sensor module 110, i.e., the circuit diagram in which U4 is KX022, is electrically connected to the processor module 140 through an I2C interface; the microphone 121, i.e., U1 and U2 in the circuit diagram are SPH0641LM4H, is electrically connected to the processor module 140 through a PDM interface.

Referring to fig. 3, in an embodiment, the audio wearable device 100 further includes a housing 170, and preferably, the housing 170 is a rear-hanging U-shaped structure, that is, the audio wearable device 100 employs the rear-hanging U-shaped housing 170 to encapsulate a plurality of modules of the audio wearable device 100 and the audio processing apparatus 200, so as to protect the modules and prevent the occurrence of leakage accidents from threatening the safety of users. In actual production, the audio wearable device 100 further includes, but is not limited to, a wireless earphone, a wired earphone, a hearing-assisted hearing earphone, a VR headset device, smart glasses, and various wearable devices with audio functions, and the housing 170 of the audio wearable device 100 also includes, but is not limited to, a head-mounted type, a rear-mounted type, an ear-plug type, and a bone-conduction type, and thus details thereof are not repeated herein.

Referring to fig. 3, a left earphone 171 is disposed at one end of the rear-hanging U-shaped structure of the audio wearable device 100, a right earphone 172 is disposed at the other end of the rear-hanging U-shaped structure, a left receiver 171a is disposed on the left earphone 171, a right receiver 172a and a first microphone 172b disposed on a connection line of the right receiver 172a are disposed on the right earphone 172, and a second microphone 172c is further disposed on the right earphone 172 near the bottom thereof, so that the two microphones can receive ambient sounds at different angles to improve the intensity of the sound source signal obtained by the audio wearable device 100. Further, the audio wearable device 100 further includes a human-computer interaction module 180 housed in the housing 170 and electrically connected to the processor module 140, and a power switch 181, a scene switch 182, a volume increasing switch 183, a volume decreasing switch 184, and a function switch 185 installed outside the housing 170 and respectively sending instructions to the human-computer interaction module 180. Preferably, the human-computer interaction module 180 is electrically connected to the operation module 142, and the human-computer interaction module 180 includes, but is not limited to, a wired control mode, a wireless control mode, and the like, and is mainly used for performing corresponding human-computer interaction operations and presentations. The power switch 181 is configured to send an instruction to the human-computer interaction module 180 to control start and stop of the audio wearable device 100; the function switch 185 is used for controlling the audio to play back and forth, fast forward or fast backward, and controlling to connect a telephone when the audio wearable device 100 receives the audio signal transmitted by the external terminal 300; the volume reducing switch 184 and the volume increasing switch 183 are used for manually adjusting the volume of the audio output by the audio wearable device 100; the scene change switch 182 is used to send an instruction to the processor module 140 to control the audio wearable device 100 to enter a hearing aid mode, an auxiliary hearing mode, and an audio playing mode of the external terminal 300, such as a call receiving mode and a call making mode. The inner cavity of the right earphone 172 is further provided with a PCB 190 for integrally mounting the other controlled elements of the audio wearing device 100, and the battery 171b is located in the inner cavity of the left earphone 171 and supplies power to the PCB 190 through the power wire 171 c.

Further, the scene switch 182 is configured to control the audio wearable device 100 to enter a hearing assistance mode of a plurality of different functional scenes and an auxiliary hearing mode of the plurality of different functional scenes, where the different functional scenes are classified according to a hearing impairment condition of the user or a volume playing condition under a predetermined environment required by the user, and the classification of the classification may be formed by mining, analyzing, and deep learning by the server 400 after the external terminal 300 sends a condition that the user uses the device, which is sent by the audio wearable device 100, to the server 400. It should be noted that, in the hearing-aid mode, the audio wearable device 100 operates independently of the external terminal 300, and processes the audio of the first microphone 172b and the second microphone 172c through amplification and filtering, and then outputs the processed audio to the left ear microphone 171a and the right ear microphone 172a through the audio decoding and power amplifier 150, and in the hearing-aid mode, the audio wearable device 100 processes the audio data of the external terminal 300 acquired through wireless, and outputs the processed audio to the left ear microphone 171a and the right ear microphone 172a through the audio decoding and power amplifier 150.

The audio processing device 200 includes a motion characteristic obtaining module 210, a characteristic information matching module 220, a timing module 230, a working mode switching module 240, and a speech presentation module 250, wherein the motion characteristic obtaining module 210 is configured to receive, filter, analyze and process the motion state data detected by the sensor module 110, and obtain current motion state information of the user; the characteristic information matching module 220 is configured to identify and match the current motion state information detected by the motion characteristic obtaining module 210, and determine whether the current motion state information matches with other non-current preset working modes; if the current motion state is matched with the current motion state, starting a timing window to record the duration of the current motion state; the timing module 230 is configured to record a duration of a certain new motion characteristic information, an initial time of a motion characteristic state, and a switching time of a working mode of the audio wearable device 100; the working mode switching module 240 is configured to determine whether a duration of a certain new motion characteristic information recorded in the timing window exceeds a time threshold for switching to a successfully matched working mode, and if so, switch the working mode of the audio wearable device 100 to a new working mode corresponding to the successfully matched working mode; the speech presentation module 250 is configured to adjust the audio volume output of the receiver 123 according to the current working mode and the functional scene of the audio wearable device 100.

In one embodiment, the voice presenting module 250 adjusts the output volume of the digital audio in the operation module 142, or adjusts the amplification factor of the power amplifier of the receiver 123, or adjusts the amplitudes of the microphone 121 and the audio input interface to adjust the audio volume output of the receiver 123. That is to say, the voice presenting module 250 adjusts the audio output path of the audio wearable device 100 in three ways, that is, adjusting the output volume of the digital audio in the operation module 142 of the audio wearable device 100, and performing equal-ratio amplification or reduction on the amplitude in the overall frequency response range; adjusting the amplification factor of a receiver 123 in the voice module 120 of the audio wearable device 100; the amplitudes of the microphone 121 and the audio input interface in the voice module 120 of the audio wearable device 100 are adjusted. It should be noted that it is necessary to ensure that the adjusted audio output energy of the audio wearable device 100 does not adversely affect and damage the auditory system, such as the ear of the wearer, for a short time and/or a long time.

Referring to fig. 4, in an embodiment, the working mode switching module 240 controls the audio wearable device 100 to enter the enhanced mode S1 for increasing the audio output amplitude in the severe motion state; controlling the audio wearable device 100 to enter the normal mode S2 in the general movement state; controlling the audio wearable device 100 to enter a standby mode S3 in which the audio output amplitude is reduced in a non-moving state; the audio wearable device 100 is controlled to enter the sleep mode S4 after the standby mode S3 continues for a predetermined time. Specifically, when the user is in a motion state with vigorous activities such as running, fitness, mountain climbing, swimming, etc., the sensor module 110 detects and transmits the motion acceleration value of the user to the motion characteristic acquisition module 210, the fluctuation of the motion acceleration value is large, the characteristic information matching module 220 compares parameters such as the maximum fluctuation amplitude of the acceleration, the frequency of the occurrence of the maximum fluctuation amplitude, the steepness of the edge, etc., with preset standard values respectively, and when the standard values are matched, the mode is switched to the reinforcement mode S1 and the up-regulation amplitude of the volume is gradually increased, so that the audio volume is adapted to the vigorous motion state of the user, and the influence of interference sound generated by driving clothes to the hearing sound of the user during heartbeat, pulse and respiration reinforcement of the user and body movement is reduced.

When the user is in a general exercise state, such as performing a more moderate activity, e.g., walking, doing housework, watching tv, etc., the operating mode switching module 240 controls the audio wearable device 100 to enter the normal mode S2, i.e., controls the receiver 123 to output at a medium volume. When the user is in a non-moving state such as sitting, reading, or nap, the activity of the user is very small, and the change amplitude weighted value of the acceleration value detected by the sensor module 110 is close to a zero value, in this case, the working mode switching module 240 controls the audio wearable device 100 to enter the standby mode S3, so that interference to the user when a large volume is output is avoided, and power consumption generated by low volume output is low, which is beneficial to prolonging the service life of the battery 171 b. After the motion state enters sleep from a nap or becomes extremely quiet, the audio wearable device 100 enters the sleep mode S4, in which case, the working mode switching module 240 sends an instruction to the voice presenting module 250 to control to close the audio related function, i.e., disconnect the transceiver 131 from the external terminal 300, and control the receiver 123 to close the output, so as to avoid power waste caused by the user not listening to the audio information.

In one embodiment, the time threshold for the normal mode S2 to switch to the robust mode S1 is set to t1, and the time threshold for the robust mode S1 to switch back to the normal mode S2 is set to t 2; the time threshold for the normal mode S2 to switch to the standby mode S3 is set at t3, and the time threshold for the standby mode S3 to switch back to the normal mode S2 is set at t 4; the time threshold for the standby mode S3 to switch to the sleep mode S4 is set to t 5; the time threshold for switching from the sleep mode S4 to the normal mode S2 is set as t6, that is, after the specified time threshold passes, the audio wearable device 100 is switched from one working mode to another working mode to save power and ensure automatic adaptation of the volume output to the motion state of the user, and the setting of each time threshold is controlled by the time module 160. The time thresholds t 1-t 6 may be the same or different, and in actual use, the audio wearable device 100 may transmit information to the server 400 in communication with the external terminal 300, so as to perform autonomous learning and dynamic updating on data, and feedback adjust the values of the time thresholds t 1-t 6 set in the audio wearable device 100, so that each time threshold is closer to the actual motion state of the user.

Implement the utility model discloses an audio frequency wearing equipment 100, based on sensor technology and signal processing technology, adopt the method that perception and digital signal processing combined together, through automatic monitoring person's of wearing motion state information, handle audio data, through automatic switch-over mode state, adjust the audio output volume under the corresponding mode, have according to user's motion state, self-adaptation regulation audio output volume to and the characteristics of self-adaptation reduction audio frequency wearing equipment 100 consumption, with the interval cycle that changes the battery and/or charge that promotes listening experience and extension equipment.

Implement the utility model discloses an information processing system based on audio wearing equipment, detect user's motion state through sensor module 110, when user's motion state changes, the current motion state information that motion characteristic acquisition module 210 detected changes, under the successful condition of matching via characteristic information matching module 220, and when the duration of new motion characteristic information exceeded the time threshold who switches over to the successful working mode of matching, working mode switching module 240 switches audio wearing equipment 100 to new working mode, and then control receiver 123 by speech presentation module 250 and export the audio frequency with predetermined volume, in the process, the volume control of audio wearing equipment 100 output sound is controlled by audio processing apparatus 200 automatically, the operational difficulty that the user frequently manually adjusted the volume and caused has been avoided, experience feels not enough scheduling problem; in addition, the information processing system adjusts the volume output through the change of the motion state, so that the volume is adaptive to the motion state of the user, the problem of high power consumption caused by continuous high-power output of the information processing system is solved, the service life of the battery 171b charged once is prolonged, and the electric energy is saved.

Referring to fig. 5, the utility model also discloses an information processing method based on audio wearing equipment, including the following steps:

step S201: and acquiring current motion characteristic information, preprocessing the characteristic information and recording corresponding time. Specifically, the motion characteristic information is mainly obtained according to the sensor module 110, particularly, sensor data related to the user posture, such as acceleration sensor data, and corresponding motion characteristic information, such as the acceleration magnitude, the maximum fluctuation amplitude of the acceleration, the frequency of occurrence of the maximum fluctuation amplitude, the steepness of the edge, and other related data, is extracted by analyzing the acceleration sensor data.

Specifically, when the acquired acceleration data is calculated, it is impossible to predict in which direction the acceleration changes due to the problem of the wearing angle of the device and the change in the exercise posture of the user, and if only the acceleration data change curve of a certain axis is determined, it will be very inaccurate, so that statistical calculation can be performed by using data curves in multiple directions. For example, when processing acceleration data of a three-axis acceleration sensor, a Signal Vector Module (SVM) feature quantity is used to assemble the spatial acceleration changes into vectors in other directions. The Acceleration Signal Vector Module (ASVM) is shown in the following formula:

ASVM_x＝ax

ASVM_y＝ay

ASVM_z＝az

the ax, ay and az are acceleration signals obtained after filtering acceleration data of the acceleration sensor in the directions of three vertical axes of a space coordinate system x, y and z, and the synthesized acceleration has 7 corresponding acceleration time curves. And on each synthesized acceleration time curve, taking the maximum value and the minimum value in a sliding time window T, sequencing the maximum value and the minimum value of the acceleration corresponding to each acceleration time curve from large to small in sequence, and taking the curves in the first three rows to perform next data analysis, such as frequency of amplitude mutation, change curvature and the like, so as to improve the reliability of the data. In addition, T is a numerical value which varies within a certain range.

Step S202: and judging whether the current motion characteristic information is matched with other current preset working modes, if so, starting a timing window and recording the duration time of the current motion state. Specifically, the current motion characteristic information is compared and matched with the motion characteristic information corresponding to each pre-stored working mode. And if the matching is successful and the successfully matched working mode is not the current working mode, starting a timing window. It should be noted that the pre-stored motion characteristic information corresponding to the working mode may be independently learned and dynamically updated, and the processes of the independent learning and the dynamic updating may be independently completed in the audio wearable device 100, or may be completed with the assistance of the external terminal 300 and the server 400.

Step S203: and judging whether the duration time of the current motion state recorded in the timing window exceeds a time threshold value for switching to a successfully matched working mode, and if so, switching to a new working mode state corresponding to successful matching. In this case, the functional scene of the audio wearable device 100 remains unchanged, and only the operation mode of the audio wearable device 100 is adjusted.

Step S204: the audio output of the receiver 123 is increased, decreased or turned off according to the new operating mode state. Specifically, the audio output of the audio wearable device 100 is adjusted according to the switching trajectory of the working mode and the pre-stored audio adjustment strategy, the switching trajectory of the working mode and the audio adjustment strategy refer to the foregoing method for switching the audio wearable device 100 between different working modes according to the corresponding time threshold, and the pre-stored audio adjustment strategy may also be completed by performing autonomous learning and dynamic updating through the audio wearable device 100 or under the assistance of the external terminal 300 and the server 400 by the audio wearable device 100, which is not described herein again.

Referring to fig. 6, fig. 6 is a logic diagram of another embodiment of the information processing method of the present invention, including the following steps:

step S301: the timing window is reset. Specifically, the time configuration module 160 clears the data of the counter, and eliminates the influence of the completed motion on the subsequent motion detection and the motion state judgment, so as to ensure the reliability of the operation mode switching operation.

Step S302: sensory data is acquired from the sensor module 110. In the installation operation of the information processing system, the sensor module 110 is rigidly coupled to the audio wearable device 100, and the two devices move synchronously when the user moves, so that the movement states of the audio wearable device 100 and the user can be reflected by acquiring the data of the sensor module 110.

Step S303: and extracting current motion characteristic information according to the sensing data, determining the current motion state, and recording the time corresponding to the current motion, such as the starting time and the duration of the current motion. Specifically, the current motion characteristic information includes parameters such as an acceleration value of the current motion, a maximum fluctuation amplitude of the acceleration, a frequency of occurrence of the maximum fluctuation amplitude, and a steepness of the edge. In actual processing operation, filtering processing operation needs to be performed on sensor data before current motion characteristic information is extracted, so that harmonic interference in a line is reduced, and reliability of extracted current motion characteristic information is improved.

Step S304: judging whether the current motion characteristic information is matched with other current preset working modes, namely judging whether each data of the current motion characteristic information reaches the preset data value of other preset working modes, if the mode matching is successful, entering step S305, and if the mode matching is not successful, returning to step S301, resetting a timing window and carrying out next round of data acquisition and matching operation.

Step S305: a timing window is started.

Step S306: after the timing window is started, whether the time of the continuous matching between the current motion characteristic and the successfully matched working mode characteristic exceeds the time threshold of switching to the successfully matched working mode, namely whether the continuous matching time reaches the time threshold of switching to the successfully matched working mode is judged, if so, the step S307 is executed, if not, the step S301 is executed, the timing window is reset, and the next round of data acquisition and matching operation is executed.

Step S307: and keeping the functional scene unchanged, and switching the working mode to the working mode which is successfully matched.

Step S308: and closing the timing window after switching to the new working mode which is successfully matched. Specifically, the switching time of the working mode needs to be recorded and the data of the counter needs to be cleared, so that the next data detection and working mode switching operation can be facilitated.

Step S309: the functional scene of the audio wearable device 100 is kept unchanged, and the audio output of the receiver 123 is increased, decreased or turned off according to the corresponding working mode.

Step S310: after the audio output of the receiver 123 is adjusted, the switching start time and the operating duration of each function scene and each operating mode are stored and recorded, and are synchronously stored in the external device 300 and the server 400. In actual processing, the data may be transmitted and stored in real time or non-real time.

Step S311: and an equipment use report is generated for a user, the user is guided to reasonably use the equipment, and the user experience is improved. Specifically, the external terminal 300 and the server 400 perform mining and analysis according to the stored and recorded user motion state information, each function scene, the switching start time and the working duration of each working mode, and other data information, and generate an equipment use report including files such as a use report and a guidance suggestion. In addition, different product types can be designed for different user groups, and the corresponding battery capacity can be calculated by estimating the use habits of the different user groups, so that a smaller and more beautiful product can be guided to be designed.

According to the information processing method based on the audio wearable device, the motion state of the user is acquired from the sensor module 110, when the motion state of the user changes, the detected current motion state information changes, and when the current motion characteristic information is successfully matched with other non-current preset working modes and the duration of the new motion characteristic information exceeds the time threshold value for switching to the successfully matched working mode, the audio wearable device 100 is switched to the new working mode, so that the receiver 123 of the audio wearable device 100 is adjusted to output audio at a preset volume, and in the process, the motion state of the user is analyzed and automatically switched to the corresponding working state, so that the problems of difficult operation, insufficient experience and the like caused by frequent manual volume adjustment of the user are avoided; in addition, volume output is adjusted through the change of the motion state, so that the volume is adapted to the motion state of the user, the problem of high power consumption caused by continuous high-power output of the audio wearable device 100 is solved, the service life of the battery 171b charged once is prolonged, and electric energy is saved.

The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.

The above-mentioned embodiments only represent some embodiments of the present invention, and the description thereof is specific and detailed, but not to be construed as limiting the scope of the present invention. It should be noted that, for those skilled in the art, without departing from the spirit of the present invention, several variations and modifications can be made, which are within the scope of the present invention. Therefore, the protection scope of the present invention should be subject to the appended claims.

Claims

1. The information processing system based on the audio wearable device is characterized by comprising the audio wearable device (100) and an audio processing device (200) in communication connection with the audio wearable device (100), wherein the audio wearable device (100) comprises:

a sensor module (110) for detecting a motion state of a user;

a voice module (120) including a microphone (121) for acquiring an ambient sound signal, a signal filter processing circuit (122) for performing filter processing on a sound signal received by the microphone (121), and a receiver (123) for outputting a sound signal at a predetermined volume;

a communication module (130) comprising a transceiver (131) for communicatively connecting with an external terminal (300) and accessing or transmitting a data information stream by the external terminal (300) to the external terminal (300);

the storage module (141) is used for storing information such as program codes, state information, data results, audio data and the like of the audio wearable device (100);

an arithmetic module (142) for running algorithms and logic of the audio processing device (200), calculating and processing audio data, sensor data and external responses;

the audio processing apparatus (200) comprises:

the motion characteristic acquisition module (210) is used for receiving, filtering, analyzing and processing the motion state data detected by the sensor module (110) to acquire the current motion state information of the user;

the characteristic information matching module (220) is used for identifying and matching the current motion state information detected by the motion characteristic acquisition module (210) and judging whether the current motion state information is matched with other non-current preset working modes; if the current motion state is matched with the current motion state, starting a timing window to record the duration of the current motion state;

the timing module (230) is used for recording the duration of a certain new motion characteristic information, the starting time of a motion characteristic state and the switching time of the working mode of the audio wearable device (100);

the working mode switching module (240) is used for judging whether the duration of a certain new motion characteristic information recorded in the timing window exceeds a time threshold value for switching to a successfully matched working mode, and if the duration exceeds the time threshold value, switching the working mode of the audio wearable device (100) to a new working mode corresponding to successful matching;

and the voice presenting module (250) is used for adjusting the audio volume output of the receiver (123) according to the current working mode and the functional scene of the audio wearable device (100).

2. The information processing system of claim 1, wherein the voice module (120) further comprises an audio input interface for accessing audio signals from an external extension device and/or an audio output interface for transmitting audio signals to an external extension device, and the audio input interface accesses audio signals to the signal filtering circuit (122) for filtering.

3. The information processing system of claim 2, wherein the speech rendering module (250) adjusts the output volume of digital audio in the computing module (142) or adjusts the power amplifier amplification of the receiver (123) or adjusts the amplitudes of the microphone (121) and the audio input interface to adjust the audio volume output of the receiver (123).

4. The information processing system of claim 1, wherein the audio-worn device (100) further comprises a time module (160).

5. The information processing system according to claim 1, wherein the microphone (121) includes a microphone (121a) and an analog/digital converter (121b), the analog/digital converter (121b) being configured to convert an analog signal into a digital signal that can be processed by the operation module (142).

6. The information processing system of claim 1, wherein the audio wearable device (100) further comprises a rear-hanging U-shaped housing (170), a man-machine interaction module (180) housed in the housing (170) and electrically connected to the operation module (142), and a power switch (181), a scene switch (182), a volume-up switch (183), a volume-down switch (184), and a function switch (185) installed outside the housing (170) and respectively sending instructions to the man-machine interaction module (180).

7. The information processing system according to claim 6, wherein the scene switcher (182) is configured to control the audio wearable device (100) to enter a hearing assistance mode for a plurality of different functional scenes and a hearing assistance mode for a plurality of different functional scenes, respectively.