CN116413750A

CN116413750A - Vibration signal source positioning method, system and medium

Info

Publication number: CN116413750A
Application number: CN202111672393.7A
Authority: CN
Inventors: 肖乐; 袁永帅; 黄雨佳; 廖风云; 齐心
Original assignee: Shenzhen Voxtech Co Ltd
Current assignee: Shenzhen Voxtech Co Ltd
Priority date: 2021-12-31
Filing date: 2021-12-31
Publication date: 2023-07-11

Abstract

The embodiment of the specification provides a vibration signal source positioning method, which comprises the steps of obtaining sensing signals of at least two vibration sensing devices positioned at different positions, wherein each sensing signal comprises a vibration signal generated by vibrating the same vibration signal source; determining a time difference of receiving the vibration signals by at least two vibration sensing devices positioned at different positions based on the sensing signals; and determining a location of the vibration signal source based on the time difference.

Description

Vibration signal source positioning method, system and medium

Technical Field

The present disclosure relates to the field of signal source positioning, and in particular, to a method, a system, and a medium for positioning a vibration signal source.

Background

Analysis and research on the vibration signal source not only comprises the identification of the signal characteristics of the vibration signal source, but also the positioning of the vibration signal source. How to accurately and quickly determine the position of the vibration signal source is of great significance to analysis and research of the vibration signal source.

The specification aims at providing a vibration signal source positioning method which can quickly and accurately determine the position of a vibration signal source.

Disclosure of Invention

Some embodiments of the present specification provide a vibration signal source positioning method, the method comprising: acquiring sensing signals of at least two vibration sensing devices positioned at different positions, wherein each sensing signal comprises a vibration signal generated by vibration of the same vibration signal source; determining a time difference of the vibration signals received by the at least two vibration sensing devices positioned at different positions based on the sensing signals; and determining a location of the vibration signal source based on the time difference.

Some embodiments of the present description provide a vibration signal source positioning system, the system comprising: the sensing signal acquisition module is used for acquiring sensing signals of at least two vibration sensing devices positioned at different positions, and each sensing signal comprises a vibration signal generated by vibration of the same vibration signal source; a time difference determining module, configured to determine, based on the sensing signals, a time difference in which the vibration signals are received by the at least two vibration sensing devices located at different positions; and a position determining module for determining a position of the vibration signal source based on the time difference.

Some embodiments of the present description provide a non-transitory computer-readable medium comprising: computer instructions; the computer instructions, when executed by at least one processor, may cause the at least one processor to perform operations of: acquiring sensing signals of at least two vibration sensing devices positioned at different positions, wherein each sensing signal comprises a vibration signal generated by vibration of the same vibration signal source; determining a time difference of the vibration signals received by the at least two vibration sensing devices positioned at different positions based on the sensing signals; and determining a location of the vibration signal source based on the time difference.

Drawings

The present specification will be further elucidated by way of example embodiments, which will be described in detail by means of the accompanying drawings. These embodiments are not limiting, and in these embodiments like numbers represent similar structures, wherein:

FIG. 1 is a vibration signal source positioning system according to some embodiments of the present description;

FIG. 2 is an exemplary flow chart of a vibration signal source localization method according to some embodiments of the present disclosure;

FIG. 3 is a block diagram of a vibration signal source positioning system according to some embodiments of the present disclosure;

FIG. 4 is an exemplary flow chart for determining the location of a vibration signal source according to some embodiments of the present description;

FIG. 5 is a schematic illustration of a touch control device provided with a vibration sensing device according to some embodiments of the present disclosure;

FIG. 6 is a schematic view of a racquet provided with vibration sensing devices according to some embodiments of the present description;

FIG. 7 is a schematic illustration of a pitch provided with vibration sensing devices, shown in accordance with some embodiments of the present description;

fig. 8 is a schematic view of a rail provided with vibration sensing devices according to some embodiments of the present disclosure.

Detailed Description

In order to more clearly illustrate the technical solutions of the embodiments of the present specification, the drawings used in the description of the embodiments will be briefly described below. It is apparent that the drawings in the following description are only some examples or embodiments of the present specification, and it is possible for those of ordinary skill in the art to apply the present specification to other similar situations according to the drawings without inventive effort. It should be understood that these exemplary embodiments are presented merely to enable those skilled in the relevant art to better understand and practice the invention and are not intended to limit the scope of the invention in any way. Unless otherwise apparent from the context of the language or otherwise specified, like reference numerals in the figures refer to like structures or operations.

As used in this specification and the claims, the terms "a," "an," "the," and/or "the" are not specific to a singular, but may include a plurality, unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that the steps and elements are explicitly identified, and they do not constitute an exclusive list, as other steps or elements may be included in a method or apparatus. The term "based on" is based at least in part on. The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment". Related definitions of other terms will be given in the description below.

Some embodiments of the present description provide a vibration signal source positioning method and system. The method can acquire sensing signals generated by at least two vibration sensing devices arranged at different positions, and the sensing signals are generated after the vibration sensing devices acquire external vibration signals. By identifying the signal characteristics of the sensor signal, the target signal characteristics corresponding to the vibration signal source are determined, and thus the time difference between the arrival of external vibrations generated by a specific vibration behavior of the vibration signal source at least two vibration sensor devices arranged at different positions is determined. And finally, determining the position of the vibration signal source corresponding to the target signal characteristic through the time difference.

FIG. 1 is a vibration signal source positioning system according to some embodiments of the present description. For ease of description, the vibration signal source-locating system 100 may be referred to simply as the system 100. The system 100 may include a vibration sensing apparatus 110, a processing device 120, and a storage device 130. In some embodiments, the system 100 may acquire a sensing signal generated by the vibration sensing device 110 based on the received external vibration signal. In some embodiments, the system 100 may identify target signal characteristics corresponding to the vibration signal sources and determine the locations of the vibration signal sources corresponding to the external vibration signals based on time differences between the target signal characteristics. The various components in the system 100 may be interconnected by wire or wirelessly.

The vibration sensing device 110 may generate a sensing signal (e.g., an electrical signal) based on the acquired external mechanical vibration signal (which may also be referred to as a vibration signal). In some embodiments, the external mechanical vibration signal is derived from a particular vibration behavior generated by a particular signal vibration source. The signal vibration source may refer to a body or a specific portion of the body that performs a specific vibration behavior (e.g., the teeth of the user's upper and lower gums, the user's fingers contact the contact manipulation area, the ball contacts the racket, the player contacts the playing surface, etc.) to generate a vibration signal. For example, basketball in a basketball court may vibrate when in contact with the court surface, thereby producing a vibration signal that the basketball may be considered a vibration signal source of. For another example, when the player moves on the basketball court, the player's feet will contact the court surface and a vibration signal will be generated when the player contacts the basketball court surface, so the vibration signal source of the vibration signal is the player's feet. In some embodiments, the vibration signal generated by a particular signal vibration source may be transmitted to the vibration sensing device 110 via a medium (e.g., a solid medium), and the vibration sensing device 110 may generate a corresponding sensing signal based on the received vibration signal. For example, the vibration sensing device 110 provided on the touch manipulation device may collect vibration signals generated by an operation (e.g., by tapping, scraping, etc.) located in the touch manipulation area and generate corresponding sensing signals. In some cases, since the vibration signal is hardly affected by environmental noise (e.g., noise caused by air vibration) during the transmission, it is ensured that the vibration signal can be accurately and effectively collected by the vibration sensing device 110.

The processing device 120 may process data and/or information obtained from the vibration sensing apparatus 110 or other components of the system 100. For example, the processing device 120 may process the sensing signal acquired from the vibration sensing apparatus 110. In some embodiments, the processing device 120 may be a processor of the vibration sensing apparatus 110 itself (e.g., a chip of the vibration sensing apparatus 110). Thus, the vibration sensing device 110 may be used not only to pick up the acquired vibration signal, but also to process the generated sensing signal (including identifying the signal characteristics of the sensing signal). In some embodiments, the processing device 120 may be a single server or a group of servers. The server farm may be centralized or distributed. In some embodiments, the processing device 120 may be local or remote. For example, the processing device 120 may access information and/or data from the vibration sensing apparatus 110 and/or the storage device 130. As another example, the processing device 120 may be directly connected to the vibration sensing apparatus 110 and/or the storage device 130 to access information and/or data. In some embodiments, processing device 120 may include one or more processors (e.g., single core processors or multi-core processors).

The storage device 130 may store data, instructions, and/or any other information, such as, for example, sensor signals acquired by the processing device 120, signal characteristics of sensor signals identified by the processing device, and so forth. In some embodiments, the storage device 130 may store data, e.g., vibration signals, obtained from the vibration sensing apparatus 110 and/or the processing device 120. In some embodiments, the storage device 130 may store data and/or instructions that the processing device 120 uses to perform or use to implement the exemplary methods described in this specification.

In some embodiments, the system 100 may also include a user terminal 140. The user terminal 140 may be configured to receive and/or transmit information and/or data. In some embodiments, the user terminal 140 may include a mobile device 140-1, a tablet computer 140-2, a laptop computer 140-3, or the like, or any combination thereof. In some embodiments, at least one user terminal 140 may be in communication and/or connected with the vibration sensing apparatus 110, the processing device 120, and/or the storage device 130. For example, the user may input the related information of the solid medium (e.g., the vibration transmission speed of the solid medium) through at least one user terminal 140. In some embodiments, the mobile device may include a wearable device, a smart mobile device, a virtual reality device, an augmented reality device, a smart toy, a smart speaker, etc., or any combination thereof.

Fig. 2 is an exemplary flow chart of a vibration signal source localization method according to some embodiments of the present description. In some embodiments, the vibration signal source localization method 200 may be performed by the vibration signal source localization system 100 (e.g., the processing device 120). For example, the vibration signal source localization method 200 may be stored in a storage device (e.g., the storage device 130) in the form of a program or instructions that, when executed by the vibration signal source localization system 100 (e.g., the processing device 120), may implement the vibration signal source localization method 200.

At step 210, sensing signals of at least two vibration sensing devices located at different positions are obtained, each sensing signal including a vibration signal generated by vibration from the same vibration signal source. In some embodiments, step 210 may be performed by the sensing signal acquisition module 310.

The sensing signal may refer to a signal generated by the vibration sensing device 110 receiving an external vibration signal. For example, the sensing signal may be an electrical signal generated by the vibration sensing device 110 based on the received external vibration signal. In some embodiments, the external vibration signal refers to a mechanical vibration signal (or vibration signal).

The vibration sensing device 110 refers to a device that can collect a mechanical vibration signal. For example, the vibration sensing device 110 may be a microphone (also called bone conduction microphone), an accelerometer, or the like, which receives bone conduction sound signals as one of the main sound signals.

In some embodiments, vibration signals are generated when a vibration signal source performs a particular vibration action, including but not limited to physical activity of a user (e.g., chewing swallowing, tooth tapping, rubbing, etc.), bump contact between objects (e.g., ball to racket contact, ball to court ground contact, rail to train contact), or performing a particular operation in a particular area (e.g., tapping, scratching, etc.). The vibration sensing device 110 may receive the vibration signal by being connected to the main body and generate a corresponding sensing signal based on the vibration signal.

In the embodiment of the present disclosure, the number of the vibration sensing devices 110 is at least two, so when the same vibration signal source generates a vibration signal, the at least two vibration sensing devices 110 may simultaneously or sequentially receive the vibration signal corresponding to the vibration signal source, and generate a corresponding sensing signal based on the vibration signal.

In some embodiments, the number of vibration sensing devices 110 may be different according to the application scenario. For example, when the application scene is a one-dimensional scene (e.g., the rail shown in fig. 8 may be regarded as a line segment extending along the length thereof), the number of vibration sensing devices 110 may be two. In another example, when the application scene is a two-dimensional scene (e.g., the playing surface shown in fig. 7 may be considered as a two-dimensional plane), the number of vibration sensing devices 110 required may be three. For more details regarding the number of vibration sensing devices 110, reference may be made to the descriptions of fig. 5-8, which are not repeated here.

Step 220, determining a time difference between the vibration signals received by at least two vibration sensing devices located at different positions based on the sensing signals. In some embodiments, step 220 may be performed by time difference determination module 320.

In some embodiments, since the at least two vibration sensing devices 110 are disposed at different positions of the same object (e.g., solid medium), and the transmission speeds of the vibration signals in the same object are almost the same, the time points at which the at least two vibration sensing devices 110 receive the vibration signals may be different. At least two vibration sensing devices 110 disposed at different positions receive the vibration signal with a time difference. The time difference refers to a difference in time elapsed for the vibration signal generated by the vibration of the same vibration signal source to be transmitted to the plurality of vibration sensing devices 110. In some embodiments, the time at which the vibration signal is received may be determined by the time at which the vibration sensing device 110 generates the sensing signal. The time difference may thus be determined by the time difference in which the vibration sensing device 110 generates the sensing signal. For example, when the time for the two vibration sensing devices 110 located at different positions to receive the vibration signals of the same vibration signal source is T1 and T2, respectively, the time difference between the vibration signals is T1-T2.

In some embodiments, the vibration signal received by the vibration sensing device 110 may include other vibration signals in addition to the vibration signal (i.e., the target vibration signal) generated by the vibration signal source (i.e., the target vibration signal source). For example, when it is desired to detect the position of a ball at a playing field, the vibration signal received by the vibration sensing device 110 may include a target vibration signal generated by contact of the ball with the playing field and other noise (e.g., a vibration signal generated by contact of the player's foot with the playing field). Therefore, the processing device 120 needs to identify the target vibration signal from the vibration signals received by the vibration sensing means before determining the time difference.

In some embodiments, the processing device 120 may identify signal characteristics of the sensing signal. And then identifying a target signal characteristic corresponding to the vibration signal source from the signal characteristics. Finally, the time difference between the target signal features is determined.

Signal characteristics may refer to relevant information reflecting the characteristics of the signal. In some embodiments, for a vibration signal, the signal characteristics of its corresponding sense signal may include, but are not limited to, a combination of one or more of the number of vibration peaks, signal strength, spacing time of adjacent vibration peaks, frequency content, signal duration, and the like.

The number of vibration peaks refers to the number of vibration peaks having a magnitude greater than a preset magnitude. In some embodiments, the number of vibration peaks may reflect the number of external signals, such as the number of times the user taps the touch handling area, chews the swallow, the number of times the ball is contacted with the playing surface, and so forth. The signal strength refers to the degree of strength of a signal. In some embodiments, the signal strength may reflect a strength characteristic of the external signal, such as the force with which the user taps, swipes, and touches the manipulation area. In some embodiments, the greater the force of the user's tap, swipe, the greater the signal strength of the generated vibration signal. The interval time of adjacent vibration peaks refers to the time interval between adjacent two of the vibration peaks. In some embodiments, the interval between adjacent vibration peaks may reflect a density characteristic of the external signal, such as, for example, the interval between a user's tap, swipe the touch manipulation area, the interval between a user's chewing and swallowing, the interval between a ball and a playing surface, etc. The frequency component of the signal refers to the information of each frequency distribution in the sensing signal. In some embodiments, each frequency distribution information includes, for example, a distribution of high frequency signals, medium and high frequency signals, medium and low frequency signals, and the like. In some embodiments, the high frequency, medium frequency, intermediate frequency, medium low frequency, and/or low frequency may be artificially defined, e.g., the high frequency signal may be a signal having a frequency greater than 4000 Hz. The medium-high frequency signal may be a signal having a frequency in the range 2500Hz-5000 Hz. The intermediate frequency signal may be a signal having a frequency in the range of 1000Hz-4000 Hz. The medium-high frequency signal may be a signal having a frequency in the range of 600Hz-2000 Hz. Signal duration may refer to the duration of the entire sensing signal or the duration of a single vibration peak in the sensing signal. For example, the entire sensor signal may include 3 vibration peaks, and the duration of the entire sensor signal is 3 seconds.

In some embodiments, the processing device 120 may determine the signal characteristic spectrum of the sensing signal by performing time domain processing and/or frequency domain processing on the sensing signal, thereby determining the signal characteristics of the sensing signal. For example, the processing device 120 may read the number of vibration peaks, the frequency component of the signal, etc. related information from the signal characteristic spectrum of the sensing signal to determine the signal characteristic of the sensing signal.

In other embodiments, the processing device 120 may algorithmically determine the signal characteristics of the sensing signal based on the sensing signal. Exemplary algorithms may include wavelet packet energy feature extraction, mel-frequency cepstral coefficient (Mel-Frequency Cepstral Coefficients, MFCC) parametric feature extraction, and the like.

In some embodiments, the vibration sensing device may be indicated as receiving the target vibration signal when the target signal characteristic occurs in the signal characteristics. Accordingly, the processing device 120 may determine whether the vibration sensing apparatus 110 receives the target vibration signal by identifying whether the signal characteristic is the target signal characteristic. In some embodiments, the processing device 120 may determine whether the signal characteristic satisfies a preset characteristic condition. When the signal characteristics satisfy the preset characteristic condition, the processing device 120 may determine that the signal characteristics are target signal characteristics corresponding to the vibration signal source. The preset conditions may include, but are not limited to, the number of vibration peaks being greater than a threshold value, the signal duration being greater than a threshold value, etc. The target signal characteristic corresponding to the vibration signal source may refer to the same or similar target signal characteristic as the signal characteristic of the vibration signal emitted by the vibration signal source. For example, if the signal duration of the vibration signal emitted from the vibration signal source is greater than 2 seconds, the processing device 120 may identify a signal feature having a signal duration of greater than 2 seconds from the signal features and use it as a target signal feature corresponding to the vibration signal source.

In some embodiments, the processing device 120 may also identify a target signal feature of the signal features that corresponds to the vibration signal source based on the target signal feature identification model. The processing device 120 may input the sensed signal or a signal characteristic spectrum thereof to the target signal characteristic recognition model. The output of the target signal feature recognition model may include the target signal feature corresponding to the vibration signal source or information related to the target signal feature (e.g., location of the target signal feature in the sensor signal, time of occurrence). In some embodiments, the target signal feature recognition model may be a machine learning model. The target signal feature recognition model may be a trained machine learning model. The machine learning model may include various models and structures, such as a deep neural network model, a recurrent neural network model, a custom model structure, and the like.

In some embodiments, when training the target signal feature recognition model, signal feature spectra of a plurality of sensing signals with labels (or called labels) may be used as training data, and training may be performed by gradient descent, for example, so that parameters of the model may be learned. In some embodiments, the target signal feature recognition model may be trained in additional devices or modules.

In some embodiments, after identifying the target signal feature, the processing device 120 may determine when the target signal feature occurs. In some embodiments, after the processing apparatus 120 may determine the time at which the target signal feature occurs in the sensing signals generated by the at least two vibration sensing devices 110 disposed at different positions based on the foregoing steps, a time difference in the occurrence of the target signal feature in the sensing signals generated by the different vibration sensing devices 110 may be determined.

Step 230, determining the position of the vibration signal source based on the time difference. In some embodiments, step 230 may be performed by the location determination module 330.

In some embodiments, the processing apparatus 120 may determine a distance between the vibration signal source corresponding to the target signal characteristic and the vibration sensing device based on a time difference between the target signal characteristic and a transmission speed of the vibration signal, and further determine a position of the vibration signal source according to the distances between the at least two vibration sensing devices 110 and the vibration signal source. In some embodiments, the vibration signal of the present description is propagated in a solid medium, so the transmission speed of the vibration signal may be equivalent to the transmission speed of the vibration of mechanical vibration in the solid medium. In some embodiments, further details regarding determining the vibration transmission speed of mechanical vibrations in a solid medium may be found in the description of fig. 4, which is not repeated here.

In some embodiments, the processing device 120 may determine the location of the vibration signal source corresponding to the target signal feature using a machine learning model based on information related to the target signal feature in the sensor signal generated by the respective vibration sensing apparatus. In some embodiments, the processing device 120 may determine the location of the vibration signal source based on a location determination model. The processing device 120 may input information regarding the target signal characteristics (e.g., the location of the target signal characteristics in the sensor signal, the time of occurrence, etc.) to the location determination model. The output of the position determination model may include the position of the vibration signal source. In some embodiments, the location determination model may be a machine learning model. The position determination model may be a trained machine learning model. The machine learning model may include various models and structures, such as a deep neural network model, a recurrent neural network model, a custom model structure, and the like. In some embodiments, the training process of the position determination model is similar to that of other models, and will not be described here.

In some alternative embodiments, the processing device 120 may determine the location of the vibration signal source directly based on the signal characteristics of the sensing signal generated by the vibration sensing apparatus 110. For example, in the embodiment shown in fig. 7, the course 700 may be evenly divided into a number of sufficiently small areas. One or more vibration sensing devices 110 are placed in each area to collect a large number of vibration signals. And then marking the signal characteristics of the sensing signals corresponding to the vibration signals, and taking the position of the signal vibration source corresponding to the vibration signals acquired by each area as the label of the vibration signals acquired by each area. The processing device 120 may then train the machine learning model using the tagged vibration signal as a training sample. The processing device 120 may implement determining the location of the vibration signal source directly based on the signal characteristics using a trained machine learning model.

In some embodiments, the vibration signal source may be in motion, and the processing device 120 may determine a motion profile of the vibration signal source. For example, the vibration sensing device may receive a vibration signal generated by a specific vibration behavior of the vibration signal source each time and generate a corresponding sensing signal. For example, the processing device 120 may determine the location of each time the basketball is in contact with the playing surface based on the sensor signals and determine the trajectory of the basketball based on the plurality of locations.

In some embodiments, the processing device 120 may obtain the locations of the vibration signal source at a plurality of points in time during the movement. And determining the motion trail of the vibration signal source based on the positions of the vibration signal source at a plurality of time points. The position referred to herein is the position at which the vibration signal source generates the vibration signal. For example, a basketball in motion may be in contact with the playing surface at multiple points in time, each of which produces a corresponding vibration signal. The motion trail refers to the motion path of the vibration signal source in a certain period of time. In some embodiments, the processing device 120 may determine where the vibration signal source is located at a plurality of points in time based on the steps described in the method 200. And connecting the positions of the vibration signal sources at a plurality of time points according to a time sequence, wherein the connecting line is the motion track of the vibration signal sources. In some embodiments, the processing device 120 may store the acquired locations of the vibration signal sources at a plurality of points in time and corresponding points in time in the storage device 130.

In some embodiments, the processing device 120 may determine the next location of the vibration signal source based on the motion profile of the vibration signal source. In some embodiments, the next position may refer to the position where the vibration signal source is next generating the vibration signal. In other embodiments, the next position may also refer to the position of the vibration signal source at the next moment.

In some embodiments, the processing device 120 may determine a motion velocity and a motion acceleration of the vibration signal source at the current location based on the motion profile of the vibration signal. In the embodiment of the present specification, the current position may refer to a position at which the vibration signal source is located at the current time.

In some embodiments, the processing device 120 may determine the velocity and acceleration of the motion of the signal source at the current location based on the locations of the three vibratory signal sources in the motion profile. For example, the processing device 120 may select a position of the vibration signal source at the current point in time (denoted as position a) and a position of the vibration signal source at two consecutive points in time (denoted as position B and position C, respectively) before the current point in time from the motion trajectory. And establishing an equation related to the speed and the acceleration based on the time from the position B to the position A, the distance from the position B to the position A, the time from the position C to the position A and the distance from the position C to the position A of the vibration signal source, and solving the speed and the acceleration of the vibration signal source at the current position.

In some embodiments, the processing device 120 may determine the next location of the vibration signal source based on the movement velocity, movement acceleration, and current location of the vibration signal source at the current location. It will be appreciated that the motion speed and the motion acceleration are both vectors and have directions, and thus the next position of the vibration signal source can be determined by establishing equations relating the speed and acceleration based on the motion speed, the motion acceleration, the current position of the vibration signal source, and the time of movement to the next position.

In some embodiments, the processing device 120 may determine whether the vibration signal sources in the touch manipulation area of the touch manipulation apparatus are the same vibration signal source based on the sensing signal. In some embodiments, the processing device 120 may determine a time difference in receiving the vibration signal for at least three vibration sensing devices disposed at different locations on the touch manipulation device based on the sensing signal. In some embodiments, the processing device 120 may determine the location of the same vibration signal source in the touch manipulation area of the touch manipulation apparatus based on the time difference. In some embodiments, further details regarding determining the location of the same vibration signal source based on the time difference may be found in the description of fig. 5, which is not repeated here.

In some embodiments, the processing device 120 may determine whether the ball is in contact with the racket based on the sensing signal. In some embodiments, the processing device 120 may determine, based on the sensed signals, a time difference in receipt of the vibration signals from the ball in contact with the racket by at least three vibration sensing devices disposed at different locations on the racket. In some embodiments, the processing device 120 may determine whether the ball contact location (i.e., the ball striking location) with the racket is located in the recommended ball striking area based on the time difference. In some embodiments, the processing device 120 may issue a cue that the ball striking location is not in the recommended ball striking area in response to the ball striking location not being in the recommended ball striking area. In some embodiments, further details regarding determining whether the ball striking location is located in the recommended ball striking area based on the time difference may be found in the description of fig. 6, which is not repeated herein.

In some embodiments, the processing device 120 may determine whether a ball or a player is in contact with the playing surface based on the sensed signals. In some embodiments, the processing device 120 may determine the time difference in vibration signals received by at least three vibration sensing devices disposed at different locations on the playing surface from the ball or from contact of the player with the playing surface based on the sensed signals. In some embodiments, the processing device 120 may determine the location of the ball or player in the playing surface based on the time difference. In some embodiments, more details regarding determining the location of the same vibration signal source based on the time difference may be found in the description of fig. 7, which is not repeated herein.

In some embodiments, the processing device 120 may determine whether a dead spot exists on an object to be detected (e.g., a rail) based on the sensing signal. In some embodiments, the processing device 120 may determine a time difference in receiving vibration signals from the dead pixel generation by at least two vibration sensing apparatuses disposed at different positions on the object to be detected based on the sensing signals. In some embodiments, the processing device 120 may determine the dead pixel location based on the time difference. In some embodiments, further details regarding determining the location of the dead spot on the rail based on the time difference may be found in the description of fig. 8, which is not repeated herein.

FIG. 3 is an exemplary block diagram of a vibration signal source positioning system according to some embodiments of the present description. As shown in fig. 3, the vibration signal source-locating system 300 may include a sensing signal acquisition module 310, a time difference determination module 320, and a position determination module 330. In some embodiments, the vibration signal source positioning system 300 may be implemented by the vibration signal source positioning system 100 (e.g., the processing device 120) shown in FIG. 1.

In some embodiments, the sensing signal acquisition module 310 may be configured to acquire sensing signals of at least two vibration sensing devices located at different positions, each including a vibration signal generated by vibration from the same vibration signal source.

In some embodiments, the time difference determination module 320 may be configured to determine a time difference in receipt of the vibration signal by at least two vibration sensing devices located at different locations based on the sensing signal.

In some embodiments, the position determination module 330 may be configured to determine the position of the vibration signal source based on the time difference.

It should be understood that the system shown in fig. 3 and its modules may be implemented in a variety of ways. For example, in some embodiments, the system and its modules may be implemented in hardware, software, or a combination of software and hardware. Wherein the hardware portion may be implemented using dedicated logic; the software portions may then be stored in a memory and executed by a suitable instruction execution system, such as a microprocessor or special purpose design hardware. Those skilled in the art will appreciate that the methods and systems described above may be implemented using computer-executable instructions and/or embodied in processor control code. The system and its modules of the present specification may be implemented not only in hardware circuitry, such as very large scale integrated circuits or gate arrays, etc., but also in software, such as executed by various types of processors, and may be implemented by a combination of the above hardware circuitry and software (e.g., firmware).

It should be noted that the above description of the system and its modules is for convenience of description only and is not intended to limit the present description to the scope of the illustrated embodiments. It will be appreciated by those skilled in the art that, given the principles of the system, various modules may be combined arbitrarily or a subsystem may be constructed in connection with other modules without departing from such principles. For example, in some embodiments, the time difference determination module 320 and the location determination module 330 may be integrated in one module. For another example, each module may share one storage device 130, and each module may have a respective storage device 130. Such variations are within the scope of the present description.

In some embodiments, the vibration sensing device 110 may collect vibration signals of a specific area. The specific region may be a region for receiving a vibration signal, and may also be referred to as a vibration receiving region. In some embodiments, the vibration sensing device 110 may acquire a vibration signal of the vibration receiving area and generate a corresponding sensing signal.

In some embodiments, at least two vibration sensing devices 110 may be respectively connected to the vibration receiving areas through solid media. The vibration signal received by the vibration receiving area may be transmitted to the vibration sensing device 110 through the solid medium. At least two vibration sensing devices 110 may generate a sensing signal in response to vibrations generated by the same vibration signal source in the vibration receiving area. In some embodiments, the solid medium may be metal (e.g., stainless steel, aluminum alloy, etc.), non-metal (e.g., wood, plastic, etc.), or the like. For example, in the embodiment shown in fig. 6, the net of the racket 600 may be a vibration receiving area, and the fourth vibration sensing device 610, the fifth vibration sensing device 620, and the sixth vibration sensing device may be provided on the net of the racket 600 or the frame of the racket 600 and generate the sensing signal in response to vibration generated at the vibration receiving area by the same vibration signal source (e.g., tennis ball). In some embodiments, the vibration receiving area may be a specific area on the solid medium. For example, in the embodiment shown in fig. 7, the solid medium may be a playing surface, and the seventh vibration sensing device 710, the eighth vibration sensing device 720, and the ninth vibration sensing device 730 may be disposed at an upper half area and a lower half area of the playing surface, respectively.

In some embodiments, at least two vibration sensing devices 110 may be fixedly attached to the solid medium in a variety of ways. For example, at least two vibration sensing devices 110 may be fixedly connected to the solid medium by at least one of bonding, embedding, welding, riveting, screw connection, magnetic attachment, respectively. In some cases, good and firm contact of the vibration sensing device 110 with the solid medium may be ensured, so that the vibration signal is accurately and efficiently transferred from the solid medium to the vibration sensing device 110. For example, in the embodiment shown in fig. 6, the fourth vibration sensing device 610, the fifth vibration sensing device 620, and the sixth vibration sensing device 630 may be adhered to the net of the racket 600.

In some embodiments, at least two vibration sensing devices 110 may be separately removable from the solid media. For example, at least two vibration sensing devices 110 may be coupled to the solid medium by a clamp connection, a magnetic attachment connection, a snap connection, a threaded connection, or the like. In some cases, the vibration sensing device 110 may be conveniently removed by removably coupling the vibration sensing device 110 to a solid medium. In other cases, the vibration sensing device 110 may be removably coupled to a solid medium to facilitate mounting the vibration sensing device 110 on any solid medium to facilitate detection of vibration signals generated in a particular vibration receiving area. For example, at least three vibration sensing devices 110 may be individually mounted on the table top (at least three vibration sensing devices are required since the table top may be regarded as a two-dimensional scene) to determine the position of the vibration signal source on the table top by the vibration sensing devices 110.

In some embodiments, when the vibration sensing device 110 is connected to the vibration receiving area through a solid medium, the vibration signal needs to be transmitted through the solid medium to be transmitted to the vibration sensing device 110. On the basis of the time difference between the target signal characteristics that has been determined in the foregoing, the transmission speed of the vibration signal in the solid medium (i.e., the vibration transmission speed of the solid medium) is also acquired. The system 100 may determine the distance between the vibration signal source and the vibration sensing device 110 based on the time difference between the target signal characteristics and the transmission speed of the vibration signal in the solid medium, thereby determining the location of the vibration signal source.

FIG. 4 is an exemplary flow chart for determining the location of a vibration signal source according to some embodiments of the present description. In some embodiments, the process 400 may be performed by the vibration signal source positioning system 100 (e.g., the processing device 120). For example, the flow 400 may be stored in a storage device (e.g., the storage device 130) in the form of a program or instructions that, when executed by the vibration signal source positioning system 100 (e.g., the processing device 120), may implement the flow 400.

In step 410, the vibration transfer rate of the solid medium is obtained. In some embodiments, step 410 may be performed by the location determination module 330.

The vibration transmission speed of the solid medium refers to the transmission speed of mechanical vibration in the solid medium.

In some embodiments, the processing device 120 may determine the vibration transfer rate of the solid medium based on information entered by the user through the user terminal 140.

In some embodiments, processing device 120 may obtain association information for the solid medium. Based on the association information of the solid medium, a vibration transmission speed corresponding to the solid medium is determined. In some embodiments, the association information of the solid medium may include multiple types of information. For example, dimensional information (including but not limited to volume, thickness, length, etc. information) of the solid medium. As another example, material information of the solid medium (including information of the type of the solid medium, the vibration transmission speed of the material of the solid medium, and the like) and the shape of the solid medium. Wherein the material of the solid medium refers to the material composing the solid medium. In some embodiments, the processing device may obtain association information of the solid medium entered by the user through the user terminal 140.

In some embodiments, when the associated information of the solid medium acquired by the processing device 120 includes a vibration transfer rate of a material of the solid medium, the processing device may directly take it as the vibration transfer rate of the solid medium. For example, in the application scenario shown in fig. 5, if the associated information of the solid medium input by the user includes a material displaying the touch screen, the processing device may determine a vibration transmission speed corresponding to the material from the storage device 130 (e.g., database), and directly use the vibration transmission speed as the vibration transmission speed of the solid medium. In some embodiments, when the acquired associated information of the solid medium does not include the vibration transfer rate of the material of the solid medium, the processing device 120 may determine the vibration transfer rate of the solid medium from the known associated information of the solid medium. Illustratively, the associated information of the solid medium input by the user includes information of the size of the solid medium, the kind of material, the shape of the solid medium, and the like. The processing device may select a material of the solid medium or a vibration transmission speed of the material of the solid medium matching the above information from the storage device 130 (e.g., database) based on the above information. For example, the processing device 120 determines that the solid medium is a basketball court based on information such as the size and shape of the solid medium entered by the user, obtains material information (e.g., material type, vibration transmission rate of the material, etc.) for the existing basketball court from the storage device 130, and determines the vibration transmission rate of the solid medium based thereon.

In some embodiments, the processing device 120 may obtain the vibration transmission speed of the solid medium by calculation based on the distance traveled by the vibration signal to be transmitted in the solid medium and the time elapsed.

In some embodiments, the processing device 120 may obtain a test distance between the test vibration signal source and the test vibration sensing apparatus and a test time at which the test vibration sensing apparatus receives the test vibration signal. The vibration transfer rate of the solid medium is then determined based on the test time and the test distance.

The test vibration signal source refers to a vibration signal source disposed at a known location of the fixed media. Test vibration sensing means refers to a vibration sensing means arranged at another known location of the solid medium. The test vibration sensing device can receive a test vibration signal generated by vibration of the test vibration signal source and generate a corresponding test sensing signal. In some embodiments, the test distance between the test vibration signal source and the test vibration sensing device may be determined directly by measurement.

In some embodiments, the processing device 120 may determine a test time at which the test vibration signal was received by the test vibration sensing device based on the test sensing signal generated by the test vibration sensing device. For example, the processing device 120 may identify signal features in the test sensor signal. And then identifying a target signal characteristic corresponding to the test vibration signal source from the signal characteristics. And finally, determining the time from the vibration signal generated by the test signal vibration source to the occurrence of the target signal characteristic as the test time. In some embodiments, after the test time and the test distance are obtained, the processing device 120 may divide the test distance by the test time to obtain the vibration transfer speed of the solid medium.

Step 420, determining a position of the vibration signal source based on a time difference between the vibration transfer rate of the solid medium and the target signal characteristic. In some embodiments, step 420 may be performed by the location determination module 330.

In some embodiments, the processing device 120 may determine the location of the vibration signal source based on a time difference between the vibration transfer rate of the solid medium and the target signal characteristic. For example, in a one-dimensional scenario (e.g., rail 800 shown in fig. 8), processing device 120 may determine a distance difference between two vibration sensing devices 110 and the same vibration signal source based on a time difference between a vibration transfer rate of the solid medium and the target signal characteristic, and then determine a location of the vibration signal source. For another example, in a two-dimensional scenario (e.g., the touch manipulation area 540 shown in fig. 5), the processing device 120 may determine the location of the vibration signal source based on time differences between the target signal characteristics received by the at least three vibration sensing devices 110. For example, taking fig. 5 as an example, the processing apparatus 120 may obtain a time difference between the first vibration sensing device 510 and the second vibration sensing device 520 receiving the target signal characteristic, a time difference between the first vibration sensing device 510 and the third vibration sensing device 530 receiving the target signal characteristic, and a time difference between the second vibration sensing device 520 and the third vibration sensing device 530 receiving the target signal characteristic, respectively. The position of the vibration signal source is then determined based on the three time differences.

In some embodiments, the processing device may apply the flow 400 in various scenarios to determine the location of the vibration signal source.

Fig. 5 is a schematic view of a touch control device provided with vibration sensing devices according to some embodiments of the present description. As shown in fig. 5, the touch manipulation device 500 may include a touch manipulation area 540, and the touch manipulation area 540 may refer to an area for receiving an instruction to control the touch manipulation device 500. In some embodiments, the contact manipulation region 540 may be referred to as a vibration receiving region. At least three vibration sensing devices (e.g., a first vibration sensing device 510, a second vibration sensing device 520, a third vibration sensing device 530) may be provided on the touch manipulation device 500 for receiving vibration signals generated within the touch manipulation area 540. In some embodiments, the user may control the touch manipulation device 500 by performing a specific operation (e.g., clicking, scratching, tapping, etc.) on the touch manipulation area 540. In some embodiments, one or more vibration sensing devices may be controlled by the system 100. For example, the processing device 120 of the system 100 may control one or more vibration sensing devices to operate (e.g., collect vibration signals). For another example, the processing device 120 of the system 100 may obtain the sensing signal from one or more vibration sensing devices.

In some embodiments, when it is desired to locate a vibration signal source in a two-dimensional scene, at least three vibration sensing devices disposed at different locations are required. For example, in the embodiment shown in fig. 5, the first vibration sensing device 510, the second vibration sensing device 520, and the third vibration sensing device 530 are provided at three different positions of the touch manipulation device 500.

In some embodiments, the touch manipulation apparatus 500 may include a touch pad, a smart mobile phone, a mobile computer, a dance mat, or the like. As shown in fig. 5, in some exemplary application scenarios, the touch control device 500 may be a touch tablet, where the touch control area 540 may be an area of the touch tablet where a touch screen is displayed. The user can perform specific operations on the display touch screen to control the touch pad. In some embodiments, at least three vibration sensing devices may be disposed at any location of the touch tablet computer. For example, the first vibration sensing device 510, the second vibration sensing device 520, and the third vibration sensing device 530 may be disposed inside the touch pad computer and directly connected with the display touch screen so as to receive vibrations generated by the display touch screen. In this embodiment, the display touch screen is a solid medium for transmitting vibration signals.

In some embodiments, the user may directly contact the display touch screen through any part of his body (e.g., finger, elbow, back of hand, foot). Contact with the display touch screen may also be made by other means (e.g., a stylus, glove worn on the hand, etc.). For convenience of description, the present specification will be described by taking an example in which a user makes contact with a contact manipulation area through a finger. In some embodiments, when a user performs a specific operation on the display touch screen using a finger, a vibration signal is generated, and the vibration sensing devices (e.g., the first vibration sensing device 510, the second vibration sensing device 520, and the second vibration sensing device 520) receive the vibration signal and generate corresponding sensing signals. In some embodiments, the system 100 may identify signal characteristics of the sensing signal and determine whether the signal characteristics satisfy a first preset characteristic condition. When the first preset condition is met, the system 100 may determine that the portion of the signal characteristic is the target signal characteristic. In this embodiment, the target signal feature may refer to a signal feature corresponding to a vibration signal generated by the contact of the finger with the display touch screen. In some embodiments, the target signal characteristic may be obtained through testing. For example, the test vibration sensing device is arranged on the touch tablet computer, a mobile phone is utilized to perform specific operation on the display touch screen, and signal characteristics corresponding to sensing signals generated by the test vibration sensing device are used as target signal characteristics. In some embodiments, when the system 100 recognizes the presence of a target signal feature in the sensing signals generated by the three vibration sensing devices, the position of the finger may be determined based on the time difference in the presence of the target signal feature. For example, the system 100 may calculate the time difference between the sensing signals generated by each two of the three vibration sensing devices, respectively, and determine the position of the finger therefrom.

In some embodiments, the system 100 may also determine the type of user-specific operation based on the signal characteristics of the sensing signal generated by the vibration sensing device. For example, the system 100 may analyze the signal characteristics of the sensing signal based on parameters such as the number of vibration peaks, the interval time between adjacent vibration peaks, the frequency component, the signal duration, etc., to determine that the operation performed by the user is a click, wipe, or continuous press operation.

For further details on how the system 100 determines the location of the vibration signal source based on the sensor signals of the vibration sensing devices at different locations, reference may be made to the descriptions of fig. 2 and 4, which are not repeated here.

Fig. 6 is a schematic view of a racquet provided with vibration sensing devices according to some embodiments of the present description. As shown in FIG. 6, the racquet 600 may include a recommended ball striking area 640 (i.e., within the dashed area of the figure). The recommended hitting area may refer to an area suitable for hitting a ball. At least three vibration sensing devices (e.g., a fourth vibration sensing device 610, a fifth vibration sensing device 620, a sixth vibration sensing device 630) may be provided on the racket 600. For example, the vibration sensing device may be provided on the net of the racket 600. The vibration sensing device may be used to receive vibration signals generated by contact of the ball with the racket 600. In some embodiments, one or more vibration sensing devices may be controlled by the system 100. The specific control manner may be referred to in fig. 5 and the description thereof, and will not be repeated here.

In some embodiments, when a player hits a ball, a vibration signal is generated when the ball contacts the racquet 600 (including a frame, handle, net, etc.). The vibration sensing devices (e.g., fourth vibration sensing device 610, fifth vibration sensing device 620, and sixth vibration sensing device 630) may receive the vibration signals and generate corresponding sensing signals. In some examples, the system 100 may identify signal characteristics of the sensory signals and determine whether the ball striking location is on the net based on the signal characteristics. In some embodiments, the system 100 may determine whether the vibration signal source is a ball based on the signal characteristics of the sensing signal. For example, the system 100 may take as a target signal feature a vibration signal generated by contact of a ball with the net of the racquet 600. Judging whether the signal characteristics of the sensing signals generated by the vibration sensing device meet second preset characteristic conditions, and determining the signal characteristics as target signal characteristics when the second preset conditions are met. Since the vibration signal source corresponding to the signal characteristics is a ball, the batting position can be determined to be positioned on the racket net.

In some embodiments, the system 100 may be based on a vibration sensing device (e.g., the fourth vibration sensing device 610, the fifth vibration sensing device 620, and the sixth vibration sensing device 630) determines whether the ball striking position is within the recommended ball striking area 640. In some embodiments, the steps for determining whether the ball striking location is within the recommended ball striking area 640 with respect to the system 100 may be the same as or similar to those described with respect to fig. 2 and 4, and will not be repeated here. In some embodiments, when the system 100 determines that the ball striking location is not in the recommended ball striking area 640, the user terminal 140 may be controlled to perform a corresponding operation. Exemplary operations may include issuing a misuse cue, recording a shot location, etc. For example, the system 100 may issue a "mislocation of the ball" alert in the form of voice, text, etc. through the user terminal 140 based on the ball not being located within the recommended ball striking area 640 with the racket 600.

Fig. 7 is a schematic view of a pitch provided with vibration sensing devices according to some embodiments of the present description. As shown in fig. 7, the pitch 700 can include at least three vibration sensing devices (e.g., a seventh vibration sensing device 710, an eighth vibration sensing device 720, and a ninth vibration sensing device 730). The vibration sensing device may be used to receive vibration signals generated by a player (e.g., the player's foot) and the ball contacting the playing surface and generate corresponding sensing signals. In some embodiments, one or more vibration sensing devices may be controlled by the system 100. The specific control manner may be referred to in fig. 5 and the description thereof, and will not be repeated here.

In some embodiments, the types of pitch 700 may include football pitch, basketball pitch, badminton pitch, and the like. As shown in fig. 7, in some exemplary application scenarios, the course 700 may be a basketball course. The playing field 700 may include a playing field and corresponding equipment (e.g., nets, basketball stands, etc.) disposed on the playing field. A seventh vibration sensing device 710 is provided in the upper half of the course 700, and an eighth vibration sensing device 720 and a ninth vibration sensing device 730 are provided in the lower half of the course 700, respectively.

In some embodiments, the system 100, after acquiring the sensing signals generated by the vibration sensing devices (e.g., the seventh vibration sensing device 710, the eighth vibration sensing device 720, and the ninth vibration sensing device 730), may identify signal characteristics of the sensing signals and determine target signal characteristics corresponding to the vibration signal source. In this embodiment, the vibration signal source may include a player (e.g., a player's foot) and a ball. The signal characteristic corresponding to the player may be referred to as a first target signal characteristic. The signal characteristic corresponding to the ball may be referred to as a second target signal characteristic. In some embodiments, the first target signal characteristic and the second target signal characteristic may be obtained by testing. For example, a ball may be thrown onto a playing surface and vibration signals generated by contact of the ball with the playing surface are acquired using a vibration sensing device. A signal characteristic of a sensing signal generated by the vibration sensing device is identified and used as a second target signal characteristic. In some embodiments, the system 100 may store the acquired first target signal characteristic and second target signal characteristic in the storage device 130.

In some embodiments, the system 100 may determine whether the signal characteristic of the sensing signal meets a third preset characteristic condition or a fourth preset characteristic condition. When the signal characteristics meet a third preset characteristic condition, the part of the signal characteristics can be determined to be the first target signal characteristics, and the corresponding vibration signal source is a player. When the signal characteristic meets a fourth preset characteristic condition, the system 100 may determine that the portion of the signal characteristic is a second target signal characteristic, and the corresponding vibration signal source is a sphere. In some embodiments, when the system 100 determines that the sensing signals of at least three vibration sensing devices are present in the same target signal characteristic, the location of the vibration signal source corresponding to the target signal characteristic may be determined based on the time difference in the presence of the target signal characteristic. Illustratively, the system 100 determines that the sensed signals of the seventh vibration sensing device 710, the eighth vibration sensing device 720, and the ninth vibration sensing device 730 all exhibit the first target signal characteristic. The system 100 can determine the time difference based on the time that the portion of the signal characteristic appears in the sensed signal of each vibration sensing device, and thus the location of the player on the playing surface.

In some embodiments, the system 100 may also determine the type of specific operations that the player is performing within the course. Specific operations may include taking off, squatting, sprinting, falling, etc. In some embodiments, after the system 100 recognizes that the sensed signal includes a signal characteristic corresponding to the first target signal characteristic, a specific operation of the player may be determined further based on the portion of the signal characteristic. In this embodiment, the vibration signal generated when the player performs operations such as taking off and squatting is different, and thus the signal characteristics of the corresponding sensor signal are also different. The system 100 may determine the particular type of operation being performed by the player based on the differences in signal characteristics. In some embodiments, the system 100 may determine the player's trajectory based on the player's position at a plurality of points in time. In some embodiments, system 100 may determine a particular operation of the player based on the player's trajectory of motion. For example, the system 100 may determine the speed of the player's motion from the player's motion profile, and when the player's speed of motion is greater than the speed threshold, the system 100 may determine that the player is performing a sprint.

In some embodiments, the vibration signal source positioning method provided in the present specification may also be used to determine the position of a dead pixel of an object to be detected. In some embodiments, the vibration signal generated by the vibration of the object to be detected is received by connecting the vibration sensing device 110 to the object to be detected. And further determining the dead point according to the sensing signals corresponding to the vibration signals. In the present embodiment, the vibration signal may be generated when the object to be detected performs a specific vibration behavior (a dead spot of the object to be detected while the specific vibration behavior). Since the signal characteristics of the sensing signal corresponding to the vibration signal generated by the dead pixel of the object to be detected are different from the signal characteristics of the sensing signal corresponding to the vibration signal generated by the normal portion of the object to be detected, the position of the dead pixel can be determined by analyzing the signal characteristics of the sensing signal corresponding to the vibration signal received by the vibration sensing device. The object to be detected may be a main body that needs to be detected to determine the position of the dead pixel. For example, in the embodiment shown in fig. 8, the object to be detected may be a rail 800. The dead pixel may refer to a failed location on the object to be detected. For example, in the embodiment shown in FIG. 8, the dead spot 830 may be the location on the rail 800 where the break occurred. In some embodiments, the signal features corresponding to dead spots may also be referred to as outlier features. The abnormal signal characteristics may refer to related information capable of reflecting characteristics of a vibration signal generated by the dead pixel vibration. In some embodiments, the target signal characteristics may include outlier signal characteristics corresponding to the outliers. In some embodiments, the signal characteristics of the vibration signal received by the vibration sensing device connected to the object to be detected may include abnormal signal characteristics and other types of signal characteristics. For example, a signal characteristic of a vibration signal generated corresponding to a partial vibration of an object to be detected other than a dead pixel, and thus may also be referred to as a normal signal characteristic.

In some embodiments, the distinction between abnormal signal features and normal signal features may include, but is not limited to, the number of vibration peaks, the spacing time of adjacent vibration peaks, frequency content, signal duration, and the like. In some embodiments, the system 100 may determine whether the signal characteristic satisfies a fifth preset characteristic condition. When the fifth preset feature condition is satisfied, it may be determined that the signal feature is an abnormal signal feature. And further determining the vibration signal source as a dead pixel. For example, the system 100 may compare all signal features with normal signal features, and if the signal features are different from the normal signal features, may determine that the signal features are target signal features (i.e., abnormal signal features corresponding to dead spots).

For convenience of description, this specification will further describe how to determine the dead spot position of the object to be detected, taking the rail as an example.

Fig. 8 is a schematic view of a rail provided with vibration sensing devices according to some embodiments of the present disclosure. As shown in fig. 8, rail 800 has at least one dead pixel, such as dead pixel 830. In some embodiments, rail 800 may be considered a line segment extending along its length, and dead spot 830 may be considered a point on the line segment. In some embodiments, at least two vibration sensing devices (e.g., tenth vibration sensing device 810 and eleventh vibration sensing device 820) are disposed at different locations on the rail. In some embodiments, one or more vibration sensing devices may be controlled by the system 100. The specific control manner may be referred to in fig. 5 and the description thereof, and will not be repeated here.

It should be noted that, since the rail 800 may be regarded as a line segment extending along the length direction thereof, determining the position of the dead pixel 830 on the rail 800 may be equivalent to determining the position of a point in a one-dimensional scene. So in a one-dimensional scene, two vibration sensing devices can determine the position of the vibration signal source. For example, two vibration sensing devices are respectively used as circle centers, the distance between each vibration sensing device and the vibration signal source is used as a radius to form a circle, and the intersection point of the line segment and the two circles is the position of the vibration signal source.

In some embodiments, the system 100 may receive vibration signals generated when the rail 800 vibrates through at least two vibration sensing devices (e.g., the tenth vibration sensing device 810 and the eleventh vibration sensing device 820) disposed at different locations of the rail 800. Since the dead spot 830 on the rail 800 vibrates along with the vibration of the rail 800, the dead spot of the rail also generates a corresponding vibration signal. The system 100 may identify signal features in the sensing signal generated after the vibration sensing device receives the vibration signals. And identifies a target signal feature corresponding to the dead pixel 830 among the signal features. Finally, the position of the dead pixel 830 is determined based on the time difference between the target signal characteristics in the sensing signals generated by the tenth vibration sensing device 810 and the eleventh vibration sensing device 820.

In some embodiments, a rough estimate of the location of the dead pixel 830 may be made before the vibration sensing device is provided. For example, a worker may determine that the dead spot 830 is approximately on the portion of the rail 800 shown in FIG. 8. Tenth vibration sensing device 810 and eleventh vibration sensing device 820 can then be positioned at each end of the section of rail 800. After the setup, the exact position of the dead pixel 830 is determined by the tenth vibration sensing device 810 and the eleventh vibration sensing device 820. In some cases, the position of the dead pixel 830 is roughly estimated before the vibration sensing devices are provided, so that the number of the vibration sensing devices required can be reduced, and the detection cost can be reduced.

In other embodiments, a plurality of vibration sensing devices may be disposed on rail 800 at equal intervals along the length of rail 800. In this embodiment, the exact location of the dead spot is determined by receiving a vibration signal generated by vibration of the rail 800.

In some embodiments, the system 100 may determine whether the signal characteristic of the sensing signal meets a sixth preset characteristic condition, thereby determining whether an abnormal signal characteristic occurs in the sensing signal. For example, the system 100 may determine the signal feature based on the number of vibration peaks, the interval time between adjacent vibration peaks, the frequency component, the signal duration, and the like, and if the sixth preset feature condition is satisfied (e.g., the frequency components are different or the similarity of the frequency components does not reach the threshold value), the system 100 may determine the signal feature as an abnormal signal feature.

In some embodiments, the system 100 may also determine the anomaly signal characteristics based on an anomaly signal characteristic determination model. The system 100 may input the signal characteristics of the sensing signal of the vibration sensing device due to the reception of the vibration signal to the abnormal signal characteristic determination model. The output of the anomaly signal feature determination model may include whether the anomaly signal feature is an anomaly signal feature. In some embodiments, the anomaly signal feature determination model may be a machine learning model. In some embodiments, further details regarding the acquisition and training of the abnormal signal feature determination model may be found in the descriptions of other embodiments of the present specification, and are not repeated herein.

In some embodiments, the system 100 may determine the location of the dead spot 830 based on the time difference between the abnormal signal characteristics of the sensor signals generated by at least two vibration sensing devices disposed at different locations of the rail 800. In this embodiment, the dead pixel may be equal to the vibration signal source, and the detailed description of how to determine the vibration signal source based on the time difference is already described in fig. 2 and 4, which will not be repeated here.

In some embodiments, the system 100 may also be applied in other usage scenarios. For example, smart home, smart wearable field, etc.

In some embodiments, the vibration sensing device 110 may be integrated or provided (e.g., affixed, snap-fit, etc.) in the wearable apparatus. When the user wears the wearable device, the vibration sensing device can receive vibration signals generated by physical activities of the user and transmitted through bones or muscles of the user more completely and clearly. In some embodiments, the wearable device may be glasses, headphones, or the like.

Illustratively, the wearable device may include headphones (e.g., in-ear headphones). One or more components or units of the system 100 may be integrated on or communicatively coupled with the headset. For example, the earphone is provided with a vibration sensing device 110 for collecting vibration signals generated by physical activities of the user. In this embodiment, the physical activity of the user may be a tap, friction, or chewing swallowing, among others, involving the user's teeth. The user may generate a vibration signal when tapping, rubbing a tooth, or chewing a swallow. The vibration signal is transmitted to the vibration sensing device via the user's bones or facial muscles.

In some embodiments, when a user chews and swallows food, the system 100 may determine the type of food based on the signal characteristics of the sensing signal generated by the vibration sensing device 110. In some embodiments, the system 100 may determine whether the signal characteristic meets a seventh preset characteristic condition corresponding to the food type. When the seventh preset feature condition is satisfied, a food type corresponding to the signal feature may be determined.

In some embodiments, the system 100 may determine the location of tooth strike, friction, based on the signal characteristics of the sensing signal generated by the vibration sensing device 110. In this embodiment, the striking and rubbing of the teeth occurs between the teeth of the upper oral cavity and the teeth of the lower oral cavity, and the vibration signal source corresponding to the striking and rubbing of the teeth can be obtained by the embodiment in the present specification. In some embodiments, the headset may include a left ear portion and a right ear portion, both of which are provided with a vibration sensing device 110. The system 100 can identify the time difference between the target signal characteristics in the sensor signals generated by the two vibration sensing devices 110 to determine the location of tooth strike, friction. The target signal characteristic may correspond to a vibration signal generated by tooth tapping, friction.

In some embodiments, the system 100 may also be applied in smart home scenarios. For example, a smart home may include a smart light. The user can control the smart lamp by performing a specific operation on the surface of the smart lamp. The intelligent light communicates/connects with one or more other components of the system 100. At least three vibration sensing devices 110 may be provided on the smart lamp for detecting vibration signals generated when a user contacts the smart lamp. In some embodiments, the system 100 may determine the location of the user (e.g., the user's finger) in contact with the smart light based on the target signal characteristics of the sensing signals generated by the at least three vibration sensing devices 110. The target signal characteristic may correspond to a vibration signal generated by a user's finger in contact with the smart light surface.

While the basic concepts have been described above, it will be apparent to those skilled in the art that the foregoing disclosure is by way of example only and is not intended to be limiting. Although not explicitly described herein, various modifications, improvements, and adaptations to the present disclosure may occur to one skilled in the art. Such modifications, improvements, and modifications are intended to be suggested within this specification, and therefore, such modifications, improvements, and modifications are intended to be included within the spirit and scope of the exemplary embodiments of the present invention.

Meanwhile, the specification uses specific words to describe the embodiments of the specification. Reference to "one embodiment," "an embodiment," and/or "some embodiments" means that a particular feature, structure, or characteristic is associated with at least one embodiment of the present description. Thus, it should be emphasized and should be appreciated that two or more references to "an embodiment" or "one embodiment" or "an alternative embodiment" in various positions in this specification are not necessarily referring to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of the present description may be combined as suitable.

Furthermore, those skilled in the art will appreciate that the various aspects of the specification can be illustrated and described in terms of several patentable categories or circumstances, including any novel and useful procedures, machines, products, or materials, or any novel and useful modifications thereof. Accordingly, aspects of the present description may be performed entirely by hardware, entirely by software (including firmware, resident software, micro-code, etc.), or by a combination of hardware and software. The above hardware or software may be referred to as a "data block," module, "" engine, "" unit, "" component, "or" system. Furthermore, aspects of the specification may take the form of a computer product, comprising computer-readable program code, embodied in one or more computer-readable media.

Furthermore, the order in which the elements and sequences are processed, the use of numerical letters, or other designations in the description are not intended to limit the order in which the processes and methods of the description are performed unless explicitly recited in the claims. While certain presently useful inventive embodiments have been discussed in the foregoing disclosure, by way of various examples, it is to be understood that such details are merely illustrative and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover all modifications and equivalent arrangements included within the spirit and scope of the embodiments of the present disclosure. For example, while the system components described above may be implemented by hardware devices, they may also be implemented solely by software solutions, such as installing the described system on an existing server or mobile device.

Likewise, it should be noted that in order to simplify the presentation disclosed in this specification and thereby aid in understanding one or more inventive embodiments, various features are sometimes grouped together in a single embodiment, figure, or description thereof. This method of disclosure, however, is not intended to imply that more features than are presented in the claims are required for the present description. Indeed, less than all of the features of a single embodiment disclosed above.

In some embodiments, numbers describing the components, number of attributes are used, it being understood that such numbers being used in the description of embodiments, in some examples, are modified with the modifier "about," "approximately," or "substantially," etc. Unless otherwise indicated, "about," "approximately," or "substantially" indicate that the number allows for a 20% variation. Accordingly, in some embodiments, numerical data used in the specification and claims is approximations that may vary depending upon the desired properties sought to be obtained by the individual embodiments. In some embodiments, the numerical data should take into account the specified significant digits and employ a method for preserving the general number of digits. Although the numerical ranges and data used in some embodiments of the present disclosure are approximations, in particular embodiments, the settings of such numerical values are as precise as possible.

Finally, it should be understood that the embodiments described in this specification are merely illustrative of the principles of the embodiments of this specification. Other variations are possible within the scope of this description. Thus, by way of example, and not limitation, alternative configurations of embodiments of the present specification may be considered as consistent with the teachings of the present specification. Accordingly, the embodiments of the present specification are not limited to only the embodiments explicitly described and depicted in the present specification.

Claims

1. A method of vibration signal source localization, the method comprising:

acquiring sensing signals of at least two vibration sensing devices positioned at different positions, wherein each sensing signal comprises a vibration signal generated by vibration of the same vibration signal source;

determining a time difference of the vibration signals received by the at least two vibration sensing devices positioned at different positions based on the sensing signals; and

based on the time difference, a location of the vibration signal source is determined.

2. The method of claim 1, the determining, based on the sensing signals, a time difference in receipt of the vibration signals by the at least two vibration sensing devices located at different locations comprising:

identifying a signal characteristic of the sensing signal;

identifying a target signal characteristic corresponding to the vibration signal source from the signal characteristics;

a time difference between the target signal characteristics is determined.

3. The method of claim 2, the identifying signal characteristics of the sensing signal comprising:

the signal characteristics of the sensing signal are determined based on the spectrum of the sensing signal.

4. The method of claim 2, the identifying a target signal feature of the signal features that corresponds to the vibration signal source further comprising:

And identifying target signal characteristics in the sensing signals by adopting a target signal characteristic identification model, wherein the target signal characteristic identification model is a machine learning model.

5. The method of claim 1, the method further comprising:

acquiring positions of the vibration signal source at a plurality of time points;

and determining the motion trail of the vibration signal source based on the positions of the vibration signal source at the plurality of time points.

6. The method of claim 5, the method further comprising:

and determining the next position of the vibration signal source based on the motion trail of the vibration signal source.

7. The method of claim 6, the determining a next position of the vibration signal source based on a motion profile of the vibration signal source comprising:

determining the motion speed and the motion acceleration of the vibration signal source at the current position based on the motion track of the vibration signal;

a next position of the vibration signal source is determined based on a movement speed, a movement acceleration of the vibration signal source at the current position, and the current position of the vibration signal source.

8. The method of claim 2, wherein the at least two vibration sensing devices located at different positions are each connected to a vibration receiving area by a solid medium, and the sensing signals are generated in response to vibrations generated in the vibration receiving area by the same vibration signal source.

9. The method of claim 8, wherein the at least two vibration sensing devices located at different positions are fixedly connected to the solid medium by at least one of bonding, inlaying, welding, riveting, and screw connection, respectively.

10. The method of claim 8, wherein the at least two vibration sensing devices located at different positions are respectively detachable from the solid medium.

11. The method of claim 9 or 10, the determining the location of the vibration signal source based on the time difference comprising:

acquiring the vibration transmission speed of the solid medium; and

the position of the vibration signal source is determined based on the time difference between the vibration transfer speed of the solid medium and the target signal characteristic.

12. The method of claim 11, the obtaining the vibration transfer rate of the solid medium comprising:

acquiring the associated information of the solid medium; and

based on the association information of the solid medium, a vibration transmission speed corresponding to the solid medium is determined.

13. The method of claim 12, the associated information of the solid medium comprising at least a size of the solid medium, a type of material of the solid medium, a vibration transfer rate of the material of the solid medium, and a shape of the solid medium.

14. The method of claim 11, the obtaining the vibration transfer speed of the solid medium further comprising:

acquiring a test distance between a test vibration signal source and a test vibration sensing device;

acquiring the test time of the test vibration signal received by the test vibration sensing device;

and determining the vibration transmission speed of the solid medium based on the test time and the test distance.

15. The method of claim 9 or 10, at least three of said vibration sensing devices being disposed at different locations of a touch manipulation device, respectively, said touch manipulation device comprising a touch manipulation area, at least three of said vibration sensing devices generating said sensing signals in response to vibrations of the same vibration signal source at said touch manipulation area.

16. The method of claim 9 or 10, at least three of the vibration sensing devices being disposed at different locations of a racket, the method further comprising:

judging whether the position of the vibration signal source is positioned in a recommended batting area or not;

and sending out an indication of improper batting positions in response to the position of the vibration signal source not being in the recommended batting area.

17. The method according to claim 9 or 10, wherein at least two of the vibration sensing devices are disposed at different positions of an object to be detected, and the target signal features include abnormal signal features corresponding to dead spots of the object to be detected.

18. The method of claim 17, the object to be detected comprising a rail.

19. The method of claim 18, the identifying a target signal feature of the signal features that corresponds to the vibration signal source further comprising:

judging whether the signal characteristics of the sensing signals meet preset characteristic conditions or not;

and determining the signal characteristic as the abnormal signal characteristic in response to the signal characteristic meeting the preset characteristic condition.

20. The method of claim 19, the determining the location of the vibration signal source based on the time difference further comprising:

and determining the position of the dead pixel based on the time difference between the abnormal signal characteristics.

21. A vibration signal source positioning system comprising:

the sensing signal acquisition module is used for acquiring sensing signals of at least two vibration sensing devices positioned at different positions, and each sensing signal comprises a vibration signal generated by vibration of the same vibration signal source;

a time difference determining module, configured to determine, based on the sensing signals, a time difference in which the vibration signals are received by the at least two vibration sensing devices located at different positions; and

And the position determining module is used for determining the position of the vibration signal source based on the time difference.

22. A non-transitory computer-readable medium comprising:

computer instructions;

the computer instructions, when executed by at least one processor, may cause the at least one processor to perform operations of: