CN115460031B - Intelligent sound control supervision system and method based on Internet of things - Google Patents

Intelligent sound control supervision system and method based on Internet of things Download PDF

Info

Publication number
CN115460031B
CN115460031B CN202211416733.4A CN202211416733A CN115460031B CN 115460031 B CN115460031 B CN 115460031B CN 202211416733 A CN202211416733 A CN 202211416733A CN 115460031 B CN115460031 B CN 115460031B
Authority
CN
China
Prior art keywords
tone
data
network
module
acquiring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202211416733.4A
Other languages
Chinese (zh)
Other versions
CN115460031A (en
Inventor
杨宁虎
董海庄
张敏
郑承翔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Heard & Learn Technology Co ltd
Original Assignee
Shenzhen Heard & Learn Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Heard & Learn Technology Co ltd filed Critical Shenzhen Heard & Learn Technology Co ltd
Priority to CN202211416733.4A priority Critical patent/CN115460031B/en
Publication of CN115460031A publication Critical patent/CN115460031A/en
Application granted granted Critical
Publication of CN115460031B publication Critical patent/CN115460031B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B31/00Predictive alarm systems characterised by extrapolation or other computation using updated historic data
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/30Control
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Computing Systems (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Alarm Systems (AREA)

Abstract

The invention discloses an intelligent sound control supervision system and method based on the Internet of things, and belongs to the technical field of intelligent sound control. The system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module. The output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module. According to the invention, based on indoor tone variation and tone analysis, network data flow is considered, indoor scene state can be accurately analyzed on the premise of ensuring user privacy, early warning is made, emotion is alleviated, and family happiness is improved.

Description

Intelligent sound control supervision system and method based on Internet of things
Technical Field
The invention relates to the technical field of intelligent sound control, in particular to an intelligent sound control supervision system and method based on the Internet of things.
Background
The intelligent sound system is one of representative products of the Internet of things, the intelligent interconnection between a user and a home can be achieved, however, along with the development of the society, the privacy of the user can be snooped frequently by the intelligent sound system technology, meanwhile, the current intelligent sound system can achieve the functions of voice playing, pause and the like, the voice data of the user collected by the intelligent sound system is gradually changed into miscellaneous garbage as storage data, and the burden of a database is aggravated.
Disclosure of Invention
The invention aims to provide an intelligent sound control and supervision system and method based on the Internet of things, and aims to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: an intelligent sound control supervision method based on the Internet of things comprises the following steps:
s1, registering an intelligent home system by a user, and authorizing an intelligent sound box to acquire indoor sound data and intelligent home network data;
s2, obtaining personalized historical data of a user, constructing a tone analysis model, generating a tone change value, and starting a network judgment module when the tone change value exceeds a tone change threshold value;
s3, the network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variable quantity of the intelligent home local area network at the moment;
s4, constructing a tone early warning model, and if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
s5, if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
According to the above technical solution, the constructing a pitch analysis model includes:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the users, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
Figure 305351DEST_PATH_IMAGE001
wherein the content of the first and second substances,
Figure 594381DEST_PATH_IMAGE002
representing the probability that the user is in an emotional state of excitement;
Figure 478023DEST_PATH_IMAGE003
represents any data in the set of data differences;
Figure 92675DEST_PATH_IMAGE004
representing a parameter value;
Figure 61768DEST_PATH_IMAGE005
finger-shaped
Figure 888910DEST_PATH_IMAGE004
Transposing; b refers to error;
setting a tone variation threshold, inputting the collected user tone height calculation difference, outputting the probability of the user in the emotional agitation state as the tone variation probability, preliminarily judging that the user is in the emotional agitation state if the tone variation probability exceeds the tone variation threshold, and starting a network judgment module.
According to the technical scheme, the step of constructing the tone early warning model comprises the following steps:
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the network information interaction means that the home equipment forms data transmission with the external internet through a local area network;
constructing the original data structure column, denoted as set A 0 ={A 0 (1),A 0 (2),A 0 (3),……,A 0 (n)};
For set A 0 Performing gray accumulation generation to generate a set A 1 ={A 1 (1),A 1 (2),A 1 (3),……,A 1 (n)};
Satisfies the following conditions:
Figure 892638DEST_PATH_IMAGE006
wherein the content of the first and second substances,
Figure 911147DEST_PATH_IMAGE007
=1,2,……,n;
Figure 570799DEST_PATH_IMAGE008
represents a serial number;
for set A 1 Calculating in a manner of close-to-average value to generate a set A 2 ={A 2 (1),A 2 (2),A 2 (3),……,A 2 (n)};
Satisfies the following conditions:
Figure 326265DEST_PATH_IMAGE009
constructing set A 1 Whitening differential equation:
Figure 794287DEST_PATH_IMAGE010
wherein the content of the first and second substances,
Figure 609796DEST_PATH_IMAGE011
in order to develop the coefficients of the image,
Figure 428848DEST_PATH_IMAGE012
the ash acting amount;
based on a least square method, calculating a ratio of a development coefficient to a gray effect amount, substituting into a model to solve:
Figure 253584DEST_PATH_IMAGE013
constructing a new network data variable quantity threshold:
Figure 841691DEST_PATH_IMAGE014
wherein the content of the first and second substances,
Figure 562523DEST_PATH_IMAGE015
if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
According to the above technical solution, the tone matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
Figure 382054DEST_PATH_IMAGE016
wherein the content of the first and second substances,
Figure 479323DEST_PATH_IMAGE017
a tone waveform curve representing the collected sound data,
Figure 187516DEST_PATH_IMAGE018
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
Figure 282511DEST_PATH_IMAGE019
any feature point in a tone waveform curve representing the collected sound data;
Figure 200788DEST_PATH_IMAGE020
representing any one corresponding characteristic point of an adult tone wave curve and an infant tone wave curve preset in a database;
Figure 977114DEST_PATH_IMAGE021
representing similarity values of two groups of tone waveform curves;
respectively calculating the similarity value of the timbre waveform curve of the collected sound data and any one of an adult timbre waveform curve and an infant timbre waveform curve preset in a database;
and taking the tone waveform curve with larger similarity as the corresponding tone waveform curve.
An intelligent sound control supervisory system based on the Internet of things, the system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box, is connected with an intelligent home local area network system and is used for acquiring the network data variable quantity of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is an infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
According to the technical scheme, the intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
the output end of the user authorization unit is connected with the input end of the data acquisition unit.
According to the technical scheme, the tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone change value according to the tone analysis model and starting the network judgment module when the tone change value exceeds a tone change threshold value;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
According to the technical scheme, the network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the intelligent home local area network and constructing a network data variation threshold under the condition of network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation threshold value under the network information interaction exists;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
According to the technical scheme, the tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
According to the technical scheme, the tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is that the infant is in the infant state; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
Compared with the prior art, the invention has the following beneficial effects: according to the invention, after a user registers an intelligent home system, the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data; acquiring user personalized historical data by using a tone analysis module, constructing a tone analysis model, generating a tone variation value, and starting a network judgment module when the tone variation value exceeds a tone variation threshold value; acquiring the network data variable quantity of the intelligent home local area network at the moment by using a network judgment module; acquiring collected sound data by using a tone matching module when the network data variation does not exceed the network data variation threshold, and performing tone matching; outputting early warning information to a manager port by using a tone early warning module when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system; according to the invention, based on indoor tone variation and tone analysis, network data flow is considered, indoor scene state can be accurately analyzed on the premise of ensuring user privacy, early warning is made, emotion is alleviated, and family happiness is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flow chart of an intelligent sound control supervision system and method based on the internet of things.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, in the first embodiment, an intelligent sound device is provided, which logs in an intelligent home system, and a user registers the intelligent home system and authorizes the intelligent sound device to collect indoor sound data and intelligent home network data;
acquiring personalized historical data of a user, and constructing a tone analysis model, wherein the step of constructing the tone analysis model comprises the following steps:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the user, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
Figure 664448DEST_PATH_IMAGE022
wherein, the first and the second end of the pipe are connected with each other,
Figure 602448DEST_PATH_IMAGE002
representing the probability that the user is in an emotional excitement state;
Figure 8021DEST_PATH_IMAGE003
represents any data in the set of data differences;
Figure 86574DEST_PATH_IMAGE004
representing a parameter value;
Figure 628413DEST_PATH_IMAGE005
finger-shaped
Figure 2894DEST_PATH_IMAGE004
Transposing; b refers to error;
setting a tone variation threshold, inputting the collected user tone height calculation difference, outputting the probability of the user in the emotional agitation state as the tone variation probability, preliminarily judging that the user is in the emotional agitation state if the tone variation probability exceeds the tone variation threshold, and starting a network judgment module.
The network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variation of the intelligent home local area network at the moment;
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the network information interaction means that the home equipment forms data transmission with the external internet through a local area network;
for example, in a home, the smart home usually uses a fixed network data transmission smart home server platform, if there is interaction with the external internet, generally, a user mobile phone or a computer, a network television, etc. obtains external data through a local area network, for example, watching a movie through a computer, the amount of data uploaded and downloaded is much higher than that of the fixed network data at ordinary times; by adopting the method for identification and judgment, when the emotional tone appears at present, whether a large amount of network transmission data exists or not is judged, and whether the false noise caused by other equipment, such as quarrel, crying and the like of a movie and television drama, exists or not is further judged, so that the system judgment precision is improved, and the invasion of the privacy of a user is avoided.
Constructing the original data structure column, denoted as set A 0 ={A 0 (1),A 0 (2),A 0 (3),……,A 0 (n)};
For set A 0 Performing gray accumulation generation to generate a set A 1 ={A 1 (1),A 1 (2),A 1 (3),……,A 1 (n)};
Satisfies the following conditions:
Figure 833447DEST_PATH_IMAGE006
wherein the content of the first and second substances,
Figure 76209DEST_PATH_IMAGE007
=1,2,……,n;
Figure 347922DEST_PATH_IMAGE008
represents a serial number;
for set A 1 Calculating in a manner of close-to-average value to generate a set A 2 ={A 2 (1),A 2 (2),A 2 (3),……,A 2 (n)};
Satisfies the following conditions:
Figure 17938DEST_PATH_IMAGE023
constructing set A 1 Whitening differential equation:
Figure 7890DEST_PATH_IMAGE024
wherein, the first and the second end of the pipe are connected with each other,
Figure 54344DEST_PATH_IMAGE011
in order to develop the coefficients of the image,
Figure 947607DEST_PATH_IMAGE012
is the ash action amount;
based on a least square method, calculating a ratio of the development coefficient to the ash action amount, substituting the ratio into a model to solve:
Figure 788524DEST_PATH_IMAGE013
constructing a new network data variable quantity threshold:
Figure 265773DEST_PATH_IMAGE025
wherein, the first and the second end of the pipe are connected with each other,
Figure 850338DEST_PATH_IMAGE015
if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
The tone color matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
Figure 424539DEST_PATH_IMAGE016
wherein the content of the first and second substances,
Figure 311723DEST_PATH_IMAGE017
a tone waveform curve representing the collected sound data,
Figure 135323DEST_PATH_IMAGE018
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
Figure 398945DEST_PATH_IMAGE019
any feature point in a tone waveform curve representing the collected sound data;
Figure 889969DEST_PATH_IMAGE020
representing any one corresponding characteristic point of an adult tone waveform curve and an infant tone waveform curve preset in a database;
Figure 446590DEST_PATH_IMAGE021
representing similarity values of two groups of tone waveform curves;
respectively calculating the similarity value of the timbre waveform curve of the collected sound data and any one of an adult timbre waveform curve and an infant timbre waveform curve preset in a database;
and taking the tone waveform curve with high similarity to judge as the corresponding tone waveform curve.
In the prior art, although the tone of each person is different, accurate judgment of tone matching of each person requires a large amount of historical data support, so that a user still has difficulty in meeting accurate tone judgment even if inputting various sounds in the using process, the method simplifies the process, only needs to distinguish adults from infants without complex precision operation, has high adaptability and good effect, and can early warn the situation to a manager port in time and remind the manager to check the situation in time when the tone change of the infants is usually caused by crying and screaming; the tone change of the adult is basically caused by emotion change, such as the situations of quarrel, sadness and sadness in happiness and the like, at the moment, the intelligent sound box plays mild music according to the preset situation of the system, and the current abnormal emotion rhythm of the user is disturbed.
In this embodiment two, provide an intelligence stereo set control supervisory systems based on thing networking, this system includes: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box, is connected with an intelligent home local area network system and is used for acquiring the network data variable quantity of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
The intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
the output end of the user authorization unit is connected with the input end of the data acquisition unit.
The tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone variation value according to the tone analysis model and starting the network judgment module when the tone variation value exceeds a tone variation threshold;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
The network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the smart home local area network and constructing a network data variation threshold under the network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation exceeds a network data variation threshold value under the network information interaction;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
The tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
The tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is the infant; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments described above, or equivalents may be substituted for elements thereof. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (9)

1. An intelligent sound control supervision method based on the Internet of things is characterized by comprising the following steps: the method comprises the following steps:
s1, registering an intelligent home system by a user, and authorizing an intelligent sound box to acquire indoor sound data and intelligent home network data;
s2, acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting a network judgment module when the tone variation value exceeds a tone variation threshold value;
s3, the network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variable quantity of the intelligent home local area network at the moment;
s4, constructing a tone early warning model, and if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
s5, if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the constructing of the pitch analysis model comprises:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the users, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
Figure 239524DEST_PATH_IMAGE002
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE003
representing the probability that the user is in an emotional excitement state; represents any data in the set of data differences;
Figure 956945DEST_PATH_IMAGE004
representing a parameter value;
Figure DEST_PATH_IMAGE005
finger
Figure 289837DEST_PATH_IMAGE004
Transposing; b refers to error;
setting a tone variation threshold, inputting the collected user tone height calculation difference, outputting the probability of the user in the emotional agitation state as the tone variation probability, preliminarily judging that the user is in the emotional agitation state if the tone variation probability exceeds the tone variation threshold, and starting a network judgment module.
2. The intelligent sound control supervision method based on the internet of things according to claim 1, characterized in that: the constructing of the tone early warning model comprises the following steps:
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the presence network information interaction means that the home equipment forms data transmission with the external Internet through a local area network;
constructing the original data structure column, denoted as set A 0 ={A 0 (1),A 0 (2),A 0 (3),……,A 0 (n)};
For set A 0 Performing gray accumulation to generate a set A 1 ={A 1 (1),A 1 (2),A 1 (3),……,A 1 (n)};
Satisfies the following conditions:
Figure 635368DEST_PATH_IMAGE006
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE007
=1,2,……,n;
Figure 129934DEST_PATH_IMAGE008
represents a serial number;
for set A 1 Calculating in a manner of close-to-average value to generate a set A 2 ={A 2 (1),A 2 (2),A 2 (3),……,A 2 (n)};
Satisfies the following conditions:
Figure 302027DEST_PATH_IMAGE010
constructing set A 1 Whitening differential equation:
Figure 704190DEST_PATH_IMAGE012
wherein the content of the first and second substances,
Figure DEST_PATH_IMAGE013
in order to develop the coefficients of the image,
Figure 310752DEST_PATH_IMAGE014
is the ash action amount;
based on a least square method, calculating a ratio of the development coefficient to the ash action amount, substituting the ratio into a model to solve:
Figure 835274DEST_PATH_IMAGE016
constructing a new network data variable quantity threshold:
Figure 730549DEST_PATH_IMAGE018
wherein, the first and the second end of the pipe are connected with each other,
Figure DEST_PATH_IMAGE019
namely, the network data variation threshold is used as a new time, if the network data variation does not exceed the network data variationA quantization threshold value is used for acquiring collected sound data and carrying out tone color matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system.
3. The intelligent sound control supervision method based on the internet of things according to claim 2, characterized in that: the tone color matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
Figure DEST_PATH_IMAGE021
wherein the content of the first and second substances,
Figure 841462DEST_PATH_IMAGE022
a tone waveform curve representing the collected sound data,
Figure DEST_PATH_IMAGE023
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
Figure 302530DEST_PATH_IMAGE024
any characteristic point in a tone waveform curve representing the collected sound data;
Figure DEST_PATH_IMAGE025
representing any one corresponding characteristic point of an adult tone waveform curve and an infant tone waveform curve preset in a database;
Figure 670058DEST_PATH_IMAGE026
representing similarity values of the two groups of tone color wave curves;
respectively calculating the similarity value of the timbre waveform curve of the collected sound data and any one of an adult timbre waveform curve and an infant timbre waveform curve preset in a database;
and taking the tone waveform curve with high similarity to judge as the corresponding tone waveform curve.
4. An intelligent sound control supervision system based on the internet of things, applying the intelligent sound control supervision method based on the internet of things of claim 1, wherein: the system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system and is used for acquiring the network data variation of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
5. The intelligent sound control and supervision system based on the internet of things according to claim 4, wherein: the intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
the output end of the user authorization unit is connected with the input end of the data acquisition unit.
6. The intelligent sound control and supervision system based on the internet of things according to claim 4, wherein: the tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone change value according to the tone analysis model and starting the network judgment module when the tone change value exceeds a tone change threshold value;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
7. The intelligent sound control and supervision system based on the internet of things as claimed in claim 4, wherein: the network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the smart home local area network and constructing a network data variation threshold under the network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation exceeds a network data variation threshold value under the network information interaction;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
8. The intelligent sound control and supervision system based on the internet of things according to claim 4, wherein: the tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
9. The intelligent sound control and supervision system based on the internet of things according to claim 4, wherein: the tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is the infant; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
CN202211416733.4A 2022-11-14 2022-11-14 Intelligent sound control supervision system and method based on Internet of things Active CN115460031B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211416733.4A CN115460031B (en) 2022-11-14 2022-11-14 Intelligent sound control supervision system and method based on Internet of things

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211416733.4A CN115460031B (en) 2022-11-14 2022-11-14 Intelligent sound control supervision system and method based on Internet of things

Publications (2)

Publication Number Publication Date
CN115460031A CN115460031A (en) 2022-12-09
CN115460031B true CN115460031B (en) 2023-04-11

Family

ID=84295736

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211416733.4A Active CN115460031B (en) 2022-11-14 2022-11-14 Intelligent sound control supervision system and method based on Internet of things

Country Status (1)

Country Link
CN (1) CN115460031B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116385234B (en) * 2022-12-30 2023-09-19 青岛交通科技信息有限公司 Vehicle-mounted intelligent terminal management system and method based on Internet of things
CN116520755B (en) * 2023-06-29 2023-09-26 深圳东原电子有限公司 Automatic production line monitoring and early warning method and system for sound equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111402925A (en) * 2020-03-12 2020-07-10 北京百度网讯科技有限公司 Voice adjusting method and device, electronic equipment, vehicle-mounted system and readable medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007148493A1 (en) * 2006-06-23 2007-12-27 Panasonic Corporation Emotion recognizer
US8088987B2 (en) * 2009-10-15 2012-01-03 Yamaha Corporation Tone signal processing apparatus and method
CN105280187A (en) * 2015-11-13 2016-01-27 上海斐讯数据通信技术有限公司 Family emotion management device and method
CN105609110A (en) * 2016-01-25 2016-05-25 上海斐讯数据通信技术有限公司 Voice recognition method and system applied to network device
CN109104667A (en) * 2018-06-25 2018-12-28 福来宝电子(深圳)有限公司 A kind of control method of intelligent sound, system and intelligent sound
CN113467258A (en) * 2020-04-24 2021-10-01 海信集团有限公司 Intelligent monitoring method and equipment thereof

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111402925A (en) * 2020-03-12 2020-07-10 北京百度网讯科技有限公司 Voice adjusting method and device, electronic equipment, vehicle-mounted system and readable medium

Also Published As

Publication number Publication date
CN115460031A (en) 2022-12-09

Similar Documents

Publication Publication Date Title
CN115460031B (en) Intelligent sound control supervision system and method based on Internet of things
CN105895087B (en) Voice recognition method and device
JP2020034895A (en) Responding method and device
US20200219384A1 (en) Methods and systems for ambient system control
CN110505491A (en) A kind of processing method of live streaming, device, electronic equipment and storage medium
CN111883131B (en) Voice data processing method and device
CN109451352A (en) A kind of video playing method for predicting and device
CN103020712B (en) A kind of distributed sorter of massive micro-blog data and method
JP2018142272A (en) Content evaluation prediction system and content evaluation prediction method
CN111863033A (en) Training method and device for audio quality recognition model, server and storage medium
CN112261437A (en) Audio and video quality evaluation method and device, readable storage medium and electronic equipment
CN113470698A (en) Speaker transfer point detection method, device, equipment and storage medium
CN113139525B (en) Multi-source information fusion-based emotion recognition method and man-machine interaction system
CN115734024A (en) Audio data processing method, device, equipment and storage medium
CN108648031A (en) Products Show method and device
CN116261009B (en) Video detection method, device, equipment and medium for intelligently converting video audience
CN112073757A (en) Emotion fluctuation index acquisition method, emotion fluctuation index display method and multimedia content production method
CN116932735A (en) Text comparison method, device, medium and equipment
CN1267838C (en) Sound searching method and video and audio information searching system using said method
CN112800230B (en) Text processing method and device, computer readable storage medium and electronic equipment
WO2022141142A1 (en) Method and system for determining target audio and video
CN115373280A (en) Remote voice control method, device and system
CN112863276A (en) Web front-end teaching interactive system based on artificial intelligence
CN111951786A (en) Training method and device of voice recognition model, terminal equipment and medium
CN117577116B (en) Training method, device, equipment and medium for continuously learning voice identification model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant