CN115460031A - Intelligent sound control supervision system and method based on Internet of things - Google Patents
Intelligent sound control supervision system and method based on Internet of things Download PDFInfo
- Publication number
- CN115460031A CN115460031A CN202211416733.4A CN202211416733A CN115460031A CN 115460031 A CN115460031 A CN 115460031A CN 202211416733 A CN202211416733 A CN 202211416733A CN 115460031 A CN115460031 A CN 115460031A
- Authority
- CN
- China
- Prior art keywords
- tone
- data
- network
- module
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 24
- 238000013475 authorization Methods 0.000 claims description 16
- 230000003993 interaction Effects 0.000 claims description 16
- 239000000126 substance Substances 0.000 claims description 11
- 230000002996 emotional effect Effects 0.000 claims description 10
- 230000009471 action Effects 0.000 claims description 9
- 238000013500 data storage Methods 0.000 claims description 9
- 238000012545 processing Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000011161 development Methods 0.000 claims description 4
- 238000009825 accumulation Methods 0.000 claims description 3
- 238000012360 testing method Methods 0.000 claims description 3
- 230000002087 whitening effect Effects 0.000 claims description 3
- 238000013019 agitation Methods 0.000 claims 2
- 230000006855 networking Effects 0.000 claims 2
- 238000004364 calculation method Methods 0.000 claims 1
- 230000008859 change Effects 0.000 abstract description 15
- 230000008451 emotion Effects 0.000 abstract description 5
- 230000005281 excited state Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 206010011469 Crying Diseases 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 206010039740 Screaming Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000009545 invasion Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B31/00—Predictive alarm systems characterised by extrapolation or other computation using updated historic data
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/30—Control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers, loudspeakers or microphones
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Acoustics & Sound (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Emergency Management (AREA)
- Business, Economics & Management (AREA)
- Computer Networks & Wireless Communication (AREA)
- Automation & Control Theory (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Alarm Systems (AREA)
Abstract
The invention discloses an intelligent sound control supervision system and method based on the Internet of things, and belongs to the technical field of intelligent sound control. The system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module. The output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module. According to the method and the device, the network data flow is considered at the same time based on indoor tone change and tone analysis, the indoor scene state can be accurately analyzed on the premise of ensuring the privacy of the user, early warning is made, the emotion is relieved, and the family happiness is improved.
Description
Technical Field
The invention relates to the technical field of intelligent sound control, in particular to an intelligent sound control supervision system and method based on the Internet of things.
Background
The intelligent sound box is one of representative products of the internet of things, intelligent interconnection between a user and a home can be achieved, however, along with development of the society, the intelligent sound technology can often snoop privacy of the user, meanwhile, functions of voice playing, pausing and the like can be achieved by the existing intelligent sound box, user voice data collected by the intelligent sound box is gradually changed into miscellaneous garbage as storage data, and burden of a database is aggravated.
Disclosure of Invention
The invention aims to provide an intelligent sound control and supervision system and method based on the Internet of things, and aims to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: an intelligent sound control supervision method based on the Internet of things comprises the following steps:
s1, registering an intelligent home system by a user, and authorizing an intelligent sound box to acquire indoor sound data and intelligent home network data;
s2, obtaining personalized historical data of a user, constructing a tone analysis model, generating a tone change value, and starting a network judgment module when the tone change value exceeds a tone change threshold value;
s3, the network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variation of the intelligent home local area network at the moment;
s4, constructing a tone early warning model, and if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
s5, if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
According to the above technical solution, said constructing a pitch analysis model includes:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the users, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
wherein, the first and the second end of the pipe are connected with each other,
representing the probability that the user is in an emotional state of excitement;
represents any data in the set of data differences;
representing a parameter value;
finger-shaped
Transposing; b refers to error;
setting a pitch change threshold, inputting the collected pitch height of the user to calculate a difference value, outputting the probability of the user in an emotional excited state as the pitch change probability, preliminarily judging that the user is in the emotional excited state if the pitch change probability exceeds the pitch change threshold, and starting a network judgment module.
According to the technical scheme, the step of constructing the tone early warning model comprises the following steps:
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the network information interaction means that the home equipment forms data transmission with the external internet through a local area network;
constructing the original data structure column, denoted as set A 0 ={A 0 （1），A 0 （2），A 0 （3），……，A 0 （n）}；
For set A 0 Performing gray accumulation generation to generate a set A 1 ={A 1 （1），A 1 （2），A 1 （3），……，A 1 （n）}；
Satisfies the following conditions:
wherein the content of the first and second substances,
=1，2，……，n；
represents a serial number;
for set A 1 Calculating in a manner of close-to-average value to generate a set A 2 ={A 2 （1），A 2 （2），A 2 （3），……，A 2 （n）}；
Satisfies the following conditions:
constructing set A 1 Whitening differential equation:
wherein the content of the first and second substances,
in order to develop the coefficients of the image,
is the ash action amount;
based on a least square method, calculating a ratio of the development coefficient to the ash action amount, substituting the ratio into a model to solve:
constructing a new network data variable quantity threshold:
wherein the content of the first and second substances,
if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
According to the above technical solution, the tone matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
wherein, the first and the second end of the pipe are connected with each other,
a tone waveform curve representing the collected sound data,
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
any feature point in a tone waveform curve representing the collected sound data;
representing any one corresponding characteristic point of an adult tone wave curve and an infant tone wave curve preset in a database;
representing similarity values of the two groups of tone color wave curves;
respectively calculating similarity values of the tone waveform curve of the collected sound data and any one of an adult tone waveform curve and an infant tone waveform curve preset in a database;
and taking the tone waveform curve with larger similarity as the corresponding tone waveform curve.
An intelligent sound control supervisory system based on the Internet of things, the system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box, is connected with an intelligent home local area network system and is used for acquiring the network data variable quantity of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
According to the technical scheme, the intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
the output end of the user authorization unit is connected with the input end of the data acquisition unit.
According to the technical scheme, the tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone variation value according to the tone analysis model and starting the network judgment module when the tone variation value exceeds a tone variation threshold;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
According to the technical scheme, the network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the smart home local area network and constructing a network data variation threshold under the network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation exceeds a network data variation threshold value under the network information interaction;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
According to the technical scheme, the tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
According to the technical scheme, the tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is that the infant is in the infant state; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
Compared with the prior art, the invention has the following beneficial effects: according to the invention, after a user registers an intelligent home system, the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data; acquiring user personalized historical data by using a tone analysis module, constructing a tone analysis model, generating a tone variation value, and starting a network judgment module when the tone variation value exceeds a tone variation threshold value; acquiring the network data variable quantity of the intelligent home local area network at the moment by using a network judgment module; acquiring collected sound data by using a tone matching module when the network data variation does not exceed a network data variation threshold, and performing tone matching; outputting early warning information to a manager port by using a tone early warning module when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system; according to the invention, based on indoor tone variation and tone analysis, network data flow is considered, indoor scene state can be accurately analyzed on the premise of ensuring user privacy, early warning is made, emotion is alleviated, and family happiness is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flow diagram of an intelligent sound control monitoring system and method based on the internet of things.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
Referring to fig. 1, in the first embodiment, an intelligent sound device is provided, which logs in an intelligent home system, and a user registers the intelligent home system and authorizes the intelligent sound device to collect indoor sound data and intelligent home network data;
acquiring personalized historical data of a user, and constructing a tone analysis model, wherein the step of constructing the tone analysis model comprises the following steps:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the users, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
wherein the content of the first and second substances,
representing the probability that the user is in an emotional state of excitement;
represents any data in the set of data differences;
representing a parameter value;
finger-shaped
Transposing; b refers to error;
setting a pitch change threshold, inputting the collected pitch height of the user to calculate a difference value, outputting the probability of the user in an emotional excited state as the pitch change probability, preliminarily judging that the user is in the emotional excited state if the pitch change probability exceeds the pitch change threshold, and starting a network judgment module.
The network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variation of the intelligent home local area network at the moment;
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the network information interaction means that the home equipment forms data transmission with the external internet through a local area network;
for example, in a home, the smart home usually uses a fixed network data transmission smart home server platform, if there is interaction with the external internet, generally, a user mobile phone or a computer, a network television, etc. obtains external data through a local area network, for example, watching a movie through a computer, the amount of data uploaded and downloaded is much higher than that of the fixed network data at ordinary times; by adopting the method for identification and judgment, when the emotional tone appears at present, whether a large amount of network transmission data exists or not is judged, and whether the false noise caused by other equipment, such as quarrel, crying and the like of a movie and television drama, exists or not is further judged, so that the system judgment precision is improved, and the invasion of the privacy of a user is avoided.
Constructing an original data structure column, denoted as set A 0 ={A 0 （1），A 0 （2），A 0 （3），……，A 0 （n）}；
For set A 0 Performing gray accumulation generation to generate a set A 1 ={A 1 （1），A 1 （2），A 1 （3），……，A 1 （n）}；
Satisfies the following conditions:
wherein, the first and the second end of the pipe are connected with each other,
=1，2，……，n；
represents a serial number;
for set A 1 Calculating in a manner of a close-to-meanGenerating a set A 2 ={A 2 （1），A 2 （2），A 2 （3），……，A 2 （n）}；
Satisfies the following conditions:
constructing set A 1 Whitening differential equation:
wherein the content of the first and second substances,
in order to develop the coefficients of the image,
is the ash action amount;
based on a least square method, calculating a ratio of the development coefficient to the ash action amount, substituting the ratio into a model to solve:
constructing a new network data variable quantity threshold:
wherein the content of the first and second substances,
if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
The tone color matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
wherein the content of the first and second substances,
a tone waveform curve representing the collected sound data,
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
any feature point in a tone waveform curve representing the collected sound data;
representing any one corresponding characteristic point of an adult tone wave curve and an infant tone wave curve preset in a database;
representing similarity values of two groups of tone waveform curves;
respectively calculating similarity values of the tone waveform curve of the collected sound data and any one of an adult tone waveform curve and an infant tone waveform curve preset in a database;
and taking the tone waveform curve with larger similarity as the corresponding tone waveform curve.
In the prior art, although the tone of each person is different, accurate judgment of tone matching of each person requires a large amount of historical data support, so that a user still has difficulty in meeting accurate tone judgment even if inputting various sounds in the using process, the method simplifies the process, only needs to distinguish adults from infants without complex precision operation, has high adaptability and good effect, and can early warn the situation to a manager port in time and remind the manager to check the situation in time when the tone change of the infants is usually caused by crying and screaming; the pitch change of adults is basically caused by emotion change, such as the situations of quarrel, sadness and sadness, and the like, at the moment, the intelligent sound equipment plays mild music according to the preset situation of the system, so that the current abnormal emotion rhythm of a user is disturbed, for example, in the quarrel, researches show that sudden sound can directly disturb the thinking of people, and the short music can cause the instant termination of the quarrel, so that the two people gradually recover emotion, and the family harmony communication is facilitated.
In the second embodiment, an intelligent sound control supervisory system based on internet of things is provided, and the system includes: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box, is connected with an intelligent home local area network system and is used for acquiring the network data variable quantity of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
The intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
and the output end of the user authorization unit is connected with the input end of the data acquisition unit.
The tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone variation value according to the tone analysis model and starting the network judgment module when the tone variation value exceeds a tone variation threshold;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
The network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the smart home local area network and constructing a network data variation threshold under the network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation exceeds a network data variation threshold value under the network information interaction;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
The tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
The tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is that the infant is in the infant state; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. An intelligent sound control supervision method based on the Internet of things is characterized in that: the method comprises the following steps:
s1, registering an intelligent home system by a user, and authorizing an intelligent sound box to acquire indoor sound data and intelligent home network data;
s2, acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting a network judgment module when the tone variation value exceeds a tone variation threshold value;
s3, the network judgment module is positioned in the intelligent sound box and connected with an intelligent home local area network system to acquire the network data variable quantity of the intelligent home local area network at the moment;
s4, constructing a tone early warning model, and if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
s5, if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
2. The intelligent sound control supervision method based on the internet of things according to claim 1, characterized in that: the constructing of the pitch analysis model comprises:
acquiring user personalized historical data, wherein the user personalized historical data comprises daily voice instruction control input by a user;
acquiring voice data sets of users under historical data, respectively acquiring the pitch height of each voice data set, calculating a difference value with the pitch height under the control of a daily voice instruction corresponding to the user, and constructing a data difference value set;
generating a pitch analysis model from the set of data differences:
wherein the content of the first and second substances,
representing the probability that the user is in an emotional state of excitement;
represents any data in the set of data differences;
representing a parameter value;
finger-shaped
Transposing; b refers to error;
setting a tone variation threshold, inputting the collected user tone height calculation difference, outputting the probability of the user in the emotional agitation state as the tone variation probability, preliminarily judging that the user is in the emotional agitation state if the tone variation probability exceeds the tone variation threshold, and starting a network judgment module.
3. The intelligent sound control supervision method based on the internet of things according to claim 2, characterized in that: the constructing of the tone early warning model comprises the following steps:
acquiring the network data variable quantity of the intelligent home local area network at the moment;
constructing a network data variable quantity threshold: acquiring n groups of historical network data variation of existing network information data interaction as test data, constructing a prediction model, and predicting to obtain the historical network data variation of the existing network information data interaction at the new time; the network information interaction means that the home equipment forms data transmission with the external internet through a local area network;
constructing the original data structure column, denoted as set A 0 ={A 0 （1），A 0 （2），A 0 （3），……，A 0 （n）}；
For set A 0 Performing gray accumulation generation to generate a set A 1 ={A 1 （1），A 1 （2），A 1 （3），……，A 1 （n）}；
Satisfies the following conditions:
wherein, the first and the second end of the pipe are connected with each other,
=1，2，……，n；
represents a serial number;
for set A 1 Calculating in a manner of close-to-average value to generate a set A 2 ={A 2 （1），A 2 （2），A 2 （3），……，A 2 （n）}；
Satisfies the following conditions:
constructing set A 1 Whitening differential equation:
wherein the content of the first and second substances,
in order to develop the coefficients of the image,
is the ash action amount;
based on a least square method, calculating a ratio of the development coefficient to the ash action amount, substituting the ratio into a model to solve:
constructing a new network data variable quantity threshold:
wherein the content of the first and second substances,
if the network data variation does not exceed the network data variation threshold, acquiring collected sound data and performing tone matching;
if the tone matching result is that the infant is the infant, outputting early warning information to a manager port; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port and sending an instruction to play the preset music of the system.
4. The intelligent sound control supervision method based on the internet of things according to claim 3, characterized in that: the tone color matching includes:
constructing a tone waveform curve of the collected sound data; acquiring an adult tone waveform curve and an infant tone waveform curve preset in a database;
respectively obtaining H characteristic points, and constructing a tone matching model:
wherein the content of the first and second substances,
a tone waveform curve representing the collected sound data,
Representing any one of adult tone wave curves and infant tone wave curves preset in a database; i represents a characteristic serial number;
any feature point in a tone waveform curve representing the collected sound data;
representing any one corresponding characteristic point of an adult tone wave curve and an infant tone wave curve preset in a database;
representing similarity values of two groups of tone waveform curves;
respectively calculating the similarity value of the timbre waveform curve of the collected sound data and any one of an adult timbre waveform curve and an infant timbre waveform curve preset in a database;
and taking the tone waveform curve with larger similarity as the corresponding tone waveform curve.
5. The utility model provides an intelligence stereo set control supervisory systems based on thing networking which characterized in that: the system comprises: the system comprises an intelligent sound data module, a tone analysis module, a network judgment module, a tone matching module and a tone early warning module;
the intelligent sound data module is used for acquiring user authorization information and acquiring indoor sound data and intelligent home network data after a user registers the intelligent home system; the tone analysis module is used for acquiring personalized historical data of a user, constructing a tone analysis model, generating a tone variation value, and starting the network judgment module when the tone variation value exceeds a tone variation threshold value; the network judgment module is positioned in the intelligent sound box, is connected with an intelligent home local area network system and is used for acquiring the network data variable quantity of the intelligent home local area network at the moment; the tone matching module is used for acquiring the collected sound data and performing tone matching when the network data variation does not exceed the network data variation threshold; the tone early warning module is used for outputting early warning information to a manager port when the tone matching result is the infant; if the tone matching result is adult, outputting early warning information to an intelligent sound playing control port, and sending an instruction to play the preset music of the system;
the output end of the intelligent sound data module is connected with the input end of the tone analysis module; the output end of the tone analysis module is connected with the input end of the network judgment module; the output end of the network judgment module is connected with the input end of the tone matching module; and the output end of the tone matching module is connected with the input end of the tone early warning module.
6. The intelligent sound control and supervision system based on the internet of things according to claim 5, wherein: the intelligent sound data module comprises a user authorization unit and a data acquisition unit;
the user authorization unit is used for acquiring user authorization information after a user registers the intelligent home system; the data acquisition unit is used for acquiring indoor sound data and intelligent home network data;
the output end of the user authorization unit is connected with the input end of the data acquisition unit.
7. The intelligent sound control and supervision system based on the internet of things according to claim 5, wherein: the tone analysis module comprises a data storage unit and a tone analysis unit;
the data storage unit is used for acquiring personalized historical data of a user and constructing a tone analysis model; the tone analysis unit is used for generating a tone variation value according to the tone analysis model and starting the network judgment module when the tone variation value exceeds a tone variation threshold;
the output end of the data storage unit is connected with the input end of the tone analysis unit.
8. The intelligent sound control supervisory system based on thing networking of claim 5, characterized in that: the network judgment module comprises a threshold processing unit and a network judgment unit;
the threshold processing unit is used for acquiring historical network data variation of the smart home local area network and constructing a network data variation threshold under the network information interaction; the network judging unit is used for acquiring the network data variation of the current intelligent home local area network and judging whether the network data variation exceeds a network data variation threshold value under the network information interaction;
the output end of the threshold processing unit is connected with the input end of the network judging unit.
9. The intelligent sound control and supervision system based on the internet of things according to claim 5, wherein: the tone matching module comprises an instruction receiving unit and a tone matching unit;
the instruction receiving unit is used for receiving a judgment instruction, acquiring collected sound data and performing tone matching if the network data variation does not exceed the network data variation threshold; the tone matching unit is used for matching the similarity value of the current tone and any one of an adult tone waveform curve and an infant tone waveform curve preset in the database, and selecting one with higher similarity;
and the output end of the instruction receiving unit is connected with the input end of the tone matching unit.
10. The intelligent sound control and supervision system based on the internet of things according to claim 5, wherein: the tone early warning module comprises an early warning unit and a control unit;
the early warning unit is used for outputting early warning information to a manager port when the tone matching result is that the infant is in the infant state; and the control unit is used for outputting early warning information to the intelligent sound playing control port and sending an instruction to play the preset music of the system when the tone matching result is adult.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211416733.4A CN115460031B (en) | 2022-11-14 | 2022-11-14 | Intelligent sound control supervision system and method based on Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211416733.4A CN115460031B (en) | 2022-11-14 | 2022-11-14 | Intelligent sound control supervision system and method based on Internet of things |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115460031A true CN115460031A (en) | 2022-12-09 |
| CN115460031B CN115460031B (en) | 2023-04-11 |
Family
ID=84295736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211416733.4A Active CN115460031B (en) | 2022-11-14 | 2022-11-14 | Intelligent sound control supervision system and method based on Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115460031B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116385234A (en) * | 2022-12-30 | 2023-07-04 | 青岛交通科技信息有限公司 | Vehicle-mounted intelligent terminal management system and method based on Internet of things |
| CN116520755A (en) * | 2023-06-29 | 2023-08-01 | 深圳东原电子有限公司 | Automatic production line monitoring and early warning method and system for sound equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090313019A1 (en) * | 2006-06-23 | 2009-12-17 | Yumiko Kato | Emotion recognition apparatus |
| US20110088534A1 (en) * | 2009-10-15 | 2011-04-21 | Yamaha Corporation | Tone signal processing apparatus and method |
| CN105280187A (en) * | 2015-11-13 | 2016-01-27 | 上海斐讯数据通信技术有限公司 | Family emotion management device and method |
| CN105609110A (en) * | 2016-01-25 | 2016-05-25 | 上海斐讯数据通信技术有限公司 | Voice recognition method and system applied to network device |
| CN109104667A (en) * | 2018-06-25 | 2018-12-28 | 福来宝电子(深圳)有限公司 | A kind of control method of intelligent sound, system and intelligent sound |
| CN111402925A (en) * | 2020-03-12 | 2020-07-10 | 北京百度网讯科技有限公司 | Voice adjusting method and device, electronic equipment, vehicle-mounted system and readable medium |
| CN113467258A (en) * | 2020-04-24 | 2021-10-01 | 海信集团有限公司 | Intelligent monitoring method and equipment thereof |
-
2022
- 2022-11-14 CN CN202211416733.4A patent/CN115460031B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090313019A1 (en) * | 2006-06-23 | 2009-12-17 | Yumiko Kato | Emotion recognition apparatus |
| US20110088534A1 (en) * | 2009-10-15 | 2011-04-21 | Yamaha Corporation | Tone signal processing apparatus and method |
| CN105280187A (en) * | 2015-11-13 | 2016-01-27 | 上海斐讯数据通信技术有限公司 | Family emotion management device and method |
| CN105609110A (en) * | 2016-01-25 | 2016-05-25 | 上海斐讯数据通信技术有限公司 | Voice recognition method and system applied to network device |
| CN109104667A (en) * | 2018-06-25 | 2018-12-28 | 福来宝电子(深圳)有限公司 | A kind of control method of intelligent sound, system and intelligent sound |
| CN111402925A (en) * | 2020-03-12 | 2020-07-10 | 北京百度网讯科技有限公司 | Voice adjusting method and device, electronic equipment, vehicle-mounted system and readable medium |
| CN113467258A (en) * | 2020-04-24 | 2021-10-01 | 海信集团有限公司 | Intelligent monitoring method and equipment thereof |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116385234A (en) * | 2022-12-30 | 2023-07-04 | 青岛交通科技信息有限公司 | Vehicle-mounted intelligent terminal management system and method based on Internet of things |
| CN116385234B (en) * | 2022-12-30 | 2023-09-19 | 青岛交通科技信息有限公司 | Vehicle-mounted intelligent terminal management system and method based on Internet of things |
| CN116520755A (en) * | 2023-06-29 | 2023-08-01 | 深圳东原电子有限公司 | Automatic production line monitoring and early warning method and system for sound equipment |
| CN116520755B (en) * | 2023-06-29 | 2023-09-26 | 深圳东原电子有限公司 | Automatic production line monitoring and early warning method and system for sound equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115460031B (en) | 2023-04-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115460031B (en) | Intelligent sound control supervision system and method based on Internet of things | |
| CN105895087B (en) | Voice recognition method and device | |
| JP6967059B2 (en) | Methods, devices, servers, computer-readable storage media and computer programs for producing video | |
| WO2018130201A1 (en) | Method for determining associated account, server and storage medium | |
| JP2020034895A (en) | Responding method and device | |
| US10565862B2 (en) | Methods and systems for ambient system control | |
| CN104239304A (en) | Data processing method, device and equipment | |
| CN103020712B (en) | A kind of distributed sorter of massive micro-blog data and method | |
| CN109451352A (en) | A kind of video playing method for predicting and device | |
| Otebolaku et al. | A framework for exploiting internet of things for context-aware trust-based personalized services | |
| CN116825088B (en) | Conference voice detection method and system based on deep learning | |
| CN103945140B (en) | The generation method and system of video caption | |
| CN113470698A (en) | Speaker transfer point detection method, device, equipment and storage medium | |
| TWI823055B (en) | Electronic resource pushing method and system | |
| CN115734024A (en) | Audio data processing method, device, equipment and storage medium | |
| CN108648031A (en) | Products Show method and device | |
| CN112073757A (en) | Emotion fluctuation index acquisition method, emotion fluctuation index display method and multimedia content production method | |
| CN116347723A (en) | Control system of sound control type wall switch with adjustable lamplight sample color | |
| CN114157023B (en) | Distribution transformer early warning information acquisition method | |
| CN110164438A (en) | A kind of audio recognition method, device and electronic equipment | |
| CN109634554A (en) | Method and apparatus for output information | |
| WO2022141142A1 (en) | Method and system for determining target audio and video | |
| CN112863276A (en) | Web front-end teaching interactive system based on artificial intelligence | |
| CN112750448A (en) | Sound scene recognition method, device, equipment and storage medium | |
| CN112017084B (en) | Learning engine open platform management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |