CN107085815A - It is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically - Google Patents
It is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically Download PDFInfo
- Publication number
- CN107085815A CN107085815A CN201710186883.3A CN201710186883A CN107085815A CN 107085815 A CN107085815 A CN 107085815A CN 201710186883 A CN201710186883 A CN 201710186883A CN 107085815 A CN107085815 A CN 107085815A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- children
- sensor
- sociability
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012544 monitoring process Methods 0.000 title claims abstract description 13
- 230000005540 biological transmission Effects 0.000 claims abstract description 18
- 238000012800 visualization Methods 0.000 claims abstract description 10
- 238000004891 communication Methods 0.000 claims abstract description 6
- 230000003993 interaction Effects 0.000 claims description 27
- 238000012545 processing Methods 0.000 claims description 25
- 230000008859 change Effects 0.000 claims description 23
- 238000004364 calculation method Methods 0.000 claims description 21
- 238000001514 detection method Methods 0.000 claims description 21
- 230000006399 behavior Effects 0.000 claims description 16
- 238000011156 evaluation Methods 0.000 claims description 14
- 230000008569 process Effects 0.000 claims description 13
- 230000001133 acceleration Effects 0.000 claims description 10
- 238000012952 Resampling Methods 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 6
- 230000002996 emotional effect Effects 0.000 claims description 6
- 238000005259 measurement Methods 0.000 claims description 6
- 230000004044 response Effects 0.000 claims description 5
- 230000010354 integration Effects 0.000 claims description 4
- 230000036651 mood Effects 0.000 claims description 4
- 238000012795 verification Methods 0.000 claims description 4
- 238000001914 filtration Methods 0.000 claims description 3
- 230000010365 information processing Effects 0.000 claims description 3
- 230000006855 networking Effects 0.000 claims description 3
- 238000005070 sampling Methods 0.000 claims description 3
- 238000001228 spectrum Methods 0.000 claims description 3
- 238000012546 transfer Methods 0.000 claims description 3
- 241001269238 Data Species 0.000 claims 1
- 230000002452 interceptive effect Effects 0.000 claims 1
- 230000002618 waking effect Effects 0.000 claims 1
- 230000007547 defect Effects 0.000 abstract description 4
- 230000032683 aging Effects 0.000 abstract description 3
- 238000007796 conventional method Methods 0.000 abstract description 2
- 238000012913 prioritisation Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 230000018109 developmental process Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000007774 longterm Effects 0.000 description 2
- 238000011002 quantification Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008131 children development Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012797 qualification Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/22—Social work
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/03—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/63—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for estimating an emotional state
-
- H04B5/73—
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Tourism & Hospitality (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Child & Adolescent Psychology (AREA)
- Psychiatry (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Hospice & Palliative Care (AREA)
- Primary Health Care (AREA)
- Marketing (AREA)
- Human Resources & Organizations (AREA)
- Economics (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present invention relates to a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically.Including personal sensor and server, personal sensor is responsible for gathering voice, motion and range data of the children in game and daily communication, and send data to server, server is responsible for analyzing the data of client transmissions, the sociability of each children is assessed by computing, and provides result feedback and visualization interface.The alternative traditional children's social ability appraisal procedure of the system, it is to avoid the objectivity of conventional method is low, quantitation capabilities are weak, ageing low defect, for assess children's social ability provide science, it is easy-to-use, can large-scale application scheme.
Description
Technical field
The present invention relates to a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically.
Background technology
Sociability is the significant capability for needing in child development to cultivate energetically, but the assessment to children's sociability at present
Rely only on the fuzzy impression that teacher or parent obtain after long-term observation, and be difficult to it is objective, assess in time.The present invention is carried
The characteristics of going out in a kind of objective, quantitative, quick appraisal procedure, automatic acquisition children's play and daily communication, utilizes artificial intelligence
Each dimension of energy algorithm evaluation children's sociability.
The sociability of children is the significant capability that children begin to development from childhood.Since children are sociable,
Whether can social ability begins to development, the interest that is embodied as linking up with other people, clearly make oneself understood, be ready
Accept other people suggestion, whether can attract other people concern etc..With the ability phase such as language, absorbed, logical operation known to us
Than sociability is more senior and comprehensive, has vital shadow to the cause after child grows process and adult, life
Ring.The defective children of sociability are difficult to effectively learn from companion, it is difficult to adapt to society, life, and cause can suffer from more
Many setbacks；Sociability is good and comprehensively children effectively can more be paid close attention to from group's learning, by more companions and teacher
With understanding, more likely possess the life of happiness and successful cause.
But, because sociability is integration capability, it is difficult in terms of absorbed, language, logical operation, artistic speciality
Ability is equally measured by simple means.Although psychological study establishes the theoretical system of sociability already, to children
The measuring method of sociability but only stays in the means of subjective observation.In academic research, the measurement to children's social ability
Typically to the manual observation and scoring of video recording, i.e., allow the trip that children are preset in pre-designed standard environment
Play, is scored each side behavior of children by researcher according to typical behaviour afterwards.Generally by two and above researcher
Independent scoring, to reduce the subjective bias of scoring person.In practice, children's social ability is generally passed through long-term by teacher or parent
Observation and subjective impression are evaluated on questionnaire, and such as teacher form master, according to the observation of 1 year, is that every children fill in questionnaires, record
The performance situation of its typical behaviour.
These means exist defect be：1) subjectivity is strong：Different observers have different understanding to same behavior and commented
Sentence standard so that evaluation error is very big；2) it is difficult to quantification to compare：The scoring that each children obtain is typically " grade ", because
And compare with being difficult to quantification, it more difficult in it is determined that whether the sociability of children is normal, in other words apart from proprietary universal water
It is flat how far；3) it is ageing low：The ability development of children is very fast, and some abilities have " time-sensitive phase ".Traditional measurements
The observation or data analysis that means usually require at least some months could obtain preliminary conclusion, it is impossible to the timely hair to children instantly
Exhibition situation, which is given, to be fed back, and has the risk for missing optimal intervention；4) it is difficult to large-scale application：Traditional approach is wanted to evaluator
Ask higher, evaluator usually requires that evaluation work could be carried out by the theory concentrated and operation training according to unified standard.Religion
Committee requires that kindergarten is needed trained " child behavior observe teacher ", but really possesses the infant teacher of the qualification seldom,
Which reflects execution difficulty of the Training Evaluation person in practical operation.
The content of the invention
The system that the present invention discloses a set of automatic assessment children sociability, to overcome the four of above-mentioned Traditional measurements mode
Individual defect.The system collects dialogue, action and range data of the children in game and daily communication using wearable device,
Analyze these data, and using mathematical modeling the social ability of children is carried out it is objective, quantitative, assess in time.
The present invention is achieved through the following technical solutions above-mentioned purpose：
It is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, including personal sensor and service
Device, personal sensor is responsible for gathering voice, motion and range data of the children in game and daily communication, and by data transfer
To server, server is responsible for analyzing the data of client transmissions, the sociability of each children is assessed by computing, and provides
As a result feed back and visualization interface.
As the further prioritization scheme of the present invention, described personal sensor includes speech transducer module, acceleration
Sensor assembly, gyro module, infrared sensor module, bluetooth sensor module, data memory module, data transfer mould
Block, central control module, power supply and charging protecting module；Described server includes Data Input Interface module, speech data
Processing module, exercise data processing module, range data processing module, interpersonal Internet computing module, data output interface,
Result visualization module.
As the present invention further prioritization scheme, described gyro module sampled rotational amount, sample frequency 100Hz,
It is made up of standard gyroscope chip；Described infrared sensor module is for detection and sensor front 1m and in the range of 30 °
Other infrared sensors, are launched by infrared coding and reception chip is constituted；Described bluetooth sensor module is detection in 5m models
Other interior bluetooth sensor modules are enclosed, are made up of low-power consumption bluetooth chip；Described data memory module can store each biography
The data of sensor module collection, are made up of standard TF cards and read-write chip；Described data transmission module can be set by wifi
For to server transmission data, it is made up of wifi antennas and control chip, the network transmission protocol uses udp protocol；In described
Entreat control module：The sampling of each module and the storage of data and transmission are controlled, is made up of microprocessor；Described power supply and charging
Protection module can provide power supply；
Described Data Input Interface module includes a database and corresponding data-interface, or in units of user's group
Data to each client are managed, the integrality and time consistency of each client data, warp in each group of verification
The user's group of completeness check is crossed, its data will be delivered separately to different pieces of information processing module；Described language data process mould
Block can be respectively calculated the speech data of each user in user's group, extract phonetic characteristics and emotional state feature, will
Feature set is exported as personal speech characteristic；Described exercise data processing module adds for each user's in processing user's group
Velocity sensor and gyro data, extract motion feature from data above, and calculate emotionality degree feature, will be special above
Collection is exported as individual sports feature；Described range data processing module can handle the infrared sensing in personal sensor
The data that device module and bluetooth sensor module are uploaded；Other people's sensors of the vicinity detected according to bluetooth sensor
Whether Bluetooth identification code differentiates children in same space, other people's sensors received according to infrared sensor it is red
Outer identification code differentiates whether children are in aspectant state；Described interpersonal interaction's network calculations and social speciality assess mould
Block is the personal speech characteristic using the output of language data process module, and the individual sports of exercise data processing module output are special
Levy, and interpersonal distance's data of range data processing module output build interpersonal interaction's network；Described data output interface energy
The output of interpersonal interaction's network calculations and social speciality evaluation module is exported with markup language form, and preserved to data
Storehouse, user can be inquired about by network AP I；Described result visualization module can be by interpersonal interaction's network calculations and social speciality
The output generation dynamic web page of evaluation module, visualizes, computer or the networking browser of mobile phone is passed through for user in graphical form
Check.
As the further prioritization scheme of the present invention, the calculation procedure of described language data process module is followed successively by：
Step one：Intercept effective period of time：Interception is stabbed according to Data Input Interface module incoming start and end time
Valid data section；
Step 2：Resampling：Resampling is carried out to valid data section, it is 8000Hz to make its sample frequency；
Step 3：Speech terminals detection：The starting of automatic detection voice and cut off；Realize and using Sohn et al. 2001
The voice activity detection algorithm that year publishes；It is output as sound end data, i.e., during the starting and ending of each section voice
Carve；
Step 4：Voice segment length is counted：Calculate the average lengths of voice segments, standard deviation, comentropy, change with time
Trend；The mathematic interpolation at the starting and ending moment that the length of each voice segments is judged by voice activity detection algorithm；
Step 5：Tone color change statistics：Calculate the tamber characteristic and its average value of each voice segments, standard deviation, comentropy, sound
The trend that changes with time of color.Tamber characteristic is quantified by the power spectrum of 12 frequency ranges；
Step 6：Tonal variations are counted：Calculate the pitch parameters and its average value of each voice segments, standard deviation, comentropy, sound
Feature is adjusted to change with time trend；Pitch parameters are quantified with fundamental frequency；
Step 7：Emotional state differentiates：The variation tendency of children's emotionality degree is differentiated according to tone color and tonal variations.Feelings
Thread wake-up degree is calculated according to the change, tone color change and volume change of tone.
As the further prioritization scheme of the present invention, the calculation procedure of described exercise data processing module is followed successively by：
Step one：Intercept effective period of time：Interception is stabbed according to Data Input Interface module incoming start and end time
Valid data section；
Step 2：Filtering：Exercise data is filtered, removes after high fdrequency component and low frequency wonder, data is divided into
Length is the data segment of 1 minute；
Step 3：Kinergety is calculated：The kinergety of each segment data is calculated, with the quadratic sum amount of all directions acceleration
Change；
Step 4：Significantly motion detection：The Large Amplitude Motion of all directions is detected, with integration of the vector acceleration in 1 second
Quantify；
Step 5：Emotionality degree is calculated：Foundation kinergety and significantly motion measurement prediction emotionality degree；
Step 6：Individual sports feature：Using kinergety, significantly motion and emotionality degree are used as individual sports feature
Output.
As the further prioritization scheme of the present invention, described interpersonal interaction's network calculations and social speciality evaluation module
Calculation procedure be followed successively by：
Step one：Ownness quantifies：Differentiate that individual, in state not in the same time, is divided into 4 kinds of states according to input data：
The low wake-up of silence, the wake-up of silence height, low wake-up of speaking, high wake-up of speaking；
Step 2：It is fitted interpersonal interaction's model：Interpersonal interaction's model is fitted with proprietary status change data, institute is estimated
Mutual response relation between influencing each other between someone and owner；
Step 3：Personal role and influence power are calculated：According to the phase between influencing each other between owner and owner
Mutual response relation calculates the personal role in interaction and the influence power index to other people；
Step 4：Personal social speciality is assessed：According to the personal role in interaction, the influence power index to other people
And personal speech characteristic predicts personal social speciality, be divided into sociability total score, leader whereabouts, job orientation, it is autonomous, be total to
Place, action, dependence, eight dimensions of mood.
As the further prioritization scheme of the present invention, the quantity of described personal sensor is one or more.
The beneficial effects of the invention are as follows：
The alternative traditional children's social ability appraisal procedure of the system, it is to avoid the objectivity of conventional method is low, quantitative energy
Power is weak, ageing low defect, for assess children's social ability provide science, it is easy-to-use, can large-scale application scheme.
Brief description of the drawings
Fig. 1 is the fundamental diagram of the language data process module of the present invention；
Fig. 2 is the fundamental diagram of the exercise data processing module of the present invention；
Fig. 3 is interpersonal interaction's network calculations of the present invention and the fundamental diagram of social speciality evaluation module；
Fig. 4 is the structural representation of the present invention.
Embodiment
The invention will be further described below in conjunction with the accompanying drawings：
As Figure 1-Figure 4, it is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, including individual
Sensor and server, personal sensor are responsible for gathering voice, motion and range data of the children in game and daily communication,
And server is sent data to, server is responsible for the society for analyzing the data of client transmissions, each children being assessed by computing
Friendship ability, and result feedback and visualization interface are provided.
Described personal sensor includes speech transducer module, acceleration sensor module, gyro module, infrared biography
Sensor module, bluetooth sensor module, data memory module, data transmission module, central control module, power supply and charge protection
Module；Described server includes Data Input Interface module, language data process module, exercise data processing module, distance
Data processing module, interpersonal Internet computing module, data output interface, result visualization module.
Described gyro module sampled rotational amount, sample frequency 100Hz is made up of standard gyroscope chip；Described
Infrared sensor module is detection and sensor front 1m and other infrared sensors in the range of 30 °, is sent out by infrared coding
Penetrate and receive chip composition；Other bluetooth sensor modules of described bluetooth sensor module for detection in the range of 5m, by
Low-power consumption bluetooth chip is constituted；Described data memory module can store the data of each sensor assembly collection, by standard TF
Card and read-write chip are constituted；Described data transmission module can be by wifi equipment to server transmission data, by wifi days
Line and control chip are constituted, and the network transmission protocol uses udp protocol；Described central control module：Control the sampling of each module
With the storage and transmission of data, it is made up of microprocessor；Described power supply and charging protecting module can provide power supply；
Described Data Input Interface module includes a database and corresponding data-interface, or in units of user's group
Data to each client are managed, the integrality and time consistency of each client data, warp in each group of verification
The user's group of completeness check is crossed, its data will be delivered separately to different pieces of information processing module；Described language data process mould
Block can be respectively calculated the speech data of each user in user's group, extract phonetic characteristics and emotional state feature, will
Feature set is exported as personal speech characteristic；Described exercise data processing module adds for each user's in processing user's group
Velocity sensor and gyro data, extract motion feature from data above, and calculate emotionality degree feature, will be special above
Collection is exported as individual sports feature；Described range data processing module can handle the infrared sensing in personal sensor
The data that device module and bluetooth sensor module are uploaded；Other people's sensors of the vicinity detected according to bluetooth sensor
Whether Bluetooth identification code differentiates children in same space, other people's sensors received according to infrared sensor it is red
Outer identification code differentiates whether children are in aspectant state；Described interpersonal interaction's network calculations and social speciality assess mould
Block is the personal speech characteristic using the output of language data process module, and the individual sports of exercise data processing module output are special
Levy, and interpersonal distance's data of range data processing module output build interpersonal interaction's network；Described data output interface energy
The output of interpersonal interaction's network calculations and social speciality evaluation module is exported with markup language form, and preserved to data
Storehouse, user can be inquired about by network AP I；Described result visualization module can be by interpersonal interaction's network calculations and social speciality
The output generation dynamic web page of evaluation module, visualizes, computer or the networking browser of mobile phone is passed through for user in graphical form
Check.
The calculation procedure of described language data process module is followed successively by：
Step one：Intercept effective period of time：Interception is stabbed according to Data Input Interface module incoming start and end time
Valid data section；
Step 2：Resampling：Resampling is carried out to valid data section, it is 8000Hz to make its sample frequency；
Step 3：Speech terminals detection：The starting of automatic detection voice and cut off；Realize and using Sohn et al. 2001
The voice activity detection algorithm that year publishes；It is output as sound end data, i.e., during the starting and ending of each section voice
Carve；
Step 4：Voice segment length is counted：Calculate the average lengths of voice segments, standard deviation, comentropy, change with time
Trend；The mathematic interpolation at the starting and ending moment that the length of each voice segments is judged by voice activity detection algorithm；
Step 5：Tone color change statistics：Calculate the tamber characteristic and its average value of each voice segments, standard deviation, comentropy, sound
The trend that changes with time of color.Tamber characteristic is quantified by the power spectrum of 12 frequency ranges；
Step 6：Tonal variations are counted：Calculate the pitch parameters and its average value of each voice segments, standard deviation, comentropy, sound
Feature is adjusted to change with time trend；Pitch parameters are quantified with fundamental frequency；
Step 7：Emotional state differentiates：The variation tendency of children's emotionality degree is differentiated according to tone color and tonal variations.Feelings
Thread wake-up degree is calculated according to the change, tone color change and volume change of tone.
The calculation procedure of described exercise data processing module is followed successively by：
Step one：Intercept effective period of time：Interception is stabbed according to Data Input Interface module incoming start and end time
Valid data section；
Step 2：Filtering：Exercise data is filtered, removes after high fdrequency component and low frequency wonder, data is divided into
Length is the data segment of 1 minute；
Step 3：Kinergety is calculated：The kinergety of each segment data is calculated, with the quadratic sum amount of all directions acceleration
Change；
Step 4：Significantly motion detection：The Large Amplitude Motion of all directions is detected, with integration of the vector acceleration in 1 second
Quantify；
Step 5：Emotionality degree is calculated：Foundation kinergety and significantly motion measurement prediction emotionality degree；
Step 6：Individual sports feature：Using kinergety, significantly motion and emotionality degree are used as individual sports feature
Output.
Described interpersonal interaction's network calculations and the calculation procedure of social speciality evaluation module are followed successively by：
Step one：Ownness quantifies：Differentiate that individual, in state not in the same time, is divided into 4 kinds of states according to input data：
The low wake-up of silence, the wake-up of silence height, low wake-up of speaking, high wake-up of speaking；
Step 2：It is fitted interpersonal interaction's model：Interpersonal interaction's model is fitted with proprietary status change data, institute is estimated
Mutual response relation between influencing each other between someone and owner；
Step 3：Personal role and influence power are calculated：According to the phase between influencing each other between owner and owner
Mutual response relation calculates the personal role in interaction and the influence power index to other people；
Step 4：Personal social speciality is assessed：According to the personal role in interaction, the influence power index to other people
And personal speech characteristic predicts personal social speciality, be divided into sociability total score, leader whereabouts, job orientation, it is autonomous, be total to
Place, action, dependence, eight dimensions of mood.
The quantity of described personal sensor is one or more.
It should be noted last that：Above example is only used to illustrative and not limiting technical scheme, although ginseng
The present invention is described in detail according to above-described embodiment, it will be apparent to an ordinarily skilled person in the art that：Still can be to this
Invention is modified or equivalent substitution, any modification or partial replacement without departing from the spirit and scope of the present invention, and its is equal
It should cover among scope of the presently claimed invention.
Claims (7)
1. it is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is characterised in that：Including individual's sensing
Device and server, personal sensor are responsible for gathering voice, motion and range data of the children in game and daily communication, and will
Data transfer is to server, and server is responsible for the social energy analyzed the data of client transmissions, each children are assessed by computing
Power, and result feedback and visualization interface are provided.
2. according to claim 1 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：Described personal sensor includes speech transducer module, acceleration sensor module, gyro module, infrared biography
Sensor module, bluetooth sensor module, data memory module, data transmission module, central control module, power supply and charge protection
Module；Described server includes Data Input Interface module, language data process module, exercise data processing module, distance
Data processing module, interpersonal Internet computing module, data output interface, result visualization module.
3. according to claim 2 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：Described gyro module sampled rotational amount, sample frequency 100Hz is made up of standard gyroscope chip；Described is red
Outer sensor module is detection and sensor front 1m and other infrared sensors in the range of 30 °, is launched by infrared coding
Constituted with chip is received；Other bluetooth sensor modules of described bluetooth sensor module for detection in the range of 5m, by low
Power consumption Bluetooth chip is constituted；Described data memory module can store the data of each sensor assembly collection, by standard TF cards
And read-write chip is constituted；Described data transmission module can be by wifi equipment to server transmission data, by wifi antennas
And control chip is constituted, the network transmission protocol uses udp protocol；Described central control module：Control each module sampling and
The storage and transmission of data, are made up of microprocessor；Described power supply and charging protecting module can provide power supply；
Described Data Input Interface module includes a database and corresponding data-interface, or to every in units of user's group
The data of one client are managed, the integrality and time consistency of each client data in each group of verification, by complete
The user's group of whole property verification, its data will be delivered separately to different pieces of information processing module；Described language data process module energy
Enough speech datas to each user in user's group are calculated respectively, phonetic characteristics and emotional state feature are extracted, by feature
Collection is exported as personal speech characteristic；Described exercise data processing module is the acceleration for handling each user in user's group
Sensor and gyro data, extract motion feature from data above, and calculate emotionality degree feature, by features above collection
Exported as individual sports feature；Described range data processing module can handle the infrared sensor mould in personal sensor
The data that block and bluetooth sensor module are uploaded；The bluetooth of other people's sensors of the vicinity detected according to bluetooth sensor
Whether identification code differentiates children in same space, the infrared mark of other people's sensors received according to infrared sensor
Know code and differentiate whether children are in aspectant state；Described interpersonal interaction's network calculations and social speciality evaluation module are
The personal speech characteristic exported using language data process module, the individual sports feature of exercise data processing module output, and
Interpersonal distance's data of range data processing module output build interpersonal interaction's network；Described data output interface energy will be interpersonal
Interactive network is calculated and the output of social speciality evaluation module is exported with markup language form, and is preserved to database, user
It can be inquired about by network AP I；Interpersonal interaction's network calculations and social speciality can be assessed mould by described result visualization module
The output generation dynamic web page of block, visualizes, is checked for user by the networking browser of computer or mobile phone in graphical form.
4. according to claim 3 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：The calculation procedure of described language data process module is followed successively by：
Step one：Intercept effective period of time：It is effective according to the start and end time stamp interception that Data Input Interface module is incoming
Data segment；
Step 2：Resampling：Resampling is carried out to valid data section, it is 8000Hz to make its sample frequency；
Step 3：Speech terminals detection：The starting of automatic detection voice and cut off；Realize and using Sohn et al. public affairs in 2001
Develop the voice activity detection algorithm of table；It is output as sound end data, i.e., the starting and ending moment of each section voice；
Step 4：Voice segment length is counted：Calculate the average lengths of voice segments, standard deviation, comentropy, change with time
Gesture；The mathematic interpolation at the starting and ending moment that the length of each voice segments is judged by voice activity detection algorithm；
Step 5：Tone color change statistics：The tamber characteristic and its average value of each voice segments, standard deviation, comentropy are calculated, tone color
Change with time trend.Tamber characteristic is quantified by the power spectrum of 12 frequency ranges；
Step 6：Tonal variations are counted：The pitch parameters and its average value of each voice segments are calculated, standard deviation, comentropy, tone are special
Levy the trend of changing with time；Pitch parameters are quantified with fundamental frequency；
Step 7：Emotional state differentiates：The variation tendency of children's emotionality degree is differentiated according to tone color and tonal variations.Mood is called out
Degree of waking up is calculated according to the change, tone color change and volume change of tone.
5. according to claim 3 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：The calculation procedure of described exercise data processing module is followed successively by：
Step one：Intercept effective period of time：It is effective according to the start and end time stamp interception that Data Input Interface module is incoming
Data segment；
Step 2：Filtering：Exercise data is filtered, removes after high fdrequency component and low frequency wonder, data is divided into length
For the data segment of 1 minute；
Step 3：Kinergety is calculated：The kinergety of each segment data is calculated, is quantified with the quadratic sum of all directions acceleration；
Step 4：Significantly motion detection：The Large Amplitude Motion of all directions is detected, is quantified with integration of the vector acceleration in 1 second；
Step 5：Emotionality degree is calculated：Foundation kinergety and significantly motion measurement prediction emotionality degree；
Step 6：Individual sports feature：Using kinergety, significantly motion and emotionality degree are exported as individual sports feature.
6. according to claim 3 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：Described interpersonal interaction's network calculations and the calculation procedure of social speciality evaluation module are followed successively by：
Step one：Ownness quantifies：Differentiate that individual, in state not in the same time, is divided into 4 kinds of states according to input data：Silence
Low wake-up, the wake-up of silence height, low wake-up of speaking, high wake-up of speaking；
Step 2：It is fitted interpersonal interaction's model：Interpersonal interaction's model is fitted with proprietary status change data, owner is estimated
Between influence each other and owner between mutual response relation；
Step 3：Personal role and influence power are calculated：According to the mutual sound between influencing each other between owner and owner
The personal role in interaction of calculating and the influence power index to other people should be related to；
Step 4：Personal social speciality is assessed：According to the personal role in interaction, the influence power index to other people and individual
People's phonetic feature predicts personal social speciality, be divided into sociability total score, leader whereabouts, job orientation, it is autonomous, coexist, OK
Dynamic, dependence, eight dimensions of mood.
7. according to claim 1 a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically, it is special
Levy and be：The quantity of described personal sensor is one or more.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710186883.3A CN107085815B (en) | 2017-03-27 | 2017-03-27 | Method for automatically evaluating social contact ability of children by monitoring interaction behaviors |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710186883.3A CN107085815B (en) | 2017-03-27 | 2017-03-27 | Method for automatically evaluating social contact ability of children by monitoring interaction behaviors |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107085815A true CN107085815A (en) | 2017-08-22 |
| CN107085815B CN107085815B (en) | 2021-01-12 |
Family
ID=59614532
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710186883.3A Active CN107085815B (en) | 2017-03-27 | 2017-03-27 | Method for automatically evaluating social contact ability of children by monitoring interaction behaviors |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107085815B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114341964A (en) * | 2019-07-10 | 2022-04-12 | 神经进程公司 | System and method for monitoring and teaching children with autism series disorders |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1908965A (en) * | 2005-08-05 | 2007-02-07 | 索尼株式会社 | Information processing apparatus and method, and program |
| US20110302144A1 (en) * | 2010-06-03 | 2011-12-08 | International Business Machines Corporation | Dynamic Real-Time Reports Based on Social Networks |
| CN103269405A (en) * | 2013-05-23 | 2013-08-28 | 深圳市中兴移动通信有限公司 | Method and device for hinting friendlily |
| CN105589561A (en) * | 2016-03-01 | 2016-05-18 | 探客柏瑞科技（北京）有限公司 | Device for real-timely measuring and feeding back interpersonal communication efficiency |
| CN106128475A (en) * | 2016-07-12 | 2016-11-16 | 华南理工大学 | Wearable intelligent safety equipment based on abnormal emotion speech recognition and control method |
| CN106510658A (en) * | 2016-10-25 | 2017-03-22 | 广东乐源数字技术有限公司 | Human body emotion judgment method based on bracelet |
-
2017
- 2017-03-27 CN CN201710186883.3A patent/CN107085815B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1908965A (en) * | 2005-08-05 | 2007-02-07 | 索尼株式会社 | Information processing apparatus and method, and program |
| US20110302144A1 (en) * | 2010-06-03 | 2011-12-08 | International Business Machines Corporation | Dynamic Real-Time Reports Based on Social Networks |
| CN103269405A (en) * | 2013-05-23 | 2013-08-28 | 深圳市中兴移动通信有限公司 | Method and device for hinting friendlily |
| CN105589561A (en) * | 2016-03-01 | 2016-05-18 | 探客柏瑞科技（北京）有限公司 | Device for real-timely measuring and feeding back interpersonal communication efficiency |
| CN106128475A (en) * | 2016-07-12 | 2016-11-16 | 华南理工大学 | Wearable intelligent safety equipment based on abnormal emotion speech recognition and control method |
| CN106510658A (en) * | 2016-10-25 | 2017-03-22 | 广东乐源数字技术有限公司 | Human body emotion judgment method based on bracelet |
Non-Patent Citations (2)
| Title |
|---|
| BORRONG CHEN: "PAMSys: long-term physical activity monitoring with single wearable motion sensor", 《CONFERENCE ON WIRELESS HEALTH. ACM, 2011》 * |
| 张彤等: "基于加强版STC51芯片的跌倒报警腰带设计", 《科技创新导报》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114341964A (en) * | 2019-07-10 | 2022-04-12 | 神经进程公司 | System and method for monitoring and teaching children with autism series disorders |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107085815B (en) | 2021-01-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Xing et al. | Beyond positive and negative emotions: Looking into the role of achievement emotions in discussion forums of MOOCs | |
| Sarwar et al. | An intelligent fire warning application using IoT and an adaptive neuro-fuzzy inference system | |
| JP5092020B2 (en) | Information processing system and information processing apparatus | |
| CN102629904B (en) | Detection and determination method of network navy | |
| Navarro et al. | Real-time distributed architecture for remote acoustic elderly monitoring in residential-scale ambient assisted living scenarios | |
| CN104866699B (en) | A kind of online game intelligent data analysis method | |
| CN106776928A (en) | Recommend method in position based on internal memory Computational frame, fusion social environment and space-time data | |
| WO2018153118A1 (en) | Virtual data construction method and system based on real data | |
| Angdresey et al. | Monitoring and predicting water quality in swimming pools | |
| Scianna et al. | Counting the game: visualizing changes in play by incorporating game events | |
| CN113128693A (en) | Information processing method, device, equipment and storage medium | |
| CN107085815A (en) | It is a kind of by monitoring the method that mutual-action behavior assesses children's sociability automatically | |
| Korenivska et al. | IoT monitoring system for microclimate parameters in educational institutions using edge devices | |
| Millage et al. | A review of inhalability fraction models: discussion and recommendations | |
| TWI524294B (en) | Online learning style automated diagnostic system, online learning style automated diagnostic method and computer readable recording medium | |
| Scott | Framing data science, analytics and statistics around the digital earth concept | |
| Angdresey et al. | A soil monitoring and recommendation system for ornamental plants | |
| CN114936843A (en) | Method and device for evaluating matching degree of personnel and post | |
| Patterson et al. | Communicating local relevance of ocean observations: Integrating real-time ocean sensor data visualizations, online communications, and ocean issues to engage public audiences | |
| CN104680443A (en) | Public security examination management system based on internet technology | |
| Khan et al. | Bigdata analytics techniques to obtain valuable knowledge | |
| Zeng et al. | Construction and Coping Strategies of Ideological and Political Education Evaluation System under the Background of Intelligent Internet of Things | |
| CN105975792A (en) | Big-data-based dermatoglyph analysis and processing device and method | |
| Omar et al. | Moderating Effect of Gender on the Relationship between TikTok Usage and Positive Emotion among TikTok Users in China | |
| Tripathi et al. | Implimentation and Study of Fuzzy Based IoT enabled Health Alert system using AQI |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |