CN109857903A - The multilingual talent tests Verification System - Google Patents

The multilingual talent tests Verification System Download PDF

Info

Publication number
CN109857903A
CN109857903A CN201811506859.4A CN201811506859A CN109857903A CN 109857903 A CN109857903 A CN 109857903A CN 201811506859 A CN201811506859 A CN 201811506859A CN 109857903 A CN109857903 A CN 109857903A
Authority
CN
China
Prior art keywords
module
assessment
training
data
multilingual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811506859.4A
Other languages
Chinese (zh)
Inventor
朱西平
汪敏
苏赋
苟智坚
韩斌
李季
郑达
帅靖
杨朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sichuan Technology Co Ltd Billion Goods
Southwest Petroleum University
Chengdu University of Information Technology
Original Assignee
Sichuan Technology Co Ltd Billion Goods
Southwest Petroleum University
Chengdu University of Information Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sichuan Technology Co Ltd Billion Goods, Southwest Petroleum University, Chengdu University of Information Technology filed Critical Sichuan Technology Co Ltd Billion Goods
Priority to CN201811506859.4A priority Critical patent/CN109857903A/en
Publication of CN109857903A publication Critical patent/CN109857903A/en
Pending legal-status Critical Current

Links

Landscapes

  • Electrically Operated Instructional Devices (AREA)

Abstract

The invention discloses a kind of multilingual talents to test Verification System, including human-computer interaction module, sound obtain module, shape of the mouth as one speaks assessment module, pronunciation characteristic and obtains module, sound assessment module, central processing unit, voice/video call module and training module.The present invention realizes the acquisition and analysis and assessment of user pronunciation situation data, make user can with basic understanding oneself pronounce situation while, also achieve the output of subsequent specific aim training scheme, substantially increase learning efficiency;The assessment for combining pronunciation mouth shape and the audio characteristic data that pronounces, improves the assessment accuracy of whole system;Integrate test, assessment and training, discrimination with higher and calculating speed, it is adaptable, and the training of the mutual exchange between user may be implemented.

Description

The multilingual talent tests Verification System
Technical field
The present invention relates to cultural connotation fields, in particular, being to be related to a kind of multilingual talent's test Verification System.
Background technique
With the international development of politics, economic, cultural situation, international community needs and towards the region of countries and regions Direction of cooperation strides forward, such as the regional cooperation based on the interconnecting of Asia, Europe and Africa continent and neighbouring ocean, and establishes and reinforces Interconnect partnership for various countries along the line, constructs comprehensive, multi-level, the compound network that interconnects, various countries along realization Polynary, autonomous, balance, sustainable development.
Countries and regions along this are numerous, majority state and the regional languages and langue for being owned by oneself, with The iterative method of regional cooperation, these countries and regions need the further many-sided in-depth hair for promoting economic, politics, culture Exhibition, language issues, which become, to be influenced the maximum of various aspects productive discussions and hinders, and these language are mostly rare foreign languages, except working as when state Outside the common people on ground, few other staff understand these language of learning and mastering.In order to minimize language issues to various aspects cooperation The influence of propulsion, applicant pointedly propose a set of multilingual information culture service scheme, pass through each national language along collecting It says cultural information, constructs multilingual Cultural Database and data-sharing systems, provide corresponding multilingual culture for general public The universal education learning platform of the information content promotes the hair of the economic political culture especially cultural connotation of regional cooperation Exhibition.The application is as system evaluation section, for realizing multilingual talent test.
Summary of the invention
In view of the above shortcomings of the prior art, the present invention provides a kind of multilingual talent's test Verification System.
To achieve the goals above, The technical solution adopted by the invention is as follows:
A kind of multilingual talent's test Verification System, comprising:
Human-computer interaction module, for completing the input of the registration of user, control command and data requirements order;
It is also used to carry out test pattern, test scene and the selection for testing examination question;
Sound obtains module, for carrying out the acquisition of tester's pronunciation audio data by microphone;
Mouth shape data acquisition module, for carrying out shape of the mouth as one speaks video data in the entire test process of tester by camera Acquisition, and shape of the mouth as one speaks assessment module is sent by collected data;
Pronunciation characteristic obtains module, for the characteristic signal of sounder to be acquired by sensor group according to predeterminated frequency, and By collected characteristic signal by be sent to sound test and assess module, the characteristic signal include pressure subglottic, glottal air flow and Sound level;
Sound assessment module respectively believes feature by pressure subglottic method and wave current index method for receiving characteristic signal It number is calculated, obtains the phonation efficiency under two kinds of algorithms, export audio penetration power assessment result according to preset algorithm, and with Pressure subglottic method measurement result is abscissa, establishes vocal cord vibration phonation efficiency as ordinate using wave current index method measurement result and sits It marks on a map;
Training scheme generation module, for being tested and assessed the commenting of module by human expert according to test and assess module and sound of the shape of the mouth as one speaks Estimate the output that result gives scheme training, and sends corresponding account for the training scheme of output;
Online AC module, the exchange mutual for each account and shared;
Central processing unit, for receiving the control command and demand order of human-computer interaction module input, and according to preset Algorithm is sent to corresponding module and is executed;Modification for user's registration, rights management and password;It is also used to be used The certification of family identity;
Voice/video call module is being led to for carrying out voice/video call with specified account according to selection It needs first to send call request before words to corresponding account, the enabling of the module can be carried out after the account returns to confirmation message.
Further, which tests Verification System, further includes a training module, for carrying out language pronouncing mouth The training of language is inside equipped with the outpost of several grade of difficulty, the examination for storing corresponding index of difficulty is equipped in each outpost Database is inscribed, in training, the calling of examination question in corresponding database is carried out using random mode, and the difficulty at outpost is successively Increase, while examination question all in the outpost need to be answered questions, next outpost could be opened.
Also, it is embedded in the microphone and oral cavity baroceptor, oral airflow sensor is installed.
Further, which tests Verification System, further includes a test information database, interior to be equipped with a variety of surveys Die trial formula, test scene and test examination question data, and it is connected with a data update module, for passing through wired or wireless side Formula carries out the update of data in database.
Compared with prior art, the invention has the following advantages:
The present invention realizes the acquisition and analysis and assessment of user pronunciation situation data, make user can with basic understanding from While oneself pronunciation situation, the output of subsequent specific aim training scheme is also achieved, learning efficiency is substantially increased;It combines The assessment of pronunciation mouth shape and the audio characteristic data that pronounces, improves the assessment accuracy of whole system;Collection test, assessment and Training is integrated, and discrimination with higher and calculating speed are adaptable, and the instruction of the mutual exchange between user may be implemented Practice.
Detailed description of the invention
Fig. 1 is structural block diagram of the invention.
Specific embodiment
Present invention will be further explained below with reference to the attached drawings and examples, and embodiments of the present invention include but is not limited to The following example.
Embodiment
As shown in Figure 1, the multilingual talent tests Verification System, comprising:
Human-computer interaction module, for completing the input of the registration of user, control command and data requirements order;
It is also used to carry out test pattern, test scene and the selection for testing examination question;
Sound obtains module, for carrying out the acquisition of tester's pronunciation audio data by microphone;
Mouth shape data acquisition module, for carrying out shape of the mouth as one speaks video data in the entire test process of tester by camera Acquisition, and shape of the mouth as one speaks assessment module is sent by collected data;
Shape of the mouth as one speaks assessment module eliminates obtained bone for carrying out bone information acquisition by kinect depth transducer The shake and noise jamming of information, and calculate the angle moving in rotation SO3 matrix information for obtaining all bones pair;And institute will be calculated Bone pair angle moving in rotation SO3 matrix information and the standard shape of the mouth as one speaks posture information in shape of the mouth as one speaks standard database carry out pair Than if gap is less than some thresholding, then it is assumed that shape of the mouth as one speaks standard, otherwise it is assumed that nonstandard;
Pronunciation characteristic obtains module, for the characteristic signal of sounder to be acquired by sensor group according to predeterminated frequency, and By collected characteristic signal by be sent to sound test and assess module, the characteristic signal include pressure subglottic, glottal air flow and Sound level;
Sound assessment module respectively believes feature by pressure subglottic method and wave current index method for receiving characteristic signal It number is calculated, obtains the phonation efficiency under two kinds of algorithms, export audio penetration power assessment result according to preset algorithm, and with Pressure subglottic method measurement result is abscissa, establishes vocal cord vibration phonation efficiency as ordinate using wave current index method measurement result and sits It marks on a map;
Training scheme generation module, for being tested and assessed the commenting of module by human expert according to test and assess module and sound of the shape of the mouth as one speaks Estimate the output that result gives scheme training, and sends corresponding account for the training scheme of output;
Online AC module, the exchange mutual for each account, PK and shared;It can be as needed by mobilizing people to carry out The foundation of interim group, personnel are 15-30 people in group;The data of all exchanges are sent to central processing using the mode that script is recorded Device is stored in real time, once finding sensitive wording, central processing unit issues control command, closes the module, and with pop-up pair The mode of words frame is reminded;
Central processing unit, for receiving the control command and demand order of human-computer interaction module input, and according to preset Algorithm is sent to corresponding module and is executed;Modification for user's registration, rights management and password;It is also used to be used The certification of family identity;
Voice/video call module is being led to for carrying out voice/video call with specified account according to selection It needs first to send call request before words to corresponding account, the enabling of the module can be carried out after the account returns to confirmation message.
Further, which tests Verification System, further includes a training module, for carrying out language pronouncing mouth The training of language is inside equipped with the outpost of several grade of difficulty, the examination for storing corresponding index of difficulty is equipped in each outpost Database is inscribed, in training, the calling of examination question in corresponding database is carried out using random mode, and the difficulty at outpost is successively Increase, while examination question all in the outpost need to be answered questions, next outpost could be opened.
Further, which tests Verification System, further includes a test information database, interior to be equipped with a variety of surveys Die trial formula, test scene and test examination question data, and it is connected with a data update module, for passing through wired or wireless side Formula carries out the update of data in database.
The present invention is the improvement based on hardware architecture, and used electronic device and module are the prior art, and can be straight It connected buying to obtain, the content reasonable employment that those skilled in the art can record according to specification, the present invention is specific to its Construction repeats no more.
Above-described embodiment is merely a preferred embodiment of the present invention, and it is not intended to limit the protection scope of the present invention, as long as using Design principle of the invention, and the non-creative variation worked and made is carried out on this basis, it should belong to of the invention Within protection scope.

Claims (4)

1. a kind of multilingual talent tests Verification System characterized by comprising
Human-computer interaction module, for completing the input of the registration of user, control command and data requirements order;
Sound obtains module, for carrying out the acquisition of tester's pronunciation audio data by microphone;
Mouth shape data acquisition module is adopted for carrying out shape of the mouth as one speaks video data in tester entire test process by camera Collection, and shape of the mouth as one speaks assessment module is sent by collected data;
Pronunciation characteristic obtains module, for acquiring the characteristic signal of sounder by sensor group according to predeterminated frequency, and will adopt For the characteristic signal collected by being sent to sound assessment module, the characteristic signal includes pressure subglottic, glottal air flow and sound level;
Sound is tested and assessed module, for receiving characteristic signal, by pressure subglottic method and wave current index method respectively to characteristic signal into Row calculates, and obtains the phonation efficiency under two kinds of algorithms, exports audio penetration power assessment result according to preset algorithm, and with glottis Downpressure measurement result is abscissa, establishes vocal cord vibration phonation efficiency coordinate by ordinate of wave current index method measurement result Figure;
Training scheme generation module, for the assessment knot by human expert according to shape of the mouth as one speaks assessment module and sound assessment module Fruit gives the output of scheme training, and sends corresponding account for the training scheme of output;
Online AC module, the exchange mutual for each user and shared;
Central processing unit, for receiving the control command and demand order of human-computer interaction module input, and according to preset algorithm Corresponding module is sent to be executed;Modification for user's registration, rights management and password;It is also used to carry out user's body The certification of part;
Voice/video call module, for carrying out voice/video call with specified account according to selection, before being conversed Call request need to first be sent to corresponding account, the enabling of the module can be carried out after the account returns to confirmation message.
2. the multilingual talent according to claim 1 tests Verification System, which is characterized in that it further include a training module, For carrying out the training of language pronouncing spoken language, it is inside equipped with the outpost of several grade of difficulty, is equipped with and stores in each outpost The item database of corresponding index of difficulty carries out the tune of examination question in corresponding database using random mode in training With, and the difficulty at outpost is sequentially increased, while need to answer questions examination question all in the outpost, could open next outpost.
3. the multilingual talent according to claim 1 tests Verification System, which is characterized in that embed peace in the microphone Equipped with oral cavity baroceptor, oral airflow sensor.
4. described in any item multilingual talents test Verification System according to claim 1~3, which is characterized in that further include one Information database is tested, it is interior to be equipped with a variety of test patterns, test scene and test examination question data, and it is connected with data update Module, for carrying out the update of data in database by wired or wireless mode.
CN201811506859.4A 2018-12-11 2018-12-11 The multilingual talent tests Verification System Pending CN109857903A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811506859.4A CN109857903A (en) 2018-12-11 2018-12-11 The multilingual talent tests Verification System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811506859.4A CN109857903A (en) 2018-12-11 2018-12-11 The multilingual talent tests Verification System

Publications (1)

Publication Number Publication Date
CN109857903A true CN109857903A (en) 2019-06-07

Family

ID=66890925

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811506859.4A Pending CN109857903A (en) 2018-12-11 2018-12-11 The multilingual talent tests Verification System

Country Status (1)

Country Link
CN (1) CN109857903A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004047077A1 (en) * 2002-11-15 2004-06-03 Voice Signal Technologies, Inc. Multilingual speech recognition
US20090239201A1 (en) * 2005-07-15 2009-09-24 Richard A Moe Phonetic pronunciation training device, phonetic pronunciation training method and phonetic pronunciation training program
CN107945625A (en) * 2017-11-20 2018-04-20 陕西学前师范学院 A kind of pronunciation of English test and evaluation system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2004047077A1 (en) * 2002-11-15 2004-06-03 Voice Signal Technologies, Inc. Multilingual speech recognition
US20090239201A1 (en) * 2005-07-15 2009-09-24 Richard A Moe Phonetic pronunciation training device, phonetic pronunciation training method and phonetic pronunciation training program
CN107945625A (en) * 2017-11-20 2018-04-20 陕西学前师范学院 A kind of pronunciation of English test and evaluation system

Similar Documents

Publication Publication Date Title
CN107945625A (en) A kind of pronunciation of English test and evaluation system
CN106448701B (en) A kind of vocal music comprehensive training system
CN107030691B (en) Data processing method and device for nursing robot
CN106251874B (en) A kind of voice gate inhibition and quiet environment monitoring method and system
CN106409030A (en) Customized foreign spoken language learning system
CN110415681A (en) A kind of speech recognition effect testing method and system
CN106097828B (en) A kind of musicology teaching performance technical ability detection system
CN106898363A (en) A kind of vocality study electron assistant articulatory system
CN105976662A (en) History teaching system based on three-dimensional simulation system
CN105427708A (en) Vocal music pronunciation training system
CN110349667A (en) The autism assessment system analyzed in conjunction with questionnaire and multi-modal normal form behavioral data
CN106228996B (en) Vocality study electron assistant articulatory system
WO2019034184A1 (en) Method and system for articulation evaluation by fusing acoustic features and articulatory movement features
CN110379221A (en) A kind of pronunciation of English test and evaluation system
CN102663928A (en) Electronic teaching method for deaf people to learn speaking
CN108229441A (en) A kind of classroom instruction automatic feedback system and feedback method based on image and speech analysis
CN116109455B (en) Language teaching auxiliary system based on artificial intelligence
CN111862758A (en) Cardio-pulmonary resuscitation training and checking system and method based on artificial intelligence
CN106710591A (en) Voice customer service system for power terminal
CN106205635A (en) Method of speech processing and system
CN110956142A (en) Intelligent interactive training system
CN103077627B (en) Portable type visualized cardiophony teaching system
CN109377577A (en) A kind of Work attendance method based on recognition of face, system and storage device
CN108961860A (en) A kind of teaching simulation system suitable for international economy and trade profession
CN109857903A (en) The multilingual talent tests Verification System

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190607