CN102509483A - Distributive automatic grading system for spoken language test and method thereof - Google Patents
Distributive automatic grading system for spoken language test and method thereof Download PDFInfo
- Publication number
- CN102509483A CN102509483A CN2011103361794A CN201110336179A CN102509483A CN 102509483 A CN102509483 A CN 102509483A CN 2011103361794 A CN2011103361794 A CN 2011103361794A CN 201110336179 A CN201110336179 A CN 201110336179A CN 102509483 A CN102509483 A CN 102509483A
- Authority
- CN
- China
- Prior art keywords
- scoring
- task
- module
- examinee
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Electrically Operated Instructional Devices (AREA)
Abstract
The invention relates to a distributive automatic grading system for a spoken language test. The distributive automatic grading system comprises a grading management device, wherein the grading management device manages a plurality of test client devices and is communicated with at least one grading task dispatching device, one grading task dispatching device manages a plurality of grading calculation devices, and a module for automatic grading comprises a recording module, a voice processing module, a pronunciation evaluation module, a speech flow feature extraction module and a grading sub module, the recording module is used for detecting and recording the voice of examinees, the voice processing module is used for processing voice signals of the examinees, extracting the acoustic features, identifying texts corresponding to the voice and obtaining the time boundary of an acoustic unit, the pronunciation evaluation module is used for analyzing and evaluating different aspects of the user pronunciation according to topic information and output results of the voice processing module, the speech flow feature extraction module is used for extracting speech flow comprehensive features reflecting the spoken language levels of the examinees, including the acoustic, grammatical and semantic features, the grading sub module is used for carrying out comprehensive grading on the user voice by using the speech flow comprehensive features, and except the recording module, other grading modules can realize the dynamic deployment according to the test client devices, calculation loads of background grading calculation devices and network loads.
Description
Technical field
This patent relates to computer speech signal Processing and analysis, language assessment, pattern-recognition and Computer Assisted Instruction (CAI) field, particularly computer assisted distributed extensive SET automatic scoring method and system field.
Background technology
The tradition examination can be divided into two big types, and one type is written exam; One type is SET (high spot review student's conversational language ability).Along with deepening continuously of Quality Education, oracy more and more is much accounted of, and correspondingly, oral English teaching is also constantly being popularized with examination, such as, all begin to test oracy in national examination and the provincial examination.In the various in addition professional grade examinations, oracy also becomes the test emphasis, such as PSC, and College English grade examination, IELTS, the TOEFL etc.
Different with written exam, SET has dual mode usually: a kind of examinee of being and examiner carry out face-to-face exchange; Another kind is to record in the special context examinee's spoken voice to analyze to the examiner.The scoring of SET also has dual mode, and a kind of examiner of being provides scoring according to exchanging the experience scene; Another kind is through listening cls analysis to mark to examinee's voice.It is thus clear that, which kind of mode no matter, SET all needs the man power and material of labor, in the especially extensive examination.On the other hand, in extensive examination, require usually in finite time, to accomplish all scorings, need to improve scoring efficient.In addition, SET belongs to subjective item, and its scoring workload is huge, and subjectivity is bigger, and consistance is relatively poor.Therefore, in extensive SET, need a kind ofly not only the scoring of height consistance can be provided but also have the examination system and the method for high-efficiency and low-cost.
Computer technology has been applied to examination of education field, can reduce the examination cost, improves examination efficient.Relatively typical application comprises: general networked examination management system [CN101964152A, CN1801244A, CN1732490B; CN101827124A]; To the networked examination system [CN101419795B, the design of Oral English Practice examination system and realization (Chinese University of Science and Technology's Master's thesis)] of spoken language, network grading points-scoring system [CN1700200A; CN1598845A, CN1987889A] etc.Yet these work all do not relate to the organization and administration and the automatic scoring problem of extensive SET.
To the subjectivity problem of current SET expert scoring, the present invention utilizes computing machine and speech analysis techniques, and examinee's voice are carried out highly conforming automatic scoring.To the huge problem of extensive SET scoring task workload, the present invention utilizes computer network and calculation server that extensive examinee's voice are carried out distributed parallel scoring.
Summary of the invention
The present invention discloses the distributed automatic scoring system and the methods of marking thereof of the spoken examination of a cover; Solve in the current SET the low problem with the consistance difference of scoring efficient, especially the one cover solution of marking reliably, efficiently and cheaply is provided for extensive SET.
The present invention provides a kind of distributed automatic scoring system of SET; Comprise one the scoring management devices manage some examination client terminal devices; Scoring management devices and at least one scoring task scheduling apparatus communicate; A scoring task scheduling apparatus is managed some score calculation devices, and the module that wherein is used for automatic scoring comprises:
Recording module is used for detecting and recording examinee's voice;
Speech processing module is used for examinee's voice signal is handled, and extracts acoustic feature, and the text that recognizing voice is corresponding obtains the time border of acoustic elements;
The pronunciation evaluation module is used for the result according to exercise question information and speech processing module output, and the different aspect of user pronunciation is analyzed and assessed;
The flow characteristic extracting module is used to extract the flow comprehensive characteristics that reflects examinee's spoken language proficiency, comprises the characteristic of acoustics, syntax and semantics;
Comprehensive grading module: utilize the flow comprehensive characteristics, user speech is carried out comprehensive grading; Wherein
Except that recording module, other grading module can be come the dynamic dispatching deployment according to the computational load and the offered load of the score calculation device on examination client terminal device and backstage.
A kind of distributed automatic scoring method of SET also is provided, and wherein the concrete steps of scoring comprise:
Step 1, sound pick-up outfit detect examinee's voice and record;
Step 2, extraction phonetic feature utilize acoustic model and language model, and voice are discerned, and obtain corresponding text and phoneme unit time border and likelihood score score;
Step 3, utilize phoneme unit time border and likelihood score score and exercise question relevant knowledge, voice are carried out analysis and evaluation, obtain pronunciation accuracy, rhythm accuracy, pronunciation integrity degree and the fluent degree of pronunciation etc. of different phonetic unit;
Step 4, integrated voice result, assessment result and exercise question information are extracted the acoustics of reflection examinee spoken language proficiency, the flow comprehensive characteristics of syntax and semantics aspect;
Step 5, based on the model and the design rule of training in advance, use the flow comprehensive characteristics that examinee's spoken language proficiency is carried out comprehensive grading.
A kind of distributed automatic scoring method of SET further is provided, has specifically comprised the steps:
Step 1, examinee obtain exam question and answer on request; The examination client terminal device is recorded examinee's voice; With requiring examinee's voice are carried out the phase one score calculation according to exercise question information, send to the scoring management devices to examinee's voice and appraisal result according to data exchange standard;
Step 2, scoring management devices receive examinee's answer and the phase one appraisal result that the examination client device sends; Resolve appraisal result; If appraisal result is not final scoring; Then be made into the scoring task to examinee's voice and scoring intermediate result and exercise question message block, send to the scoring task scheduling apparatus after the encryption and further mark according to data exchange standard;
Step 3, scoring task scheduling apparatus receive the scoring task that the scoring management devices sends; Resolve the scoring task and obtain score data and task priority; Select required grading module and algorithm according to being provided with of grading module territory; Generate the score calculation program, the score calculation device that is submitted to the backstage according to task priority calculates;
Step 4, score calculation device receive the scoring procedures that task scheduling apparatus sends, and carry out the subordinate phase scoring, send to the scoring task scheduling apparatus to final appraisal result, and the task scheduling apparatus of marking then is forwarded to the scoring management devices to appraisal result again.
Description of drawings:
The institutional framework synoptic diagram of the distributed automatic scoring system of Fig. 1 SET.
The scoring schematic flow sheet of the distributed automatic scoring system and method for Fig. 2 SET.
The workflow synoptic diagram of the distributed automatic scoring system of Fig. 3 SET.
The deployment synoptic diagram of the distributed automatic scoring module of a kind of typical SET of Fig. 4.
Fig. 5 inserts the institutional framework synoptic diagram of distributed automatic scoring system of the SET of voice high in the clouds equipment.
The structural representation of the distributed automatic scoring system environments of the SET that Fig. 6 simplifies.
Embodiment
Below in conjunction with accompanying drawing and specific embodiment the present invention is done further detailed description:
Fig. 1 has provided the institutional framework synoptic diagram of the disclosed system of the present invention.A kind of distributed automatic scoring system of SET is made up of four bigger devices: examination client terminal device 101, scoring management devices 102, scoring task scheduling apparatus 103 and score calculation device 104.
Alternatively, support graphic user interface and touch control operation.
It shows the examination paper content through graphical interfaces to the examinee; Play the examination paper audio frequency through audio playing unit (as: headphone or loudspeaker); Record examinee's voice through audio recording unit (as: microphone); Through local computing unit check on one's answers (being examinee's voice) carry out pre-service and certain score calculation (abbreviating the phase one scoring as), send examinee's answer and appraisal result (appraisal result normally) to the management devices of marking through network or other modes.And can keep in examinee's voice, carry out the off-line asynchronous transmission.
Can also on the examination client device, dispose a special-purpose examination client-side program or a browser to accomplish above-mentioned recording and scoring work with examination plug-in unit.
Scoring management equipment 102 is the computing machines that obtain examinee's answer and phase one appraisal result, tissue and submit the scoring task to.
It obtains examinee's answer and phase one appraisal result from the examination client device, utilizes this appraisal result and exercise question information structuring scoring task, sends to the scoring task scheduling apparatus, and receives the final appraisal result from the scoring task scheduling apparatus.
Has reliable mass-memory unit, general configurable high data transmission broadband.Preserve examinee's answer and final appraisal result, and temporary next middle appraisal result to the phase one scoring.
Scoring task scheduling equipment 103 is the computing machines that are used to receive scoring task, parsing and structure score calculation task, submission calculation task and management score calculation device.
It receives the scoring task that the scoring management equipment is sent; The parsing task; Extract score data, organize the score calculation program automatically, generate the score calculation task according to information such as exercise question information and the required modules of scoring; Submit to calculation task to the score calculation device through dispatching algorithm, obtain final appraisal result from computing equipment at last.
Especially, said scoring task scheduling apparatus has reliable mass-memory unit, and generally can have high data transmission broadband.
Especially, said scoring task scheduling apparatus keeps one section memory headroom, safeguards the calculation task formation of a prioritization.
Especially, the task scheduling algorithm of said scoring task scheduling apparatus is: if task queue is discontented, then insert the formation relevant position to task according to its priority; Task priority is higher than some task priority in the formation else if, then is moved out to buffer area or external memory storage to the minimum task of priority, inserts the formation relevant position to this task; Otherwise store this task into buffer area or external memory storage; Regularly query task formation if having living space, then adds formation to the buffer area task by its priority; Each score calculation equipment of automatic regular polling, if there is CPU idle, the task of then from task queue, getting is carried out computing to this CPU.
The calculating cluster that score calculation equipment 104 is made up of some high-performance CPU, all CPU can concurrent working.It carries out the score calculation program that the scoring task scheduling apparatus is submitted to, through calculating appraisal result and exporting to the scoring task scheduling apparatus.
But its characteristics of distributed automatic scoring system of SET are said scoring task scheduling apparatus and can constitute a plurality of scoring taskings the calculation task of a batch processing together, submit to the score calculation equipment on backstage.
Its characteristics of distributed automatic scoring system of SET are that said examination client terminal device can dispose a plurality of grading module.Guaranteeing to utilize local cpu to accomplish the scoring work of phase one under the impregnable situation of examination Recording Process.Said phase one scoring work can be carried out with examination simultaneously, for avoiding that examination is had any impact, and also can be at the free time timing operation outside the examination.
Its characteristics of distributed automatic scoring system of SET are that said scoring task scheduling apparatus can be connected through wide area network with the scoring management devices, also can connect through LAN.
Its characteristics of distributed automatic scoring system of SET are that the score calculation device on said backstage can be a common computer, also can the high performance computing service device.These score calculation devices connect through LAN, constitute one and calculate cluster.
The structure of the distributed automatic scoring system of described SET is: a scoring management devices is managed some examination client terminal devices; Scoring management devices and at least one said scoring task scheduling apparatus communicate, and a scoring task scheduling apparatus is managed the score calculation device on some backstages.
The network structure of the distributed automatic scoring system of described SET is: between scoring management devices and the examination client terminal device through LAN or dedicated Internet access; Connect through LAN between the score calculation device on scoring task scheduling apparatus and backstage; Data communication between scoring management devices and the scoring task scheduling apparatus both also can be carried out through other data transfer modes of maintaining secrecy through any refined net.
Specifically, also can carry out data transmission between scoring management devices and the examination client terminal device and between scoring management devices and the scoring task scheduling apparatus through movable storage device.
Fig. 2 has provided the grading module and the flow process of the distributed automatic scoring system and method for SET.The nucleus module of the distributed automatic scoring system and method for SET comprises: recording module 201, speech processing module 202, pronunciation evaluation module 203, flow characteristic extracting module 204 and comprehensive grading module 205.
Recording module 201: detect and record examinee's voice.
Said recording module utilizes sound end detecting method to detect examinee's voice automatically, perhaps starts recording through receiving examinee's manual operations order.
Speech processing module 202: examinee's voice signal is handled, extracted acoustic feature, the text that recognizing voice is corresponding obtains the time border of acoustic elements.
Its characteristics of said speech processing module are to support real-time online to handle and off-line batch processing dual mode.Speech recognition process in the said speech processing module both can adopt local service to accomplish, and also can serve through access to netwoks voice high in the clouds and accomplish.
Pronunciation evaluation module 203: the result according to exercise question information and speech processing module 202 outputs, analyze and assess the different aspect of user pronunciation.
Said its characteristics of pronunciation evaluation module are that pronunciation evaluation comprises four aspects at least: the fluent degree of the pronunciation accuracy of different units, rhythm accuracy (like stress, tone, intonation etc.), pronunciation integrity degree and pronunciation.
Flow characteristic extracting module 204: extract the flow comprehensive characteristics of reflection examinee spoken language proficiency, comprise the characteristic of acoustics, syntax and semantics.
Said flow characteristic extracting module is characterized in that a characteristic part of being extracted comes from pronunciation evaluation module 203, and a part is from exercise question information, and some is from speech processing module 202.
Said exam question information comprises exercise question type, exercise question requirement, item content, investigation emphasis and model answer text etc. at least.
Scoring submodule 205: utilize the flow comprehensive characteristics, user speech is carried out comprehensive grading.
Said scoring submodule is characterized in that the flow comprehensive characteristics comes from flow characteristic extracting module 204, and comprehensive grading algorithm statistics combines with rule.
The methods of marking of the distributed automatic scoring method of SET comprises the steps:
Step 1 detects examinee's voice and records through recording module;
Step 2 is extracted phonetic feature, utilizes acoustic model and language model, and voice are discerned, and obtains corresponding text and acoustic elements time border and likelihood score score;
Step 3 is utilized acoustic elements time border and likelihood score score and exercise question relevant knowledge, and voice are carried out analysis and evaluation, obtains the scoring of pronunciation accuracy, rhythm accuracy, pronunciation integrity degree and the fluent degree of pronunciation etc. of different phonetic unit;
Step 4 is extracted the acoustics of reflection examinee spoken language proficiency, the flow comprehensive characteristics of syntax and semantics aspect from the output result of speech processing module and pronunciation evaluation module and exam question information;
Step 5 based on the model and the designed regular of training in advance, uses the flow comprehensive characteristics that examinee's spoken language proficiency is carried out comprehensive grading.
The distributed automatic scoring method of said SET is characterized in that between each grading module it being that front and back rely on, and the input information of each grading module comes from the calculating output of last module, and wherein the computational complexity of speech processing module 202 is the highest.
Fig. 3 has provided the workflow of the distributed automatic scoring system of SET:
The first step; The examinee obtains exam question and answers on request; The examination client device is recorded examinee's voice, with requiring examinee's voice is carried out the phase one score calculation according to exercise question information, sends to the scoring management devices to examinee's voice and appraisal result according to data exchange standard;
Second step; The scoring management devices receives examinee's answer and the appraisal result that the examination client terminal device sends; Resolve appraisal result; If appraisal result is not final scoring, then be organized into the scoring task to examinee's voice and scoring intermediate result according to data exchange standard, send to the scoring task scheduling apparatus after the encryption and further mark;
The 3rd step; The scoring task scheduling apparatus receives the scoring task that the scoring management devices sends; Resolve the scoring task and obtain score data and task priority; Select required grading module and algorithm according to being provided with of grading module territory, generate the score calculation program, the score calculation device that is submitted to the backstage according to task priority calculates;
The 4th step; The score calculation device receives the scoring procedures that the scoring task scheduling apparatus sends; The scoring of execution subordinate phase sends to the scoring task scheduling apparatus to final appraisal result, and the task scheduling apparatus of marking then is forwarded to the scoring management devices to appraisal result again.
Its key features of distributed automatic scoring system of disclosed SET is that the automatic scoring process can be divided into two stages: be positioned at the phase one scoring on the examination client terminal device and be positioned at the subordinate phase scoring on the score calculation device on backstage.
Its key feature of distributed automatic scoring system of disclosed SET is that described automatic scoring module can belong to the first scoring stage and the second scoring stage respectively.
Its key feature of distributed automatic scoring system of disclosed SET is that said phase one scoring is deployed on the examination client terminal device, and the subordinate phase scoring is deployed on the score calculation device.
The subordinate phase scoring that its key feature of distributed automatic scoring system of disclosed SET is to be deployed on the score calculation device supports the batch of extensive scoring task to calculate, and a plurality of score calculation task independent parallels are carried out.
Its key feature of distributed automatic scoring system of disclosed SET is that also subordinate phase score calculation task can comprise the scoring of a plurality of examinees' multiple tracks exercise question simultaneously.The identical grading module of different examinees and examination paper can be shared identical scoring resource in the same score calculation task, reduces time and space waste that resource repeats to load.
Its characteristic of distributed automatic scoring system of disclosed SET also is both to have supported extensive off-line to mark in batches, also supports online scoring on a small scale.
Its characteristic of distributed automatic scoring system of said SET is also to support online scoring on a small scale that the task of promptly at every turn marking is only handled one examination paper answer of an examinee, direct feedback score after examination is accomplished.
Its key feature of distributed automatic scoring system of disclosed SET is to remove other grading module of recording module other places can come the dynamic dispatching deployment according to the computational load and the offered load of the score calculation device on examination client terminal device and backstage.
Its key feature of distributed automatic scoring system of disclosed SET is to be deployed in the grading module on the examination client terminal device, and recording module has limit priority, guarantees that the execution of other modules can not influence sound-recording function.
According to the position that grading module is disposed, the distributed automatic scoring system of SET has following four kinds of grading module deployment schemes:
Four kinds of grading module deployment schemes of the distributed automatic scoring system of table 1 SET
Specifically, in scheme 4, the score calculation device that the scoring task no longer need be sent into the backstage calculates.
Fig. 4 has provided the grading module of scheme 1 and has disposed synoptic diagram.The distributed automatic scoring system of whole SET can be divided into two big modules: front-end module and rear module.
Said front-end module comprises examination client terminal device and scoring management devices.The client terminal device deploy of wherein taking an examination has recording module and speech processing module.
Said rear module comprises the score calculation device on scoring task scheduling apparatus and backstage.Wherein the score calculation device deploy on backstage has the pronunciation evaluation module, flow characteristic extracting module and comprehensive grading module.
Typically, scheme 1 is disposed recording module and speech processing module on the preceding root module, and other module is deployed on the rear module.
The benefit of deployment scheme 1 is that the computing power that makes full use of the examination client terminal device is accomplished language process function, can alleviate the pressure of the score calculation device on backstage, and the load that is unlikely to simultaneously to cause the examination client terminal device again is too heavy and influence recording work.
Its characteristic of distributed automatic scoring system of said SET client terminal device that also is to take an examination can be connected with voice high in the clouds system through network, can make full use of the high in the clouds computational resource.
Deployment scheme 1 its characteristic of the distributed automatic scoring system of said SET also is, the speech recognition of speech processing module is calculated and can be submitted to voice high in the clouds and accomplish, thereby alleviates the computational load of examination client.
Fig. 5 is the institutional framework synoptic diagram of distributed automatic scoring system that inserts the SET of voice cloud system.Examination client terminal device 101 is through network insertion voice high in the clouds system 105.
Under the situation of grading module deployment scheme 1, examination client terminal device 101 is at first recorded examinee's voice; Carry out speech processes then; Send to system enterprising lang sound identification in voice high in the clouds to the acoustic feature of examinee's voice or examinee's voice; And acquisition voice identification result; After other speech processes work of completion, send to scoring management devices 102 to the result of exercise question information, examinee's voice and speech processes together, carry out follow-up scoring work of treatment by scoring management devices 102.
The distributed automatic scoring system of said SET it is characterized in that if the Marking apparatus on backstage and scoring management devices in same LAN; Perhaps data transmission is through movable storage device, and then the scoring management devices in the distributed automatic scoring system of said SET can merge with the scoring task scheduling apparatus.This system is the distributed automatic scoring system of a SET of simplifying.
Fig. 6 has provided a kind of structural representation of distributed automatic scoring system environments of SET of simplifying.
The distributed automatic scoring system of described SET of simplifying comprises examination client terminal device 301, task management equipment 302 and score calculation device 303.
Among examination client terminal device 301 and Fig. 1 the function of 101 modules with dispose identical.
The function of 104 modules is identical with configuration among score calculation device 303 and Fig. 1.
Task management equipment 302: receive examinee's answer and appraisal result, resolve appraisal result, score data and exercise question information structuring score calculation program in the middle of utilizing are submitted the score calculation task to, receive final appraisal result.
Specifically, can utilize movable storage device to move to the scoring management devices to examinee's answer and appraisal result on each examination client terminal device.Scoring supervisory routine on the scoring management devices is resolved appraisal result; Score data, examinee's voice and exercise question information in the middle of extracting; Be connected with the scoring procedures of required grading module; Gather a plurality of scoring tasks and generate score calculation task in batches, the score calculation equipment of submitting to the backstage then calculates.
Its characteristics of distributed automatic scoring system of said SET also are to have a cover and calculate fault tolerant mechanism, to guarantee the stability of score calculation.Concrete measure comprises:
1) dispose subsequent use computing equipment: for the redundant CPU of the score calculation equipment disposition on backstage with reply burst hardware fault.If there is score calculation equipment to break down, the scoring task scheduling equipment is launched subsequent use score calculation equipment automatically, and resubmits the scoring task on this computing machine, and sends a warning.Subsequent use score calculation equipment is in waiting status always, and the scoring task scheduling equipment can be launched this equipment at any time.Usually be provided with score calculation equipment can use CPU 1/10th as subsequent use computing equipment.
2) daily record of record calculation process: the scoring task of inscribing for per pass all keeps a journal file; Begin until obtain last scoring from recording; Write down the implementation status of each step in each scoring submodule, comprise the instruction of execution at least, data directory; Execution time, information such as executing state.
3) detect recording unusually: before examination formally began, recording module required examinee's rehearsal sound.Through analyzing the sound signal of obtaining from examinee's sound pick-up outfit, detect the unusual of sound pick-up outfit, such as: do not have voice, the too big or volume of volume is too little etc., and abnormal conditions all will be pointed out the examinee.
4) detect the score calculation task abnormity: the computation process of each scoring task of scoring task scheduling apparatus monitoring of rear module; If find to have the task computation failure; If the computing hardware problem causes, then launch subsequent use computational resource, and resubmit calculation task; Otherwise misregistration information, information gives a warning.
5) detect data transmission exception: examination client terminal device and scoring management devices monitor data transmission course, if data transmission fails is arranged, the some time transmits again at interval, and misregistration information, information gives a warning.
6) data backup: the interim result who preserves examinee's voice and phase one scoring on the examination client terminal device, successfully transmit up to these data.On front end scoring management devices, preserve examinee's voice, scoring task and final appraisal result.Interim scoring task and the final appraisal result of preserving on the scoring task scheduling apparatus of rear end.
Certainly; The present invention also can have other various embodiments; Under the situation that does not deviate from spirit of the present invention and essence thereof; Those of ordinary skill in the art work as can make various corresponding changes and distortion according to the present invention, but these corresponding changes and distortion all should belong to the protection domain of the appended claim of the present invention.
Claims (14)
1. the distributed automatic scoring system of a SET; Comprise one the scoring management devices manage some examination client terminal devices; Scoring management devices and at least one scoring task scheduling apparatus communicate; A scoring task scheduling apparatus is managed some score calculation devices, and the module that wherein is used for automatic scoring comprises:
Recording module is used for detecting and recording examinee's voice;
Speech processing module is used for examinee's voice signal is handled, and extracts acoustic feature, and the text that recognizing voice is corresponding obtains the time border of acoustic elements;
The pronunciation evaluation module is used for the result according to exercise question information and speech processing module output, and the different aspect of user pronunciation is analyzed and assessed;
The flow characteristic extracting module is used to extract the flow comprehensive characteristics that reflects examinee's spoken language proficiency, comprises the characteristic of acoustics, syntax and semantics;
Comprehensive grading module: utilize the flow comprehensive characteristics, user speech is carried out comprehensive grading; Wherein
Except that recording module, other grading module can be come the dynamic dispatching deployment according to the computational load and the offered load of the score calculation device on examination client terminal device and backstage.
2. the distributed automatic scoring system of SET as claimed in claim 1, wherein
The examination client terminal device; Be used for recording examinee's voice through said recording module; Through said local computing unit pre-service is carried out in examinee's answer; Calculate certain middle appraisal result, send to the scoring management devices to examinee's answer and middle appraisal result thereof through network communication unit or other modes;
The scoring management devices; Be used to obtain examinee's answer and middle appraisal result thereof from the examination client terminal device; Appraisal result and exercise question information structuring scoring task sends to the scoring task scheduling apparatus in the middle of utilizing, and receives the final appraisal result from the scoring task scheduling apparatus;
The scoring task scheduling apparatus; Be used to receive the scoring task that said scoring management devices sends; Resolve and extract score data, organize the score calculation program automatically, generate the score calculation task according to information such as exercise question information and the required modules of scoring; Submit to calculation task to the score calculation device through dispatching algorithm, obtain final appraisal result from the score calculation device at last;
The score calculation device is used to receive and carry out the scoring procedures that said scoring task scheduling apparatus sends, and sends to said scoring task scheduling apparatus to final appraisal result.
3. the distributed automatic scoring system of SET as claimed in claim 2, the client terminal device of wherein taking an examination can be disposed a plurality of grading module, is guaranteeing to utilize local cpu to accomplish certain scoring work under the impregnable situation of Recording Process; Said scoring work can be carried out with examination simultaneously, for avoiding that examination is had any impact, and also can be at the free time timing operation outside the examination.
4. the distributed automatic scoring system of SET as claimed in claim 2, the management devices of wherein marking disposes reliable mass-memory unit with the scoring task scheduling apparatus, generally can have high data transfer bandwidth; Said scoring task scheduling apparatus is safeguarded the calculation task formation of a prioritization in internal memory.
5. the distributed automatic scoring system of SET as claimed in claim 2; The network data transmission mode of wherein taking an examination between client terminal device, scoring management devices and the scoring task scheduling apparatus can use other data transfer mode to substitute, and all the other devices and workflow still remain unchanged; Consider from data confidentiality, transmit data and can carry out encryption.
6. the distributed automatic scoring system of SET as claimed in claim 4, the task scheduling algorithm of wherein said scoring task scheduling apparatus is: if task queue is discontented, then insert the formation relevant position to task according to its priority; Task priority is higher than some task priority in the formation else if, then is moved out to buffer area or external memory storage to the minimum task of priority, inserts the formation relevant position to this task; Otherwise store this task into buffer area or external memory storage; Regularly query task formation if having living space, then adds formation to the buffer area task by its priority; Each score calculation device of automatic regular polling, if there is CPU idle, the task of then from task queue, getting is carried out computing to this CPU.
7. the distributed automatic scoring system of SET as claimed in claim 4, but wherein said scoring task scheduling apparatus is submitted to the score calculation device to the calculation task that a plurality of scoring taskings constitute a batch processing together.
8. the distributed automatic scoring system of SET as claimed in claim 1, wherein the flow characteristic extracting module combines exam question information to extract the flow comprehensive characteristics according to the output result of speech processing module and pronunciation evaluation module; Said exam question information comprises exercise question type, exercise question requirement, item content, investigation emphasis and model answer text at least.
9. the distributed automatic scoring system of SET as claimed in claim 1, its automatic scoring process is divided into two stages: the phase one scoring is deployed on the examination client terminal device; The subordinate phase scoring is deployed on the score calculation device; Wherein: the phase one scoring comprises recording module.
10. the distributed automatic scoring system of SET as claimed in claim 1, its automatic scoring module is successively to rely on; Except that recording module, other modules can be on phase one scoring and subordinate phase be marked flexible allocation; Concrete scheme is: the phase one scoring also comprises speech processing module; The subordinate phase scoring is made up of pronunciation evaluation module, flow characteristic extracting module and comprehensive grading module.
11. the distributed automatic scoring system of SET as claimed in claim 9, the subordinate phase scoring that is deployed on the score calculation device supports the batch of extensive scoring task to calculate, and a plurality of score calculation task independent parallels are carried out; Each score calculation task of subordinate phase scoring can comprise the scoring of answer of a plurality of examinees' multiple tracks exercise question or a whole set of examination question.
12. the distributed automatic scoring method of a SET, wherein the concrete steps of scoring comprise:
Step 1, detect examinee's voice and record through recording module;
Step 2, extraction phonetic feature utilize acoustic model and language model, and voice are discerned, and obtain corresponding text and phoneme unit time border and likelihood score score;
Step 3, utilize phoneme unit time border and likelihood score score and exercise question relevant knowledge, voice are carried out analysis and evaluation, obtain pronunciation accuracy, rhythm accuracy, pronunciation integrity degree and the fluent degree of pronunciation etc. of different phonetic unit;
Step 4, integrated voice result, assessment result and exercise question information are extracted the acoustics of reflection examinee spoken language proficiency, the flow comprehensive characteristics of syntax and semantics aspect;
Step 5, based on the model and the designed regular of training in advance, use the flow comprehensive characteristics that examinee's spoken language proficiency is carried out comprehensive grading.
13. the distributed automatic scoring method of a SET specifically comprises the steps:
Step 1, examinee obtain exam question and answer on request; The examination client terminal device is recorded examinee's voice; With requiring examinee's voice are carried out the phase one score calculation according to exercise question information, send to the scoring management devices to the phase one appraisal result of examinee's voice and acquisition according to the self-defining data exchange standard;
Step 2, scoring management devices receive examinee's answer and the phase one appraisal result that the examination client terminal device sends; Resolve appraisal result; If appraisal result is not final scoring; Then be made into the scoring task to examinee's voice and scoring intermediate result and exercise question message block, send to the scoring task scheduling apparatus and carry out the subordinate phase scoring according to the self-defining data exchange standard;
Step 3, scoring task scheduling apparatus receive the scoring task that the scoring management devices sends; Resolve the scoring task and obtain score data and task priority; Select required grading module and algorithm according to being provided with of grading module territory; Generate the score calculation program, the score calculation device that is submitted to the backstage according to task priority calculates;
Step 4, score calculation device receive the scoring procedures that task scheduling apparatus sends, and carry out the subordinate phase scoring, send to the scoring task scheduling apparatus to final appraisal result, and the task scheduling apparatus of marking then is forwarded to the scoring management devices to appraisal result again.
14. the distributed automatic scoring system of SET as claimed in claim 1, said automatic scoring system comprises that a cover calculates fault tolerant mechanism, specifically comprises:
1) dispose subsequent use computational resource: for the CPU of backstage score calculation device configuring redundancy with reply burst hardware fault; If there is the score calculation device to break down, said task scheduling apparatus is launched subsequent use score calculation device CPU automatically, and resubmits the scoring task on this computing machine, and sends a warning; Subsequent use score calculation device is in waiting status always, and said task scheduling apparatus can be launched the CPU of this device at any time;
2) daily record of record calculation process: the scoring task of inscribing for per pass all keeps a journal file; Up to obtaining last scoring, write down the implementation status of each step in each grading module from the recording beginning, comprise the order of execution at least; Data directory, execution time and execution state information;
3) detect recording unusually: before examination formally began, said recording module required examinee's rehearsal sound.Through examinee's sound signal that analysis is obtained, it is unusual to detect sound-recording function, and prompting examinee adjustment;
4) detect the score calculation task abnormity: the computation process of said each scoring task of scoring task scheduling apparatus monitoring, if find to have the task computation failure,, then launch subsequent use computational resource, and resubmit task if the computing hardware problem causes; Otherwise misregistration information, information gives a warning;
5) detect data transmission exception: said examination client terminal device and scoring management devices monitor data transmission course, if data transmission fails is arranged, the some time transmits again at interval, and misregistration information, information gives a warning;
6) data backup: said examination client terminal device is preserved the result of user speech and phase one scoring temporarily, successfully transmits up to these data; Said scoring management devices is preserved examinee's voice, scoring task and final appraisal result; Said scoring task scheduling apparatus is preserved scoring task and final appraisal result temporarily.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110336179.4A CN102509483B (en) | 2011-10-31 | 2011-10-31 | A kind of distributed Auto-Evaluation System of SET and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110336179.4A CN102509483B (en) | 2011-10-31 | 2011-10-31 | A kind of distributed Auto-Evaluation System of SET and method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102509483A true CN102509483A (en) | 2012-06-20 |
| CN102509483B CN102509483B (en) | 2015-10-21 |
Family
ID=46221559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110336179.4A Active CN102509483B (en) | 2011-10-31 | 2011-10-31 | A kind of distributed Auto-Evaluation System of SET and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102509483B (en) |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102779435A (en) * | 2012-07-30 | 2012-11-14 | 无锡南理工科技发展有限公司 | Wireless intelligent answering system supporting multi-network and multi-terminal and data transmission method thereof |
| CN103151042A (en) * | 2013-01-23 | 2013-06-12 | 中国科学院深圳先进技术研究院 | Full-automatic oral language evaluating management and scoring system and scoring method thereof |
| CN103258544A (en) * | 2013-04-15 | 2013-08-21 | 深圳市海云天科技股份有限公司 | Recording testing method, recording testing device, examination terminal and examination system |
| CN103605492A (en) * | 2013-11-28 | 2014-02-26 | 中国科学院深圳先进技术研究院 | Self-adaption language training method and platform |
| CN103685313A (en) * | 2013-12-26 | 2014-03-26 | 北京中电普华信息技术有限公司 | Communication method and system applied to online examination |
| CN104240543A (en) * | 2013-06-19 | 2014-12-24 | 一宇数位科技股份有限公司 | Cloud course market teaching system |
| CN104347071A (en) * | 2013-08-02 | 2015-02-11 | 安徽科大讯飞信息科技股份有限公司 | Method and system for generating oral test reference answer |
| CN104575490A (en) * | 2014-12-30 | 2015-04-29 | 苏州驰声信息科技有限公司 | Spoken language pronunciation detecting and evaluating method based on deep neural network posterior probability algorithm |
| CN104715640A (en) * | 2015-03-14 | 2015-06-17 | 陕西学前师范学院 | Language teaching system |
| CN105556564A (en) * | 2013-07-16 | 2016-05-04 | 株式会社倍乐生 | Portable information processing device, test assistance system, and test assistance method |
| CN106205635A (en) * | 2016-07-13 | 2016-12-07 | 中南大学 | Method of speech processing and system |
| CN106409283A (en) * | 2016-08-31 | 2017-02-15 | 上海交通大学 | Audio frequency-based man-machine mixed interaction system and method |
| CN107316255A (en) * | 2017-04-07 | 2017-11-03 | 苏州清睿教育科技股份有限公司 | A kind of efficient competition method competed online that shuttles |
| CN107578778A (en) * | 2017-08-16 | 2018-01-12 | 南京高讯信息科技有限公司 | A kind of method of spoken scoring |
| CN107767862A (en) * | 2017-11-06 | 2018-03-06 | 深圳市领芯者科技有限公司 | Voice data processing method, system and storage medium |
| CN108877308A (en) * | 2018-07-14 | 2018-11-23 | 汤凯 | A kind of VR safety education evaluating method |
| CN109087667A (en) * | 2018-09-19 | 2018-12-25 | 平安科技（深圳）有限公司 | The recognition methods of voice fluency, device, computer equipment and readable storage medium storing program for executing |
| CN109147765A (en) * | 2018-11-16 | 2019-01-04 | 安徽听见科技有限公司 | Audio quality comprehensive evaluating method and system |
| CN109785698A (en) * | 2017-11-13 | 2019-05-21 | 上海流利说信息技术有限公司 | Method, apparatus, electronic equipment and medium for spoken language proficiency evaluation and test |
| CN109889938A (en) * | 2019-01-17 | 2019-06-14 | 东南大学 | Interpretation examination recording device |
| CN110164422A (en) * | 2019-04-03 | 2019-08-23 | 苏州驰声信息科技有限公司 | A kind of the various dimensions appraisal procedure and device of speaking test |
| CN110164447A (en) * | 2019-04-03 | 2019-08-23 | 苏州驰声信息科技有限公司 | A kind of spoken language methods of marking and device |
| CN110827835A (en) * | 2019-11-21 | 2020-02-21 | 上海好学网络科技有限公司 | Spoken language examination system and method |
| CN111161577A (en) * | 2019-12-25 | 2020-05-15 | 上海好学网络科技有限公司 | Spoken language examination system and method |
| CN111833853A (en) * | 2020-07-01 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Voice processing method and device, electronic equipment and computer readable storage medium |
| CN113674766A (en) * | 2021-08-18 | 2021-11-19 | 上海复深蓝软件股份有限公司 | Voice evaluation method and device, computer equipment and storage medium |
| CN114245194A (en) * | 2021-12-23 | 2022-03-25 | 深圳市优必选科技股份有限公司 | Video teaching interaction method and device and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094104A (en) * | 2007-07-30 | 2007-12-26 | 中兴通讯股份有限公司 | Method and device for carrying out device management through proxy of security network management |
| CN101197084A (en) * | 2007-11-06 | 2008-06-11 | 安徽科大讯飞信息科技股份有限公司 | Automatic spoken English evaluating and learning system |
| CN101739868A (en) * | 2008-11-19 | 2010-06-16 | 中国科学院自动化研究所 | Automatic evaluation and diagnosis method of text reading level for oral test |
| CN201570038U (en) * | 2009-12-09 | 2010-09-01 | 丁肇芬 | Blinding control system for spoken language tests |
-
2011
- 2011-10-31 CN CN201110336179.4A patent/CN102509483B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101094104A (en) * | 2007-07-30 | 2007-12-26 | 中兴通讯股份有限公司 | Method and device for carrying out device management through proxy of security network management |
| CN101197084A (en) * | 2007-11-06 | 2008-06-11 | 安徽科大讯飞信息科技股份有限公司 | Automatic spoken English evaluating and learning system |
| CN101739868A (en) * | 2008-11-19 | 2010-06-16 | 中国科学院自动化研究所 | Automatic evaluation and diagnosis method of text reading level for oral test |
| CN201570038U (en) * | 2009-12-09 | 2010-09-01 | 丁肇芬 | Blinding control system for spoken language tests |
Non-Patent Citations (1)
| Title |
|---|
| 严可等: "面向大规模英语口语机考的复述题自动评分技术", 《清华大学学报（自然科学版）》 * |
Cited By (38)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102779435A (en) * | 2012-07-30 | 2012-11-14 | 无锡南理工科技发展有限公司 | Wireless intelligent answering system supporting multi-network and multi-terminal and data transmission method thereof |
| CN103151042A (en) * | 2013-01-23 | 2013-06-12 | 中国科学院深圳先进技术研究院 | Full-automatic oral language evaluating management and scoring system and scoring method thereof |
| CN103151042B (en) * | 2013-01-23 | 2016-02-24 | 中国科学院深圳先进技术研究院 | Full-automatic oral evaluation management and points-scoring system and methods of marking thereof |
| CN103258544A (en) * | 2013-04-15 | 2013-08-21 | 深圳市海云天科技股份有限公司 | Recording testing method, recording testing device, examination terminal and examination system |
| CN103258544B (en) * | 2013-04-15 | 2016-05-25 | 深圳市海云天科技股份有限公司 | A kind of examination system |
| CN104240543A (en) * | 2013-06-19 | 2014-12-24 | 一宇数位科技股份有限公司 | Cloud course market teaching system |
| CN105556564A (en) * | 2013-07-16 | 2016-05-04 | 株式会社倍乐生 | Portable information processing device, test assistance system, and test assistance method |
| CN104347071A (en) * | 2013-08-02 | 2015-02-11 | 安徽科大讯飞信息科技股份有限公司 | Method and system for generating oral test reference answer |
| CN103605492A (en) * | 2013-11-28 | 2014-02-26 | 中国科学院深圳先进技术研究院 | Self-adaption language training method and platform |
| CN103605492B (en) * | 2013-11-28 | 2016-08-17 | 中国科学院深圳先进技术研究院 | A kind of self adaptation speech training method and platform |
| CN103685313A (en) * | 2013-12-26 | 2014-03-26 | 北京中电普华信息技术有限公司 | Communication method and system applied to online examination |
| CN104575490A (en) * | 2014-12-30 | 2015-04-29 | 苏州驰声信息科技有限公司 | Spoken language pronunciation detecting and evaluating method based on deep neural network posterior probability algorithm |
| CN104575490B (en) * | 2014-12-30 | 2017-11-07 | 苏州驰声信息科技有限公司 | Spoken language pronunciation evaluating method based on deep neural network posterior probability algorithm |
| CN104715640A (en) * | 2015-03-14 | 2015-06-17 | 陕西学前师范学院 | Language teaching system |
| CN106205635A (en) * | 2016-07-13 | 2016-12-07 | 中南大学 | Method of speech processing and system |
| CN106409283A (en) * | 2016-08-31 | 2017-02-15 | 上海交通大学 | Audio frequency-based man-machine mixed interaction system and method |
| CN106409283B (en) * | 2016-08-31 | 2020-01-10 | 上海交通大学 | Man-machine mixed interaction system and method based on audio |
| CN107316255A (en) * | 2017-04-07 | 2017-11-03 | 苏州清睿教育科技股份有限公司 | A kind of efficient competition method competed online that shuttles |
| CN107578778A (en) * | 2017-08-16 | 2018-01-12 | 南京高讯信息科技有限公司 | A kind of method of spoken scoring |
| CN107767862A (en) * | 2017-11-06 | 2018-03-06 | 深圳市领芯者科技有限公司 | Voice data processing method, system and storage medium |
| CN107767862B (en) * | 2017-11-06 | 2024-05-21 | 深圳市领芯者科技有限公司 | Voice data processing method, system and storage medium |
| CN109785698A (en) * | 2017-11-13 | 2019-05-21 | 上海流利说信息技术有限公司 | Method, apparatus, electronic equipment and medium for spoken language proficiency evaluation and test |
| CN108877308A (en) * | 2018-07-14 | 2018-11-23 | 汤凯 | A kind of VR safety education evaluating method |
| CN109087667A (en) * | 2018-09-19 | 2018-12-25 | 平安科技（深圳）有限公司 | The recognition methods of voice fluency, device, computer equipment and readable storage medium storing program for executing |
| CN109087667B (en) * | 2018-09-19 | 2023-09-26 | 平安科技（深圳）有限公司 | Voice fluency recognition method and device, computer equipment and readable storage medium |
| WO2020056995A1 (en) * | 2018-09-19 | 2020-03-26 | 平安科技（深圳）有限公司 | Method and device for determining speech fluency degree, computer apparatus, and readable storage medium |
| CN109147765A (en) * | 2018-11-16 | 2019-01-04 | 安徽听见科技有限公司 | Audio quality comprehensive evaluating method and system |
| CN109889938B (en) * | 2019-01-17 | 2021-03-26 | 东南大学 | Oral interpretation examination recording device |
| CN109889938A (en) * | 2019-01-17 | 2019-06-14 | 东南大学 | Interpretation examination recording device |
| CN110164422A (en) * | 2019-04-03 | 2019-08-23 | 苏州驰声信息科技有限公司 | A kind of the various dimensions appraisal procedure and device of speaking test |
| CN110164447B (en) * | 2019-04-03 | 2021-07-27 | 苏州驰声信息科技有限公司 | Spoken language scoring method and device |
| CN110164447A (en) * | 2019-04-03 | 2019-08-23 | 苏州驰声信息科技有限公司 | A kind of spoken language methods of marking and device |
| CN110827835A (en) * | 2019-11-21 | 2020-02-21 | 上海好学网络科技有限公司 | Spoken language examination system and method |
| CN111161577A (en) * | 2019-12-25 | 2020-05-15 | 上海好学网络科技有限公司 | Spoken language examination system and method |
| CN111833853A (en) * | 2020-07-01 | 2020-10-27 | 腾讯科技（深圳）有限公司 | Voice processing method and device, electronic equipment and computer readable storage medium |
| CN111833853B (en) * | 2020-07-01 | 2023-10-27 | 腾讯科技（深圳）有限公司 | Voice processing method and device, electronic equipment and computer readable storage medium |
| CN113674766A (en) * | 2021-08-18 | 2021-11-19 | 上海复深蓝软件股份有限公司 | Voice evaluation method and device, computer equipment and storage medium |
| CN114245194A (en) * | 2021-12-23 | 2022-03-25 | 深圳市优必选科技股份有限公司 | Video teaching interaction method and device and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102509483B (en) | 2015-10-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102509483B (en) | A kind of distributed Auto-Evaluation System of SET and method thereof | |
| CN108399923B (en) | More human hairs call the turn spokesman's recognition methods and device | |
| CN107680019A (en) | A kind of implementation method of Examination Scheme, device, equipment and storage medium | |
| US8682241B2 (en) | Method and system for improving the quality of teaching through analysis using a virtual teaching device | |
| CN102629936B (en) | A kind of method of mobile terminal process text, relevant device and system | |
| CN109147768A (en) | A kind of audio recognition method and system based on deep learning | |
| CN104346480B (en) | information mining method and device | |
| CN106898349A (en) | A kind of Voice command computer method and intelligent sound assistant system | |
| US20180285345A1 (en) | Natural Language Processing System to Analyze Mobile Application Feedback | |
| CN109544104A (en) | A kind of recruitment data processing method and device | |
| CN106781763A (en) | A kind of university's applied mathematics Teaching System | |
| CN204759523U (en) | Teleeducation system based on discern authentication more | |
| CN111430044A (en) | Natural language processing system and method of nursing robot | |
| CN106067092A (en) | The student realized based on the Internet asks for leave management method and system | |
| US9047872B1 (en) | Automatic speech recognition tuning management | |
| CN205814303U (en) | A kind of Chinese standard aphasia evaluation system | |
| CN106448296A (en) | Intelligent English teaching system for English teaching | |
| CN110163777A (en) | A kind of public good assistance to improve schooling in backward areas management method and device | |
| CN111507758B (en) | Investigation method, device, system and server based on semantic analysis | |
| JP2003066820A (en) | Communication correction system, terminal device, and storage medium | |
| CN112837688B (en) | Voice transcription method, device, related system and equipment | |
| WO2021017302A1 (en) | Data extraction method and apparatus, and computer system and readable storage medium | |
| JP6859702B2 (en) | Conversation recording device, conversation recording method and conversation recording program | |
| CN113593553B (en) | Voice recognition method, voice recognition apparatus, voice management server, and storage medium | |
| KR100513038B1 (en) | Storing Method of Audible Data in Enhanced Multi-Channel Automatic Speech Recognition System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| DD01 | Delivery of document by public notice |
Addressee: Suzhou gallop Mdt InfoTech Ltd patent controller (collect) Document name: Notification that Application Deemed not to be Proposed |
|
| DD01 | Delivery of document by public notice |
Addressee: Suzhou gallop Mdt InfoTech Ltd patent controller (collect) Document name: Notification that Application Deemed not to be Proposed |
|
| ASS | Succession or assignment of patent right |
Owner name: SUZHOU CHISHENG INFORMATION TECHNOLOGY CO., LTD. Free format text: FORMER OWNER: SUZHOU AISPEECH INFORMATION TECHNOLOGY CO., LTD. Effective date: 20140926 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 215021 SUZHOU, JIANGSU PROVINCE TO: 215000 SUZHOU, JIANGSU PROVINCE |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20140926 Address after: 102, room 210, Xinghai street, Suzhou Industrial Park, Jiangsu, Suzhou 215000, China Applicant after: Suzhou Chisheng Information Technology Co., Ltd. Address before: 215021, Jiangsu Province, Suzhou Industrial Park, No. 258 benevolence Road, alone lake library, C106 Applicant before: Suzhou Speech Information Technology Co., Ltd. |
|
| C53 | Correction of patent of invention or patent application | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhou Weida Inventor after: Lin Yuandong Inventor after: Yu Kai Inventor after: Wang Huanliang Inventor after: Xue Feng Inventor after: Zhu Hongjie Inventor after: Zhang Li Inventor before: Zhou Weida Inventor before: Yu Kai Inventor before: Wang Huanliang Inventor before: Xue Feng Inventor before: Zhu Hongjie Inventor before: Zhang Li |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: ZHOU WEIDA YU KAI WANG HUANLIANG XUE FENG ZHU HONGJIE ZHANG LI TO: ZHOU WEIDA LIN YUANDONG YU KAI WANG HUANLIANG XUE FENG ZHU HONGJIE ZHANG LI |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |