CN108389444A - A kind of English language tutoring system and teaching application method - Google Patents

A kind of English language tutoring system and teaching application method Download PDF

Info

Publication number
CN108389444A
CN108389444A CN201810273236.0A CN201810273236A CN108389444A CN 108389444 A CN108389444 A CN 108389444A CN 201810273236 A CN201810273236 A CN 201810273236A CN 108389444 A CN108389444 A CN 108389444A
Authority
CN
China
Prior art keywords
module
english
ordinate
row
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810273236.0A
Other languages
Chinese (zh)
Inventor
张扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan City University
Original Assignee
Hunan City University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan City University filed Critical Hunan City University
Priority to CN201810273236.0A priority Critical patent/CN108389444A/en
Publication of CN108389444A publication Critical patent/CN108389444A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/06Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems

Abstract

The invention belongs to English teaching technical field, discloses a kind of English language tutoring system and teaching application method, the English language tutoring system include:Image capture module, audio collection module, central control module, online conversation module, English game module, English test module, display module, sound processing module.The present invention can eliminate the noise generated when pronunciation typing by sound processing module, and the displaying voice effect being more clear improves pronunciation standard training;Student may be implemented by online conversation module simultaneously and carry out one-to-one English dialogue, greatly improve efficiency of learning English.

Description

A kind of English language tutoring system and teaching application method
Technical field
The invention belongs to English teaching technical field more particularly to a kind of English language tutoring system and teaching application sides Method.
Background technology
English teaching, which refers to the process of for English, to be or is not that the people of first language teaches English.English teaching Be related to a variety of professional theory knowledges, including linguistics, second language acquisition, lexicology, syntactics, Style Science, corpus it is theoretical, The contents such as cognitive psychology.English teaching is an incremental process, is either for English or is not the first language For the people of speech, English study is all vital in today of globalization fast development.However, existing English teaching exists When typing sound pronounces, it is susceptible to noise, causes voice training effect poor, pronunciation is nonstandard;Existing English teaching is past simultaneously Toward being unidirectional, student, which cannot carry out cerebral infarction in time, causes learning effect poor.
In conclusion problem of the existing technology is:Existing English teaching is susceptible to when typing sound pronounces Noise causes voice training effect poor, and pronunciation is nonstandard;Simultaneously existing English teaching it is often unidirectional, student cannot in time into Row cerebral infarction causes learning effect poor.
Invention content
In view of the problems of the existing technology, the present invention provides a kind of English language tutoring system and teaching application sides Method.
The invention is realized in this way a kind of English language tutoring system includes:
Image capture module, audio collection module, central control module, online conversation module, English game module, English Test module, display module, sound processing module;
Described image acquisition module carries out rectangle partitioning algorithm, and the specific method is as follows:
Step 1, image transmitting terminal obtain the resolution ratio of screen first, obtain 0~C of range and the row scanning of column scan 0~R of range;
The data of current frame image conservation zone are saved in previous frame image buffering area by step 2, transmitting terminal;It intercepts and captures current Screen bitmaps data and be stored in current frame image buffering area;
Step 3, transmitting terminal initializes variation rectangular area top left co-ordinate first and bottom right angular coordinate is (0,0), next time Sweep starting point coordinate is (0,0), and row is unchanged to be identified as true, updates the range of the range and row scanning of column scan;
Step 4 judges whether to be expert in scanning range, not exist, jumps to step 10;
Step 5 judges whether within the scope of column scan, does not exist, and jumps to step 8;Within the scope of column scan using every Row direct comparison method is detected current sampling point;Value is different, sets the unchanged mark of row to false first, then sentences Whether disconnected be the first variation sampled point detected, be using sample point coordinate as the top left co-ordinate for changing rectangular area, It is not first variation sampled point, the coordinate of the coordinate in the rectangle lower right corner and the point relatively and is maximized as new rectangle Bottom right angular coordinate, then judge whether the sampled point is first variation sampled point of one's own profession, it is that the ordinate just by the sampled point is same The ordinate in the rectangle upper left corner is compared and is minimized the top left co-ordinate of more new change rectangular area;It is worth identical, needs Judge that row is unchanged and identifies whether, for false, if it is false, starting point of the record coordinate as scanning next time detects it is most Latter row sampled point jumps to step 7 using last row sample point coordinate as the starting point of scanning next time;
Row coordinate is moved to right N row, jumps to step 5 and detect next sampled point by step 6;
Step 7, one's own profession detection finish, and the next time of the next sweep starting point coordinate of one's own profession and lastrow record is scanned Point coordinates compares, and is maximized as new next sweep starting point coordinate, and line number adds 1, jump to step 4 from next line from Head starts from left to right to detect;
Step 8, judge go it is unchanged identify whether as true and variation rectangular area top left co-ordinate be not (0,0), no It is true, line number adds 1, jumps to step 4;It is true, then shows that full line without different pixels, has obtained the square of a variation Shape region unit;Obtained variation rectangular area block upper left corner ordinate be moved to the left N row, lower right corner ordinate move right N row To include image boundary information;
Step 9 records the variation rectangular area coordinate detected and corresponding next sweep starting point coordinate, judges to work as The range of preceding column scan whether 0~C and row scanning range whether 0~R, be, setting mark show the variation that current detection goes out Rectangular area mark detects that then line number adds 1 to jump to step 4 to detect next change since next line for the first time The rectangular area block of change;Until detecting the range beyond row scanning;
Step 10 after this detection, handles next sweep starting point all in this detection, calculates down The set of secondary scanning range;The ordinate for first next sweep starting point that this is detected is first checked for whether than last row The ordinate of sampled point is small, is not, which completes, and detects the ordinate of next next sweep starting point;It is, with first The abscissa in the secondary variation rectangular area upper left corner detected is abscissa, is scanned relevant next time with currently changing rectangular area The ordinate of starting point coordinate is ordinate, generates the top left co-ordinate of a next scanning range;With the change detected for the first time The abscissa for changing the rectangular area lower right corner is abscissa, and a scanning next time model is generated by ordinate of the maximum number of column C of screen The bottom right angular coordinate enclosed;Then handle second next sweep starting point, until next sweep starting point all in this detection all It is treated as stopping;
Step 11 detects scanning area all in next scanning range set, is primarily based on next scanning range collection The width and height of first scanning area in conjunction, the range of raw row scan and column scan repeat step 3 and are examined to step 10 The rectangular area block changed in first scanning area is surveyed, second scanning area is then handled, until next scanning range collection Until all scanning areas are all detected in conjunction;
Step 12 repeats step 10 to step 11, obtains the variation rectangular area block of scanning range next time, until The ordinate of all next sweep starting points is greater than or equal to the ordinate of last row sampled point, and entire screen detection finishes;
Step 13 has obtained the not overlapping rectangles for the area minimum that all frame images change relative to previous frame image The set in region, checks the rectangular area in the set, and two rectangle its upper left corner ordinates are identical with lower right corner ordinate, and The lower right corner abscissa of one rectangle is adjacent with another rectangle upper left corner abscissa, merges into a rectangle, then recompresses And the set for the sending rectangular area image data that is included and respective coordinates are to client;
Step 14, image receiving terminal will be based on each rectangular region image data and corresponding seat after the data decompression of reception Mark is integrated into previous frame image and shows;
Step 15 repeated step 2 every T seconds and arrives step 14, according to difference and the requirements of bandwidth of application scenarios, It adjusts to interval time T;
Audio collection module is connect with central control module, for acquiring voice data information;
Central control module, with image capture module, audio collection module, online conversation module, English game module, English Language test module, display module, sound processing module connection, for image capture module, audio collection module gathered data Information carries out processing analysis, and dispatches modules normal work;
The central control module estimates the jumping moment of each jump using clustering algorithm and respectively jumps corresponding normalization Hybrid matrix column vector, Hopping frequencies when, include the following steps:
The first step is right at p (p=0,1,2 ... the P-1) momentThe frequency values of expression are clustered, obtained cluster centre numberIndicate carrier frequency number existing for the p moment,A cluster centre then indicates the size of carrier frequency, uses respectively It indicates;
Second step utilizes clustering algorithm pair to each sampling instant p (p=0,1,2 ... P-1)It is clustered, It is same availableA cluster centre is usedIt indicates;
Third walks, to allIt averages and rounding, obtains the estimation of source signal numberI.e.
4th step, finds outAt the time of, use phIt indicates, to the p of each section of continuous valuehIntermediate value is sought, is used Indicate the l sections of p that are connectedhIntermediate value, thenIndicate the estimation at first of frequency hopping moment;
5th step is obtained according to estimation in second stepAnd the 4th estimate to obtain in step The frequency hopping moment estimate it is each jump it is correspondingA hybrid matrix column vectorSpecifically formula is:
HereIt is corresponding to indicate that l is jumpedA mixing Matrix column vector estimated value;
6th step is estimated the corresponding carrier frequency of each jump, is usedIt is corresponding to indicate that l is jumpedA frequency estimation, calculation formula are as follows:
Online conversation module, connect with central control module, for online with the one-to-one progress English Dialogue Teaching of student;
English game module, connect with central control module, for carrying out English study training by English game;
English test module, connect with central control module, for carrying out English test to student;
Display module is connect with central control module, for showing English teaching video;
Sound processing module is connect with central control module, for disappearing to collected English pronunciation audio It makes an uproar processing, and pronunciation information decoder is sent to by denoising voice signal is obtained.
A kind of English language teaching application method includes the following steps:
Gathered data information is sent to central control module and carried out by step 1, image capture module, audio collection module Processing analysis;
Step 2 when teaching, passes through online conversation module and the one-to-one progress English Dialogue Teaching of student;It is swum by English Module of playing carries out English study training;English test is carried out to student by English test module;
When sound typing, de-noising is carried out by sound processing module to collected English audio of pronouncing for step 3 Processing;
Step 4 shows English teaching video by display module.
Further, the sound processing module includes:Pronunciation information decoder, word generator, phonetic symbol generator;
Pronunciation information decoder, for according to the corresponding phonetic symbol of the pronunciation model collection pre-established and each pronunciation The voice signal received is carried out retrieval one by one and compared, and the result after retrieval is exported to word generator by library and word library With phonetic symbol generator;
Word generator is shown for the Word search result of pronunciation information decoder to be sent to display module 7;
Phonetic symbol generator is shown for the phonetic symbol retrieval result of pronunciation information decoder to be sent to display module 7.
Advantages of the present invention and good effect are:The present invention generates when can eliminate pronunciation typing by sound processing module Noise, the displaying voice effect being more clear, improve pronunciation standard training;It may be implemented simultaneously by online conversation module Student carries out one-to-one English dialogue, greatly improves efficiency of learning English.
Description of the drawings
Fig. 1 is that the present invention implements the English language teaching application method flow chart provided;
Fig. 2 is that the present invention implements the English language tutoring system structural schematic diagram provided;
In figure:1, image capture module;2, audio collection module;3, central control module;4, online conversation module;5, English Language game module;6, English test module;7, display module;8, sound processing module.
Specific implementation mode
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to embodiments, to the present invention It is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to Limit the present invention.
Below in conjunction with the accompanying drawings and specific embodiment is further described the application principle of the present invention.
As shown in Figure 1, a kind of English language teaching application method provided by the invention includes the following steps:
Step S101, image capture module, audio collection module by gathered data information be sent to central control module into Row processing analysis;
Step S102 when teaching, passes through online conversation module and the one-to-one progress English Dialogue Teaching of student;Pass through English Game module carries out English study training;English test is carried out to student by English test module;
Step S103 when sound typing, disappears to collected English audio of pronouncing by sound processing module It makes an uproar processing;
Step S104 shows English teaching video by display module.
As shown in Fig. 2, English language tutoring system provided by the invention includes:Image capture module 1, audio collection module 2, central control module 3, online conversation module 4, English game module 5, English test module 6, display module 7, acoustic processing Module 8.
Image capture module 1 is connect with central control module 3, for acquiring instructional video image by camera;
Audio collection module 2 is connect with central control module 3, for acquiring voice data information;
Central control module 3, with image capture module 1, audio collection module 2, online conversation module 4, English game mould Block 5, English test module 6, display module 7, sound processing module 8 connect, for image capture module 1, audio collection mould 2 gathered data information of block carries out processing analysis, and dispatches modules normal work;
Online conversation module 4 is connect with central control module 3, for being taught online with the one-to-one progress English dialogue of student It learns;
English game module 5 is connect with central control module 3, for carrying out English study training by English game;
English test module 6 is connect with central control module 3, for carrying out English test to student;
Display module 7 is connect with central control module 3, for showing English teaching video;
Sound processing module 8 is connect with central control module 3, for being carried out to collected English pronunciation audio Denoising, and it is sent to pronunciation information decoder by denoising voice signal is obtained.
Described image acquisition module carries out rectangle partitioning algorithm, and the specific method is as follows:
Step 1, image transmitting terminal obtain the resolution ratio of screen first, obtain 0~C of range and the row scanning of column scan 0~R of range;
The data of current frame image conservation zone are saved in previous frame image buffering area by step 2, transmitting terminal;It intercepts and captures current Screen bitmaps data and be stored in current frame image buffering area;
Step 3, transmitting terminal initializes variation rectangular area top left co-ordinate first and bottom right angular coordinate is (0,0), next time Sweep starting point coordinate is (0,0), and row is unchanged to be identified as true, updates the range of the range and row scanning of column scan;
Step 4 judges whether to be expert in scanning range, not exist, jumps to step 10;
Step 5 judges whether within the scope of column scan, does not exist, and jumps to step 8;Within the scope of column scan using every Row direct comparison method is detected current sampling point;Value is different, sets the unchanged mark of row to false first, then sentences Whether disconnected be the first variation sampled point detected, be using sample point coordinate as the top left co-ordinate for changing rectangular area, It is not first variation sampled point, the coordinate of the coordinate in the rectangle lower right corner and the point relatively and is maximized as new rectangle Bottom right angular coordinate, then judge whether the sampled point is first variation sampled point of one's own profession, it is that the ordinate just by the sampled point is same The ordinate in the rectangle upper left corner is compared and is minimized the top left co-ordinate of more new change rectangular area;It is worth identical, needs Judge that row is unchanged and identifies whether, for false, if it is false, starting point of the record coordinate as scanning next time detects it is most Latter row sampled point jumps to step 7 using last row sample point coordinate as the starting point of scanning next time;
Row coordinate is moved to right N row, jumps to step 5 and detect next sampled point by step 6;
Step 7, one's own profession detection finish, and the next time of the next sweep starting point coordinate of one's own profession and lastrow record is scanned Point coordinates compares, and is maximized as new next sweep starting point coordinate, and line number adds 1, jump to step 4 from next line from Head starts from left to right to detect;
Step 8, judge go it is unchanged identify whether as true and variation rectangular area top left co-ordinate be not (0,0), no It is true, line number adds 1, jumps to step 4;It is true, then shows that full line without different pixels, has obtained the square of a variation Shape region unit;Obtained variation rectangular area block upper left corner ordinate be moved to the left N row, lower right corner ordinate move right N row To include image boundary information;
Step 9 records the variation rectangular area coordinate detected and corresponding next sweep starting point coordinate, judges to work as The range of preceding column scan whether 0~C and row scanning range whether 0~R, be, setting mark show the variation that current detection goes out Rectangular area mark detects that then line number adds 1 to jump to step 4 to detect next change since next line for the first time The rectangular area block of change;Until detecting the range beyond row scanning;
Step 10 after this detection, handles next sweep starting point all in this detection, calculates down The set of secondary scanning range;The ordinate for first next sweep starting point that this is detected is first checked for whether than last row The ordinate of sampled point is small, is not, which completes, and detects the ordinate of next next sweep starting point;It is, with first The abscissa in the secondary variation rectangular area upper left corner detected is abscissa, is scanned relevant next time with currently changing rectangular area The ordinate of starting point coordinate is ordinate, generates the top left co-ordinate of a next scanning range;With the change detected for the first time The abscissa for changing the rectangular area lower right corner is abscissa, and a scanning next time model is generated by ordinate of the maximum number of column C of screen The bottom right angular coordinate enclosed;Then handle second next sweep starting point, until next sweep starting point all in this detection all It is treated as stopping;
Step 11 detects scanning area all in next scanning range set, is primarily based on next scanning range collection The width and height of first scanning area in conjunction, the range of raw row scan and column scan repeat step 3 and are examined to step 10 The rectangular area block changed in first scanning area is surveyed, second scanning area is then handled, until next scanning range collection Until all scanning areas are all detected in conjunction;
Step 12 repeats step 10 to step 11, obtains the variation rectangular area block of scanning range next time, until The ordinate of all next sweep starting points is greater than or equal to the ordinate of last row sampled point, and entire screen detection finishes;
Step 13 has obtained the not overlapping rectangles for the area minimum that all frame images change relative to previous frame image The set in region, checks the rectangular area in the set, and two rectangle its upper left corner ordinates are identical with lower right corner ordinate, and The lower right corner abscissa of one rectangle is adjacent with another rectangle upper left corner abscissa, merges into a rectangle, then recompresses And the set for the sending rectangular area image data that is included and respective coordinates are to client;
Step 14, image receiving terminal will be based on each rectangular region image data and corresponding seat after the data decompression of reception Mark is integrated into previous frame image and shows;
Step 15 repeated step 2 every T seconds and arrives step 14, according to difference and the requirements of bandwidth of application scenarios, It adjusts to interval time T;
The central control module estimates the jumping moment of each jump using clustering algorithm and respectively jumps corresponding normalization Hybrid matrix column vector, Hopping frequencies when, include the following steps:
The first step is right at p (p=0,1,2 ... the P-1) momentThe frequency values of expression are clustered, obtained cluster centre numberIndicate carrier frequency number existing for the p moment,A cluster centre then indicates the size of carrier frequency, uses respectively It indicates;
Second step utilizes clustering algorithm pair to each sampling instant p (p=0,1,2 ... P-1)It is clustered, It is same availableA cluster centre is usedIt indicates;
Third walks, to allIt averages and rounding, obtains the estimation of source signal numberI.e.
4th step, finds outAt the time of, use phIt indicates, to the p of each section of continuous valuehIntermediate value is sought, is used Indicate the l sections of p that are connectedhIntermediate value, thenIndicate the estimation at first of frequency hopping moment;
5th step is obtained according to estimation in second stepAnd the 4th estimate to obtain in step The frequency hopping moment estimate it is each jump it is correspondingA hybrid matrix column vectorSpecifically formula is:
HereIt is corresponding to indicate that l is jumpedA mixing Matrix column vector estimated value;
6th step is estimated the corresponding carrier frequency of each jump, is usedIt is corresponding to indicate that l is jumpedA frequency estimation, calculation formula are as follows:
Sound processing module 8 provided by the invention includes:Pronunciation information decoder, word generator, phonetic symbol generator;
Pronunciation information decoder, for according to the corresponding phonetic symbol of the pronunciation model collection pre-established and each pronunciation The voice signal received is carried out retrieval one by one and compared, and the result after retrieval is exported to word generator by library and word library With phonetic symbol generator;
Word generator is shown for the Word search result of pronunciation information decoder to be sent to display module 7;
Phonetic symbol generator is shown for the phonetic symbol retrieval result of pronunciation information decoder to be sent to display module 7.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention All any modification, equivalent and improvement etc., should all be included in the protection scope of the present invention made by within refreshing and principle.

Claims (3)

1. a kind of English language tutoring system, which is characterized in that the English language tutoring system includes:Image capture module, Audio collection module, central control module, online conversation module, English game module, English test module, display module, sound Sound processing module;
Image capture module is connect with central control module, for acquiring instructional video image by camera;
Described image acquisition module carries out rectangle partitioning algorithm, and the specific method is as follows:
Step 1, image transmitting terminal obtain the resolution ratio of screen first, obtain the range 0 of the 0~C of range and row scanning of column scan ~R;
The data of current frame image conservation zone are saved in previous frame image buffering area by step 2, transmitting terminal;Intercept and capture current screen Curtain bitmap data is simultaneously stored in current frame image buffering area;
Step 3, transmitting terminal initializes variation rectangular area top left co-ordinate first and bottom right angular coordinate is (0,0), scanning next time Starting point coordinate is (0,0), and row is unchanged to be identified as true, updates the range of the range and row scanning of column scan;
Step 4 judges whether to be expert in scanning range, not exist, jumps to step 10;
Step 5 judges whether within the scope of column scan, does not exist, and jumps to step 8;Using straight every row within the scope of column scan Comparison method is connect to be detected current sampling point;Value is different, sets the unchanged mark of row to false first, and then judgement is No is the first variation sampled point detected, is not to be using sample point coordinate as the top left co-ordinate of variation rectangular area The coordinate of the coordinate in the rectangle lower right corner and the point relatively and is maximized as new rectangle bottom right by first variation sampled point Angular coordinate, then judge whether the sampled point is first variation sampled point of one's own profession, it is the same rectangle of ordinate just by the sampled point The ordinate in the upper left corner is compared and is minimized the top left co-ordinate of more new change rectangular area;It is worth identical, needs to judge Row is unchanged to identify whether detect it is last if it is the starting point that false, record coordinate are scanned as next time for false Row sampled point jumps to step 7 using last row sample point coordinate as the starting point of scanning next time;
Row coordinate is moved to right N row, jumps to step 5 and detect next sampled point by step 6;
Step 7, one's own profession detection finish, and the next sweep starting point of the next sweep starting point coordinate of one's own profession and lastrow record is sat Mark compares, and is maximized as new next sweep starting point coordinate, and line number adds 1, jumps to step 4 and is from the beginning opened from next line Beginning is from left to right detected;
Step 8, judge go it is unchanged identify whether as true and variation rectangular area top left co-ordinate be not (0,0), be not True, line number add 1, jump to step 4;It is true, then shows that full line without different pixels, has obtained the rectangle of a variation Region unit;Obtained variation rectangular area block upper left corner ordinate be moved to the left N row, lower right corner ordinate move right N arrange with Including image boundary information;
Step 9, records the variation rectangular area coordinate detected and corresponding next sweep starting point coordinate, and forefront is worked as in judgement The range of scanning whether 0~C and row scanning range whether 0~R, be, setting mark show the variation rectangle that current detection goes out Area identification is to detect for the first time, and then line number adds 1 to jump to step 4 to detect next variation since next line Rectangular area block;Until detecting the range beyond row scanning;
Step 10 after this detection, handles next sweep starting point all in this detection, calculates and sweep next time Retouch the set of range;The ordinate for first next sweep starting point that this is detected is first checked for whether than last row sampling The ordinate of point is small, is not, which completes, and detects the ordinate of next next sweep starting point;It is, to examine for the first time The abscissa in the variation rectangular area upper left corner measured is abscissa, currently to change the relevant next sweep starting point in rectangular area The ordinate of coordinate is ordinate, generates the top left co-ordinate of a next scanning range;With the variation square detected for the first time The abscissa in the shape region lower right corner is abscissa, using the maximum number of column C of screen as one next scanning range of ordinate generation Bottom right angular coordinate;Then second next sweep starting point is handled, until next sweep starting point all in this detection is all located Until reason;
Step 11 detects scanning area all in next scanning range set, is primarily based in next scanning range set The width and height of first scanning area, the range of raw row scan and column scan repeat step 3 and detect the to step 10 The rectangular area block changed in one scanning area then handles second scanning area, until in next scanning range set Until all scanning areas are all detected;
Step 12 repeats step 10 to step 11, obtains the variation rectangular area block of scanning range next time, until all The ordinate of next sweep starting point be greater than or equal to the ordinate of last row sampled point, the detection of entire screen finishes;
Step 13 has obtained the not overlapping rectangles region for the area minimum that all frame images change relative to previous frame image Set, check the rectangular area in the set, two rectangle its upper left corner ordinates are identical with lower right corner ordinate, and one The lower right corner abscissa of rectangle is adjacent with another rectangle upper left corner abscissa, merges into a rectangle, and then recompression is concurrent Send image data that the set of rectangular area is included and respective coordinates to client;
Step 14, image receiving terminal will be based on each rectangular region image data after the data decompression of reception and respective coordinates are whole It is bonded in previous frame image and shows;
Step 15 repeated step 2 every T seconds to step 14, according to the difference of application scenarios and the requirement of bandwidth, between pair It adjusts every time T;
Audio collection module is connect with central control module, for acquiring voice data information;
Central control module is surveyed with image capture module, audio collection module, online conversation module, English game module, English Die trial block, display module, sound processing module connection, for image capture module, audio collection module gathered data information Processing analysis is carried out, and dispatches modules normal work;
The central control module is estimated the jumping moment of each jump using clustering algorithm and is respectively jumped corresponding normalized mixed When closing matrix column vector, Hopping frequencies, include the following steps:
The first step is right at p (p=0,1,2 ... the P-1) momentThe frequency values of expression are clustered, obtained cluster centre numberIndicate carrier frequency number existing for the p moment,A cluster centre then indicates the size of carrier frequency, uses respectively It indicates;
Second step utilizes clustering algorithm pair to each sampling instant p (p=0,1,2 ... P-1)It is clustered, equally It is availableA cluster centre is usedIt indicates;
Third walks, to allIt averages and rounding, obtains the estimation of source signal numberI.e.
4th step, finds outAt the time of, use phIt indicates, to the p of each section of continuous valuehIntermediate value is sought, is used Indicate the l sections of p that are connectedhIntermediate value, thenIndicate the estimation at first of frequency hopping moment;
5th step is obtained according to estimation in second stepAnd the 4th frequency for estimating in step It is corresponding that rate jumping moment estimates each jumpA hybrid matrix column vectorSpecifically formula is:
HereIt is corresponding to indicate that l is jumpedA hybrid matrix Column vector estimated value;
6th step is estimated the corresponding carrier frequency of each jump, is usedIt is corresponding to indicate that l is jumpedIt is a Frequency estimation, calculation formula are as follows:
Online conversation module, connect with central control module, for online with the one-to-one progress English Dialogue Teaching of student;
English game module, connect with central control module, for carrying out English study training by English game;
English test module, connect with central control module, for carrying out English test to student;
Display module is connect with central control module, for showing English teaching video;
Sound processing module is connect with central control module, for being carried out at de-noising to collected English pronunciation audio Reason, and it is sent to pronunciation information decoder by denoising voice signal is obtained.
2. English language tutoring system as described in claim 1, which is characterized in that the sound processing module includes:Pronunciation Info decoder, word generator, phonetic symbol generator;
Pronunciation information decoder, for according to the corresponding phonetic symbol library of the pronunciation model collection that pre-establishes and each pronunciation and The voice signal received is carried out retrieval one by one and compared, and the result after retrieval is exported to word generator and sound by word library Mark generator;
Word generator is shown for the Word search result of pronunciation information decoder to be sent to display module 7;
Phonetic symbol generator is shown for the phonetic symbol retrieval result of pronunciation information decoder to be sent to display module 7.
3. a kind of English language teaching application method of English language tutoring system as described in claim 1, which is characterized in that institute English language teaching application method is stated to include the following steps:
Gathered data information is sent to central control module and handled by step 1, image capture module, audio collection module Analysis;
Step 2 when teaching, passes through online conversation module and the one-to-one progress English Dialogue Teaching of student;Pass through English game mould Block carries out English study training;English test is carried out to student by English test module;
When sound typing, denoising is carried out by sound processing module to collected English audio of pronouncing for step 3;
Step 4 shows English teaching video by display module.
CN201810273236.0A 2018-03-29 2018-03-29 A kind of English language tutoring system and teaching application method Pending CN108389444A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810273236.0A CN108389444A (en) 2018-03-29 2018-03-29 A kind of English language tutoring system and teaching application method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810273236.0A CN108389444A (en) 2018-03-29 2018-03-29 A kind of English language tutoring system and teaching application method

Publications (1)

Publication Number Publication Date
CN108389444A true CN108389444A (en) 2018-08-10

Family

ID=63072134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810273236.0A Pending CN108389444A (en) 2018-03-29 2018-03-29 A kind of English language tutoring system and teaching application method

Country Status (1)

Country Link
CN (1) CN108389444A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051367A (en) * 2012-11-27 2013-04-17 西安电子科技大学 Clustering-based blind source separation method for synchronous orthogonal frequency hopping signals
CN104735449A (en) * 2015-02-27 2015-06-24 成都信息工程学院 Image transmission method and system based on rectangular segmentation and interlaced scanning
CN105225549A (en) * 2015-10-13 2016-01-06 安阳师范学院 A kind of Language for English learning system
CN107203953A (en) * 2017-07-14 2017-09-26 深圳极速汉语网络教育有限公司 It is a kind of based on internet, Expression Recognition and the tutoring system of speech recognition and its implementation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103051367A (en) * 2012-11-27 2013-04-17 西安电子科技大学 Clustering-based blind source separation method for synchronous orthogonal frequency hopping signals
CN104735449A (en) * 2015-02-27 2015-06-24 成都信息工程学院 Image transmission method and system based on rectangular segmentation and interlaced scanning
CN105225549A (en) * 2015-10-13 2016-01-06 安阳师范学院 A kind of Language for English learning system
CN107203953A (en) * 2017-07-14 2017-09-26 深圳极速汉语网络教育有限公司 It is a kind of based on internet, Expression Recognition and the tutoring system of speech recognition and its implementation

Similar Documents

Publication Publication Date Title
US4975960A (en) Electronic facial tracking and detection system and method and apparatus for automated speech recognition
CN109165552A (en) A kind of gesture recognition method based on human body key point, system and memory
WO2020082566A1 (en) Physiological sign recognition-based distance learning method, device, apparatus, and storage medium
JP2012014394A (en) User instruction acquisition device, user instruction acquisition program and television receiver
CN108960067A (en) Real-time train driver motion recognition system and method based on deep learning
CN112183238B (en) Remote education attention detection method and system
CN110363129B (en) Early autism screening system based on smiling paradigm and audio-video behavior analysis
CN103150023A (en) System and method for cursor control based on brain-computer interface
CN110085068A (en) A kind of study coach method and device based on image recognition
Yargıç et al. A lip reading application on MS Kinect camera
US20090251458A1 (en) Image signal generating apparatus, image signal generation method, computer program, and recording medium
US20080004879A1 (en) Method for assessing learner's pronunciation through voice and image
US9355641B2 (en) Monitoring device using selective attention model and method for monitoring same
CN109754653B (en) Method and system for personalized teaching
CN106447695A (en) Same object determining method and device in multi-object tracking
CN109876416A (en) A kind of rope skipping method of counting based on image information
CN107103293A (en) It is a kind of that the point estimation method is watched attentively based on joint entropy
CN113705510A (en) Target identification tracking method, device, equipment and storage medium
CN112749684A (en) Cardiopulmonary resuscitation training and evaluating method, device, equipment and storage medium
CN103686092A (en) Dual system detection method and system for rising of students
CN109302528A (en) A kind of photographic method, mobile terminal and computer readable storage medium
JPH10263126A (en) Form analyzing system for exercise using personal computer
CN110399810A (en) A kind of auxiliary magnet name method and device
CN111223549A (en) Mobile end system and method for disease prevention based on posture correction
CN114708658A (en) Online learning concentration degree identification method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180810