CN108877771A - data processing method, storage medium and electronic equipment - Google Patents

data processing method, storage medium and electronic equipment Download PDF

Info

Publication number
CN108877771A
CN108877771A CN201810758220.9A CN201810758220A CN108877771A CN 108877771 A CN108877771 A CN 108877771A CN 201810758220 A CN201810758220 A CN 201810758220A CN 108877771 A CN108877771 A CN 108877771A
Authority
CN
China
Prior art keywords
courseware
information
operation block
voice
reduced parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810758220.9A
Other languages
Chinese (zh)
Other versions
CN108877771B (en
Inventor
王正博
沈亮
张保福
张连杰
赵明明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Dami Technology Co Ltd
Original Assignee
Beijing Dami Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Dami Technology Co Ltd filed Critical Beijing Dami Technology Co Ltd
Priority to CN201810758220.9A priority Critical patent/CN108877771B/en
Publication of CN108877771A publication Critical patent/CN108877771A/en
Priority to PCT/CN2019/081589 priority patent/WO2020010882A1/en
Application granted granted Critical
Publication of CN108877771B publication Critical patent/CN108877771B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/01Assessment or evaluation of speech recognition systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/60Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for measuring the quality of voice signals

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Technology (AREA)
  • Marketing (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Educational Administration (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Electrically Operated Instructional Devices (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Disclose a kind of data processing method, storage medium and electronic equipment.The corresponding voice recognition information of the audio data of online teaching is mapped to different courseware operation blocks according to the courseware operation data recorded by the embodiment of the present invention, the voice recognition information of each courseware operation block is further obtained into reduced parameter with the lateral comparison of corresponding average state information, assessed value is obtained based on the reduced parameter of courseware operation block.The courseware of combination record of the embodiment of the present invention operates to handle audio data, thus, it is possible to carry out accurate Assessment to a large amount of online teaching audio data.

Description

Data processing method, storage medium and electronic equipment
Technical field
The present invention relates to data processing fields, and in particular to a kind of data processing method, storage medium and electronic equipment, more The method and relevant apparatus evaluated in particular it relates to the content for audio data.
Background technique
With the development of internet technology, network-based online teaching has been more and more widely used.Knowledge services Person or knowledge sharers (alternatively referred to as instructor) can carry out real-time exchange and conmmunication by network and learner.In order to right Understood and assessed in the explanation situation of online teaching, it usually needs reviewed or carry out dependent on based on manually carrying out recording a video Line supervision.But if the quantity of online teaching is larger, a large amount of audio, video data can be related to, if using manual type meeting Need to consume a large amount of human resources.
Summary of the invention
In view of this, the embodiment of the present invention provides a kind of data processing method, storage medium and electronic equipment, with automation Ground handles the audio data recorded online, and accurately automation assessment is carried out the case where to online teaching.
According to a first aspect of the embodiments of the present invention, a kind of data processing method is provided, wherein the method includes:
Time shaft is divided into multiple courseware operation blocks according to courseware operation data;
Obtain the corresponding voice recognition information of voice messaging in audio data;
The voice recognition information is mapped to corresponding courseware operation block according to timeline information;
For each courseware operation block, by the voice recognition information and the corresponding average state information ratio after mapping Compared with to obtain reduced parameter, wherein each courseware operation block corresponds at least one reduced parameter;
Evaluation of estimate is obtained according to the reduced parameter of the courseware operation block.
According to a second aspect of the embodiments of the present invention, a kind of computer readable storage medium is provided, stores computer thereon Program instruction, wherein the computer program instructions realize method as described in relation to the first aspect when being executed by processor.
According to a third aspect of the embodiments of the present invention, a kind of electronic equipment, including memory and processor are provided, wherein The memory is for storing one or more computer program instructions, wherein one or more computer program instructions It is executed by the processor to realize method as described in relation to the first aspect
The technical solution of the embodiment of the present invention will be recorded according to the courseware operation data recorded during online teaching The voice recognition information of audio data be mapped to different courseware operation blocks, further to the voice of courseware operation block Identification information carries out laterally obtaining reduced parameter with corresponding average state information, the comparison finally based on courseware operation block Parameter obtains assessed value.The courseware of combination record of the embodiment of the present invention operates to handle audio data, thus, it is possible to Accurate Assessment is carried out to a large amount of online teaching audio data.
Detailed description of the invention
By referring to the drawings to the description of the embodiment of the present invention, the above and other purposes of the present invention, feature and Advantage will be apparent from, in the accompanying drawings:
Fig. 1 is the schematic diagram for the on-line teaching system that the data processing method of the embodiment of the present invention is applicable in;
Fig. 2 is the interface schematic diagram of the online teaching applications client of the embodiment of the present invention;
Fig. 3 is the flow chart of the data processing method of the embodiment of the present invention;
Fig. 4 is an exemplary schematic diagram of the data processing method of the embodiment of the present invention;
Fig. 5 is the schematic diagram of the electronic equipment of the embodiment of the present invention.
Specific embodiment
Below based on embodiment, present invention is described, but the present invention is not restricted to these embodiments.Under Text is detailed to describe some specific detail sections in datail description of the invention.Do not have for a person skilled in the art The present invention can also be understood completely in the description of these detail sections.In order to avoid obscuring essence of the invention, well known method, mistake There is no narrations in detail for journey, process, element and circuit.
In addition, it should be understood by one skilled in the art that provided herein attached drawing be provided to explanation purpose, and What attached drawing was not necessarily drawn to scale.
Unless the context clearly requires otherwise, "include", "comprise" otherwise throughout the specification and claims etc. are similar Word should be construed as the meaning for including rather than exclusive or exhaustive meaning;That is, be " including but not limited to " contains Justice.
In the description of the present invention, it is to be understood that, term " first ", " second " etc. are used for description purposes only, without It can be interpreted as indication or suggestion relative importance.In addition, in the description of the present invention, unless otherwise indicated, the meaning of " multiple " It is two or more.
Data processing method of the invention is suitable for carrying out the scene of online audio-video teaching based on scheduled courseware.Fig. 1 It is the schematic diagram of on-line teaching system that the data processing method of the embodiment of the present invention is applicable in.As shown in Figure 1, the online religion System includes the first client 1, the second client 2 and server 3.Wherein, the first client 1, the second client 2 and service Device 3 is connected by network communication.First client 1 and the second client 2 can be established logical indirectly directly or by server 3 Real time communication carries out the activity of online teaching after letter connection.First client 1 can be operated by instructor.Second client 2 can To be operated by learner.Meanwhile server 3 forms with the first client 1 and the second client 2 communicate to connect simultaneously, to the two Between interaction data stored.First client 1 and the accessible server 3 of the second client 2 obtain courseware data into Row is shown, to realize the online teaching based on courseware.In the on-line teaching system that the present embodiment uses, the first client 1 With the second client 2 show courseware content it is synchronous change, allow instructor and learner synchronously, the phase based on courseware It is same partially to be exchanged.It should be understood that the first client 1 and the second client 2 can have predefined computer application for any operation Communications data processing unit of program, such as desktop computer, portable computer, tablet computer, smart phone etc..Service Device 3 is high-performance data processing equipment for running predefined computer application program, can be a server, can also be with The server cluster of distributed deployment can also be and dispose Virtual Server Cluster in a manner of virtual machine or container.It should be understood that In the on-line teaching system of the embodiment of the present invention, a large amount of first client 1 is in a manner of one-to-one, one-to-many or multi-to-multi It is communicated with the foundation of the second client 2.
Fig. 2 is the interface schematic diagram of the online teaching applications client of the embodiment of the present invention.As shown in Fig. 2, the present embodiment Online teaching applications client can show courseware in the main window 21 of application interface, and it is aobvious in the child window of application interface 22 Show the realtime graphic of the image acquisition device of other side.In general, the other side's shown in the child window 22 of application interface is upper The video of half body.The both sides communicated as a result, can see courseware and the state of other side simultaneously.Meanwhile being shown in main window The operation that courseware content is controlled by instructor one end switches over or shows track.Specifically, instructor is in the first client 1 On can carry out page switching (that is, page turning) on courseware or track operation is carried out to the content of courseware.The track operation Refer on courseware through perhaps drawing image in track identification.For example, instructor can protrude mark by line or circle Know certain contents of courseware, track graphing or text can also be passed through by hand-written or mouse action.Server 3 can be remembered Instructor is applied in the first client 1 in record teaching process all coursewares operations (including page switching operation and rail Mark operation).Server 3 can also record audio data and learner of the instructor in entire teaching process in teaching process In audio data.The audio data includes corresponding voice messaging.Above two audio data can be with the side of partial rail Formula is stored in the same audio file.
The method of the present embodiment is handled by the audio data and courseware operation data recorded to server 3, with Automatically assess teaching process.
Fig. 3 is the flow chart of the data processing method of the embodiment of the present invention.As shown in figure 3, the data processing of the present embodiment Method includes the following steps:
In step S100, time shaft is divided by multiple courseware operation blocks according to courseware operation data.
As described previously for based on the teaching of on-line teaching system, can recorde courseware operation data each time.It can be with The timeline information of each courseware operation is obtained based on courseware operation data, that is, the operation of each courseware is in which time point generation.This The process of teaching is divided into different courseware operation blocks by the timeline information that embodiment is operated using courseware.
As described above, courseware operation may include page switching operation and track operation.Based on above two different behaviour The process of teaching can be divided into multiple courseware operation blocks by work in two different dimensions.In the present embodiment, courseware Operation block refers to that some or certain several coursewares operate corresponding time interval.Firstly, operated based on page switching, it will be whole A teaching process time shaft is divided into the first kind operation block explained for the every page of courseware.First kind operation block The time shaft between page switching operation adjacent twice is covered, that is, first kind operation block can characterize and be imparted knowledge to students The time interval information that person explains every page courseware.
Secondly, being operated based on track, it can will divide and obtain the second corresponding generic operation block of every subslot operation.The Two generic operation blocks cover the time shaft of subslot operation.One the second generic operation block is that its corresponding track operation continues Time interval.One the second generic operation block may be the track operation start before the predetermined time to the track operation terminate The time interval of predetermined time afterwards.One subslot of every generation operation as a result, will divide to obtain corresponding second generic operation Section.
For example, instructional blocks of time shaft length is 20 minutes for one page 5 of courseware.Instructor carries out in teaching process 5 page switchings operations (including end operation).1 scribing operation has been carried out respectively on page 4 and the courseware of page 5 simultaneously To emphasize content therein.As a result, as shown in figure 4, being operated according to page switching, time shaft can be divided into 5 first kind Operation block A1-A5.Each first kind operation block corresponds to instructor to the explanation time interval of one page courseware.Meanwhile In another dimension, the track carried out when according to explanation page 4 and the courseware of page 5 is operated, and can obtain two the second generic operations Block B1 and B2, each second generic operation block include the time interval that track operation occurs.
As a result, based on the courseware operation block obtained is divided, further the voice messaging in the period can be carried out Processing.
In step S200, the corresponding voice recognition information of voice messaging in audio data is obtained.
Speech recognition technology be the audio data comprising voice messaging is handled with obtain it is related to voice content Information technology.In the present embodiment, voice duration information can be by the voice recognition information that speech recognition obtains, It can be the corresponding text information of voice messaging.Text information can embody the particular content that instructor explains in teaching process, Its basis that can be used as further evaluation.Meanwhile voice duration information refers to the time shaft letter that voice is detected in audio data Breath.Since in teaching process, instructor may not be constantly to explain, therefore, the certain journey of voice duration information It can reflect the intensity that instructor exchanges with learner on degree.The voice recognition information that this step obtains is simultaneously with time shaft Information.The word content corresponding time on a timeline for text information, in the timeline information characterization text.For Voice duration information, timeline information characterize the starting time and terminal time of voice duration.
In this step, from least one extracted in audio data in text information and voice duration information as progress The basis of assessment.
It should be understood that the time shaft of the audio data of this step process should be synchronous with the time shaft of courseware operation data in advance pair Together, to guarantee the accuracy of subsequent processing.
It should be understood that step S200 can successively be executed with step S100 with random order, also may be performed simultaneously.
In step S300, the voice recognition information is mapped to corresponding by the timeline information operated according to the courseware In courseware operation block.
The mapping of this step refers to according to the timeline information of speech recognition signal institute band, and courseware operation block is related to Voice recognition information corresponding to time interval extracts, and establishes associated process with courseware operation block.
In an optional implementation, voice recognition information includes text information and voice duration information.In this step In, text information is mapped twice, text information is mapped to each first kind operating space according to its corresponding time shaft In block.This makes text information be divided into multiple portions, the corresponding first kind operation block in each part.Meanwhile text Information is also mapped into each second generic operation block.This makes related to track operation time of origin section in text information Part be extracted, and with corresponding track operation (or second generic operation block) establish be associated with.For example, in some teaching process In, for courseware page 5, instructor has carried out track operation in 30 seconds.Then in 30 seconds time intervals or plus its front and back 30 Second correspond to text information totally in 90 seconds time intervals and can be extracted and be associated with track operation foundation.Meanwhile entire courseware All text informations (including the text information in track operating process in 30 seconds) during the explanation of page 5 can be mapped to correspondence First kind operation block, that is, courseware operation block corresponding to the courseware of page 5.Similarly, for voice duration information, It can also be mapped twice.Voice duration information is according to time shaft distribution map into each first kind operation block.This makes Obtaining each first kind operation block can have a voice duration attribute, which can identify the explanation in this page of courseware The time span that instructor is explained in journey.Meanwhile voice duration information is also mapped into each second generic operation block. When this makes voice during carrying out track operation of each second generic operation block (that is, each track operate) and instructor Long message establishes association.
As a result, in this implementation, following data can be obtained by mapping:
(1) in each courseware page instructor's teaching content text information;
(2) in each courseware page instructor's teaching content voice duration information;
(3) every time instructor carry out track operation during teaching content text information;And
(4) every time instructor carry out track operation during teaching content voice duration information.
Next, the corresponding informance of above- mentioned information and other instructors when lecturing identical courseware can be carried out laterally Compare.Optionally, the information that identical instructor lectures same courseware can also be used as the basis of lateral comparison.This can relatively be marked Know out in aforementioned four dimension, whether the content of currently processed audio data deposits with other instructors or other teaching process In biggish difference, in other words, significantly deviation average.
It should be understood that can not be grasped to the second class when being not the emphasis of assessment there is no track operation or track operation It is mapped as block.Only one in above-mentioned voice recognition information can also be mapped, to reduce computation burden, be accelerated The speed of data processing.
In step S400, by the voice recognition information and the corresponding average state information in each courseware operation block Compare to obtain corresponding reduced parameter.Wherein, each courseware operation block corresponds at least one reduced parameter.Wherein, institute Average state information is stated for characterizing the average state of above-mentioned different dimensions information in other teaching process for identical courseware.
In an optional implementation, the average state information of text information can be obtained in the following way.? In text-processing, vector space model (VSM) is generallyd use to identify text.Vector space model characterizes one with vector Section text information, each single item in vector are characterized the weight of item.Characteristic item can be the word, word or phrase of information in text. By segmenting and counting the operation such as word frequency, so that it may get the characteristic item of text and the weight of characteristic item.If necessary If, feature extraction can be carried out to vector, reduce the dimension of vector to reduce the calculation amount of data processing.After extracting Feature vector is mapping of the text information in a scheduled feature space, can uniquely characterize text information.As a result, After for largely carrying out vectorization operation and feature extraction with class text, so that it may obtain the corresponding feature of each text Vector.The average value of these feature vectors can serve as the average state information of this kind of text informations.In the above process Participle, word frequency statistics, the vectorization expression of text and feature extraction can using existing various text-processing technologies come It realizes.
It can be by calculating the corresponding feature of text information to text information and operation that average state information is compared Distance of the vector sum average state information in feature space or the angle on a certain projection plane are realized.The distance And the numerical value of angle can characterize the difference degree between text information and average state information, thus as the comparison Parameter.
In an optional implementation, the average state letter of voice duration information can be obtained in the following way Breath.Voice duration information is actually a numerical value, therefore, can direct averaged putting down as voice duration information Equal status information.Voice duration information and average state information can be characterized by comparing voice duration information and average value Difference degree.The difference degree can be used as the reduced parameter.
Step S500, evaluation of estimate is obtained according to the reduced parameter of the courseware operation block.
In an optional implementation, the evaluation is obtained according to the reduced parameter of all courseware operation blocks Value.
In another optional implementation, the comparison of a part of courseware operation block is also only selected to the property of can choose to join Number evaluation values to obtain.
Specifically, institute's evaluation values can be calculated by the reduced parameter weighted sum to different courseware operation blocks and be obtained ?.Different courseware operation blocks can have different weights, and different reduced parameters also can have different weights.
Step S500 may include following sub-step:
Step S510, multiple reduced parameter weighted sums corresponding for each courseware operation block are to obtain the courseware The evaluation number of operation block.
Step S520, adding according to the evaluation number of all courseware operation blocks of weight calculation of each courseware operation block It weighs and as institute's evaluation values.
Still by taking example shown in Fig. 4 as an example, for first kind operation block A1-A5 and the second generic operation block B1 and B2.Voice messaging in step S200, audio data is identified, thus long letter when obtaining corresponding text information and voice Breath.Above- mentioned information have time shaft relevant information.In step S300, the text of every page courseware explanation is directed to instructor Information and voice duration information are respectively mapped to first kind operation block A1-A5.Text during the operation of two subslot of instructor This information (corresponding with its voice messaging) and voice duration information are respectively mapped to operation block B1 and B2.In step S400, The text information X1-X5 of first kind operation block A1-A5 is obtained compared with corresponding average state information Y1-Y5 as a result, respectively Obtain the text information reduced parameter a1-a5 of each first kind operation block A1-A5.By first kind operation block A1-A5's Thus voice duration information T1-T5 obtains each first kind operation block A1- compared with corresponding average state information Q1-Q5 The voice duration information reduced parameter b1-b5 of A5.Meanwhile the text information X6 and X7 of the second generic operation block B1 and B2 being distinguished Compared with corresponding average state information Y6 and Y7, the text information comparison of each second generic operation block B1 and B2 are thus obtained Parameter c1 and c2.By voice the duration information T6 and T7 of the second generic operation block B1 and B2 respectively with corresponding average state information Q6, Q7 compare, and thus obtain voice duration the reduced parameter d1 and d2 of each second generic operation block B1 and B2.In step S500, first kind operation block A1-A5 are assigned weight w1-w5 respectively in advance, and the second generic operation block B1-B2 is endowed respectively Weight bw1 and bw2.Since the second generic operation block has certain uncertainty, accordingly it is also possible to be assigned entirely to identical power Weight.Meanwhile text information is endowed weight W1, voice duration information is endowed weight W2.Thus, it is possible to pass through weighting meter as follows Formula is calculated to calculate assessed value:
Wherein, W1ai+W2bi is the evaluation index of first kind operation block Ai, and W1ci+W2di is the second class The evaluation index of operation block Bi.
For another angle, it is believed that:The text information of first kind operation block A1-A5 is assigned scheduled Weight W1*wi, i=1,2 ..., 5;Scheduled weight W2* is assigned in the voice duration information of first kind operation block A1-A5 Wi, i=1,2 ..., 5;Scheduled weight W1*bwi, i=1 or 2 is assigned in the text information of second generic operation block B1-B2; Scheduled weight W2*bwi, i=1 or 2 is assigned in the voice duration information of second generic operation block B1-B2.
It should be understood that above-mentioned weight can by operator according to courseware understanding and experience set.For example, can be right The important higher weight of courseware page setup.In another example being assigned when comparing attention and telling about content for text information Higher weight.
It should be understood that procedure described above is merely illustrative, the embodiment of the present invention can reduce a part of data handling procedure To reduce calculation amount.It is mapped for example, can not be operated to track, only each first kind operation block is mapped, is right Than and assessed value calculate.It is possible to further will in first kind operation block with the presence or absence of track operation as each the The additional information of a kind of operation block is paid attention to when calculating assessed value.
Optionally, the data processing method can also include step S600, show step S500 obtain evaluation of estimate or Show the reduced parameter of each courseware operation block.For example, can show the evaluation of different dimensions by the way of radar map.By This, can according to by evaluation of estimate or according to the displaying of reduced parameter understand teaching process the case where.It meanwhile being also quality of instruction Evaluation provide more objective appraisal foundation.
The technical solution of the embodiment of the present invention will be recorded according to the courseware operation data recorded during online teaching The voice recognition information of audio data be mapped to different courseware operation blocks, further to the voice of courseware operation block Identification information carries out laterally obtaining reduced parameter with corresponding average state information, the comparison finally based on courseware operation block Parameter obtains assessed value.The courseware of combination record of the embodiment of the present invention operates to handle audio data, thus, it is possible to Accurate Assessment is carried out to a large amount of online teaching audio data.
Fig. 5 is the schematic diagram of the electronic equipment of the embodiment of the present invention.Electronic equipment shown in fig. 5 is general data processing dress It sets comprising general computer hardware structure includes at least processor 51 and memory 52.Processor 51 and memory 52 It is connected by bus 53.Memory 52 is suitable for the instruction or program that storage processor 51 can be performed.Processor 51 can be independence Microprocessor, be also possible to the set of multi-microprocessor.The life that processor 51 is stored by executing memory 52 as a result, It enables, realizes thereby executing the method flow of embodiment present invention as described above for the processing of data and for other devices Control.Bus 53 links together above-mentioned multiple components, while said modules are connected to display controller 54 and display dress It sets and input/output (I/O) device 55.Input/output (I/O) device 55 can be mouse, keyboard, modem, net Network interface, touch-control input device, body-sensing input unit, printer and other devices well known in the art.Typically, input/ Output (I/O) device 55 is connected by input/output (I/O) controller 56 with system.
Wherein, memory 52 can store component software, such as operating system, communication module, interactive module and application Program.Above-described each module and application program are both corresponded to complete one or more functions and be retouched in inventive embodiments One group of executable program instructions of the method stated.
It is above-mentioned according to the method for the embodiment of the present invention, the flow chart and/or frame of equipment (system) and computer program product Figure describes various aspects of the invention.It should be understood that each of flowchart and or block diagram piece and flow chart legend and/or frame The combination of block in figure can be realized by computer program instructions.These computer program instructions can be provided to general meter The processor of calculation machine, special purpose computer or other programmable data processing devices, to generate machine so that (via computer or What the processors of other programmable data processing devices executed) instruction creates for realizing in flowchart and or block diagram block or block The device of specified function action.
Meanwhile as skilled in the art will be aware of, the various aspects of the embodiment of the present invention may be implemented as be System, method or computer program product.Therefore, the various aspects of the embodiment of the present invention can take following form:Complete hardware Embodiment, complete software embodiment (including firmware, resident software, microcode etc.) usually can all claim herein For the embodiment for combining software aspects with hardware aspect of circuit, " module " or " system ".In addition, side of the invention Face can take following form:The computer program product realized in one or more computer-readable medium, computer can Reading medium has the computer readable program code realized on it.
It can use any combination of one or more computer-readable mediums.Computer-readable medium can be computer Readable signal medium or computer readable storage medium.Computer readable storage medium can be such as (but not limited to) electronics, Magnetic, optical, electromagnetism, infrared or semiconductor system, device or any suitable combination above-mentioned.Meter The more specific example (exhaustive to enumerate) of calculation machine readable storage medium storing program for executing will include the following terms:With one or more electric wire Electrical connection, hard disk, random access memory (RAM), read-only memory (ROM), erasable is compiled portable computer diskette Journey read-only memory (EPROM or flash memory), optical fiber, portable optic disk read-only storage (CD-ROM), light storage device, Magnetic memory apparatus or any suitable combination above-mentioned.In the context of the embodiment of the present invention, computer readable storage medium It can be that can include or store the program used by instruction execution system, device or combine instruction execution system, set Any tangible medium for the program that standby or device uses.
Computer-readable signal media may include the data-signal propagated, and the data-signal of the propagation has wherein The computer readable program code realized such as a part in a base band or as carrier wave.The signal of such propagation can use Any form in diversified forms, including but not limited to:Electromagnetism, optical or its any combination appropriate.It is computer-readable Signal media can be following any computer-readable medium:It is not computer readable storage medium, and can be to by instructing Program that is that execution system, device use or combining instruction execution system, device to use is communicated, is propagated Or transmission.
Computer program code for executing the operation for being directed to various aspects of the present invention can be with one or more programming languages Any combination of speech is write, and the programming language includes:The programming language of object-oriented such as Java, Smalltalk, C++, PHP, Python etc.;And conventional process programming language such as " C " programming language or similar programming language.Program code can be made It fully on the user computer, is partly executed on the user computer for independent software package.Partly in subscriber computer Above and partly execute on the remote computer;Or it fully executes on a remote computer or server.In latter feelings It, can be by remote computer by including that any type of network connection of local area network (LAN) or wide area network (WAN) are extremely used under condition Family computer, or (such as internet by using ISP) can be attached with outer computer.
The above description is only a preferred embodiment of the present invention, is not intended to restrict the invention, for those skilled in the art For, the invention can have various changes and changes.All any modifications made within the spirit and principles of the present invention are equal Replacement, improvement etc., should all be included in the protection scope of the present invention.

Claims (12)

1. a kind of data processing method, which is characterized in that the method includes:
Time shaft is divided into multiple courseware operation blocks according to courseware operation data;
Obtain the corresponding voice recognition information of voice messaging in audio data;
The voice recognition information is mapped to corresponding courseware operation block according to timeline information;
For each courseware operation block, by the voice recognition information after mapping compared with corresponding average state information with Obtain reduced parameter, wherein each courseware operation block corresponds at least one reduced parameter;
Evaluation of estimate is obtained according to the reduced parameter of the courseware operation block.
2. data processing method according to claim 1, which is characterized in that the method also includes:
Show institute's evaluation values;And/or
Show the reduced parameter of each courseware operation block.
3. data processing method according to claim 1, which is characterized in that the voice recognition information includes the voice The corresponding text information of information;
By the voice recognition information in each courseware operation block to obtain correspondence compared with corresponding average state information Reduced parameter include:
By the text information in each courseware operation block to obtain first compared with corresponding text average state information Reduced parameter.
4. data processing method according to claim 1, which is characterized in that the voice recognition information includes the voice The corresponding voice duration information of information;
By the voice recognition information in each courseware operation block to obtain correspondence compared with corresponding average state information Reduced parameter include:
By the voice duration information in each courseware operation block compared with corresponding voice duration average state information with Obtain the second reduced parameter.
5. data processing method according to claim 1, which is characterized in that the voice recognition information includes the voice The corresponding text information of information and voice duration information;
By the voice recognition information in each courseware operation block to obtain correspondence compared with corresponding average state information Reduced parameter include:
By the text information in each courseware operation block to obtain first compared with corresponding text average state information Reduced parameter;
By the voice duration information in each courseware operation block compared with corresponding voice duration average state information with Obtain the second reduced parameter.
6. data processing method according to claim 1, which is characterized in that the average state information is according to for identical Multiple courseware operation datas of courseware and corresponding audio data obtain.
7. data processing method according to claim 1, which is characterized in that the courseware operation data includes page switching The record of operation;The courseware operation block includes first kind operation block corresponding with page switching operation, wherein institute State the time shaft between first kind operation block covering page switching operation adjacent twice.
8. data processing method according to claim 1, which is characterized in that the courseware operation data includes track operation Record, the courseware operation block includes the second generic operation block corresponding with track operation, wherein second class Operation block covers the time shaft of subslot operation.
9. data processing method according to claim 1, which is characterized in that according at least to the institute of all courseware operation blocks Stating reduced parameter acquisition evaluation of estimate includes:
According to the weighted sum conduct of the corresponding reduced parameter in all courseware operation blocks of the weight calculation of each courseware operation block Institute's evaluation values.
10. data processing method according to claim 1, which is characterized in that according to the courseware operation block Reduced parameter obtains evaluation of estimate:
Multiple reduced parameter weighted sums corresponding for each courseware operation block are to obtain commenting for the courseware operation block Valence index;
According to the conduct of the weighted sum of the evaluation number of all courseware operation blocks of the weight calculation of each courseware operation block Evaluation of estimate.
11. a kind of computer readable storage medium, stores computer program instructions thereon, which is characterized in that the computer journey Such as method of any of claims 1-10 is realized in sequence instruction when being executed by processor.
12. a kind of electronic equipment, including memory and processor, which is characterized in that the memory is for storing one or more Computer program instructions, wherein one or more computer program instructions are executed by the processor to realize such as power Benefit requires method described in any one of 1-10.
CN201810758220.9A 2018-07-11 2018-07-11 Data processing method, storage medium and electronic device Active CN108877771B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810758220.9A CN108877771B (en) 2018-07-11 2018-07-11 Data processing method, storage medium and electronic device
PCT/CN2019/081589 WO2020010882A1 (en) 2018-07-11 2019-04-04 Data processing method, storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810758220.9A CN108877771B (en) 2018-07-11 2018-07-11 Data processing method, storage medium and electronic device

Publications (2)

Publication Number Publication Date
CN108877771A true CN108877771A (en) 2018-11-23
CN108877771B CN108877771B (en) 2021-01-26

Family

ID=64301076

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810758220.9A Active CN108877771B (en) 2018-07-11 2018-07-11 Data processing method, storage medium and electronic device

Country Status (2)

Country Link
CN (1) CN108877771B (en)
WO (1) WO2020010882A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108962221A (en) * 2018-07-12 2018-12-07 苏州思必驰信息科技有限公司 The optimization method and system of online conversation status tracking model
CN110650369A (en) * 2019-09-29 2020-01-03 北京谦仁科技有限公司 Video processing method and device, storage medium and electronic equipment
WO2020010882A1 (en) * 2018-07-11 2020-01-16 北京大米科技有限公司 Data processing method, storage medium and electronic device
CN112735392A (en) * 2020-12-31 2021-04-30 科大讯飞股份有限公司 Voice processing method, device, equipment and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070124142A1 (en) * 2005-11-25 2007-05-31 Mukherjee Santosh K Voice enabled knowledge system
CN102509482A (en) * 2011-11-15 2012-06-20 北京瑞信在线系统技术有限公司 Multimedia teaching system based on mobile terminal framework
CN106127631A (en) * 2016-06-15 2016-11-16 汤美 The teaching-course manager method and system of network courses
CN106228668A (en) * 2016-07-19 2016-12-14 张庆 A kind of hand-held classroom comprehensive data acquisition evaluates scoring device
CN107240047A (en) * 2017-05-05 2017-10-10 广州盈可视电子科技有限公司 The credit appraisal procedure and device of a kind of instructional video
CN107545791A (en) * 2017-08-29 2018-01-05 广州思涵信息科技有限公司 A kind of system and method that classroom instruction knowledge mapping is automatically generated using courseware

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103530837A (en) * 2013-10-28 2014-01-22 苏州市思玛特电力科技有限公司 Teaching evaluation system
CN107277598A (en) * 2016-04-07 2017-10-20 北京文香信息技术有限公司 For the net cast VOD system of teaching
CN106851216B (en) * 2017-03-10 2019-05-28 山东师范大学 A kind of classroom behavior monitoring system and method based on face and speech recognition
CN107920280A (en) * 2017-03-23 2018-04-17 广州思涵信息科技有限公司 The accurate matched method and system of video, teaching materials PPT and voice content
CN107609736A (en) * 2017-08-09 2018-01-19 广州思涵信息科技有限公司 A kind of teaching diagnostic analysis system and method for integrated application artificial intelligence technology
CN108877771B (en) * 2018-07-11 2021-01-26 北京大米科技有限公司 Data processing method, storage medium and electronic device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070124142A1 (en) * 2005-11-25 2007-05-31 Mukherjee Santosh K Voice enabled knowledge system
CN102509482A (en) * 2011-11-15 2012-06-20 北京瑞信在线系统技术有限公司 Multimedia teaching system based on mobile terminal framework
CN106127631A (en) * 2016-06-15 2016-11-16 汤美 The teaching-course manager method and system of network courses
CN106228668A (en) * 2016-07-19 2016-12-14 张庆 A kind of hand-held classroom comprehensive data acquisition evaluates scoring device
CN107240047A (en) * 2017-05-05 2017-10-10 广州盈可视电子科技有限公司 The credit appraisal procedure and device of a kind of instructional video
CN107545791A (en) * 2017-08-29 2018-01-05 广州思涵信息科技有限公司 A kind of system and method that classroom instruction knowledge mapping is automatically generated using courseware

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020010882A1 (en) * 2018-07-11 2020-01-16 北京大米科技有限公司 Data processing method, storage medium and electronic device
CN108962221A (en) * 2018-07-12 2018-12-07 苏州思必驰信息科技有限公司 The optimization method and system of online conversation status tracking model
CN110650369A (en) * 2019-09-29 2020-01-03 北京谦仁科技有限公司 Video processing method and device, storage medium and electronic equipment
CN110650369B (en) * 2019-09-29 2021-09-17 北京谦仁科技有限公司 Video processing method and device, storage medium and electronic equipment
CN112735392A (en) * 2020-12-31 2021-04-30 科大讯飞股份有限公司 Voice processing method, device, equipment and storage medium
CN112735392B (en) * 2020-12-31 2024-04-16 中国科学技术大学 Voice processing method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN108877771B (en) 2021-01-26
WO2020010882A1 (en) 2020-01-16

Similar Documents

Publication Publication Date Title
US20190065906A1 (en) Method and apparatus for building human face recognition model, device and computer storage medium
CN108877771A (en) data processing method, storage medium and electronic equipment
CN109255830A (en) Three-dimensional facial reconstruction method and device
CN105336233A (en) Virtual simulation teaching application platform
CN107291867B (en) Dialog processing method, device and equipment based on artificial intelligence and computer readable storage medium
CN108229478A (en) Image, semantic segmentation and training method and device, electronic equipment, storage medium and program
CN110399983A (en) Shape similarity analysis
CN111027486A (en) Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom
CN110415521A (en) Prediction technique, device and the computer readable storage medium of traffic data
US12079961B2 (en) Method, apparatus, electronic device, and storage medium for processing image
CN108491823A (en) Method and apparatus for generating eye recognition model
CN109726661A (en) Image processing method and device, medium and calculating equipment
CN110070076B (en) Method and device for selecting training samples
CN110087143A (en) Method for processing video frequency and device, electronic equipment and computer readable storage medium
CN109377003A (en) Risk control method and device, computer readable storage medium, electronic equipment
CN109902446A (en) Method and apparatus for generating information prediction model
CN115127557B (en) Path navigation method and device, wearable equipment and storage medium
CN110348109A (en) The method and terminal device of three-dimensional artificial training data processing
US20210113889A1 (en) Viewer feedback based motion video playback
CN108491972A (en) A kind of crowd evacuation emulation method and device based on Sarsa algorithms
CN110111011A (en) A kind of quality of instruction monitoring and managing method, device and electronic equipment
CN109033052A (en) Page processing method and device, medium and calculating equipment
CN115294283B (en) Digital twin plant construction method, device, equipment and storage medium
Gupta et al. An evolving multi-agent scenario generation framework for simulations in preventive medicine education
CN114648900A (en) Immersive interactive training method and system under VR combination

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant