CN107844762A - Information processing method and system - Google Patents
Information processing method and system Download PDFInfo
- Publication number
- CN107844762A CN107844762A CN201711018331.8A CN201711018331A CN107844762A CN 107844762 A CN107844762 A CN 107844762A CN 201711018331 A CN201711018331 A CN 201711018331A CN 107844762 A CN107844762 A CN 107844762A
- Authority
- CN
- China
- Prior art keywords
- behavioural characteristic
- media segment
- information processing
- default
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/40—Scenes; Scene-specific elements in video content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/02—Preprocessing operations, e.g. segment selection; Pattern representation or modelling, e.g. based on linear discriminant analysis [LDA] or principal components; Feature selection or extraction
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L17/00—Speaker identification or verification
- G10L17/22—Interactive procedures; Man-machine interfaces
- G10L17/24—Interactive procedures; Man-machine interfaces the user being prompted to utter a password or a predefined phrase
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
Abstract
The invention provides a kind of information processing method and system, methods described is applied to the terminal device being arranged in classroom, including：Receive the multimedia file that characteristic collector gathers within the default course period；Screen the multi-media segment for meeting preparatory condition in the multimedia file；Identify the identity information and behavioural characteristic of each who object in the multi-media segment；The identity information of each who object and behavioural characteristic are sent to Cloud Server.Methods described can alleviate the low technical problem of efficiency present in existing information processing procedure.Reach and reduced the time that processing information uses, improved the technique effect of the efficiency of information process.
Description
Technical field
The present invention relates to technical field of information processing, more particularly, to a kind of information processing method and system.
Background technology
During the teaching of existing school is given lessons, for Course Exercise quality, teachers ' teaching quality and student's acceptance level
Evaluation, all by daily examination, questionnaire and superintend and direct the traditional means such as class to realize.Daily examination, questionnaire and
It is huge to superintend and direct the information on process of giving lessons of imparting knowledge to students that the traditional means such as class obtain, and the quantity of these information can be with upper class hour
Between and the increase of number of students purpose and increase, these information of artificial treatment can take a long time, the problem of causing efficiency low.
The content of the invention
In view of this, it is an object of the invention to provide a kind of information processing method and system, to alleviate at existing information
The low technical problem of efficiency existing for reason process.
In a first aspect, the embodiments of the invention provide a kind of information processing method, described information processing method is applied to set
The terminal device being placed in classroom, including：
Receive the multimedia file that characteristic collector gathers within the default course period；
Screen the multi-media segment for meeting preparatory condition in the multimedia file；
Identify the identity information and behavioural characteristic of each who object in the multi-media segment；
The identity information of each who object and behavioural characteristic are sent to Cloud Server.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the first of first aspect, wherein, institute
Stating multimedia file includes audio file and/or video file, meets preparatory condition in the screening multimedia file
Multi-media segment, including：
Screen the multi-media segment that who object voice is included in the audio file；
And/or screen the multi-media segment that who object face is included in the video file.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of second of first aspect, wherein, know
The identity information of each who object in not described multi-media segment, including：
Extract the vocal print feature of who object in the multi-media segment；
, will be with when the similarity of any vocal print in the vocal print feature and default vocal print storehouse meets the first preparatory condition
Identity information corresponding to vocal print in the default vocal print storehouse is defined as the identity information of the who object.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the third of first aspect, wherein, know
The behavioural characteristic of each who object in not described multi-media segment, including：
Extract the facial image of who object in the multi-media segment；
When the similarity of any facial image in the facial image and default face database meets the second preparatory condition,
Behavioural characteristic corresponding with the facial image in the default face database is defined as to the behavioural characteristic of the who object.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 4th of first aspect kind, wherein, institute
Stating behavioural characteristic includes word dialog content, identifies the behavioural characteristic of each who object in the multi-media segment, including：
Extract the voice signal of who object in the multi-media segment；
Using default Feature Selection Model, predetermined acoustic model, preset language model and default Voice decoder to described
Voice signal is handled, and obtains word dialog content.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 5th of first aspect kind, wherein, institute
Stating behavioural characteristic includes expression description content, identifies the behavioural characteristic of each who object in the multi-media segment, including；
Detect the facial image of who object in the multi-media segment；
When the human face expression in the facial image is similar to any Facial Expression Image in default face expression database
Degree meet three preparatory conditions when, will expression description content corresponding with Facial Expression Image in the default face expression database it is true
It is set to the behavioural characteristic of the who object.
With reference in a first aspect, the embodiments of the invention provide the possible embodiment of the 6th of first aspect kind, wherein, institute
Stating behavioural characteristic includes mood, identifies the behavioural characteristic of each who object in the multi-media segment, including；
Extract the voice signal of who object in the multi-media segment；
The voice signal obtains intonation text data by the processing of default intonation identifier.
Second aspect, the embodiment of the present invention also provide a kind of information processing method, and described information processing method is applied to cloud
Server, including：
Receive the identity information and behavioural characteristic of each who object of at least two terminal devices transmission；
Behavioural characteristic set is built respectively for each who object；
Personage's analysis report is generated according to the behavioural characteristic set of each who object；
Based on personage's analysis report Emergent Curriculum evaluation result.
With reference to second aspect, the embodiments of the invention provide the possible embodiment of the first of second aspect, wherein, institute
Stating method also includes：
When receiving the course improvement project that user inputs according to the course evaluation result, by the course improvement side
Case is sent to terminal device.
The third aspect, the embodiment of the present invention also provide a kind of information processing system, including：Cloud Server, multiple features are adopted
Storage and at least one terminal device；
The characteristic collector, for gathering multimedia file within the default course period；
The terminal device, the identity information and behavior for determining each who object according to the multimedia file are special
Sign；
The Cloud Server, for the identity information according to each who object and behavioural characteristic generation personage
Analysis report, and, according to personage's analysis report Emergent Curriculum evaluation result.
The embodiment of the present invention brings following beneficial effect：Information processing method provided in an embodiment of the present invention is applied to set
The terminal device being placed in classroom, including：Receive the multimedia file that characteristic collector gathers within the default course period；Sieve
Select the multi-media segment for meeting preparatory condition in the multimedia file；Identify each who object in the multi-media segment
Identity information and behavioural characteristic；The identity information of each who object and behavioural characteristic are sent to Cloud Server.
In the embodiment of the present invention, the terminal device being arranged in classroom receives characteristic collector within the default course period
The multimedia file of collection, enabling obtain continuous real-time multimedia file.Terminal device screens the multimedia text
Meet the multi-media segment of preparatory condition in part, identify the identity information of each who object and behavior in the multi-media segment
Feature, the identity information of each who object and behavioural characteristic are sent to Cloud Server.Largely believed by server process
Breath, alleviate the low technical problem of efficiency present in existing information processing procedure.Reached reduce processing information use when
Between, improve the technique effect of the efficiency of information process.
Other features and advantages of the present invention will illustrate in the following description, also, partly become from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in specification, claims
And specifically noted structure is realized and obtained in accompanying drawing.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
, below will be to specific in order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art
The required accompanying drawing used is briefly described in embodiment or description of the prior art, it should be apparent that, in describing below
Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid
Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the first flow chart of information processing method provided in an embodiment of the present invention；
Fig. 2 is second of flow chart of information processing method provided in an embodiment of the present invention；
Fig. 3 is the third flow chart of information processing method provided in an embodiment of the present invention；
Fig. 4 is the structural representation of information processing system provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described, it is clear that described embodiment is part of the embodiment of the present invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
Current daily examination, questionnaire and superintend and direct that the traditional means such as class obtain is huge on the give lessons information of process of teaching
Big, these information of artificial treatment can take a long time, the problem of causing efficiency low, based on this, the embodiment of the present invention
A kind of information processing method and system are provided, the low technology of efficiency present in existing information processing procedure can be alleviated and asked
Topic, reach and reduced the time that processing information uses, improved the technique effect of the efficiency in information process.
For ease of understanding the present embodiment, a kind of information processing method disclosed in the embodiment of the present invention is entered first
Row is discussed in detail, as shown in figure 1, the embodiment of the present invention provides a kind of information processing method, described information processing method is applied to
The terminal device being arranged in classroom, information processing method may comprise steps of.
Step S101, receive the multimedia file that characteristic collector gathers within the default course period.
Exemplary, characteristic collector can be audio-video collection camera.Multimedia file can include audio file
And/or video file.The default course period can be taking human as setting.So the characteristic collector can be real-time
Ground, the multimedia file for automatically, objectively with normalization gathering student's school session.
Step S102, screen the multi-media segment for meeting preparatory condition in the multimedia file.
Exemplary, the multi-media segment that who object voice is included in the audio file can be screened, and/or, sieve
Select the multi-media segment that who object face is included in the video file.
Exemplary, the step S103 may comprise steps of.
1) identity information of each who object in the multi-media segment is identified.
Exemplary, as shown in Fig. 2 the side for identifying the identity information of each who object in the multi-media segment
Method may comprise steps of.
Step S201, extract the vocal print feature of who object in the multi-media segment.
Step S202, when the similarity of any vocal print in the vocal print feature and default vocal print storehouse meets the first default bar
During part, identity information corresponding with the vocal print in the default vocal print storehouse is defined as to the identity information of the who object.
2) behavioural characteristic of each who object in the multi-media segment is identified.
It is exemplary, the facial image of who object in the multi-media segment can be extracted.When the facial image with
When the similarity of any facial image in default face database meets the second preparatory condition, by with the people in the default face database
Behavioural characteristic corresponding to face image is defined as the behavioural characteristic of the who object.
In the embodiment of the present invention, the behavioural characteristic can include at least one of：Word dialog content, expression description
Content and mood.
Exemplary, when the behavioural characteristic includes word dialog content, identify each individual in the multi-media segment
The behavioural characteristic of thing object, the voice signal of who object in the multi-media segment can be extracted.Utilize default feature extraction
Model, predetermined acoustic model, preset language model and default Voice decoder are handled the voice signal, obtain word
Conversation content.
Exemplary, when the behavioural characteristic includes expression description content, identify each individual in the multi-media segment
The behavioural characteristic of thing object, the facial image of who object in the multi-media segment can be detected.When in the facial image
Human face expression and default face expression database in the similarity of any Facial Expression Image when meeting three preparatory conditions, will be with
Expression description content corresponding to Facial Expression Image is defined as the behavioural characteristic of the who object in the default face expression database.
Exemplary, when the behavioural characteristic includes mood, identify each who object in the multi-media segment
Behavioural characteristic, the voice signal of who object in the multi-media segment can be extracted.The voice signal is by default intonation
The processing of identifier, obtain intonation text data.
Step S104, the identity information of each who object and behavioural characteristic are sent to Cloud Server.
In the embodiment of the present invention, due to step S103 obtain be each who object identity information and behavioural characteristic,
So the identity information of obtained each who object and behavioural characteristic can be sent here to Cloud Server.
In another embodiment of the present invention, a kind of information processing method disclosed in the embodiment of the present invention is carried out detailed
Introduce, as shown in figure 3, the embodiment of the present invention provides a kind of information processing method, described information processing method is applied to cloud service
Device, described information processing method comprise the following steps.
Step S301, receive the identity information and behavioural characteristic of each who object that at least two terminal devices are sent.
Step S302, behavioural characteristic set is built respectively for each who object.
Exemplary, for each student, real-time behavioural characteristic set can be built respectively.The behavioural characteristic set
It can include：Word dialog content, expression description content and mood.The behavioural characteristic set can objectively portray student and exist
Classroom performance in the corresponding default course period.
Step S303, personage's analysis report is generated according to the behavioural characteristic set of each who object.
Exemplary, personage's analysis report can be personage's analysis report for different user.The different use
Family can include：Parents of student, Principal of School and Bureau of Education staff.For parents of student, they are only concerned oneself
Child study situation.For Principal of School, they are concerned about the Educational quality of oneself school.For Bureau of Education work people
For member, they are concerned about the whole learning quality of oneself location.So being provided for different user has different emphasis
Personage's analysis report.
Step S304, based on personage's analysis report Emergent Curriculum evaluation result.
Exemplary, the course evaluation result can include：Teachers' instruction quality evaluation, Course Exercise quality evaluation,
Student profile and interest evaluation, student receive the prediction and evaluation of course degree evaluation and Students ' Learning situation.
In the embodiment of the present invention, the Cloud Server is by the identity information and behavioural characteristic of each who object received
The behavioural characteristic set of each who object is built into, the behavioural characteristic set is generated into personage's analysis report, based on described
Personage's analysis report Emergent Curriculum evaluation result.The Cloud Server can carry out the real-time huge information received fast
The processing of speed, form personage's analysis report, and then Emergent Curriculum evaluation result.The process of this information processing is efficient and section
Learn.
In another embodiment of the present invention, methods described also includes：
When receiving the course improvement project that user inputs according to the course evaluation result, by the course improvement side
Case is sent to terminal device.
Exemplary, terminal device can be attached with multimedia touch-control all-in-one machine, the multimedia touch-control all-in-one machine
It can be used for playing video classes.
The terminal device can also include intelligent things gateway, for receive be arranged on temperature sensor in classroom,
The data of humidity sensor, air mass sensor and intensity of illumination sensor collection, by the data being collected into and preset optimal
Interval value is compared, and the electric equipment corresponding with each sensor is adjusted according to obtained comparison result.
Exemplary, the temperature data being collected into is sent to the intelligence by the temperature sensor being arranged in classroom
The temperature data received is compared with default optimum temperature interval value for gateway of internet of things, the intelligent things gateway.
If the temperature data is located in default optimum temperature interval value, the air-conditioning being arranged in classroom keeps present situation to work on.
If the temperature data is located at outside default optimum temperature interval value, the air-conditioning being arranged in classroom carries out temperature adjustment.
Exemplary, the humidity data being collected into is sent to the intelligence by the humidity sensor being arranged in classroom
The humidity data received is compared with default optimum humidity interval value for gateway of internet of things, the intelligent things gateway.
If the humidity data is located in default optimum humidity interval value, the humidifier being arranged in classroom keeps present situation to continue work
Make.If the humidity data is located at outside default optimum humidity interval value, the humidifier being arranged in classroom carries out humidity tune
Section.
Exemplary, the air quality data being collected into is sent to by the air mass sensor being arranged in classroom
The intelligent things gateway, the intelligent things gateway is by the air quality data received and default oppimum air quality
Interval value is compared.If the air quality data is located in default oppimum air quality interval value, it is arranged in classroom
VMC keep present situation work on.If the air quality data is located at outside default oppimum air quality interval value,
The VMC being then arranged in classroom carries out air quality regulation.
Exemplary, the intensity of illumination data being collected into are sent to by the intensity of illumination sensor being arranged in classroom
The intelligent things gateway, the intelligent things gateway is by the intensity of illumination data received and default optimum illumination intensity
Interval value is compared.If the intensity of illumination data are located in default optimum illumination intensity interval value, it is arranged in classroom
Intensity of illumination adjuster keep present situation work on.If the intensity of illumination data are located at default optimum illumination intensity interval value
Outside, then the intensity of illumination adjuster being arranged in classroom carry out intensity of illumination regulation.
, can by using the intelligent things gateway, multiple sensors and the electric equipment corresponding with multiple sensors
With for improving the ambient level that student attends class.Suitable classroom environment can make student focus more on the content of course, make
More accurate multimedia file can be collected by obtaining characteristic collector.
In another embodiment of the present invention, a kind of information processing system disclosed in the embodiment of the present invention is carried out detailed
To introduce, the embodiment of the present invention provides a kind of information processing system, including：Cloud Server, multiple characteristic collectors and at least one
Terminal device；
The characteristic collector, for gathering multimedia file within the default course period；
The terminal device, the identity information and behavior for determining each who object according to the multimedia file are special
Sign；
The Cloud Server, for the identity information according to each who object and behavioural characteristic generation personage
Analysis report, and, according to personage's analysis report Emergent Curriculum evaluation result.
Exemplary, as shown in figure 4, described information processing system can include：Cloud Server 41, first terminal equipment
44th, second terminal equipment 48, fisrt feature collector 42, second feature collector 45, third feature collector 46, fourth feature
Collector 47 and fifth feature collector 43.
First terminal equipment 44 is arranged in the first classroom, fisrt feature collector 42, second feature collector 45 and
Three characteristic collectors 46 are connected with first terminal equipment 44 respectively, can be used for gathering on first within the default course period
The multimedia file of student in classroom, first terminal equipment 44 can determine each in the first classroom according to the multimedia file
The identity information and behavioural characteristic of student.
Second terminal equipment 48 is arranged in the second classroom, and fourth feature collector 47 and fifth feature collector 43 are distinguished
It is connected with second terminal equipment 48, can be used for multimedia of the collection on student in the second classroom within the default course period
File, second terminal equipment 48 can determine the identity information and row of each student in the second classroom according to the multimedia file
It is characterized.
First terminal equipment 44 and second terminal equipment 48 are connected with Cloud Server 41 respectively, and first terminal equipment 44 is by
The identity information of each student and behavioural characteristic are sent to Cloud Server 41 in one classroom, and second terminal equipment 48 is by the second classroom
The identity information and behavioural characteristic of interior each student is sent to Cloud Server 41, Cloud Server 41 to be believed according to the identity of all students
Breath and behavioural characteristic generation personage's analysis report, and, according to personage's analysis report Emergent Curriculum evaluation result.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description
Specific work process, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
The information processing method and the computer program product of system that the embodiment of the present invention is provided, including store program
The computer-readable recording medium of code, the instruction that described program code includes can be used for performing described in previous methods embodiment
Method, specific implementation can be found in embodiment of the method, will not be repeated here.
Unless specifically stated otherwise, part and the relative step of step, the digital table otherwise illustrated in these embodiments
It is not limit the scope of the invention up to formula and numerical value.
In all examples being illustrated and described herein, any occurrence should be construed as merely exemplary, without
It is that therefore, other examples of exemplary embodiment can have different values as limitation.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent accompanying drawing in individual accompanying drawing.
Flow chart and block diagram in accompanying drawing show system, method and the computer journey of multiple embodiments according to the present invention
Architectural framework in the cards, function and the operation of sequence product.At this point, each square frame in flow chart or block diagram can generation
The part of one module of table, program segment or code, a part for the module, program segment or code include one or more use
In the executable instruction of logic function as defined in realization.It should also be noted that marked at some as in the realization replaced in square frame
The function of note can also be with different from the order marked in accompanying drawing generation.For example, two continuous square frames can essentially base
Originally it is performed in parallel, they can also be performed in the opposite order sometimes, and this is depending on involved function.It is also noted that
It is the combination of each square frame and block diagram in block diagram and/or flow chart and/or the square frame in flow chart, can uses and perform rule
Fixed function or the special hardware based system of action are realized, or can use the group of specialized hardware and computer instruction
Close to realize.
In addition, in the description of the embodiment of the present invention, unless otherwise clearly defined and limited, term " installation ", " phase
Even ", " connection " should be interpreted broadly, for example, it may be being fixedly connected or being detachably connected, or be integrally connected；Can
To be mechanical connection or electrical connection；Can be joined directly together, can also be indirectly connected by intermediary, Ke Yishi
The connection of two element internals.For the ordinary skill in the art, with concrete condition above-mentioned term can be understood at this
Concrete meaning in invention.
In the description of the invention, it is necessary to explanation, term " " center ", " on ", " under ", "left", "right", " vertical ",
The orientation or position relationship of the instruction such as " level ", " interior ", " outer " be based on orientation shown in the drawings or position relationship, merely to
Be easy to the description present invention and simplify description, rather than instruction or imply signified device or element must have specific orientation,
With specific azimuth configuration and operation, therefore it is not considered as limiting the invention.In addition, term " first ", " second ",
" the 3rd " is only used for describing purpose, and it is not intended that instruction or hint relative importance.
Finally it should be noted that：Embodiment described above, it is only the embodiment of the present invention, to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent substitution is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of technical scheme of the embodiment of the present invention, should all cover the protection in the present invention
Within the scope of.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
1. a kind of information processing method, it is characterised in that the terminal that described information processing method is applied to be arranged in classroom is set
It is standby, including：
Receive the multimedia file that characteristic collector gathers within the default course period；
Screen the multi-media segment for meeting preparatory condition in the multimedia file；
Identify the identity information and behavioural characteristic of each who object in the multi-media segment；
The identity information of each who object and behavioural characteristic are sent to Cloud Server.
2. information processing method according to claim 1, it is characterised in that the multimedia file includes audio file
And/or video file, the multi-media segment of preparatory condition is met in the screening multimedia file, including：
Screen the multi-media segment that who object voice is included in the audio file；
And/or screen the multi-media segment that who object face is included in the video file.
3. information processing method according to claim 2, it is characterised in that identify each personage in the multi-media segment
The identity information of object, including：
Extract the vocal print feature of who object in the multi-media segment；
When the similarity of any vocal print in the vocal print feature and default vocal print storehouse meets the first preparatory condition, will with it is described
Identity information corresponding to vocal print in default vocal print storehouse is defined as the identity information of the who object.
4. information processing method according to claim 2, it is characterised in that identify each personage in the multi-media segment
The behavioural characteristic of object, including：
Extract the facial image of who object in the multi-media segment；
, will be with when the similarity of any facial image in the facial image and default face database meets the second preparatory condition
Behavioural characteristic corresponding to facial image in the default face database is defined as the behavioural characteristic of the who object.
5. information processing method according to claim 4, it is characterised in that the behavioural characteristic is included in word dialog
Hold, identify the behavioural characteristic of each who object in the multi-media segment, including：
Extract the voice signal of who object in the multi-media segment；
Using default Feature Selection Model, predetermined acoustic model, preset language model and default Voice decoder to the voice
Signal is handled, and obtains word dialog content.
6. information processing method according to claim 5, it is characterised in that the behavioural characteristic is included in expression description
Hold, identify the behavioural characteristic of each who object in the multi-media segment, including；
Detect the facial image of who object in the multi-media segment；
When the similarity of the human face expression in the facial image and any Facial Expression Image in default face expression database expires
During three preparatory condition of foot, expression description content corresponding with Facial Expression Image in the default face expression database is defined as
The behavioural characteristic of the who object.
7. information processing method according to claim 6, it is characterised in that the behavioural characteristic includes mood, identifies institute
The behavioural characteristic of each who object in multi-media segment is stated, including；
Extract the voice signal of who object in the multi-media segment；
The voice signal obtains intonation text data by the processing of default intonation identifier.
A kind of 8. information processing method, it is characterised in that described information processing method is applied to Cloud Server, including：
Receive the identity information and behavioural characteristic of each who object of at least two terminal devices transmission；
Behavioural characteristic set is built respectively for each who object；
Personage's analysis report is generated according to the behavioural characteristic set of each who object；
Based on personage's analysis report Emergent Curriculum evaluation result.
9. information processing method according to claim 8, it is characterised in that methods described also includes：
When receiving the course improvement project that user inputs according to the course evaluation result, the course improvement project is sent out
Give terminal device.
A kind of 10. information processing system, it is characterised in that including：Cloud Server, multiple characteristic collectors and at least one terminal
Equipment；
The characteristic collector, for gathering multimedia file within the default course period；
The terminal device, for determining the identity information and behavioural characteristic of each who object according to the multimedia file；
The Cloud Server, for the identity information according to each who object and behavioural characteristic generation personage's analysis
Report, and, according to personage's analysis report Emergent Curriculum evaluation result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711018331.8A CN107844762A (en) | 2017-10-25 | 2017-10-25 | Information processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711018331.8A CN107844762A (en) | 2017-10-25 | 2017-10-25 | Information processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107844762A true CN107844762A (en) | 2018-03-27 |
Family
ID=61663032
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711018331.8A Pending CN107844762A (en) | 2017-10-25 | 2017-10-25 | Information processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107844762A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109461104A (en) * | 2018-10-22 | 2019-03-12 | 杭州闪宝科技有限公司 | Classroom monitoring method, device and electronic equipment |
| CN109817221A (en) * | 2018-12-26 | 2019-05-28 | 出门问问信息科技有限公司 | More people's video methods, device, equipment and storage medium |
| CN110135317A (en) * | 2019-05-08 | 2019-08-16 | 深圳达实智能股份有限公司 | Behavior monitoring and management system and method based on cooperated computing system |
| CN110276246A (en) * | 2019-05-09 | 2019-09-24 | 威比网络科技(上海)有限公司 | Course index detects alarm method, device, electronic equipment, storage medium |
| CN110827835A (en) * | 2019-11-21 | 2020-02-21 | 上海好学网络科技有限公司 | Spoken language examination system and method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104065928A (en) * | 2014-06-26 | 2014-09-24 | 北京小鱼儿科技有限公司 | Behavior pattern counting device and behavior pattern counting method |
| CN105334743A (en) * | 2015-11-18 | 2016-02-17 | 深圳创维－Rgb电子有限公司 | Intelligent home control method and system based on emotion recognition |
| CN106846949A (en) * | 2017-03-07 | 2017-06-13 | 佛山市金蓝领教育科技有限公司 | A kind of long-range Emotional Teaching system |
| CN106878677A (en) * | 2017-01-23 | 2017-06-20 | 西安电子科技大学 | Student classroom Grasping level assessment system and method based on multisensor |
| CN107085721A (en) * | 2017-06-26 | 2017-08-22 | 厦门劢联科技有限公司 | A kind of intelligence based on Identification of Images patrols class management system |
-
2017
- 2017-10-25 CN CN201711018331.8A patent/CN107844762A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104065928A (en) * | 2014-06-26 | 2014-09-24 | 北京小鱼儿科技有限公司 | Behavior pattern counting device and behavior pattern counting method |
| CN105334743A (en) * | 2015-11-18 | 2016-02-17 | 深圳创维－Rgb电子有限公司 | Intelligent home control method and system based on emotion recognition |
| CN106878677A (en) * | 2017-01-23 | 2017-06-20 | 西安电子科技大学 | Student classroom Grasping level assessment system and method based on multisensor |
| CN106846949A (en) * | 2017-03-07 | 2017-06-13 | 佛山市金蓝领教育科技有限公司 | A kind of long-range Emotional Teaching system |
| CN107085721A (en) * | 2017-06-26 | 2017-08-22 | 厦门劢联科技有限公司 | A kind of intelligence based on Identification of Images patrols class management system |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109461104A (en) * | 2018-10-22 | 2019-03-12 | 杭州闪宝科技有限公司 | Classroom monitoring method, device and electronic equipment |
| CN109817221A (en) * | 2018-12-26 | 2019-05-28 | 出门问问信息科技有限公司 | More people's video methods, device, equipment and storage medium |
| CN110135317A (en) * | 2019-05-08 | 2019-08-16 | 深圳达实智能股份有限公司 | Behavior monitoring and management system and method based on cooperated computing system |
| CN110276246A (en) * | 2019-05-09 | 2019-09-24 | 威比网络科技(上海)有限公司 | Course index detects alarm method, device, electronic equipment, storage medium |
| CN110827835A (en) * | 2019-11-21 | 2020-02-21 | 上海好学网络科技有限公司 | Spoken language examination system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107844762A (en) | Information processing method and system | |
| CN110991381B (en) | Real-time classroom student status analysis and indication reminding system and method based on behavior and voice intelligent recognition | |
| US11151892B2 (en) | Internet teaching platform-based following teaching system | |
| US20200286396A1 (en) | Following teaching system having voice evaluation function | |
| CN108281052A (en) | A kind of on-line teaching system and online teaching method | |
| US20190147760A1 (en) | Cognitive content customization | |
| CN110910691B (en) | Personalized course generation method and system | |
| CN110930781B (en) | Recording and broadcasting system | |
| CN109189535A (en) | Teaching method and device | |
| CN111027486A (en) | Auxiliary analysis and evaluation system and method for big data of teaching effect of primary and secondary school classroom | |
| CN114422820A (en) | Education interactive live broadcast system and live broadcast method | |
| CN109754653B (en) | Method and system for personalized teaching | |
| CN117314700A (en) | Dual-teacher teaching management method and system for preschool education | |
| Haug et al. | Development of a technology-assisted assessment for sign language learning | |
| CN113038259B (en) | Method and system for feeding back class quality of Internet education | |
| CN109919816A (en) | Cource arrangement method and device, storage medium and electronic equipment based on data analysis | |
| CN113268512A (en) | Enterprise post professional skill training system based on internet platform | |
| TWM600908U (en) | Learning state improvement management system | |
| TWM600909U (en) | Class course management system | |
| CN108388138A (en) | Apparatus control method, apparatus and system | |
| Harrison-Pitaniello | Using student-produced time-lapse plant movies to communicate concepts in plant biology | |
| TWI731577B (en) | Learning state improvement management system | |
| CN110808066B (en) | Teaching environment safety analysis method | |
| CN105096668A (en) | Teaching voice and video manufacturing system and manufacturing method | |
| CN108776794B (en) | Teaching effect image drawing method based on big data and artificial intelligence and robot system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180327 |