CN112712738A - Student display processing method and device and electronic device - Google Patents

Student display processing method and device and electronic device Download PDF

Info

Publication number
CN112712738A
CN112712738A CN202011067867.0A CN202011067867A CN112712738A CN 112712738 A CN112712738 A CN 112712738A CN 202011067867 A CN202011067867 A CN 202011067867A CN 112712738 A CN112712738 A CN 112712738A
Authority
CN
China
Prior art keywords
teacher
student
students
virtual
learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011067867.0A
Other languages
Chinese (zh)
Other versions
CN112712738B (en
Inventor
不公告发明人
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN202011067867.0A priority Critical patent/CN112712738B/en
Publication of CN112712738A publication Critical patent/CN112712738A/en
Application granted granted Critical
Publication of CN112712738B publication Critical patent/CN112712738B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/735—Filtering based on additional data, e.g. user or group profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/7837—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content
    • G06F16/784—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using objects detected or recognised in the video content the detected or recognised objects being people
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Educational Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Educational Administration (AREA)
  • Tourism & Hospitality (AREA)
  • Library & Information Science (AREA)
  • Computational Linguistics (AREA)
  • Strategic Management (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • General Business, Economics & Management (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The application discloses a student display processing method and device and an electronic device, wherein the method comprises the following steps: judging whether a student needs to be displayed or not under the condition that a teacher gives lessons through first intelligent equipment, wherein the student is a virtual student and/or a real student which can be displayed on a screen; under the condition that students need to be displayed, acquiring information of the students needing to be displayed, wherein the information comprises at least one of: the number of students, the ages of the students, the sexes of the students, the images of the students and the learning states of the students; and displaying the students corresponding to the information to the teacher on the second intelligent device according to the information. The problem that a teacher can only face the device to give a lecture in online education and interaction with students is caused is solved, and the mutual dynamic sense of the teacher in class teaching is improved.

Description

Student display processing method and device and electronic device
Technical Field
The application relates to the field of education, in particular to a student display processing method and device and an electronic device.
Background
Along with online education's popularization, can develop the indispensable ability that online teaching becomes every teacher, more and more teachers need participate in online live broadcast and online course and record, because live broadcast and course record the environment and have very big difference with the classroom teaching, the teacher (or called teacher as well) can only be facing to the equipment lecture, lack with student's interdynamic, can not fully receive student's the feedback of listening to lessons, hardly reach the on-the-spot effect that has the student when the lecture.
Disclosure of Invention
The application provides a student display processing method and device and an electronic device, and aims to solve the problem that a teacher can only face equipment to give a lecture and interaction with students is lacked in online education.
According to an aspect of the present invention, there is provided a student display processing method including: judging whether a student needs to be displayed or not under the condition that a teacher gives lessons through first intelligent equipment, wherein the student is a virtual student and/or a real student which can be displayed on a screen; under the condition that the students need to be displayed, acquiring information of the students needing to be displayed, wherein the information comprises at least one of: the number of said students, the age of said students, the gender of said students, the image of said students, the learning status of said students; and displaying the student corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices.
According to another aspect of the present invention, there is also provided a student display processing apparatus including: the system comprises a judging module, a display module and a display module, wherein the judging module is used for judging whether a student needs to be displayed or not under the condition that a teacher gives a lesson through first intelligent equipment, and the student is a virtual student and/or a real student which can be displayed on a screen; the acquisition module is used for acquiring the information of the students needing to be displayed under the condition that the students need to be displayed, wherein the information comprises at least one of: the number of said students, the age of said students, the gender of said students, the image of said students, the learning status of said students; and the display module is used for displaying the students corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices.
According to another aspect of the present application, there is also provided an electronic device comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to execute the computer program to perform the above method.
In the embodiment of the application, whether a student needs to be displayed is judged under the condition that a teacher gives a lesson through first intelligent equipment, wherein the student is a virtual student and/or a real student which can be displayed on a screen; under the condition that the students need to be displayed, acquiring information of the students needing to be displayed, wherein the information comprises at least one of: the number of said students, the age of said students, the gender of said students, the image of said students, the learning status of said students; and displaying the student corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices. The problem that a teacher can only face the device to give a lecture in online education and interaction with students is caused is solved, and the mutual dynamic sense of the teacher in class teaching is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the application and, together with the description, serve to explain the application and are not intended to limit the application. In the drawings:
FIG. 1 is a flow chart of a student display processing method according to an embodiment of the application;
FIG. 2 is a schematic illustration of a teacher lecture status display according to an embodiment of the application;
FIG. 3 is a schematic diagram of a virtual student at a teacher teaching device according to an embodiment of the application;
FIG. 4 is a schematic diagram of a virtual student displaying on a standalone intelligent device according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a student displaying on a standalone intelligent device according to an embodiment of the application;
fig. 6 is a schematic diagram of a display of a device for students to give lessons to teachers according to an embodiment of the application.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
In order to make the technical solutions better understood by those skilled in the art, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only partial embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In this embodiment, an electronic device is provided, comprising a memory in which a computer program is stored and a processor arranged to run the computer program to perform the method in the following embodiments.
All functions of the system are implemented by a program on a smart device (for example, a smart phone or a tablet computer, or a device such as a computer or a notebook computer having a display processor) side, and a mobile phone side is taken as an example for description below. The mobile phone terminal program can be matched with the server to realize the functions of the following system. The system can also be used as software installed on a computer, and the functions of the system can be realized by using the computer. Alternatively, the system can be implemented in a BS manner, and a browser and a server are used to implement the corresponding functions. In the following embodiments, the enhanced software or application refers to software capable of running on a smart device or a computer, and may also refer to a system capable of running corresponding functions through third-party software (e.g., a browser). Whatever system, so long as the functions in the following embodiments are realized, is within the scope of the present application.
The system can be called as a student display system, the student display system can be used as a piece of software or an application or a module, and the system provides an interface to the outside, so that in the education software without the student display function, the corresponding function can be realized in the education software only by calling the interface provided by the system. Alternatively, the student display system can also be used as a built-in functional module in other systems. The student display system as a single module or application has the advantages that: the application scene of the student display function can be expanded, so that other mature systems can call the student display function through the interface without great change.
Fig. 1 is a flowchart of a student display processing method according to an embodiment of the present application, and as shown in fig. 1, the flowchart includes the following steps:
step S102, judging whether a student needs to be displayed or not under the condition that a teacher gives a lesson through first intelligent equipment, wherein the student is a virtual student and/or a real student which can be displayed on a screen;
the function displayed by the student can be used in various application scenes, for example, when the course is recorded or when the course is live. In other application scenarios, the teacher may also determine whether to enable the student display function according to the actual needs of the teacher. These scenarios are not listed. The virtual students in this step may be avatars that can be displayed, and the live students may be videos of the live students, which can be displayed in a screen, for example, videos of the live students may be displayed in a system. The display of the virtual students and the real students can be flexibly configured or flexibly selected in the using process. The selection may be made by a user, such as a teacher, an administrator, or the like, or the system may actively make the selection based on the actual usage scenario.
Step S104, under the condition that the students need to be displayed, acquiring the information of the students needing to be displayed, wherein the information comprises at least one of: the number of the students, the ages of the students, the sexes of the students, the images of the students and the learning states of the students;
in an alternative embodiment, a virtual student library may be preconfigured, in which information for different types of virtual students is stored. For example, a virtual student library is designed in the system, the image and the behavior of virtual students completely simulate real people, the virtual students comprise different sexes and different age groups, the presented learning behaviors are all seriously active, and the learning behaviors are formed by multiple modes. The teacher may be asked to enter information about the virtual student at the time of selecting the student, or the system may default to generating information about the virtual student (e.g., randomly generating information about different virtual students) and then generate the virtual student based on the information.
And S106, displaying the student corresponding to the information to the teacher on a second intelligent device according to the information of the student, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices. The first smart device may be one or more devices, and the second smart device may also be one or more devices. A plurality of students can be displayed on the second intelligent device simultaneously, or a plurality of second intelligent devices can be arranged, each intelligent device can display one student, and students with different quantities can be displayed according to the setting. For example: the system can display the close-range videos of one or more students, and the teacher can independently set the age, sex and number of the students needing to be displayed, and when the students are displayed on the independent intelligent device, the number of the students is more than that displayed on the teaching device of the teacher.
The functions in the above steps and the first and second smart devices may be understood as functions implemented by a software system. The system can operate on intelligent planar equipment based on android, apples, WINDOWS and LINUX systems, can be connected with a live system through an interface, and is better in display effect of large-screen equipment. The system can be operated on intelligent equipment for teaching by teachers, can be displayed with teaching content documents at the same time, and can also be operated on the intelligent equipment independently, only displays videos of students and is placed right in front of the teachers.
Through the steps, the problem that a teacher can only face the device to give a lecture in online education and interaction with students is lacked is solved, and the mutual dynamic sense of the teacher in class giving is improved.
In an alternative embodiment, in order to make the teacher feel close to the real classroom, the lecture behavior of the teacher in the course of the lecture can be acquired, wherein the lecture comprises at least one of the following: the sound of the teacher, the actions of the teacher, and the expressions of the teacher; and then adjusting the learning behaviors of part or all of the virtual students according to the lecture behaviors, wherein the adjusted learning behaviors are used as feedback of the lecture behaviors, and the learning behaviors comprise at least one of the following: expressions in learning, actions in learning, answers to teacher's questions; and displaying the adjusted learning behaviors of the virtual student to the teacher.
In an alternative embodiment, machine learning may also be introduced for processing. A model may be trained using a machine learning model through multiple sets of training data. Each group of training data in the multiple groups of training data comprises teacher's behavior data and student's behavior data, the corresponding relation between the teacher's behavior and the student's behavior is established after training, at the moment, the corresponding student's behavior can be obtained after the teacher's behavior is input by using the model, and then the performance or image of the virtual student is adjusted according to the student's behavior.
Or a simpler comparison relationship can be used for processing, the expression or the image of the virtual student corresponding to different teacher behaviors is configured in advance, and the corresponding expression or image of the virtual student can be found according to the comparison relationship after the behaviors are obtained.
This optional function can be used to implement classroom questioning and answering. At this time, adjusting the learning behavior of part or all of the virtual students according to the lecture behavior may include: acquiring the sound of the teacher; judging whether the sound of the teacher has the content of asking questions of students; and adjusting the behaviors of part or all of the virtual students according to the content of the question to answer the question.
In order to better simulate the feeling of an actual classroom, the function of asking questions by virtual students can be added, for example, the voice of a teacher can be obtained; judging whether the sound of the teacher has the content triggering the preset problem; and if the preset problem is triggered, selecting a certain virtual student to ask a preset problem. In the function, the function of questioning students is added, so that the classroom atmosphere is more real.
For example, when a teacher asks some questions, the system judges the question type of the teacher through the voice recognition system, and the virtual students make corresponding answers, so that the teacher is guided to carry out the next explanation. For the judgment type question, if the keywords such as "yes or not", "not right", "unable to answer", etc., the student randomly answers yes or no; for other types of questions, the student's answer is typically unknown, unclear, or ask the teacher to explain next, etc. During the course of the lecture, the teacher may choose whether to replace the virtual student of the video presentation.
The teacher can preset some questions asked by virtual students in the system, and when designing the questions, key sentences triggering the students to ask the questions are set at the same time, and the voice recognition system of the system judges that the matching degree of the words spoken by the teacher and the key sentences reaches more than 60%, and then randomly selects a certain virtual student to ask the corresponding question to guide the teacher to answer the question.
Through this mode, can accomplish to let virtual student make corresponding performance according to mr's lecture action, increased the interactivity of mr's lecture.
In some cases, videos of live students (or called as real students) may be accessed, and at this time, only videos of the live students may be displayed, or videos of the live students or videos of virtual students may be displayed in a mixed manner, and selection may be flexibly performed according to actual conditions.
Under this alternative embodiment, the method may further comprise: under the condition that the videos of the real students are accessed, whether the videos of the real students are displayed to the teacher is determined; and under the condition that the number of the live student videos is multiple, selecting part or all of the live student videos to be displayed to the teacher.
The selection of the live student video to be displayed to the teacher may be made randomly or may be based on conditions pre-configured by the teacher. As a preferred approach, the selection may be based on the status of the student, and in the preferred embodiment, the selection of part or all of the live student video for display to the teacher may include: judging the learning state reflected in each live student video in the live student video; selecting part or all of the real person student videos according to the learning state; and displaying the selected part or all of the live student videos to the teacher.
For example, when a real student accesses the system through the image of the virtual student, the system selects the image of the virtual student similar to the real student through the information of the sex, age, image and the like of the real student, and the virtual student displayed by the system is a positive state of listening and speaking seriously no matter what the learning state of the real student is.
When a teacher selects to access a live student video, the system identifies and judges the learning state of a student through facial expression and action behavior, the teacher selects to access the student video in which learning state (positive learning state or negative learning state), and if the state of the student accessing the video changes for more than a certain time, the system selects other student videos in specific learning states to replace the student.
As a preferred embodiment, a model may be trained to implement this functionality. For example, a model is trained by machine learning using multiple sets of training data, each set of training data including a video learned by a student and a label indicating whether the video corresponds to a positive or negative status. Through the training, a usable model can be obtained, and the corresponding state of the video can be obtained through inputting the student learning video into the model.
In another alternative embodiment, in the case of live student video access, determining whether to display to a teacher through the virtual student video in place of the live student video; if the virtual student video is selected to be displayed, selecting part or all of the real student video, judging at least one of the age, sex and image of the real student, and selecting the virtual student with the characteristics similar to those of the real student, wherein the virtual student presents a positive and serious learning state; and displaying the video of the selected virtual student to the teacher.
Through the optional implementation mode, a teacher can flexibly select to access the live student video or the virtual student video. Or, under the condition that the real student videos and the virtual student videos are mixed, the teacher cannot distinguish which videos are real and which videos are virtual, so that the real teaching experience is improved. In order to achieve the effect that real and virtual images cannot be distinguished, in the optional embodiment, the video of the live students may be acquired, and parameters of the virtual video may be adjusted according to parameters (for example, image quality, color, background, and picture resolution) of the video of the live students, so as to obtain an effect that the video of the live students and the virtual video are consistent.
In order to enable the teacher to know the status of himself in real time, an optional embodiment may be added, in which the method may further include: acquiring the lecture behavior of the teacher in the course of lecture, wherein the lecture comprises at least one of the following: the sound of the teacher, the actions of the teacher, and the expressions of the teacher; determining a numerical value corresponding to the lecture behavior; and comparing the value with a preset value standard range and displaying the value to the teacher.
For example, the system can display quantized values of states such as the speed of speech, the number of times of questioning, expressions, gestures and the like in the teaching process of a teacher in real time through the voice recognition module, the face recognition module and the action recognition module, and provide a suggested value range of the states, so that the teacher can adjust the teaching state of the teacher in time.
Fig. 2 is a schematic diagram of a teacher teaching state display according to an embodiment of the present application, and as shown in fig. 2, the system can display quantized values of states such as a speed of speech, a number of questions asked, an expression, and a gesture in a teaching process of a teacher in real time through the voice recognition module, the face recognition module, and the motion recognition module, and provide a suggested value range of the states, so that the teacher can adjust a teaching state of the teacher in time.
This is described below in connection with a preferred embodiment. The preferred embodiment illustrates two scenes, in the course recording situation, the system designs a virtual student library, the image and behavior of the virtual students completely simulate real people, the images and behavior of the virtual students comprise different sexes and different age groups, the presented learning behaviors are all serious and positive, and the learning behaviors are in multiple modes. For on-line live broadcast training, a teacher can select to display the live students in the system through virtual students instead of the live students, and can also select to access videos of the live students into the system. The following describes these two scenarios separately.
(1) Course recording mode
In the course recording mode, the system can display close-range videos of one or more virtual students, a teacher can independently set the ages, sexes and number of the virtual students needing to be displayed, and when the virtual students are displayed on a single intelligent device, the number of the students is more than the number displayed on a teacher teaching device.
Fig. 3 is a schematic view of display of a virtual student on a teacher teaching device according to an embodiment of the present application, and fig. 4 is a schematic view of display of a virtual student on an independent intelligent device according to an embodiment of the present application. In fig. 3, the virtual students are shown on the teacher teaching device, and in fig. 4, the virtual students are shown on the independent smart device.
When the teacher speaks, if questions are not asked, the students all present positive learning states, such as actions of carefully listening to the class, nodding on recognition, smiling and indicating, note recording and the like, each action has multiple expression forms, the actions are randomly and naturally presented, the frequency of the nodding on recognition state presentation is higher, and the teacher feels concerned. If the teacher chooses to present multiple virtual students, the actions and feedback of each student will be somewhat different.
When a teacher asks some questions, the system judges the question type of the teacher through the voice recognition system, and the virtual students make corresponding answers, so that the teacher is guided to carry out next explanation. For the judgment type question, if the keywords such as "yes or not", "not right", "unable to answer", etc., the student randomly answers yes or no; for other types of questions, the student's answer is typically unknown, unclear, or ask the teacher to explain next, etc. During the course of the lecture, the teacher may choose whether to replace the virtual student of the video presentation.
The teacher can preset some questions asked by virtual students in the system, and when designing the questions, key sentences triggering the students to ask the questions are set at the same time, and the voice recognition system of the system judges that the matching degree of the words spoken by the teacher and the key sentences reaches more than 60%, and then randomly selects a certain virtual student to ask the corresponding question to guide the teacher to answer the question.
(2) On-line live broadcast mode
When online live broadcasting is carried out, the system is connected with a live broadcasting system through an interface, and teachers can select display modes of students participating in live broadcasting in the system, so that the videos of real students can be displayed through virtual students and can be directly accessed.
Fig. 5 is a schematic view of a display of a student on an independent intelligent device according to an embodiment of the present application, and fig. 6 is a schematic view of a display of a student on a teacher teaching device according to an embodiment of the present application. As shown in fig. 5 and 6, the student is shown on the standalone smart device display in fig. 5 and the student is shown on the teacher live device display in fig. 6.
When the real-person students access the system through the images of the virtual students, the system selects the images of the virtual students similar to the real-person students through the information of sex, age, occupation and the like of the real-person students, and the virtual students displayed by the system are in the positive state of listening and speaking seriously no matter what the learning state of the real-person students is.
When a teacher selects to access a live student video, the system identifies and judges the learning state of a student through facial expression and action behavior, the teacher selects to access the student video in which learning state (positive learning state or negative learning state), and if the state of the student accessing the video changes for more than a certain time, the system selects other student videos in specific learning states to replace the student.
In the course of lecturing, if the teacher allows the student to ask questions, the student can click the question asking operation of the live broadcast system, the teacher live broadcast system end can display the name of the student, if the virtual student video or the live video corresponding to the student is accessed into the system, the teacher can click the name of the student in the live broadcast system to open the microphone of the student, and the student communicates with the teacher through the system; if the students do not access the system through virtual student videos or real person videos, the live system end of the teacher displays the name of the questioner, if the teacher allows the students to ask questions, the student names are clicked at the live system end point, the video access system of the students is asked to randomly replace a certain student video accessed before, and meanwhile, the microphone is started.
The system provided by the preferred embodiment can support two teaching situations of online live broadcast and course recording. When the course is recorded and is directly broadcast on line, the teacher can interact with virtual students and real-person students through multiple modes, and can obtain more effective and positive student feedback than the teaching environment of the face-to-face, so that the teacher is fully integrated into the teaching atmosphere. For the learning behaviors of virtual students, a series of active learning behavior libraries are designed and can be presented to teachers through natural and real states. When the course is recorded, the system can perform voice recognition on the content of the teaching of the teacher, and performs targeted interaction through the virtual students, wherein the interaction comprises interaction modes such as actions, expressions, languages and the like. When the live broadcasting is carried out, the system can identify the learning behaviors of the real students, and select the videos of the real students in a specific learning state to be displayed to a teacher. When the live broadcasting is carried out, the teacher can select to replace the live students to access the video through the virtual students, and positive learning states are presented through the virtual students. During teaching, the system can display the key teaching state of a teacher and provide a basis for the teacher to adjust the state through visual data.
In another embodiment, a student display processing apparatus is further provided, and modules of the apparatus correspond to steps in the above method, which have already been described, and are not described herein again. The device includes: the judging module is used for judging whether a student needs to be displayed or not under the condition that a teacher gives lessons through the first intelligent device, wherein the student is a virtual student and/or a real student which can be displayed on a screen; the acquisition module is used for acquiring the information of the students needing to be displayed under the condition that the students need to be displayed, wherein the information comprises at least one of: the number of the students, the ages of the students, the sexes of the students, the images of the students and the learning states of the students; and the display module is used for displaying the students corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices.
Preferably, the obtaining module is further configured to obtain the lecture behavior of the teacher during the course of the lecture, where the lecture includes at least one of: the sound of the teacher, the actions of the teacher, and the expressions of the teacher; the device also includes: the adjusting module is used for adjusting the learning behaviors of part or all of the virtual students according to the lecture behaviors, wherein the adjusted learning behaviors serve as feedback of the lecture behaviors, and the learning behaviors comprise at least one of the following: expressions in learning, actions in learning, answers to teacher's questions; the display module is also used for displaying the adjusted learning behaviors of the virtual student to the teacher; and/or the judging module is further used for determining whether to display videos of the live students to the teacher under the condition that the videos of the live students are accessed, judging learning states embodied by the students in the videos of the live students if the videos of the live students are selected to be displayed, and selecting part or all of the videos of the live students according to the learning states; the display module is also used for displaying the selected part or all of the live student videos to the teacher; and/or the judging module is further used for determining whether to display the virtual student video to the teacher by replacing the live student video under the condition that the live student video is accessed, if the virtual student video is selected to be displayed, selecting part or all of the live student video, judging at least one of the age, sex and image of the live student, and selecting the virtual student with the characteristic similar to that of the live student, wherein the virtual student presents a positive and serious learning state; the display module is further used for displaying the selected video of the virtual student to the teacher.
Preferably, the obtaining module is further configured to obtain the lecture behavior of the teacher during the course of the lecture, where the lecture includes at least one of: the sound of the teacher, the actions of the teacher, and the expressions of the teacher; the device also comprises a determining module used for determining the corresponding numerical value of the lecture behavior; the display module is also used for comparing and displaying the numerical value with a preset numerical value standard range to the teacher.
Through the device, the problem that a teacher can only face the equipment to give lessons and interaction with students is lacked in online education is solved, and the mutual dynamic sense of the teacher in class teaching is improved.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
The embodiment of the application provides a storage medium, on which a program or software is stored, and the program realizes the method when being executed by a processor. The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims (10)

1. A student display processing method, characterized by comprising:
judging whether a student needs to be displayed or not under the condition that a teacher gives lessons through first intelligent equipment, wherein the student is a virtual student and/or a real student which can be displayed on a screen;
under the condition that the students need to be displayed, acquiring information of the students needing to be displayed, wherein the information comprises at least one of: the number of said students, the age of said students, the gender of said students, the image of said students, the learning status of said students;
and displaying the student corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices.
2. The method of claim 1, further comprising:
acquiring the lecture behavior of the teacher in the lecture process, wherein the lecture comprises at least one of the following: the sound of the teacher, the actions of the teacher, and the expressions of the teacher;
and adjusting the learning behaviors of part or all of the virtual students according to the lecture behaviors, wherein the adjusted learning behaviors are used as feedback of the lecture behaviors, and the learning behaviors comprise at least one of the following: expressions in learning, actions in learning, answers to teacher's questions;
and displaying the adjusted learning behaviors of the virtual students to the teacher.
3. The method of claim 2, wherein adjusting learning behaviors of some or all of the virtual students according to the lecture behaviors comprises:
acquiring the sound of the teacher;
judging whether the sound of the teacher has the content of triggering a preset problem;
and if the content triggering the preset problem exists, selecting a certain virtual student to ask the preset problem.
4. The method of claim 1, further comprising:
under the condition that the videos of the live students are accessed, whether the videos of the live students are displayed to the teacher is determined;
if the real-person student video is selected to be displayed, judging the learning state embodied by the students in the real-person student video;
selecting part or all of the real person student videos according to the learning state;
and displaying the selected part or all of the live student videos to the teacher.
5. The method of claim 1, further comprising:
under the condition that live student videos are accessed, whether the live student videos are replaced by the virtual student videos to be displayed to the teacher is determined;
if the virtual student video is selected to be displayed, selecting part or all of the real student video, judging at least one of the age, sex and image of the real student, and selecting the virtual student with the characteristics similar to those of the real student, wherein the virtual student presents a positive and serious learning state;
displaying the selected video of the virtual student to the teacher.
6. The method according to any one of claims 1 to 5, further comprising:
acquiring the lecture behavior of the teacher in the lecture process, wherein the lecture comprises at least one of the following: the sound of the teacher, the actions of the teacher, and the expressions of the teacher;
determining a numerical value corresponding to the lecture behavior;
and comparing the numerical value with a preset numerical value standard range and displaying the numerical value to the teacher.
7. A student display processing apparatus characterized by comprising:
the system comprises a judging module, a display module and a display module, wherein the judging module is used for judging whether a student needs to be displayed or not under the condition that a teacher gives a lesson through first intelligent equipment, and the student is a virtual student and/or a real student which can be displayed on a screen;
the acquisition module is used for acquiring the information of the students needing to be displayed under the condition that the students need to be displayed, wherein the information comprises at least one of: the number of said students, the age of said students, the gender of said students, the image of said students, the learning status of said students;
and the display module is used for displaying the students corresponding to the information to the teacher on a second intelligent device according to the information, wherein the first intelligent device and the second intelligent device are the same intelligent device, or the first intelligent device and the second intelligent device are different intelligent devices.
8. The apparatus of claim 7,
the obtaining module is further configured to obtain a lecture behavior of the teacher during a lecture process, where the lecture includes at least one of: the sound of the teacher, the actions of the teacher, and the expressions of the teacher; the device further comprises: an adjusting module, configured to adjust learning behaviors of some or all virtual students according to the lecture behavior, where the adjusted learning behaviors serve as feedback of the lecture behavior, and the learning behaviors include at least one of: expressions in learning, actions in learning, answers to teacher's questions; the display module is further configured to display the adjusted learning behavior of the virtual student to the teacher; and/or the presence of a gas in the gas,
the acquisition module is also used for acquiring the sound of the teacher in the course of lecturing; the judging module is used for identifying whether the sound of the teacher has the content triggering the preset problem; if the content triggering the preset question exists, the display module is used for displaying a virtual student to ask the preset question to the teacher; and/or the presence of a gas in the gas,
the judgment module is also used for determining whether to display videos of the live students to the teacher or not under the condition that the videos of the live students are accessed, judging the learning states embodied by the students in the videos of the live students if the videos of the live students are selected to be displayed, and selecting part or all of the videos of the live students according to the learning states; the display module is also used for displaying the selected part or all of the live student videos to the teacher; and/or the presence of a gas in the gas,
the judgment module is further used for determining whether to replace the live student video to display to the teacher through the virtual student video under the condition that the live student video is accessed, if the virtual student video is selected to be displayed, selecting part or all of the live student video, judging at least one of the age, sex and image of the live student, and selecting the virtual student with the characteristic similar to that of the live student, wherein the virtual student presents a positive and serious learning state; the display module is further used for displaying the selected video of the virtual student to the teacher.
9. The apparatus of claim 7,
the obtaining module is further configured to obtain a lecture behavior of the teacher during a lecture process, where the lecture includes at least one of: the sound of the teacher, the actions of the teacher, and the expressions of the teacher;
the device also comprises a determining module used for determining the corresponding numerical value of the lecture behavior;
the display module is also used for comparing and displaying the numerical value with a preset numerical value standard range to the teacher.
10. An electronic device comprising a memory and a processor, wherein the memory has stored therein a computer program, and wherein the processor is arranged to execute the computer program to perform the method of any of claims 1 to 6.
CN202011067867.0A 2020-10-08 2020-10-08 Student display processing method and device and electronic device Active CN112712738B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011067867.0A CN112712738B (en) 2020-10-08 2020-10-08 Student display processing method and device and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011067867.0A CN112712738B (en) 2020-10-08 2020-10-08 Student display processing method and device and electronic device

Publications (2)

Publication Number Publication Date
CN112712738A true CN112712738A (en) 2021-04-27
CN112712738B CN112712738B (en) 2023-07-21

Family

ID=75542384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011067867.0A Active CN112712738B (en) 2020-10-08 2020-10-08 Student display processing method and device and electronic device

Country Status (1)

Country Link
CN (1) CN112712738B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113727063A (en) * 2021-11-03 2021-11-30 瑶坤(北京)教育科技有限公司 Multi-party video information interaction method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011107329A (en) * 2009-11-16 2011-06-02 Wao Corporation Server device, bidirectional education method, and program
CN102609885A (en) * 2012-01-11 2012-07-25 艾沃瑞克（北京）科技有限公司 On-line language teaching system
CN107765859A (en) * 2017-11-09 2018-03-06 温州大学 A kind of training system and method based on VR virtual classrooms
CN108091192A (en) * 2017-12-14 2018-05-29 尹子悦 Interactive on-line teaching system and method, teacher's system and student system
CN109615961A (en) * 2019-01-31 2019-04-12 华中师范大学 A kind of classroom instruction classroom interactions network system and method
CN110472099A (en) * 2018-05-10 2019-11-19 腾讯科技（深圳）有限公司 Interdynamic video generation method and device, storage medium
CN110618757A (en) * 2019-09-23 2019-12-27 北京大米科技有限公司 Online teaching control method and device and electronic equipment
CN111680137A (en) * 2020-05-20 2020-09-18 北京大米科技有限公司 Online classroom interaction method and device, storage medium and terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2011107329A (en) * 2009-11-16 2011-06-02 Wao Corporation Server device, bidirectional education method, and program
CN102609885A (en) * 2012-01-11 2012-07-25 艾沃瑞克（北京）科技有限公司 On-line language teaching system
CN107765859A (en) * 2017-11-09 2018-03-06 温州大学 A kind of training system and method based on VR virtual classrooms
CN108091192A (en) * 2017-12-14 2018-05-29 尹子悦 Interactive on-line teaching system and method, teacher's system and student system
CN110472099A (en) * 2018-05-10 2019-11-19 腾讯科技（深圳）有限公司 Interdynamic video generation method and device, storage medium
CN109615961A (en) * 2019-01-31 2019-04-12 华中师范大学 A kind of classroom instruction classroom interactions network system and method
CN110618757A (en) * 2019-09-23 2019-12-27 北京大米科技有限公司 Online teaching control method and device and electronic equipment
CN111680137A (en) * 2020-05-20 2020-09-18 北京大米科技有限公司 Online classroom interaction method and device, storage medium and terminal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113727063A (en) * 2021-11-03 2021-11-30 瑶坤(北京)教育科技有限公司 Multi-party video information interaction method and device

Also Published As

Publication number Publication date
CN112712738B (en) 2023-07-21

Similar Documents

Publication Publication Date Title
Häggström Teaching systems of linear equations in Sweden and China: What is made possible to learn?
KR101375119B1 (en) Virtual interview mothod and mobile device readable recording medium for executing application recorded the method
CN108447329A (en) Learning effect test method, learning resource manager device, system and client
Starr et al. Third culture kids in the outer circle: The development of sociolinguistic knowledge among local and expatriate children in Singapore
CN110827595A (en) Interaction method and device in virtual teaching and computer storage medium
Ball et al. Research, Principles, and Practices in Visual Communication.
Bakla A Study of Digital Nativeness and Digital Productivity: Data from EFL and ESL Contexts.
CN112712738B (en) Student display processing method and device and electronic device
US20230306864A1 (en) Producing video of a lesson package in a virtual world
Lin et al. Exploring Multiliteracy of Pre-Service Language Teachers through Spherical Video-Based Virtual Reality
Gromik Smartphone-based learning in the Japanese ESL classroom: A case study report
CN113570227A (en) Online education quality evaluation method, system, terminal and storage medium
ANNISA THE EFFECTIVENESS OF USING VIDEO BLOG (VLOG) ON STUDENTS’SPEAKING ABILITY IN EXPRESSING DAILY ACTIVITIES FOR THE FIRST SEMESTER OF THE ELEVENTH GRADE OF MA UNWANUL FALAH PESAWARAN IN THE ACADEMIC YEAR OF 2020/2021
CN110853428A (en) Recording and broadcasting control method and system based on Internet of things
Krašna et al. Video learning materials for better students’ performance
KR102154859B1 (en) Cognition improvement training system for prevention of dementia
KR20180002992A (en) Language learning method and system using a variable speed audio-visual training principles
KR102528293B1 (en) Integration System for supporting foreign language Teaching and Learning using Artificial Intelligence Technology and method thereof
US11676501B2 (en) Modifying a lesson package
CN113240953A (en) Personalized virtual teaching system
US20220051583A1 (en) Updating a lesson package
US20220084425A1 (en) Utilizing a lesson package
Medina et al. LANGUAGE LEARNING IN SITU: THE USE OF 360° VIDEO AND CONVERSATIONAL TECHNOLOGIES FOR SECOND LANGUAGE ACQUISITION
CN115376372A (en) Multimedia teaching method and teaching system
CN114547350A (en) Information processing method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant