CN111507220A - Method and device for determining and feeding back user information in live broadcast teaching - Google Patents
Method and device for determining and feeding back user information in live broadcast teaching Download PDFInfo
- Publication number
- CN111507220A CN111507220A CN202010271314.0A CN202010271314A CN111507220A CN 111507220 A CN111507220 A CN 111507220A CN 202010271314 A CN202010271314 A CN 202010271314A CN 111507220 A CN111507220 A CN 111507220A
- Authority
- CN
- China
- Prior art keywords
- user
- information
- determining
- camera
- teacher
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/14—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Abstract
The embodiment of the application discloses a method and a device for determining and feeding back user information in live broadcasting teaching. According to the technical scheme, the user picture data and the questions to be fed back are obtained through the collection and the processing of the double cameras, the user picture data and the questions to be fed back are sent to the teacher end, the feedback information generated by the teacher end according to the user picture data and the questions to be fed back is received, the communication interaction between students and the teacher is achieved, the real-time tutoring of homework and difficult problems is achieved while the learning state of the students is supervised, and the live broadcast learning effect is further improved.
Description
Technical Field
The embodiment of the application relates to the technical field of electronic equipment, in particular to a method and a device for determining and feeding back user information in live broadcast teaching.
Background
In current live broadcasting teaching, acquire mr's real-time picture and send mr's real-time picture to high in the clouds server through the teacher end, the high in the clouds server sends received mr's real-time picture to each student end so that all students can all watch mr's live broadcast picture again, and then realize live broadcasting teaching.
The existing live broadcast scheme is generally one-way communication, a teacher continuously outputs information to each student end to complete a teaching task, and if the students feed back problems, the students can only feed back the problems by means of message boards and the like. Under the condition, the teacher can not know the learning state of the students under the live broadcast teaching in real time, and can not realize effective and timely information communication and communication, so that the communication efficiency between the teacher and the students is greatly reduced, and the live broadcast teaching effect is reduced.
Disclosure of Invention
The embodiment of the application provides a method and a device for determining and feeding back user information in live broadcast teaching, electronic equipment and a storage medium, which can enable a teacher end to receive user picture data and desktop picture data of students in real time, and provide feedback information to a student end according to the user picture data and the desktop picture data, so that the communication efficiency between teachers and students is greatly improved.
In a first aspect, an embodiment of the present application provides a method for determining and feeding back user information in live broadcast teaching, including:
receiving user picture data collected by a first camera;
receiving desktop picture data collected by a second camera, and determining a question to be fed back pointed by a user according to the desktop picture data;
sending the user picture data and the questions to be fed back to a teacher end for the teacher end to generate feedback information, wherein the feedback information comprises user prompt information and/or question analysis information;
and receiving and displaying feedback information sent by the teacher end.
Further, determining a topic to be fed back, which is pointed out by the user, according to the desktop image data, includes:
carrying out image recognition on the desktop picture data, and determining the hand position of a user;
determining a frame selection area according to the hand position of a user;
and carrying out optical character recognition on the frame selection area to determine the question to be fed back.
Further, the teacher generates feedback information, including:
and the teacher end generates question analysis information according to the detected screen information input data.
Further, the teacher generates feedback information, including:
the teacher end receives the teacher voice data and generates user prompt information according to the teacher voice data; or the teacher end receives the screen click command and generates user prompt information according to the screen click command.
Further, the user picture data includes a user head picture, and before receiving the desktop picture data collected by the second camera, the method further includes:
and determining whether the user meets the preset action according to the head picture of the user, if so, controlling to start the second camera for data acquisition, and if not, controlling the second camera to be in a standby state.
Further, determining whether the user satisfies a preset action according to the user head picture includes:
comparing the user head picture with a preset action model to determine whether the user meets the preset action; or the like, or, alternatively,
determining the inclination angle of the head of the user according to the head picture of the user, and determining whether the user meets a preset action or not according to the inclination angle; or the like, or, alternatively,
and determining the sight orientation of the user according to the head picture of the user, and determining whether the user meets the preset action or not according to the sight orientation.
Further, first camera and second camera set up in electronic equipment with different shooting angles, before receiving the user's picture data that first camera gathered, still include:
when the fact that the course tutoring module is triggered is detected, controlling to start the first camera and the second camera;
and searching and displaying the corresponding course live broadcast content according to the received course content operation instruction.
In a second aspect, an embodiment of the present application provides an apparatus for determining and feeding back user information in live broadcast teaching, including:
a first receiving module: the first camera is used for acquiring user picture data;
a second receiving module: the device comprises a first camera, a second camera, a display screen and a display screen, wherein the first camera is used for acquiring desktop picture data;
a feedback module: the system comprises a teacher end and a user interface, wherein the teacher end is used for sending user picture data and questions to be fed back to the teacher end and generating feedback information by the teacher end, and the feedback information comprises user prompt information and/or question analysis information;
a display module: and the system is used for receiving and displaying the feedback information sent by the teacher end.
In a third aspect, an embodiment of the present application provides an electronic device, including:
a memory and one or more processors;
a memory for storing one or more programs;
when executed by one or more processors, cause the one or more processors to implement a method for user information determination and feedback in live education as described in the first aspect.
In a fourth aspect, embodiments of the present application provide a storage medium containing computer-executable instructions for performing a method of user information determination and feedback in live education as in the first aspect when executed by a computer processor.
According to the embodiment of the application, the user picture data and the questions to be fed back are obtained through the collection and the processing of the double cameras, the user picture data and the questions to be fed back are sent to the teacher end, the feedback information generated by the teacher end according to the user picture data and the questions to be fed back is received, the communication interaction between students and teachers is achieved, the real-time tutoring of homework and difficult problems is achieved while the learning state of the students is supervised, and the live broadcast learning effect is further improved.
Drawings
Fig. 1 is a flowchart of a method for determining and feeding back user information in live broadcast teaching according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a display of user screen data provided in an embodiment of the present application;
FIG. 3 is a schematic view of head tilt provided by embodiments of the present application;
FIG. 4 is a schematic view of a line of sight tilt provided by an embodiment of the present application;
FIG. 5 is a schematic diagram illustrating a display of desktop screen data according to an embodiment of the present disclosure;
FIG. 6 is a flowchart for determining a topic to be fed back, which is pointed out by a user, according to desktop screen data according to an embodiment of the present application;
FIG. 7 is a schematic diagram of determining a frame selection area according to a hand position of a user according to an embodiment of the present application;
FIG. 8 is a schematic diagram of a display interface at a teacher end provided by an embodiment of the present application;
fig. 9 is a flowchart of turning on a camera according to an embodiment of the present disclosure;
fig. 10 is a schematic structural diagram of an apparatus for determining and feeding back user information in live teaching provided in an embodiment of the present application;
fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, specific embodiments of the present application will be described in detail with reference to the accompanying drawings. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some but not all of the relevant portions of the present application are shown in the drawings. Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the operations (or steps) as a sequential process, many of the operations can be performed in parallel, concurrently or simultaneously. In addition, the order of the operations may be re-arranged. A process may be terminated when its operations are completed, but may have additional steps not included in the figure. A process may correspond to a method, a function, a procedure, a subroutine, a subprogram, etc.
The method for determining and feeding back the user information in live broadcasting teaching enables a user to know the face and action of the user and capture the operation of a student on a desktop through a finger or a pen through another camera while the user can know the face and action of the user, and sends collected and processed information to a teacher end to enable the teacher end to feed back the information. The communication efficiency of the teacher end and the student end is greatly improved, and the live broadcast effect is improved. In order to perform communication interaction between the teacher end and the student end, most of the current methods provide a bullet screen or leave a message through a message board, and the method has no way of real-time monitoring and communication; in most cases, a teacher is required to collect information popped up by students on a message board or a bullet screen after class and then explain the information in the next class; to some extent, the pressure of the teacher end is increased, and the student can not answer the doubtful questions of the student at the first time because the student needs to collect data after class, so that the student is not beneficial to live teaching effect. In a common live broadcast, students can see teachers, but the teachers have no way to directly observe the performance of the students in the live broadcast; even if the student is not concentrated, the teacher has no way to remind timely. Based on this, the method for determining and feeding back the user information in the live broadcast teaching provided by the embodiment of the application is provided, so that the problem of real-time communication and interaction between students and teachers in the live broadcast teaching process is solved, and the live broadcast teaching effect is improved.
Fig. 1 is a flowchart of a method for determining and feeding back user information in live broadcast teaching according to an embodiment of the present application, where the method for determining and feeding back user information in live broadcast teaching provided in this embodiment may be executed by a device for determining and feeding back user information in live broadcast teaching, the device for determining and feeding back user information in live broadcast teaching may be implemented in a software and/or hardware manner, and the device for determining and feeding back user information in live broadcast teaching may be formed by two or more physical entities or may be formed by one physical entity. Generally speaking, the device for determining and feeding back the user information in the live teaching can be a computer, a mobile phone, a tablet and the like.
The following description will be given by taking a tablet as an example of a device for executing a method for determining and feeding back user information in live broadcasting teaching. Referring to fig. 1, the method for determining and feeding back user information in live broadcast teaching specifically includes:
s101: and receiving user picture data acquired by the first camera.
The method for determining and feeding back the user information in the live broadcast teaching is mainly used for determining and feeding back the user information in the live broadcast teaching, the device is a tablet of a student, user picture data are collected through a first camera arranged at the tablet, as shown in fig. 2, fig. 2 is a display schematic diagram of the user picture data provided by the embodiment of the application, and the user picture data comprise information such as facial expressions, sitting postures and head movements of the student; the teacher can observe the real-time lecture listening state of the student through the first camera. For example, in the course of live broadcast and lecture listening, if a relatively difficult subject is met, the students can have expression of frowning and thinking of frowning; when an irrational point appears, the student can have a doubtful expression; when meeting the scene, the teacher can adjust the content and rhythm of the lecture according to the situation. When the student is low all the time or the head is turned elsewhere all the time or the live broadcast picture is not watched, the student can know that the student does not listen to the class seriously, and a teacher is required to remind the corresponding student to listen to the class seriously. Through the picture information of the students of real-time acquisition, the real-time trends of the students in the live lecture process can be known, and then real-time interactive reminding is carried out on the students.
Further, whether the user meets preset actions or not is determined according to the head picture of the user, if yes, the second camera is controlled to be started for data acquisition, and if not, the second camera is controlled to be in a standby state. Because if two cameras are in the on state all the time, then can improve the power consumption of equipment to because the second camera can carry out corresponding gesture recognition, then can produce certain amount of information misdelivery. For example, in the course of listening to a lesson, a student points at a textbook on a desktop only to facilitate the self-positioning of information and then reading, but not to ask a question for a question; if at this moment, the action is identified as the fact that the student has a question, and the content displayed corresponding to the textbook is identified, a large amount of invalid content can be uploaded, so that the uploading time is increased on one hand, the content needing to be processed by the teacher is increased on the other hand, the information processing pressure of the teacher is increased, and further the interaction efficiency is reduced. Therefore, in the embodiment, whether the corresponding desktop image data really needs to be acquired is judged by identifying the specific action, and when the judgment is yes, the second camera is controlled to be started for data acquisition, so that the power consumption is reduced, and the accuracy of data acquisition is improved.
Fig. 3 is a schematic view of head tilt provided by an embodiment of the present application, and fig. 4 is a schematic view of line of sight tilt provided by an embodiment of the present application. Illustratively, determining whether the user satisfies the preset action according to the user head picture includes: comparing the user head picture with a preset action model to determine whether the user meets the preset action; or, as shown in fig. 4, determining an inclination angle of the head of the user according to the user head picture, and determining whether the user meets a preset action according to the inclination angle; or, as shown in fig. 5, the gaze direction of the user is determined according to the head picture of the user, and whether the user meets the preset action is determined according to the gaze direction. The specific embodiment mode of the action is that the student looks at the desktop in a head-down mode or eyes look at the desktop, when the action is identified, the probability that the student is in doubt is greatly increased, and at the moment, the second camera can be controlled to be started to acquire desktop picture data. In addition to the above-mentioned motion recognition, it can also be combined with time or other motions to improve recognition accuracy, for example, when the student is down and the duration exceeds 3 seconds, it can clearly indicate that the student has a question; or when the students have frown and deep thinking, the students look at the desktop; finally, the fingers are pointed to a specific subject, when the combination of the multiple characteristics is identified according to the sequence, the student can definitely know that a question is asked by the student at the moment and hopes to be solved by a teacher; at the moment, the second camera is controlled to be started and the recognized information is transmitted to the teacher end.
S102: receiving desktop picture data collected by the second camera, and determining a question to be fed back pointed by a user according to the desktop picture data.
Fig. 5 is a schematic display diagram of desktop image data provided in an embodiment of the present application, where in this step, in order to obtain specific desktop image information, as shown in fig. 5, specifically, topic information indicated by a student, a topic to be fed back may be transmitted to a teacher end in various forms, where the topic may be part of directly captured picture information, or may be text information, or even may be voice information, and the like; in this embodiment, it is preferable to describe a manner of transmitting text information.
Fig. 6 is a flowchart for determining a topic to be fed back, which is pointed out by a user, according to desktop screen data according to an embodiment of the present application, specifically as shown in fig. 6, including:
s1021: and carrying out image recognition on the desktop picture data to determine the hand position of the user.
S1022: and determining a frame selection area according to the hand position of the user.
In one embodiment, a hand model is constructed in advance, the hand position of a user is found through the hand model and desktop picture data, and after the hand position of the user is identified, an area pointed by a finger of the user is determined, wherein the area is a framing area, illustratively, a rectangular frame framing area with a preset size is determined as the framing area by taking the position of the finger as a reference point, the framing area is also a query area of the user, and the size of the rectangular frame can be 2cm to 10 cm; as shown in fig. 7, fig. 7 is a schematic diagram of determining a frame selection area according to a hand position of a user according to an embodiment of the present application, where a matrix frame displayed in the diagram is the determined frame selection area, that is, a query area of the user.
S1023: and carrying out optical character recognition on the frame selection area to determine the question to be fed back.
One reason for adopting optical character recognition is that when the graphic is distorted, operations such as binarization, noise removal, inclination correction and the like can be performed on the graphic through an OCR technology to correct the deviation, so that the accuracy of the finally recognized title information is improved. And identifying the content of the frame selection area in an optical character identification mode to obtain a corresponding topic to be fed back, wherein the topic to be fed back can be the text content corresponding to the whole topic, the serial number of the topic and the like.
In addition to the above information identification method, another identification method exists, in which a corresponding subject is found by positioning a finger at a position corresponding to a page and comparing the finger with pre-stored textbook information. Specifically, the database needs to store corresponding textbook information, and the textbook information includes textbook pages and textbook page numbers. When the identification is performed, the page number is found by identifying the corresponding page, as shown in fig. 7, the page number of the page is known to be 53 through image identification, and the relative position of the finger on the textbook is identified at the same time; then, the relative position and the page number information are compared with the prestored textbook information, so that the corresponding question can be found, and then the found question is sent to a teacher end.
S103: and sending the user picture data and the questions to be fed back to the teacher end for the teacher end to generate feedback information, wherein the feedback information comprises user prompting information and/or question analysis information.
Fig. 8 is a schematic diagram of a display interface at a teacher end provided in an embodiment of the present application, where information transmitted in this step mainly includes two aspects: the first is the state information of the student; secondly, subject information pointed out by students; the teacher will also feed back different content for different information. As shown in fig. 8, the status information of more than one student and the pointed subject information displayed on the teacher's side may be displayed as well as the status information of a plurality of students and the pointed subject information; when the information of a plurality of students need to be shown, the corresponding display frames need to be numbered or named so that the teacher can conveniently correspond the problems to the students.
Illustratively, the way of generating the feedback information at the teacher end includes:
the teacher end receives the teacher voice data and generates user prompt information according to the teacher voice data; or the teacher end receives the screen click command and generates user prompt information according to the screen click command. The feedback is to remind the specific student user to pay attention to class and listen to the talk seriously through voice or instruction. For example, when the first schooling does not pay attention to the content of the classroom, the teacher end receives the teacher's ' first schooling ' and asks to listen carefully. The voice information is sent to the flat end of the classmates to remind the classmates. The corresponding reminding button can be arranged at the teacher end, when classmates do not listen to the speech seriously, the teacher can send reminding information to the corresponding classmates flat plate by directly pressing the reminding button, and the reminding operation can be window vibration or voice reminding.
In addition to the above feedback information generation, there is also an automatic feedback information generation method; because in the live broadcast process, if the teacher directly carries out voice reminding, a problem exists that other students are influenced to live broadcast and listen to and talk. Therefore, in the embodiment, the user is reminded to listen to the lecture by setting the automatic generation feedback information, and when the user is identified to stay in class, the reminding information is sent to the corresponding student end, so that the course of lecturing by the teacher is influenced, and other students are not disturbed.
The feedback information is information collected by the first camera, and the teacher end generates corresponding feedback information for information collected by the second camera in addition to the information collected by the first camera. Illustratively, the teacher generates feedback information, including:
and the teacher end generates question analysis information according to the detected screen information input data. That is, after the student titles are identified, the teacher can explain in a direct voice way or in the way of inputting information through the screen; when the mode of adopting information entry to explain, can send the analytic information of mr input that detects to corresponding student's end to make the student can receive relevant analytic information.
S104: and receiving and displaying feedback information sent by the teacher end.
In this step, all the received feedback information is displayed, for example, the content parsed by the teacher is directly displayed on the tablet of the user so that the user can know the relevant parsing answer. It should be noted that, in addition to the interactive mode of displaying the feedback information, a voice broadcast mode may be adopted to perform interaction of the feedback information, for example, a question analysis voice of a teacher is played.
In the solution of this embodiment, the first camera and the second camera may be separately disposed, or disposed in the electronic device at different shooting angles, because the two cameras need to obtain different image information, the shooting angles need to be different, otherwise, the same image information is captured, and the expected effect cannot be generated.
Fig. 9 is a flowchart of turning on a camera according to an embodiment of the present application, and as shown in fig. 9, before step S101, the method further includes:
s101 a: when detecting that course tutoring module is triggered, control is opened first camera and second camera.
S101 b: and searching and displaying the corresponding course live broadcast content according to the received course content operation instruction. The content aims at the operation before the first camera and the second camera are started, when a user does not conduct course guidance, the two cameras are both in a closed state or a state without opening authority, and after the user clicks to enter a course guidance module, double shooting authority is started, so that the two cameras can work; and corresponding live broadcast content is delivered to the tablet end of the student.
The scheme of this application is through leading two applications of taking photograph in the flat board, to live operation tutor scene: through the first camera, a teacher can see the real-time state of students listening to a class, supervise the learning state of children and interact with the students; the second camera captures the desktop picture, so that real-time guidance of operation and difficult problems can be realized. Through the different applications of two shots, the learning effect is improved.
According to the embodiment of the application, the user picture data and the questions to be fed back are obtained through the collection and the processing of the double cameras, the user picture data and the questions to be fed back are sent to the teacher end, the feedback information generated by the teacher end according to the user picture data and the questions to be fed back is received, the communication interaction between students and teachers is achieved, the real-time tutoring of homework and difficult problems is achieved while the learning state of the students is supervised, and the live broadcast learning effect is further improved.
On the basis of the foregoing embodiment, fig. 10 is a schematic structural diagram of a device for determining and feeding back user information in live broadcast teaching according to an embodiment of the present application. Referring to fig. 10, the apparatus for determining and feeding back user information in live broadcast teaching provided in this embodiment specifically includes:
the first receiving module 21: the first camera is used for acquiring user picture data;
the second receiving module 22: the device comprises a first camera, a second camera, a display screen and a display screen, wherein the first camera is used for acquiring desktop picture data;
the feedback module 23: the system comprises a teacher end and a user interface, wherein the teacher end is used for sending user picture data and questions to be fed back to the teacher end and generating feedback information by the teacher end, and the feedback information comprises user prompt information and/or question analysis information;
the display module 24: and the system is used for receiving and displaying the feedback information sent by the teacher end.
By the aid of the method, the user picture data and the questions to be fed back are acquired and processed through the double cameras, the user picture data and the questions to be fed back are sent to the teacher end, feedback information generated by the teacher end according to the user picture data and the questions to be fed back is received, communication interaction between students and a teacher is achieved, real-time tutoring of homework and difficult problems is achieved while the learning state of the students is supervised, and live broadcast learning effect is further improved.
Specifically, determining a topic to be fed back pointed out by a user according to desktop picture data includes:
an image recognition module: carrying out image recognition on the desktop picture data, and determining the hand position of a user;
a frame selection module: determining a frame selection area according to the hand position of a user;
a character recognition module: and carrying out optical character recognition on the frame selection area to determine the question to be fed back.
Specifically, the user picture data includes a user head picture, and before receiving the desktop picture data collected by the second camera, the method further includes:
a judging module: and the second camera is controlled to be in a standby state if the second camera is not started.
Specifically, first camera and second camera set up in electronic equipment with different shooting angles, before receiving the user's picture data that first camera gathered, still include:
a triggering module: the device comprises a course tutoring module, a first camera, a second camera and a display module, wherein the course tutoring module is used for controlling the first camera and the second camera to be started when the course tutoring module is triggered;
a searching module: and the system is used for searching and displaying the corresponding course live broadcast content according to the received course content operation instruction.
The device for determining and feeding back the user information in the live broadcast teaching provided by the embodiment of the application can be used for executing the method for determining and feeding back the user information in the live broadcast teaching provided by the embodiment, and has corresponding functions and beneficial effects.
An embodiment of the present application provides an electronic device, and referring to fig. 11, fig. 11 is a schematic structural diagram of an electronic device provided in an embodiment of the present application, where the electronic device includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The number of processors 31 in the electronic device may be one or more, and the number of memories 32 in the electronic device may be one or more. The processor 31, the memory 32, the communication module 33, the input device 34 and the output device 35 of the electronic apparatus may be connected by a bus or other means.
The memory 32 serves as a computer-readable storage medium for storing software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to a method for determining and feeding back user information in live education according to any embodiment of the present application (e.g., a first receiving module, a second receiving module, a feedback module, and a display module in a device for determining and feeding back user information in live education). The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the device, and the like. Further, the memory 32 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state memory 32 device. In some examples, the memory 32 may further include memory 32 located remotely from the processor 31, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The communication module 33 is used for data transmission.
The processor 31 executes various functional applications and data processing of the device by running software programs, instructions and modules stored in the memory 32, that is, the method for determining and feeding back user information in live teaching is implemented.
The input device 34 may be used to receive entered numeric or character information and to generate key signal inputs relating to user settings and function controls of the apparatus. The output device 35 may include a display device such as a display screen.
The electronic equipment can be used for executing the method for determining and feeding back the user information in the live broadcast teaching provided by the embodiment, and has corresponding functions and beneficial effects.
Embodiments of the present application further provide a storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method for user information determination and feedback in live broadcasting teaching, where the method for user information determination and feedback in live broadcasting teaching includes: receiving user picture data collected by a first camera; receiving desktop picture data collected by a second camera, and determining a question to be fed back pointed by a user according to the desktop picture data; sending the user picture data and the questions to be fed back to a teacher end for the teacher end to generate feedback information, wherein the feedback information comprises user prompt information and/or question analysis information; and receiving and displaying feedback information sent by the teacher end.
Storage medium-any of various types of memory devices or storage devices. The term "storage medium" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The storage medium may also include other types of memory or combinations thereof. In addition, the storage medium may be located in a first computer system in which the program is executed, or may be located in a different second computer system connected to the first computer system through a network (such as the internet). The second computer system may provide program instructions to the first computer for execution. The term "storage medium" may include two or more storage media residing in different locations, e.g., in different computer systems connected by a network. The storage medium may store program instructions (e.g., embodied as a computer program) that are executable by one or more processors.
Of course, the storage medium containing computer-executable instructions provided in this embodiment of the present application is not limited to the above method for determining and feeding back user information in live broadcast teaching, and may also perform related operations in a method for determining and feeding back user information in live broadcast teaching provided in any embodiment of the present application.
The device, the storage medium, and the electronic device for determining and feeding back the user information in the live broadcast teaching provided in the foregoing embodiments may execute the method for determining and feeding back the user information in the live broadcast teaching provided in any embodiments of the present application, and reference may be made to the method for determining and feeding back the user information in the live broadcast teaching provided in any embodiments of the present application without detailed technical details in the foregoing embodiments.
The foregoing is considered as illustrative of the preferred embodiments of the invention and the technical principles employed. The present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the claims.
Claims (10)
1. A method for determining and feeding back user information in live broadcast teaching is characterized by comprising the following steps:
receiving user picture data collected by a first camera;
receiving desktop picture data collected by a second camera, and determining a question to be fed back pointed by a user according to the desktop picture data;
sending the user picture data and the question to be fed back to a teacher end, wherein the teacher end is used for generating feedback information, and the feedback information comprises user prompting information and/or question analysis information;
and receiving and displaying the feedback information sent by the teacher end.
2. The method for determining and feeding back the user information in the live broadcasting teaching according to claim 1, wherein the determining the topic to be fed back pointed by the user according to the desktop image data comprises:
carrying out image recognition on the desktop picture data, and determining the hand position of a user;
determining a frame selection area according to the hand position of the user;
and carrying out optical character recognition on the frame selection area to determine a question to be fed back.
3. The method for user information determination and feedback in live teaching of claim 2, wherein the generating of the feedback information by the teacher comprises:
and the teacher end inputs data according to the detected screen information to generate question analysis information.
4. The method for user information determination and feedback in live teaching of claim 1, wherein the generating of the feedback information by the teacher comprises:
the teacher end receives teacher voice data and generates user prompt information according to the teacher voice data; or the teacher end receives a screen click instruction and generates user prompt information according to the screen click instruction.
5. The method for determining and feeding back user information in live teaching according to any one of claims 1-4, wherein the user picture data includes a user head picture, and before receiving desktop picture data collected by the second camera, the method further comprises:
and determining whether the user meets preset actions according to the user head picture, if so, controlling to start a second camera for data acquisition, and if not, controlling the second camera to be in a standby state.
6. The method for determining and feeding back user information in live teaching according to claim 5, wherein determining whether a user satisfies a preset action according to the user head picture comprises:
comparing the user head picture with a preset action model to determine whether the user meets a preset action; or the like, or, alternatively,
determining the inclination angle of the head of the user according to the user head picture, and determining whether the user meets a preset action or not according to the inclination angle; or the like, or, alternatively,
and determining the sight orientation of the user according to the head picture of the user, and determining whether the user meets a preset action according to the sight orientation.
7. The method for determining and feeding back user information in live teaching according to any one of claims 1 to 4, wherein the first camera and the second camera are disposed in the electronic device at different shooting angles, and before receiving the user picture data collected by the first camera, the method further comprises:
when the fact that the course tutoring module is triggered is detected, controlling to start the first camera and the second camera;
and searching and displaying the corresponding course live broadcast content according to the received course content operation instruction.
8. An apparatus for determining and feeding back user information in live broadcasting teaching, comprising:
a first receiving module: the first camera is used for acquiring user picture data;
a second receiving module: the device comprises a first camera, a second camera, a display screen and a display screen, wherein the first camera is used for acquiring desktop picture data;
a feedback module: the system comprises a user screen data acquisition unit, a teacher end and a question analysis unit, wherein the user screen data acquisition unit is used for acquiring user screen data and a question to be fed back;
a display module: and the system is used for receiving and displaying the feedback information sent by the teacher end.
9. An electronic device, comprising:
a memory and one or more processors;
the memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a method for user information determination and feedback in live education as recited in any one of claims 1-7.
10. A storage medium containing computer-executable instructions, which when executed by a computer processor, perform a method of user information determination and feedback in live education as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010271314.0A CN111507220A (en) | 2020-04-08 | 2020-04-08 | Method and device for determining and feeding back user information in live broadcast teaching |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010271314.0A CN111507220A (en) | 2020-04-08 | 2020-04-08 | Method and device for determining and feeding back user information in live broadcast teaching |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111507220A true CN111507220A (en) | 2020-08-07 |
Family
ID=71874193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010271314.0A Pending CN111507220A (en) | 2020-04-08 | 2020-04-08 | Method and device for determining and feeding back user information in live broadcast teaching |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111507220A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112329629A (en) * | 2020-11-05 | 2021-02-05 | 平安科技（深圳）有限公司 | Evaluation method and device for online training, computer equipment and storage medium |
| CN112528799A (en) * | 2020-12-02 | 2021-03-19 | 广州宏途教育网络科技有限公司 | Teaching live broadcast method and device, computer equipment and storage medium |
| CN112616060A (en) * | 2020-11-20 | 2021-04-06 | 深圳点猫科技有限公司 | Interactive method, device, system and medium for answering questions in online lessons |
| CN112672171A (en) * | 2020-11-21 | 2021-04-16 | 薄涛 | But tall and erect box of ann that a plurality of cameras of external carry out live tutor of homework |
| CN113507616A (en) * | 2021-05-26 | 2021-10-15 | 深圳点猫科技有限公司 | Online classroom patrol interaction control method, device, system and medium |
| CN114727127A (en) * | 2022-05-13 | 2022-07-08 | 北京聚云数字信息技术有限公司 | Live broadcast data processing method and system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104348858A (en) * | 2013-07-30 | 2015-02-11 | 上海好记星数码科技有限公司 | Method for uploading questions to be answered based on mobile intelligent electronic device |
| CN105361429A (en) * | 2015-11-30 | 2016-03-02 | 华南理工大学 | Intelligent studying platform based on multimodal interaction and interaction method of intelligent studying platform |
| CN106228982A (en) * | 2016-07-27 | 2016-12-14 | 华南理工大学 | A kind of interactive learning system based on education services robot and exchange method |
| CN108735022A (en) * | 2018-05-24 | 2018-11-02 | 西安恒坐标教育科技集团有限公司 | A kind of outdoor scene teaching platform |
| CN109376737A (en) * | 2018-09-27 | 2019-02-22 | 广东小天才科技有限公司 | A kind of method and system for assisting user to solve problem concerning study |
-
2020
- 2020-04-08 CN CN202010271314.0A patent/CN111507220A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104348858A (en) * | 2013-07-30 | 2015-02-11 | 上海好记星数码科技有限公司 | Method for uploading questions to be answered based on mobile intelligent electronic device |
| CN105361429A (en) * | 2015-11-30 | 2016-03-02 | 华南理工大学 | Intelligent studying platform based on multimodal interaction and interaction method of intelligent studying platform |
| CN106228982A (en) * | 2016-07-27 | 2016-12-14 | 华南理工大学 | A kind of interactive learning system based on education services robot and exchange method |
| CN108735022A (en) * | 2018-05-24 | 2018-11-02 | 西安恒坐标教育科技集团有限公司 | A kind of outdoor scene teaching platform |
| CN109376737A (en) * | 2018-09-27 | 2019-02-22 | 广东小天才科技有限公司 | A kind of method and system for assisting user to solve problem concerning study |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112329629A (en) * | 2020-11-05 | 2021-02-05 | 平安科技（深圳）有限公司 | Evaluation method and device for online training, computer equipment and storage medium |
| CN112329629B (en) * | 2020-11-05 | 2023-11-14 | 平安科技（深圳）有限公司 | Evaluation method and device for online training, computer equipment and storage medium |
| CN112616060A (en) * | 2020-11-20 | 2021-04-06 | 深圳点猫科技有限公司 | Interactive method, device, system and medium for answering questions in online lessons |
| CN112672171A (en) * | 2020-11-21 | 2021-04-16 | 薄涛 | But tall and erect box of ann that a plurality of cameras of external carry out live tutor of homework |
| CN112528799A (en) * | 2020-12-02 | 2021-03-19 | 广州宏途教育网络科技有限公司 | Teaching live broadcast method and device, computer equipment and storage medium |
| CN113507616A (en) * | 2021-05-26 | 2021-10-15 | 深圳点猫科技有限公司 | Online classroom patrol interaction control method, device, system and medium |
| CN114727127A (en) * | 2022-05-13 | 2022-07-08 | 北京聚云数字信息技术有限公司 | Live broadcast data processing method and system |
| CN114727127B (en) * | 2022-05-13 | 2022-08-09 | 北京聚云数字信息技术有限公司 | Live broadcast data processing method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111507220A (en) | Method and device for determining and feeding back user information in live broadcast teaching | |
| US11151892B2 (en) | Internet teaching platform-based following teaching system | |
| CN107316520B (en) | Video teaching interaction method, device, equipment and storage medium | |
| US20190340944A1 (en) | Multimedia Interactive Teaching System and Method | |
| CN209980508U (en) | Wisdom blackboard, and wisdom classroom's teaching system | |
| KR100466709B1 (en) | learning system | |
| CN111796752B (en) | Interactive teaching system based on PC | |
| CN109147444B (en) | Learning condition feedback method and intelligent desk lamp | |
| CN109727167B (en) | Teaching auxiliary system | |
| CN107492154B (en) | Class attendance system and working method thereof | |
| CN108735022A (en) | A kind of outdoor scene teaching platform | |
| CN112652200A (en) | Man-machine interaction system, man-machine interaction method, server, interaction control device and storage medium | |
| CN107103802A (en) | Real-time human eye discrimination system and method based on online education | |
| CN112085630B (en) | Intelligent adaptive operation system suitable for OMO learning scene | |
| US20210225185A1 (en) | Method and apparatus for determining key learning content, device and storage medium | |
| CN111506381A (en) | Method and device for assisting user in information input in live broadcast teaching | |
| US20190164444A1 (en) | Assessing a level of comprehension of a virtual lecture | |
| CN111402096A (en) | Online teaching quality management method, system, equipment and medium | |
| CN111836106A (en) | Online video playing monitoring processing method and device, computer and storage medium | |
| CN111931608A (en) | Operation management method and system based on student posture and student face recognition | |
| US20220208016A1 (en) | Live lecture augmentation with an augmented reality overlay | |
| CN114489331A (en) | Method, apparatus, device and medium for interaction of separated gestures distinguished from button clicks | |
| CN112367526B (en) | Video generation method and device, electronic equipment and storage medium | |
| CN111464875B (en) | Method and device for feeding back user interaction information in live broadcast teaching | |
| CN111417026A (en) | Online learning method and device based on writing content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |