WO2019033663A1 - Video teaching interaction method and apparatus, device, and storage medium - Google Patents

Video teaching interaction method and apparatus, device, and storage medium Download PDF

Info

Publication number
WO2019033663A1
WO2019033663A1 PCT/CN2017/116770 CN2017116770W WO2019033663A1 WO 2019033663 A1 WO2019033663 A1 WO 2019033663A1 CN 2017116770 W CN2017116770 W CN 2017116770W WO 2019033663 A1 WO2019033663 A1 WO 2019033663A1
Authority
WO
WIPO (PCT)
Prior art keywords
teaching
client
interaction
data
video
Prior art date
Application number
PCT/CN2017/116770
Other languages
French (fr)
Chinese (zh)
Inventor
胡杰
胡婵
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019033663A1 publication Critical patent/WO2019033663A1/en

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/08Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
    • G09B5/14Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations with provision for individual teacher-student communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Definitions

  • the present invention relates to the field of multimedia technologies, and in particular, to a video teaching interaction method, device, device and storage medium.
  • the lecture video is usually recorded in advance by the lecturer. At least one student can learn by playing the instructional video. If the student has doubts during the learning process, the question can be answered by means of a message.
  • the lecturer can pass the login. Respond to the message in a way that interacts with the student. Or, the lecturer teaches online, and at least one student who establishes a video connection learns online. If the student has doubts during the course, then they need to wait until the end of the course to interact with the instructor online. No matter which kind of scheme mentioned above, it is impossible to realize the interaction between the lecturer and the student in the process of video teaching, which reduces the user experience.
  • the embodiments of the present invention provide a video teaching interaction method, device, device, and storage medium to solve the technical problem that the lecturer and the student cannot interact in the process of video teaching.
  • an embodiment of the present invention provides a video teaching interaction method, including:
  • At least one teaching client that triggers the teaching interaction mechanism is selected and interacts with the selected teaching client.
  • an embodiment of the present invention provides a video teaching interaction method, including:
  • the embodiment of the present invention further provides a video teaching interaction device, including:
  • a first obtaining module configured to acquire teaching interaction data sent by at least one teaching client during a video teaching process
  • a trigger detection module configured to detect, according to the teaching interaction data, whether a teaching interaction mechanism is triggered
  • the interaction execution module is configured to, if yes, select at least one teaching client that triggers the teaching interaction mechanism, and implement interaction with the selected teaching client.
  • the embodiment of the present invention further provides a video teaching interaction device, including:
  • a second obtaining module configured to acquire teaching interaction data during a video teaching process
  • the data sending module is configured to send the teaching interaction data to the main client, so that the main client determines whether to implement interaction with the teaching client according to the teaching interaction data.
  • an embodiment of the present invention further provides an apparatus, including:
  • One or more processors are One or more processors;
  • a memory for storing one or more programs
  • the one or more programs are executed by the one or more processors, such that the one or more The processor implements the video teaching interaction method as described in the first aspect.
  • an embodiment of the present invention further provides an apparatus, including:
  • One or more processors are One or more processors;
  • a memory for storing one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the video teaching interaction method as described in the second aspect.
  • the embodiment of the present invention further provides a storage medium comprising computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method according to the first aspect.
  • the embodiment of the present invention further provides a storage medium comprising computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method according to the second aspect.
  • the video teaching interaction method, device, device and storage medium provided above determine whether the teaching interaction mechanism is triggered according to the teaching interaction data sent by at least one teaching client in the video teaching process, and if triggered, determining to trigger the teaching interaction At least one teaching client of the mechanism, and realizes the technical solution of interacting with the determined teaching client, realizes the interaction between the lecturer and the student in the video teaching process, makes the video teaching process closer to the face-to-face teaching process, and improves the user experience. .
  • FIG. 1a is a flowchart of a video teaching interaction method according to Embodiment 1 of the present invention.
  • Figure 1b is a schematic diagram of a first display screen of the lecturer client
  • FIG. 2a is a flowchart of a video teaching interaction method according to Embodiment 2 of the present invention.
  • FIG. 2b is a flowchart of a detection method according to Embodiment 2 of the present invention.
  • 2c is a schematic diagram of a second display screen of the lecturer client
  • 2d is a schematic diagram of a third display screen of the lecturer client
  • 2e is a schematic diagram of a fourth display screen of the lecturer client
  • FIG. 3a is a flowchart of a video teaching interaction method according to Embodiment 3 of the present invention.
  • Figure 3b is a schematic diagram of a fifth display screen of the lecturer client
  • FIG. 4 is a flowchart of a video teaching interaction method according to Embodiment 4 of the present invention.
  • FIG. 5 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 5 of the present invention.
  • FIG. 6 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 6 of the present invention.
  • FIG. 7 is a schematic structural diagram of a device according to Embodiment 7 of the present invention.
  • FIG. 8 is a schematic structural diagram of a device according to Embodiment 8 of the present invention.
  • FIG. 1a is a flowchart of a video teaching interaction method according to Embodiment 1 of the present invention.
  • the video teaching interaction method provided by this embodiment may be implemented by a video teaching interaction device, which may be implemented by software and/or hardware, and integrated in a device capable of video teaching. among them,
  • the device includes at least one camera.
  • the device includes but is not limited to an interactive smart tablet, a smart phone, or the like.
  • the video teaching interaction method provided in this embodiment is applicable to an Internet-based video teaching scenario.
  • at least two video teaching software devices are configured with at least one video teaching software and connected via the Internet.
  • One of the devices is used by the instructor as the client client, and the rest of the device is used by the student as the teaching client.
  • the video teaching interaction method provided in this embodiment is executed in the main client.
  • the video teaching interaction method provided by this embodiment specifically includes:
  • S110 Obtain teaching interaction data sent by at least one teaching client in the video teaching process.
  • the video teaching process refers to that the at least one teaching client is connected to the main client, and the present client obtains the lecturer's lecture screen through at least one camera, and sends the lecture screen to at least one teaching client, so as to use the teaching.
  • the teaching interaction data is data acquired by the teaching client during the video teaching process, and the data may specifically include video data and/or text data.
  • the video data is data obtained by the teaching client by taking at least one camera to capture the student's listening picture
  • the text data is text data input by the student using the teaching client, or the voice data input by the student obtained by the teaching client, and is taught by the teaching client.
  • a teaching client can be used by at least one student.
  • the client speaks real-time video data in the display screen, wherein each sub-display area corresponds to video data of a teaching client, so that the lecturer can view the student's listening picture. At the same time, it also displays the lecturer's lecture screen obtained by itself.
  • FIG. 1b it is assumed that a total of five teaching clients and a client client perform video teaching, and then the main client's display screen displays the lecturer's lecture screen acquired by the camera itself, and is set on the basis of the current screen. Five sub-display areas are marked separately No. 1-5, used to display the lecture screen sent by five teaching clients.
  • the lecture client sends the lecture screen to the teaching client, it is preferred to send a display screen of the display screen, that is, the display screen of each teaching client is synchronized with the display screen of the client client.
  • the teaching interaction data is processed to determine whether the teaching interaction data includes an interaction request sent by the student, and if the interaction request sent by the student is included, the teaching interaction mechanism is triggered, otherwise, the confirmation teaching interaction mechanism is not triggered. .
  • the action track of the at least one target object in the video data may be detected, where the target object is a student.
  • the motion track of the target object is a preset interaction motion track
  • the preset interactive motion track can be set according to actual conditions.
  • the teaching interaction data is text data
  • whether the attribute information of the text data is detected includes an immediate interaction identifier, and if included, the text data is confirmed as interactive text data, that is, the target user is determined to issue an interaction request, and vice versa. Make sure the target object does not issue an interactive request.
  • the teaching interaction data that triggers the teaching interaction mechanism is determined, and the teaching client that sends the teaching interaction data is selected. Further, the interaction with the selected teaching client may be to initiate a voice call with the teaching client to enable voice communication with the student of the teaching client.
  • the sub-display area of the video data of the teaching client may be enlarged in the display screen, so that His teaching client clarifies the current interactive teaching client through the sub-display area.
  • the teaching interaction data is text data
  • the text display data related to the text data and the attribute information of the corresponding teaching client may be displayed to enable the instructor to explicitly interact with each other. Content and students who make interactive requests.
  • the teaching client that triggers the teaching interaction mechanism may be at least two. At this time, interaction with at least two teaching clients may be implemented at the same time, and one of at least two teaching clients may be selected according to a set rule.
  • the teaching client acts as an interactive teaching client.
  • the first triggered teaching client may be selected as the client that implements the interaction according to the triggering time sequence, or at least two teaching clients may be marked, and the instructor selects an interactive teaching client.
  • the technical solution provided by the embodiment determines whether the teaching interaction mechanism is triggered according to the teaching interaction data sent by the at least one teaching client in the video teaching process, and if triggered, determines at least one teaching client that triggers the teaching interaction mechanism. And realize the technical solution of interaction with the determined teaching client, realize the interaction between the lecturer and the student in the video teaching process, make the video teaching process closer to the face-to-face teaching process, and improve the user experience.
  • the teaching interaction data is video data.
  • the video teaching interaction method provided in this embodiment specifically includes:
  • the video data is a lecture picture taken by the teaching client through at least one camera, which is silent data.
  • Each sub-display area correspondingly displays video data sent by one teaching client.
  • the number of sub-display areas is determined according to the number of teaching clients.
  • the current area of each sub-display area is the same size, and the specific display position can be set according to actual conditions.
  • S230 Detect whether a display screen of the sub display area satisfies a preset display condition. If yes, execute S240; otherwise, return to execution S210.
  • the display screen of each sub-display area is subjected to recognition processing, and the video data corresponding to each sub-display area may be identified. That is, it may be displayed first and then processed, or it may be processed first and then displayed.
  • the specific means for the identification processing is not limited in this embodiment.
  • the motion track and/or facial expression data of the target object in the display screen may be determined.
  • the preset display condition can be set according to actual conditions.
  • the preset display condition is a preset interactive action track, refer to FIG. 2b, and the step specifically includes:
  • the display screen of each sub-display area is separately identified, and at least one target object in the display screen is confirmed, wherein the target object is a student. Further, the motion track of the target object is acquired.
  • the motion track of the target object may be a local motion track of the target object, such as an arm motion track. It can also be the overall motion trajectory of the target object, such as the motion trajectory when the body moves.
  • the preset interaction action track can be used according to the actual situation.
  • the preset interaction motion track may be a hand movement motion track and/or a standing motion track.
  • the action track and the preset interaction action The trajectory is compared. If the similarity between the motion trajectory and the preset interaction trajectory is higher than the set similar threshold, the motion trajectory may be confirmed as a preset interaction motion trajectory.
  • determining whether the motion track is a preset interaction motion track may also be determining whether the target object performs the motion posture after the motion track, and determining whether the motion posture is consistent with the posture after performing the preset interaction motion track. If they are consistent, confirm that the motion track of the target object is a preset interactive motion track. For example, the action trajectory of the target object is standing up, and the action gesture is standing. The posture after performing the preset interactive motion trajectory is also standing. Then, it can be confirmed that the motion track of the target object is a preset interactive motion track.
  • the motion trajectories of the plurality of target objects are respectively identified, and when the motion trajectory of at least one of the target objects is a preset interactive motion trajectory, the display screen is confirmed. Meet the preset display conditions.
  • a display screen that satisfies the preset display condition is determined, and the display screen is enlarged.
  • the enlarged display screen refers to a sub-display area of the enlarged display screen, and the specific enlargement rule is not limited in this embodiment.
  • the voice data of the corresponding teaching client can be played to implement interaction with the teaching client.
  • all display screens of all teaching client displays are synchronized with all display screens of the teacher client display.
  • Other non-interactive teaching client displays simultaneously play the voice data of the interactive client and the voice data of the teacher client.
  • the displaying the display screen that meets the preset display condition comprises: performing an interactive prompt, and when receiving the interactive instruction, zooming in the display screen that meets the preset display condition.
  • an interactive prompt is given to enable the instructor to explicitly issue an interactive request by the teaching client.
  • the specific form of the interactive prompt may be set according to actual conditions, for example, the border of the sub-display area that satisfies the display condition is bolded and/or discolored.
  • the lecturer issues an interactive instruction according to the interactive prompt, so that the lecturer client confirms the interaction according to the interactive instruction, and then enlarges the display screen that satisfies the preset display condition.
  • the lecturer can issue an interactive command by clicking a setting button, clicking a display screen that satisfies the preset display condition, or performing a set touch operation in the display screen.
  • the display screen that meets the preset display condition is at least two
  • the display screen that satisfies the preset display condition specifically includes the following:
  • Solution 1 Simultaneously enlarge at least two display screens that meet preset display conditions.
  • the sub-display areas of the at least two enlarged display screens have the same size.
  • the voice data is played, when the voice data of a teaching client is played, the corresponding display screen is highlighted, so that the lecturer and other students clarify the target object of the current speech.
  • the second scheme at least two display screens satisfying the preset display condition are marked, a selection instruction is received, and a display screen corresponding to the selection instruction is enlarged in at least two display screens that satisfy the preset display condition.
  • the mark form of the display screen can be set according to the actual situation. For example, the border of the corresponding sub-display area is highlighted, such as the border color of the sub-display area, the border thickness, and/or the blinking display border.
  • At least two display screens that meet preset display conditions are marked, so that the instructor can specify the teaching client that can currently interact, and issue a selection instruction, wherein the specific instruction of the instruction is selected.
  • the present embodiment is not limited, and it can refer to the setting manner of the interactive instruction. Further, when the selection instruction is received, the display screen corresponding to the selection instruction is confirmed, and the display screen is enlarged to implement interaction with the display screen.
  • the technical solution provided by the embodiment is that, in the video teaching process, the video data of the at least one teaching client is acquired and displayed, and each sub-display area corresponds to one video data, and whether the display screen of the sub-display area satisfies the preset display condition, and When the preset display condition is met, the display screen that satisfies the preset display condition is enlarged to realize the technical means of interacting with the corresponding teaching client, and the interaction between the lecturer and the student in the video teaching process is realized, and at the same time, according to the video data Automatically confirm whether to interact, without the need for students to perform additional operations on the teaching client, especially when multiple students use the teaching client together, it can ensure the normal order of the learning environment and enhance the user experience.
  • the lecturer client establishes a video connection with five teaching clients.
  • the display screen of the lecturer client refers to FIG. 1b, wherein the five teaching client numbers are respectively 1-5, and the corresponding video data are respectively displayed in the sub display regions 1-5.
  • the lecturer client recognizes the display screen of the five sub-display areas, and confirms whether the motion track of the target object in the display screen is a preset interactive motion track.
  • the display screen of the sub-display area with the number 5 is enlarged.
  • the display screen of the lecturer client is as shown in FIG. 2c. Show.
  • the display screen of the sub-display area numbered 4 and 5 is enlarged, and at this time, the display of the lecturer client is displayed.
  • the picture is shown in Figure 2d.
  • the display screen of the sub-display area marked with numbers 4 and 5, at this time, the lecturer client The display of the end is shown in Figure 2e, and it is connected.
  • the selection command is received, the corresponding display screen is enlarged according to the selection command.
  • FIG. 3a is a flowchart of a video teaching interaction method according to Embodiment 3 of the present invention. This embodiment is embodied on the basis of the above embodiment. Specifically, the teaching interaction data is text data. Referring to FIG. 3a, the video teaching interaction method provided in this embodiment specifically includes:
  • the text data is data obtained by the teaching client to obtain text information or voice data input by the student.
  • the text data is voice data
  • the teaching client acquires the voice data
  • the voice data is subjected to voice recognition and semantic recognition, and converted into text form to obtain text data.
  • the attribute information of the text data is sent.
  • the attribute information of the text data includes: an instant interaction identifier and a teaching client identifier.
  • the specific content of the instant interaction identifier can be set according to the actual situation. For example, when the instant interaction identifier is set to 0, the confirmation text data does not need real-time interaction, and when the instant interaction identifier is set to 1, it is confirmed that the text data needs to be instantly interacted.
  • the main client obtains the text data sent by the teaching client, the attribute information of the text data is acquired at the same time.
  • the attribute information may be identified, the instant interaction identifier may be read to confirm whether it is interactive text data, or the specific content of the text data may be identified, and the text content exists.
  • the text data is confirmed as interactive text data.
  • the interactive text data is data that needs to be immediately notified to the lecturer.
  • the text data is recognized to obtain a specific text content, and the text content is confirmed as text display data.
  • the text content and the attribute information of the text data are confirmed together as text display data.
  • the teaching client that sends the text data is confirmed. Specifically, the corresponding teaching client is confirmed by identifying the teaching client identifier in the attribute information of the text data.
  • the attribute information of the teaching client may be a teaching client identifier and/or a teaching client name. Extracting the teaching client identifier in the text data attribute information, and using the teaching client identifier as the attribute information of the teaching client, or searching for the corresponding teaching client name according to the teaching client identifier, and teaching the client name and/or The teaching client identifier is used as the attribute information of the teaching client.
  • the text prompt box may be displayed in a manner of displaying the text prompt box.
  • the specific form of the text prompt box is not limited in this embodiment.
  • the text prompt box can be popped up only in the display screen of the lecturer client, and the display screen not containing the text prompt box is sent to the teaching client, so that the teaching client displays the display screen without the text prompt box. The advantage of doing this is that when the student of the teaching client does not want to disclose the interactive content, the interactive content is kept secret.
  • the lecturer can select whether to immediately reply to the text display data according to the actual situation. If the reply is immediately, the lecturer client can establish a voice call with the corresponding teaching client, and at the same time enlarge the video data of the teaching client, or, by means of text Line interaction, the text data is sent by the instructor client to the teaching client. If the reply is not immediately replied, the lecturer client will generate a delay notification and send it to the teaching client so that the student of the teaching client can clearly indicate that the instructor is currently unable to interact immediately according to the delay notification.
  • the technical solution provided by the embodiment obtains text data sent by at least one teaching client in the video teaching process, and confirms whether the text data is interactive text data, and if so, displays text display data corresponding to the text data and correspondingly
  • the technical solution of teaching the client's attribute information realizes the interaction between the lecturer and the student in the video teaching process, especially when interacting through the text data, the student can ask questions according to the actual situation without interrupting the normal lecture given by the lecturer. Improve the user experience. Even if the lecturer client cannot obtain the video image of the teaching client, the interaction can still be realized in the form of text data.
  • the lecturer client establishes a video connection with five teaching clients.
  • the display screen of the lecturer client refers to FIG. 1b, wherein the five teaching client numbers are respectively 1-5, and the corresponding video data are respectively displayed in the sub display regions 1-5.
  • the lecturer client obtains text data of five teaching clients and determines whether the text data is interactive text data.
  • the corresponding text display data is identified as "What is the specific value of Y", and the corresponding teaching client number is 5, at this time, the text display data and teaching are displayed in the display screen.
  • the client number, where the display of the lecturer client is shown in Figure 3b.
  • FIG. 4 is a flowchart of a video teaching interaction method according to Embodiment 4 of the present invention.
  • the video teaching interaction method provided by this embodiment may be implemented by a video teaching interaction device, which may be implemented in the form of software and/or hardware, and integrated in a device capable of video teaching. among them,
  • the device includes at least one camera.
  • the video teaching interaction method provided in this embodiment is applicable to an Internet-based video teaching scenario.
  • at least two video teaching software devices are configured with at least one video teaching software and connected via the Internet.
  • One of the devices is used by the teacher as the client client, and the rest of the device is used by the student as the teaching client.
  • the video teaching interaction method provided in this embodiment is executed in the teaching client.
  • the video teaching interaction method provided in this embodiment specifically includes:
  • the teaching interaction data includes video data and/or text data.
  • the video data is data obtained by the teaching client by taking at least one camera to take a picture of the student's lecture
  • the text data is text data input by the student using the teaching client, or the voice data input by the student obtained by the teaching client, and is based on the teaching client
  • the text data obtained from the sound data In general, a teaching client can be used by at least one student.
  • video data is acquired in real time.
  • the text data is acquired in real time, or when the data input instruction is received, the text data is acquired.
  • the specific form of the data input instruction is not limited in this embodiment.
  • S420 Send teaching interaction data to the main client, so that the main client determines whether to implement interaction with the teaching client according to the teaching interaction data.
  • the interpreter client confirms whether to implement interaction with the teaching client according to the teaching interaction data, and the specific method for confirming whether the interaction is possible may refer to the above embodiment.
  • the teaching client may also parse the teaching interaction data by itself, and confirm whether the currently used student sends an interaction request, and if an interaction request is issued, The interaction request and the teaching interaction data are directly sent to the lecturer client, so that the lecturer client directly confirms the teaching client that needs to interact according to the interaction request.
  • the teaching client obtains the video data, parsing the video data to obtain a motion track of the target object, confirming whether the motion track is a preset interaction motion track, and if yes, confirming that the current use student sends an interaction request, and
  • the interactive request is sent along with the video data to the instructor client.
  • the teaching client obtains the text data, parsing the text data to confirm whether the text data is interactive text data, and if so, confirming that the current use student sends an interaction request, and sending the interaction request and the text data to the same.
  • Lecturer client Further, the lecturer client implements interaction with the corresponding teaching client according to the interaction request and the teaching interaction data. The benefit of this is that it reduces the amount of data processed by the instructor client.
  • the technical solution provided by the embodiment realizes the video teaching by acquiring the teaching interaction data and transmitting the teaching interaction data to the lecturer client, so that the lecturer client realizes the interaction with the teaching client according to the teaching interaction data.
  • the interaction between the teaching client and the lecturer client makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
  • FIG. 5 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 5 of the present invention.
  • the video teaching interaction device provided in this embodiment includes: a first obtaining module 501, a trigger detecting module 502, and an interaction executing module 503.
  • the first obtaining module 501 is configured to: obtain, in the video teaching process, the teaching interaction data sent by the at least one teaching client; the trigger detecting module 502, configured to detect whether the teaching interaction mechanism is triggered based on the teaching interaction data; and the interaction execution module 503. If yes, select at least one teaching client that triggers the teaching interaction mechanism and implement interaction with the selected teaching client.
  • the technical solution provided by this embodiment is based on at least one teaching guest in the video teaching process.
  • the teaching interaction data sent by the client determines whether the teaching interaction mechanism is triggered. If triggered, the at least one teaching client that triggers the teaching interaction mechanism is determined, and the technical solution for interacting with the determined teaching client is realized, and the video teaching is realized.
  • the interaction between the lecturer and the students in the process makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
  • the teaching interaction data is video data
  • the trigger detection module 502 includes: a first display unit, configured to display video data in a sub-display area of the display screen, and each sub-display area correspondingly displays a teaching client.
  • the transmitted video data; the first detecting unit is configured to detect whether the display screen of the sub display area meets the preset display condition.
  • the interaction execution module 503 is specifically configured to: if yes, enlarge the display screen that meets the preset display condition to implement interaction with the teaching client corresponding to the enlarged display screen.
  • the first detecting unit includes: a screen recognition subunit for identifying a display screen of the sub display area to acquire an action track of the target object in the display screen; and a track determining subunit for determining the motion track Whether it is a preset interactive action track.
  • the display screens that meet the preset display conditions are at least two
  • the interaction execution module 503 is specifically configured to: if yes, simultaneously enlarge at least two display screens that meet preset display conditions to achieve The teaching client corresponding to the enlarged display screen interacts; or, if so, at least two display screens satisfying the preset display condition are marked, receiving a selection instruction, and zooming in at least two display screens satisfying the preset display condition
  • the display screen corresponding to the instruction is selected to implement interaction with the teaching client corresponding to the enlarged display screen.
  • the interaction execution module 503 is specifically configured to: if yes, perform an interaction prompt, and when receiving the interaction instruction, enlarge the display screen that meets the preset display condition.
  • the teaching interaction data is text data
  • the trigger detection module 502 is specifically configured to: determine whether the text data is interactive text data.
  • the interaction execution module 503 includes: a text recognition unit, configured to: if yes, identify the text data to determine the text display data and the corresponding teaching client; the associated display unit is configured to associate the display text display data with the attribute information of the teaching client.
  • the video teaching interaction device provided by the embodiment of the present invention can be used to perform the video teaching method provided in the foregoing Embodiments 1 to 3, and has corresponding functions and beneficial effects.
  • FIG. 6 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 6 of the present invention.
  • the video teaching interaction apparatus provided in this embodiment may be used to execute the video teaching method provided in the fourth embodiment.
  • the video teaching interaction apparatus provided in this embodiment includes: a second obtaining module 601 and a data sending module 602.
  • the second obtaining module 601 is configured to obtain teaching interaction data in the video teaching process
  • the data sending module 602 is configured to send the teaching interaction data to the main client, so that the main client determines whether to implement the interaction data according to the teaching interaction data.
  • Teaching client interactions are configured to obtain teaching interaction data in the video teaching process, and the data sending module 602 to send the teaching interaction data to the main client, so that the main client determines whether to implement the interaction data according to the teaching interaction data. Teaching client interactions.
  • the technical solution provided by the embodiment realizes the video teaching by acquiring the teaching interaction data and transmitting the teaching interaction data to the lecturer client, so that the lecturer client realizes the interaction with the teaching client according to the teaching interaction data.
  • the interaction between the teaching client and the lecturer client makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
  • FIG. 7 is a schematic structural diagram of a device according to Embodiment 7 of the present invention.
  • the device includes a processor 70, a memory 71, an input device 72, an output device 73, and a communication device 74.
  • the number of processors 70 in the device may be one or more, and one processor 70 in FIG. As an example; equipment
  • the processor 70, the memory 71, the input device 72, the output device 73, and the communication device 74 may be connected by a bus or the like, and the bus connection is taken as an example in FIG.
  • the memory 71 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the video teaching interaction method in Embodiments 1 to 3 of the present invention (for example, the first The acquisition module 501, the trigger detection module 502, and the interaction execution module 503).
  • the processor 70 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 71, that is, implementing the video teaching interaction method described above.
  • the memory 71 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Further, the memory 71 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 71 may further include memory remotely located relative to processor 70, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 72 can be used to receive input digital or character information and to generate key signal inputs related to user settings and function control of the device.
  • the output device 73 may include a display device such as a display screen.
  • the communication device 74 can be configured to establish a video connection with the at least one teaching client and receive the teaching interaction data sent by the at least one teaching client.
  • the device provided by the embodiment of the present invention can perform the video teaching method provided in the foregoing Embodiments 1 to 3, and has corresponding functions and beneficial effects, and has corresponding functions and beneficial effects.
  • FIG. 8 is a schematic structural diagram of a device according to Embodiment 8 of the present invention.
  • the design The processor 80, the memory 81, the input device 82, the output device 83, and the communication device 84 are included; the number of processors 80 in the device may be one or more, and one processor 80 is taken as an example in FIG. 8; processing in the device
  • the device 80, the memory 81, the input device 82, the output device 83, and the communication device 84 may be connected by a bus or the like, and the bus connection is taken as an example in FIG.
  • the memory 81 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the video teaching interaction method in Embodiment 4 of the present invention (for example, the second acquisition module 601). And data sending module 602).
  • the processor 80 executes various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 81, that is, implementing the video teaching interaction method described above.
  • the memory 81 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Further, the memory 81 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 81 may further include memory remotely located relative to processor 80, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • Input device 82 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the device.
  • the output device 83 may include a display device such as a display screen.
  • the communication device 84 can be used to establish a video connection with the instructor client and to communicate interactive teaching data to the instructor client.
  • the device provided by the embodiment of the present invention can perform the video teaching method provided in the foregoing fourth embodiment, and has corresponding functions and beneficial effects, and has corresponding functions and beneficial effects.
  • Embodiment 9 of the present invention further provides a storage medium including computer executable instructions for executing a video teaching interaction method when executed by a computer processor, the video teaching interaction method comprising:
  • At least one teaching client that triggers the teaching interaction mechanism is selected and interacts with the selected teaching client.
  • the storage medium containing the computer executable instructions provided by the embodiment of the present invention is not limited to the video teaching interaction method operation as described above, and may also perform any of the first embodiment to the third embodiment of the present invention.
  • the related operations in the video teaching interaction method provided have corresponding functions and beneficial effects.
  • the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer.
  • the video teaching interaction method according to the first embodiment to the third embodiment of the present invention is implemented by using a server, a network device, or the like.
  • the tenth embodiment of the present invention further provides a storage medium including computer executable instructions, which are executed by a computer processor to execute a video teaching interaction method provided in Embodiment 4, and have corresponding functions. And beneficial effects.
  • the video teaching interaction method includes:
  • the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer.
  • Embodiment 4 of the present invention is implemented by a server, a network device, or the like.
  • each unit and module included is only divided according to functional logic, but is not limited to the above division, as long as the corresponding function can be implemented;
  • the specific names of the respective functional units are also for convenience of distinguishing from each other and are not intended to limit the scope of protection of the present invention.

Abstract

A video teaching interaction method and apparatus, a device, and a storage medium. The method comprises: obtaining teaching interaction data sent by at least one teaching client during the process of video teaching (S110); detecting, on the basis of the teaching interaction data, whether a teaching interaction mechanism is triggered (S120); and if yes, selecting at least one teaching client triggering the teaching interaction mechanism, and interacting with the selected teaching client (S130). The method can resolve the technical problem of the failure of the interaction between lecturers and students during the process of video teaching.

Description

视频教学互动方法、装置、设备及存储介质Video teaching interaction method, device, device and storage medium 技术领域Technical field
本发明涉及多媒体技术领域,尤其涉及一种视频教学互动方法、装置、设备及存储介质。The present invention relates to the field of multimedia technologies, and in particular, to a video teaching interaction method, device, device and storage medium.
背景技术Background technique
如今,智能化已经成了用户生活的重要组成部分。用户可以足不出户,通过智能设备实现购物、教育以及健康监测等。针对教育方面,尤其是儿童教育方面,为了满足日益增长的教育需求,出现了各类教学应用,以通过视频的方式进行教学。Today, intelligence has become an important part of user life. Users can go shopping, education and health monitoring through smart devices without leaving their homes. In terms of education, especially in children's education, in order to meet the growing educational needs, various teaching applications have emerged to teach through video.
一般而言,视频教学时,通常由讲师提前录制好教学视频,至少一个学生通过播放教学视频进行学习,如果学生在学习过程中存在疑问,那么可以通过留言的方式提问,讲师在登录后可以通过回复该留言的方式与学生进行互动。或者是,讲师在线授课,至少一个建立视频连接的学生在线学习,如果学生在听课过程中存在疑问,那么需要等到课程结束后,再与讲师进行线上互动。无论上述哪类方案,均无法在视频教学的过程中实现讲师和学生的互动,降低了用户的使用体验。Generally speaking, in video teaching, the lecture video is usually recorded in advance by the lecturer. At least one student can learn by playing the instructional video. If the student has doubts during the learning process, the question can be answered by means of a message. The lecturer can pass the login. Respond to the message in a way that interacts with the student. Or, the lecturer teaches online, and at least one student who establishes a video connection learns online. If the student has doubts during the course, then they need to wait until the end of the course to interact with the instructor online. No matter which kind of scheme mentioned above, it is impossible to realize the interaction between the lecturer and the student in the process of video teaching, which reduces the user experience.
发明内容Summary of the invention
有鉴于此,本发明实施例提供一种视频教学互动方法、装置、设备及存储介质,以解决在视频教学的过程中无法实现讲师和学生互动的技术问题。 In view of this, the embodiments of the present invention provide a video teaching interaction method, device, device, and storage medium to solve the technical problem that the lecturer and the student cannot interact in the process of video teaching.
第一方面,本发明实施例提供了一种视频教学互动方法,包括:In a first aspect, an embodiment of the present invention provides a video teaching interaction method, including:
在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;In the video teaching process, obtaining teaching interaction data sent by at least one teaching client;
基于所述教学互动数据检测教学互动机制是否被触发;Detecting whether the teaching interaction mechanism is triggered based on the teaching interaction data;
若是,则选定触发所述教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。If so, at least one teaching client that triggers the teaching interaction mechanism is selected and interacts with the selected teaching client.
第二方面,本发明实施例提供了一种视频教学互动方法,包括:包括:In a second aspect, an embodiment of the present invention provides a video teaching interaction method, including:
在视频教学过程中,获取教学互动数据;In the process of video teaching, obtain teaching interaction data;
向主讲客户端发送所述教学互动数据,以使所述主讲客户端根据所述教学互动数据确定是否实现与教学客户端的交互。Sending the teaching interaction data to the presenting client, so that the speaking client determines whether to implement interaction with the teaching client according to the teaching interaction data.
第三方面,本发明实施例还提供了一种视频教学互动装置,包括:In a third aspect, the embodiment of the present invention further provides a video teaching interaction device, including:
第一获取模块,用于在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;a first obtaining module, configured to acquire teaching interaction data sent by at least one teaching client during a video teaching process;
触发检测模块,用于基于所述教学互动数据检测教学互动机制是否被触发;a trigger detection module, configured to detect, according to the teaching interaction data, whether a teaching interaction mechanism is triggered;
交互执行模块,用于若是,则选定触发教学互动机制的至少一个教学客户端,并实现与选定的所述教学客户端的交互。The interaction execution module is configured to, if yes, select at least one teaching client that triggers the teaching interaction mechanism, and implement interaction with the selected teaching client.
第四方面,本发明实施例还提供了一种视频教学互动装置,包括:In a fourth aspect, the embodiment of the present invention further provides a video teaching interaction device, including:
第二获取模块,用于在视频教学过程中,获取教学互动数据;a second obtaining module, configured to acquire teaching interaction data during a video teaching process;
数据发送模块,用于向主讲客户端发送所述教学互动数据,以使所述主讲客户端根据所述教学互动数据确定是否实现与教学客户端的交互。The data sending module is configured to send the teaching interaction data to the main client, so that the main client determines whether to implement interaction with the teaching client according to the teaching interaction data.
第五方面,本发明实施例还提供了一种设备,包括:In a fifth aspect, an embodiment of the present invention further provides an apparatus, including:
一个或多个处理器;One or more processors;
存储器,用于存储一个或多个程序;a memory for storing one or more programs;
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多 个处理器实现如第一方面所述的视频教学互动方法。When the one or more programs are executed by the one or more processors, such that the one or more The processor implements the video teaching interaction method as described in the first aspect.
第六方面,本发明实施例还提供了一种设备,包括:In a sixth aspect, an embodiment of the present invention further provides an apparatus, including:
一个或多个处理器;One or more processors;
存储器,用于存储一个或多个程序;a memory for storing one or more programs;
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如第二方面所述的视频教学互动方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the video teaching interaction method as described in the second aspect.
第七方面,本发明实施例还提供了一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行如第一方面所述的视频教学互动方法。In a seventh aspect, the embodiment of the present invention further provides a storage medium comprising computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method according to the first aspect.
第八方面,本发明实施例还提供了一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行如第二方面所述的视频教学互动方法。In an eighth aspect, the embodiment of the present invention further provides a storage medium comprising computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method according to the second aspect.
上述提供的视频教学互动方法、装置、设备及存储介质,通过在视频教学过程中,根据至少一个教学客户端发送的教学互动数据确定教学互动机制是否被触发,如果被触发,则确定触发教学互动机制的至少一个教学客户端,并实现与确定的教学客户端的交互的技术方案,实现了在视频教学过程中讲师与学生的互动,使得视频教学过程更加贴近面对面教学过程,提升了用户的使用体验。The video teaching interaction method, device, device and storage medium provided above determine whether the teaching interaction mechanism is triggered according to the teaching interaction data sent by at least one teaching client in the video teaching process, and if triggered, determining to trigger the teaching interaction At least one teaching client of the mechanism, and realizes the technical solution of interacting with the determined teaching client, realizes the interaction between the lecturer and the student in the video teaching process, makes the video teaching process closer to the face-to-face teaching process, and improves the user experience. .
附图说明DRAWINGS
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other features, objects, and advantages of the present invention will become more apparent from the Detailed Description of Description
图1a为本发明实施例一提供的一种视频教学互动方法的流程图; 1a is a flowchart of a video teaching interaction method according to Embodiment 1 of the present invention;
图1b为讲师客户端的第一显示画面示意图;Figure 1b is a schematic diagram of a first display screen of the lecturer client;
图2a为本发明实施例二提供的一种视频教学互动方法的流程图;2a is a flowchart of a video teaching interaction method according to Embodiment 2 of the present invention;
图2b为本发明实施例二提供的一种检测方法的流程图;2b is a flowchart of a detection method according to Embodiment 2 of the present invention;
图2c为讲师客户端的第二显示画面示意图;2c is a schematic diagram of a second display screen of the lecturer client;
图2d为讲师客户端的第三显示画面示意图;2d is a schematic diagram of a third display screen of the lecturer client;
图2e为讲师客户端的第四显示画面示意图;2e is a schematic diagram of a fourth display screen of the lecturer client;
图3a为本发明实施例三提供的一种视频教学互动方法的流程图;FIG. 3a is a flowchart of a video teaching interaction method according to Embodiment 3 of the present invention; FIG.
图3b为讲师客户端的第五显示画面示意图;Figure 3b is a schematic diagram of a fifth display screen of the lecturer client;
图4为本发明实施例四提供的一种视频教学互动方法的流程图;4 is a flowchart of a video teaching interaction method according to Embodiment 4 of the present invention;
图5为本发明实施例五提供的一种视频教学互动装置的结构示意图;FIG. 5 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 5 of the present invention; FIG.
图6为本发明实施例六提供的一种视频教学互动装置的结构示意图;FIG. 6 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 6 of the present invention; FIG.
图7为本发明实施例七提供的一种设备的结构示意图;FIG. 7 is a schematic structural diagram of a device according to Embodiment 7 of the present invention;
图8为本发明实施例八提供的一种设备的结构示意图。FIG. 8 is a schematic structural diagram of a device according to Embodiment 8 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部内容。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the present invention are shown in the drawings.
实施例一 Embodiment 1
图1a为本发明实施例一提供的一种视频教学互动方法的流程图。本实施例提供的视频教学互动方法可以由视频教学互动装置执行,该视频教学互动装置可以通过软件和/或硬件的方式实现,并集成在可进行视频教学的设备中。其中, 该设备包括至少一个摄像头。可选的,该设备包括但不限定于交互智能平板、智能手机等。FIG. 1a is a flowchart of a video teaching interaction method according to Embodiment 1 of the present invention. The video teaching interaction method provided by this embodiment may be implemented by a video teaching interaction device, which may be implemented by software and/or hardware, and integrated in a device capable of video teaching. among them, The device includes at least one camera. Optionally, the device includes but is not limited to an interactive smart tablet, a smart phone, or the like.
具体的,本实施例提供的视频教学互动方法适用于基于互联网的视频教学场景。在该场景下,至少两台可进行视频教学的设备中配置有至少一个视频教学软件,并通过互联网进行连接。其中一台设备被讲师使用称为主讲客户端,其余设备被学生使用称为教学客户端。本实施例提供的视频教学互动方法在主讲客户端中执行。Specifically, the video teaching interaction method provided in this embodiment is applicable to an Internet-based video teaching scenario. In this scenario, at least two video teaching software devices are configured with at least one video teaching software and connected via the Internet. One of the devices is used by the instructor as the client client, and the rest of the device is used by the student as the teaching client. The video teaching interaction method provided in this embodiment is executed in the main client.
具体的,参考图1a,本实施例提供的视频教学互动方法具体包括:Specifically, referring to FIG. 1a, the video teaching interaction method provided by this embodiment specifically includes:
S110、在视频教学过程中,获取至少一个教学客户端发送的教学互动数据。S110: Obtain teaching interaction data sent by at least one teaching client in the video teaching process.
示例性的,视频教学过程是指至少一个教学客户端与主讲客户端连接后,主讲客户端通过至少一个摄像头获取讲师的讲课画面,并将讲课画面发送给至少一个教学客户端,以使使用教学客户端的学生通过讲课画面进行学习的过程。Exemplarily, the video teaching process refers to that the at least one teaching client is connected to the main client, and the present client obtains the lecturer's lecture screen through at least one camera, and sends the lecture screen to at least one teaching client, so as to use the teaching. The client's students learn through the lecture screen.
具体的,教学互动数据为教学客户端在视频教学过程中获取的数据,该数据具体可以包括视频数据和/或文本数据。其中,视频数据为教学客户端通过至少一个摄像头拍摄学生听课画面得到的数据,文本数据为使用教学客户端的学生输入的文本数据,或者,教学客户端获取的学生输入的声音数据,并由教学客户端基于该声音数据得到的文本数据。一般而言,一个教学客户端可以被至少一个学生使用。Specifically, the teaching interaction data is data acquired by the teaching client during the video teaching process, and the data may specifically include video data and/or text data. The video data is data obtained by the teaching client by taking at least one camera to capture the student's listening picture, the text data is text data input by the student using the teaching client, or the voice data input by the student obtained by the teaching client, and is taught by the teaching client. The text data obtained based on the sound data. In general, a teaching client can be used by at least one student.
进一步的,主讲客户端在显示屏中实时视频数据,其中,每个子显示区域对应一个教学客户端的视频数据,以使讲师观看到学生的听课画面。同时,还显示自身获取的讲师讲课画面。具体的,参考图1b,假设当前共五个教学客户端与主讲客户端进行视频教学,那么主讲客户端的显示屏上全屏显示自身摄像头获取的讲师讲课画面,并在当前画面的基础上,设定五个子显示区域分别标 号1-5,用于显示五个教学客户端发送的听课画面。进一步的,主讲客户端向教学客户端发送讲课画面时,优选发送显示屏的显示画面,即各教学客户端的显示画面与主讲客户端的显示画面同步。Further, the client speaks real-time video data in the display screen, wherein each sub-display area corresponds to video data of a teaching client, so that the lecturer can view the student's listening picture. At the same time, it also displays the lecturer's lecture screen obtained by itself. Specifically, referring to FIG. 1b, it is assumed that a total of five teaching clients and a client client perform video teaching, and then the main client's display screen displays the lecturer's lecture screen acquired by the camera itself, and is set on the basis of the current screen. Five sub-display areas are marked separately No. 1-5, used to display the lecture screen sent by five teaching clients. Further, when the lecture client sends the lecture screen to the teaching client, it is preferred to send a display screen of the display screen, that is, the display screen of each teaching client is synchronized with the display screen of the client client.
S120、基于教学互动数据检测教学互动机制是否被触发。若是,则执行S130,否则,返回执行S110。S120. Detecting whether the teaching interaction mechanism is triggered based on the teaching interaction data. If yes, execute S130, otherwise, return to execution S110.
具体的,对教学互动数据进行处理,以确定该教学互动数据中是否包括学生发出的交互请求,如果包括学生发出的交互请求,则确认教学互动机制被触发,否则,确认教学互动机制未被触发。Specifically, the teaching interaction data is processed to determine whether the teaching interaction data includes an interaction request sent by the student, and if the interaction request sent by the student is included, the teaching interaction mechanism is triggered, otherwise, the confirmation teaching interaction mechanism is not triggered. .
可选的,当教学互动数据为视频数据时,可以是检测视频数据中至少一个目标对象的动作轨迹,其中,目标对象为学生。当确认目标对象的动作轨迹为预设的交互动作轨迹时,确定目标对象发出交互请求,反之,则确定目标对象未发出交互请求。其中,预设的交互动作轨迹可以根据实际情况进行设定。Optionally, when the teaching interaction data is video data, the action track of the at least one target object in the video data may be detected, where the target object is a student. When it is confirmed that the motion track of the target object is a preset interaction motion track, it is determined that the target object issues an interaction request, and vice versa, it is determined that the target object does not issue an interaction request. The preset interactive motion track can be set according to actual conditions.
可选的,当教学互动数据为文本数据时,可以是检测文本数据的属性信息中是否包括立即交互标识,如果包括,则确认文本数据为交互文本数据,即确定目标用户发出交互请求,反之,确定目标对象未发出交互请求。Optionally, when the teaching interaction data is text data, whether the attribute information of the text data is detected includes an immediate interaction identifier, and if included, the text data is confirmed as interactive text data, that is, the target user is determined to issue an interaction request, and vice versa. Make sure the target object does not issue an interactive request.
S130、选定触发教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。S130. Select at least one teaching client that triggers a teaching interaction mechanism, and implement interaction with the selected teaching client.
具体的,确定教学互动机制被触发后,确定触发教学互动机制的教学互动数据,选定发送该教学互动数据的教学客户端。进一步的,与选定的教学客户端的交互可以是,启动与教学客户端的语音通话,以实现与教学客户端的学生进行语音交流。Specifically, after determining that the teaching interaction mechanism is triggered, the teaching interaction data that triggers the teaching interaction mechanism is determined, and the teaching client that sends the teaching interaction data is selected. Further, the interaction with the selected teaching client may be to initiate a voice call with the teaching client to enable voice communication with the student of the teaching client.
可选的,当教学互动数据为视频数据时,实现与选定的教学客户端的交互时,可以在显示屏中放大显示该教学客户端的视频数据的子显示区域,以使其 他教学客户端通过子显示区域明确当前进行交互的教学客户端。Optionally, when the teaching interaction data is video data, when the interaction with the selected teaching client is implemented, the sub-display area of the video data of the teaching client may be enlarged in the display screen, so that His teaching client clarifies the current interactive teaching client through the sub-display area.
还可选的,当教学互动数据为文本数据时,实现与选定的教学客户端的交互时,可以是显示与文本数据相关的文本显示数据以及对应的教学客户端的属性信息,以使讲师明确交互内容以及提出交互请求的学生。Optionally, when the teaching interaction data is text data, when the interaction with the selected teaching client is implemented, the text display data related to the text data and the attribute information of the corresponding teaching client may be displayed to enable the instructor to explicitly interact with each other. Content and students who make interactive requests.
在实际应用中,触发教学互动机制的教学客户端可以是至少两个,此时,可以同时与至少两个教学客户端实现互动,还可以按照设定规则在至少两个教学客户端中选择一个教学客户端作为实现互动的教学客户端。其中,按照设定规则可以是按照触发时间先后顺序选择最先触发的教学客户端作为实现互动的客户端,还可以是标记至少两个教学客户端,由讲师选择一个实现互动的教学客户端。In practical applications, the teaching client that triggers the teaching interaction mechanism may be at least two. At this time, interaction with at least two teaching clients may be implemented at the same time, and one of at least two teaching clients may be selected according to a set rule. The teaching client acts as an interactive teaching client. In the following, according to the setting rule, the first triggered teaching client may be selected as the client that implements the interaction according to the triggering time sequence, or at least two teaching clients may be marked, and the instructor selects an interactive teaching client.
本实施例提供的技术方案,通过在视频教学过程中,根据至少一个教学客户端发送的教学互动数据确定教学互动机制是否被触发,如果被触发,则确定触发教学互动机制的至少一个教学客户端,并实现与确定的教学客户端的交互的技术方案,实现了在视频教学过程中讲师与学生的互动,使得视频教学过程更加贴近面对面教学过程,提升了用户的使用体验。The technical solution provided by the embodiment determines whether the teaching interaction mechanism is triggered according to the teaching interaction data sent by the at least one teaching client in the video teaching process, and if triggered, determines at least one teaching client that triggers the teaching interaction mechanism. And realize the technical solution of interaction with the determined teaching client, realize the interaction between the lecturer and the student in the video teaching process, make the video teaching process closer to the face-to-face teaching process, and improve the user experience.
实施例二 Embodiment 2
图2a为本发明实施例二提供的一种视频教学互动方法的流程图。本实施例是在上述实施例的基础上进行具体化。具体的,教学互动数据为视频数据,参考图2a,本实施例提供的视频教学互动方法具体包括:2a is a flowchart of a video teaching interaction method according to Embodiment 2 of the present invention. This embodiment is embodied on the basis of the above embodiment. Specifically, the teaching interaction data is video data. Referring to FIG. 2a, the video teaching interaction method provided in this embodiment specifically includes:
S210、在视频教学过程中,获取至少一个教学客户端发送的视频数据。S210. Obtain video data sent by at least one teaching client during the video teaching process.
其中,该视频数据为教学客户端通过至少一个摄像头拍摄的听课画面,其为无声数据。 The video data is a lecture picture taken by the teaching client through at least one camera, which is silent data.
S220、在显示屏的子显示区域中显示视频数据。S220. Display video data in a sub display area of the display screen.
其中,每个子显示区域对应显示一个教学客户端发送的视频数据。Each sub-display area correspondingly displays video data sent by one teaching client.
进一步的,根据教学客户端的数量确定子显示区域的数量。每个子显示区域当前的区域大小相同,且具体的显示位置可以根据实际情况进行设定。Further, the number of sub-display areas is determined according to the number of teaching clients. The current area of each sub-display area is the same size, and the specific display position can be set according to actual conditions.
S230、检测子显示区域的显示画面是否满足预设显示条件。若是,则执行S240,否则,返回执行S210。S230: Detect whether a display screen of the sub display area satisfies a preset display condition. If yes, execute S240; otherwise, return to execution S210.
具体的,对每个子显示区域的显示画面进行识别处理,其也可以是对每个子显示区域对应的视频数据进行识别处理。即其可以是先显示再处理,也可以是先处理再显示。其中,识别处理的具体手段本实施例不作限定。可选的,对显示画面进行识别处理后,可以确定显示画面中目标对象的动作轨迹和/或面部表情数据。Specifically, the display screen of each sub-display area is subjected to recognition processing, and the video data corresponding to each sub-display area may be identified. That is, it may be displayed first and then processed, or it may be processed first and then displayed. The specific means for the identification processing is not limited in this embodiment. Optionally, after the display screen is identified, the motion track and/or facial expression data of the target object in the display screen may be determined.
可选的,预设显示条件可以根据实际情况进行设定。当预设显示条件为预设的交互动作轨迹时,参考图2b,该步骤具体包括:Optionally, the preset display condition can be set according to actual conditions. When the preset display condition is a preset interactive action track, refer to FIG. 2b, and the step specifically includes:
S231、识别子显示区域的显示画面,以获取显示画面中目标对象的动作轨迹。S231. Identify a display screen of the sub display area to acquire an action track of the target object in the display screen.
具体的,分别识别每个子显示区域的显示画面,确认显示画面中的至少一个目标对象,其中,目标对象为学生。进一步的,获取目标对象的动作轨迹。其中,目标对象的动作轨迹可以是目标对象局部动作轨迹,比如手臂动作轨迹。也可以是目标对象整体动作轨迹,比如身体移动时的动作轨迹。Specifically, the display screen of each sub-display area is separately identified, and at least one target object in the display screen is confirmed, wherein the target object is a student. Further, the motion track of the target object is acquired. The motion track of the target object may be a local motion track of the target object, such as an arm motion track. It can also be the overall motion trajectory of the target object, such as the motion trajectory when the body moves.
S232、判断动作轨迹是否为预设的交互动作轨迹。S232. Determine whether the motion track is a preset interaction motion track.
其中,预设的交互动作轨迹可以根据实际情况进行设备。在本实施例中,预设的交互动作轨迹可以是举手动作轨迹和/或站立动作轨迹。The preset interaction action track can be used according to the actual situation. In this embodiment, the preset interaction motion track may be a hand movement motion track and/or a standing motion track.
进一步的,获取目标对象的动作轨迹后,将该动作轨迹与预设的交互动作 轨迹进行比对,如果该动作轨迹与预设的交互动作轨迹的相似度高于设定的相似阈值,那么可以确认该动作轨迹为预设的交互动作轨迹。Further, after acquiring the motion track of the target object, the action track and the preset interaction action The trajectory is compared. If the similarity between the motion trajectory and the preset interaction trajectory is higher than the set similar threshold, the motion trajectory may be confirmed as a preset interaction motion trajectory.
可选的,判断动作轨迹是否为预设的交互动作轨迹时,也可以是确定目标对象执行该动作轨迹后的动作姿态,并判断该动作姿态与执行预设的交互动作轨迹后的姿态是否一致,若一致,则确认目标对象的动作轨迹为预设的交互动作轨迹。例如,目标对象的动作轨迹为起立,动作姿态为站立。执行预设的交互动作轨迹后的姿态也为站立。那么可以确认目标对象的动作轨迹为预设的交互动作轨迹。Optionally, determining whether the motion track is a preset interaction motion track may also be determining whether the target object performs the motion posture after the motion track, and determining whether the motion posture is consistent with the posture after performing the preset interaction motion track. If they are consistent, confirm that the motion track of the target object is a preset interactive motion track. For example, the action trajectory of the target object is standing up, and the action gesture is standing. The posture after performing the preset interactive motion trajectory is also standing. Then, it can be confirmed that the motion track of the target object is a preset interactive motion track.
具体的,每个子显示区域的显示画面中可能存在多个目标对象,那么分别识别多个目标对象的动作轨迹,当其中至少一个目标对象的动作轨迹为预设的交互动作轨迹时,确认显示画面满足预设显示条件。Specifically, if there are multiple target objects in the display screen of each sub-display area, the motion trajectories of the plurality of target objects are respectively identified, and when the motion trajectory of at least one of the target objects is a preset interactive motion trajectory, the display screen is confirmed. Meet the preset display conditions.
S240、放大满足预设显示条件的显示画面,以实现与被放大的显示画面对应的教学客户端进行交互。S240. Enlarge the display screen that meets the preset display condition to implement interaction with the teaching client corresponding to the enlarged display screen.
具体的,确定满足预设显示条件的显示画面,并放大该显示画面。其中,放大显示画面是指放大显示画面的子显示区域,其具体的放大规则本实施例不作限定。具体的,放大显示画面后,可以播放对应的教学客户端的语音数据,以实现与教学客户端的交互。在进行交互时,全部教学客户端显示屏的全部显示画面与教师客户端显示屏的全部显示画面同步。其他非交互教学客户端显示屏同时播放交互客户端的语音数据和教师客户端的语音数据。Specifically, a display screen that satisfies the preset display condition is determined, and the display screen is enlarged. The enlarged display screen refers to a sub-display area of the enlarged display screen, and the specific enlargement rule is not limited in this embodiment. Specifically, after the display screen is enlarged, the voice data of the corresponding teaching client can be played to implement interaction with the teaching client. When interacting, all display screens of all teaching client displays are synchronized with all display screens of the teacher client display. Other non-interactive teaching client displays simultaneously play the voice data of the interactive client and the voice data of the teacher client.
可选的,放大满足预设显示条件的显示画面包括:进行交互提示,并在接收到交互指令时,放大满足预设显示条件的显示画面。Optionally, the displaying the display screen that meets the preset display condition comprises: performing an interactive prompt, and when receiving the interactive instruction, zooming in the display screen that meets the preset display condition.
考虑到实际应用中,即使教学客户端发出了交互请求,讲师可能也无法立即回应交互请求,需要讲解完当前的授课内容。如果直接放大显示画面,可能 影响正常讲课,因此,在确认显示画面满足预设显示条件时,进行交互提示,以使讲师明确有教学客户端发出了交互请求。其中,交互提示的具体形式可以根据实际情况进行设定,比如,将满足显示条件的子显示区域的边框加粗和/或变色显示。Considering the actual application, even if the teaching client issues an interactive request, the instructor may not be able to immediately respond to the interactive request, and the current teaching content needs to be explained. If you zoom in directly, it is possible Affects normal lectures. Therefore, when the confirmation display screen satisfies the preset display condition, an interactive prompt is given to enable the instructor to explicitly issue an interactive request by the teaching client. The specific form of the interactive prompt may be set according to actual conditions, for example, the border of the sub-display area that satisfies the display condition is bolded and/or discolored.
进一步的,讲师根据交互提示发出交互指令,以使讲师客户端根据交互指令确认进行交互,进而放大满足预设显示条件的显示画面。具体的,讲师可以通过点击设定按键、点击满足预设显示条件的显示画面或者在显示屏中执行设定的触摸操作等方式发出交互指令。Further, the lecturer issues an interactive instruction according to the interactive prompt, so that the lecturer client confirms the interaction according to the interactive instruction, and then enlarges the display screen that satisfies the preset display condition. Specifically, the lecturer can issue an interactive command by clicking a setting button, clicking a display screen that satisfies the preset display condition, or performing a set touch operation in the display screen.
可选的,当满足预设显示条件的显示画面为至少两个时,放大满足预设显示条件的显示画面具体包括下述方案:Optionally, when the display screen that meets the preset display condition is at least two, the display screen that satisfies the preset display condition specifically includes the following:
方案一、同时放大至少两个满足预设显示条件的显示画面。Solution 1: Simultaneously enlarge at least two display screens that meet preset display conditions.
具体的,同时放大至少两个满足预设显示条件的显示画面时,至少两个被放大的显示画面的子显示区域大小相同。获取至少两个显示画面的语音数据,以实现与至少两个教学客户端的交互。可选的,播放语音数据时,当播放某个教学客户端的语音数据时,突出显示对应的显示画面,以使讲师和其他学生明确当前讲话的目标对象。Specifically, when at least two display screens satisfying the preset display condition are simultaneously enlarged, the sub-display areas of the at least two enlarged display screens have the same size. Acquiring voice data of at least two display screens to achieve interaction with at least two teaching clients. Optionally, when the voice data is played, when the voice data of a teaching client is played, the corresponding display screen is highlighted, so that the lecturer and other students clarify the target object of the current speech.
方案二、标记至少两个满足预设显示条件的显示画面,接收选择指令,并在至少两个满足预设显示条件的显示画面中放大与选择指令对应的显示画面。In the second scheme, at least two display screens satisfying the preset display condition are marked, a selection instruction is received, and a display screen corresponding to the selection instruction is enlarged in at least two display screens that satisfy the preset display condition.
其中,显示画面的标记形式可以根据实际情况进行设定。比如,突出显示对应的子显示区域的边框,如变换子显示区域的边框颜色、边框粗度和/或闪烁显示边框等。Among them, the mark form of the display screen can be set according to the actual situation. For example, the border of the corresponding sub-display area is highlighted, such as the border color of the sub-display area, the border thickness, and/or the blinking display border.
具体的,对至少两个满足预设显示条件的显示画面进行标记,以使讲师明确当前可进行交互的教学客户端,并发出选择指令,其中,选择指令的具体发 出形式本实施例不作限定,其可参照交互指令的设定方式。进一步的,当接收到选择指令时,确认选择指令对应的显示画面,并放大该显示画面,以实现与该显示画面的交互。Specifically, at least two display screens that meet preset display conditions are marked, so that the instructor can specify the teaching client that can currently interact, and issue a selection instruction, wherein the specific instruction of the instruction is selected. The present embodiment is not limited, and it can refer to the setting manner of the interactive instruction. Further, when the selection instruction is received, the display screen corresponding to the selection instruction is confirmed, and the display screen is enlarged to implement interaction with the display screen.
本实施例提供的技术方案,通过在视频教学过程中,获取并显示至少一个教学客户端的视频数据,每个子显示区域对应一个视频数据,检测子显示区域的显示画面是否满足预设显示条件,并在满足预设显示条件时,放大满足预设显示条件的显示画面,以实现与对应的教学客户端进行交互的技术手段,实现了在视频教学过程中讲师与学生的互动,同时,根据视频数据自动确认是否进行互动,无需学生对教学客户端进行额外的操作,尤其是当多个学生共同使用教学客户端时,可以保证学习环境的正常秩序,提升用户使用体验。The technical solution provided by the embodiment is that, in the video teaching process, the video data of the at least one teaching client is acquired and displayed, and each sub-display area corresponds to one video data, and whether the display screen of the sub-display area satisfies the preset display condition, and When the preset display condition is met, the display screen that satisfies the preset display condition is enlarged to realize the technical means of interacting with the corresponding teaching client, and the interaction between the lecturer and the student in the video teaching process is realized, and at the same time, according to the video data Automatically confirm whether to interact, without the need for students to perform additional operations on the teaching client, especially when multiple students use the teaching client together, it can ensure the normal order of the learning environment and enhance the user experience.
下面为本实施例提供的具体示例:The following is a specific example provided for this embodiment:
其中,讲师客户端与五个教学客户端建立视频连接。视频教学过程中,讲师客户端的显示画面参考图1b,其中,五个教学客户端编号分别为1-5,对应的视频数据分别在子显示区域1-5中显示。讲师客户端识别5个子显示区域的显示画面,确认显示画面中目标对象的动作轨迹是否为预设的交互动作轨迹。Among them, the lecturer client establishes a video connection with five teaching clients. In the video teaching process, the display screen of the lecturer client refers to FIG. 1b, wherein the five teaching client numbers are respectively 1-5, and the corresponding video data are respectively displayed in the sub display regions 1-5. The lecturer client recognizes the display screen of the five sub-display areas, and confirms whether the motion track of the target object in the display screen is a preset interactive motion track.
若确认编号为5的子显示区域的显示画面中目标对象的动作轨迹为预设的交互动作轨迹,放大编号为5的子显示区域的显示画面,此时,讲师客户端的显示画面如图2c所示。If the motion track of the target object in the display screen of the sub-display area with the number 5 is the preset interactive motion track, the display screen of the sub-display area with the number 5 is enlarged. At this time, the display screen of the lecturer client is as shown in FIG. 2c. Show.
若确认编号为4和5的子显示区域的显示画面中目标对象的动作轨迹为预设的交互动作轨迹,则放大编号为4和5的子显示区域的显示画面,此时,讲师客户端的显示画面如图2d所示。或者,若确认编号为4和5的子显示区域的显示画面中目标对象的动作轨迹为预设的交互动作轨迹,则标记编号为4和5的子显示区域的显示画面,此时,讲师客户端的显示画面如图2e所示,并在接 收到选择指令时,根据选择指令放大对应的显示画面。If it is confirmed that the motion track of the target object in the display screen of the sub-display area numbered 4 and 5 is the preset interactive motion track, the display screen of the sub-display area numbered 4 and 5 is enlarged, and at this time, the display of the lecturer client is displayed. The picture is shown in Figure 2d. Or, if it is confirmed that the motion track of the target object in the display screen of the sub-display area numbered 4 and 5 is the preset interactive motion track, the display screen of the sub-display area marked with numbers 4 and 5, at this time, the lecturer client The display of the end is shown in Figure 2e, and it is connected. When the selection command is received, the corresponding display screen is enlarged according to the selection command.
实施例三 Embodiment 3
图3a为本发明实施例三提供的一种视频教学互动方法的流程图。本实施例是在上述实施例的基础上进行具体化。具体的,教学互动数据为文本数据,参考图3a,本实施例提供的视频教学互动方法具体包括:FIG. 3a is a flowchart of a video teaching interaction method according to Embodiment 3 of the present invention. This embodiment is embodied on the basis of the above embodiment. Specifically, the teaching interaction data is text data. Referring to FIG. 3a, the video teaching interaction method provided in this embodiment specifically includes:
S310、在视频教学过程中,获取至少一个教学客户端发送的文本数据。S310. Obtain text data sent by at least one teaching client during the video teaching process.
其中,文本数据为教学客户端获取学生输入的文本信息或者语音数据得到的数据。其中,文本数据为语音数据时,教学客户端获取语音数据时,对语音数据进行语音识别和语义识别,以转换成文字形式得到文本数据。The text data is data obtained by the teaching client to obtain text information or voice data input by the student. Wherein, when the text data is voice data, when the teaching client acquires the voice data, the voice data is subjected to voice recognition and semantic recognition, and converted into text form to obtain text data.
可选的,教学客户端在发送文本数据时,关联发送文本数据的属性信息。其中,文本数据的属性信息包括:即时交互标识和教学客户端标识。即时交互标识的具体内容可以根据实际情况设定。如,设定即时交互标识为0时,确认文本数据不需要即时交互,设定即时交互标识为1时,确认文本数据需要即时交互。相应的,主讲客户端获取教学客户端发送的文本数据时,同时获取文本数据的属性信息。Optionally, when the teaching client sends the text data, the attribute information of the text data is sent. The attribute information of the text data includes: an instant interaction identifier and a teaching client identifier. The specific content of the instant interaction identifier can be set according to the actual situation. For example, when the instant interaction identifier is set to 0, the confirmation text data does not need real-time interaction, and when the instant interaction identifier is set to 1, it is confirmed that the text data needs to be instantly interacted. Correspondingly, when the main client obtains the text data sent by the teaching client, the attribute information of the text data is acquired at the same time.
S320、判断文本数据是否为交互文本数据。若是,则执行S330,否则,返回执行S310。S320. Determine whether the text data is interactive text data. If yes, execute S330, otherwise, go back to execution S310.
具体的,判断文本数据是否为交互文本数据时,可以是识别关联的属性信息,读取即时交互标识以确认是否为交互文本数据;还可以是识别文本数据的具体内容,当该文本内容中存在“立即”“即刻”“回答”“解答”等关键字时,确认文本数据为交互文本数据。其中,交互文本数据为需要立即告知讲师的数据。 Specifically, when determining whether the text data is interactive text data, the attribute information may be identified, the instant interaction identifier may be read to confirm whether it is interactive text data, or the specific content of the text data may be identified, and the text content exists. When "immediately", "immediately", "answer", "answer" and other keywords, the text data is confirmed as interactive text data. Among them, the interactive text data is data that needs to be immediately notified to the lecturer.
进一步的,如果为交互文本数据,则说明教学客户端的学生需要讲师即时互动,如果不为交互文本数据,则说明教学客户端的学生不需要讲师即时互动,此时,讲师可以授课结束后再进行互动。Further, if it is interactive text data, it means that the student of the teaching client needs the teacher to interact instantly. If the text data is not interactive, the student of the teaching client does not need the teacher to interact instantly. At this time, the lecturer can interact after the lecture is over. .
S330、识别文本数据以确定文本显示数据以及对应的教学客户端。S330. Identify text data to determine text display data and a corresponding teaching client.
具体的,识别文本数据得到具体的文本内容,将文本内容确认为文本显示数据。可选的,将文本内容和文本数据的属性信息一同确认为文本显示数据。Specifically, the text data is recognized to obtain a specific text content, and the text content is confirmed as text display data. Optionally, the text content and the attribute information of the text data are confirmed together as text display data.
进一步的,确认发送文本数据的教学客户端。具体的,通过识别文本数据的属性信息中教学客户端标识确认对应的教学客户端。Further, the teaching client that sends the text data is confirmed. Specifically, the corresponding teaching client is confirmed by identifying the teaching client identifier in the attribute information of the text data.
S340、关联显示文本显示数据以及教学客户端的属性信息,并实现与选定的教学客户端的交互。S340. Associate the display text display data with the attribute information of the teaching client, and implement interaction with the selected teaching client.
具体的,教学客户端的属性信息可以是教学客户端标识和/或教学客户端名称等。提取文本数据属性信息中的教学客户端标识,并将该教学客户端标识作为教学客户端的属性信息,或者,根据教学客户端标识查找对应的教学客户端名称,并将教学客户端名称和/或教学客户端标识作为教学客户端的属性信息。Specifically, the attribute information of the teaching client may be a teaching client identifier and/or a teaching client name. Extracting the teaching client identifier in the text data attribute information, and using the teaching client identifier as the attribute information of the teaching client, or searching for the corresponding teaching client name according to the teaching client identifier, and teaching the client name and/or The teaching client identifier is used as the attribute information of the teaching client.
进一步的,关联显示文本显示数据和教学客户端的属性信息时,可以是弹出文本提示框的方式进行显示,其中,文本提示框的具体形式本实施例不做限定。可选的,该文本提示框可以仅在讲师客户端的显示屏中弹出,并将不包含文本提示框的显示画面发送至教学客户端中,以使教学客户端显示不包含文本提示框的显示画面,这样做的好处是当教学客户端的学生不想公开交互内容时,会交互内容进行保密。Further, when the text display data and the attribute information of the teaching client are associated, the text prompt box may be displayed in a manner of displaying the text prompt box. The specific form of the text prompt box is not limited in this embodiment. Optionally, the text prompt box can be popped up only in the display screen of the lecturer client, and the display screen not containing the text prompt box is sent to the teaching client, so that the teaching client displays the display screen without the text prompt box. The advantage of doing this is that when the student of the teaching client does not want to disclose the interactive content, the interactive content is kept secret.
可选的,当弹出文本提示框后,讲师可以根据实际情况选择是否立即回复该文本显示数据。如果立即回复,那么讲师客户端可以建立与对应的教学客户端的语音通话,同时放大教学客户端的视频数据,或者是,通过文本的方式进 行交互,由讲师客户端将文本数据发送至教学客户端。如果不立即回复,那么讲师客户端会生成延时通知并发送给教学客户端,以使教学客户端的学生根据该延时通知明确讲师当前无法立即进行交互。Optionally, after the text prompt box is popped up, the lecturer can select whether to immediately reply to the text display data according to the actual situation. If the reply is immediately, the lecturer client can establish a voice call with the corresponding teaching client, and at the same time enlarge the video data of the teaching client, or, by means of text Line interaction, the text data is sent by the instructor client to the teaching client. If the reply is not immediately replied, the lecturer client will generate a delay notification and send it to the teaching client so that the student of the teaching client can clearly indicate that the instructor is currently unable to interact immediately according to the delay notification.
本实施例提供的技术方案,通过在视频教学过程中,获取至少一个教学客户端发送的文本数据,并确认文本数据是否为交互文本数据,若是,则关联显示文本数据对应的文本显示数据以及相应教学客户端的属性信息的技术方案,实现在视频教学过程中讲师与学生的交互,尤其通过文本数据进行交互时,可以在不打断讲师正常授课的基础上,由学生自行根据实际情况进行提问,提升了用户的使用体验。即使讲师客户端无法获取教学客户端的视频画面,仍然能够通过文本数据的形式实现交互。The technical solution provided by the embodiment obtains text data sent by at least one teaching client in the video teaching process, and confirms whether the text data is interactive text data, and if so, displays text display data corresponding to the text data and correspondingly The technical solution of teaching the client's attribute information realizes the interaction between the lecturer and the student in the video teaching process, especially when interacting through the text data, the student can ask questions according to the actual situation without interrupting the normal lecture given by the lecturer. Improve the user experience. Even if the lecturer client cannot obtain the video image of the teaching client, the interaction can still be realized in the form of text data.
下面为本实施例提供的具体示例:The following is a specific example provided for this embodiment:
其中,讲师客户端与五个教学客户端建立视频连接。视频教学过程中,讲师客户端的显示画面参考图1b,其中,五个教学客户端编号分别为1-5,对应的视频数据分别在子显示区域1-5中显示。进一步的,讲师客户端获取五个教学客户端的文本数据,并判断文本数据是否为交互文本数据。Among them, the lecturer client establishes a video connection with five teaching clients. In the video teaching process, the display screen of the lecturer client refers to FIG. 1b, wherein the five teaching client numbers are respectively 1-5, and the corresponding video data are respectively displayed in the sub display regions 1-5. Further, the lecturer client obtains text data of five teaching clients and determines whether the text data is interactive text data.
若确认其中某一个文本数据为交互文本数据,识别对应的文本显示数据为“Y的具体值是什么”,对应的教学客户端编号为5,此时,在显示屏中显示文本显示数据以及教学客户端编号,其中,讲师客户端的显示画面如图3b所示。If it is confirmed that one of the text data is interactive text data, the corresponding text display data is identified as "What is the specific value of Y", and the corresponding teaching client number is 5, at this time, the text display data and teaching are displayed in the display screen. The client number, where the display of the lecturer client is shown in Figure 3b.
实施例四 Embodiment 4
图4为本发明实施例四提供的一种视频教学互动方法的流程图。本实施例提供的视频教学互动方法可以由视频教学互动装置执行,该视频教学互动装置可以通过软件和/或硬件的形式实现,并集成在可进行视频教学的设备中。其中, 该设备包括至少一个摄像头。FIG. 4 is a flowchart of a video teaching interaction method according to Embodiment 4 of the present invention. The video teaching interaction method provided by this embodiment may be implemented by a video teaching interaction device, which may be implemented in the form of software and/or hardware, and integrated in a device capable of video teaching. among them, The device includes at least one camera.
本实施例提供的视频教学互动方法适用于基于互联网的视频教学场景。在该场景下,至少两台可进行视频教学的设备中配置有至少一个视频教学软件,并通过互联网进行连接。其中一台设备被教师使用称为主讲客户端,其余设备被学生使用称为教学客户端。本实施例提供的视频教学互动方法在教学客户端中执行。The video teaching interaction method provided in this embodiment is applicable to an Internet-based video teaching scenario. In this scenario, at least two video teaching software devices are configured with at least one video teaching software and connected via the Internet. One of the devices is used by the teacher as the client client, and the rest of the device is used by the student as the teaching client. The video teaching interaction method provided in this embodiment is executed in the teaching client.
具体的,参考图4,本实施例提供的视频教学互动方法具体包括:Specifically, referring to FIG. 4, the video teaching interaction method provided in this embodiment specifically includes:
S410、在视频教学过程中,获取教学互动数据。S410. Obtain teaching interaction data in the video teaching process.
其中,教学互动数据包括视频数据和/或文本数据。视频数据为教学客户端通过至少一个摄像头拍摄学生听课画面得到的数据,文本数据为使用教学客户端的学生输入的文本数据,或者,教学客户端获取的学生输入的声音数据,并由教学客户端基于该声音数据得到的文本数据。一般而言,一个教学客户端可以被至少一个学生使用。Among them, the teaching interaction data includes video data and/or text data. The video data is data obtained by the teaching client by taking at least one camera to take a picture of the student's lecture, the text data is text data input by the student using the teaching client, or the voice data input by the student obtained by the teaching client, and is based on the teaching client The text data obtained from the sound data. In general, a teaching client can be used by at least one student.
进一步的,在视频教学过程中,实时获取视频数据。更进一步的,在视频教学过程中,实时获取文本数据,或者在接收到数据输入指令时,获取文本数据。其中,数据输入指令的具体形式本实施例不做限定。Further, in the video teaching process, video data is acquired in real time. Further, in the video teaching process, the text data is acquired in real time, or when the data input instruction is received, the text data is acquired. The specific form of the data input instruction is not limited in this embodiment.
S420、向主讲客户端发送教学互动数据,以使主讲客户端根据教学互动数据确定是否实现与教学客户端的交互。S420: Send teaching interaction data to the main client, so that the main client determines whether to implement interaction with the teaching client according to the teaching interaction data.
具体的,向主讲客户端发送教学互动数据后,由主讲客户端根据教学互动数据确认是否实现与教学客户端的交互,其中,确认是否交互的具体方法可以参照上述实施例。Specifically, after the teaching interaction data is sent to the main client, the interpreter client confirms whether to implement interaction with the teaching client according to the teaching interaction data, and the specific method for confirming whether the interaction is possible may refer to the above embodiment.
可选的,教学客户端在获取到教学互动数据后,也可以自行解析该教学互动数据,已确认当前使用的学生是否发出的交互请求,如果发出了交互请求, 则直接将交互请求和教学交互数据一同发送至讲师客户端中,以使讲师客户端根据交互请求直接确认需要交互的教学客户端。具体的,教学客户端获取视频数据后,解析该视频数据,以得到目标对象的动作轨迹,确认该动作轨迹是否为预设的交互动作轨迹,若是,则确认当前使用学生发出交互请求,并将交互请求发送和视频数据一同发送至讲师客户端。或者是,教学客户端获取文本数据后,解析该文本数据,以确认该文本数据是否为交互文本数据,如果是,则确认当前使用学生发出交互请求,并将交互请求发送和文本数据一同发送至讲师客户端。进一步的,讲师客户端根据交互请求和教学互动数据实现与对应教学客户端的交互。这样做的好处是可以减轻讲师客户端的数据处理量。Optionally, after obtaining the teaching interaction data, the teaching client may also parse the teaching interaction data by itself, and confirm whether the currently used student sends an interaction request, and if an interaction request is issued, The interaction request and the teaching interaction data are directly sent to the lecturer client, so that the lecturer client directly confirms the teaching client that needs to interact according to the interaction request. Specifically, after the teaching client obtains the video data, parsing the video data to obtain a motion track of the target object, confirming whether the motion track is a preset interaction motion track, and if yes, confirming that the current use student sends an interaction request, and The interactive request is sent along with the video data to the instructor client. Alternatively, after the teaching client obtains the text data, parsing the text data to confirm whether the text data is interactive text data, and if so, confirming that the current use student sends an interaction request, and sending the interaction request and the text data to the same. Lecturer client. Further, the lecturer client implements interaction with the corresponding teaching client according to the interaction request and the teaching interaction data. The benefit of this is that it reduces the amount of data processed by the instructor client.
本实施例提供的技术方案,通过获取教学互动数据,并将教学互动数据发送至讲师客户端,以使讲师客户端根据该教学互动数据实现与教学客户端的交互的技术方案,实现了在视频教学过程中,教学客户端与讲师客户端的交互,使得视频教学过程更加贴近面对面教学过程,提升了用户的使用体验。The technical solution provided by the embodiment realizes the video teaching by acquiring the teaching interaction data and transmitting the teaching interaction data to the lecturer client, so that the lecturer client realizes the interaction with the teaching client according to the teaching interaction data. In the process, the interaction between the teaching client and the lecturer client makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
实施例五 Embodiment 5
图5为本发明实施例五提供的一种视频教学互动装置的结构示意图。本实施例提供的视频教学互动装置包括:第一获取模块501、触发检测模块502以及交互执行模块503。FIG. 5 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 5 of the present invention. The video teaching interaction device provided in this embodiment includes: a first obtaining module 501, a trigger detecting module 502, and an interaction executing module 503.
其中,第一获取模块501,用于在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;触发检测模块502,用于基于教学互动数据检测教学互动机制是否被触发;交互执行模块503,用于若是,则选定触发教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。The first obtaining module 501 is configured to: obtain, in the video teaching process, the teaching interaction data sent by the at least one teaching client; the trigger detecting module 502, configured to detect whether the teaching interaction mechanism is triggered based on the teaching interaction data; and the interaction execution module 503. If yes, select at least one teaching client that triggers the teaching interaction mechanism and implement interaction with the selected teaching client.
本实施例提供的技术方案,通过在视频教学过程中,根据至少一个教学客 户端发送的教学互动数据确定教学互动机制是否被触发,如果被触发,则确定触发教学互动机制的至少一个教学客户端,并实现与确定的教学客户端的交互的技术方案,实现了在视频教学过程中讲师与学生的互动,使得视频教学过程更加贴近面对面教学过程,提升了用户的使用体验。The technical solution provided by this embodiment is based on at least one teaching guest in the video teaching process. The teaching interaction data sent by the client determines whether the teaching interaction mechanism is triggered. If triggered, the at least one teaching client that triggers the teaching interaction mechanism is determined, and the technical solution for interacting with the determined teaching client is realized, and the video teaching is realized. The interaction between the lecturer and the students in the process makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
在上述实施例的基础上,教学互动数据为视频数据,触发检测模块502包括:第一显示单元,用于在显示屏的子显示区域中显示视频数据,每个子显示区域对应显示一个教学客户端发送的视频数据;第一检测单元,用于检测子显示区域的显示画面是否满足预设显示条件。相应的,交互执行模块503具体用于:若是,则放大满足预设显示条件的显示画面,以实现与被放大的显示画面对应的教学客户端进行交互。On the basis of the above embodiment, the teaching interaction data is video data, and the trigger detection module 502 includes: a first display unit, configured to display video data in a sub-display area of the display screen, and each sub-display area correspondingly displays a teaching client. The transmitted video data; the first detecting unit is configured to detect whether the display screen of the sub display area meets the preset display condition. Correspondingly, the interaction execution module 503 is specifically configured to: if yes, enlarge the display screen that meets the preset display condition to implement interaction with the teaching client corresponding to the enlarged display screen.
在上述实施例的基础上,第一检测单元包括:画面识别子单元,用于识别子显示区域的显示画面,以获取显示画面中目标对象的动作轨迹;轨迹判断子单元,用于判断动作轨迹是否为预设的交互动作轨迹。On the basis of the above embodiment, the first detecting unit includes: a screen recognition subunit for identifying a display screen of the sub display area to acquire an action track of the target object in the display screen; and a track determining subunit for determining the motion track Whether it is a preset interactive action track.
在上述实施例的基础上,满足预设显示条件的显示画面为至少两个,交互执行模块503具体用于:若是,则同时放大至少两个满足预设显示条件的显示画面,以实现与被放大的显示画面对应的教学客户端进行交互;或,若是,则标记至少两个满足预设显示条件的显示画面,接收选择指令,并在至少两个满足预设显示条件的显示画面中放大与选择指令对应的显示画面,以实现与被放大的显示画面对应的教学客户端进行交互。On the basis of the foregoing embodiment, the display screens that meet the preset display conditions are at least two, and the interaction execution module 503 is specifically configured to: if yes, simultaneously enlarge at least two display screens that meet preset display conditions to achieve The teaching client corresponding to the enlarged display screen interacts; or, if so, at least two display screens satisfying the preset display condition are marked, receiving a selection instruction, and zooming in at least two display screens satisfying the preset display condition The display screen corresponding to the instruction is selected to implement interaction with the teaching client corresponding to the enlarged display screen.
在上述实施例的基础上,交互执行模块503具体用于:若是,则进行交互提示,并在接收到交互指令时,放大满足预设显示条件的显示画面。Based on the foregoing embodiment, the interaction execution module 503 is specifically configured to: if yes, perform an interaction prompt, and when receiving the interaction instruction, enlarge the display screen that meets the preset display condition.
在上述实施例的基础上,教学互动数据为文本数据,触发检测模块502具体用于:判断文本数据是否为交互文本数据。相应的,交互执行模块503包括: 文本识别单元,用于若是,则识别文本数据以确定文本显示数据以及对应的教学客户端;关联显示单元,用于关联显示文本显示数据以及教学客户端的属性信息。On the basis of the foregoing embodiment, the teaching interaction data is text data, and the trigger detection module 502 is specifically configured to: determine whether the text data is interactive text data. Correspondingly, the interaction execution module 503 includes: a text recognition unit, configured to: if yes, identify the text data to determine the text display data and the corresponding teaching client; the associated display unit is configured to associate the display text display data with the attribute information of the teaching client.
本发明实施例提供的视频教学互动装置可以用于执行上述实施例一至实施例三提供的视频教学方法,具备相应的功能和有益效果。The video teaching interaction device provided by the embodiment of the present invention can be used to perform the video teaching method provided in the foregoing Embodiments 1 to 3, and has corresponding functions and beneficial effects.
实施例六Embodiment 6
图6为本发明实施例六提供的一种视频教学互动装置的结构示意图。本实施例提供的视频教学互动装置可以用于执行实施例四提供的视频教学方法。具体的,参考图6,本实施例提供的视频教学互动装置包括:第二获取模块601和数据发送模块602。FIG. 6 is a schematic structural diagram of a video teaching interaction apparatus according to Embodiment 6 of the present invention. The video teaching interaction apparatus provided in this embodiment may be used to execute the video teaching method provided in the fourth embodiment. Specifically, referring to FIG. 6, the video teaching interaction apparatus provided in this embodiment includes: a second obtaining module 601 and a data sending module 602.
其中,第二获取模块601,用于在视频教学过程中,获取教学互动数据;数据发送模块602,用于向主讲客户端发送教学互动数据,以使主讲客户端根据教学互动数据确定是否实现与教学客户端的交互。The second obtaining module 601 is configured to obtain teaching interaction data in the video teaching process, and the data sending module 602 is configured to send the teaching interaction data to the main client, so that the main client determines whether to implement the interaction data according to the teaching interaction data. Teaching client interactions.
本实施例提供的技术方案,通过获取教学互动数据,并将教学互动数据发送至讲师客户端,以使讲师客户端根据该教学互动数据实现与教学客户端的交互的技术方案,实现了在视频教学过程中,教学客户端与讲师客户端的交互,使得视频教学过程更加贴近面对面教学过程,提升了用户的使用体验。The technical solution provided by the embodiment realizes the video teaching by acquiring the teaching interaction data and transmitting the teaching interaction data to the lecturer client, so that the lecturer client realizes the interaction with the teaching client according to the teaching interaction data. In the process, the interaction between the teaching client and the lecturer client makes the video teaching process closer to the face-to-face teaching process and enhances the user experience.
实施例七Example 7
图7为本发明实施例七提供的一种设备的结构示意图。如图7所示,该设备包括处理器70、存储器71、输入装置72、输出装置73以及通信装置74;设备中处理器70的数量可以是一个或多个,图7中以一个处理器70为例;设备 中的处理器70、存储器71、输入装置72、输出装置73以及通信装置74可以通过总线或其他方式连接,图7中以通过总线连接为例。FIG. 7 is a schematic structural diagram of a device according to Embodiment 7 of the present invention. As shown in FIG. 7, the device includes a processor 70, a memory 71, an input device 72, an output device 73, and a communication device 74. The number of processors 70 in the device may be one or more, and one processor 70 in FIG. As an example; equipment The processor 70, the memory 71, the input device 72, the output device 73, and the communication device 74 may be connected by a bus or the like, and the bus connection is taken as an example in FIG.
存储器71作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例一至实施例三中的视频教学互动方法对应的程序指令/模块(例如,第一获取模块501、触发检测模块502和交互执行模块503)。处理器70通过运行存储在存储器71中的软件程序、指令以及模块,从而执行设备的各种功能应用以及数据处理,即实现上述的视频教学互动方法。The memory 71 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the video teaching interaction method in Embodiments 1 to 3 of the present invention (for example, the first The acquisition module 501, the trigger detection module 502, and the interaction execution module 503). The processor 70 executes various functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 71, that is, implementing the video teaching interaction method described above.
存储器71可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据设备的使用所创建的数据等。此外,存储器71可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器71可进一步包括相对于处理器70远程设置的存储器,这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 71 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Further, the memory 71 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 71 may further include memory remotely located relative to processor 70, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
输入装置72可用于接收输入的数字或字符信息,以及产生与设备的用户设置以及功能控制有关的键信号输入。输出装置73可包括显示屏等显示设备。通信装置74可用于与至少一个教学客户端建立视频连接,并接收至少一个教学客户端发送的教学互动数据。 Input device 72 can be used to receive input digital or character information and to generate key signal inputs related to user settings and function control of the device. The output device 73 may include a display device such as a display screen. The communication device 74 can be configured to establish a video connection with the at least one teaching client and receive the teaching interaction data sent by the at least one teaching client.
本发明实施例提供的设备可以执行上述实施例一至实施例三提供的视频教学方法,具备相应的功能和有益效果,具备相应的功能和有益效果。The device provided by the embodiment of the present invention can perform the video teaching method provided in the foregoing Embodiments 1 to 3, and has corresponding functions and beneficial effects, and has corresponding functions and beneficial effects.
实施例八Example eight
图8为本发明实施例八提供的一种设备的结构示意图。如图8所示,该设 备包括处理器80、存储器81、输入装置82、输出装置83以及通信装置84;设备中处理器80的数量可以是一个或多个,图8中以一个处理器80为例;设备中的处理器80、存储器81、输入装置82、输出装置83以及通信装置84可以通过总线或其他方式连接,图8中以通过总线连接为例。FIG. 8 is a schematic structural diagram of a device according to Embodiment 8 of the present invention. As shown in Figure 8, the design The processor 80, the memory 81, the input device 82, the output device 83, and the communication device 84 are included; the number of processors 80 in the device may be one or more, and one processor 80 is taken as an example in FIG. 8; processing in the device The device 80, the memory 81, the input device 82, the output device 83, and the communication device 84 may be connected by a bus or the like, and the bus connection is taken as an example in FIG.
存储器81作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例四中的视频教学互动方法对应的程序指令/模块(例如,第二获取模块601和数据发送模块602)。处理器80通过运行存储在存储器81中的软件程序、指令以及模块,从而执行设备的各种功能应用以及数据处理,即实现上述的视频教学互动方法。The memory 81 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the video teaching interaction method in Embodiment 4 of the present invention (for example, the second acquisition module 601). And data sending module 602). The processor 80 executes various functional applications and data processing of the device by executing software programs, instructions, and modules stored in the memory 81, that is, implementing the video teaching interaction method described above.
存储器81可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据设备的使用所创建的数据等。此外,存储器81可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器81可进一步包括相对于处理器80远程设置的存储器,这些远程存储器可以通过网络连接至设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 81 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Further, the memory 81 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 81 may further include memory remotely located relative to processor 80, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
输入装置82可用于接收输入的数字或字符信息,以及产生与设备的用户设置以及功能控制有关的键信号输入。输出装置83可包括显示屏等显示设备。通信装置84可用于与讲师客户端建立视频连接,并向讲师客户端发送的教学互动数据。 Input device 82 can be used to receive input numeric or character information and to generate key signal inputs related to user settings and function controls of the device. The output device 83 may include a display device such as a display screen. The communication device 84 can be used to establish a video connection with the instructor client and to communicate interactive teaching data to the instructor client.
本发明实施例提供的设备可以执行上述实施例四提供的视频教学方法,具备相应的功能和有益效果,具备相应的功能和有益效果。 The device provided by the embodiment of the present invention can perform the video teaching method provided in the foregoing fourth embodiment, and has corresponding functions and beneficial effects, and has corresponding functions and beneficial effects.
实施例九Example nine
本发明实施例九还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行一种视频教学互动方法,该视频教学互动方法包括:Embodiment 9 of the present invention further provides a storage medium including computer executable instructions for executing a video teaching interaction method when executed by a computer processor, the video teaching interaction method comprising:
在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;In the video teaching process, obtaining teaching interaction data sent by at least one teaching client;
基于教学互动数据检测教学互动机制是否被触发;Detecting whether the teaching interaction mechanism is triggered based on the teaching interaction data;
若是,则选定触发教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。If so, at least one teaching client that triggers the teaching interaction mechanism is selected and interacts with the selected teaching client.
当然,本发明实施例所提供的一种包含计算机可执行指令的存储介质,其计算机可执行指令不限于如上所述的视频教学互动方法操作,还可以执行本发明任意实施例一至实施例三所提供的视频教学互动方法中的相关操作,具备相应的功能和有益效果。Certainly, the storage medium containing the computer executable instructions provided by the embodiment of the present invention is not limited to the video teaching interaction method operation as described above, and may also perform any of the first embodiment to the third embodiment of the present invention. The related operations in the video teaching interaction method provided have corresponding functions and beneficial effects.
通过以上关于实施方式的描述,所属领域的技术人员可以清楚地了解到,本发明可借助软件及必需的通用硬件来实现,当然也可以通过硬件实现,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明实施例一至实施例三所述的视频教学互动方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The video teaching interaction method according to the first embodiment to the third embodiment of the present invention is implemented by using a server, a network device, or the like.
实施例十 Example ten
本发明实施例十还提供一种包含计算机可执行指令的存储介质,所述计算机可执行指令在由计算机处理器执行时用于执行实施例四提供的一种视频教学互动方法,具备相应的功能和有益效果。其中,该视频教学互动方法包括:The tenth embodiment of the present invention further provides a storage medium including computer executable instructions, which are executed by a computer processor to execute a video teaching interaction method provided in Embodiment 4, and have corresponding functions. And beneficial effects. Among them, the video teaching interaction method includes:
在视频教学过程中,获取教学互动数据;In the process of video teaching, obtain teaching interaction data;
向主讲客户端发送所述教学互动数据,以使主讲客户端根据教学互动数据确定是否实现与教学客户端的交互。Sending the teaching interaction data to the presenting client, so that the presenting client determines whether to implement interaction with the teaching client according to the teaching interaction data.
通过以上关于实施方式的描述,所属领域的技术人员可以清楚地了解到,本发明可借助软件及必需的通用硬件来实现,当然也可以通过硬件实现,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明实施例四所述的视频教学互动方法。Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The video teaching interaction method described in Embodiment 4 of the present invention is implemented by a server, a network device, or the like.
值得注意的是,上述视频教学互动装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It should be noted that, in the embodiment of the video teaching interaction device, each unit and module included is only divided according to functional logic, but is not limited to the above division, as long as the corresponding function can be implemented; The specific names of the respective functional units are also for convenience of distinguishing from each other and are not intended to limit the scope of protection of the present invention.
注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽 然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。 Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, though The present invention is described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the scope of the present invention. It is determined by the scope of the appended claims.

Claims (13)

  1. 一种视频教学互动方法,其特征在于,包括:A video teaching interaction method, which is characterized in that:
    在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;In the video teaching process, obtaining teaching interaction data sent by at least one teaching client;
    基于所述教学互动数据检测教学互动机制是否被触发;Detecting whether the teaching interaction mechanism is triggered based on the teaching interaction data;
    若是,则选定触发所述教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。If so, at least one teaching client that triggers the teaching interaction mechanism is selected and interacts with the selected teaching client.
  2. 根据权利要求1所述的视频教学互动方法,其特征在于,所述教学互动数据为视频数据,The video teaching interaction method according to claim 1, wherein the teaching interaction data is video data.
    所述基于所述教学互动数据检测教学互动机制是否被触发包括:The detecting, based on the teaching interaction data, whether the teaching interaction mechanism is triggered comprises:
    在显示屏的子显示区域中显示所述视频数据,每个子显示区域对应显示一个所述教学客户端发送的所述视频数据;Displaying the video data in a sub-display area of the display screen, where each sub-display area correspondingly displays the video data sent by the teaching client;
    检测所述子显示区域的显示画面是否满足预设显示条件;Detecting whether a display screen of the sub display area meets a preset display condition;
    相应的,所述若是,则选定触发所述教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互包括:Correspondingly, if yes, selecting at least one teaching client that triggers the teaching interaction mechanism, and implementing interaction with the selected teaching client includes:
    若是,则放大满足预设显示条件的显示画面,以实现与被放大的显示画面对应的教学客户端进行交互。If so, the display screen that satisfies the preset display condition is enlarged to implement interaction with the teaching client corresponding to the enlarged display screen.
  3. 根据权利要求2所述的视频教学互动方法,其特征在于,所述检测所述子显示区域的显示画面是否满足预设显示条件包括:The video teaching interaction method according to claim 2, wherein the detecting whether the display screen of the sub-display area satisfies the preset display condition comprises:
    识别所述子显示区域的显示画面,以获取所述显示画面中目标对象的动作轨迹;Identifying a display screen of the sub display area to acquire an action track of the target object in the display screen;
    判断所述动作轨迹是否为预设的交互动作轨迹。Determining whether the motion track is a preset interaction motion track.
  4. 根据权利要求2所述的视频教学互动方法,其特征在于,所述满足预设显示条件的显示画面为至少两个,The video teaching interaction method according to claim 2, wherein the display screen that satisfies the preset display condition is at least two.
    所述放大满足预设显示条件的显示画面包括: The displaying a display screen that satisfies the preset display condition includes:
    同时放大至少两个所述满足预设显示条件的显示画面;或,Simultaneously magnifying at least two of the display screens that satisfy the preset display condition; or
    标记至少两个所述满足预设显示条件的显示画面,接收选择指令,并在至少两个所述满足预设显示条件的显示画面中放大与所述选择指令对应的显示画面。Marking at least two of the display screens satisfying the preset display condition, receiving a selection instruction, and enlarging the display screen corresponding to the selection instruction in at least two of the display screens satisfying the preset display condition.
  5. 根据权利要求2所述的视频教学互动方法,其特征在于,所述放大满足预设显示条件的显示画面包括:The video teaching interaction method according to claim 2, wherein the displaying the display screen that satisfies the preset display condition comprises:
    进行交互提示,并在接收到交互指令时,放大满足预设显示条件的显示画面。The interactive prompt is performed, and when the interactive instruction is received, the display screen that satisfies the preset display condition is enlarged.
  6. 根据权利要求1所述的视频教学互动方法,其特征在于,所述教学互动数据为文本数据,The video teaching interaction method according to claim 1, wherein the teaching interaction data is text data.
    所述基于所述教学互动数据检测教学互动机制是否被触发包括:The detecting, based on the teaching interaction data, whether the teaching interaction mechanism is triggered comprises:
    判断所述文本数据是否为交互文本数据;Determining whether the text data is interactive text data;
    相应的,所述若是,则选定触发教学互动机制的至少一个教学客户端包括:Correspondingly, if yes, selecting at least one teaching client that triggers the teaching interaction mechanism comprises:
    若是,则识别所述文本数据以确定文本显示数据以及对应的教学客户端;If yes, identifying the text data to determine text display data and a corresponding teaching client;
    关联显示所述文本显示数据以及所述教学客户端的属性信息。The text display data and the attribute information of the teaching client are displayed in association.
  7. 一种视频教学互动方法,其特征在于,包括:A video teaching interaction method, which is characterized in that:
    在视频教学过程中,获取教学互动数据;In the process of video teaching, obtain teaching interaction data;
    向主讲客户端发送所述教学互动数据,以使所述主讲客户端根据所述教学互动数据确定是否实现与教学客户端的交互。Sending the teaching interaction data to the presenting client, so that the speaking client determines whether to implement interaction with the teaching client according to the teaching interaction data.
  8. 一种视频教学互动装置,其特征在于,包括:A video teaching interaction device, comprising:
    第一获取模块,用于在视频教学过程中,获取至少一个教学客户端发送的教学互动数据;a first obtaining module, configured to acquire teaching interaction data sent by at least one teaching client during a video teaching process;
    触发检测模块,用于基于所述教学互动数据检测教学互动机制是否被触发; a trigger detection module, configured to detect, according to the teaching interaction data, whether a teaching interaction mechanism is triggered;
    交互执行模块,用于若是,则选定触发教学互动机制的至少一个教学客户端,并实现与选定的教学客户端的交互。The interactive execution module is configured to, if yes, select at least one teaching client that triggers the teaching interaction mechanism and implement interaction with the selected teaching client.
  9. 一种视频教学互动装置,其特征在于,包括:A video teaching interaction device, comprising:
    第二获取模块,用于在视频教学过程中,获取教学互动数据;a second obtaining module, configured to acquire teaching interaction data during a video teaching process;
    数据发送模块,用于向主讲客户端发送所述教学互动数据,以使所述主讲客户端根据所述教学互动数据确定是否实现与教学客户端的交互。The data sending module is configured to send the teaching interaction data to the main client, so that the main client determines whether to implement interaction with the teaching client according to the teaching interaction data.
  10. 一种设备,其特征在于,包括:An apparatus, comprising:
    一个或多个处理器;One or more processors;
    存储器,用于存储一个或多个程序;a memory for storing one or more programs;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-6任一所述的视频教学互动方法。When the one or more programs are executed by the one or more processors, the one or more processors implement the video teaching interaction method of any of claims 1-6.
  11. 一种设备,其特征在于,包括:An apparatus, comprising:
    一个或多个处理器;One or more processors;
    存储器,用于存储一个或多个程序;a memory for storing one or more programs;
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求7所述的视频教学互动方法。The one or more programs are executed by the one or more processors such that the one or more processors implement the video teaching interaction method of claim 7.
  12. 一种包含计算机可执行指令的存储介质,其特征在于,所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求1-6中任一所述的视频教学互动方法。A storage medium comprising computer executable instructions, the computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method of any of claims 1-6.
  13. 一种包含计算机可执行指令的存储介质,其特征在于,所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求7所述的视频教学互动方法。 A storage medium comprising computer executable instructions, the computer executable instructions, when executed by a computer processor, for performing the video teaching interaction method of claim 7.
PCT/CN2017/116770 2017-08-17 2017-12-17 Video teaching interaction method and apparatus, device, and storage medium WO2019033663A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710707253.6 2017-08-17
CN201710707253.6A CN107316520B (en) 2017-08-17 2017-08-17 Video teaching interaction method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2019033663A1 true WO2019033663A1 (en) 2019-02-21

Family

ID=60177104

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/116770 WO2019033663A1 (en) 2017-08-17 2017-12-17 Video teaching interaction method and apparatus, device, and storage medium

Country Status (2)

Country Link
CN (1) CN107316520B (en)
WO (1) WO2019033663A1 (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107316520B (en) * 2017-08-17 2020-10-02 广州视源电子科技股份有限公司 Video teaching interaction method, device, equipment and storage medium
CN107967830A (en) * 2018-01-08 2018-04-27 广州视源电子科技股份有限公司 Method, apparatus, equipment and the storage medium of online teaching interaction
CN108629714A (en) * 2018-05-10 2018-10-09 北京快校科技有限公司 Online teaching interactive processing method, apparatus and server
CN109101161B (en) * 2018-08-24 2021-06-18 北京新界教育科技有限公司 Display method and device
CN109817047B (en) * 2019-02-13 2021-09-10 北京谦仁科技有限公司 Interaction method and device for online class and electronic equipment
CN109872588A (en) * 2019-02-28 2019-06-11 北京谦仁科技有限公司 A kind of interactive approach of online class, apparatus and system
CN110059661B (en) * 2019-04-26 2022-11-22 腾讯科技(深圳)有限公司 Action recognition method, man-machine interaction method, device and storage medium
CN110334626B (en) * 2019-06-26 2022-03-04 北京科技大学 Online learning system based on emotional state
CN110570698B (en) * 2019-08-21 2022-04-26 北京大米科技有限公司 Online teaching control method and device, storage medium and terminal
CN112287767A (en) * 2020-09-30 2021-01-29 北京大米科技有限公司 Interaction control method, device, storage medium and electronic equipment
CN112286610A (en) * 2020-10-28 2021-01-29 北京有竹居网络技术有限公司 Interactive processing method and device, electronic equipment and storage medium
CN112767757A (en) * 2021-01-29 2021-05-07 中南大学 Computer multimedia interactive teaching management system and teaching management method
CN112995132B (en) * 2021-02-01 2023-05-02 百度在线网络技术(北京)有限公司 Online learning interaction method and device, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001337589A (en) * 2000-05-26 2001-12-07 Tricore International Inc Remote education system
JP2005055846A (en) * 2003-08-01 2005-03-03 Tottori Prefecture Remote educational communication system
CN103281347A (en) * 2013-03-29 2013-09-04 吴晗 Network interaction system
CN105447795A (en) * 2015-12-31 2016-03-30 米科互动教育科技(北京)有限公司 Online curriculum processing method and device
CN105551330A (en) * 2015-12-25 2016-05-04 北京荣之联科技股份有限公司 Cloud classroom system
CN106774894A (en) * 2016-12-16 2017-05-31 重庆大学 Interactive teaching methods and interactive system based on gesture
CN107316520A (en) * 2017-08-17 2017-11-03 广州视源电子科技股份有限公司 Video teaching interactive approach, device, equipment and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106683506A (en) * 2017-02-20 2017-05-17 管斌彬 Audio and video interaction system for network teaching platform
CN106991850A (en) * 2017-04-26 2017-07-28 广东小天才科技有限公司 The sharing method and device of a kind of operation layout process

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001337589A (en) * 2000-05-26 2001-12-07 Tricore International Inc Remote education system
JP2005055846A (en) * 2003-08-01 2005-03-03 Tottori Prefecture Remote educational communication system
CN103281347A (en) * 2013-03-29 2013-09-04 吴晗 Network interaction system
CN105551330A (en) * 2015-12-25 2016-05-04 北京荣之联科技股份有限公司 Cloud classroom system
CN105447795A (en) * 2015-12-31 2016-03-30 米科互动教育科技(北京)有限公司 Online curriculum processing method and device
CN106774894A (en) * 2016-12-16 2017-05-31 重庆大学 Interactive teaching methods and interactive system based on gesture
CN107316520A (en) * 2017-08-17 2017-11-03 广州视源电子科技股份有限公司 Video teaching interactive approach, device, equipment and storage medium

Also Published As

Publication number Publication date
CN107316520A (en) 2017-11-03
CN107316520B (en) 2020-10-02

Similar Documents

Publication Publication Date Title
WO2019033663A1 (en) Video teaching interaction method and apparatus, device, and storage medium
US10805365B2 (en) System and method for tracking events and providing feedback in a virtual conference
US10630738B1 (en) Method and system for sharing annotated conferencing content among conference participants
CN110570698B (en) Online teaching control method and device, storage medium and terminal
JP5195106B2 (en) Image correction method, image correction system, and image correction program
CN110568984A (en) Online teaching method and device, storage medium and electronic equipment
WO2022089192A1 (en) Interaction processing method and apparatus, electronic device, and storage medium
CN110136032B (en) Classroom interaction data processing method based on courseware and computer storage medium
KR20200057562A (en) System and method for multi-way interactive lecture
WO2016012751A1 (en) A chat system
US20170323574A1 (en) Contemporaneous capture and tagging of media evidence for education evaluation
US20210382675A1 (en) System and method of organizing a virtual classroom setting
JP7119615B2 (en) Server, sound data evaluation method, program, communication system
CN115206150B (en) Scenario experience-based teaching method, apparatus, device and storage medium
US20220150290A1 (en) Adaptive collaborative real-time remote remediation
KR20140117170A (en) Method of providing question and answer service and server thereof
KR101845390B1 (en) Online learning coaching apparatus and method based on learning video file obtained using electronic pen
KR20220067402A (en) Interactive internet real-time lecture system and lecture method using the same
CN115052194B (en) Learning report generation method, device, electronic equipment and storage medium
US11949727B2 (en) Organic conversations in a virtual group setting
JP5833280B1 (en) Learning support device, learning support system, and learning support method
JP7194554B2 (en) Communication systems and programs
CN112181334A (en) Remote interactive networking teaching method and electronic equipment
Pardon An Extensible Presentation Framework for Real-time Data Acquisition, Interaction and Augmented Reality Visualisations
Sindoni The repurposing of gaze in video-mediated spaces: Implications for designing learning

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17921943

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17921943

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 19/10/2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17921943

Country of ref document: EP

Kind code of ref document: A1